You can use other items as substitutes, such as coins, buttons, or even pieces of paper. Each player can agree on the value of these items and use them as currency during the game. Another option is to use a deck of playing cards as a form of currency, with each card representing a certain value.
The short answer is yes  poker still falls under the category of gambling, despite its status as a game of skill.