I think it really depends on how strong your hair is and how tight you're putting the ponytail. It's too bad scrunchies aren't in fashion because those seem really gentle
But, I don't think you'll have a problem, as long as you're not yanking on your hair and keeping it healthy.

You could try clips too for pinning hair up or back.
CG Birthday: 7/25/11
Type 3a/2c
Dense, Fine in front Coarse in back, Low porosity
Low-Poo: SM Moisture Retention Shampoo
Rinse Out: Tresemme Naturals
Leave In: ^^^^
Stylers: AIF, Natural Silks Curly Gel
*Desert Curly*