I think it really depends on how strong your hair is and how tight you're putting the ponytail. It's too bad scrunchies aren't in fashion because those seem really gentle
But, I don't think you'll have a problem, as long as you're not yanking on your hair and keeping it healthy.
You could try clips too for pinning hair up or back.
CG Birthday: 7/25/11
Dense, Fine in front Coarse in back, Low porosity
Low-Poo: SM Moisture Retention Shampoo
Rinse Out: Tresemme Naturals
Leave In: ^^^^
Stylers: AIF, Natural Silks Curly Gel