Yoga is one of the six āstika ("orthodox") schools of Hindu philosophy.

I'm not sure how you would practice yoga w/o practicing Hinduism. From the goals of yoga to the physical poses, it's all based on spirtualism and worship.