It's individual for everyone, but mineral oil is basically liquid petroleum jelly. Go stick your finger in some vaseline and see how easily it's removed. It's scary!

You can always try it and look for signs of buildup (limpness, increased frizz, gunkiness, producty feel or appearance, hair that "just won't do anything").