An open-mouth jar sterilized with alcohol doesn't need rinsing. You inspired me to try Mason jars for FSG - and I like them!
The alcohol evaporates. But any narrow-mouth plastic bottle that you can't get all the alcohol out of (or if you used bleach) needs rinsing. I like bleach better for plastics.