Oh, yes, definitely rinse it out. The first time I tried the honey rinse, I didn't rinse thoroughly enough, and I wound up with a sticky, stringy mop that attracted all manner of flying insects. I like to mix honey with my conditioner, leave it in for a few minutes while I shave my legs, and then rinse it out.