Sweetmx85- I hope your baby feels better soon. I understand what you mean about wanting to take him to the ER. Sick children (especially when they are so small) always look so pitiful when they aren't feeling well. If you want to take him to the hospital, I'd say do it. It can't hurt and it may help so you can't lose. Who cares if it turns out to be unnecessary and you were "overreacting", it's your baby!
102.5 is on quite high in my opinion. I can't remember what is normally thought of as needing immediate/emergency care but I think it's somewhere between 104-106 (I think that may be for adults though)???
Your husband is right about the hot/cold thing. It was actually mentioned in my physiology class the other day!