Please pardon my ignorance, but can you get kicked out of church? I would go to church with BIL and the entire family as a sign of solidarity to let thoes people know you all aren't ashamed of anything. I don't know, I think people would make more assumptions if you all stopped going. Like you were hiding from something.
But like I said, I don't know what church you go to and I could be talking out of turn. Sorry if I am.