There's a big difference between convicting someone, which involves a burden of proof, and being a parent, which involves a whole lot less faith in others.
I hope you never have a loved one wrongly accused, because the "convict him, lock him up, throw away the key" attitude is what will mean they get locked up undeservedly.
I think he's most likely guilty. That doubt would make me keep any kids away from him! At the same time, I will not call him guilty until a jury does so.