if Godly people are unanimously telling you that you are mistaken in your perception that God called you to do X, then you should listen and go back and pray about it some more.

Sure. But it depends on why they are saying it. If they are saying it because of the quality of the work you do, that's one thing. If they are saying it because of a prejudice brought on by knowledge they should never have been entrusted with, it's another.

Knowledge that you are a pedophile is likely to blind all but the most Godly of people to the quality of the work you do. Even those most Godly people may decide that due to insurance/security requirements, leaving you in that position isn't worth the risk.

Let people judge you for who you are and for the work you do, not for their stereotypes and prejudices about what a pedophile is and what motivates them.