If it makes you feel better to distance yourself from this guy by inventing your own personal definition of the word pedophile and making sure people you want distance from can't fit that definition, then by all means go ahead.

I, on the other hand, find that practice to be a little dishonest. I think the only real difference between someone like this guy and someone like us is the choices that we made. I have no problem with calling him a pedophile (if it turns out that he is, which we still don't know for sure since he hasn't been accused of any sex crimes).