There will always be some people you don't get along with. Just ignore those people. If it starts becoming the majority of the congregation, then I'd start thinking about going to a different church. But for just one or two families, it's not that big a deal. So what if they don't like you, that's their problem.