Celibacy, for men, is a difficult row to hoe; the whole magical, completing part of your existence that people look for in a loving relationship has to come from elsewhere. The prevalent solution, traditionally, is a very peaceful life consisting mainly of ecstatic meditation, mixed with some physical chores -- the monastic life, as seen in catholicism, orthodoxy and buddhism. Meditation, which the orthodox and the buddhists particularly developed, is one of the few viable substitutes for a loving sex life, and it takes time and concentration. (Other viable pathways of celibacy include expression of artistic or other creative genius, and intense involvement with either kids or animals -- and you can see which one of those Benedict would not go for in the current catholic context).

Knocking about in the day to day world as a regular working joe is vey much at odds with celibacy, unless there is some definite relief like having a YF to pour love into.

I think denominations that want sexual minorities to be both celibate and away from children should provide the necessary hermitage facilities, desert monasteries and that sort of thing. The Coptic church supports a good number of desert monasteries, and they're not especially rich, so why shouldn't the Catholic church. Catholics recently have had the notion that monasteries should be for ordained people, but clearly they also need to provide them for their non-ordainable celibates, who will need many hours of seclusion for prayer and meditation.