I have a friend who took over a many centred parish a few years ago, he is kind, he is gentle, he his mild. His liturgical and theological orientation is strictly "Benedictine", it is not because it is his personal taste but because he has read the documents and understands that that is the taste of the Church.
His parish had a succession of priests many of whom were nationally known for their avante guard opinions. Most of his parishioners, the vast majority welcomed him, a small handful were difficult at first but gradually, little by little, by returning kindness for rudeness he won them over.
Privately he would tell me about the pain he was going through, the sleepless nights, the feelings of nausea before parish meetings which were so often occasions for public acts of contempt, the venomous untruthful letters to the bishop, the snide suggestions, his visits to the doctor, the pills he was on etc. I suggested on several occasions he should simply say, "I am the parish priest, if you really don't like it, go elsewhere, I have had enough!"
He always replied, "But if they don't come here, they might not go anywhere and be lost".
Behind it all in his theology of priesthood, traditional Catholic theology; each and every "soul" is of supreme value, that souls could be saved or lost by a priest, the priest is there to gather in the lost sheep. Suffering is part of priesthood. The priest is the servant of Christ in the local Church, he is there to lead them to salvation rather than to an ideology of his personal choice.
When I was going through similar difficulties myself a more liberal priest than Fr X told me, "Tell them to ******* off, I would. When I came to St ___, a third of the congregation left, good riddance, I won't put up with trouble makers!"