“An Englishman thinks he is moral when he is only uncomfortable.”

Shaw's joke is that the English moral reputation rests on being uncomfortable rather than on being good, which is a jab at a national self-image. The line is quoted whenever somebody describes the English as priggish without being able to say exactly why.