If you say the pity is that, or the pity of it is that, before a comment, you are emphasizing your disappointment or regret about something.
[emphasis] The pity is that it was all completely unnecessary.
The pity of it was that the Americans didn't play cricket.