You use fair in expressions such as to be fair and let's be fair when you want to add a favourable comment about someone or something that you have just mentioned and to correct a false impression that you might have given.
To be fair, the team is young and not yet settled.
And, let us be fair, some MPs do work hard.