To save appearances

to preserve a fair outward show.
to preserve a decent outside; to avoid exposure of a discreditable state of things.

See also: Appearance, Save