let something/someone slide
to not do anything about something or someone when you should try to change or correct that thing or person:
I knew he wasn’t telling me everything, but I decided to let it slide.
It’s easy to let exercise slide in the suburbs where you have to drive your car all the time.