Doing nothing still counts as taking a side
Imagine the President does something that goes against the Constitution. Congress is supposed to step in and stop it — that’s their job. But if Congress chooses not to act, and the people who work for the President go ahead and carry out the unconstitutional action, then Congress is basically allowing it to happen.
Not acting doesn’t keep them “neutral.” It actually helps the action move forward.