Press the Esc key on the keyboard to close the active side panels. The active panel is the one that has keyboard focus. When the panel is closed, keyboard focus is automatically given to the main editor.
If none of the open panels has keyboard focus, all of them are closed. To quickly close all panels at any time, simply press the Esc key twice.