There’s a long list of caveats when running VS Code over SSH. By comparison, text editors:

• Work on Alpine remotes
• Work on older distributions, and other *NIX systems
• Have no problems with SSH key passphrases or security keys
• Only require a few MB of memory
• When run in tmux are largely resilient to SSH connection issues

If you frequently work on remote systems you frequently only get command line access, where you can still use vim/nano/emacs but not a full IDE like VS Code. In that case you might find it more convenient to learn one text editor well and forgo the IDE.