It’s absolutely authoritarian. You’re an idiot if you think otherwise. I’m not even going to offer an argument, you’re just stupid.

If you do want to open 22, and there are plenty of good reasons to want to, just implement something called port knocking and you can do it safely.

Note with this you still need good authentication. That means no passwords, key based auth only.