But do I have to?
Yes! WordPress is increasingly using more and more JS, whether in the admin, themes, or plugins.
And the current priorities for WordPress development — customization, the editing experience, and the REST API — all require JS.
So, if you want to develop for WordPress, learning JS in addition to PHP is a necessity.