RewriteRule in .htaccess only works when query string is present for only one among dozens of redirects

Question

I have the following lines in my ".htaccess":

RewriteEngine On
RewriteBase "/my-folder/"
RewriteRule  "^my\\-page(?:|\\.php)$"