or more simply:

rm -- -

will work.

the double hyphen is useful for several commands; it basically informs that there are no more switches, but to treat the rest of input as args