Had to look this up as well. Its not rm specific:

* is a simple, non-recursive wildcard representing zero or more characters which you can use for paths and file names. ** is a recursive wildcard that can only be used with paths, not file names.

More here.