It's mold. I usually wait it out if it doesn't get too bad, and the mold will eventually die off in one to three weeks. You can also wash it off or soak it in saltwater to get rid of it right now, but that usually discolors the moss and causes it to get funky faster.
Want to see all my crazy pets? @waywardwaifs on Instagram