I've been there, it's very frustrating!
I don't think it's harmful to the fish. When it happened in my tank I bought one of those algae magnets to scrape the glass, which worked well with regular cleaning. I also took ornaments with heavy growth and put them in a bleach solution for an hour or so, then rinsed them
well and placed them in the tank again, it's amazing how well that worked.
It's a frustrating problem, good luck with it!
Chrissy