If your goldfish are happy don't worry about it
GH is a measure of calcium and/or magnesium in your water. As far as goldfish are concerned they can tolerate any level of GH. It's impact is minimal on goldfish whether it is very low or very high. Low GH or high GH will not cause any problems in your tank. (unless you keep invertebrates like snails) The only concern about GH is maintaing a consistent level. Just like any other water parameter, fluctuations of GH could be stressful to the fish (although if there was one I chose to lose control of it would be GH)
The more important measure for your tank is KH or carbonate hardness (sometimes referred to as alkalinity, or buffering capacity). KH testing measures the amount of carbonate ion in your tank. Carbonate is important because it buffers the pH of the aquarium. A tank with sufficent KH (4dKH or 70ppm) will effectively prevent the pH from changing rapidly and harming the fish.
Check out this link for a comprehensive discussion about KH, GH, and pH:
Click hereCrushed coral (calcium carbonate) or Epsom Salts (Magnesium Sulfate) will raise GH