Well,
You didn't say which tank was experiencing a drop, so I'd guess your goldfish are causing the drop in KH, which is understandable because they poop and pee so much. From my reading, the nitrogen cycle is an acidic process, so pH will eventually be dragged down, expecially if there is a lot of ammonia to process.
Your KH from the tap is pretty low, so I'd expect your pH to drop with time. You definitely don't want this to happen.
Are you using any KH/pH buffers? How does the pH of the tank compare to tap water? Does it differ before and after water changes?
If you aren't already using a pH/KH buffer, I'd suggest you add a level teaspoon of baking soda per 20g of tank water. Mix it with the tank water before pouring it in.
Do post back with your findings.
Slugger