Volcanic stone is inert - in the way you are worrying about. And it is a common thing to use in fish tanks. BUT - and it is a big BUT - goldies (or any fish with delicate flowing tails or protruding eyes, etc.) are rather delicate. A sharp surfaced stone can easily catch and tear delicate finnage, scratch eyes, or pop scales. If the fish decide to "get frisky", the males can drive a female and body check her into the glass and everything in the tank. A female, being slammed into a sharp stone would definately not come out in good shape.
Volcanic stone, because it has sooooo many pores is GREAT for biological platforms - the surface area is amazing. But because of those pores, small pieces of stone and sand and stuff can hide - and be nearly impossible to get out of the stone. I am sure with much rinsing and shaking and such, the majority can be removed, however.
If you can return this stone, I would recommend it. It is really not a safe ornament for use in a fancy goldfish tank. IF you cannot return it, it can be very valuable for biological media. Take a hammer and smash it into smaller chunks. Those chunks, used in your filter, will be a marvelous platform for beneficial bacteria.