I have had
serious problems with goldfish choking on gravel, a few members have even had goldies die after swallowing it

The best thing you can do is have large river rocks, the fish can't get them in their mouths. Also, this makes keeping the tank clean MUCH easier. I went with this route, and put my plants in containers, here's a pic