Did you buy" river rocks" at the craft store? If you did they are perfect! You can get big bags at the dollar store too. Much cheaper...
How long has your filter been set up, and when was your last maintenance done? While it is true that there is some bacteria in your gravel, 80% of your bio-bed is in your filter. If you have a mature filter pad and have not done any filter maintenance lately(i.e. cleaning or changing the pad) then I wouldn't worry about it. If you've done filter maintenance this week:
1. Make sure the gravel is REALLY clean. Do a DEEP gravel cleaning until nothing is stirred up when you finish. Do it over a few days in need be.
You don't want all that mulm floating around and choking your fish. This will also ensure that there are no anaerobic pockets that could instantly kill your fish. Anaerobic organisms need no oxygen to survive. Anaerobic pockets are usually found in deep gravel beds that are not vacuumed to the bottom of the tank. They also appear under decorations. That's why you should always lift tank decor to vacuum under.
When you "break" one of these pockets the result is death for everything in the tank. Deep gravel cleaning ensures that the "pocket" will go up the syphon instead of into the tank.
2. Remove gravel and replace with river rock. If you are worried about your bi-bed then try this:
Take about 1/3 of your existing gravel and place it into a pair of knee high panyhose. I kid you not. Buy new socks so you don't have to worry about any soap.
Tie off the end of the socks and plunk them into the tank. This will help to "seed" the new gravel bed without mixing it up. Leave it there for a few weeks and BLAMO no probs.

This also works wonderfully for "seeding" a new tank during cycling. In that case you would put a smaller "sock" into the filter. Cuts cycling time almost in half!
Hope this helps.