Yes - that is an excellent plan!
Bac2it, as usual, though, has good advice. I would suggest that you scoop it out and put it in a clean bucket and rinse again. Scoop it out and rinse again, until the water rinses clean.
Boiling will definately kill all the nasties that are on the gravel, for the heat reaches all the pores and crannies in the rocks. But the action of the rolling boil bounces a lot of the gunk that had settled into those pores and cannies out - hense the yuck that was left in the bottom of the pot. It is a good thing - having all that gunk out not only removes excess material (albeit sterile material) from the gravel, but opens up the pores of the gravel, giving it more surface area for the beneficial bacteria to colonate and more open areas for the water to circulate through - both excellent things!
So, rinse away, and then bag that stuff up and into the goldies tank with it.
You are doing GREAT!

If you have any of the biomedia you are planning on using in your angel fish tank's filter, yet, bagging that up and sticking it in the goldfish filter or in the tank will also help seed well. Biomedia has even more surface area for the beneficial bacteria to colonate!