Are you sure it isn't larger tubifex worms? With my cubes, if you look closely, the top of the cube has smaller worms and the bottom of the cube has the larger ones.
But if it is twigs, (I'm not really doubting you) I'm sure it's not that dangerous to the fish. But you can take them out if it makes you nervous or they're big chunks.