After repeating green run of Dungeon of the Conqueror many times, i haven't dropped even one fragment. They should drop from chests on 5th, 10th and so on waves.
I did some also, while I have drop the other collectibles from CCD I still haven't drop the fragment too. I am afraid you are right. That's really sad.