Is they RGB module itself bright? if it is, then yeah, you probably just need a different kind of ball. I've got transluscent 3" blue balls for my trackballs and they light up quite brightly (I'm using a single white LED though, not the RGB). You can clearly see them lit from across the room in a brightly lit room.
I'd guess the pearl is a little too opaque.