I would allow 40mm for the J-stick (actually ~37mm including the metal plate).
But for the pushbuttons you need to allow 60mm (actually ~56mm but don't forget spade connector!)
Sorry I can't help with the trackball depth, but it is probably more than the above measurements...