Cut off the switch, heat up the legs while tugging them with needlenose pliers.
To clear the hole get the solder super hot and blast it with compressed air.
Or drill it out.
If the solder isn't melted well, tugging is the last thing you'd want to be doing. If the solder is still stuck to the through-hole or pad, the probability of pulling up traces is pretty high. And don't even think of drilling a through hole. Those vias can get stuck to the bit and twist right out of the PCB, disconnecting top, bottom and whatever planes might be between.
It sounds like the OP is trying to pull a large-ish component connected to a ground plane, which can suck a large amount of heat from a small iron. Just because an iron can reach a certain temp with no thermal load, that doesn't mean it's actually delivering that to the joint. Tip size, thermal mass and wattage all come into play. The diode probably doesn't have as much thermal mass as the switch, so it might not be as difficult. If that ends up being the case, solder wick all of the solder away and then carefully wiggle the diode. If it breaks free and can be removed, you've succeeded. Otherwise, wick away more.
If the joint is large enough, and you are very careful, you could try using a "soldering gun". These can typically deliver much more heat to the joint, but again, it's a bigger "hammer" so be careful how you swing it. A hot air rework station is the real tool for the job, but caution is in order there as well. Once a section of the board is hot enough to pull a component, any surrounding SMDs (if there are any) start floating as well.