The same joystick was used in Stargate 19mm panel, by putting the washer in a different position, see attached.
18mm ply plus your 2mm? metal panel would be OK with the Defender setup. A bit high is better than a bit low.
Something like 12mm x28mm for the panel hole.