Yes, or leave the original button in and connect the extra power button in parallel.
Doing so, you can use either one to power the system.
Those buttons have 4 connections.
Normally The 2 on one side and 2 on the other side are connected to each other.
If you press the button, all 4 are connected to each other.
Sometimes however, 2 of them are only used for fixation of the button.