Frizzlefried.... I do this all the time with 48-in-1 conversions.
That 3-watt pot you have will be fine. your pot should have 3 leads. Turn your onboard volume pot all the way up, and your onscreen volume adjust all the way up. Then, cut the wires to your speaker. Run one wire (brown/silver)to an outside lead on your pot, then on to the speaker. Run your other wire (red/silver) to the other outside lead on your pot. Now add another wire to the middle lead on your pot and run it to your other speaker terminal. Now you can adjust the volume anytime by turning the pot.
If your leads aren't set up this way, put a meter on the leads. Your outside leads should show the full resistance of the pot, while an outside-to-inside reading should change as the pot is turned.
This works every time.