I mix/match mine all the time, so I'd vote no.
It's like mice.
If you use a bunch of different mice all the time, you get to where NONE of them feel weird.
I used to play Battlezone with a T-stik and a Top-Fire Super, which would be about the same feel for throw/resistance as the J-stik matchup.
If it really bothers you down the road, you can always switch it then.