One of the biggest challenge in this case is the latency - the time from when you hit the trigger to the time the mouse position is received. It is really hard to find a USB camera with low latency, I don't think there is one easily accessible.
After that you still have the update rate (camera FPS), image processing time and so on...
Your processing time is 15 ms, which is nothing compared to the total latency (~1000 ms). The Sinden processing time is 7 ms, but I guess the Sinden's total latency should be in the range 50-100 ms. So I don't expect good latency from Sinden.
I also thought of using a IMU (accel, gyro) to estimate the moviment, so that the camera gives an absolute position and the IMU gives a relative one. This is analogous to a car positioning system (GPS gives the absolute position). I guess it is not hard to find a 1000hz IMU. In this cenario, due to the image grabbing delay, we would never use the actual image information to update the current position, rather we will use it to correct a past position and propagate this correction to the current positon using past reading of the IMU sensor. What do you guys think?
One, question, how bad the IR based solutions latency?
Best regards,