| Main > Lightguns |
| DIY projects with other than IR led tracking |
| (1/2) > >> |
| sniiki:
Not that the Sinden gun price would be bad at all, but just wondering if, even just for the joy (and rage) of tinkering anyone else has been experimenting with RGB/BW cameras using something else than IR leds to track the monitor? I did some crude tests with OpenCV and the basics were easily there but not really sure if OpenCV would allow fast enough algorithms out of box. With 176x144 RGB video the tracking test takes ~15ms on my old i7 Ivy Bridge, which is a probably too much (no idea of the delays in other tracking systems). This time includes grapping the pic from an URL, preprocessing it, finding the screen rectangle, sorting the corners and calculating perspective transformation matrix to map the center point of camera on that found screen plane. Now, it's a sucky test code and I actually know nothing about OpenCV but I thought it was at least somewhat promising and therefore thought there must be some other tests around this forum? Here's a vid just for the fun of it. Huge delay was mostly from using old cell phone as an IP camera over WiFi as I couldn't find any non integrated webcam and also for this retarded demo I used a larger 1080p source video so the total processing time went up to 250ms or so. |
| Howard_Casto:
If one is using a camera, IR filtering is probably the best way to go. Basically it filters off a buttload of image data before the camera even starts processing, which increases responsiveness. We were discussing trying IR lasers and a stationary camera last year but we had trouble sourcing a ir laser powerful enough that wouldn't destroy our retinas. |
| JayBee:
Very nice tests you did there. Yeah the amount of data to process and all the issues that can come from this solution aren't easy to overcome I guess. --- Quote from: Howard_Casto on August 10, 2020, 03:57:18 pm ---If one is using a camera, IR filtering is probably the best way to go. Basically it filters off a buttload of image data before the camera even starts processing, which increases responsiveness. We were discussing trying IR lasers and a stationary camera last year but we had trouble sourcing a ir laser powerful enough that wouldn't destroy our retinas. --- End quote --- But would IR filtering be really useful here without any IR emitting source? I also tried the laser stuff a bit, and true, it's not working very well, especially with non glossy screen that don't reflect the laser enough. |
| sniiki:
Thanks for the comments. Initial driver to experiment was my earlier experience on IR tracking a long, long long time ago with FreeTrack and with some issue with environment light. That said, I don't think these IR light guns have the same issue as there should not be any light sources shining at the screen anyway. Still, fun to just try new stuff and I think I will experiment more but need to get a better camera (maybe one that provides non Bayer filtered image to minimize the delay). Using gyros along with the camera tracking could help with the response times but then again if current tracking options have no significant delay, why bother. I found that laser discussion of yours and it was indeed an interesting idea but yeah, LCD is a nasty surface to detect the beam. |
| JayBee:
--- Quote from: sniiki on August 11, 2020, 05:44:14 am ---Thanks for the comments. Initial driver to experiment was my earlier experience on IR tracking a long, long long time ago with FreeTrack and with some issue with environment light. That said, I don't think these IR light guns have the same issue as there should not be any light sources shining at the screen anyway. Still, fun to just try new stuff and I think I will experiment more but need to get a better camera (maybe one that provides non Bayer filtered image to minimize the delay). Using gyros along with the camera tracking could help with the response times but then again if current tracking options have no significant delay, why bother. I found that laser discussion of yours and it was indeed an interesting idea but yeah, LCD is a nasty surface to detect the beam. --- End quote --- Having various solutions is always a good thing for innovation ;D Yeah parasite lights is one of the most annoying thing in the IR led solutions. If we can find a way to remove this issue without losing the overall stability and speed, that'd be great. I'd recommend a camera of at least 120fps to minimize the latency. |
| Navigation |
| Message Index |
| Next page |