Im currently working on a project which involves stabilizing a video stream from a camera mounted on a moving platform. Im planning on using gyroscope as well as the video stream itself to get data. What I fear is that the RPi wont be able to handle the necessary image processing in real time. I've read (somewhat old) posts about getting max 1 - 4 fps with a USB camera and openCV. Has this gotten any better? Even if it hasn't, I would still like to test my approach. What type of Camera would be the optimal choice? Currently, I have a "Point Grey CMLN 13S2M". It might be a bit heavy for my purpose, since I'm planning on doing hardware stabilizing, i.e. physically moving the camera to compensate for angular displacement. This leads to another question regarding the choice of motor. What would be best here?
I'm not asking for a full solution here. Just curious to see if anyone has any experience with this type of project.