Now, what would be the best way in your opinion of controlling graphics with this data? I thought of maybe modifying omxplayer but it seems to be daunting to integrate the python script that reads the data to c++. Same applies for openFrameworks.
Any pointers would be greatly appreciated. I am very interested in the possibility of using the pi for audiovisual installations!
edit: if this is the wrong forum, my apologies.