Thanks for the reply and help.
I ended up trying a few different things with the drivers, code, and different computers.
I came to the conclusion that my implementation is slow. I am not maxing out my CPU in either RPI or my desktop. But obviously my powerful desktop is going to make my...