USB is a polled system. Doesn't mean you can't "push" data through it with some kind of supersampling, but you need to hit a rendezvous with the host controller.

32ms is FOREVER for game input. That's two whole frames of a 60hz game.