I found a Xbox Adaptive Controller project on github that allows the use of bluetooth keyboards & mice, with the help of a Raspberry Pi. The Pi plugs directly in the XAC and the KB & Mouse connect to it over bluetooth, emulating a joystick and buttons.
I have an idea for a remix of this project that could help a lot of people get back in to console gaming at a low cost:
Would it be possible to alter the original code so that the Pi would be able to receive mouse cursor data and global keystrokes of a PC over bluetooth? The Pi would then turn that data in to joystick movements and button presses for the XAC. I'm guessing the PC would need to be running some sort of software to be able to send that data to the Pi.
This would allow players to use their usual eyetracker or any other mouse-moving adaptive equipment to control a joystick in XAC games.
This would also enable players to use any keystroke software, including voice control and eye-gaze screen regions to press controller buttons.
I’m not sure if the joystick movement of the current build is analog or digital. My idea would be to capture the desktop’s x/y position of the mouse cursor and convert it to a value that fits within the range of an analog joystick.
The middle of the screen would have an adjustable dead-zone. Ideally, the overall size and shape of the aiming area would also be adjustable.
To use this with an eyetracker, you would calibrate the eyetracker and turn on it’s mouse-moving software on windows and afterwards switch the monitor input to the gaming console.
Does any of this sound do-able? I’m still too new to programming to know what the limitations are.