Playing games with real movement is far from new, especially for Nintendo who made billions for the Wii from the concept. But Ian Charnas decided to take that idea all the way back to the 80s with some cool hacking for Punch-Out!! on the NES.
Ian bought the game, dumped the ROM, and used Google MoveNet to define some heuristics for the boxing moves he’d need for the controls. He then disassembled the game binary over the course of about two months and the result can be seen below. The bonus is you can play his version too, straight from your browser. All you need is a camera and the will to win.