We have to be just a few months away from this right? LLMs are already training on screencasts etc. on YouTube so it can probably understand what it is looking at on a modern OS. It just needs “mouse and keyboard” to be another language it can output? I’m not sure what the technical term is.