Students of Irkutsk Technical University are creating a future computer that can be controlled by voice and gestures without a keyboard or mouse. The project has already received a grant, was noted in Skolkovo, and interested Intel, and its authors promise that such a system will be especially useful for people with disabilities. The hardest task now is to teach the device to understand not only commands, but also ordinary spoken language.

The project of Irkutsk scientists has already won a grant — one million rubles. It was recognized in Skolkovo. The development has attracted the interest of the well-known corporation Intel, which even offered cooperation. Just one more year, the young scientists promise, and the computer of the future will no longer be beyond the bounds of reality.
Students at Irkutsk Technical University are developing a computer that will not need touch. It will carry out all commands as soon as you say them. Even people with physical limitations will be able to work with it.
This computer needs neither a keyboard nor a mouse. It is an interactive panel that can understand a person by a single gesture or word.
As IrNITU student Sergey Kim says, for example, you are cooking. You need to send an email from your mail, do something else. You speak in parallel, and the computer does it. At the same time you are cutting a salad, I don’t know, baking pies. Your hands are covered in flour, and there is no need to poke the computer with dirty fingers.
All of this is 3D graphics. The students are now working on creating the software. It will be a full-fledged computer — something like a large tablet with the hardware of an all-in-one PC, which can easily change its angle of inclination. According to the project authors, the mouse and keyboard are already living out their days. The future belongs to wireless technologies. Artists, designers, and ordinary users will appreciate this too. And for people with disabilities, such a computer will be indispensable.
— When using a mouse, we rely on fine motor skills. And when we work with a touch panel, our gestures are larger. And there you can make such a gesture easier for a person with impaired mobility. Or the same voice control system. It allows part of the load to be shifted to voice interaction, says IrNITU student Vladimir Zaitsev.
The most difficult thing, the developers of the interactive panel say, is teaching it to recognize conversational speech rather than carrying out specific commands that the user still needs to learn first.
— We are writing a huge add-on, a large piece that will integrate speech-to-text technologies, analytics, and after that we will understand what the user meant and perform an action in the operating system or some device, says IrNITU student Alexander Popov.