NUIA eyeCharm: Kinect to eye tracking

User avatar
Halvar

05 Dec 2013, 00:37

The end of the mouse!!!!!!!!!!!!!!!!!!!!!!!!!111111111111111111111111

Control your computer with your eyes:

Would you have backed this?
http://www.kickstarter.com/projects/4ti ... e-tracking

User avatar
webwit
Wild Duck

05 Dec 2013, 00:46

I wonder, to really press that little icon as fast as a mouse or gesture, would that work? However it might work for some things like public display or interface, with custom interface (big icons). Buy your train ticket this way, etc.

User avatar
7bit

05 Dec 2013, 00:53

Some weeks ago, I read that Canon had such a system to select the focus point in their 35mm film cameras, but not in their digitals.

User avatar
webwit
Wild Duck

05 Dec 2013, 02:10

It cannot guess your intent. If you'd look up on a webpage, but don't wanna scroll up to focus on it, it would scroll up.

Findecanor

05 Dec 2013, 06:24

I don't see any reference to Kinect here ...

I have tried a few eye-tracking games and a desktop helper over at Tobii.
It felt really weird to use. It took a while to get used to your eye movement mattering for something. Browsing through menus with your eyes was a chore, because you couldn't move your eyes too much when reading the labels of menu items or you would open or close submenus that you did not want to.
In the end I came to the conclusion that the concept is inherently flawed - eye movement is part of your input device. By detecting your eye movement and using that for direct control, the computer is restricting you.

However, I do think that there is great potential in using eye tracking to augment other modes of input. For instance, the desktop enhancer program would accelerate the mouse: if you started moving the mouse and it was far from where you had been looking, the mouse pointer would jump to where your eyes were.
I think that motion-detection systems such as Leap Motion and Kinect would benefit greatly from being combined with eye tracking to provide proper eye-hand coordination, so that your movements get aligned with the objects on the screen that you are looking at. Unfortunately, Sony has a patent on that concept, which will prevent anyone from developing it.

User avatar
Halvar

05 Dec 2013, 09:02

Findecanor wrote:I don't see any reference to Kinect here ...
Their current hardware is a clip-on for Kinect, and they use the Kinect IR camera. The link to the kickstarter campaign has more.

They're marketing this for games. I read somewhere that they can calculate what you're looking at on your screen with a resolution of about 1 or 2 cm, so it's not really usable as a replacement for the mouse in a classic GUI at the moment.

JBert

05 Dec 2013, 13:15

Findecanor wrote:However, I do think that there is great potential in using eye tracking to augment other modes of input. For instance, the desktop enhancer program would accelerate the mouse: if you started moving the mouse and it was far from where you had been looking, the mouse pointer would jump to where your eyes were.
I think that motion-detection systems such as Leap Motion and Kinect would benefit greatly from being combined with eye tracking to provide proper eye-hand coordination, so that your movements get aligned with the objects on the screen that you are looking at. Unfortunately, Sony has a patent on that concept, which will prevent anyone from developing it.
I believe that's what they were doing in the Photoshop part of the demo, and the user was clicking or using the keyboard in some other parts as well.

Maybe they worked around the Sony patent?

Post Reply

Return to “Mice & other input devices”