Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.
Showing posts with label openframeworks. Show all posts
Showing posts with label openframeworks. Show all posts

Tuesday, 17 November 2009

Openframeworks: First tests with Eyetracking

I've tried the application downloaded from Eyewriter developer page. Have downloaded Openframeworks as well and installed X-Code for MacOS (compatible with version 10.5). The software should work better with special glasses, close to the beholder's eye, not as shown in the video below:



From my understanding, the camera searches for the darkest point within sight (in the best scenario, the pupil) and follows it, replicating on the screen the point where the user is looking at. In the video we can see that the darkest area (after several configurations) was my eye cavity. Just a test, have to find out how to change it for my research interests.

Monday, 16 November 2009

EyeWriter Initiative

This one was a suggestion from my big friend Marcelo Amaral, from Rio de Janeiro and has everything to do with my research. The EyeWriter project is an ongoing collaborative research effort to empower people, who are suffering from ALS, with creative technologies. Great idea, a camera detects the pupils and reflects on the screen the eye movement from the user. With such project, one can draw anything on the screen. With regards to my research, it would be fantastic if a person could manipulate elements within an interface, like activating buttons, links, rearranging elements, etc.






 












The Eyewriter from Evan Roth on Vimeo.

The eye-tracking software detects and tracks the position of a pupil from an incoming camera or video image, and uses a calibration sequence to map the tracked eye/pupil coordinates to positions on a computer screen or projection. The team uses the GSL (gnu scientific library) for calibration, which is GPL, thus the eye tracking source code is GPL. The EyeWriter software is two parts — an eye-tracking software designed for use with our low-cost glasses, and a drawing software designed for drawing with eye movements.The software for both parts has been developed using openframeworks, a cross platform c++ library for creative development.
The pupil tracking relies upon a clear and dark image of the pupil. The diy glasses designed use near-infrared leds to illuminate the eye and create a dark pupil effect. This makes the pupil much more distinguishable and, thus, easier to track. The camera setting part of the software is designed so the image can be adjusted with brightness and contrast to get an optimal image of the eye.
The calibration part of the software displays a sequence of points on the screen and records the position of the pupil at each point. It is designed so that a person wearing the glasses should focus on each point as it is displayed. When the sequence is finished, the two sets of data are used to interpolate where subsequent eye positions are located in relation to the screen.