Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.

Tuesday, 17 November 2009

Openframeworks: First tests with Eyetracking

I've tried the application downloaded from Eyewriter developer page. Have downloaded Openframeworks as well and installed X-Code for MacOS (compatible with version 10.5). The software should work better with special glasses, close to the beholder's eye, not as shown in the video below:



From my understanding, the camera searches for the darkest point within sight (in the best scenario, the pupil) and follows it, replicating on the screen the point where the user is looking at. In the video we can see that the darkest area (after several configurations) was my eye cavity. Just a test, have to find out how to change it for my research interests.

Monday, 16 November 2009

Aurora interface concept

Regarding Aurora interface concept, from Mozilla Labs. This was created a year ago, but I still consider the concept very interesting in regards to some controversial issues. Very brave and towards paradigm brakedown within browser software and website content and interaction, but at the same time over flooded with Icons and visual/audio metaphors which will require a great amount of abstraction thinking from the user. I see accessibility problems as well: children are not the public here and over aged people will have problems seeing the great amount of details displayed. It's a great idea but might not be to everyone...see for yourself.


Aurora (Part 1) from Adaptive Path on Vimeo.













Jesse James Garrett: "With Aurora, we set out to define a plausible vision of how technology, the browser, and the Web might evolve in the future by depicting that experience in a variety of real-world contexts.
The release of Aurora is part of the launch of Mozilla Labs’ browser concept series, an ongoing initiative to encourage designers and developers to contribute their own visions of the future of the browser and the Web. Over the next couple of weeks, we’ll be releasing more video segments, as well as background material showing just what went into imagining the future of the Web and translating that into a video."

Processing: Flob Library

Again, thank's to my great friend Clarissa Ribeiro I've installed and tested the flob library within the open source software Processing. Her remarks: "flob is a fast flood-fill multi-blob detector that works in processing. It's a jar library that tracks blobs and simple features in processings' image streams. has been tested in windows and mac in several systems. Aims at fast code. many new algorithms: can track blobs with id's, track feature points..."
From my point of view it is a fantastic software. With a simple camera connected to your computer (in my case MacBook built in camera) the camera reacts with movement and displays the most contrasting elements within its view. Now, with regards to my project I've to figure out how to define specific elements, like fingers or eyes so the camera would only detect such elements. Have no idea (for now...) how to do it. A screen capture and some printscreens below:







EyeWriter Initiative

This one was a suggestion from my big friend Marcelo Amaral, from Rio de Janeiro and has everything to do with my research. The EyeWriter project is an ongoing collaborative research effort to empower people, who are suffering from ALS, with creative technologies. Great idea, a camera detects the pupils and reflects on the screen the eye movement from the user. With such project, one can draw anything on the screen. With regards to my research, it would be fantastic if a person could manipulate elements within an interface, like activating buttons, links, rearranging elements, etc.






 












The Eyewriter from Evan Roth on Vimeo.

The eye-tracking software detects and tracks the position of a pupil from an incoming camera or video image, and uses a calibration sequence to map the tracked eye/pupil coordinates to positions on a computer screen or projection. The team uses the GSL (gnu scientific library) for calibration, which is GPL, thus the eye tracking source code is GPL. The EyeWriter software is two parts — an eye-tracking software designed for use with our low-cost glasses, and a drawing software designed for drawing with eye movements.The software for both parts has been developed using openframeworks, a cross platform c++ library for creative development.
The pupil tracking relies upon a clear and dark image of the pupil. The diy glasses designed use near-infrared leds to illuminate the eye and create a dark pupil effect. This makes the pupil much more distinguishable and, thus, easier to track. The camera setting part of the software is designed so the image can be adjusted with brightness and contrast to get an optimal image of the eye.
The calibration part of the software displays a sequence of points on the screen and records the position of the pupil at each point. It is designed so that a person wearing the glasses should focus on each point as it is displayed. When the sequence is finished, the two sets of data are used to interpolate where subsequent eye positions are located in relation to the screen.

Henry Markram builds a brain in a supercomputer

Hint from my friend João Paulo Gomes - PhD student in the CRNS (Centre for Robotics and Neural Sciences), Faculty of Science and Technology, University of Plymouth: Henry Markram says the mysteries of the mind can be solved -- soon. Mental illness, memory, perception: they're made of neurons and electric signals, and he plans to find them with a supercomputer that models all the brain's 100,000,000,000,000 synapses.