Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.
Showing posts with label tobii. Show all posts
Showing posts with label tobii. Show all posts

Thursday, 25 April 2013

The Wall Street Journal: Computing Looks to the Eyes

Lovely article:

Computing Looks to the Eyes

Technology That Tracks Eye Movement Could Cut Down on Mouse Use
[image]Getty Images
State-of-the-art eye tracking technology may change 
the way we operate computers and mobile devices.






Touch screens have removed some of the need for clunky hardware extras long associated with personal computing. But the biggest technical challenge to wean computers off the age-old keyboard and mouse may rest on the two sockets in our heads.

Eyes are poised to emerge in coming years as a legitimate pointing tool for computers and mobile devices to accompany other methods of interacting with personal gadgets.

State-of-the-art eye tracking is mostly found in the health-care industry, as aids for disabled people with impaired mobility. Now the race is on to incorporate the technology into mass-market consumer electronics for games and everyday applications.

Multinational heavyweights Samsung Electronics Co. and LG Electronics Inc. have brought eye-tracking technology to the forefront by implementing it in their mobile devices. Their new flagship phones are able to detect users' eye presence, allowing for features such as automatically pausing videos when the user is looking away from the screen or scrolling up or down a Web page.

These companies' technologies, however, can only be used for very limited applications, and some tech reviewers and analysts consider them to be more gimmicky than game-changing.
Eyeballs are poised to emerge in coming years as a legitimate tool for controlling everything from handsets to games, Sven Grundberg reports. Photo: Getty Images.

"Samsung's eye tracking is definitely very interesting, but they have not yet nailed the experience," said Francisco Jeronimo, a tech analyst at International Data Corp, who recently tried out the eye-tracking function in Samsung's coming Galaxy S 4 phone which starts shipping next month.

One company that is hoping to bring eye-tracking tools to the masses is Tobii TechnologyAB, a Stockholm company founded by three engineers in 2001.

"I'm convinced, even to the point of fanaticism, that eye tracking will be integrated in all types of computer devices in the future," Henrik Eskilsson, the 38-year-old chief executive and co-founder, said during a phone interview from Japan, where he was meeting customers.

This fall his company plans to start shipping its REX device, a small bar that attaches to the bottom of a computer screen through a USB port. Tobii plans to start selling it as an accessory for Windows 8 PCs, with eventual plans to incorporate the technology into laptops and tablets. 

Rather than using a camera, Tobii's device includes a microprojector that emits infrared light to generate a reflection pattern on the eyes. This reflection is collected by an image sensor and processed by software to determine where the person is looking, within a millimeter, Tobii says. Users must sit within a meter of the eye-tracker, and calibrate it to understand the characteristics of the specific set of eyes.

image


Mr. Eskilsson expects games to be one of the initial applications for this technology, and said the company is working with undisclosed game developers. To show off its technology, Tobii built what it calls the first eye-controlled arcade game, called EyeAsteroids, a spin on the old Atari game, Asteroids.

The REX is also designed to offer Windows 8 users more routine tasks, such as mouse pointing and scrolling down pages.

"Touch is intuitive and efficient if you're holding a device in your hands, but unless you're actually holding the device, it isn't that useful," he said. "I'm struggling to see that we will be sitting at our desks at work, bending over to touch the screens of our laptops or desktop computers."

But there are limitations to the usefulness of eye-tracking on its own. A user wouldn't be able to open a link, for example, without also executing a command of some kind, such as on a keyboard.

"Eyes are perfect for pointing, but lousy for clicking and executing commands, so I don't expect that we will only use our eyes to interact with computers in the future," Mr. Eskilsson said.

He said eye-tracking will most likely accompany several emerging methods of interacting with computers.

Body-motion detection systems, like Microsoft Corp.'s Kinect and Nintendo's Wii Remote, have been around for several years, and Apple Inc.'s Siri voice-command software for the iPhone can readily tell you the score in the latest 49ers game if you ask her. San Francisco startup Leap Motion Inc. has just started taking preorders for its motion sensor technology that precisely tracks hand gestures and reflects the movements on screen.

Intel Corp. is also betting that future computing will abolish the mouse and the keyboard in favor of more intuitive user interfaces. Last year the chip maker invested about $21 million for a 10% stake in Tobii, and it is now distributing software tool kits for independent developers to build PC applications that make use of voice commands, hand gestures and eye tracking. Intel's chips are in the majority of personal computers, and it has been pushing a newer breed of portable PCs it calls Ultrabooks, some of which have touch screens.

A problem with advanced eye tracking has been the high cost. Five years ago, a package containing an infrared camera, an application processor and software could cost as much as $10,000. While prices have come down and the equipment has become considerably smaller and more power efficient, it remains expensive, with complete packages commanding prices around $1,000.

Tobii hasn't yet disclosed the retail price of its REX device, but says it is targeted at tech-savvy aficionados rather than everyday computer users. So far, his company has been selling tools for marketing research and kits to help disabled people to operate speech programs and computers with their eyes only.

"Within a year, there will be solutions out there with prices that will feel perfectly reasonable for ordinary users," Mr. Eskilsson said.
Write to Sven Grundberg at sven.grundberg@dowjones.com
A version of this article appeared March 26, 2013, on page B5 in the U.S. edition of The Wall Street Journal, with the headline: Computing Looks to the Eyes.

Tuesday, 17 April 2012

Tobii Gaze Eye-Controlled Interface on Windows 8 to be Demoed at CES

Tobii’s eye-tracking technology has already made its way onto a Lenovo laptop, and now it’s finding a home on Windows 8. At CES, the Swedish company will showcase its Tobii Gaze interface on Microsoft’s tile-based Windows 8 Metro UI.
The Tobii Gaze interface eliminates the need for users to touch a laptop’s display to navigate the interface, a process which Tobii says is not as intuitive on a notebook as it is on a tablet. Instead, thanks to a combination of eye-tracking and a touchpad, Tobii Gaze lets your eyes perform the same commands you would with your hands.
Though looking at an item on-screen effectively points to it, a touchpad is also there to enable Windows 8′s touch gestures (including zoom, select, and scroll) and to fine-tune when Tobii Gaze doesn’t register a command. Check out the video demo below—it certainly whetted our appetite for seeing more in Las Vegas.

Tuesday, 24 January 2012

My Talk at the Web Accessibility London (a11yLDN) event

Did a great presentation at the Web Accessibility London (a11yLDN) event: Considerations about Eye Gaze interface for people with disabilities: from the HCI perspective.
Took place on the 24th January from 7pm to 8.30pm here at City (Social Science Building) the 2nd a11yLDNmeetup. Hosted by City Interaction Lab.




Conference videos: http://vimeo.com/a11yldn

My presentation (playback): http://lanyrd.com/2012/a11yldnmeetup2/spczc/


And the PPT on Slideshare: http://www.slideshare.net/jchueke/considerations-about-eye-gaze-interfaces-for-people-with-disabilities-from-the-hci-perspective

The event discussed Web Accessibility but also had strong presentations that consider User Experience (UX) and HCI. FREE tickets were available http://a11yldnmeetup2-estw.eventbrite.co.uk/

Talks:
Jacques Chueke*, City University London “Considerations about Eye Gaze interfaces for people with disabilities: from the HCI perspective”Sophie Freiermuth, User Experience Practitionner “Accessibility as an implied practice of user experience”

Makayla Lewis*, City University London “Developing a 5-stage process for online social network change, focus on users with cerebral palsy”

Artur Ortega, Yell.com “Mobile Web Accessibility  - Improved Usability for everyone”

Monday, 9 January 2012

G1: Sistema permite controlar PC e tablet apenas com os olhos

Dica do meu amigão Marcelo Amaral: 09/01/2012 14h26 - Atualizado em 09/01/2012 14h59

Sistema permite controlar PC e tablet apenas com os olhos

G1 testa tecnologia durante evento de prévia da CES 2012.
Sensores devem chegar ao mercado em dois anos, diz executiva.

Gustavo Petró Do G1, em Las Vegas (EUA)
4 comentários
Depois de que as telas sensíveis ao toque, que permitem acessar quase qualquer tipo de conteúdo com os dedos, tornaram a tecnologia mais acessível, o próximo passo é usar os olhos para controlar o computador. Um sistema com esse recurso foi apresentado na prévia da Consumer Electronic Show 2012, realizada no último domingo (8).
Em desenvolvimento desde 2001 pela Tobii, esse sistema rastreia o olho de modo similar ao usado pelo Kinect, acessório do videogame Xbox 360, para capturar os movimentos dos jogadores. O resultado é que, para onde o usuário olhar, o movimento dos olhos será reconhecido; o recurso vale para PCs e tablets, inclusive o novo sistema operacional da Microsoft, o Windows 8, que será mostrado na CES.
Embora na ocasião tenha sido possível controlar o novo Windows, a Tobii apresentou uma série de aplicações que funcionam com o olhar para o teste do G1. O rastreamento dos olhos utiliza uma série de sensores instalados em um monitor de computador ou TV, segundo Sara Hyléen, gerente de marketing da companhia. "Sensores infravermelhos monitoram o movimento dos olhos, e, para onde o usuário olhar, será como movimentar o mouse do PC".
O uso da tecnologia é muito natural. Após uma rápida calibragem, foi possível navegar por um álbum de fotos apenas olhando para as imagens. Ao fixar o olhar em uma fotografia por alguns segundos, ela se expandia na tela; para voltar, bastava olhar por algum tempo para a parte inferior da tela. Para mudar as páginas, era preciso apenas dar uma olhada nos cantos esquerdo ou direito do monitor. A utilização é tão simples que dispensou maiores explicações da executiva.
'Visão laser'Em seguida, foi apresentado um game em que o objetivo é destruir asteroides que podem se chocar contra a Terra. Para destruí-los, basta usar uma "visão laser", fixando os olhos nos pedregulhos que flutuam pelo espaço -- quanto maiores, mais tempo deve-se olhar para eles até transformá-los em pó.
Mesmo com uma utilização bastante simples e eficaz, o produto ainda está longe de ser comercializado nas lojas. "Ainda estamos na fase de protótipo, mas esperamos que o sensor seja colocado à venda nos próximos dois anos", afirma Sara. A intenção, segundo ela, é disponibilizar o sensor inicialmente para deficientes físicos, facilitando o acesso deles à tecnologia.
Após rápida calibragem, é fácil navegar por álbum de fotos no PC apenas olhando para as imagens (Foto: Gustavo Petró/G1)Após rápida calibragem, é fácil navegar por álbum de fotos no PC apenas olhando para as imagens (Foto: Gustavo Petró/G1)

Tuesday, 4 October 2011

Presentation at EyeTrack Behavior 2011

Within the Centre for HCI Design blog:

Jacques Chueke presented at the EyeTrackBehavior 2011 – Tobii Eye Tracking Conference on Behavioral Research in Frankfurt, Germany. His paper: Drag-and-Drop and Perceptible Affordances Issues within Personal Web Portals: An iGoogle Case Study.
It was a successful presentation with great participation from the audience. The conference, as Jacques mentioned, was a great opportunity to share ideas and methodologies with researchers and people working with eye tracking technology in diverse forms.




Within Tobii technology blog:

Web: http://tiny.cc/j3j7s
Password: ETB2011

Reference: Chueke, J. Buchanan, G. Wilson, S. Drag-and-Drop and Perceptible Affordances Issues within Personal Web Portals: A iGoogle Case Study. In EyeTrackBehavior 2011 – Tobii Eye Tracking Conference on Behavioral Research (Frankfurt, Germany, October 4-5, 2011).

Thursday, 22 September 2011

EyeTrackBehavior 2011 - Tobii Eye Tracking Conference on Behavioral Research

Confirmed speakers for the EyeTrackBehavior Conference, Frankfurt. Oct 4-5, 2011. I'm one of them:
http://www.tobii.com/en/eye-tracking-research/global/news-and-events/tobii-conference/international-eye-tracking-behavior-conference/speakers-abstracts/

Drag-and-Drop and Perceptible Affordances Issues within Personal Web Portals: A iGoogle Case StudyBy Jacques Chueke, Centre for HCI Design, City University London, United Kingdom
Abstract: In this research we investigate Perceptible Affordances and their role in drag-and-drop interactions within the iGoogle Personal Web Portal. A usability evaluation with Eye Tracking was conducted in order to better understand how this website signals the possibility for Drag-and-drop interaction with its content. Our protocol for analysis also included participants thinking aloud, so we could better grasp their strategies for identifying potential interactions. We verified that expertise influences how able a user is to identify and understand cues for interaction within an interface. In the case of personal web portals, a general lack of familiarity with this type of website hinders the effective use of these systems by new users. Clearer and stronger cues for perceptible affordance are needed to ensure that users can quickly adopt and adapt these systems.

Biography: Jacques (MSc.) has been working for 10 years developing projects for Internet and Software for large companies and teaching about HCI and Digital Image in Brazil before coming to UK. He has joined the Centre for HCI Design at City University London in October of 2010 as a MPhil/PhD student, supervised by Dr George Buchanan and Stephanie Wilson. His research investigates new forms of interaction within digital interfaces (e.g. eye tracking, multi-touch, voice command, gesture recognition) and different visual feedback with the purpose to explore cognitive aspects of experience design. He is sponsored by the Ministry of Education, Brasília.
Link with Jacques' profile at City University: http://www.city.ac.uk/informatics/school-organisation/centre-for-human-computer-interaction-design/people/jacques-chueke

Friday, 5 August 2011

New gadgets at the Interaction Lab!

Raj Arjan, my friend and Interaction Lab manager purchased more equipment that will allow more research and interdisciplinary research:

1. Mind control two devices (emotiv and mindwave) mindwave is mac compatible

2. X60 now can track gaming
Still no app for mac besides the sdk
Stand to track mobile and ipad

3. Mini wearable camera, non intrusive

4. Nvidia 3d glasses

5. Galvanic skin response for temperature, motion, skin condutivity - stress levels
UT of gesture based interactions

6. 2 iPad2 tablet computers

7. Didital pad Acecad, handwriting notes being digitalized and drawings/scribbles

8. Panasonic IP camera, remote controlled, controlled by browser

9. Gaming console: nintendo Wii (controller hacks) and x-box360 with kinect (for geatural interaction)

10. Dell laptop to run Tobii eyetracker so we could analyze

Thursday, 9 June 2011

Meeting with Scott and Sara from Tobii - subject: Lenovo prototype

Great meeting, great feedback from Scott Hodgins, Director, Acuity ETS Ltd.

Videos of our meeting:

Part 01 (Introduction):


Part 02 (Software for demonstration of eye gaze control):


Part 03 (Tech Specs):


Part 04 (Game and final comments):


And great response from Scott:

Hi Jacques,

Thank you very much for taking the time to head over with Meirion last week. Apologies for the slight delay in coming back to you, it has been a busy time catching up with 2 days out of the office.

I am glad to see that you liked the Tobii Laptop, as we mentioned it is still a proof of concept, not an actual product, but the technology is available for integration. As we mentioned, and you reiterated below, the logical step forward is for you to look at the SDK and to see which ideas you may be able to take forward from there. I would suggest you use the SDK 3.0 Beta release to ensure compatibility with the Tobii Studio Software in the Lab. Once you have a plan, I am more than happy to head over and go over the details. Then you're looking at coding it using the SDK, and we can take a view from there. We are excited, as you guys clearly were, about the possibilities and wish you luck on this first stage. I am more than happy to help with any queries you might have, and encourage you to use me as the first point of contact.

Best,
Scott.

And some pictures of the showroom:
Meirion and Tobii glasses: Mobile Eye Tracker for real world research.

Stand for Mobile Device testing.

Mounted Tobii T120 Eye Tracker

Monday, 6 June 2011

Tobii Lenovo!

My research addresses the insertion of NUI (specially eye gaze) at daily basis and for regular users, that means mainstream. I know Tobii technology, we work with a x60 here at the Interaction Lab (recently purchased, trade off with a x50). I closely follow Tobii since October 2009, when I met Mick Donegan at HDTI 2009 (and became very fond of him) and later did a workshop with him at UEL, with Tobii P-10: http://www.youtube.com/watch?v=vsR4e3oQKaQ

Well, to the point: I saw Tobii Lenovo prototype: http://tobii.posterous.com/ and went crazy. Really amazing. We're already considering changing the API
with our x60:
http://www.tobii.com/analysis-and-research/global/products/software/tobii-software-development-kit/tobii-sdk-30-beta/
http://appmarket.tobii.com/wiki/index.php/Application_Market_for_Tobii_Eye_Trackers 
but when I saw the LeNovo, I thought, that solves my problem. The hardware is there and I'll be able to install different software or test the user experience with NUI with eye gaze.

Technology for TUI, NUI and Post-WIMP Interactions

Great investigation from my friend Meirion Williams, about NUI, TUI and Post-WIMP. Link to his presentation online, during the OpenDay from HCID 2011.

Anoto io2 Digital Pen - Ghandi clinical handover project

Zeal GPS Ski Goggles - googles with mini display
NEC TeleScouter - display projected into eye
Tobii X120 - eye tracker (we've a x60 at the Interaction Lab)
Tobii PCEye - new small eye tracker, mounted under monitor <£5000 cost
Tobii / Lenovo eye tracking laptop prototype: http://www.youtube.com/watch?v=GFwhx0Wy8PI and http://www.tobii.com/en/group/news-and-events/press-releases/the-worlds-first-eye-controlled-laptop/
eviGroup Paddle Pro - head tracking tablet PC (webcam)
Nintendo DSi - webcam head tracking games
also look at Sony PS3 for more head tracking games - eg GT5 you can look around the car with your head.

Primesense - make the gesture control hardware used in:
- Microsoft Kinect
- Asus Wavi XTION - TV media gesture control system

Primesense also ran gesture controlled browser competition
winner: Stolarsky 'SwimBrowser'
2nd place: Xie et al 'Kin Vi': http://youtu.be/IosmAD10AKg
Toshiba, Samsung, Hitachi - all developing gesture control TVs: http://gigaom.com/video/show-of-hands-gestures-control-hitachi-tv/
Epoc Emotiv - brain control headset
Washington Uni brain implant research
Mindflex - simple brain ball game

Wednesday, 17 November 2010

Tobii x50: Testing with banners Rich Media - Yahoo! UK

Testing Tobii x50 Eye Tracker with Yahoo! UK - I was interested on banners Rich Media (and how distracting they could be):
 

Monday, 15 November 2010

Tobii Eye Tracking system workhop

Raj, the Interaction Lab manager was again very kind to guide me trough how to work with Tobii x50 Eye Tracking. I'm overwhelmed with the possibilities. One can assess user interaction with static images, websites and even video.
The test as observed by the expert evaluator, presented below.  It records the ambient sound, creates a video of the subject's face (that could frame some face/body reaction that could be matched with the test results), displays the IR feedback reflex from the subject eyes, besides the eye gaze results in real time.



It's a complete product, where you could set up an introduction screen with timer, keyboard or mouse shortcut toward the start of the task itself. It's possible to add a form at any point of the task as well, which is amazing (as can be seen below):



It's possible as well to overlap results obtained with different users, in order to identify trends of observation. Below a print screen of different gazes from different users, generating a heatmap as well, besides a cluster view:

Gaze view results: 4 users

Heatmap results: 4 users

Cluster results: 4 users


I also generated a video from the Gaze results overlapped:


To sum up, that was brilliant, I've been waiting to use this equipment for at least three years and for sure will be a great addition to my PhD research.

Friday, 10 September 2010

Workshop at UEL with Mick Donegan

Mick Donegan, founder of the charity Special Effects, whom I met at RAatE 2009 (Coventry) gave me at SmartLab (CITE-UEL) a short workshop on Tobii P-10 Eye Gaze equipment for people with disabilities:



My Tobii P-10 Training with Mick Donegan - Predictive Keyboard (Detail):


My Tobii P-10 Training with Mick Donegan - Musical Games:


 Thank you for all, Mick.

Thursday, 3 December 2009

RAatE 2009: Recent Advances in Assistive Technology & Engineering 2009

The conference took place in the Hotel Hilton Coventry on Monday 30th November and Tuesday 1st of December, sponsored by the HDTI (Health Design & Technology Institute), from Coventry University. It was a great conference (first use of my bench fee) and the city of Coventry is very nice as well.
The first day I could participate in a wokshop from Smartbox - Assistive Technology Ltd where Adam Waits and other professionals within the company presented Tobii equipment and software for assistive technology. Enjoyed very much the presentation of all Tobii equipment as well all explanation on how it works with disabled and non-disabled people, etc.
A few videos I could capture during the workhop - thank you for letting me record it guys!



Me, playing with Tobii P-10 (it worked pretty well):



Me, playing with Intelligaze from Alea Technologies, the less expensive and plug and play in any computer running regular OS (Thank you Adam):



Here are my thoughts after all: For sure, special software for people with special needs are very needed and very welcome - I saw them working beautifully (large icons, simplified commands), but regarding non-disabled people I guess a mix of eye control with other features (like touch screen, voice command, gesture recognition, etc.) plus the standard mouse-keyboard interface will bring better results. When operating regular desktop - with small icons - I found rather difficult to keep my attention over a small object, where so many other colours and elements within the screen were calling my gaze. 

On the second day I could see presentations about Smart housing, Voice recognition, Gaze control, Speech driven environmental control, EyeSequencer (playing music with eye gazing and eye dwelling), television and touch screen set, etc. Great days, great contacts, could bring a few software demos from ClaroRead and Oksa (face recognition), both from Claro Software.