Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.

Wednesday, 29 June 2011

Some thinking...

Some reviews:

1. The possibility to set up a machine as an active Eye Gaze - using our Tobii X120 (I'm checking the tech specs, George).
2. Reviewing my timeline (next steps until the end).
3. need to write the 1 year report.4
4. Defining the prototype, reviewing objectives, hypotesis, variables, methodology (this is a subject that is coming back in papaer revies and doc consortioums that I was declined...too 'high level' is the general comment).
5. Updates about my qualitative analysis on the web 2 drag and drop experiment.

Remember: Metrics by Fixation Duration, Total Fixation duration, fixation count, fix count including zeros

Very interested on what happens when one comes across a novel form of interface, specially Post-WIMP with NUI modes of interaction
Very interested on the experience of what happens when one is offered an interaction with multiple inputs (gesture, eye gaze, voice) and with novel GUI solutions.

Present more graphics to justify my point!
Present more percentages within the problem. How many r interested? Any info online?
It's happening. But I should run a questionnaire if people r interested on engaging on Post-WIMP NUI

Studies about linguistics/natural gestures/gaze commands for the new interface

That was not done before. What am I improving? What novelty am I bringing?
Am I developing a technique/protocol? Recommendations for design?

Add a slide with completed work so far with checks (eg bibliographic review)

Check success/failure rate bibliography

Tool to capture websites: captures AJAX-style/SSL/Data mining (web mining)
RECOGNIZE is better then RECALL

how to analyze user's memory? What theory should I use? Within Cogn Psy?
How to analyze behaviour? Gestures language, grammatics, shall I bring back semiotics, linguistics

Define properly my variables

Correct my doc consortium doc

Declare general and specific obj

FRAMEWORK FOR EVALUATION

What is the Scenario?

Wednesday, 22 June 2011

1st City University Researcher Symposium: My Poster

Researchers’ Symposium

Opportunities for PhD researchers

PhD researchers are invited to participate in the Researcher’s Symposium on Wednesday 22nd June 2011. This will be at a prestigious event with a high ranking keynote speaker.

Why present a paper or a poster?

This is an ideal opportunity for students who have undertaken some data collection and analysis and would value some feedback as well as an opportunity to present in a conference environment. Presenters will gain experience in the process of presenting at a conference in a supportive environment, and will have the opportunity to receive feedback from the research community here at City University London.

Get the full programme of the day here

My poster:

Suggestion for topics for an improved version of my methodology of research:
Aim
Background
Data
Results
Discussion
Conclusion




Some thoughts about my research that emerged during the sessions:

It's well known that eyes seek eyes [ ]. We react when in others presence. Now comps seek eyes. Why shouldn't comps seek our eyes and react to our gaze and presence? It's only natural.

1. DISSECT GUI WITHIN POST-WIMP (QDA - Qualitative Data Analysis)
<tested with web 2 drag and drop widgets within PWP>
Assumption: Regular desktop GUI does not convey/signal properly possible interactions with NUI modes of interaction.
2. CREATE A PROTOCOL FOR UT: OBSERVATION / TASK
3. DISSECT THE GUI WITHIN THE PROTOTYPE (QDA)
4. CREATE A PROTOTYPE (POST-WIMP layer / NUI MODE OF INTERACTION layer)
5. METHODOLOGIES AND NEW THEORY for Post- WIMP embedded in NUI modes of interaction.

Check assumptions about traditional modes of interaction.
Visual cue that signals NUI?
You take for granted double click - it's a convention, it was learned - the UI itself does not provide a Perceptible Affordance for this.
Could adding eye gaze in combination with traditional methods for input slower down or speed up the interaction with a Post-WIMP UI?
When you gaze what is a double click and what is a simple selection?
How to right click?
Eye gaze for selections does not require learning
Check track pad learning
8 stylus pen

Thursday, 9 June 2011

Meeting with Scott and Sara from Tobii - subject: Lenovo prototype

Great meeting, great feedback from Scott Hodgins, Director, Acuity ETS Ltd.

Videos of our meeting:

Part 01 (Introduction):


Part 02 (Software for demonstration of eye gaze control):


Part 03 (Tech Specs):


Part 04 (Game and final comments):


And great response from Scott:

Hi Jacques,

Thank you very much for taking the time to head over with Meirion last week. Apologies for the slight delay in coming back to you, it has been a busy time catching up with 2 days out of the office.

I am glad to see that you liked the Tobii Laptop, as we mentioned it is still a proof of concept, not an actual product, but the technology is available for integration. As we mentioned, and you reiterated below, the logical step forward is for you to look at the SDK and to see which ideas you may be able to take forward from there. I would suggest you use the SDK 3.0 Beta release to ensure compatibility with the Tobii Studio Software in the Lab. Once you have a plan, I am more than happy to head over and go over the details. Then you're looking at coding it using the SDK, and we can take a view from there. We are excited, as you guys clearly were, about the possibilities and wish you luck on this first stage. I am more than happy to help with any queries you might have, and encourage you to use me as the first point of contact.

Best,
Scott.

And some pictures of the showroom:
Meirion and Tobii glasses: Mobile Eye Tracker for real world research.

Stand for Mobile Device testing.

Mounted Tobii T120 Eye Tracker

Monday, 6 June 2011

Tobii Lenovo!

My research addresses the insertion of NUI (specially eye gaze) at daily basis and for regular users, that means mainstream. I know Tobii technology, we work with a x60 here at the Interaction Lab (recently purchased, trade off with a x50). I closely follow Tobii since October 2009, when I met Mick Donegan at HDTI 2009 (and became very fond of him) and later did a workshop with him at UEL, with Tobii P-10: http://www.youtube.com/watch?v=vsR4e3oQKaQ

Well, to the point: I saw Tobii Lenovo prototype: http://tobii.posterous.com/ and went crazy. Really amazing. We're already considering changing the API
with our x60:
http://www.tobii.com/analysis-and-research/global/products/software/tobii-software-development-kit/tobii-sdk-30-beta/
http://appmarket.tobii.com/wiki/index.php/Application_Market_for_Tobii_Eye_Trackers 
but when I saw the LeNovo, I thought, that solves my problem. The hardware is there and I'll be able to install different software or test the user experience with NUI with eye gaze.

Technology for TUI, NUI and Post-WIMP Interactions

Great investigation from my friend Meirion Williams, about NUI, TUI and Post-WIMP. Link to his presentation online, during the OpenDay from HCID 2011.

Anoto io2 Digital Pen - Ghandi clinical handover project

Zeal GPS Ski Goggles - googles with mini display
NEC TeleScouter - display projected into eye
Tobii X120 - eye tracker (we've a x60 at the Interaction Lab)
Tobii PCEye - new small eye tracker, mounted under monitor <£5000 cost
Tobii / Lenovo eye tracking laptop prototype: http://www.youtube.com/watch?v=GFwhx0Wy8PI and http://www.tobii.com/en/group/news-and-events/press-releases/the-worlds-first-eye-controlled-laptop/
eviGroup Paddle Pro - head tracking tablet PC (webcam)
Nintendo DSi - webcam head tracking games
also look at Sony PS3 for more head tracking games - eg GT5 you can look around the car with your head.

Primesense - make the gesture control hardware used in:
- Microsoft Kinect
- Asus Wavi XTION - TV media gesture control system

Primesense also ran gesture controlled browser competition
winner: Stolarsky 'SwimBrowser'
2nd place: Xie et al 'Kin Vi': http://youtu.be/IosmAD10AKg
Toshiba, Samsung, Hitachi - all developing gesture control TVs: http://gigaom.com/video/show-of-hands-gestures-control-hitachi-tv/
Epoc Emotiv - brain control headset
Washington Uni brain implant research
Mindflex - simple brain ball game