Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.

Friday, 11 December 2009

A little bit more about my PhD Proposal...

A littile bit more about my ideas, after being in RAatE 2009:
Physical computing [1] aims to make man-machine interaction more organic, i.e. integrating computer technology with natural actions and behaviours from a user, regardless his/her characteristics, limitations, intelligence or ethnic group. For instance, assistive technology for disabled people is a great field of research bringing quite impressive results, allowing people with special needs not to be excluded from interfacing with digital technology.

As Dourish suggests (2004: 27), interaction with screen and keyboard, tends to demand our direct attention; we have to look at the screen to see what we’re doing, which involves looking away from whatever other elements are in our environment, including other people. The computer sits by the desk and ties us to the desk, too.

The proposed project examines the assumption that advances in physical and tangible computing (a.k.a as tangible user interface[2]) will improve and enhance man-machine interface. The project’s outcomes will provide insight into the sensory, emotive and cognitive functions operating in physical and tangible computing. 
It will provide test protocols for further experimentation and design principles for natural actions and behaviours from a user that are evidence-based rather than technology-led. This is an ethnographic study. The aim is over people and their experience when coming across such innovations when interfacing with digital technology.

This research is not about the creation of a new software but it is about a profound understanding over the user relation with new technologies for interaction, i.e. physical and tangible computing. These technologies already exist and will be integrated to produce an experience within a known context and little control over the steps the user will choose towards the completion of a task. The digital environment will be an Operational System (OS) like Windows, Macintosh or Linux. The real environment should be defined, but if the software is prepared in a laptop the interaction could be carried out anyware. A screen capture software should be running to keep record of the user’s interaction for formal analysis.
___________________________________________
[1] A tangible user interface (TUI) is a user interface in which a person interacts with digital information through the physical environment. The initial name was Graspable User Interface, which no longer is used.
One of the pioneers in tangible user interfaces is Hiroshi Ishii, a professor in the MIT Media Laboratory who heads the Tangible Media Group. His particular vision for tangible UIs, called Tangible Bits, is to give physical form to digital information, making bits directly manipulable and perceptible. Tangible bits pursues seamless coupling between these two very different worlds of bits and atoms.
[2] Physical (or embedded) computing, in the broadest sense, means building interactive physical systems by the use of software and hardware that can sense and respond to the analogue world. While this definition is broad enough to encompass things such as smart automotive traffic control systems or factory automation processes, it is not commonly used to describe them. In the broad sense, physical computing is a creative framework for understanding human beings' relationship to the digital world. In practical use, the term most often describes handmade art, design or DIY hobby projects that use sensors and microcontrollers to translate analogue input to a software system, and/or control electro-mechanical devices such as motors, servos, lighting or other hardware.

Sunday, 6 December 2009

TED: Pranav Mistry is the inventor of SixthSense, a wearable device that enables new interactions between the real world and the world of data.

This is what I want for my research...Hope it is feasible...At TEDIndia, Pranav Mistry demos several tools that help the physical world interact with the world of data -- including a deep look at his SixthSense device and a new, paradigm-shifting paper "laptop." In an onstage Q&A, Mistry says he'll open-source the software behind SixthSense, to open its possibilities to all.

Thursday, 3 December 2009

RAatE 2009: Recent Advances in Assistive Technology & Engineering 2009

The conference took place in the Hotel Hilton Coventry on Monday 30th November and Tuesday 1st of December, sponsored by the HDTI (Health Design & Technology Institute), from Coventry University. It was a great conference (first use of my bench fee) and the city of Coventry is very nice as well.
The first day I could participate in a wokshop from Smartbox - Assistive Technology Ltd where Adam Waits and other professionals within the company presented Tobii equipment and software for assistive technology. Enjoyed very much the presentation of all Tobii equipment as well all explanation on how it works with disabled and non-disabled people, etc.
A few videos I could capture during the workhop - thank you for letting me record it guys!



Me, playing with Tobii P-10 (it worked pretty well):



Me, playing with Intelligaze from Alea Technologies, the less expensive and plug and play in any computer running regular OS (Thank you Adam):



Here are my thoughts after all: For sure, special software for people with special needs are very needed and very welcome - I saw them working beautifully (large icons, simplified commands), but regarding non-disabled people I guess a mix of eye control with other features (like touch screen, voice command, gesture recognition, etc.) plus the standard mouse-keyboard interface will bring better results. When operating regular desktop - with small icons - I found rather difficult to keep my attention over a small object, where so many other colours and elements within the screen were calling my gaze. 

On the second day I could see presentations about Smart housing, Voice recognition, Gaze control, Speech driven environmental control, EyeSequencer (playing music with eye gazing and eye dwelling), television and touch screen set, etc. Great days, great contacts, could bring a few software demos from ClaroRead and Oksa (face recognition), both from Claro Software.

Sunday, 29 November 2009

CRNS: Inaugural Workshop on Robotics and Neural Systems

On November 26th in Plymouth City Museum and on the 27th in Portland Square Building took place a conference/workshop in Robotics and Cognition from CRNS: Centre for Robotics and Neural Systems in Plymouth University.
It was a great conference, approaching subjects like AI, evolution of robots, cognitive systems, robots that learn, vision system (BunnyBot from Phil Culverhouse), neural circuits & visual cognition, etc.
ChristianGoerik from Honda and Steve Furber from Manchester University and Hans-Georg Stork from the European Comission, Cognitive Systems Unit. were the keynote speakers.
On the second day we could see several posters and all robots and devices were in the Roland Lewinsky, through two floors. Great learning and high level conversations.


On the left a study for a robot that reacts from our facial expressions and display expressions in accordance. The image is projected from behind the artificial face (pictures from my friend João Paulo).


And once again the robot iCub in action (picture from my friend João Paulo). :


















On the end we could play a "robot soccer" against an AI team - in the picture a "goal" moment...The robots actually comunicate aming themselves, informing position, calling for help, spinning, blocking, etc. We won a game, final score 1x1. (movie from my friend João Paulo). 

Watch a video:

Thursday, 26 November 2009

I just can't stop watching TED: Talks David Merrill demos Siftables

Again, Marcelo always surprises me with great links:



Again, ubiquity and no screens at all. Objects, like modules, used as recreation purposes, educational and work as well. Watch until the end and imagine a DJ playing and mixing with those cubes in a club...tangible computing at its best.