Greetings, those of good will.

I've created this blog to register my experience through this PhD in London, UK. Welcome to a space for discussion of new ideas within digital interfaces, eye tracking, assistive technology, natural user interfaces, physical and tangible computing, gestural interfaces, upcoming devices, web 2/3.0, augmented reality and beyond.

Saturday, 19 December 2009

Another conference on target: EyeTracKConf

Yet again, another conference of great interest:


EyeTracKConf
Monday, 25 January 2010 09:00 -
Tuesday, 26 January 2010 17:00 (Central European Time)


Scandic Hotel Copenhagen
Vester Soegade 6
Copenhagen
1601
Denmark

About the Conference
This conference is sure to be an educational experience, bringing together leading researchers to engage in a high level exchange of ideas on eye tracking within psychology and linguistic research.
This two days event is also a platform for knowledge sharing about eye tracking research and methodology, with the aim of establishing a strong European network that will allow further cooperation among research departments.


The following topics will discussed during the event:


- Cognitive psychology
- Developmental psychology
- Experimental psychology
- Linguistic research
- Neuropsychology


Friday, 11 December 2009

A little bit more about my PhD Proposal...

A littile bit more about my ideas, after being in RAatE 2009:
Physical computing [1] aims to make man-machine interaction more organic, i.e. integrating computer technology with natural actions and behaviours from a user, regardless his/her characteristics, limitations, intelligence or ethnic group. For instance, assistive technology for disabled people is a great field of research bringing quite impressive results, allowing people with special needs not to be excluded from interfacing with digital technology.

As Dourish suggests (2004: 27), interaction with screen and keyboard, tends to demand our direct attention; we have to look at the screen to see what we’re doing, which involves looking away from whatever other elements are in our environment, including other people. The computer sits by the desk and ties us to the desk, too.

The proposed project examines the assumption that advances in physical and tangible computing (a.k.a as tangible user interface[2]) will improve and enhance man-machine interface. The project’s outcomes will provide insight into the sensory, emotive and cognitive functions operating in physical and tangible computing. 
It will provide test protocols for further experimentation and design principles for natural actions and behaviours from a user that are evidence-based rather than technology-led. This is an ethnographic study. The aim is over people and their experience when coming across such innovations when interfacing with digital technology.

This research is not about the creation of a new software but it is about a profound understanding over the user relation with new technologies for interaction, i.e. physical and tangible computing. These technologies already exist and will be integrated to produce an experience within a known context and little control over the steps the user will choose towards the completion of a task. The digital environment will be an Operational System (OS) like Windows, Macintosh or Linux. The real environment should be defined, but if the software is prepared in a laptop the interaction could be carried out anyware. A screen capture software should be running to keep record of the user’s interaction for formal analysis.
___________________________________________
[1] A tangible user interface (TUI) is a user interface in which a person interacts with digital information through the physical environment. The initial name was Graspable User Interface, which no longer is used.
One of the pioneers in tangible user interfaces is Hiroshi Ishii, a professor in the MIT Media Laboratory who heads the Tangible Media Group. His particular vision for tangible UIs, called Tangible Bits, is to give physical form to digital information, making bits directly manipulable and perceptible. Tangible bits pursues seamless coupling between these two very different worlds of bits and atoms.
[2] Physical (or embedded) computing, in the broadest sense, means building interactive physical systems by the use of software and hardware that can sense and respond to the analogue world. While this definition is broad enough to encompass things such as smart automotive traffic control systems or factory automation processes, it is not commonly used to describe them. In the broad sense, physical computing is a creative framework for understanding human beings' relationship to the digital world. In practical use, the term most often describes handmade art, design or DIY hobby projects that use sensors and microcontrollers to translate analogue input to a software system, and/or control electro-mechanical devices such as motors, servos, lighting or other hardware.

Sunday, 6 December 2009

TED: Pranav Mistry is the inventor of SixthSense, a wearable device that enables new interactions between the real world and the world of data.

This is what I want for my research...Hope it is feasible...At TEDIndia, Pranav Mistry demos several tools that help the physical world interact with the world of data -- including a deep look at his SixthSense device and a new, paradigm-shifting paper "laptop." In an onstage Q&A, Mistry says he'll open-source the software behind SixthSense, to open its possibilities to all.

Thursday, 3 December 2009

RAatE 2009: Recent Advances in Assistive Technology & Engineering 2009

The conference took place in the Hotel Hilton Coventry on Monday 30th November and Tuesday 1st of December, sponsored by the HDTI (Health Design & Technology Institute), from Coventry University. It was a great conference (first use of my bench fee) and the city of Coventry is very nice as well.
The first day I could participate in a wokshop from Smartbox - Assistive Technology Ltd where Adam Waits and other professionals within the company presented Tobii equipment and software for assistive technology. Enjoyed very much the presentation of all Tobii equipment as well all explanation on how it works with disabled and non-disabled people, etc.
A few videos I could capture during the workhop - thank you for letting me record it guys!



Me, playing with Tobii P-10 (it worked pretty well):



Me, playing with Intelligaze from Alea Technologies, the less expensive and plug and play in any computer running regular OS (Thank you Adam):



Here are my thoughts after all: For sure, special software for people with special needs are very needed and very welcome - I saw them working beautifully (large icons, simplified commands), but regarding non-disabled people I guess a mix of eye control with other features (like touch screen, voice command, gesture recognition, etc.) plus the standard mouse-keyboard interface will bring better results. When operating regular desktop - with small icons - I found rather difficult to keep my attention over a small object, where so many other colours and elements within the screen were calling my gaze. 

On the second day I could see presentations about Smart housing, Voice recognition, Gaze control, Speech driven environmental control, EyeSequencer (playing music with eye gazing and eye dwelling), television and touch screen set, etc. Great days, great contacts, could bring a few software demos from ClaroRead and Oksa (face recognition), both from Claro Software.

Sunday, 29 November 2009

CRNS: Inaugural Workshop on Robotics and Neural Systems

On November 26th in Plymouth City Museum and on the 27th in Portland Square Building took place a conference/workshop in Robotics and Cognition from CRNS: Centre for Robotics and Neural Systems in Plymouth University.
It was a great conference, approaching subjects like AI, evolution of robots, cognitive systems, robots that learn, vision system (BunnyBot from Phil Culverhouse), neural circuits & visual cognition, etc.
ChristianGoerik from Honda and Steve Furber from Manchester University and Hans-Georg Stork from the European Comission, Cognitive Systems Unit. were the keynote speakers.
On the second day we could see several posters and all robots and devices were in the Roland Lewinsky, through two floors. Great learning and high level conversations.


On the left a study for a robot that reacts from our facial expressions and display expressions in accordance. The image is projected from behind the artificial face (pictures from my friend João Paulo).


And once again the robot iCub in action (picture from my friend João Paulo). :


















On the end we could play a "robot soccer" against an AI team - in the picture a "goal" moment...The robots actually comunicate aming themselves, informing position, calling for help, spinning, blocking, etc. We won a game, final score 1x1. (movie from my friend João Paulo). 

Watch a video:

Thursday, 26 November 2009

I just can't stop watching TED: Talks David Merrill demos Siftables

Again, Marcelo always surprises me with great links:



Again, ubiquity and no screens at all. Objects, like modules, used as recreation purposes, educational and work as well. Watch until the end and imagine a DJ playing and mixing with those cubes in a club...tangible computing at its best.

Some inspiration: writing my abstract

Some parts from my Abstract: "Ubiquitous computing aims to make man-machine interaction invisible, that is, integrating computer technology with natural actions and behaviours from a user, regardless his/her characteristics, limitations, intelligence or ethnic group. Furthermore, having intelligent computers connected with the network all the time is a ubiquitous condition. It’s a pos-modern world where exteriorizing memory is a regular activity. It’s not anymore about human-computer interaction; one might argue that is more about human-technology interaction, where the understanding of the term “computer” belongs to another age."

"The first step to reach this interaction easier or invisible, is the use of natural interfaces, the most primitive ways of expression we have to interact with another human being, which is the use of speech, gestures, touching, presence in the environment or even eye movements, thus leaving the keyboard and mouse with almost no use (or combining with the above-mentioned). For instance, assistive technology for disabled people is a great field of research bringing quite impressive results, allowing people with special needs not to be excluded from interfacing with digital technology." 

"...will people use those interfaces? Or they’re not ready yet for such paradigm break? Maybe the well-known mouse-pointer computer screen will overcome such innovation? In regards to military and recreation purposes it’s already bringing great results and commercial success, but will ubiquitous technology be a success within routine computing work? Those are the subjects that this thesis seeks to investigate."

More Ubiquity: Talks Pattie Maes and Pranav Mistry demo SixthSense

Another great suggestion from my dear friend Marcelo (kiss to Carol, mate). Again ubiquity in a great sense. This time the information is displayed in any surface (merchandise, wall, table, hands...) and with the aid of a device around the neck (that projects information and capture data from the external world) and some thimble around fingers, one can manipulate information without a screen...brilliant! Again and again I wonder what can I do within my research that could just get near to something like this??
Watch the video:

Tuesday, 17 November 2009

Openframeworks: First tests with Eyetracking

I've tried the application downloaded from Eyewriter developer page. Have downloaded Openframeworks as well and installed X-Code for MacOS (compatible with version 10.5). The software should work better with special glasses, close to the beholder's eye, not as shown in the video below:



From my understanding, the camera searches for the darkest point within sight (in the best scenario, the pupil) and follows it, replicating on the screen the point where the user is looking at. In the video we can see that the darkest area (after several configurations) was my eye cavity. Just a test, have to find out how to change it for my research interests.

Monday, 16 November 2009

Aurora interface concept

Regarding Aurora interface concept, from Mozilla Labs. This was created a year ago, but I still consider the concept very interesting in regards to some controversial issues. Very brave and towards paradigm brakedown within browser software and website content and interaction, but at the same time over flooded with Icons and visual/audio metaphors which will require a great amount of abstraction thinking from the user. I see accessibility problems as well: children are not the public here and over aged people will have problems seeing the great amount of details displayed. It's a great idea but might not be to everyone...see for yourself.


Aurora (Part 1) from Adaptive Path on Vimeo.













Jesse James Garrett: "With Aurora, we set out to define a plausible vision of how technology, the browser, and the Web might evolve in the future by depicting that experience in a variety of real-world contexts.
The release of Aurora is part of the launch of Mozilla Labs’ browser concept series, an ongoing initiative to encourage designers and developers to contribute their own visions of the future of the browser and the Web. Over the next couple of weeks, we’ll be releasing more video segments, as well as background material showing just what went into imagining the future of the Web and translating that into a video."

Processing: Flob Library

Again, thank's to my great friend Clarissa Ribeiro I've installed and tested the flob library within the open source software Processing. Her remarks: "flob is a fast flood-fill multi-blob detector that works in processing. It's a jar library that tracks blobs and simple features in processings' image streams. has been tested in windows and mac in several systems. Aims at fast code. many new algorithms: can track blobs with id's, track feature points..."
From my point of view it is a fantastic software. With a simple camera connected to your computer (in my case MacBook built in camera) the camera reacts with movement and displays the most contrasting elements within its view. Now, with regards to my project I've to figure out how to define specific elements, like fingers or eyes so the camera would only detect such elements. Have no idea (for now...) how to do it. A screen capture and some printscreens below:







EyeWriter Initiative

This one was a suggestion from my big friend Marcelo Amaral, from Rio de Janeiro and has everything to do with my research. The EyeWriter project is an ongoing collaborative research effort to empower people, who are suffering from ALS, with creative technologies. Great idea, a camera detects the pupils and reflects on the screen the eye movement from the user. With such project, one can draw anything on the screen. With regards to my research, it would be fantastic if a person could manipulate elements within an interface, like activating buttons, links, rearranging elements, etc.






 












The Eyewriter from Evan Roth on Vimeo.

The eye-tracking software detects and tracks the position of a pupil from an incoming camera or video image, and uses a calibration sequence to map the tracked eye/pupil coordinates to positions on a computer screen or projection. The team uses the GSL (gnu scientific library) for calibration, which is GPL, thus the eye tracking source code is GPL. The EyeWriter software is two parts — an eye-tracking software designed for use with our low-cost glasses, and a drawing software designed for drawing with eye movements.The software for both parts has been developed using openframeworks, a cross platform c++ library for creative development.
The pupil tracking relies upon a clear and dark image of the pupil. The diy glasses designed use near-infrared leds to illuminate the eye and create a dark pupil effect. This makes the pupil much more distinguishable and, thus, easier to track. The camera setting part of the software is designed so the image can be adjusted with brightness and contrast to get an optimal image of the eye.
The calibration part of the software displays a sequence of points on the screen and records the position of the pupil at each point. It is designed so that a person wearing the glasses should focus on each point as it is displayed. When the sequence is finished, the two sets of data are used to interpolate where subsequent eye positions are located in relation to the screen.

Henry Markram builds a brain in a supercomputer

Hint from my friend João Paulo Gomes - PhD student in the CRNS (Centre for Robotics and Neural Sciences), Faculty of Science and Technology, University of Plymouth: Henry Markram says the mysteries of the mind can be solved -- soon. Mental illness, memory, perception: they're made of neurons and electric signals, and he plans to find them with a supercomputer that models all the brain's 100,000,000,000,000 synapses.

Sunday, 15 November 2009

Conferences...

And I should be in this one either: hdti presents RAatE 2009 
Recent Advances in Assistive Technology & Engineering
RAatE 2009 is the only UK conference focused on the latest innovations and developments in assistive technology. This conference will be of interest to everyone who uses, works with, develops or conducts research on assistive technologies (AT).
The conference program has, over the past years, regularly included new technological developments, service innovations, results of formal research projects, service based research and development and a wide range of other stimulating topics.
Known as a friendly and productive conference, RAatE offers you a chance to meet and share knowledge and experience with other people working in AT.
CeBIT:
Oh, I should go in this one...

The leading business event for the digital worldCeBIT is the world's largest trade fair showcasing digital IT and telecommunications solutions for home and work environments. The key target groups are users from industry, the wholesale/retail sector, skilled trades, banks, the services sector, government agencies, science and all users passionate about technology.CeBIT offers an international platform for comparing notes on current industry trends, networking, and product presentations. Deutsche Messe AG has organized CeBIT in Hannover each spring since 1986.

Wednesday, 28 October 2009

Presentation from Angelo Cangelosi in Babbage Building

On 28.10.2009 I saw a presentation from Angelo Cangelosi, Professor of Artificial Intelligence and Cognition in CRNS: Centre for Robotics and Neural Systems in Plymouth University.















Took place in the Babbage building, where he presented several projects worldwide evolving Evolution of language and cognition, Categorical perception and language, Symbol grounding and embodied cognition, Cognitive and neural modelling, Synthetic brain imaging, Information visualisation in adaptive agents, Artificial life and Adaptive behaviour, Multi-agent modelling.

At the end we went back to Portland Square to see the robot iCub:




There will be another presentation on November 26 and 27 in Plymouth City Museum. Watch the video below, showing the robot following objects with its eyes:

Saturday, 24 October 2009

Respect Festival in Plymouth

The Respect Festival took place in Plymouth, on October 24 and 25. From the local paper the Plymouth Herald: Celebrating city's rich diversity. THOUSANDS lined the city's streets to embrace the colour and music of the Plymouth Respect festival. The event celebrating Plymouth's multicultural society with a fusion of music, performance, arts and information, took place throughout the city on Saturday and yesterday. People flocked as a colourful samba parade through the City Centre on Saturday provided irresistible rhythms and beats.



And below, one moment (video) from the event:

Friday, 23 October 2009

Aging...

Birthday with my new friends in the Vault (Pub close to the University of PLY), indeed great moments...

From left to right: Guto Nóbrega, Claudy, João Paulo and Joana.



On the picture below: Claudy, Joana, Guto, Clarissa and myself.





On the end a great Jazz show, in Annabel Cabbaret (The Barbican, PLY)

Thursday, 22 October 2009

Teaching about Vector Image

I taught in Babbage room S211 for 6 hours (three classes) the IDAT107 class, digital image - Illustrator CS3. I was replacing for that day a colleague in the PhD, professor Gianni who went ill. I taught again on the 29th, for the same reason. Great experience for a Brazilian guy to teach in english for 12 hours. I am thankful for the opportunity, Mike (my Director of Studies) and Gianni.

Presentation from Roy Ascott in Roland Levinski building

On 22.10.2009 I could be in a presentation from Roy Ascott in Roland Levinski building, University of PLY.















He has been a practitioner of interactive computer art, electronic art, cybernetic and telematic art. He spoke about Technoetics, Syncretic approaches to digital interactive art, behaviorist art, radical practice, critical discourse, immersive experience, pos-biological, moist media. Quotes: "Cybernetics is about behavior, is about the user changing the environment. Cybernetics is about diversity." "In behaviourist art the process is what matters." "We came from Modern, to Pos-Modern to Syncretic era.".




Roy Ascott and his wife.

Thursday, 15 October 2009

IVT: Immersion Vision Theatre

On the 15th I could wath a presentation in the Immersive Vision Theatre (IVT) showing some videos created specifically for the high quality 360º projector. Watch one of the videos below:



Afterwards I had my first Guiness pint in PLY with my Director of Studies, Mike Phillips. Here's a link for my profile as well, within i-DAT (Institute of Digital Art and Technology).















From left to right: Jacques, Mike Phillips, Musaf (IVT) and Clarissa Ribeiro, a great brazilian friend from MG-Brasil, doing her sandwich PhD (Brazil-UK) in PLY.

Monday, 12 October 2009

Arriving in UK

Arriving in Plymouth, on 12.10.2009 after almost 18 hours (flight from Rio de Janeiro - RJ to Paris, then to Bristol and finally a train to Plymouth).














The picture shows the coast of Devon - Cornwall. The flight from Paris to Bristol was in a small twin-engine plane...scary...