The Problem
How can housebound people have immersive social experiences?
UX Tools and Techniques Used
• Coding
• Desk and Original Research
• Prototyping
• Sketching
• Thematic Analysis
• UI Design
• Usability Testing
• Video Production
• Desk and Original Research
• Prototyping
• Sketching
• Thematic Analysis
• UI Design
• Usability Testing
• Video Production
Also, in terms of soft skills, the project required:
• Collaboration
• Communication Skills
• Communication Skills
The Assignment
Design a novel interactive physical user interface prototype using methods of physical computing and digital fabrication - addressing a concrete problem.
I chose to address social isolation and loneliness, one of our major social problems, which can lead to depression and increased risk of physical heath deterioration, particularly with seniors.
This portfolio page is based on the design process poster presentation prepared for the Physical Computing and Prototyping module of my UCL HCI Master's Degree. (The poster can be viewed at the foot of the page).
NB The related paper Using Portable Telepresence Technology to Enable Live, lmmersive,
Participatory Social Experiences For Users With Motor Neurone Disease in the Writing section of this website covers the research, co-design and user testing of ParticiPod in more detail.
Participatory Social Experiences For Users With Motor Neurone Disease in the Writing section of this website covers the research, co-design and user testing of ParticiPod in more detail.
The Inspiration
One night in a pub a friend said "imagine this camera was streaming video to one of our friends who couldn't make it here tonight". I've been passionate about the issue of social isolation and loneliness for some years (see Mindings), so that struck a chord. I imagined a new kind of portable telepresence device, with a user at the other end wearing a VR headset and having immersive experiences. I sketched it, a colleague suggested adding arms, then I built a model. Carrying it around with me I was surprise by how happily people interacted with it. I then learned about the power of anthropomorphism: making something look human encourages interaction. So, I stuck a phone in a Mr Potato Head toy and my daughter and her cousin enjoyed talking to me through it. That was the inspiration for "ParticiPod". I thought it would be great for parents working away from home or to help encourage cross-generational interaction.
Original picture when playing with 360° camera, that inspired ParticiPod.
TelePresence Pod - the original sketch.
User Testing the first non-working prototype.
User Testing the first Mr Potato Head prototype with children.
The problem, and how the solution could help
A fellow student was intrigued by ParticiPod and told me about his work with people living with Motor Neurone Disease (MND). Social interaction for people living with MND is very limited. If not stuck in a hospital, their world can be confined to a single room in an adapted home. Communication is difficult and visiting can required complex logistics. Could ParticiPod be useful for this group of people?
Co-Design and User Testing
People Living with MND
Co-design sessions were planned in the homes of three people living with MND. They took the form of informal semi-structured interviews, in order to gain insight into their day-to-day lives, and their abilities and limitations. We introduced the co-designees to the basic concept of a 360° video and VR headset and the sessions iterated from there.
The key findings were:
• Worries around social situations and being either ignored, or people considering having to interact with a device being a burden.
• Concerns about being taken seriously if the device's form-factor was a caricature.
• The need to be a physical presence in a space, and have emotional expression.
Healthcare Professionals
ParticiPod was presented at a meeting of the Augmented and Alternative Communication London group. A discussion followed, and a questionnaire was filled out by attendees. Some insights included:
• The need for simplicity of use, as a lot of support from carers (who may be non-technical) may be required.
• Users with neurodisabilities have vestibular problems, so motion sickness could be an issue.
An interesting discussion followed regarding agency - ParticiPod being manhandled and moved around against the users will - akin to people grabbing a wheelchair and moving someone when they didn't ask to be moved. Or, even worse, ParticiPod being switched off without permission. Clearly, some rules of etiquette and boundaries would need to be considered.
Co-design session in the home of a person living with MND. (360° camera image).
Discussing ParticiPod with AACLondon, the Alternative and Augmentation Communication Group.
Design Iterations based on Feedback
Although the form-factor of the Mr Potato Head and the ability to personalise it was popular, we decided to build a version with a digital screen that could display photo-realistic facial expressions for when ParticiPod's face being too much of a caricature might be inappropriate.
In order for ParticiPod to have a physical presence, we gave it moveable arms, and a rotatable waist, so if in a group, it could turn to an individual and have hand gestures to enhance emotional expression.
ParticiPod's "face", based on photographs of the user.
How does it work?
ParticiPod is a hacked Mr Potato Head with three servos that make its arms wave and body rotate. Its face is a TFT screen driven by an Arduino with a programme that changes facial expression at the touch of a button. A 360° video camera gives ParticiPod its 'eyesight' when connected to a mobile phone and a streaming 360° video service such as YouTube Live. The prototype is controlled by a remote, powered by an Arduino Nano, and has with three joysticks for movement. Future developments will include twin microphones for immersive binaural sound, buttons to change the facial expressions, and a whistle to attract attention when ParticiPod is being ignored.
Ultimately, a VR head-set with eye-tracking will provide the control system for users who cannot physically interact with controls.
Early sketches of ParticiPod.
Servos inside ParticiPod.
Prototype of Arduino Nano-controlled ParticiPod.
Conclusion/Feedback
From an idea in a pub, to a sketch, to a cardboard model, to an ever-adapting working prototype, every stage of ParticiPod's development has been driven by discussion, co-design and user testing with real users. ParticiPod has been tested with students in cafés, children in their home, families at Sunday lunch, people with MND and their carers, and a conference of speech therapists. Not only has the set of requirements been developed, but also some rules of etiquette.
The approach was validated when, in March 2018, ParticiPod was presented by a UCL team at the finals of the Human Robotics Interaction 2018 Student Competition in Chicago, after successfully submitting a competition entry paper.
The UCL HRI team at HRI 2018 In Chicago.
ParticiPod prototypes on display.
Introductory Video
Part of the final assessment of the Physical Computing and Prototyping module was the production of an explanatory video describing the problem and design process:
The Participod Design Poster
The full design poster can be dowloaded as a PDF here:
Design Process Poster for ParticiPod.
Feedback and Reviews
The design project component of the ParticiPod project received a Distinction grade of 84%, as part of the Physical Computing and Prototyping module of the HCI Masters Degree.
The written paper component of the ParticiPod project also received a Distinction grade of 84%, as part of the Accessibility & Assistive Technologies module of the HCI Masters Degree.
Thanks
Thank you to my colleagues with whom I co-wrote the original paper "ParticiPod : Portable Telepresence For lmmersive Activity Sharing": Sriraj Aiyer, Raya Sharbain, Qin Wang, and Heyi Wen.
END