profile picture
HCI Researcher

About

My interest in technology led me to an Electronic Engineering degree and subsequently, a research technician role at Interact Lab and SCHI lab, now consolidated as UCL’s Multi-Sensory Devices group. This experience prompted my pursuit of a PhD in haptic controllers for VR under Diego Martinez Plasencia supervision, while I also developed an open-source force feedback characterization framework for haptic controllers. A multifaceted maker, my expertise spans digital fabrication, VR, and electronics, and I’m intrigued by multisensory and ephemeral displays. I founded creative studio Bubaki Design with artist Catherine Ireton, creating interactive experiences that evoke wonder.

Education

  • PhD in Informatics, Interact Lab (pre-sub)
    • Novel formats for 3D User Interfaces: VR and beyond
  • University of Sussex 2017 - present
  • BEng Elec. Eng (1st)
  • University of Sussex 2012 - 2015

Interests

  • Novel displays
  • Multisensory interfaces
  • Electronic / embedded system
  • VR / XR
  • Human Computer Interaction
  • New Media Art

Publications

Exploring the Effects of Replicating Shape, Weight and Recoil Effects on VR Shooting Controllers

Haptics, VR

Virtual Reality (VR) controllers with realistic force feedback for first-person shooting (FPS) games are emerging to enhance realism and immersion. These controllers imitate the shape, weight, and recoil. This paper explores the impact of these properties on VR performance for general users with no marksmanship experience, providing insights for consumers and manufacturers.

Programmable liquid matter: 2D shape deformation of highly conductive liquid metal in a dynamic electric field.

TUI, Displays

We present a method for transforming liquid into unique organic shapes through controlled electric fields. Our system uses a droplet of liquid metal and electrodes to manipulate its surface tension, resulting in dynamic, reconfigurable shapes. The work explores the potential for programmable materials and reflects on the challenges of controlling liquid in this manner.

Haptic rules! Augmenting the gaming experience in traditional games:The case of foosball

Haptics

This study explores the role of haptic feedback in enhancing traditional, non-digital games. By focusing on haptic-based enhancements in player interactions, the study proposes "haptic rules" to enrich the gaming experience. The study applies this concept to the game of foosball, evaluating its impact on gameplay and user experience.

Collaborations

For the past 7 years, I have been fortunate to assist various researchers in their endeavors. I provided technical support by developing hardware or software for a number of projects. The following is a brief overview of some of the projects that resonated most to me

What Did I Sniff?: Mapping Scents Onto Driving-Related Message

Smell Interfaces

A study was conducted to explore the potential use of the sense of smell in in-car interaction design. Three driving-related messages (Slow down, Fill gas, Passing by a point of interest) were mapped to four scents (lemon, lavender, peppermint, rose). Results showed strong associations between the messages and scents, confirmed in a second study where participants expressed their preferences while completing a simulated driving task. The findings highlight the potential of olfactory communication as a modality in enhancing the in-car experience.

MistForm: Adaptive Shape Changing Fog Screens

Displays

MistForm is a shape-shifting fog display that creates an immersive experience for users. It combines the benefits of shape-shifting interfaces and mid-air displays for a unique blend of form and function. With the ability to change its shape, the display adapts to individual or collaborative needs and even affects the brightness and clarity of the content. Through machine learning and a custom rendering algorithm, MistForm overcomes challenges such as image distortion to deliver an artful, dynamic viewing experience.

TableHop: An Actuated Fabric Display Using Transparent Electrodes

Haptics, Displays

TableHop is an innovative tabletop display that blends self-actuated deformation, vibro-tactile feedback and high-res visual projection on a stretchable spandex fabric surface. Controlled by transparent electrodes, the surface can deform up to 5mm and function as a diffuser for projections while avoiding occlusion. Experience expressive interactions and localized tactile sensations with TableHop, a unique blend of art and technology.

Gustatory Interface: The Challenges of ‘How’ to Stimulate the Sense of Taste

Taste Interfaces, Levitation

This paper delves into the growing trend of gustatory interfaces in HCI. It explore previous works on this topic and categorize them based on the method of stimulation (chemicals, electricity, or heat). The authors then present two new approaches to delivering gustatory experiences: a traditional mouthpiece and a cutting-edge contactless delivery system based on acoustic levitation. The paper highlights the design challenges and opportunities of each approach and looks into overcoming obstacles in stimulating the sense of taste.

Acoustic levitation - Metamaterial bricks and quantization of meta-surfaces

Physics, Metamaterials, Levitation

Traditional acoustic field control approaches use costly phased arrays or fixed lenses. This solution introduces quantal meta-surfaces, using pre-made 3D units called metamaterial bricks for phase delay encoding. By assembling these bricks, meta-surfaces can produce any diffraction-limited acoustic field, leading to acoustic focusing, steering and levitation. This approach simplifies acoustic device design and brings us closer to spatial sound modulation.

Multimodal Mixed-Reality Display System

Displays, Smell Interfaces

I worked on a later development on SensaBubble for an installation for Uniliver, Sensabubble is a chrono-sensory mid-air display system that generates scented bubbles to deliver information via multiple sensory modalities. Technical and user evaluations demonstrate its potential for use in a range of applications, from peripheral displays to engaging gaming and education.

JOLED: A Mid-air Display based on Electrostatic Rotation of Levitated Objects

Displays, Levitation

JOLED is a mid-air display for interactive physical visualization using Janus objects as physical voxels. It uses electrostatic rotation and acoustic levitation to control each voxel's angular position and 3D position, respectively. This paper demonstrates a voxel update speed of 37.8 ms/flip, enabling physical games and interactive displays.

OSpace: Towards a Systematic Exploration of Olfactory Interaction Spaces

Smell Interfaces

OSpace is an approach for designing olfactory interfaces, exploring how different scent delivery, detection, and lingering parameters affect user experience. Results show that scents can be perceived within 10 seconds and disappear in 9 seconds, with or without air extraction. Practical applications are discussed for HCI researchers and practitioners.

Other Work

As a creative technologist, I have explored a wide range of disciplines. My research in multisensory technologies has enabled me to develop innovative interactive works that explore the relationship between people and technology. My work have been featured in exhibitions and publications and I continue to explore the potential of technology in creative practice. I am passionate about pushing the boundaries to create meaningful, engaging interactions between people and technology.

Digital Fabrication

Through my expertise in 3D printing, CNC, and laser cutting, I am able to bring an vision to life easier than ever before. From bespoke sculptures to personalized pieces, these techniques provide the tools to create a truly unique and captivating work of art.

Workshops

At past workshops, I utilized Voice coils and thermochromatic paint to craft dynamic, imaginative approaches to bringing STEAM topics to life. From captivating color-changing art to interactive soundscapes, these creative tools create a truly captivating experience.

XR content and Video Mapping

Through my work with bubbles, smoke, and ice as displays, I have been able to explore a multitude of ways to transform our surroundings into interactive spectacles. From mesmerizing fogscapes to otherworldly ice sculptures, these techniques can create an immersive and captivating atmosphere.

Get in touch