Student Innovation Challenge Program
The WHC Program will feature 6 Student Innovation Challenge Projects. The Student Innovation Challenge invites students to use haptic technology in new, creative ways to solve real-world problems. This year, student teams worked on designing and producing vibrotactile feedback with an open-source and self-contained kit driven by embedded multi-channel audio signal processing. The kit features: LRA vibrotactile actuators, the open-source Syntacts amplifier board (https://www.syntacts.org) for driving vibrators from audio sources, a Raspberry Pi 4 (https://www.raspberrypi.org) with a multi-channel soundcard hat, and SparkFun Qwiic (https://www.sparkfun.com/qwiic) sensors and boards facilitating plug-and-plug prototyping in remote and distributed workspaces. The projects will be presented during Interactive Sessions during which attendees will be able to meet members of the student team and discuss their work by videoconference.
You can also find the detailed program on X-CD, our virtual conference platform.
SIC Session 1 (Thursday, July 8, 2021, 8:30-9:30)
Musical Armband
Members:
- Razvan Paisa
- Anders R. Bargum
Affiliation: Multisensory Experience Lab, Aalborg University, Copenhagen, Denmark
Abstract: Musical Armbrand is a multi-actuator vibrotactile wearable device, designed to augment the music listening experience for persons using cochlear implants. We constructed the device on the principle of multisensory integration that describes how humans form coherent, valid, and robust perception of reality, by processing sensory stimuli from various modalities. Multisensory integration suggests that enhancement can occur only for stimuli that are temporally coincident and propose that enhancement is strongest for those stimuli that individually are least effective – in our case, the auditory one.
The hardware is composed from an array of 7 actuators placed on the underside of the forearm representing musical notes from a diatonic scale. Each transducer can reproduce only one note and the array is following a note-to-position mapping scheme, with the lowest note closest to the wrist, and the higher one closest to the elbow. The haptic signal is generated with Pure-Data, as is the auditory one, and both signals are loaded from MIDI files.
Tactile-Mirror: Improving fingerpad vibrotactile sensation through the wrist
Members:
- Davide Deflorio
- Diar Karim
Advisor: Max Di Luca
Affiliation: University of Birmingham
Abstract: Several conditions (e.g. carpal tunnel syndrome and traumatic median nerve section) affect the innervation of the fingertip with a detrimental effect on tactile perception. Patients affected, however, can still perform roughness discrimination tasks by sensing the vibrations that (despite being attenuated and distorted) propagate from the finger to the wrist. In this research, we built a wearable device with the goal of relaying the vibration at the fingertip to the wrist so as to improve perceptual skills related to vibrotactile roughness discrimination in affected patients. We mounted an accelerometer on the dorsal side of the distal interphalangeal joint of the index finger to capture vibrations generated by sliding the fingertip on a surface. We mapped vibrations experienced by the fingertip to the wrist via an optimised function to generate frequencies in the range of 100-Hz to 800-Hz, which best activate the rapidly adapting mechano-receptors in the wrist. The signal is sent to two actuators positioned on the wrist. The actuators activate in a temporal order according to the direction of finger movement on the surface. We tested our device with three participants to finetune the mapping parameters for three different surface-gratings with smooth, fine and coarse spatial periods.
Vibrotactile data physicalization
(Audience Choice Award)
Members:
- Franklin Bastidas1
- Yhonatan Iquiapaza1
- Mariane Giambastiani1
- Carlos Johansson1
- Renan Guarese2
Advisor: Anderson Maciel1
Affiliations:
- Universidade Federal do Rio Grande do Sul
- Royal Melbourne Institute of Technology
Abstract: Physicalization has been studied by the data visualization research community as a good way to help people to understand and communicate data through physical representation. This type of data representation is widely used in museums as tangible surfaces and mockups, furthermore it is used in the medical field as 3D prints for the study of human organs. However, building physical artifacts to represent data can be expensive and very time-consuming. Another way to build this kind of data visualization is using Augmented or Virtual Reality associated with tangible surfaces or haptic stimulation. In this work, we explore the use of vibrotactile actuators to physically convey additional information to the visual data representation. Likewise, In the context of helping people understand data visualization with limited graphic resources, we propose an adaptive data physicalization surface.
SIC Session 2 (Thursday, July 8, 2021, 12:30-13:30)
Cyborg Crafts: Vibrotactile Tongue Vision (VTTV)
(Honorable Mention Award)
Members:
- Sandra Bae1
- Chris Hill1
- Casey Hunt1
- Netta Ofer1
- Mary Etta West2
Advisor: Daniel Leithinger1,2
Affiliations:
- University of Colorado Boulder, ATLAS Institute
- University of Colorado Boulder, Dept. of Computer Science
Abstract: Vibrotactile Tongue Vision (VTTV) is a programmable, haptic tongue display unit (TDU) that augments visual and auditory experiences through touch and taste. The VTTV system is composed of (i) a seven-segment TDU with embedded LRA motors, (ii) a controller that actuates the motors through user-uploaded files or input from force-sensitive resistors, and (iii) a graphical user interface where users can program and share expressive haptic sequences with customizable intensities. VTTV affords the playful experimentation with edible elements that enhance how users perceive and process tactile information with taste. Example use cases include a watermelon-flavored VTTV programmed to simulate waves and a sunset, and learning to identify letters by tongue to explore concepts in neuroplasticity. With VTTV, users can extend their perception through a tongue-based vibrotactile display as well as create novel interactions that can be shared between users.
Feel the Vibe: A Wearable On-Body Gym Simulator
(Best Overall Interaction Award)
Members:
- Adil Rahman
- Md Aashikur Rahman Azim
- Wen Ying
- Archana Narayanan
Advisor: Seongkook Heo
Affiliation: University of Virginia
Abstract: Impacted by the COVID-19 pandemic, gyms across the globe have either shut down or restricted total capacity. Due to this, everyone has turned to exercising at home regularly. To benefit people with their mental and physical health, we propose a wearable on-body haptic device capable of providing a holistic workout experience at home. Using granular haptic feedback, our proposed system can simulate the feeling of using actual gym equipment. We leverage flex sensors, force sensors, and vibrotactile actuators, all working in tandem to detect workout activity and trigger a granular haptic response to mirror the feedback we receive from various spring-and-pulley based gym machines. The generated granular haptic feedback also motivates free-hand workout routines. Additionally, our system simulates the rhythm of the music using vibrotactile actuators to promote endurance and a positive mood during workouts, allowing users to select from a range of predefined soundtracks, or load their own music. This will be especially useful for people with hearing impairment, who can now enjoy the rhythm of any music while working out. Overall, we have designed this system to encourage all types of people to pursue fitness and to enrich their home workout experience.
Vibroraptile
Members:
- Sri Gannavarapu
- Linnea Kirby
- Yaxuan Li
Affiliation: McGill University
Abstract: Vibroraptile is a vibrotactile display that maps auditory signals from a nature exhibit to give visitors the ability to not only see and hear, but also feel otherwise untouchable animals. Touch is a crucial modality when designing a tool that is inclusive for all populations, including those with disabilities or impairments; furthermore, young visitors who cannot read and visitors who do not speak the language used in the exhibit are unable to gain insight from written information and so can benefit from the addition of haptics. We believe Vibroraptile would be a useful addition to natural history museums, zoos, aquariums, national parks, and animal sanctuaries. For our submission, we simulated a regional exhibit (northeastern North America) by showcasing a day in the life of a blue jay family. With the addition of curated haptics effects, visitors are able to “touch” the animals they hear in our audio soundscape, such as blue jays, mourning doves, chipmunks, woodpeckers, coyotes, and a hawk.