Final Projects
Penny Games
This project explores a genre of charitable mixed reality games called penny games, which aim to integrate virtual coin-pieces in augmented mini-games with real-world monetary donations. Our implementation of a specific penny game is Coins for Climate, in which a non-profit designs an entry point or marker to start the game, and users are tasked to shoot coins at pollutants and bulldozers to protect a tree that they planted. Video
ArcheX
This project examines the application of augmented reality in early stage architectural design through volumetric shape manipulation. We present ArcheX, an augmented application that facilitates architectural exploration. The system supports creating 3D shapes, manipulating their size, location, and orientation, and removing them from the scene. Virtual object manipulation provides architects an easy way to augment, move, transform the components of their design model to obtain a general idea of what structure they want their building to resemble before using modeling software to fill in precise measurements and geometries. Video
Beyond The Cup
Beyond the Cup (BTC) is an interactive tabletop augmented reality system that increases user empathy surrounding the coffee industry. BTC is instrumented with two RGB cameras, 2 optical projectors, and two projection screens placed perpendicular to each other, and is designed for the use case of an interactive exhibit in a coffee shop or a coffee-themed museum. Video
SCANME
SCANME is a project that allows people to use augmented reality to set a social digital status. SCANME gives users the creative freedom afforded by augmented reality to communicate with their friends and digitally augment their identity to share with strangers. When designing SCANME, we used the HCI process to enhance accessibility, content viewing interactions, and privacy. Video
PianoLens
Pianolens is an augmented reality system built on the Microsoft HoloLens platform which assists players in learning by providing 1) a dynamic and interactive sheet music display, 2) a gaze-based user interface for controlling the playback and loading of different songs, 3) a "piano roll" visualization situated on the keys for note and timing instruction, and 4) MIDI-based interaction for visualizing correctness while playing. We hypothesize that these aids will not only facilitate the learning of new music but also make the rehearsal process more engaging for learners. Video
Project Live
We have developed an augmented reality (AR) system, codenamed ProjectLive, intended to provide stress relief and improve mental health of users. The system provides this stress relief in the form of short, interactive games that prompt the user to exert themselves in ways that approximate Tai Chi exercises. ProjectLive uses butterflies as the "instructor" which provide the user with hand movement guidance. The user is given positive feedback if they correctly follow the butterflies. The activities are further customized to the user by taking into consideration the user's biometric markers, primarily heart rate, using the Microsoft Band. Video