Shaping the Human-Technology Frontier

Shaping the Human-Technology Frontier

IPaT is shaping the human-technology frontier by augmenting human capabilities at every level. We're exploring new ideas in user experiences that foster creativity, stimulate learning and enable productive collaboration. Through this initiative, we're researching and developing novel wearable computing, assistive, augmented reality, and gaming technologies.


Back to Main
BrainBraille: Towards 100bpm+ Typing with a Haemodynamic Response-based Brain-Computer Interface
BrainBraille: Towards 100bpm+ Typing with a Haemodynamic Response-based Brain-Computer Interface
Most high-speed non-invasive BCI typing systems require intense visual attention and feedback. BrainBraille investigates a more open-loop approach similar to touch typing. BrainBraille enables communication at 20 characters per minute (cpm) by...

GEORGIA INSTITUTE OF TECHNOLOGY The Scientific Way of Thinking using VERA - Part 2
Virtual Ecological Research Assistant (VERA)
Accelerating scientific discovery using AI technologies.

VERA - The Virtual Ecological Research Assistant
Virtual Ecological Research Assistant (VERA)
Accelerating scientific discovery using AI technologies.

Using AI to understand the spread of COVID-19
Virtual Ecological Research Assistant (VERA)
Using AI to understand the spread of COVID-19 is part of accelerating scientific discovery using AI technologies.

Virtual Teaching Assistant: Jill Watson
Virtual Teaching Assistant: Jill Watson
IBM CEO Ginni Rometty discussing "Jill Watson" (an AI teaching assistant) with Dr. Ashok Goel. It has been said that Jill Watson is the most famous teaching assistant in the world. Jill's origin actually is quite humble. She was conceived in summer...

Jill Watson TA-explained by masters student
Virtual Teaching Assistant: Jill Watson
A human teaching assistant discusses "Jill Watson" (an AI teaching assistant). It has been said that Jill Watson is the most famous teaching assistant in the world. Jill's origin actually is quite humble. She was conceived in summer 2015 with the...

Artificial Intelligence (AI) through Symbiosis
Artificial Intelligence (AI) through Symbiosis
We're using a revolutionary new approach to optimizing the process of order picking. Contrary to traditional methods, we want to use smart head-worn displays (HWDs) to enable our users to detect and correct errors during order picking in real-time,...

Environments that Support Speech Perception
Encouraging Speech Perception in Individuals with MCI through Improved Sound Environments
Our goal is to improve the speech perception of individuals with mild cognitive impairment in a therapeutic facility through the design of the sound environment. Discerning speech is complex task that is an interplay between the receiver's cognitive...

Convergence Innovation Competition banner
Convergence Innovation Competition
The Convergence Innovation Competition (CIC) is a unique competition open to all Georgia Tech students and is run in both the Fall and Spring semesters. Each year the categories in the CIC are defined by our Industry partners who provide mentorship...

SHAKTI: A Storytelling Collective of Professional Practices in Digital Accessibility
SHAKTI: A Storytelling Collective of Professional Practices in Digital Accessibility
This project aims to provide resources for someone interested in a career in accessibility and inclusive design. Using storytelling, it aims to show people the varied paths that others have taken to achieve their goals, tools they have used, lessons...

Gaming and Esports Applied Research
GEAR: Gaming & Esports Applied Research
Gaming for good.

optosense
OptoSense: Ubiquitous Self-Powered Imaging Surface
OptoSense is a ubiquitous Imaging Surface which conforms to everyday objects, harvests energy from ambient light, and senses a variety of human activities without compromising privacy. By leveraging organic semiconductor (OSC) optoelectronics with...

Silver Tape
Silver Tape: Inkjet-Printed Circuits Peeled-and-Transferred on Versatile Substrates
We propose Silver Tape, a simple yet novel fabrication technique to transfer inkjet-printed silver traces from paper onto versatile substrates, without time-/space- consuming processes such as screen printing or heat sintering. This allows users to...

primal clay.jpg
Digital Craft - Primal Clay
Learning from craft practices, tools, and crafters to enhance media and interaction design.

digital craft
Digital Craft - Wood
Learning from craft practices, tools, and crafters to enhance media and interaction design.

These Gloves Hack Your Brain
Passive Haptic Rehabilitation: Improve Sensation and Dexterity after Traumatic Injury Using Wearables
Our Passive Haptic Learning gloves teach the "muscle memory" of how to play piano melodies without the learner's active attention. These gloves can also help wearers recover sensation in their hands after a traumatic event, such as a partial spinal...

augmentally app
Helping children with dyslexia read faster using Augmented Reality
Augmenta11y is an Augmented Reality (AR) app that helps people with learning disabilities like dyslexia easily read textual material in the real world using their smartphones and tablets. By giving users customizable font styles, background colors,...

Using VR to test UI prototypes with environmental cues
Using VR to test UI prototypes with environmental cues
The purpose of this project is to validate the following research question: Would testing UI prototypes in a simulated virtual reality environment provide a better experience to testing in a usability lab setting? Better experience‚ is defined as...

CopyCat: Helping Young Deaf Children Acquire Language Skills Using Sign Language Recognition
CopyCat: Helping Young Deaf Children Acquire Language Skills Using Sign Language Recognition
CopyCat and PopSign are two games that help deaf children and their parents acquire language skills in American Sign Language. 95% of deaf children are born to hearing parents, and most of those parents never learn enough sign language to teach...

Silent Speech Recognition
Silent Speech Recognition
SilentSpeller enables mobile silent texting using a dental retainer with capacitive touch sensors to track tongue movement. Users type by spelling words without voicing.

Cognitive AR: Manipulating Augmented Reality to Support Learning and Work
Cognitive AR: Manipulating Augmented Reality to Support Learning and Work
Utilizing augmented reality to support workers and trainees in the performance of complex cognitive and motor tasks.

Helping Non-Native English Speaking Students in the States Learn English
Helping Non-Native English Speaking Students in the States Learn English
This is an ongoing MSHCI master project. With this project, we want to understand problems non-native English speaking students have studying in the states and develop new solutions to address these problems.

RERC TechSage: SmartBathroom
RERC TechSage: SmartBathroom
The needs and abilities of people who are aging with progressive chronic conditions, such as MS, Parkinson's, ALS and Arthritis fluctuate from day to day. Yet, even when they have supportive AT, such as grab bars, to compensate for functional...

Real-time Captioning
Captioning on Glass: captioning eyeglasses for the deaf and hard of hearing
Captioning on Glass is an on-going project creating captioning eyeglasses with a companion Android phone app to assist the hard-of-hearing in everyday conversations. We are also working on another version of this app, "Translation on Glass", which...

Gait Speed Measurement for the Clinical Workflow
RERC TechSage: A Mobile Application to Measure Gait Speed
Multiple studies have shown a consistently strong association between gait speed of frail older adults and negative functional (e.g., survival) and activity outcomes. However, health care professionals have been slow to measure this physiologic...

Wearable Technology Designer's Web Tool
Wearable Technology Designer's Web Tool
The Wearable Technology Designer's Web Tool WTDWT is a tool that leads designers / developers through a series of questions about their wearable technology project. The questions are designed to force designers to think of all options at the...

Empowering Esports graphic
Empowering Collegiate Esports Teams to Communicate Better
As our Master's Project for the MS HCI degree, David and I worked closely with collegiate esports teams and athletes to understand how teams communicate and improve their comm. practices. Through a UCD process, we gained insights into their...

FossilVR graphic
FossilVR: Using Virtual Reality to integrate science and ELA topics for K-5 students
Fossil VR is a virtual reality tool that allows students to accompany a paleontologist into the field to find fossils and make observations and inferences about their findings.

ada design
Elementary Student Adjustment Tracker
A platform that allows teachers, counselors and parents to follow student's adjustment behaviors.

Audo PPT
Audo: A Sound-Based Virtual Coworking Space
Before the onset of the pandemic, we used to be able to visit public places, like library and cafes, where we could work and enjoy the atmosphere of having others around. But then the pandemic hit, and with it came remote work where many were forced...

Bit Whisperer
Bit Whisperer: Enabling Ad-hoc, Short-range, Walk-Up-and-Share Data Transmissions via Surface-bound Acoustics
We introduce Bit Whisperer, an ad-hoc short-range wireless communication system that enables "walk up and share" data transmissions with "good enough" security.

Children's Educational Water Play screen shot
Children's Educational Water Play
MS-HCI Master Project-Partnered with Children's Museum of Atlanta, our project aims to develop a water play that educates children under 12 years old with a limited knowledge base about concepts of plastic pollution and the protection of ocean life.

ChoreKit: a mobile app screenshot
ChoreKit: a mobile app helps manage all aspects of a household efficiently and delightfully
The problem: There’s an uneven distribution of time and effort every family member devotes in doing chores. Usually there’s one person, usually women, in each household that naturally take on more responsibility in managing the household, even...

Connecting Social Media Influencers and Small Business Owners
Connecting Social Media Influencers and Small Business Owners
Providing a platform for social media influencers and small business owners to foster a better connection and collaboration.

Design Method and Application on Voice-Centered Seamless Multimodal Experience in Future Automotive Human-Machine Interface
Design Method and Application on Voice-Centered Seamless Multimodal Experience in Future Automotive Human-Machine Interface
Using a user-centered research approach, this project explored possible scenarios for voice interaction inside cars in the next 3-5 years and developed a set of voice interaction design tools.

Developing a K-2 Remote Art Education Platform
Developing a K-2 Remote Art Education Platform
This study will be focused on studying and developing teaching and technological supports to facilitate remote art instruction and art museum exhibits in K-2 education.

Helping Astronauts Explore Mars Autonomously
Helping Astronauts Explore Mars Autonomously
Future surface EVAs on Mars will be exploratory in nature and require flexible geospatial tools to support dynamic operations. These EVAs will have limited support from ground control and will need to be executed autonomously. This new dynamic will...

In Tune: A tool to improve 1:1, online piano lessons
In Tune: A tool to improve 1:1, online piano lessons
For my master's project, I designed In Tune - a tool to improve 1-1, online piano lessons for beginner to intermediate students and their teachers. My design enhances the connection and collaboration between a teacher and a student and helps them...

Mi Casa Mis Derechos
Mi Casa Mis Derechos: A mobile narrative site for tenant education
Tenants facing eviction often approach Welcoming Atlanta (WA) when it is too late: they reach out when the eviction is already ongoing, they have already relocated, or rent interest is already accruing to large sums. Aside from emergency action,...

Project Aether: A tool to support communication between brain tumor patients and healthcare providers
Project Aether: A tool to support communication between brain tumor patients and healthcare providers
Project Aether focuses on bridging the knowledge gap brain tumor and peak anxiety brain tumor patients experience after their initial diagnosis. As a tablet application, it comprises a patient workspace for consolidating information relating to...

Reflecting on Ethics Through Interactive Gameplay
Reflecting on Ethics Through Interactive Gameplay
An interactive fiction game, looking at the labor dynamics in a clothes factory, one of the first factories to be set up in the U.S.

Smart Webcam Cover: Exploring the Design of an Intelligent Webcam Cover to Improve Usability and Trust
Smart Webcam Cover: Exploring the Design of an Intelligent Webcam Cover to Improve Usability and Trust
Laptop webcams can be covertly activated by malware and law enforcement agencies. Consequently, 59% percent of Americans manually cover their webcams to avoid being surveilled. However, manual covers are prone to human error–through a survey with...

Social Sensing to Support PTSD Therapy
Social Sensing to Support PTSD Therapy
The Social Sensing study is studying the inclusion of social support in therapy for Veterans with PTSD as a part of the larger Prolonged Exposure Collective Sensing System study led by Dr. Rosa Arriaga from Georgia Tech's College of Computing and...

Speech on Twitter - Evaluation, Intervention and Solutions
Speech on Twitter - Evaluation, Intervention and Solutions
In this project, I designed and developed a research dashboard for researchers to better understand Speech on Twitter. Through extensive user research, I understand user pain points and identified key values. Based on this, I designed and developed...

Spidey Sense: Designing Wrist-Mounted Haptics to Improve Awareness of Cybersecurity Warnings
Spidey Sense: Designing Wrist-Mounted Haptics to Improve Awareness of Cybersecurity Warnings
We designed and implemented a novel smartwatch wristband, Spidey Sense, that can produce expressive and repeatable squeezing sensations and effectively explore the design space of squeezing patterns.

Tangible and Auditory Periodic Table for Visually Impaired Students
Tangible and Auditory Periodic Table for Visually Impaired Students
This project is focused on designing a tangible and auditory periodic table educational tool for visually impaired and sighted students.

The STEAM Playground: An Educational Home Experience
The STEAM Playground: An Educational Home Experience
The STEAM Playground is an augmented reality fraction learning experience with storytelling and tangible artifacts. With help from the Georgia Department of Education, we pinpointed student issues with learning and comprehending fractions and...

Visual Analogies
Visual Analogies

Visual analogies on intelligence tests.



Building Blocks: Learning Visual Design Independently
Building Blocks: Learning Visual Design Independently
Designing a curriculum builder that provides curated resources to learning the fundamentals of visual design.

Insights: A Productivity Evaluation Tool
Insights: A Productivity Evaluation Tool
We were inspired by the COVID-19 pandemic, in which a lot of people work remotely or design their own work schedules. While flexibility is good, it is also accompanied by people being unsure of their actual productivity. So we wanted to help...

The emPrize project - Agent Smith
The emPrize project - Agent Smith
As part of the Jill Watson Suite of Tools for Education, Agent Smith enable anyone to build their own agents.

Wind-based Interaction Techniques
Wind-based Interaction Techniques
Exploration in using the sensation of wind as a computation interface and calm technology.