CV

Education

• B.S. in GitHub, GitHub University, 2012
• M.S. in Jekyll, GitHub University, 2014
• Ph.D in Version Control Theory, GitHub University, 2018 (expected)

Work experience

• Summer 2015: Research Assistant
  • Github University
  • Duties included: Tagging issues
  • Supervisor: Professor Git
• Fall 2015: Research Assistant
  • Github University
  • Duties included: Merging pull requests
  • Supervisor: Professor Hub

Skills

• Skill 1
• Skill 2
  • Sub-skill 2.1
  • Sub-skill 2.2
  • Sub-skill 2.3
• Skill 3

Publications

WikiBrain: Democratizing Computation on Wikipedia

Leveraging Advances in Natural Language Processing to Better Understand Tobler’s First Law of Geography

Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations

Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems

Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications

Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs

Screen2Vec: Semantic Embedding of GUI Screens and GUI Components

StoryBuddy: A Human-AI Collaborative Agent for Parent-Child Interactive Storytelling with Flexible Parent Involvement

Fantastic Questions and Where to Find Them: FairytaleQA–An Authentic Dataset for Narrative Comprehension

It is AI’s Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset

A Bottom-Up End-User Intelligent Assistant Approach to Empower Gig Workers against AI Inequality

An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries

PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis

PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data

VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping

Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations

From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX

Not at Home on the Range: Peer Production and the Urban/Rural Divide

SUGILITE: Creating Multimodal Smartphone Automation by Demonstration

Programming IoT Devices by Demonstration Using Mobile Apps

PrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps

KITE: Building conversational bots from mobile apps

APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions

PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations

CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models

Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors

EyeTrans: Merging Human and Machine Attention for Neural Code Summarization

MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos

SQLucid: Grounding Natural Language Database Queries with Interactive Explanations

Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI

Careful About What App Promotion Ads Recommend! Detecting and Explaining Malware Promotion via App Promotion Graph

Talks

WikiBrain: Making Computer Programs Smarter with Knowledge from Wikipedia

May 06, 2014

at Minneapolis, MN. May 6, 2014,

Atlasify – The Geography of Everything

May 14, 2015

at Minneapolis, MN. May 14, 2015,

Atlasify – The Geography of Everything

June 25, 2015

at St Paul, MN. Jun 25, 2015,

SUGILITE: Enabling InMind Agent to Learn New Tasks from User Demonstration

May 30, 2018

at Sunnyvale, CA. May 30, 2018,

Teaching Intelligent Agents New Tricks: Natural Language Instructions plus Programming-by-Demonstration for Teaching Tasks

June 25, 2018

at Watsonville, CA. Jun. 25, 2018,

Machine Learning from Human Instruction: Every Person a Programmer

May 24, 2019

at New York, NY. May 24, 2019,

SUGILITE: A Multi-Modal Agent that Learns Tasks from Natural Language and Demonstrations

October 25, 2019

at Pittsburgh, PA. Oct. 25, 2019,

SUGILITE: A Multi-Modal Agent that Learns Tasks from Natural Language and Demonstrations

October 28, 2019

at Pittsburgh, PA. Oct. 28, 2019,

Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations

February 07, 2020

at New York, NY. Feb 7, 2020,

SUGILITE: A Multi-Modal Agent that Learns Tasks from Natural Language and Demonstrations

July 10, 2020

at Seattle, WA. July 10, 2020,

Interactive Systems for Configuring, Extending, and Developing AI Applications

August 12, 2020

at Virtual Visit. Aug. 12, 2020,

Interactive Systems for Configuring, Extending, and Developing AI Applications

October 13, 2020

at Virtual Visit. Oct. 13, 2020,

Teaching

UMN: CSCI2011 Discrete Structures of Computer Science

Coursera: From GPS and Google Maps to Spatial Computing

CMU: User-Centered Research and Evaluation

CMU: Designing Human-Centered Software

Notre Dame: Human-Centered Computing Research

Service and leadership

• Currently signed in to 43 different slack teams