Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Page not in menu
This is a page not in th emain menu
Posts
Future Blog Post
Published:
This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.
Blog Post number 4
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 3
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 2
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
Blog Post number 1
Published:
This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.
book_secs
Making End User Development More Natural
Published:
Teaching Agents When They Fail: End User Development in Goal-Oriented Conversational Agents
Published:
Demonstration + Natural Language: Multimodal Interfaces for GUI-based Interactive Task Learning Agents
Published:
Download here
minor_pubs
Smartphone Text Entry in Cross-Application Tasks
Published:
Download here
Designing a Conversational Interface for a Multimodal Smartphone Programming-by-Demonstration Agent
Published:
Download here
End User Mobile Task Automation using Multimodal Programming by Demonstration
Published:
Download here
Supporting Co-adaptive Human-Agent Relationship through Programming by Demonstration using Existing GUIs
Published:
Download here
How End Users Express Conditionals in Programming by Demonstration for Mobile Apps
Published:
Download here
A Multi-Modal Approach to Concept Learning in Task Oriented Conversational Agents
Published:
Download here
Interactive Task and Concept Learning from Natural Language Instructions and GUI Demonstrations
Published:
Download here
Towards Effective Human-AI Collaboration in GUI-Based Interactive Task Learning Agents
Published:
Download here
Building an Interactive Storytelling Conversational Agent through Parent-AI Collaboration
Published:
Download here
AI as an Active Writer: Interaction strategies with generated text in human-AI collaborative fiction writing
Published:
Download here
Bridging the Gap Between UX Practitioners’ Work Practices and Machine-Learning-Enabled Design Support Tools
Published:
Download here
Computational Approaches for Understanding, Generating, and Adapting User Interfaces
Published:
Download here
MIMOSA: Human-in-the-Loop Generation of Spatial Audio from Videos with Monaural Audio
Published:
Download here
The Future of Computational Approaches for Understanding and Adapting User Interfaces
Published:
Download here
SHAI 2023: Workshop on Designing for Safety in Human-AI Interactions
Published:
Download here
An Empirical Study of Developer Behaviors for Validating and Repairing AI-Generated Code
Published:
Download here
patents
publications
WikiBrain: Democratizing Computation on Wikipedia
Published in Proceedings of the 10th International Symposium on Open Collaboration (OpenSym / WikiSym 2014), 2014
Download here
Leveraging Advances in Natural Language Processing to Better Understand Tobler’s First Law of Geography
Published in Proceedings of the ACM Conference on Advances in Geographic Information Systems (SIGSPATIAL 2014), 2014
Download here
Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations
Published in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020): System Demonstrations, 2020
Download here
Privacy-Preserving Script Sharing in GUI-based Programming-by-Demonstration Systems
Published in Proceedings of the ACM on Human-Computer Interaction (CSCW 2020), 2020
Download here
Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications
Published in Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2020), 2020
Download here
Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs
Published in Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2020), 2020
Download here
Screen2Vec: Semantic Embedding of GUI Screens and GUI Components
Published in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI 2021), 2021
Download here
StoryBuddy: A Human-AI Collaborative Agent for Parent-Child Interactive Storytelling with Flexible Parent Involvement
Published in Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI 2022), 2022
Download here
Fantastic Questions and Where to Find Them: FairytaleQA–An Authentic Dataset for Narrative Comprehension
Published in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022), 2022
Download here
It is AI’s Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset
Published in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022), 2022
Download here
A Bottom-Up End-User Intelligent Assistant Approach to Empower Gig Workers against AI Inequality
Published in Proceedings of the 1st Symposium on Human-Computer Interaction for Work (CHIWORK 2022), 2022
Download here
An Empirical Study of Model Errors and User Error Discovery and Repair Strategies in Natural Language Database Queries
Published in Proceedings of the 28th ACM Conference on Intelligent User Interfaces (IUI 2023), 2023
Download here
PaTAT: Human-AI Collaborative Qualitative Coding with Explainable Interactive Rule Synthesis
Published in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2023), 2023
Download here
PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data
Published in Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2023), 2023
Download here
VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping
Published in Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2023), 2023
Download here
Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations
Published in Proceedings of the the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023), 2023
Download here
From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX
Published in Proceedings of the ACM on Human-Computer Interaction (CSCW 2024), 2024
Download here
Not at Home on the Range: Peer Production and the Urban/Rural Divide
Published in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), 2016
Download here
SUGILITE: Creating Multimodal Smartphone Automation by Demonstration
Published in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI 2017), 2017
Download here
Programming IoT Devices by Demonstration Using Mobile Apps
Published in Proceedings of the International Symposium on End User Development (IS-EUD 2017), 2017
Download here
PrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps
Published in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (PACM IMWUT / UbiComp 2017), 2017
Download here
KITE: Building conversational bots from mobile apps
Published in Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys 2018), 2018
Download here
APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions
Published in Proceedings of the 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC 2018), 2018
Download here
PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations
Published in Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST 2019), 2019
Download here
CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models
Published in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2024), 2024
Download here
Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
Published in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2024), 2024
Download here
SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers
Published in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2024), 2024
Download here
An Empathy-Based Sandbox Approach to Bridge the Privacy Gap among Attitudes, Goals, Knowledge, and Behaviors
Published in Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2024), 2024
Download here
EyeTrans: Merging Human and Machine Attention for Neural Code Summarization
Published in Proceedings of the ACM International Conference on the Foundations of Software Engineering (FSE 2024), 2024
Download here
MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos
Published in Proceedings of the 16th ACM Conference on Creativity and Cognition (C&C 2024), 2024
Download here
SQLucid: Grounding Natural Language Database Queries with Interactive Explanations
Published in Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2024), 2024
Download here
Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI
Published in Proceedings of the ACM on Human-Computer Interaction (CHI PLAY 2024), 2024
Download here
Careful About What App Promotion Ads Recommend! Detecting and Explaining Malware Promotion via App Promotion Graph
Published in The Network and Distributed System Security Symposium (NDSS 2025), 2024
Download here
talks
Atlasify – The Geography of Everything
Published:
Atlasify – The Geography of Everything
Published:
Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations
Published:
teaching
UMN: CSCI2011 Discrete Structures of Computer Science
, I worked as a Teaching Assistant for this course in Fall 2013 with Prof. Carl Sturtivant and in Spring 2014 with Prof. Rui Kuang. Topics covered in CSCI2011 included intro-level set theory, number theory, combinatorics, probability, proof and graph theory. My responsibilities were leading two weekly 50-student recitation sessions, holding weekly office hour sessions and grading assignments/quizzes., 2013
Coursera: From GPS and Google Maps to Spatial Computing
, This course is a free online course that introduces the fundamental ideas underlying spatial computing services, systems and sciences co-taught by Profs. Brent Hecht and Shashi Shekhar. Topics covered include spatial database, spatial data mining, VGI analysis, positioning, web cartography and relevant algorithms. As of October 2014, this class has reached over 20,000 enrolled students. I served as a teaching staff for this course. My responsibilities included monitoring the discussion forum, providing academic support for students, designing programming assignments and quizzes and recording assignment instruction videos., 2014
CMU: User-Centered Research and Evaluation
, As one of the core “flagship” courses for CMU’s Master in HCI program, this course introduces the skills and concepts of Human-Computer Interaction (HCI) that enable computer scientists to design systems that effectively meet human needs. A concrete illustration of the practice of HCI, this course covers iterative design processes, interactive prototype construction, discount evaluation techniques, and the historical context of HCI. I TA’d this course with Profs. Amy Ogan, Raelin Musuraca, and Chris Connors. My responsibilities included holding weekly office hours, leading recitation sessions, and designing assignments, projects, and exams., 2018
CMU: Designing Human-Centered Software
, DHCS is CMU’s main “introduction to HCI” course. This course introduces the skills and concepts of Human-Computer Interaction (HCI) that enable computer scientists to design systems that effectively meet human needs. A concrete illustration of the practice of HCI, this course covers iterative design processes, interactive prototype construction, discount evaluation techniques, and the historical context of HCI. I TA’d this course with Prof. Chris Harrison in Spring 2019. My responsibilities included holding office hours, grading assignments, and help conducting project “bakeoffs”., 2019
Notre Dame: Human-Centered Computing Research
, I developed a new doctoral level HCI research course for graduate students in Computer Science and Engineering at Notre Dame. This course provides an introduction to the different types of contributions, the foundational theories, and the core methods for research in HCI and human-centered research in other CS disciplines., 2021