| Title: |
DrawTalking: Building Interactive Worlds by Sketching and Speaking |
| Authors: |
Rosenberg, Karl Toby, Kazi, Rubaiat Habib, Wei, Li-Yi, Xia, Haijun, Perlin, Ken |
| Publication Year: |
2024 |
| Collection: |
Computer Science |
| Subject Terms: |
Computer Science - Human-Computer Interaction, Computer Science - Artificial Intelligence, Computer Science - Computation and Language, Computer Science - Emerging Technologies, Computer Science - Graphics, H.5.2, D.2.2, I.2.7, D.1.7, H.5.1 |
| More Details: |
We introduce DrawTalking, an approach to building and controlling interactive worlds by sketching and speaking while telling stories. It emphasizes user control and flexibility, and gives programming-like capability without requiring code. An early open-ended study with our prototype shows that the mechanics resonate and are applicable to many creative-exploratory use cases, with the potential to inspire and inform research in future natural interfaces for creative exploration and authoring.
Comment: 25 pages, 27 figures; Matching version accepted at UIST 2024 |
| Document Type: |
Working Paper |
| Access URL: |
http://arxiv.org/abs/2401.05631 |
| Accession Number: |
edsarx.2401.05631 |
| Database: |
arXiv |
