StoryDrawer 儿童-AI协同创作系统

张超,姚琤,吴嘉怡,林伟嘉,柳丽娟,闫戈,应放天

视觉叙事是一种建立在语言创造力和人格创造力基础上的新的创造性表达方式。视觉叙事的关键是在同一时间段叙述和绘画,是一种需要儿童投入创造力的有意义的活动。在需求调查的启发下,本文开发了StoryDrawer,这是一个通过儿童和人工智能(AI)之间协作绘画,为6-10岁儿童提供视觉故事讲述支持的联合创意系统。该系统包括一个基于情境的语音代理和两种由AI驱动的协同策略:将儿童的讲述实时转化为绘画,生成与现有故事内容语义相似的抽象草图。我们对64名儿童进行了一项2 × 2的研究,通过在四种条件下改变两种策略来评估StoryDrawer的效果。结果表明,StoryDrawer激发了参与者的创造性和想法细节,并在一个引人入胜的视觉叙事体验中促进了他们的创造性成果。

Chao Zhang, Cheng Yao, Jiayi Wu, Weijia Lin, Lijuan Liu, Ge Yan, Fangtian Ying

Visual storytelling is a new approach to creative expression based on verbal and fgural creativity. The keys to visual storytelling are narrating and drawing over a period of time, which can be benefcial but also demanding on creativity for children. Informed by needfnding investigations, we developed StoryDrawer, a co-creative system that supports visual storytelling for children aged 6–10 years through collaborative drawing between children and artifcial intelligence (AI). The system includes a context-based voice agent and two AI-driven collaborative strategies: the real-time transformation of children’s telling into drawings, and the generation of abstract sketches with semantic similarity to existing story content. We conducted a 2 × 2 study with 64 children to evaluate the efcacy of StoryDrawer by varying the two strategies in four conditions. The results suggest that StoryDrawer provoked participants’ creative and elaborate ideas and contributed to their creative outcomes during an engaging visual storytelling experience.

已发表论文/Publications

 StoryDrawer: A Child–AI Collaborative Drawing System to Support Children’s Creative Visual Storytelling 

StoryDrawer: A Co-Creative Agent Supporting Children’s Storytelling through Collaborative Drawing

视频链接:StoryDrawer

Previous
Previous

ModBot 水下机器人

Next
Next

ColorGuardian 皮肤纹身