Arts, Data, and Immersive Storytelling with OpenAI and Three.js
This course, “Arts, Data, and Immersive Storytelling with OpenAI and Three.js,” is designed to push the boundaries of how technology and art intersect. By leveraging cutting-edge tools like OpenAI’s APIs, Three.js, and custom code, participants will explore the transformative potential of data as an artistic medium. From climate science to cultural resilience, data holds stories waiting to be uncovered. This program empowers learners to transform raw data into dynamic, interactive, and immersive visualizations, merging the worlds of coding, artificial intelligence, and storytelling to create meaningful artistic experiences. The course emphasizes a hands-on, coding-first approach, fostering technical skills while maintaining a focus on creativity and impact.
Participants will progress through a structured curriculum that begins with the fundamentals of data processing and visualization, building up to advanced projects that integrate AI-driven narratives with real-time 3D rendering. By the end of the course, learners will not only master tools like OpenAI and Three.js but also develop the ability to communicate complex ideas and emotions through data-driven art. Whether you’re creating a virtual climate map or an interactive cultural archive, this course offers the technical and creative foundation needed to bridge art, data, and immersive storytelling in new and exciting ways.
This project builds on a foundation first piloted in 2021-2022 with strategic arts innovation funding from the Canada Council for the Arts Digital Greenhouse. During that time, we explored the potential of digital tools in climate storytelling and creative expression. We’re incredibly thankful for their support, which made the initial exploration possible, and we’re excited to bring this learning opportunity back—this time, with even greater detail, depth, and impact!
Curriculum
- 1 Section
- 8 Lessons
- Lifetime
- Arts Meets Data: FoundationsIntroduce the concept of data as an artistic medium, using coding and AI to enhance storytelling for climate and cultural narratives.8
- 1.1Introduction to Data-Driven Arts
- 1.2Processing Data for Creative Applications
- 1.3Understanding Three.js and Data Visualization
- 1.4Using OpenAI to Advance Data-Driven Arts Projects
- 1.5Creating Interactive Elements with Three.js
- 1.6Using Three.js to Simulate Immersive Experiences
- 1.7Creating Data-Driven Artistic Works with OpenAI and Three.js
- 1.8Creating a Virtual Showcase with Three.js
Instructor
The Arts Incubator is a participatory arts collective and living lab, based in Winnipeg, Manitoba and Northwestern Ontario. It's a space where innovation and creativity thrive. It's latest iteration was launched in 2021 with funding and support from the Canada Council for the Arts Digital Greenhouse. Today, working with students and faculty from the Minneapolis College of Art and Design, we fuse traditional and participatory media arts with artificial intelligence, music, storytelling and community-driven, land-based artist residencies to cultivate new voices and bold ideas. Whether through collaborative projects or immersive experiences, our small but vibrant community supports creators to explore, experiment, and connect. Join us at the intersection of artistry, technology, culture and community—where every moment is a new opportunity to create.
