This is part 2 in my series on using AI in my filmmaking work. Like part 1, this is specifically about animation.
***
Vibe Coding with Gemini
I’m finding Google’s Gemini to be a good sounding board for topics. I ask it questions like “What are some ways I can build a stand for a TV monitor?”, “What are some solutions for reading old Mac diskettes?”, and “Can you help me with my Windows networking issues?” All lead to discussions that are more in depth than a web search… or rather if I did traditional searches, it would lead to hours of reading message boards and watching tutorials that often answer the wrong questions.
One thing I asked Gemini was to code a stop motion animation app for me. I typically use Dragonframe, but for my Animation Workshop students, it’s more than I need. I’ve also used the very affordable Stop Motion Studio, which is great in general, but there are a few things I wanted to improve about the experience. It can be slow to export and crash unexpectedly.
I had heard about vibe coding, but didn’t know what to expect. Would I need to know Python or another coding language? How would I get my code out of Gemini and use it locally? Can Gemini even code like Claude? (I haven’t tried Claude, instead I started with Gemini because I already use so many Google services.)
Well, I told Gemini what I wanted, and it wrote something in Javascript that runs right in Chrome. Impressive. I then proceeded to tweak the look and functionality over several weeks in our Animation Workshop classes. I would watch our students use the app, and when they found glitches or stumbled over UI issues, I would go back to Gemini and ask for changes. It helped that I knew HTML and some CSS, but for the most part I didn’t need to get into the nuts and bolts of code.
The biggest issue I’m having with vibe coding is the tendency for the AI to undo functions that are already working. I’ll ask for a button to be moved and it will make the change… along with changing the name of some other buttons and breaking the “save” function, for instance. I’ve taken to finishing my commands with “Don’t make any other changes,” which usually helps.
Is vibe coding unethical? Where is Gemini getting its stop motion interface and code from? Well, at this point I wouldn’t feel right about selling this app. (I don’t want to support software, for one thing.) But also, I didn’t write it! If anything, I’m acting as “developer.” One of my students insists that to use the app ethically, we should go into the code ourselves and modify it, make our own changes to make it our own. But I want to iterate quickly. I keep coming up with new functions to add, and Gemini can do that — even if I have to double check that old functions don’t break.
My bottom line on this is that I want to shoot animation, and the movies themselves are the creative output. So the AI generated product — the software — is a tool I’ll gladly use to that end.
I look forward to vibe coding some other software in a similar vein. I already started on screenplay software (watch out Final Draft, your days are numbered) and a hand-drawn animation app. I could see using Gemini to help with scheduling and call sheets, especially since it talks with Google Sheets fairly well.
Part 3 coming soon…