Animated Projects from MS038
Three animated projects from my Machine Learning for Artists class at Scripps College.
This animation project transforms my grandfather's early childhood memories as a farmer in rural Taiwan into a short film, combining three animations and images with a voiceover to celebrate and preserve the rich tapestry of elderly stories. The project highlighted the limitations of AI in handling abstract concepts and spatial relationships, emphasizing the need for precise prompts or embracing whimsical AI outcomes.
This project demonstrates the potential of AI-driven animation for creating compelling and atmospheric horror narratives. While there were technical and narrative challenges, the combination of CogVideoX, LoRA, and ControlNet successfully delivered an eerie and visually engaging final product. Future iterations could focus on enhancing narrative complexity and improving character interactions, further showcasing the power of AI in creative projects.
I wrote text prompts for each of historical periods. Each prompt is around 50 words and mostly contains adjectives and nouns. I entered the prompt for each historical period in a JSON file for DeForum and generated a 7-seconds animation (90 frames, 15 frames per second) for each. After I generated the first animation, I uploaded it to iMovie, and based on the background soundtrack, I edited the animation to only keep parts of it. Then, I took a screenshot of the very last scene and uploaded it to the Init function in DeForum. This allowed the following scene to be (near) perfectly interpolated.