Computer Art
ROYGIBIV
Deep learning empowered music video
- Studio
- individual
- Client
- UQiYO (band)
- Year
- 2017
- Responsibility
I was responsible for art direction, technical direction/implementation and film direction/editing.
Process
This was a quick 2 weeks project - ask was to create a video clip with iPhone video clips that the client captured scenery in NYC. As the beginning of the process, I started with brainstorming transition of the song and mapping its dynamics to timeline.
Technology
After setting the direction, I made a few different programatic visual effects to process input clips: 1) a line drawing effect, 2) fluid simulation for swirl 3) deep learning style transfer. I implemented #1 and #2 with Processing, and #3 with Python and Lua, referencing some available libraries. I chopped all input scenes into single image, process all frames, and stitched them after all with video editing software (Adobe Premiere).
