Another generative ai image synthesis animation experiment using the lyrics from a Public Hanging song as the content text prompting (the lyrics key-frame as the animation progresses). Working with fixed style prompts for all of these (no key-framing). Song lyrics that are allegories for an emotional journey that work well in a greater musical context seem to be difficult to pull coherent imagery from with this particular generative synthesis approach (which is extremely literal in terms of the imagery it generates). Maybe we need a new CLIP model that works with multi-modal emotional similarity (existing CLIP is all about multi-modal text-image description).
No comments:
Post a Comment