kahului adventure - CLIP guided RGB synthesis remix

 

Same text prompting used in the previous 'kahului adventure' post processed with CLIP guided direct rgb generative image synthesis above.  I then ran that (time compressed) through the stable diffusion U-Net latent input with the same text prompting sequence below. I ran it twice to see the effect of different random seeds with the same dynamic U-Net latent input.

neon squid interiors

 

kahului adventure

 

new age dream 3 - CLIP guided RGB synthesis remix

I tried running the CMU 'Towards Real-Time Text2Video via CLIP-Guided Pixel Level Optimization' code using the 'new age dream 3' text key-frame prompts.  Still frame above shows it's kind of a bust.  And the video download was unplayable on a mac?  So double bust.

Especially in comparison to the direct rgb CLIP generative synthesis code i was running in late summer here shown below.  This is using the same 'new age dream text prompt key-framing used in the last post.

 

Now the second part of the experiment i was interested in running was to take the CMU direct rgb CLIP generative synthesis output and pump it into the U-net embedding in Stable Diffusion.  Since the CMU video output was a total bust i decided to do that experiment with my direct rgb CLIP generative output instead (above video time compressed by 6X), which is shown below.

new age dream 3

 

new age dream 2

 

new age dream