margaritaville 2

 

Generative ai image synthesis animations created from the song titles of the WMF cd "Margaritaville".

margaritaville

 

Generative ai image synthesis animations created from the song titles of the WMF cd "Margaritaville".

over the edge 2

 

Generative ai image synthesis animations created from the song titles of the WMF cd "Over the Edge".

Alternate Realities - margaritaville cover art

 

One shot image resynthesis experiments using the cover art from the WMF cd "Margaritaville" as the input image (no text prompting). Above is using the new Versatile Diffusion model, which is an integrated multi-modal model that is indeed quite versatile.  Above is using it in image to image mode.  

Below is using it in an alternate image to text embedding to image mode.  I tried to negate the cars and trucks in the intermediate text embedding space, which was a big fail.  However, it did act to break the image resynthesis out of the tight hold it has on the input in an interesting way.  So a useful knob in some respects that is an interesting artistic tool.

Below is using the retrained image to image stable diffusion model used in previous alternate realities posts.  It give a more abstracted cartoony look as output, looser interpretation of the content.  None of the neural net models ever understand the visual joke present in any of the WMF cd covers, so while the 'understanding' is very impressive on some level for these models, there is a long ways to go towards complete human understanding of the content they are manipulating.

The original WMF "Margaritaville" cd cover art is shown below for reference.

over the edge

 

Generative ai image synthesis animations created from the song titles of the WMF cd "Over the Edge".

Alternate Realities - over the edge cover art

 

Two different one shot WMF cd cover art generative image resynthesis experiments above and below for the "Over the Edge" cd release.  Above is using the retrained CLIP image embedding guidance for the Stability model, below is using the Versatile Diffusion mode just released this week.  Fascinating the differences between the 2 different approaches.  You really need a dial to adjust between the tightness vs the abstraction, depending on what you want to achieve using this kind of model.  At the rate things are moving in this area we'll probably see that in a few days.

The original WMF "Over the Edge" cd cover artwork used as the one shot input is show below for comparison.

Alternate Realities - animal cover art

 

CLIP embedding only image resynthesis experiment. Based on the CLIP embedding of the WMF cd cover art from "Animal". The original cover art the above generative examples were derived off of is shown below.

animal 2

 

More generative ai image synthesis animations created from the song titles on the WMF cd "Animal".

animal

 

Generative ai animations created from the song titles of the WMF cd "Animal".

Alternate Realities -pst feind hort mit cover art

 

CLIP embedding only image resynthesis experiment. Based on the CLIP embedding of the WMF cd cover art from "pst Feind, hort mit". The original cover art the above generative examples were derived off of is shown below.

daze of rapture 2

More generative ai image synthesis animations created from the song titles of the WMF cd "Daze of Rapture".

daze of rapture

 

generative ai image synthesis animations made from the song titles of the WMF cd "Daze of Rapture".

Alternate Realities -train to nowhere cover art

CLIP embedding only image resynthesis experiment. Based on the CLIP embedding of the WMF cd cover art from "Train to Nowhere".  The original cover art the above generative examples were derived off of is shown below.

yokohama relaxation 2

 

More generative ai image synthesis animations created from the song titles of the WMF cd "Yokohama Relaxation".

Alternate Realities - lucky seven cover art

 

CLIP embedding only image resynthesis experiment. Based on the CLIP embedding of the WMF cd cover art from "Lucky Seven".  The original cover art the above generative examples were derived off of is shown below.

Alternate Realities - yokohama relaxation cover art 2

 

CLIP embedding only image resynthesis experiment. Based on the CLIP embedding of the WMF cd cover art from "Yokohama Relaxation".  The original cover art the above generative examples were derived off of is shown below.

yokohama relaxation

Generative ai image synthesis animations created from the song titles of the WMF cd " Yokohama Relaxation".

Alternate Realities - yokohama relaxation cover art

 

CLIP embedding only latent diffusion resynthesis of the WMF cd cover art for 'Yokohama Relaxation'.  In combination with gallery show auto-mutation processing.