Thursday, April 28, 2022

Babbler

 

One interesting behavior with the LAION-400M latent diffusion generative ai model is that it generates very weird images when you give it a gibberish text prompt.  This one was prompted with 'arghhh'.  Who are these people anyway and why do they come up when you feed the model this text?

Other nonsense prompts give you something like this where you get random people along with a mangled version of the gibberish text prompt built into the generated image.

Changing the gibberish prompt slightly can push you into a different space where you get mangled text mixed with the weird alien cartoony characters that are very characteristic of this particular model.

Using 'zappp' gives you mangled text built into some weird abstract design structure.  Probing the boundaries of the system in this way exposes to some extent what the synthesis algorithm is doing.  It helps in the analysis of this to think of generative texture models, how they are built, what is going on under the hood, and what the resulting output looks like.  It also gives you all kinds of clues to building alternate algorithms for synthesis that are not neural net based but would give similar looking results.


 

No comments: