Thursday, December 15, 2022

isometric alien abducting alligator

 


There's an interesting editors letter in the latest issue of Digital Art Live Magazine talking about isometric art.  In the letter, editor David Haden mentions a potential generative ai thought experiment using the text prompt 'UFO abducting an alligator from a creepy swamp at night'.  It inspired me to try a few experiments.

I first tried some experiments using just the subject matter text prompt.  Pretty hit and miss, most of the images are bad renders of weird alligators.  This one below seemed kind of in the ballpark, so i was primarily working off of it as a base for the rest of the experiment.

If you just try to modify the style prompt to incorporate some form of 'isometric grid' extension, the results tend to be pretty bad.  This includes various 'prompt engineering' approaches to coerce better output.  One example from that batch of experiments shown below.
I'm a big proponent of using image embeddings and image embedding manipulation or modulation to control generative image synthesis, so the rest of the experiment was really focused on working with generative resynthesis.  Most of those experiments used that image above that i said would be the base image.

I recursively resynthesized previous output images, subjected to a second push of the attention embedding to try and push it to have more of an isometric grid influence.  The first 2 images up at the beginning of the post are representative of where i ended up.

I also tried some 'sci-fi' poster variations, where i started with resynthesis of old 50's era alien invasion poster art.  You can see the progression of the 'pushed' recursive resynthesis cycles below.




No comments: