Sunday, September 4, 2022

form2 (extended) -SD remix 2

 

Another stable diffusion generative image synthesis animation run using the same form2 (extended) text prompt storyline we used for the first SD remix (and the earlier animation runs with a different synthesis model).  Once again, it loves to turn the 'endless form' text prompt into a series of human nude sketches.  Perhaps a lot of art school drawing class sketch the nude model as a form study imagery in the database it was trained on?

Same storyline of text prompting for this as the previous one except for frame 0, which i setup to put a representation image in the canvas for the start of the recursive feedback animation run.  Otherwise, no representational text prompting going on in the story line, which is all about a tour through different forms of abstract geometric patterning.

There is this color shift offset going on in the base recursive synthesis process that needs to be corrected for.  The code i'm using runs a 'color coherence' algorithm based on a color histogram match that forces the color histogram at frame time 0 onto the rest of the animation.  This problem should really be corrected at the source, since i have no doubt this particular processing is affecting the visual appearance of the output, both due to the color histogram algorithm as well as the particular color space you select to run it in.

I added an animation below so you can see what i'm talking about.  This one is not running the color coherence color histogram matching.
So you can't turn it off with the existing stable diffusion algorithm and get reasonable animations.  but turning it on effects the coloring in a different way, and ties you to that first frame, which is not necessarily something you want.



No comments: