Showing posts with label energy based model. Show all posts
Showing posts with label energy based model. Show all posts

Saturday, May 21, 2022

EBM MSG Brush Load 3

 









EBM MSG Brush Load

 



EBM Image Folder Brush

 


Working with the image folder background texture as opposed to the source brush.  Used as source for Brush Load with EBM error minimizer.

Thursday, May 19, 2022

misc EBM experiments

 


Starting to dial in the new EBM (energy based model) digital paint features in the paint synthesizer a little bit better.  You need to be open to re-thinking old strategies for paint design.  We're applying energy forces that mold and sculpt the canvas in intelligent ways.

Totally different EBM digital paint thing going on below.  All of this is built using the new Brush Load features in pre_V6.




Compeller Brush test run

 

Quick experiment with the new Compeller brush load option in pre_V6.  Using that in combination with a MSG brush load.


Wednesday, May 18, 2022

New Experimental Brush Load Options

 



Experimenting with some new paint synthesizer brush load options.  Some new EBM (energy based model) digital paint ones.  You can also embed any IpOP effect into a paint brush in pre_V6 now.



Monday, May 16, 2022

sunRise hut

 


EBM Photo Collage

 




New Approach

 

Different kind of error metric for a different kind of EBM digital paint approach.

You can mix and match different error metrics in the same preset.

You also have all of the power and associated visual stylization associated with all of the other paint synthesizer features.


Sunday, May 15, 2022

EBM Digital Paint experiments 4



EBD Digital Paint experiments 3

 

I added some additional treatments to the source below. So i process the source, then load that processed source into the source area, then run the PASeq i used for above.

None of these work like conventional 'natural media' digital paint emulation, where you blit colored paint onto the canvas, usually with some dispersion of some kind in the mix. Energy Based Model (EBM) digital painting works by subjecting the existing canvas to energy minimization forces, forces you can configure in the paint synthesizer in this example.  You run the system recursively and it minimizes the energy of the system.  This emulates what is going on under the hood in many neural net image synthesis algorithms.  It has a distinctive look (and behavior) that is somewhat different than conventional natural media digital paint.



EBM Digital Paint experiments 2

 

Slightly tweaked my PASeq to build in a little bit more detail in the EBM painting.

The Image Compeller IpOp effect is an EBM based effect, so i added a little bit of stochastic Compeller adaptation to the PASeq below to try and get the coloring a little bit better in the face.  Probably too much with the 5% mix used below.



EBM Digital Paint experiments

 







proof Of concept

 

First images out of the gate for a new paint synthesizer feature for energy based model digital paint.  You can see a few bugs that need cleaning if you look closely.  But it works well enough already to clean it up and further develop.


After some bug cleaning i ran the paint animation below.
If i turn off the new feature and leave everything else the same in the PASeq i get the following.
All of this is pure energy based model digital paint.  The new feature supports a new kind of error minimizer model, and you can get a sense of what it is doing by contrasting the 2 videos.