Wednesday, September 30, 2009
Another live video processing experiment. Runs slower but a lot more going on it it. Used a PASeq as opposed to a single image processing effect to build complexity. The new PASeq preference option was used so the screen only updates once per cycle for PASeq loop action processing of the live video feed. All done in Studio Artist 4.
Tuesday, September 29, 2009
I've been playing around with Studio Artist 4 on a powerbook running live video effect processing using the built in iSight camera. It's surprisingly zippy. And only running 2 cpu cores as opposed to my usual 8.
Monday, September 28, 2009
Sunday, September 27, 2009
In general threading is a great thing for image processing code, since you get close to a Nx speedup for N threads running on different cpu cores. So why would you want to turn it off?
It's possible in Studio Artist's MSG modular image processing architecture to build recursive IO connections. For some MSG processors it doesn't matter, but for things like warps or filtering where the output image buffer is also the input image buffer, strange and magical things happen because of the recursive feedback created by this kind of recursive processing. Now if you thread the processing into multiple cores processing separate bands in the image the recursive spatial feedback is broken up into N chunks. So you get a banded visual effect associated with the recursive processing that is very different than what you would see with non-threaded processing. And the banding is a function of the number of cpu cores.
So i added a new Studio Artist 4 preference option yesterday that lets you turn MSG threading off if you wish. The image at the top of this post is with threading off. The image below is with threading on. Notice the difference in the appearance.
Now sometimes the banding effect associated with threaded processing can be visually quite stunning, so you really do want to have the option of choosing whether you are running this kind of preset with threading on or off.
The amazing thing about MSG is that I'm always surprised by new processing effects it's capable of generating. This one in particular is fascinating. It shows the power of directed evolution for generating new visual processing effects, since i'm not even sure where i would have started if i tried to generate this particular effect from ground zero by building a processing chain by hand. The nice thing about directed evolution is that you just choose the example effects you like and then evolve or mutate variations off of the chosen preview image, continuing that iterative process until you arrive at your final effected image(s).
Saturday, September 26, 2009
A cool abstraction example from the variations series. Like all the images in the series, this was generated using MSG processors that were assembled into visual processing presets using the Studio Artist 4 evolution editor.
Trying out some new ideas with live video processing in Studio Artist 4. I was using a paint action sequence (PASeq) that works with 2 different layers to build up this live processing effect. MSG processing in one layer, interactive warp and color simplify in the other.
Friday, September 25, 2009
Thursday, September 24, 2009
Wednesday, September 23, 2009
Tuesday, September 22, 2009
Another example in the variations on a face series. All generated in Studio Artist 4 using the evolution editor to swap evolve and mutate MSG presets that process a source image. The same source image in the case of this series of abstracted images.
Monday, September 21, 2009
The continuing series that explores different MSG abstraction presets processing the same source image. I hope by now you're getting the sense that there's an infinite range of variety in the kinds of visual effects that can be generated using MSG processors in Studio Artist 4.
Sunday, September 20, 2009
This one is kind of out but fun. More examples from the variations on a face series. All of the images in the series were generated from the same source image using different MSG presets that were generated via directed evolution. Directed evolution means you evolve sets of MSG previews via swap or mutation evolution, then choose the one you like the most, then generate a new set based off the preview image you liked the best, etc in an iterative process until you get to something you like enough to keep. Doing this moves you slowly through the overall MSG parameter space with it's associated visual looks, which is essentially infinite.
Saturday, September 19, 2009
Another image in the MSG derived variations on a face series. I used the Studio Artist 4 evolution editor to generated all of the different examples. I use swap evolution a lot when performing directed evolution to build varying complexity over time. Along with the occasional random add mutation.
Friday, September 18, 2009
Thursday, September 17, 2009
Another image from the variations on a face series. This one would be good for video processing for a horror movie. Everything in this series was generated by directed evolution of MSG processors in Studio Artist 4.
Wednesday, September 16, 2009
Another image generated by loop action processing of a live video stream in Studio Artist 4. I'm using a Paint Action Sequence (PASeq) for the loop processing. It combines a few interactive warp action steps with some image operation processing steps. The video feed is coming in from an iSight camera.
Tuesday, September 15, 2009
Dinner in Kapaa at this place next to a cool old coconut grove filled with goats. It's amazing it hasn't been bulldozed and turned into a shopping center or condo complex, enjoy it while it lasts. Flip video pan taken in low light and then converted into a static panorama using the Studio Artist 4 temporal scan tracker.
Monday, September 14, 2009
This cracks me up. I've been playing around with live video processing in Studio Artist 4 today. It was actually created by running a Paint Action Sequence (PASeq) in loop action while processing an iSight camera live video feed.
Sunday, September 13, 2009
This started with a Flip video pan in Ching Young Village in Hanalei. I ran the Studio Artist 4 temporal scan tracker in reverse direction from the actual video pan so it generates an artificial rendition of the scene that is more surreal. Although Ching Young Village is kind of surreal by itself without any additional modification.
Saturday, September 12, 2009
I had this idea to shoot a video sequence of taking off from Honolulu airport from the window of the place, and then turning it into a static panorama. Here's a first attempt at it. Not quite what i had hoped for, i need to think through how to make it better. This was generated using the temporal scan tracker in Studio Artist 4. Using the full slit scan is way to jumpy with no real detail.
Friday, September 11, 2009
This is a still frame from an IFS attractor animation i was trying out using Studio Artist 4. There are a few different IFS attractors displayed in the frame capture. They are all being generated within a single MSG preset that was generated by directed evolution in the evolution editor palette. I used the MSG memories in the MSG advanced editor to build up the keyframes for the animation (it works like the old animation memories in MSG Evolver in the Studio Artist 3.5 package).
IFS stand for iterated fractal system. It's a kind of chaotic attractor.
Thursday, September 10, 2009
Sunset shot taken in Paia with a Flip video pan, followed by processing using the Studio Artist 4 scan tracker to make a static panorama. For this particular video sequence i got better results dialing it down all the way to a slit scan setting. The partial coverage control is still really useful even when you do this and gives a much better image quality then you would get if you used a standard slit scan algorithm.
Wednesday, September 9, 2009
Dinner at a cool place in Paia. This started with a video pan using a Flip camera followed by processing with the Studio Artist 4 temporal scan tracker to create the static panorama image. As you can see, only 1 crutch, so we're making progress these days.
Tuesday, September 8, 2009
Monday, September 7, 2009
Sunday, September 6, 2009
Saturday, September 5, 2009
This guy looks like he belongs in HellRaiser. Actually the same source image as yesterday's post. More variations on the stark look using FSA MSG processing in Studio Artist 4. FSA stands for float sum area and is a set of MSG processors that can be used to build resolution independent filtering effects.