I've done a couple of posts where I've been playing with Stable Diffusion over on the balloons forums. Today I'm trying to get it to generate inflatable toy ideas! Here's the setup:
I'm using the Automatic1111 repo on an i7 with an nvidia 4090. All these images take in the ballpark of 15-20 seconds to produce. Rather than the stable diffusion model. I'm using Chermamixl (https://civitai.com/models/120033/chimeramixl) which has been trained on various mythical creatures. My prompt is along the lines of "A highly detailed and intricate inflatable toy in the form of an anthropomorphic ..." with some text after that describing materials, pose and body features as I feel they need them. You get a pretty wide variety of images from one prompt.
The AI seems to generally have a pretty hard time with putting tails in the right place, frequently generates quadrupedal forms even though I specified anthropomorphic (As well as some other text trying to force upright poses.) Using "doll" rather than "toy" does seem to have better results for getting upright poses if those are all you want. Some of the quadrupedal ones that were generated were also pretty good.
Look at a couple thousand of these things and you'll start noticing similarities depending on your phrasing. A lot of anthro fox/vulpera pics seem to have a tuft in the center of their head, for example. Almost all of them do, in fact.
One way to refine these would be to generate a few thousand images and then pick the ones that look the best to the user and retrain the AI on those. It'd take a solid weekend to generate the images and probably a while to retrain the AI with the hardware I have. I have some free time in December, though, so I might take a crack at that and see if I can improve the quality for this application.
Here are some of the better images that were generated
I'm using the Automatic1111 repo on an i7 with an nvidia 4090. All these images take in the ballpark of 15-20 seconds to produce. Rather than the stable diffusion model. I'm using Chermamixl (https://civitai.com/models/120033/chimeramixl) which has been trained on various mythical creatures. My prompt is along the lines of "A highly detailed and intricate inflatable toy in the form of an anthropomorphic ..." with some text after that describing materials, pose and body features as I feel they need them. You get a pretty wide variety of images from one prompt.
The AI seems to generally have a pretty hard time with putting tails in the right place, frequently generates quadrupedal forms even though I specified anthropomorphic (As well as some other text trying to force upright poses.) Using "doll" rather than "toy" does seem to have better results for getting upright poses if those are all you want. Some of the quadrupedal ones that were generated were also pretty good.
Look at a couple thousand of these things and you'll start noticing similarities depending on your phrasing. A lot of anthro fox/vulpera pics seem to have a tuft in the center of their head, for example. Almost all of them do, in fact.
One way to refine these would be to generate a few thousand images and then pick the ones that look the best to the user and retrain the AI on those. It'd take a solid weekend to generate the images and probably a while to retrain the AI with the hardware I have. I have some free time in December, though, so I might take a crack at that and see if I can improve the quality for this application.
Here are some of the better images that were generated
Comment