AI Trained Model to make Sprites

runticuts

runticuts

New member
Hey Community,

We have been on a bit of journey trying to speed up the artwork development and reduce costs for our beat ‘em up game.

We have been slowly developing and training an AI system we have built and the results are starting to finally come together.

It’s still a work in progress and not perfect, but it’s getting super close. Just want to share our progress with the community and open up the discussion of AI tools.

So we feed roughly 300 axle sprites into the system to learn. Then we feed in the concept art.

Images attached. One is the concept reference and the other is the Output next to the sprite reference each pose is matched with.
 

Attachments

  • 23E436DE-03CB-4D3B-A02F-00B065959F97.jpeg
    23E436DE-03CB-4D3B-A02F-00B065959F97.jpeg
    714.8 KB · Views: 84
  • 9F8E9023-8A36-4B3B-AAEA-901A859D92AF.jpeg
    9F8E9023-8A36-4B3B-AAEA-901A859D92AF.jpeg
    112.8 KB · Views: 87
AI generated sprites sounds really cool, looks decent too, I can't seem to get my head round it though. what's next AI generated social media.
 
runticuts said:
Hey Community,

We have been on a bit of journey trying to speed up the artwork development and reduce costs for our beat ‘em up game.

We have been slowly developing and training an AI system we have built and the results are starting to finally come together.

It’s still a work in progress and not perfect, but it’s getting super close. Just want to share our progress with the community and open up the discussion of AI tools.

So we feed roughly 300 axle sprites into the system to learn. Then we feed in the concept art.

Images attached. One is the concept reference and the other is the Output next to the sprite reference each pose is matched with.
Click to expand...
Interesting... Can you show some more moves ?
I'm curious to see how is the result.
Also, How is the stance when animated. Can you show a bit?

Also, What is the software you use for this learning process etc?
 
Very interesting. Could save a ton of time once all the growing pains are worked out. Since this isn't about OpenBOR, I've moved it to the graphics thread.

DC
 
The result is actually not bad at all :) . I was wondering what kind of artificial intelligence software you used and if it was able to do pixelart too?
 
  • Like
Reactions: NED
kimono said:
The result is actually not bad at all :) . I was wondering what kind of artificial intelligence software you used and if it was able to do pixelart too?
Click to expand...
Same here! I would definitely not let the AI do the work for me, but if it can create interpolation for sprites, it would be great.
Exemple, for a punch or kick. Just giving a ference and one sprite of the main punch kick pose you created yourself and the software would make all the frames with a video reference or similar.
Just a dream, but I think it ill be possible soon... I hope.
 
We have built and trained the model to generate the 2d sprites based on the input concept artwork and the 300 sprite references.

We’ve managed to fine tune it to generate some pretty solid results. I think it will solve the problems for all the labor and costs involved with generating such a large amount of sprites.

We are hoping to develop a HD beat ‘em up.
Fingers crossed we can get @Kratus to develop the game for us.

We have also been producing all the background art using AI. It’s shaping up to be quite a fun project.
 
My congratulations on the great work, it really is amazing and looks very promising. :D
Your idea is to share the tool in the community when it is finished? :unsure:
 
runticuts said:
We have built and trained the model to generate the 2d sprites based on the input concept artwork and the 300 sprite references.

We’ve managed to fine tune it to generate some pretty solid results. I think it will solve the problems for all the labor and costs involved with generating such a large amount of sprites.

We are hoping to develop a HD beat ‘em up.
Fingers crossed we can get @Kratus to develop the game for us.

We have also been producing all the background art using AI. It’s shaping up to be quite a fun project.
Click to expand...

Can you show more of the actual created sprites?

We all want Kratus to be our own personnal programmer for our own personnal project.

My only wish is these requests not to slowdown his SORX project.
SORX = LIFE!
 
Off topic spam.
fellows,
recently at one of those WEF conference things, there was talks of headsets that can interpret your brain waves, so your boss can tell if you are focused on your job and not thinking about video games or sexy times....

any way, here is a paper where AI "decodes" or translates active brain MRI to images -
sites.google.com

Stable Diffusion with Brain Activity

Accepted at CVPR 2023 Yu Takagi* 1,2 , Shinji Nishimoto 1,2 1. Graduate School of Frontier Biosciences, Osaka University, Japan 2. CiNet, NICT, Japan
sites.google.com sites.google.com

very cool, hoping that this stuff can be used locally eventually
 
You must log in or register to reply here.
Back
Top Bottom