# Pixel graphics generated by an A.I

**URL:** <https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145>\
**Category:** Off-topic\
**Created:** [August 16, 2022, 3:42pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145 "2022-08-16T15:42:15Z")\
**Posts on this page:** 16\
**Page:** 1

<div class="post-metadata">

**Author:** ![Someone](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@Someone](https://forums.thimbleweedpark.com/u/Someone)\
**Post date:** [August 16, 2022, 3:42pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/1 "2022-08-16T15:42:15Z")

</div>

We had already a [chat with an AI](https://forums.thimbleweedpark.com/t/a-discussion-with-an-ai/5121) and the [upscaling of adventure game backgrounds](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465). Now I stumbled over this interesting (and long!) blog post where the AI DALL-E2 is generating pixel graphic backgrounds for adventures games:

> **[Adventure game graphics with DALL-E 2 - Et tu, Cthulhu](https://hpjansson.org/blag/2022/08/16/adventure-game-graphics-with-dall-e-2/)**
>
> Is DALL-E 2 fit for use in creative work? A case study involving pixel graphics for a point-and-click adventure game.

---

<div class="post-metadata">

**Author:** ![LowLevel](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/lowlevel/32/48_2.png) [@LowLevel](https://forums.thimbleweedpark.com/u/LowLevel)\
**Post date:** [August 16, 2022, 4:03pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/2 "2022-08-16T16:03:27Z")

</div>

Nice article, but unfortunately the AI didn’t create the pixel graphic.

It was simply asked to create images in the style of **oil paintings**. Then the author simply downsampled everything with the software “magick”.

Currently, the contribution of AI to pixel graphic is substantial in style transfer: you give the AI a drawing or photo and the AI can draw a pixel art version of it. With very good results, [like those shown here](https://inikolaeva.medium.com/make-pixel-art-in-seconds-with-machine-learning-e1b1974ba572).

When it comes to _generation_ of pixel art, though, DALL-E 2 isn’t so good at it. [Some people tried and got this](https://www.reddit.com/r/PixelArt/comments/up2q8j/an_artificial_pixel_artist_welcome_dalle2_new_ai/), but the quality is still inferior to what you get when you ask the AI to transform an existing image to pixel art.

---

<div class="post-metadata">

**Author:** ![Paul](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/paul/32/15080_2.png) [@Paul](https://forums.thimbleweedpark.com/u/Paul)\
**Post date:** [August 16, 2022, 4:04pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/3 "2022-08-16T16:04:00Z")

</div>

“Guybrush with normal human nose”

 ![craiyon_170223_Guybrush_with_normal_human_nose](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/6/6c0fd739442b4a220f9ab2f20a1952d2ba84eedb.jpeg)

---

<div class="post-metadata">

**Author:** ![Guga](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/guga/32/14476_2.png) [@Guga](https://forums.thimbleweedpark.com/u/Guga)\
**Post date:** [August 16, 2022, 4:26pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/4 "2022-08-16T16:26:08Z")

</div>

That could be an interesting way of generating at least some inspiration for an artist

---

<div class="post-metadata">

**Author:** ![Ema](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/ema/32/14101_2.png) [@Ema](https://forums.thimbleweedpark.com/u/Ema)\
**Post date:** [August 16, 2022, 6:00pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/5 "2022-08-16T18:00:20Z")

</div>

guybrush picking his human nose  
 ![guypick](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/0/04d1e84b59f9b1321031da112e046b450d6c337a.jpeg)

---

<div class="post-metadata">

**Author:** ![GuybrushTransmasc](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/guybrushtransmasc/32/14191_2.png) [@GuybrushTransmasc](https://forums.thimbleweedpark.com/u/GuybrushTransmasc)\
**Post date:** [August 16, 2022, 6:29pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/6 "2022-08-16T18:29:35Z")

</div>

This one is great. Its just Guybrush, with a normal human nose. They are hanging out.

![20220817_042514](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/8/8d64c4176349624fc959892c03a51ea61ddb9e0b.jpeg)

---

<div class="post-metadata">

**Author:** ![Paul](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/paul/32/15080_2.png) [@Paul](https://forums.thimbleweedpark.com/u/Paul)\
**Post date:** [August 16, 2022, 6:44pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/7 "2022-08-16T18:44:47Z")

</div>

And I can’t complain, because it’s technically exactly what I asked for.

---

<div class="post-metadata">

**Author:** ![Paul](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/paul/32/15080_2.png) [@Paul](https://forums.thimbleweedpark.com/u/Paul)\
**Post date:** [August 16, 2022, 7:14pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/8 "2022-08-16T19:14:33Z")

</div>

> [@Ema](#):
>
> guybrush picking his human nose

I kind of wish it had given you Guybrush picking a human nose from a list of noses.

---

<div class="post-metadata">

**Author:** ![Ema](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/ema/32/14101_2.png) [@Ema](https://forums.thimbleweedpark.com/u/Ema)\
**Post date:** [August 16, 2022, 7:22pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/9 "2022-08-16T19:22:40Z")

</div>

> [@Paul](#):
>
> Guybrush picking a human nose from a list of noses

 ![Senza nome](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/d/dbbe037224fbe2fc14f63282f7ff408b64be246e.jpeg)

---

<div class="post-metadata">

**Author:** ![Paul](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/paul/32/15080_2.png) [@Paul](https://forums.thimbleweedpark.com/u/Paul)\
**Post date:** [August 16, 2022, 7:32pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/10 "2022-08-16T19:32:06Z")

</div>

I asked it to show me “The secret of Monkey Island” and it’s given me some intriguing options…

The secret is that Guybrush finds his son - this strange gopher boy:  
 ![4GopherBoy](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/2/25dcefdc2196b21792d499e2d4dfe307d5e8feb1.jpeg)

The secret is that Guybrush finds this giant spoon and then marries a handsome cowboy:  
 ![2CowboyFriend](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/4/44504e4df9f70189a003e311639c95a20ed0166b.jpeg)

The secret is that Guybrush and his monkey friend find a cool cactus wearing sunglasses and sideways baseball cap:  
 ![3CoolSunglassesCactus](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/1/145c478bf706f458fd6fab4eece048b844a906c8.jpeg)

The secret is that Guybrush finds a shovel and throttles a small giraffe:  
 ![8ThrottlingSmallGiraffe](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/3/3d1866815e88c6feec9b5a8ab292e5483623046a.jpeg)

---

<div class="post-metadata">

**Author:** ![Guga](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/guga/32/14476_2.png) [@Guga](https://forums.thimbleweedpark.com/u/Guga)\
**Post date:** [August 17, 2022, 6:11am UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/11 "2022-08-17T06:11:59Z")

</div>

> [@Paul](#):
>
> The secret is that Guybrush and his monkey friend find a cool cactus wearing sunglasses and sideways baseball cap

If this isn’t the actual secret I’m going to be mad for life.

---

<div class="post-metadata">

**Author:** ![Frenzie](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/frenzie/32/4416_2.png) [@Frenzie](https://forums.thimbleweedpark.com/u/Frenzie)\
**Post date:** [August 17, 2022, 7:12am UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/12 "2022-08-17T07:12:52Z")

</div>

> **[Adventure game graphics with DALL-E 2 - Et tu, Cthulhu](https://hpjansson.org/blag/2022/08/16/adventure-game-graphics-with-dall-e-2/)**
>
> Is DALL-E 2 fit for use in creative work? A case study involving pixel graphics for a point-and-click adventure game.

From asking for pixel art:  
[![](https://hpjansson.org/blag/wp-content/uploads/2022/08/hotel-entrance-pixel-art.png) ](https://hpjansson.org/blag/wp-content/uploads/2022/08/hotel-entrance-pixel-art.png)

To asking for modernist art and applying a pixel filter:  
[![](https://hpjansson.org/blag/wp-content/uploads/2022/08/hacienda-1.png) ](https://hpjansson.org/blag/wp-content/uploads/2022/08/hacienda-1.png)

---

<div class="post-metadata">

**Author:** ![kaiman](https://avatars.discourse-cdn.com/v4/letter/k/a698b9/32.png) [@kaiman](https://forums.thimbleweedpark.com/u/kaiman)\
**Post date:** [August 17, 2022, 5:56pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/13 "2022-08-17T17:56:40Z")

</div>

Isn’t that the exact article that started this thread?

At any rate, I wouldn’t really consider images like those to be pixel art, but rather pixelated art 😉. I also fail to see the advantage of this approach over, say, taking a photo or collage of the desired scene and then applying the same filters. Maybe having the AI create an “original” scene alleviates copyright concerns? Though where did the AI get its “inspiration” from?

Though would be interesting to see what an AI might come up with when trained on actual pixel art.

---

<div class="post-metadata">

**Author:** ![LowLevel](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/lowlevel/32/48_2.png) [@LowLevel](https://forums.thimbleweedpark.com/u/LowLevel)\
**Post date:** [August 17, 2022, 7:37pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/14 "2022-08-17T19:37:13Z")

</div>

> [@kaiman](#):
>
> At any rate, I wouldn’t really consider images like those to be pixel art, but rather pixelated art 😉.

Exactly. I’m pretty sure that every pixel artist wouldn’t consider downsampling an image a form of pixel art. Pixel art requires _drawing_ with pixels, juxtaposing them manually or at least with the aid of tools that don’t make the process entirely automatic.

> [@kaiman](#):
>
> I also fail to see the advantage of this approach over, say, taking a photo or collage of the desired scene and then applying the same filters. Maybe having the AI create an “original” scene alleviates copyright concerns?

I don’t know why the author of the article chose this path, but there are a lot of public domain images (including images of paintings) that could be “pixelated” without any legal risk.

> [@kaiman](#):
>
> Though where did the AI get its “inspiration” from?

DALL-E 2 was trained on about 650 million images of every kind and style, including images of copyrighted works.

> [@kaiman](#):
>
> Though would be interesting to see what an AI might come up with when trained on actual pixel art.

DALL-E 2 _was_ trained on actual pixel art images, meaning that those 650 millions images included also pixel art. The issue is that results are not good enough.

Here are some results for the prompt “An astronaut lounging in a tropical resort in space as pixel art.”:

 ![image](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/4/400cae1a6964995dbca8d6d29f958bee42ef74a4.jpeg)  
[[Source](https://towardsdatascience.com/dall-e-2-explained-the-promise-and-limitations-of-a-revolutionary-ai-3faf691be220)]

As you can see, pixels don’t even have the same size. While DALL-E 2 has understood the concept of “a drawing made of little squares”, it has not grasped the notion of a grid composed of squares of the same size.

This AI is _very_ good at creating images of many styles but pixel art is not one of them.

There are also attempts at generating pixel art **game assets** , here is the first tweet of a list with many examples; you can visit Twitter to see the other images:

> <https://twitter.com/_dschnurr/status/1514673929209614337>

So, it’s not that DALL-e 2 can’t generate nice looking pixel art images, it’s just that they contain many artifacts.

---

<div class="post-metadata">

**Author:** ![Someone](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@Someone](https://forums.thimbleweedpark.com/u/Someone)\
**Post date:** [August 17, 2022, 10:07pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/15 "2022-08-17T22:07:53Z")

</div>

> [@kaiman](#):
>
> I wouldn’t really consider images like those to be pixel art, but rather pixelated art 😉

Even the first pixel graphic generated by the AI? (The “hotel entrance in mexico, in the style of pixel art”). This _created_ the AI as pixel art.

> [@LowLevel](#):
>
> pixels don’t even have the same size

Is this necessary for pixel art? 😉

---

<div class="post-metadata">

**Author:** ![kaiman](https://avatars.discourse-cdn.com/v4/letter/k/a698b9/32.png) [@kaiman](https://forums.thimbleweedpark.com/u/kaiman)\
**Post date:** [August 18, 2022, 4:27pm UTC](https://forums.thimbleweedpark.com/t/pixel-graphics-generated-by-an-a-i/5145/16 "2022-08-18T16:27:03Z")

</div>

> [@LowLevel](#):
>
> DALL-E 2 _was_ trained on actual pixel art images

Let me rephrase then: would be interesting to see what an AI might come up with when trained _exclusively_ on actual pixel art.

> [@Someone](#):
>
> Is this necessary for pixel art? 😉

You could easily argue that there are solid colored squares comprised of multiple pixels instead of different sized pixels. And I think in case of the astronauts it’s not too jarring either.

If the hotel scene was considered pixel art, it’s either done in a very extravagant style or by a not so talented artist 🙂.

As for actual pixels of different size, I would argue that if a pixel is defined as

> the smallest controllable element of a picture represented on the screen

you’d just have to construct a screen with different sized pixels, et voila! Any pixel art displayed on that screen would still remain pixel art.
