# AI Neural Net upscaling of old pixel backgrounds

**URL:** <https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465>\
**Category:** Adventure/Lucasfilm Games\
**Created:** [January 10, 2019, 2:51pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465 "2019-01-10T14:51:26Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 12, 2019, 2:56pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/23 "2019-01-12T14:56:19Z")

</div>

here you can compare different AI models that draws the image.  
I used Main Street image from TWP.

From Original to 10K resolution  
[https://drive.google.com/open?id=1YPMnmQ-yJkMrVyVkUSjG7d-Cl8s-xD7u](https://drive.google.com/open?id=1YPMnmQ-yJkMrVyVkUSjG7d-Cl8s-xD7u)  
**Download it and zoom in!**

---

<div class="post-metadata">

**Author:** ![nihilquest](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/nihilquest/32/645_2.png) [@nihilquest](https://forums.thimbleweedpark.com/u/nihilquest)\
**Post date:** [January 12, 2019, 7:49pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/24 "2019-01-12T19:49:15Z")

</div>

We have MI2 original backgrounds, so in case of a new remake I’d prefer to see those used but still, very nice. How hard is this to setup? Do you need to know programming?

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 13, 2019, 1:45am UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/25 "2019-01-13T01:45:19Z")

</div>

All images can be upscaled pretty easy, hard part is to make a code that will be supported for HD resolutions.  
i.e. scumm MI2

to set up the ESRGAN you need to install all correctly, otherwise you will have problems. Installment is the crucial part. python and packages that are needed to run the code. We did lots google-ling till we reached the result. Follow the git page steps.

> **[xinntao/ESRGAN](https://github.com/xinntao/ESRGAN)**
>
> ECCV18 Workshops - Enhanced SRGAN. Champion PIRM Challenge on Perceptual Super-Resolution (Third Region) - xinntao/ESRGAN

---

<div class="post-metadata">

**Author:** ![bloodnose](https://avatars.discourse-cdn.com/v4/letter/b/439d5e/32.png) [@bloodnose](https://forums.thimbleweedpark.com/u/bloodnose)\
**Post date:** [January 14, 2019, 12:46pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/26 "2019-01-14T12:46:19Z")

</div>

Goodness. Those upscaled images are all I’ve ever wanted from a Curse of Monkey Island remaster. Hopefully someone at least makes a compiler or something!

---

<div class="post-metadata">

**Author:** ![Nor\_Treblig](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/nor_treblig/32/216_2.png) [@Nor\_Treblig](https://forums.thimbleweedpark.com/u/Nor_Treblig)\
**Post date:** [January 14, 2019, 1:00pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/27 "2019-01-14T13:00:02Z")

</div>

> [@patrik3dspacek](#):
>
> hard part is to make a code that will be supported for HD resolutions

I don’t know how problematic it would be to add support for HD graphics to **ScummVM** without breaking anything.  
But eventually we want ScummVM to support the Special Editions of MI1 and MI2 anyway.

If someone makes this work then it wouldn’t be hard to use our own custom HD graphics and hopefully the same for CoMI too…

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 14, 2019, 2:24pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/29 "2019-01-14T14:24:39Z")

</div>

I am very opened to it… if there is anybody who wants to try it out… let me know, I will help with the artworks.

---

<div class="post-metadata">

**Author:** ![Sushi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/sushi/32/163_2.png) [@Sushi](https://forums.thimbleweedpark.com/u/Sushi)\
**Post date:** [January 14, 2019, 5:46pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/30 "2019-01-14T17:46:16Z")

</div>

I’m all in for that!  
The first issue I see is upscaling the verb coin.  
🤔 I wonder what date the AI is going to put there.

[Edit: [solved](https://forums.thimbleweedpark.com/t/when-is-placed-monkey-island-1/2458/85?u=sushi)!]

---

<div class="post-metadata">

**Author:** ![milanfahrnholz](https://avatars.discourse-cdn.com/v4/letter/m/cab0a1/32.png) [@milanfahrnholz](https://forums.thimbleweedpark.com/u/milanfahrnholz)\
**Post date:** [January 14, 2019, 5:53pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/31 "2019-01-14T17:53:53Z")

</div>

> [@Sushi](#):
>
> 🤔 I wonder what date the AI is going to put there.

Y2K!!! 😱

---

<div class="post-metadata">

**Author:** ![Sushi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/sushi/32/163_2.png) [@Sushi](https://forums.thimbleweedpark.com/u/Sushi)\
**Post date:** [January 14, 2019, 5:56pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/32 "2019-01-14T17:56:48Z")

</div>

I am trying to find back the thread in which we discussed the year Monkey Island takes place… but I couldn’t find it back.  
Perhaps for the best, as we’d risk going off topic.

---

<div class="post-metadata">

**Author:** ![milanfahrnholz](https://avatars.discourse-cdn.com/v4/letter/m/cab0a1/32.png) [@milanfahrnholz](https://forums.thimbleweedpark.com/u/milanfahrnholz)\
**Post date:** [January 14, 2019, 6:09pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/33 "2019-01-14T18:09:30Z")

</div>

Was that an off topic in another one (impossible to find) or was it in the title? I think it was in the title. Wasn´t it one of Zak´s topics? @ZakPhoenixMcKracken

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 14, 2019, 6:12pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/34 "2019-01-14T18:12:24Z")

</div>

well, if there are skillful coders that would like to try first HD version of MI2, create a new topic and talk about it over there. (i guess, this is gonna be live till Ron kicks us out 😅😂

---

<div class="post-metadata">

**Author:** ![Sushi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/sushi/32/163_2.png) [@Sushi](https://forums.thimbleweedpark.com/u/Sushi)\
**Post date:** [January 14, 2019, 7:12pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/35 "2019-01-14T19:12:42Z")

</div>

I was just browsing CMI files to see if I could get at least the first HD screen back in… and I found this nice piece of built-in art

 ![image](https://canada1.discourse-cdn.com/flex030/uploads/thimbleweedpark/original/2X/2/21dc389b89034846b9fa58c90f84d771a1258851.png)

I say we drop the whole AI Neural upscaling and try to revive _those_ instead!

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 14, 2019, 7:21pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/36 "2019-01-14T19:21:48Z")

</div>

well, … first you need to make sure, you are able to import it back in and see it.  
Just export one image, scale it up 3x in any software, make a huge X over it as mark, and import it back in. See, if it works in original game with HD res.

I still recommend to create a new topic for this.

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 15, 2019, 5:49pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/38 "2019-01-15T17:49:39Z")

</div>

just in case you wanna give it some headaches here are the links for step by step:

[https://www.reddit.com/r/GameUpscale/comments/ag4ax3/instructions\_for\_training\_esrgan\_in\_windows\_i/](https://www.reddit.com/r/GameUpscale/comments/ag4ax3/instructions_for_training_esrgan_in_windows_i/)

[https://kingdomakrillic.tumblr.com/post/178254875891/i-figured-out-how-to-get-esrgan-and-sftgan](https://kingdomakrillic.tumblr.com/post/178254875891/i-figured-out-how-to-get-esrgan-and-sftgan)

now I am building up another AI custom models from 5000 images of Disney movies

---

<div class="post-metadata">

**Author:** ![dangerouslee](https://avatars.discourse-cdn.com/v4/letter/d/ecccb3/32.png) [@dangerouslee](https://forums.thimbleweedpark.com/u/dangerouslee)\
**Post date:** [January 17, 2019, 1:09am UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/39 "2019-01-17T01:09:25Z")

</div>

Could this technology be used on sprites as well?

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 17, 2019, 4:12am UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/40 "2019-01-17T04:12:05Z")

</div>

yes…any art

---

<div class="post-metadata">

**Author:** ![dangerouslee](https://avatars.discourse-cdn.com/v4/letter/d/ecccb3/32.png) [@dangerouslee](https://forums.thimbleweedpark.com/u/dangerouslee)\
**Post date:** [January 17, 2019, 4:05pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/41 "2019-01-17T16:05:00Z")

</div>

So technically, as long as filenames and extensions are correct with Curse of Monkey Island, you could just overwrite and import all the room art and sprite art back into the game correct?

---

<div class="post-metadata">

**Author:** ![patrik3dspacek](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/patrik3dspacek/32/16_2.png) [@patrik3dspacek](https://forums.thimbleweedpark.com/u/patrik3dspacek)\
**Post date:** [January 18, 2019, 2:59am UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/42 "2019-01-18T02:59:15Z")

</div>

Only if the game engine supports it. (HD 1080p, 2K, 4K…)

---

<div class="post-metadata">

**Author:** ![Sushi](https://yyz2.discourse-cdn.com/flex030/user_avatar/forums.thimbleweedpark.com/sushi/32/163_2.png) [@Sushi](https://forums.thimbleweedpark.com/u/Sushi)\
**Post date:** [January 18, 2019, 6:16am UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/43 "2019-01-18T06:16:56Z")

</div>

I tried that. But it is a bit more complicated because it is packed data and you also need to change in other places in the code what the new dimensions are.  
Not to mention you would also need to redraw/upscale the walkable areas, z-planes,…

---

<div class="post-metadata">

**Author:** ![dangerouslee](https://avatars.discourse-cdn.com/v4/letter/d/ecccb3/32.png) [@dangerouslee](https://forums.thimbleweedpark.com/u/dangerouslee)\
**Post date:** [January 18, 2019, 12:12pm UTC](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465/44 "2019-01-18T12:12:33Z")

</div>

I see…  
so what’s the likelyhood of the filtering happening in real-time as part of scummvm or dosbox etc?  
Does it require a lot of cpu and gpu power?

[Previous page](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465.md?page=1)

[Next page](https://forums.thimbleweedpark.com/t/ai-neural-net-upscaling-of-old-pixel-backgrounds/3465.md?page=3)
