Modders are using AI to upgrade retro games

HD remasters are a staple of the modern gaming world. Whether it be full rebuilds like Resident Evil 2, or simple graphical upgrades like the forthcoming Jak and Daxter collection, the best games of yesteryear are still keeping up in the modern era. Unfortunately, not all retro games can get remasters. That said, fans don’t need to despair. Artificial intelligence is making it easier than ever for modders to give retro games impressive graphical upgrades that rival any modern remaster.

Modders are using AI to upgrade retro games

AI “machine learning” recently took center stage as a major part of Google’s ambitious Stadia project. Essentially, AI systems use given data sets to “learn” and apply patterns to other sets of data. Google showcased this machine learning tool by showing its ability to use source images to apply an art style or palette to an entire game.

This machine learning ability is what’s enabling modders to create these impressive graphical upgrades. In this case, the process is called AI upscaling. When an AI system is fed a low-res image of a graphical asset, it will automatically upgrade the asset by adding pixels to create a stunning new version.

These AI networks work by literally learning. By feeding networks both low and high-res images as examples, the AI will begin to train and start to tell the differences between the two image types. After identifying a low-res image, it will start the process to upscale and add additional pixels to create a high-res version. Some companies, such as Topaz Labs, offer pre-trained AI networks for use by the modding communities.

It’s a surprisingly quick process, but doesn’t always churn out results that are worthy of a final product. Modders still have to put in quite a bit of work to polish and tweak the resulting visuals. The r/GameUpscale subreddit is a community devoted to sharing the best techniques, tips, and tricks to get the most out of the AI upscaling process. Even after an AI upscale, most assets will still take several hours to polish. In the case of an AI upscale mod for the classic Doom, over 200 hours of work were reportedly required on top of the results created by the AI upscaling process. Compared to starting an HD upgrade from scratch, this is still amazingly fast.

The results are nothing short of astonishing. Over the past six months, the AI upscaling community has been churning out mods at a rapid pace. Gamers can find graphical upgrades for classic titles like Mass Effect 2, Half-Life 2, Elder Scrolls III: Morrowind, and Final Fantasy VII. The full potential of these tools has yet to be realized, but it could mean great things for more nostalgic fans. In the case of older games created by now-defunct studios or games where rights are tied up in the legal system, fans can now receive HD remasters that might not have been possible otherwise.