Description
Why is this important?
Arm neural technology is an industry first, adding dedicated neural accelerators to Arm GPUs, bringing PC-quality, AI powered graphics to mobile for the first time – and laying the foundation for future on-device AI innovation.
Developers can start building now with the industry’s first open development kit for neural graphics with an Unreal Engine plugin, emulators, and open models on GitHub and Hugging Face.
Arm Neural Technology Announcement
Neural Super Sampling (NSS) is Arm’s mobile-optimized AI-driven graphics upscaler that improves image quality while lowering resolution. It builds on a prior Arm solution: Accuracy Super Resolution (ASR). It is supported by an Unreal Engine plugin, streamlining its use as part of a typical industry games development process.
Future SDK support will be provided for Neural Frame Rate Upscaling (NFRU) - so feel free to extend this project using NFRU when released.
Project Summary
Create a small game scene utilising the Arm Neural Graphics UE plugin to demonstrate:
- Improved graphical fidelity despite lower resolution (render low → upscale with NSS)
Document your progress and findings and consider alternative applications of the neural technology within games development.
Attempt different environments and objects. For example:
- Daytime vs night
- Urban city, jungle forest, ocean floor, alien planet, building interiors
- Complex lighting and shadows
- NPCs with detailed clothing, faces, hair. Include animations.
Make your scenes dynamic with particle effects, shadows, physics and motion.
Beyond the plugin
Want to go further and start experimenting more with Neural Graphics? After building your game with the NSS Unreal plugin, try-out the Vulkan ML Extensions learning path to explore how neural inference runs directly through the Vulkan API. This provides lower-level control over ML workloads in the graphics pipeline, and allows for prototyping custom neural effects or optimising performance beyond what’s exposed through the engine plugin. You may also want to explore fine-tuning your own neural models with the Arm Neural Graphics Model Gym and how to apply different quantization strategies for optimisation of memory and latency.
Pre-requisites
- Laptop/PC/Mobile for Android Unreal Engine game development
- Willingness to learn about games development and graphics, and the increasing use of AI in these fields.
Resources from Arm and partners
- Get Started Blog: Start experimenting with NSS today
- Deep Dive Blog: How NSS works
- Arm Developer: Neural Graphics Development Kit
- Learning Path: Neural Super Sampling in Unreal Engine
- Learning Path: Getting started with Arm Accuracy Super Resolution (Arm ASR)
- Unreal Engine Intro by Epic Games: Understanding the basics
- Repo: Arm Neural Graphics SDK
- Repo: Arm Neural Geraphics for Unreal
- Repo: Arm Neural Graphics Model Gym
- Documentation: Arm Neural Graphics SDK for Game Engines Developer guide
Support Level
This project is designed to be self-serve but comes with opportunity of some community support from Arm Ambassadors, who are part of the Arm Developer program. If you are not already part of our program, click here to join.
Benefits
Standout project contributions to the community will earn digital badges. These badges can support CV or resumé building and demonstrate earned recognition. Contributions may also be highlighted in case studies or newsletters.
To receive the benefits, you must show us your project through our online form. Please do not include any confidential information in your contribution. Additionally if you are affiliated with an academic institution, please ensure you have the right to share your material.