Learn how to optimize the performance of the NPU on your laptop for enhanced machine learning and AI tasks. Maximize efficiency with these expert tips!Find out what the NPU performance is on your laptop. I tell you how to know the theoretical performance and resource consumption of this processor.
In this guide, I’m going to explain the steps you need to follow to find out how your laptop’s NPU performs . You may already know that the NPU is a coprocessor dedicated to artificial intelligence tasks. It’s a way to free up the CPU and GPU from algorithmic execution, providing AI-based features that run locally in a highly efficient manner. My intention is not to explain in depth how an NPU works. What I’m going to teach you is how to find out how well the NPU performs and the resources that certain tasks consume on this neural processor. Don’t miss it!
NPU performance in TOPS
This guide is divided into two parts. On the one hand, I show you the steps to find out the NPU performance declared by the manufacturer . This is important to know what type of tasks it will be able to execute without saturating and how many operations it is capable of covering. It is also a key piece of information to know if you will have access to the Windows AI experience, which, although it is limited for now, is expected to improve over time.
We’ve already explained that NPU performance is measured in TOPS . This unit of measurement is not only used for these coprocessors dedicated to AI, but also for CPUs and GPUs. Essentially, TOPS measures the number of operations that a processor is capable of completing in a given amount of time.
The thing is, TOPS isn’t a foolproof measure either, but it will help you get a bit of an idea of how powerful your laptop’s NPU is . It’s also the benchmark Microsoft has used to decide which computers are part of the Copilot+ PC range , as is the case with the ASUS Vivobook S 15 . The higher the TOPS number, the faster AI tasks run on your computer.
With this in mind, it is clear that knowing the number of TOPS is essential to know the performance of your NPU. And how can you find out? The first thing you need to know is what processor your laptop has . This information is key, because the NPU is associated with the CPU. Find out what processor your computer has by going to Settings > System > Information .
Once you have this data, there are two ways to know its performance:
- Do some research on the web . The manufacturer will usually provide a TOPS figure for the NPU. This can help you determine how powerful this chip is and what tasks it will be able to perform.
- Benchmark . Applications such as Procyon AI Benchmark are used to test NPUs and compare performance between different models on the market. This is a tool aimed at industry professionals, rather than end users.
NPU Performance: Resources consumed by tasks
Okay, now it’s time to learn how to see the NPU’s performance live. That is, to know the percentage of resources consumed by artificial intelligence tasks. Although this method does not allow you to know the TOPS, it does help you evaluate to what extent you are taking advantage of this neural processor in your computer . For example, you may be thinking of running an application that relies on the NPU to perform certain tasks and you want to monitor its consumption of this component.
That’s what the Task Manager is for . This system tool will show you graphically how your computer’s resources are being used . You can access the Task Manager in several ways, but there are two that are very quick:
- Control + Shift + Escape . This keyboard shortcut quickly opens the tool.
- Right click on the start button . When you right click on the Windows icon in the taskbar, you will see a menu where there is a shortcut to the task manager.
Once the tool has opened, tap on Performance (it’s the second button on the left sidebar, starting from the top). Then, go to the NPU section . There you will have a graph and different metrics that will help you understand the status of the neural processor. An application built into Windows 11 that uses the NPU as the main processor is the studio effects for the webcam.
The controls for this feature are located in the taskbar. As you can see in the image above, the NPU quietly goes to work when this feature is activated.