In this article, we'll explain what an NPU is, what they're used for, and how their features and purposes compare to other similar processors.
WHAT IS NPU | THE MOST ADVANCED AI COMPUTER PROCESSOR
“NPU” stands for “neural processing unit.” It is a specially designed and manufactured piece of silicon that can accelerate machine learning calculations faster than a more general-purpose central processing unit (CPU) or graphics processing unit (GPU).
While normally found mainly in data centers and servers, NPUs are now also appearing in recent consumer processors to accelerate local computations of artificial intelligence (AI) software, for example large language models, similar to ChatGPT.
NPUs have been popping up for years in a variety of devices, including Apple’s iPhones and iPads, “Copilot+” PCs and laptops, and more. While Apple’s Bionic chips with onboard NPUs handle tasks like video stabilization and photo correction, they’re now being used for generative AI functions like drawing and text generation. Those applications even include answering real-language questions using large language model AIs.
