When many think AI, they think high power consumption in a datacentre setting. ipXchange has proven that really does not have to be the case, but the race to find the most efficient device for AI inferencing at the edge is never over. Axelera AI presents the latest chip to aspire to.
Any company that wants to take on NVIDIA in the world of AI is worth talking to, so ipXchange interviewed Axelera AI at Embedded World 2024.
As you can see in the video, just one of Axelera AI’s Metis AIPU chips is capable of running (over) 16 concurrent video streams. At the same time, it is inferencing while maintaining a high frame rate on all feeds. And this chip is running these workloads at the edge with 15 TOPS per watt.
That is very disruptively efficient, and on full blast, the Metis AIPU can run at up to 214 TOPs (INT8) and 3200 frames per second!
More than providing some exciting hardware to take on the giants, Axelera AI has also slashed the cost of entry to performing this type of vision inferencing on a power- and resource-constrained edge device. Axelera AI’s Voyager SDK also helps embedded engineers to easily create a pipeline for computer vision tasks, without having to be an expert in the field.
Testing Axelera AI’s Metis AIPU
Axelera AI has a few different M.2 and PCIe cards to evaluate this technology for various use cases. These have been created in collaboration with several partners so that engineers can easily get started using this technology out of the box.
Of course, this is just the first step for efficiently bringing next-level edge AI to your projects, but it will certainly be exciting to see how the market responds to such low cost of entry and high TOPS per watt. This was a short-but-sweet encounter, so let us know if you want a deep-dive with an ipXperience.
As always, ipXchange invites you to connect with Axelera AI by filling out one of our board forms and applying to evaluate the technology we report on – follow the link below to the user-defined form and specify Axelera AI within your project details.
Keep designing!