Nvidia, is one of those companies that never ceases to amaze me. I have to say that they have technically monopolized the GPU ecosystem and now Nvidia is gaining (if not already) for a new crown – AI on the Edge.
AI in the cloud has been the buzz ever since, enabling numerous application to be able to achieve Artifical intelligence capabilities without much effort. Of course, this is a good idea, and multiple players are gaining for this. I believe cloud computing is great – but it alone isn’t enough. So many things come into place here, centralization, privacy (who really controls the data), security, and most crucial physics (there is a limit of the data we can receive and push). But AI on the Edge brings a different dimension to this, you indeed have control of so many things and most importantly build to your imagination.
With AI on the Cloud, we put critical assets and infrastructure at risk of attack and might not even get the performance we geared for especially in the case of autonomous machines. However, Nvidia has been pushing for edge infrastructure to enable AI on the Edge with its numerous arrays of AI enabled hardware, but the unveiling of the Jetson AGX Xavier Module will be a total game changer. It promises to give robots and other intelligent machines the processing juice they will ever need for their AI brains.
Nvidia announced the Xavier platform earlier this year and has now added the AGX to the Jetson Xavier name. The AGX Xavier module is built around the Xavier system-on-chip which relies on six processors to get its work done, including a 512-core Nvidia Volta Tensor Core GPU, an eight-core Carmel Arm64 CPU, two NVDLA deep-learning chips, and dedicated image, vision, and video processors. Here comes the impressive part of it; the AGX Xavier module delivers up to 32 TOPS (30 trillion computing operations per second) of accelerated computing capability while consuming under 30 Watts. That’s more than 20X the performance and 10X the energy efficiency of the Jetson TX2. Users can configure operating modes at 10W, 15W, and 30W as needed.