Delivering Server-Class Performance at the Edge with NVIDIA Jetson Orin

Get started with developing all four Jetson Orin modules for a new era of robotics.

Leela Subramaniam Karumbunathan
10 min readintermediate
--
View Original

Overview

The article discusses the capabilities and performance enhancements of the NVIDIA Jetson AGX Orin modules, highlighting their role in advancing AI-powered robotics and edge applications. It details the specifications, comparisons with previous models, and the software ecosystem that supports these modules.

What You'll Learn

1

How to leverage NVIDIA Jetson AGX Orin modules for AI applications

2

Why the Jetson AGX Orin series offers superior performance compared to previous models

3

When to choose Jetson Orin NX for small form factor products

Prerequisites & Requirements

  • Basic understanding of AI and robotics concepts
  • Familiarity with NVIDIA JetPack SDK(optional)

Key Questions Answered

What are the performance specifications of the Jetson AGX Orin modules?
The Jetson AGX Orin modules deliver up to 275 tera operations per second (TOPS) for the 64GB version and 200 TOPS for the 32GB version. They offer power configurations ranging from 15W to 60W for the 64GB model and 15W to 40W for the 32GB model.
How does the Jetson AGX Orin compare to the Jetson Xavier series?
The Jetson AGX Orin series provides an 8x performance upgrade over the Jetson AGX Xavier series and offers up to 6x the performance at the same price, with improved power efficiency and inference capabilities.
What software supports the Jetson AGX Orin modules?
The Jetson AGX Orin modules run the comprehensive NVIDIA AI software stack, including NVIDIA JetPack 5.0, which supports various SDKs and software platforms for developing AI applications.
What benchmarks demonstrate the performance of Jetson AGX Orin?
Benchmarks show that Jetson AGX Orin achieves a 3.3X performance increase compared to Jetson AGX Xavier, with expectations to reach a 5X increase with future software improvements. It also ranks highly in MLPerf industry inference benchmarks.

Key Statistics & Figures

Performance of Jetson AGX Orin 64GB
275 TOPS
This performance is achieved with power configurable between 15W and 60W.
Performance of Jetson AGX Orin 32GB
200 TOPS
This performance is achieved with power configurable between 15W and 40W.
Performance increase compared to Jetson AGX Xavier
3.3X
This increase is based on benchmarks conducted with the Jetson AGX Orin Developer Kit.
Expected performance increase with future software improvements
5X
This is anticipated as software enhancements are rolled out.

Technologies & Tools

Software
Nvidia Jetpack
Provides a full development environment for AI-at-the-edge development.
Software
Nvidia AI Software Stack
Supports the development of AI applications on Jetson modules.

Key Actionable Insights

1
Utilize the Jetson AGX Orin Developer Kit for rapid prototyping of AI applications.
The kit includes everything needed to get started quickly, making it ideal for developers looking to create advanced AI solutions in various fields such as robotics and healthcare.
2
Leverage the enhanced performance of Jetson Orin modules for real-time AI processing.
With capabilities like 275 TOPS, these modules are well-suited for applications requiring concurrent processing of multiple AI tasks, such as 3D perception and natural language understanding.
3
Explore the NVIDIA JetPack SDK to accelerate development.
JetPack provides a full development environment that supports hardware-accelerated AI development, making it easier to build and deploy applications on Jetson devices.

Common Pitfalls

1
Overlooking the power configuration options of Jetson Orin modules.
Failing to configure the power settings appropriately can lead to suboptimal performance in AI applications, as the modules are designed to operate efficiently within specific power ranges.

Related Concepts

AI And Robotics Integration
Nvidia Jetpack SDK
Performance Benchmarking In AI Applications