Announcing NVIDIA Metropolis Microservices for Jetson for Rapid Edge AI Development

NVIDIA Metropolis Microservices for Jetson has been renamed to Jetson Platform Services, and is now part of NVIDIA JetPack SDK 6.0.

Chintan Shah
5 min readadvanced
--
View Original

Overview

NVIDIA has rebranded its Metropolis Microservices for Jetson to Jetson Platform Services, now included in the NVIDIA JetPack SDK 6.0. This suite offers customizable, cloud-native building blocks for rapid development of vision AI applications at the edge, featuring over 15 microservices that streamline the development process.

What You'll Learn

1

How to utilize NVIDIA Metropolis microservices to accelerate edge AI application development

2

Why cloud-native architecture is essential for modern AI applications

3

How to implement generative AI for zero-shot detection in edge applications

Key Questions Answered

What are NVIDIA Metropolis microservices and their purpose?
NVIDIA Metropolis microservices are a suite of customizable, cloud-native building blocks designed to accelerate the development and deployment of vision AI applications at the edge. They provide a modular architecture that simplifies the integration of various AI components, enhancing development efficiency.
How can developers leverage the AI-enabled network video recorder (AI-NVR) application?
The AI-NVR application integrates multiple microservices for video ingestion, AI perception, and analytics, allowing developers to build comprehensive AI applications. It demonstrates how to utilize the Video Storage Toolkit and AI Perception service for effective video management and analysis.
What is zero-shot detection using generative AI?
Zero-shot detection using generative AI allows models to detect specified objects in live streaming data without prior training on those specific classes. Developers can dynamically change detection classes via REST APIs, enabling flexible and powerful AI applications.
What are the key components of the NVIDIA Metropolis microservices architecture?
The architecture includes application services like video storage and AI perception, platform services for communication and monitoring, and cloud services for secure connectivity. This modular design allows developers to select components based on their application needs.

Technologies & Tools

Hardware
Nvidia Jetson
Platform for deploying edge AI applications using Metropolis microservices.
Software
Nvidia Deepstream
Used for AI inference and object tracking within the AI Perception service.
Protocol
REST API
Enables dynamic interaction with AI services for tasks like zero-shot detection.

Key Actionable Insights

1
Utilizing NVIDIA Metropolis microservices can significantly reduce development time for edge AI applications.
By leveraging pre-built microservices, developers can focus on creating unique intellectual property rather than building foundational components from scratch, thus accelerating time-to-market.
2
Incorporating generative AI capabilities can enhance the flexibility of AI applications.
With features like zero-shot detection, developers can adapt applications to new requirements without extensive retraining, making it easier to respond to changing business needs.
3
Adopting a cloud-native architecture is crucial for scalability and security in AI applications.
This architecture allows for seamless integration of IoT services and secure edge-to-cloud communication, which is essential for modern AI solutions.

Common Pitfalls

1
Failing to leverage the modular nature of Metropolis microservices can lead to longer development cycles.
Developers might attempt to build applications from scratch instead of utilizing available microservices, which can significantly increase time and resource expenditure.