Deep Learning and ROS Collide to Bring New Levels of Autonomy to Robots

The NVIDIA Jetson team was in Seoul, Korea last week at ROSCon. More than 450 attendees from across the globe trekked to the conference to learn and network…

Brad Nemire
3 min readbeginner
--
View Original

Overview

The article discusses the intersection of deep learning and the Robot Operating System (ROS) at ROSCon, highlighting NVIDIA's contributions to the robotics community through its Jetson platform. It showcases various demonstrations of AI-powered robotics, emphasizing the capabilities of the Jetson TX1 and its applications in real-time computer vision and deep learning.

What You'll Learn

1

How to utilize TensorRT for GPU-accelerated inference in robotics

2

Why the Jetson TX1 is suitable for small form-factor robotics applications

3

When to implement ROS for robotic simulations and control

Key Questions Answered

What capabilities does the Jetson TX1 provide for robotics?
The Jetson TX1 offers high classification frame rates through TensorRT and JetPack 2.3, making it ideal for applications requiring real-time processing. Its small form factor allows it to be integrated into size-constrained robotics platforms like drones and rovers.
How does NVIDIA support the ROS community?
NVIDIA has been a Platinum sponsor of the ROS community and the Open Source Robotics Foundation for three years, showcasing its commitment to advancing robotics through partnerships and technology demonstrations at events like ROSCon.
What are the applications of the Jetson platform in robotics?
The Jetson platform is used in various applications such as real-time depth-from-stereo processing in drones, scene captioning, and pedestrian detection, demonstrating its versatility in robotic systems.

Key Statistics & Figures

Number of attendees at ROSCon
450
This number reflects the global interest and engagement within the ROS community.

Technologies & Tools

Hardware
Jetson Tx1
Used for running deep learning models and processing real-time data in robotics.
Software
Tensorrt
A GPU-accelerated inference library utilized for enhancing deep learning model performance.
Software
Ros
The Robot Operating System framework used for developing robotic applications.
Software
Chainer
Used in the Amazon Picking Challenge for deploying deep learning strategies.
Software
Fastercnn
A deep learning framework utilized in robotics for object detection.
Software
Pcl
The Point Cloud Library used for processing point clouds in conjunction with depth cameras.

Key Actionable Insights

1
Leverage TensorRT to enhance the performance of deep learning models in robotics applications.
Using TensorRT can significantly improve inference speeds, which is crucial for real-time robotic applications, especially in environments where quick decision-making is essential.
2
Consider the Jetson TX1 for projects requiring compact and efficient computing power.
The small form factor of the Jetson TX1 makes it an excellent choice for drones and rovers, where space and weight are critical factors.
3
Engage with the ROS community for knowledge sharing and collaboration.
Participating in events like ROSCon can provide valuable networking opportunities and insights into the latest advancements in robotics technology.

Related Concepts

Deep Learning
Robot Operating System (ros)
Computer Vision
Real-time Processing