NVIDIA logo

How NVIDIA Uses engineering

89 engineering articles about engineering from NVIDIA's engineering team

Articles

Filter:
NVIDIA logo
NVIDIA
Intermediate
In an AI factory, high bandwidth memory (HBM)is the fastest, most expensive, and most contested memory tier. Every byte spent on a redundant weight copy…
Shara Tibken
13 min read
--
NVIDIA logo
NVIDIA
Advanced
Turn production evidence into prioritized issues and custom evaluations that help you improve prompts, tools, models, memory, skills, and harness code.
Patrick Moorhead
8 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast…
Elizabeth Goodman
12 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
AI Factories are some of the most technologically complex operational environments ever created. Hundreds of thousands of GPUs, NVIDIA Spectrum-X Ethernet scale…
Elizabeth Goodman
11 min read
--
NVIDIA logo
NVIDIA
Intermediate
Building an AI factory digital twin requires developers to bring site plans, equipment assets, and engineering requirements into a consistent model that teams…
Tanya Lenz
13 min read
--
NVIDIA logo
NVIDIA
Advanced
AI factories turn energy into intelligence. But before an AI workload can produce its first token, operators must bring an interconnected system of compute…
Tanya Lenz
10 min read
--
NVIDIA logo
NVIDIA
Advanced
Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources…
NVIDIA logo
NVIDIA
Intermediate
AI agents offer remarkable productivity gains in complex chip design workflows, but their tendency to generate plausible yet incorrect artifacts makes…
Tanya Lenz
7 min read
--
NVIDIA logo
NVIDIA
Intermediate
Enterprise applications have become increasingly demanding. Agentic AI has compounded the need for vast amounts of enterprise data with frequent…
Elizabeth Goodman
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
How we taught robots to assemble GB300 tester trays and what it taught us about robot learning, mechanical intelligence, and good old-fashioned engineering The…
NVIDIA logo
NVIDIA
Advanced
GPU applications increasingly need networking and data movement to behave like first-class GPU-controlled operations rather than host-driven services.
Elizabeth Goodman
18 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Parallel work, model-family isolation, reversible changes, and GPU-backed validation shaped an open source project designed around coding agents NVIDIA TensorRT…
Tanya Lenz
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
To understand where agentic AI stands today, consider the last seismic shift in technology: the rise of the internet in the 90s. It was new and full of…
Tanya Lenz
7 min read
--
NVIDIA logo
NVIDIA
Intermediate
AI agents can be given a goal, write code, use tools, and keep working as new information becomes available. This opens the door to applications that…
Alex Watson
9 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Every unused watt is capacity left on the table. AI factories are typically provisioned for the unlikely moment when every GPU reaches peak power…
Sarah McKenney
8 min read
--
NVIDIA logo
NVIDIA
Intermediate
Using NVIDIA Cluster Readiness Engine, teams can bring reliable GPU clusters to production with workload-driven validation.
Michelle Horton
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
An AI coding agent’s patch can pass tests yet fail when the server loads a real model and handles requests. Evaluating changes to inference-serving software…
Elizabeth Goodman
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
As large language model (LLM) inference increasingly processes sensitive information and proprietary model context across personal, enterprise…
Tanya Lenz
6 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Agentic AI workflows can be used to prepare and validate digital twins for physical AI systems. Agents can inspect 3D scenes, author simulation-relevant data in…
Tanya Lenz
17 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
AI agents are moving from cloud data centers to vehicles, robots, and other edge devices. Unlike a chatbot that answers a single prompt, an agent works through…
Elizabeth Goodman
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
cuTile Rust () is a tile-based system for safe, idiomatic GPU kernel authoring in the Rust programming language. Extending the Rust ownership model to tile…
Tanya Lenz
18 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Power is a defining constraint for AI factories. As AI workloads demand a full compute platform to serve them, each component of that platform must maximize…
Tanya Lenz
9 min read
--
NVIDIA logo
NVIDIA
Advanced
For operators of large-scale AI factories, maximizing continuous output is essential for productivity. In massive-scale AI training, every GPU in the cluster…
Elizabeth Goodman
11 min read
--
NVIDIA logo
NVIDIA
Advanced
Deploying a large language model is only the first step toward production-ready serving. Production teams also need to serve as many concurrent users as…
Elizabeth Goodman
6 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Biomolecular structure prediction is now often run at proteome scale, where the goal is to move an entire worklist through the pipeline efficiently.
Elizabeth Goodman
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
In September 2026, NVIDIA announced it is leaning into native GPU programming in Rust. CUDA C++ and CUDA Python are mature, enterprise-grade toolchains…
Elizabeth Goodman
13 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
AI is changing the pace of cybersecurity. Agentic systems can coordinate work and pursue complex objectives over long horizons. Security teams are beginning to…
Michelle Horton
10 min read
--
NVIDIA logo
NVIDIA
Advanced
The surge in AI adoption is transforming everything from chatbots to content generation. Still, a common pain point remains: How can organizations confidently…
Elizabeth Goodman
12 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Agentic AI is changing how research is done. AI scientists can read papers, propose hypotheses, call models, and determine which experiments to prioritize next.
Michelle Horton
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Navigation enables a robot to turn perception and motion into purposeful autonomy. Unlike locomotion, which produces stable movement, navigation must be used to…
Tanya Lenz
15 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
For years, a Python developer who needed a GPU had two realistic choices: Learn NVIDIA CUDA C++ well enough to write an extension, set up a build toolchain…
Elizabeth Goodman
12 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
AI agents have expanded inference from single-turn interactions into multi-step workflows that reason, invoke tools, coordinate subagents…
Elizabeth Goodman
8 min read
--
NVIDIA logo
NVIDIA
Advanced
A frontier language model is only one component of an AI agent. The surrounding agent system—often called a harness—determines how the model receives context…
Tanya Lenz
9 min read
--
NVIDIA logo
NVIDIA
Advanced
Recommender systems (RecSys) are one of the most ubiquitous machine learning problems in the consumer internet industry yet notoriously difficult to train and…
Elizabeth Goodman
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
NVIDIA Holoscan is a platform for building real-time AI applications at the edge, from medical imaging to robotics. HoloHub is its companion repository: a…
Elizabeth Goodman
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Modern vision-language models (VLMs) can support tasks such as visual question answering, captioning, and image-text reasoning. In practice, however…
NVIDIA logo
NVIDIA
Intermediate
Video is a core data path across NVIDIA Jetson applications, from robotics and intelligent video analytics to industrial automation, healthcare…
Elizabeth Goodman
7 min read
--
NVIDIA logo
NVIDIA
Advanced
Learn how NVIDIA NeMo Switchyard routes AI agent workloads across models using tuning-free and tunable routers that balance model capability, cost, and latency.
NVIDIA logo
NVIDIA
Advanced
NVIDIA nvmath-python is a library designed to bridge the gap between the Python scientific community and NVIDIA CUDA-X math libraries. It gives Python users…
Michelle Horton
14 min read
Includes Code
--
NVIDIA logo
NVIDIA
Beginner
Knowledge workers are increasingly integrating AI agents into their workflows. Agents that function as “digital coworkers” offer clear benefits. For example…
Michelle Horton
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Deploying an AI coding assistant in a regulated, sovereign, or source-sensitive environment, often comes with challenges. Three common issues are: the source…
Tanya Lenz
13 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Unlike autonomous driving or industrial robotics, healthcare robotics can’t rely on internet-scale data collection or unlimited real-world experimentation.
Michelle Horton
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Building a great AI agent isn’t just about choosing the right models. The harness is the architecture surrounding the model. How it renders context…
Michelle Horton
9 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Modern chip design is increasingly limited by engineering time. Register transfer level (RTL) development and verification require specialized hardware…
Elizabeth Goodman
8 min read
--
NVIDIA logo
NVIDIA
Advanced
As AI workloads increase, explosive compute demand is pushing the semiconductor industry to meet unprecedented performance targets. Even small delays can have…
Tanya Lenz
6 min read
--
NVIDIA logo
NVIDIA
Intermediate
What began as discrete AI model training and human-facing chat interfaces has evolved into always-on AI factories dedicated to producing intelligence at scale.
Tanya Lenz
13 min read
--
NVIDIA logo
NVIDIA
Intermediate
The NVIDIA Nemotron Model Reasoning Challenge invited the Kaggle community to explore a focused question: What techniques can improve reasoning accuracy when…
Elizabeth Goodman
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
What if autonomous coding AI agents could push your vision reasoning models above 90% accuracy with almost no manual effort? When adapting vision reasoning…
NVIDIA logo
NVIDIA
Intermediate
Across science, engineering, and finance, many of the most important risks come from low-likelihood, high-impact events. Estimating the probability of these…
Elizabeth Goodman
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Agentic systems often face a trade-off between accuracy and cost. The highest-performing proprietary frontier models and harnesses provide top accuracy but are…
Sean Lopp
10 min read
Includes Code
--