NVIDIA logo

How NVIDIA Uses Apache

166 engineering articles about Apache from NVIDIA's engineering team

Articles

Filter:
NVIDIA logo
NVIDIA
Advanced
NVIDIA is announcing two open source projects for building and operating managed Kubernetes services on GPU infrastructure—NVIDIA Kubernetes Engine (NVKE) and…
Nathan Taber
8 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
One underperforming GPU can slow an entire distributed training job. The node may pass basic health checks and show normal utilization…
Sowmyan Soman
13 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
As distributed AI training scales, failures across hardware and software dependencies increasingly disrupt training progress, making fast…
Elizabeth Goodman
12 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
NVIDIA DSX AI Factory Platform brings together technologies to help the ecosystem design, build, and operate more efficient AI factories, including open source…
Alon Lavian
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
NVIDIA GPUDirect Storage (GDS) accelerates GPU storage access in on-premises and cloud environments. It provides a robust, portable, and efficient data path…
Phil Carns
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Protein design is a search problem. Choose amino acids for an eight-residue protein sequence and more than 25 billion combinations are possible.
Elizabeth Goodman
11 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Enterprise applications have become increasingly demanding. Agentic AI has compounded the need for vast amounts of enterprise data with frequent…
Elizabeth Goodman
7 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Today, NVIDIA is making the full NVIDIA Run:ai platform available as open source software, giving customers, developers, and ecosystem partners access to…
NVIDIA logo
NVIDIA
Intermediate
To understand where agentic AI stands today, consider the last seismic shift in technology: the rise of the internet in the 90s. It was new and full of…
Tanya Lenz
7 min read
--
NVIDIA logo
NVIDIA
Intermediate
Using NVIDIA Cluster Readiness Engine, teams can bring reliable GPU clusters to production with workload-driven validation.
Michelle Horton
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Kubernetes manages what runs on your nodes. Managing the nodes themselves is the challenge: kernel settings, system packages, storage layouts, security agents…
Michelle Horton
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
For years, a Python developer who needed a GPU had two realistic choices: Learn NVIDIA CUDA C++ well enough to write an extension, set up a build toolchain…
Elizabeth Goodman
12 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
Useful quantum computers will require fault tolerant logical operations. Researchers are actively exploring many different quantum error correction (QEC) codes…
Elizabeth Goodman
5 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
As more teams move from humanoid robot bring-up to task-specific skill development, the need for repeatable development workflows is growing.
Elizabeth Goodman
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
Industrial machinery generates more alarms than technicians can triage. For each important alarm requiring follow-up, the technician pulls historical context…
NVIDIA logo
NVIDIA
Advanced
GPU-accelerated query engines are often constrained by memory and I/O bandwidth. NVIDIA hardware advances—including high bandwidth memory (HBM)…
Michelle Horton
12 min read
--
NVIDIA logo
NVIDIA
Advanced
Maximizing the value of AI infrastructure demands deep visibility into GPU utilization. Yet many platform teams running AI workloads on Kubernetes operate with…
Guy Saltoun
6 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
NVIDIA Ising is the world’s first family of open AI models for building quantum processors, launching with two model domains: Ising Calibration and Ising…
NVIDIA logo
NVIDIA
Intermediate
The Gemmaverse expands with the launch of the latest Gemma 4 multimodal and multilingual models, designed to scale across the full spectrum of deployments…
NVIDIA logo
NVIDIA
Advanced
Developing new protein-based therapies and catalysts involves the challenging task of designing protein binders, or proteins that bind to a target protein or…
Kyle Gion
10 min read
Includes Code
--
NVIDIA logo
NVIDIA
Intermediate
AI has evolved from assistants following your directions to agents that act independently. Called claws, these agents can take a goal, figure out how to achieve…
Ali Golshan
6 min read
Includes Code
--
NVIDIA logo
NVIDIA
Advanced
The article discusses Project Aether, a tool developed by NVIDIA to facilitate the migration of CPU-based Apache Spark workloads to GPU-accelerated environments on Amazon EMR.
Navin Kumar
6 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
NVIDIA's Sirius, an open-source GPU-native SQL engine, has set a new performance record on ClickBench, enhancing DuckDB with GPU-accelerated analytics.
Xiangyao Yu
6 min read
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the development of scientific AI agents using reinforcement learning (RL) techniques, specifically through the NVIDIA NeMo framework.
Christian Munley
12 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the collaboration between IBM and NVIDIA to enhance large-scale data analytics through GPU-native Velox and NVIDIA cuDF, highlighting significant performance improvements over...
Gregory Kimball
7 min read
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
This article discusses the integration of the Newton physics engine with NVIDIA Isaac Lab for training quadruped locomotion policies and simulating cloth manipulation.
Mohammad Mohajerani
13 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the advancements in NVIDIA cuVS, a GPU-accelerated vector search library designed for high-performance indexing and low-latency retrieval.
NVIDIA logo
NVIDIA
Advanced
The article discusses the deployment of a serverless, distributed data processing architecture using Apache Spark and NVIDIA AI on Azure.
NVIDIA logo
NVIDIA
Advanced
The article discusses NVIDIA's advancements in molecular AI modeling through the introduction of cuEquivariance and NIM microservices, which enhance the speed and efficiency of training and inferen...
Neha Tadimeti
8 min read
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses how NVIDIA cuOpt, an open-source GPU-accelerated optimization tool, enhances decision-making processes in businesses by efficiently solving complex linear programming (LP), mi...
Gordana Neskovic
5 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the application of Graph Neural Networks (GNNs) in enhancing fraud detection within financial services.
NVIDIA logo
NVIDIA
Intermediate
The article discusses the latest enhancements in RAPIDS, including zero-code-change acceleration for Python machine learning, significant IO performance improvements, and out-of-core XGBoost capabi...
NVIDIA logo
NVIDIA
Advanced
The article discusses how Atgenomix SeqsLab leverages NVIDIA technologies to enhance health omics analysis for precision medicine.
Yu-Ting Lin
9 min read
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses the use of GPU acceleration to enhance performance in Apache Spark applications, highlighting the challenges of migrating workloads from CPUs to GPUs.
Matt Ahrens
9 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses how to accelerate Deep Learning (DL) and Large Language Model (LLM) inference using Apache Spark in cloud environments.
NVIDIA logo
NVIDIA
Advanced
The article discusses the integration of the 3D Gaussian Unscented Transform (3DGUT) into the gsplat library, enhancing neural rendering and scene reconstruction for realistic 3D simulations.
Ruilong Li
5 min read
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
NVIDIA cuPyNumeric 25. 03 is a fully open-source library designed as a drop-in replacement for NumPy, leveraging the Legate framework for accelerated computing.
Bo Dong
4 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses how to accelerate Apache Parquet scans on Apache Spark using GPUs, specifically through the RAPIDS Accelerator for Apache Spark.
Matt Ahrens
7 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
NVIDIA has open-sourced the KAI Scheduler, a Kubernetes-native GPU scheduling solution under the Apache 2. 0 license, originally developed for the Run:ai platform.
Ronen Dar
9 min read
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
This article discusses strategies for preventing GPU fragmentation in the Volcano Scheduler, focusing on an enhanced scheduling approach that integrates bin-packing with gang scheduling.
Ameya Parab
6 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the performance and energy efficiency of the NVIDIA Grace CPU Superchip for ETL workloads, comparing it with AMD and Intel CPUs.
Gregory Kimball
6 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses how the NVIDIA RAPIDS Accelerator for Apache Spark enables zero code change for GPU-accelerated data processing, enhancing the performance of Apache Spark ML applications.
Erik Ordentlich
5 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses optimizing high-performance remote I/O operations using NVIDIA KvikIO for data analysis workloads on cloud object storage services.
Tom Augspurger
8 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses how to read JSON Lines data using NVIDIA's cuDF library, achieving performance improvements of up to 100 times faster than traditional pandas methods.
Karthikeyan Natarajan
10 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the collaboration between BRLi and Toulouse INP to develop AI-based flood models using NVIDIA PhysicsNeMo, addressing the limitations of traditional physics-based numerical si...
Ram Cherukuri
6 min read
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
The article discusses the optimization of JSON processing on Apache Spark using GPU acceleration, highlighting significant performance improvements achieved by a Fortune 100 retail company.
Matt Ahrens
8 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
IBM has launched Granite 3. 0, a new generation of generative AI models that are compact yet deliver high accuracy and efficiency.
Maryam Ashoori
5 min read
Has Summary
--
NVIDIA logo
NVIDIA
Intermediate
NVIDIA has announced that its CUDA-X platform now accelerates the Polars Data Processing Library, enhancing its performance for data analytics.
Nick Becker
3 min read
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses how RAPIDS AI can accelerate predictive maintenance in manufacturing by leveraging advanced data analytics to minimize downtime and optimize maintenance schedules.
Amarnath Mohan
11 min read
Includes Code
Has Summary
--
NVIDIA logo
NVIDIA
Advanced
The article discusses the NVIDIA GH200 Grace Hopper Superchip, highlighting its significant advancements in energy efficiency and node consolidation for Apache Spark workloads.