Neural Networks Programming Tutorials & Engineering Articles

The article discusses the limitations of current large language models (LLMs) in handling long contexts and introduces Test-Time Training with an end-to-end formulation (TTT-E2E) as a solution.

The article discusses the integration of AI Physics into Technology Computer-Aided Design (TCAD) simulations, highlighting its significance in semiconductor manufacturing.

The article discusses the application of Graph Neural Networks (GNNs) in enhancing fraud detection within financial services.

The article discusses the establishment of a large-scale learned retrieval system at Pinterest, focusing on the transition from heuristic-based methods to an embedding-based retrieval system.

The article discusses the implementation of data-efficient knowledge distillation using NVIDIA NeMo-Aligner during supervised fine-tuning (SFT).

The article introduces tile-based programming in Warp 1. 5. 0, highlighting new Python primitives that enhance GPU programming efficiency.

The NVIDIA Deep Learning Institute has launched the Accelerated Data Science Teaching Kit, aimed at educators to enhance data science education.

The article discusses the nvmath-python library, which allows Python programmers to perform high-performance mathematical operations using NVIDIA's CUDA-X math libraries.

The article explores the RecurrentGemma architecture, a hybrid model that combines gated linear recurrences with local sliding window attention, enhancing performance for long context prompts.

This article discusses the Candidate Generation (CG) stage of LinkedIn's People You May Know (PYMK) recommendation system, detailing the various techniques used to generate relevant candidate pools...

The article discusses the application of Graph Neural Networks (GNNs) in optimizing the design and simulation of lattice structures in additive manufacturing.

This article explores the optimization of memory and retrieval processes for large-scale Graph Neural Networks (GNNs) using WholeGraph, a feature of the RAPIDS cuGraph library.

The article discusses WholeGraph, a feature in the RAPIDS cuGraph library designed to optimize memory and retrieval for Graph Neural Networks (GNNs).

The article discusses the rapid adoption of federated learning (FL) and the new features introduced in NVIDIA FLARE 2. 4.

The article discusses the evolution of ads conversion optimization models at Pinterest, highlighting the transition from Gradient Boosted Decision Trees (GBDT) to advanced Deep Neural Networks (DNN...

The article discusses the intricacies of training Large Language Models (LLMs) using transformer networks, focusing on model architectures, attention mechanisms, and embedding techniques.

A Stanford University team is revolutionizing cardiovascular care through AI-driven simulations that provide patient-specific blood flow visualizations.

The article discusses NVIDIA AI Enterprise 4. 0, a comprehensive solution designed to support enterprises in developing and deploying generative AI applications.

This article introduces Graph Neural Networks (GNNs) and how to utilize cuGraph-DGL, a GPU-accelerated library for graph computations.

The article discusses the design of deep neural networks (DNNs) that can process the weights of other DNNs, focusing on architectures that leverage the symmetries of weight spaces.

The article discusses the structured sparsity feature in the NVIDIA Ampere architecture, particularly focusing on its implementation in deep learning and applications in search engines.

This article discusses the use of time-series models, specifically autoregressive recursive neural networks and XGBoost, for predicting credit defaults.

The article discusses NVIDIA PhysicsNeMo, a framework for developing physics-informed machine learning models, with a focus on the latest update that introduces support for Graph Neural Networks (G...

The article discusses the training workflow and best practices for implementing sparsity in INT8 models using NVIDIA TensorRT.

This article discusses a Machine Learning (ML) based approach to proactively prevent advertiser churn at Pinterest.

The article discusses the NVIDIA GTC 2023 conference, highlighting its extensive training opportunities in AI, HPC, and the metaverse.

The article discusses five methods for database obfuscation, emphasizing the importance of using realistic data for performance testing in analytical databases like ClickHouse.

The article discusses the benchmarking of deep neural networks, specifically Long Short-Term Memory (LSTM) models, for low-latency trading and rapid backtesting using NVIDIA GPUs.

The article discusses the application of causal machine learning at Netflix to derive creative insights for promotional artwork.

The article discusses the development of LinkedIn's Skills Graph, which aims to create a skills-first job market by mapping the relationships between skills, people, and organizations.

The NVIDIA Grace Hopper Superchip Architecture represents a significant advancement in heterogeneous computing, combining NVIDIA Grace CPUs and Hopper GPUs to optimize performance for AI and high-p...

The article discusses how Graph Neural Networks (GNNs) and NVIDIA GPUs can optimize fraud detection in financial services.

NVIDIA has announced significant updates to its AI software suite, including JAX, NVIDIA CV-CUDA, and NVIDIA RAPIDS, aimed at accelerating AI research, computer vision, and data science.

The article discusses hands-on training opportunities provided by the NVIDIA Deep Learning Institute (DLI) at the upcoming GPU Technical Conference (GTC).

This article provides a comprehensive guide on deploying large transformer models like GPT-J and T5 using NVIDIA's Triton Inference Server and FasterTransformer library.

NVIDIA has announced significant updates to the NeMo framework, enhancing the training speed of large language models (LLMs) by up to 30%.

The article discusses how to accelerate GPU applications using NVIDIA Math Libraries, highlighting three main approaches: compiler directives, programming languages, and preprogrammed libraries.

The article introduces Transformers4Rec, a library from NVIDIA Merlin designed for building session-based recommendation systems using state-of-the-art Transformer architectures.

The article discusses the application of graph machine learning at Airbnb, highlighting how graph structures can enhance machine learning models by providing contextual information about users.

The article discusses various techniques for training large neural networks, focusing on the challenges and strategies involved in parallelizing model training across multiple GPUs.

NVIDIA experts will present advancements in robotics, Graph Neural Networks (GNNs), and Natural Language Processing (NLP) at the WeAreDevelopers World Congress in Berlin.

The article discusses the Performance-Adaptive Sampling Strategy (PASS) for Graph Neural Networks (GNNs) and announces its open-source release.

This article serves as a guide for Data Scientists to understand the fundamental concepts of gradient descent and backpropagation algorithms, which are essential for training Artificial Neural Netw...

The article discusses the completion of member knowledge graphs using Graph Neural Networks (GNNs), specifically introducing a novel model called Entity-BERT.

The article provides a comprehensive overview of NVIDIA's Nsight Developer Tools, which are designed to optimize computational applications across various architectures.

NVIDIA has launched PhysicsNeMo, a framework for training neural networks that integrates governing physics equations with observed or simulated data, aimed at enhancing the development of digital ...

NVIDIA has introduced GPU-accelerated Deep Graph Library (DGL) containers to assist developers, researchers, and data scientists in working with Graph Neural Networks (GNN) on large heterogeneous g...

NVIDIA has released an updated Edge AI and Robotics Teaching Kit aimed at university educators, developed in collaboration with experts from the University of Oxford and the University of Maryland,...

The article discusses NVIDIA PhysicsNeMo, an AI toolkit that leverages physics-informed neural networks (PINNs) to enhance product development by solving complex nonlinear physics problems.

The article discusses the upcoming NVIDIA DRIVE Developer Day at NVIDIA GTC, where developers can learn about the latest features in autonomous vehicle technology from NVIDIA experts.