Apache Arrow Programming Tutorials & Engineering Articles

NVIDIA's Sirius, an open-source GPU-native SQL engine, has set a new performance record on ClickBench, enhancing DuckDB with GPU-accelerated analytics.

This article discusses the transition from OpenTelemetry (OTel) to Rotel, an open-source Rust project that enhances tracing capabilities at petabyte scale.

The article discusses the development of StockHouse, a real-time market analytics application that leverages ClickHouse, Massive, and Perspective to handle high-frequency financial data.

ClickHouse version 25. 8 introduces 45 new features, 47 performance optimizations, and 119 bug fixes, enhancing its capabilities as a high-performance analytical database.

The article discusses how to read JSON Lines data using NVIDIA's cuDF library, achieving performance improvements of up to 100 times faster than traditional pandas methods.

This article explores the integration of the Perspective library with ClickHouse to create real-time visualizations of streaming Forex data.

The article discusses how RAPIDS AI can accelerate predictive maintenance in manufacturing by leveraging advanced data analytics to minimize downtime and optimize maintenance schedules.

This article provides a comprehensive guide on encoding and compression techniques for string data in the Parquet format using RAPIDS.

The article introduces five new technical courses offered by NVIDIA aimed at enhancing skills in AI and data science.

The article discusses Meta's transition to a composable data management architecture, emphasizing interoperability, reusability, and engineering efficiency.

The article discusses how Netflix supports a diverse range of machine learning (ML) systems through its Machine Learning Platform (MLP) and the Metaflow framework.

The article discusses the collaboration between Meta, Voltron Data, and the Apache Arrow community to align Apache Arrow with Velox, Meta's open-source execution engine.

The article discusses the use of nested data types in RAPIDS libcudf for optimizing ETL workflows.

The article discusses how GPU-accelerated data analytics can enhance machine learning (ML) projects by improving speed and scalability.

The article discusses the integration of distributed deep learning with Apache Spark 3. 4, highlighting new built-in APIs for both distributed model training and inference.

This article delves into the Apache Parquet format and its integration with ClickHouse, focusing on file reading and writing optimizations.

Meta has introduced Velox, an open source unified execution engine designed to enhance data management systems and streamline their development.

The article discusses Accelerated WEKA, a project that integrates GPU acceleration into the WEKA machine learning software using RAPIDS libraries.

This article discusses a novel approach to analyzing data stored in Apache Cassandra using GPU acceleration through the RAPIDS ecosystem.

This article discusses the importance of efficient memory layouts and memory pools in machine learning frameworks to enhance interoperability and performance.

The article discusses the advancements in Natural Language Processing (NLP) and text processing using RAPIDS, emphasizing performance improvements in string processing with cuDF and cuML.

This article is the second part of a series on building deep learning-powered recommender systems, focusing on the application of deep learning techniques to enhance recommendation quality.

This article serves as an introductory guide to the RAPIDS ecosystem, focusing on GPU-accelerated DataFrames in Python through cuDF.

This article provides an in-depth look at how to leverage machine learning techniques to detect fraud, specifically through the lens of the Kaggle IEEE CIS Fraud Detection competition.

The article announces the open beta of NVIDIA NVTabular, highlighting its new multi-GPU support and optimized data loaders for deep learning recommenders.

The article discusses the significance of deep learning-based recommender systems in enhancing personalized online experiences across various industries.

The article discusses how NVIDIA's RAPIDS Accelerator for Apache Spark enables GPU acceleration for data processing tasks in Apache Spark 3. 0.

The article discusses Uber's SpeedsUp visualization project, which utilizes machine learning to analyze and display city street speed patterns.

The article discusses the use of the RAPIDS VM Image on Google Cloud Platform, highlighting its capabilities for accelerating data science workflows through GPU-accelerated libraries.

The article discusses the design principles for mathematical engineering in the Experimentation Platform at Netflix, highlighting the challenges and strategies for enhancing data science productivi...

NVIDIA announced RAPIDS, a suite of open-source software libraries designed to accelerate end-to-end data science and analytics pipelines entirely on GPUs.

The article introduces Petastorm, an open-source data access library developed by Uber's Advanced Technologies Group (ATG) for facilitating deep learning model training and evaluation directly from...