Ollama Programming Tutorials & Engineering Articles

Long-running AI agents spend most of their time on high-volume execution: tool calls, result validation, and subagent delegation. Using a frontier reasoning…

Deploying secure, real-time Edge AI on Raspberry Pi is now simplified using LiteRT and lightweight Gemma open models. LiteRT optimizes CPU and GPU performance, delivering fast token speeds for models like Gemma4, enabling real-time local reasoning for robotics. Developers can quickly convert, quantize, and run these models using the lightweight LiteRT CLI tool. Support for Hailo AI accelerators is also coming very soon.

ClickHouse 26.6 is here! In this release, we have hypothetical skip indexes, cascading refreshable materialized views, experimental support for continuous queries, and more!

Single-turn chatbots are evolving into long-running agents that can reason, maintain context, use tools, and run efficiently across many turns to complete…

The newly released Gemma 4 12B is a dense, multimodal model designed for high-performance local AI execution on consumer devices. By introducing a novel, encoder-free architecture, it bypasses traditional visual and audio encoders to feed multimodal data directly into the LLM backbone.

The rise of autonomous, long-running AI agents has introduced a new class of compute demand, namely tasks that maintain large context windows…

Agentic systems often reason across screens, documents, audio, video, and text within a single perception‑to‑action loop. However, they still rely on fragmented…

Agents are evolving from question-and-answer systems into long-running autonomous assistants that read files, call APIs, and drive multi-step workflows. However…

The Gemmaverse expands with the launch of the latest Gemma 4 multimodal and multilingual models, designed to scale across the full spectrum of deployments…

The article discusses how recent upgrades to open source AI tools enhance the performance of small language models (SLMs) and diffusion models on NVIDIA RTX PCs.

The article discusses the implementation of Edge AI on the NVIDIA Jetson platform, focusing on the use of Large Language Models (LLMs), Vision Language Models (VLMs), and Foundation Models in robot...

The NVIDIA-accelerated Mistral 3 open model family offers developers and enterprises industry-leading accuracy, efficiency, and customization capabilities.

The article discusses the integration of Google’s Agent Development Kit (ADK) for Java with the LangChain4j LLM framework, enabling developers to utilize a variety of Large Language Models (LLMs) f...

The article announces the release of Genkit Go 1. 0, a stable, production-ready open-source AI development framework for the Go ecosystem.

EmbeddingGemma is an innovative open embedding model designed for on-device AI applications, featuring 308 million parameters for efficient performance.

The article introduces Gemma 3 270M, a compact AI model designed for hyper-efficient task-specific fine-tuning.

NVIDIA has optimized OpenAI's gpt-oss models for accelerated inference performance on the NVIDIA GB200 NVL72 system, achieving up to 1. 5 million tokens per second (TPS).

The article discusses the general availability of Google DeepMind's Gemma 3n on NVIDIA RTX and Jetson platforms, highlighting its capabilities in multi-modal on-device deployment, including audio, ...

The article introduces Gemma 3n, a mobile-first architecture designed for on-device AI, highlighting its multimodal capabilities and architectural innovations.

The article discusses the integration and deployment of Alibaba's Tongyi Qwen3 models into production applications using NVIDIA technologies.

The article discusses the launch of Gemma 3, a state-of-the-art AI model optimized for consumer GPUs through Quantization-Aware Training (QAT).

NVIDIA has announced world-record inference performance for the DeepSeek-R1 model using the Blackwell architecture, achieving over 250 tokens per second per user and a maximum throughput of over 30...

Gemma 3 is the latest version of the Gemma open-model family, boasting enhanced capabilities such as multimodality, longer context windows, and improved reasoning.

The article discusses the launch of ShieldGemma 2, a safety content classifier model built on Gemma 3, aimed at detecting harmful content in both synthetic and natural images.

NVIDIA JetPack 6. 2 introduces Super Mode for the Jetson Orin Nano and Jetson Orin NX modules, significantly enhancing generative AI performance.

The article discusses the enhancements made to the NVIDIA Jetson Orin Nano Developer Kit, now renamed the Jetson Orin Nano Super Developer Kit, which offers a performance boost of up to 1.

The article discusses how llama. cpp, an efficient framework for large language model (LLM) inference, can be accelerated on NVIDIA RTX systems.

The article discusses the advancements in responsible AI through the introduction of Gemma 2, which includes models with 27 billion and 9 billion parameters, emphasizing safety and accessibility.

The article discusses how Infosys leverages NVIDIA NIM and NeMo Retriever to enhance network operations centers (NOCs) for telecom companies.

Genkit for Go is an open-source framework designed to help developers build scalable AI-powered applications using the Go programming language.

The article discusses Firebase Genkit, an open-source framework introduced at Google I/O 2024, designed for developers to integrate generative AI into web and mobile applications using models like ...

The article recaps the Google I/O 2024 event, highlighting advancements in AI technologies aimed at making AI accessible for developers.

The article discusses the development of an open-source AI image description service using large language models (LLMs) like LLaVA and tools such as Ollama and PocketBase.

Fly. io has announced the availability of GPU instances for everyone, enabling users to leverage powerful GPUs for applications like large language models, text transcription, and image generation.

The article discusses Yoko Li's innovative work in AI, focusing on her projects like AI Town and AI Tamago, which utilize emergent behavior and large language models.

Fly. io has announced the availability of GPUs, enabling users to perform AI workloads closer to their users at the edge. The article discusses the capabilities of Fly.

The article explores the nature and capabilities of Graphics Processing Units (GPUs), particularly in the context of AI/ML workloads.

The article discusses how to scale large language models to zero using Ollama on Fly. io, emphasizing the benefits of self-hosting AI tools and the efficient use of GPU resources.

The article discusses the FLAME pattern, a new approach to serverless computing that allows developers to elastically scale applications without the complexities of traditional Function as a Servic...