Google logo

How Google Uses Transformer

12 engineering articles about Transformer from Google's engineering team

Articles

Filter:
Google logo
Google
Intermediate
The article provides an in-depth exploration of the EmbeddingGemma architecture, detailing its origins, embedding generation process, and the comprehensive training methodology.
Henrique Schechter Vera, Juyeong Ji, Sahil Dua
7 min read
Includes Code
Has Summary
--
Google logo
Google
Advanced
The article discusses the deployment of on-device generative AI (GenAI) using LiteRT-LM in Chrome, Chromebook Plus, and Pixel Watch.
Yu-hui Chen, Ram Iyengar
9 min read
Includes Code
Has Summary
--
Google logo
Google
Intermediate
The article introduces T5Gemma, a new collection of encoder-decoder models derived from pretrained decoder-only models.
Biao Zhang, Paul Suganthan, Ben Hora
5 min read
Has Summary
--
Google logo
Google
Intermediate
The article introduces Gemma 3n, a mobile-first architecture designed for on-device AI, highlighting its multimodal capabilities and architectural innovations.
Omar Sanseviero, Ian Ballantyne
9 min read
Includes Code
Has Summary
--
Google logo
Google
Intermediate
LiteRT is a new API designed to simplify and enhance AI model performance on mobile devices by leveraging GPU and NPU acceleration.
Mogan Shieh, Terry (Woncheol) Heo, Jingjiang Li
7 min read
Includes Code
Has Summary
--
Google logo
Google
Advanced
The article discusses the Gemma 3 1B model, a lightweight language model designed for mobile and web applications using Google AI Edge.
Marissa Ikonomidis, T.J. Alumbaugh, Mark Sherwood, Cormac Brick
8 min read
Includes Code
Has Summary
--
Google logo
Google
Advanced
The article explores the RecurrentGemma architecture, a hybrid model that combines gated linear recurrences with local sliding window attention, enhancing performance for long context prompts.
Ju-yeong Ji, Ravin Kumar
6 min read
Includes Code
Has Summary
--
Google logo
Google
Intermediate
The article provides an overview of the Gemma model family architectures, detailing its lightweight, state-of-the-art open models derived from Gemini research.
Ju-yeong Ji, Ravin Kumar
9 min read
Includes Code
Has Summary
--
Google logo
Google
Advanced
This article provides a comprehensive guide on using Gemma with Ray on Vertex AI, detailing the steps to set up, fine-tune, and deploy machine learning models.
Google logo
Google
Intermediate
The article discusses the release of the Gemma 2 model with 27 billion parameters, highlighting its capabilities in Keras and integration with JAX for efficient model training.
Martin Görner
5 min read
Includes Code
Has Summary
--
Google logo
Google
Intermediate
The article introduces the expansion of the Gemma family with two new models, CodeGemma and RecurrentGemma, designed specifically for developers and researchers.
Google logo
Google
Intermediate
The article introduces Gemma models in Keras, a family of lightweight, state-of-the-art open models that leverage the same technology as the Gemini models.

You've reached the end! All 12 articles loaded.