Jupiter: Config Driven Adtech Batch Ingestion Platform

Barani Subramanian, Manaswini Lakshmikanth Sugatoor
12 min readadvanced
--
View Original

Overview

The article discusses Jupiter, Uber's new config-driven adtech batch ingestion platform, which replaces the legacy system MaRS. It highlights the challenges faced with the previous system and how Jupiter enhances marketing operations through improved scalability and timely data ingestion.

What You'll Learn

1

How to enhance data ingestion processes for marketing platforms

2

Why timely data ingestion is crucial for ad performance

3

How to implement a config-driven architecture for data ingestion

Prerequisites & Requirements

  • Understanding of adtech and performance marketing concepts
  • Familiarity with data ingestion tools and APIs(optional)

Key Questions Answered

What challenges did Uber face with the legacy ingestion system?
Uber's legacy ingestion system, MaRS, struggled with diverse technological systems, inconsistent data formats, and delays in data processing. This led to difficulties in accurately measuring ad performance and onboarding new users, ultimately affecting the balance between supply and demand in the marketplace.
How does Jupiter improve the data ingestion process?
Jupiter enhances the data ingestion process by implementing a config-driven architecture that allows for rapid onboarding of new partners and sources. This system reduces the time required for data ingestion by over 90% for new ingestion processes and 75% for new vendors and sources, significantly improving marketing operations.
Why is timely ingestion critical for performance marketing?
Timely ingestion of advertising signals is crucial for Uber's performance marketing as delays can lead to inaccurate performance metrics. This can result in misguided ad spending decisions, ultimately affecting user onboarding and the overall effectiveness of marketing strategies.
What metrics indicate the success of the new ingestion platform?
The success of the Jupiter platform is indicated by significant improvements in metrics such as onboarding time for new ingestion processes (>90% improvement), new vendors (>75%), and data ingestion frequency (>75%). These metrics demonstrate enhanced efficiency and responsiveness in marketing operations.

Key Statistics & Figures

Onboarding Time – New Ingestion
> 90%
This improvement reflects the efficiency of the new Jupiter platform in onboarding new ingestion processes.
Onboarding Time – New Vendor
> 75%
This statistic highlights the reduced time required to onboard new vendors compared to the legacy system.
Data Ingestion Frequency
> 75%
This indicates the increased frequency of data ingestion, enhancing the responsiveness of marketing operations.

Technologies & Tools

Some links below are affiliate links. We may earn a commission if you make a purchase.

Key Actionable Insights

1
Implement a config-driven architecture to streamline data ingestion processes.
This approach allows for flexibility and rapid adaptation to new data sources, which is essential in the fast-paced adtech environment.
2
Prioritize timely data ingestion to maintain accurate performance metrics.
Delays in data processing can lead to misguided marketing strategies, so ensuring prompt ingestion is critical for effective ad performance.
3
Utilize a hybrid architecture to balance external vendor data and in-house data retrieval.
This strategy provides greater control over critical marketing channels and enhances the overall data ingestion process.

Common Pitfalls

1
Failing to standardize data formats across diverse partners can lead to integration challenges.
Without consistent data formats, the ingestion process becomes cumbersome and error-prone, making it difficult to maintain data integrity and reliability.
2
Neglecting timely data ingestion can result in inaccurate performance metrics.
Delays in processing advertising signals can mislead marketing strategies, causing inefficiencies in ad spending and user onboarding.

Related Concepts

Performance Marketing Strategies
Data Ingestion Best Practices
Adtech Ecosystem Changes