How Aampe Handles High-Volume Data Ingestion Without Breaking the Bank
Introduction Agentic AI enables businesses to unlock massive amounts of value for their customers. In some cases, that involves solving conventionally familiar problems so that agents can focus on harder learning problems. For example, Aampe enables businesses to provision and manage an agentic learning agent for every one of its customers. Those agents need to […]
Building a High-Performance Real-Time Query Engine with ClickHouse
System Purpose Aampe’s agentic AI infrastructure allows our customers to provision and manage an agent for every one of their end-users. If you’re a food delivery app with 10 million customers, deploying Aampe lets you provision and manage 10 million agents. While Aampe’s agent design enables them to operate a lot of causal learning, experimentation, […]
A 30,000,000,000 row join! And how we reduced runtime of a query by >99%
Last week we at Aampe faced a simple yet interesting scale problem when using BigQuery. The culprit: A simple inner join. We wrote a simple query that joins the users who are eligible to be messaged with their corresponding messages CMS table. The output needed: for each user, all messages that they are eligible to […]
How we handle messy data
As our platform has to work with various data providers, CDPs, and many different companies with very different data lakes and schemas, it’s actually more common for us to encounter messy data than anything else. Here’s our approach to cleaning up this data so it can be usable and actionable: What is “messy” data? “Messy […]
The journey from ETL to reverse ELT
It all began with ETL: Extract -> Transform -> Load Data is pulled from various data sources that house user data, it can be multiple API’s or event data or even raw static files. These are transformed to fit into a predefined data model and then loaded into the data warehouse. This in itself turned […]
Aampe is now integrated with Segment
Aza Raskin says he’s sorry for making you sad. If you don’t know Aza, he’s a writer, engineer, and entrepreneur…and the inventor of the “Infinite scroll”. (You know how you can scroll and scroll and never reach the end of TikTok, Pinterest, Instagram, or even LinkedIn? That’s him.) Infinite scroll came from an attempt to […]