Please submit your questions on this thread
We are delighted to announce our next community call on October 28, 2020 9:30 AM Pacific Time . This month we are featuring an exciting talk by Daniel Posthuma from Martin.ai. We will also have a Dgraph product update from @mrjn and the rest of the team. As always, you will have the opportunity to get your questions answered by the Dgraph team.
9:30 AM - 10:00 AM: Daniel Posthuma from Martin.ai and Q&A
10:00 AM - 10:20 AM: Product update from the Dgraph Team
10:20 AM - 10:30 AM: Q&A with Dgraph team
How did I reduce an almost 1TB Redis cluster down to 10GB using Dgraph’s Ristretto by Daniel Posthuma
When you need low latency access to large datasets, it’s easy to cache yourself into massive cloud hosting bills. Off-the-shelf solutions may solve parts of your problem but don’t address the full picture. This is the situation we found ourselves in at Martin where we are building real-time bidding systems that have strict latency requirements while receiving well over 200k RPS. Solving this problem requires a robust caching and storage strategy, but before devising a strategy we first need to ask the right questions. What kind of usage patterns does the solution need to support? How does data enter into the system? What needs to be fast - reads, writes or both? What kind of scaling requirements must be supported? How important is consistency to your application? What metrics determine success in the solution? Join me as we address these questions by walking through our caching strategy at Martin.
You will learn:
- How to isolate caching in its own service
- How to identify the right off-the-shelf software to include in your solution
- How Dgraph’s Ristretto library can play a part in your caching strategy
- A data driven approach to measuring the performance of your solution
About Daniel Posthuma
Daniel Posthuma is a software engineer building high performance bidding systems for Martin that support billions of requests per day. Most of the code he writes is in Go, C, or C++ and his interests primarily revolve around operating systems, computer architecture, and infrastructure engineering. In his spare time you could find him hacking on Plan 9 from Bell Labs, picking up algorithmic trading, or enjoying the outdoors with his family.