Debugging Memory Exhaustion in a Kubernetes Redis Cluster

Fri, 20 Dec 2024 06:38:35 -0400

Introduction

In one of our high-traffic deployments, which sits at the intersection of web and AI use cases, we had a Redis cache pod shared between the web application and AI background workers. While this setup wasn’t ideal, it had worked well—until one day, we were paged: Redis was down‼️ When a Redis pod crashes or restarts frequently, it’s important to follow a step-by-step guide to diagnose and resolve the root cause effectively.

Rate Limiter in API Design

Thu, 20 Jul 2023 11:57:16 -0400

A rate limiter is a mechanism used to control the rate at which certain operations or requests are allowed to be processed by a system or an API. It helps prevent abuse, protect system resources, and ensure fair usage by limiting the number of requests or actions that can be performed within a specific timeframe. And Richard Schneeman has put it nicely in his tweet where he said:

If you provide an API client that doesn’t include rate limiting, you don’t really have an API client. You’ve got an exception generator with a remote timer.

System Design on Uday K

Debugging Memory Exhaustion in a Kubernetes Redis Cluster

Introduction

Rate Limiter in API Design