Shadow Traffic with Envoy

Pankaj Takawale
5 min readNov 11, 2020

How can we capture the incoming requests to replay them in a shadow production environment or in a test environment?

How can we investigate request failures like 5XX in the production environment?

Systems behave differently depending on environment and traffic patterns. For testing the systems, we can achieve high throughput with the scripted tests. However, we may end up repeating request/s that are not resource intensive or too much resource intensive. As a result, we would end up estimating small or larger capacity for the system. The smaller capacity would…

--

--

Pankaj Takawale

Leading Machine Learning Model Serving Platform & Query Understanding at Walmart Search. Passionate about engineering excellence on large Distributed Systems