How Netflix uses eBPF flow logs at scale for network insight

4 years ago netflixtechblog.com

Summary: This is a summary of an article originally published by Netflix Tech Blog. Read the full original article here →

By Alok Tiagi, Hariharan Ananthakrishnan, Ivan Porto Carrero and Keerti Lakshminarayan The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices. Netflix software infrastructure is a large distributed ecosystem that consists of specialized functional tiers that are operated on the AWS and Netflix owned services.

By collecting, accessing and analyzing network data from a variety of sources like VPC Flow Logs, ELB Access Logs, eBPF flow logs on the instances, etc, we can provide network insight to users and central teams through multiple data visualization techniques like Lumen, Atlas, etc.

We are currently ingesting and enriching billions of eBPF flow logs per hour and providing visibility into our cloud ecosystem.

DevOps Articles