Staff Infrastructure Engineer – Data Platform

Job Description:• Design and implement a new real-time data pipeline using Kafka or other queuing technologies, supporting data engineering and ML use cases• Partner with the data engineering team to stream data directly from core app Postgres databases. • Begin executing the migration path from Datastream to a queuing-based architecture• Outline and drive execution steps for eventual cloud migration from GCP to AWS, leveraging cloud-agnostic technologies• Build scalable load testing frameworks to stress test pricing engineering systems and validate autoscaling logic• Integrate testing frameworks into deployment pipelines to ensure robustness in every release.• Collaborate with Pricing Engineering (PE) and Data Engineering (DE) teams to develop a 6–12 month technical roadmap for shared platform initiatives• Modularize Terraform and other infrastructure-as-code solutions to support both PE and DE teams consistentlyRequirements:• 8+ years of experience building and scaling high-performance distributed systems in production environments• 8+ years of hands on expertise with Kubernetes, Kafka/Kinesis, and Terraform for cloud-native infrastructure• Strong background in systems programming with Golang and C++ and a deep understanding of networking fundamentals• Comfortable driving cloud agnostic infrastructure strategies across GCP and AWS• Results-oriented, entrepreneurial, and able to move quickly in ambiguous, fast paced environments• Background in building real time event driven systems for consumer-facing products• Strong sense of ownership with the ability to set technical direction and influence multiple teams• Knowledge of CI/CD pipelines and integrating advanced testing frameworksBenefits:• Unlimited PTO for full-time employees (we're extremely flexible with the exception of the first few weeks before & into the NFL season)• 16 weeks of fully paid parental leave• A $500 home office allowance• A connected virtual-first culture with a highly engaged distributed workforce• 5% 401k match, FSA, company paid health, dental, vision plan options for employees and dependents Apply tot his job