Senior Data Engineer
4 hours ago
The infrastructure that powers Rover’s consumer facing web app runs in AWS. It is fully automated (IAC and CI/CD) with Kubernetes as its strategic platform. We release to production over thirty times per day. Rover’s data infrastructure that supports this consists of MySQL and Postgres RDS instances, data streaming and batch jobs using a combination of Luigi jobs, Alooma’s ETL pipelines, and Amazon’s MSK to move data to suit the needs of the business. We use AWS Redshift as our data-warehouse and together with an S3 based data lake we support various traditional and machine learning based applications.