Principal Data Engineer
Position Summary
About Discovery
Discovery, Inc. is the global leader in real life entertainment. We serve passionate fans with content that inspires, informs, and entertains, providing leadership across deeply loved and trusted brands, such as Discovery Channel, TLC, Animal Planet, HGTV, Food Network, and Travel Channel. Available in 220 countries and territories and 50 languages, Discovery reaches viewers on all screens and services, from free-to-air and pay-TV channels, to digital products and streaming services, to social and mobile-first content and formats. Discovery delivers over 8,000 hours of original programming each year.
About Us
Discovery's Digital group is a well-funded start-up within Discovery, Inc. We are fast, nimble, and have fun developing new, innovative, and immersive digital products and content for iconic brands. We are working at the crossroads of technology, entertainment, and every day utility. As content creators across the digital ecosystem, we continuously leverage our technology to create immersive viewing and interactive experiences. We tell engaging stories to millions of viewers across the Internet every day, and bring new interactive experiences to life to not only entertain, but improve the lives of our customers.
Position Summary
We are hiring a Principal Data Engineer in Bellevue, Washington to help build, scale, and maintain the data infrastructure needed to transform data into actionable insights and science-driven capabilities across our food, home, and lifestyle products. The Principal Data Engineer will be an experienced engineer and leader on the Data Science and Analytics team. They will help advise and create a scalable data ecosystem and infrastructure that encompasses the many data elements produced across our direct-to-consumer products and apps.
This role will design data flow and architecture, create frameworks for ETL jobs, establish standards for new data, scale existing data sets, and create innovative data solutions to support consumer products across mobile, tablets, web, connected TV, voice, and emerging technologies. They will use big data platforms, data warehousing, and business intelligence technology to enable data science, machine learning, and self-service visualization analytics to drive these insights and product capabilities. This Principal engineer will ensure the ongoing performance of reliable and efficient data systems using AWS and other data technologies.
An ideal candidate will be a driven, passionate advocate for building and maintaining highly scalable data systems, and using that data to support analytics and solutions that produce great experiences for our customers. This person will make data-driven decisions, have an insatiable curiosity, and obsess about their customers. They will have a strong point of view but remain open-minded should evidence lead in another direction. They are a senior member of the team whom others enjoy working with because they are reliable, innovative, and care for their team members. They build trust with people from all areas of the business and have a proven track record. This senior engineer takes end-to-end ownership and consistently delivers results in a fast-paced environment.
Responsibilities
1. Lead the implementation, expansion and on-going development of analytics and data platform supporting food, home, and lifestyle direct-to-consumer products.
2. Build a modern data infrastructure needed to ingest, connect and process detailed data from multiple sources and systems, including but not limited to user behavior data, marketing and content data as well as logs/signals generated by engineering services.
3. Establish standards for data ingestion, storage, data cleansing and business logic transformation to ensure accurate, reliable and timely processing of vast amounts of data and support concurrent usage across the business unit.
4. and Partner with product, marketing, engineering, and analytics stakeholders to understand what data structures and systems are needed to support key business goals and processes.
5. Evolve the infrastructure to support new use cases, advanced analytics and data science and drive data-driven decision making across the organization.
6. Partner with central data warehousing team to ensure all relevant data is accessible enterprise-wide and meets common standards.
7. Support the hiring and development of other data engineers, scientists, analysts, and other technical professionals, helping them enhance their skills, while supporting a fun and engaging culture.
Requirements
* Minimum of 10+ years of proven technical experience in data engineering, data warehousing, and analytics.
* Passion for building robust analytic and data foundation with solid test foundation.
* Solid understanding of common distributed systems problems and solutions.
* Solid understanding of common database technologies, including SQL and NoSQL.
* Experience with Amazon Web Services (Redshift, S3, EC2, EMR, etc.) is required.
* Experience with open-source technology stack and practice.
* Experience with large scale data processing systems (Hadoop, Spark, Flink, Beam)
* Experience with programming languages, such as Python or R is required.
* Curiosity and interest in using machine learning.
* Demonstrated ability to work across product, engineering, and analytics teams to evaluate new ideas, discuss technical concepts, create scalable designs, and make tradeoffs to remove roadblocks.
* Master’s degree in quantitative or technical field (statistics, mathematics, computer sciences, etc.) is a plus.
* Must have the legal right to work in the United States.