Data Engineer II

As a Data Engineer II, you will share ownership of Redfin’s Data Platform, owning business critical data integrations and operational excellence. You will work closely with Engineering and Analytics teams to create and support data pipelines and transformations. The ideal candidate is a data pipeline builder who enjoys optimizing existing systems as well as building new systems from the ground up. We are also looking for someone who is self-directed and comfortable supporting the data needs of multiple systems and teams.
 

About the Role

• Design, develop, and support complex data pipelines from a wide variety of data sources for Redfin

• Work with other Engineering teams to design and implement data exchange systems from structured and unstructured data sources

• Work with end users to gather requirements and design solutions that provide the the data they need in the format they need it in

• Ensure 100% accuracy in everything you do - make sure that all code and processes are fully tested and verified before running in production

• Identify and implement internal process improvements by automating manual processes and optimizing for accuracy, performance and coding best practices

• Support and maintain dev / test / prod environments

• Serve as part of weekly on call rotation

About You

• 3+ years experience with a modern programming language (Python, Java, etc). Python is preferred

• 3+ years experience with complex SQL, data modeling and database technologies (Postgres, MySQL, Snowflake, etc). Snowflake is preferred

• Experience creating and maintaining complex data pipelines

• Experience with batch and streaming data pipelines

• Experience with both structured and unstructured data sets

• Ability to translate business needs into technical requirements

• Experience with Git / Jenkins / Airflow / Docker / Kubernetes / Spark is a plus

• Experience with API development is a plus

• Experience with cloud services (AWS / Azure / GCP) is a plus. AWS is preferred

• Ability to structure data to make it accessible, performant, and resilient to change

• Experience with message queuing and stream processing data is a plus

• Ability to handle ambiguity and function in a fast paced, constantly changing environment

• Ability to communicate well with both technical and non technical users

What you’ll get

Our team members fuel our strategy, innovation and growth, so we ensure the health and well-being of not just you, but your family, too! We go above and beyond to give you the support you need on an individual level and offer all sorts of ways to help you live your best life. We are proud to offer eligible team members perks and health benefits that will help you have peace of mind. Simply put: We’ve got your back. Check out our full list of Benefits and Perks.

About us

Redfin is revolutionizing the $75 billion real estate industry. We use data, beautiful software, and innovative design to put customers first at every step in the home-buying and selling process. Get ready to dive headfirst into our award-winning website and mobile apps, solving complex business problems in a highly visible, customer-centric way. If you value doing great work in a collaborative environment, join our team!

This job description is an outline of the primary responsibilities of this position and may be modified at the discretion of the company at any time.  Decisions related to employment are not based on race, color, religion, national origin, sex, physical or mental disability, sexual orientation, gender identity or expression, age, military or veteran status or any other characteristic protected by state or federal law.  The company provides reasonable accommodations to qualified individuals with disabilities in accordance with applicable state and federal laws.  Applicants requiring reasonable accommodations in completing the application and/or participating in the application process should contact a member of the Human Resources team, at [email protected].

The compensation information below is provided in compliance with all applicable job posting disclosure requirements. The compensation for this position is $119,900.00-$162,200.00. The position may also be eligible for an annual bonus, incentives, and other employment-related benefits including, but not limited to, medical, dental, and vision benefits, 401K retirement plan, and paid-time off. More information regarding these benefits and others can be found here. The information regarding compensation and other benefits included in this paragraph is the company’s current, good faith estimate at the time of posting. [Compensation and benefits are subject to modification from time to time as the Company, in its sole and exclusive discretion, deems appropriate.] The Company may determine during its future reviews of the proposed compensation and benefits provided for this position, that the compensation and benefits for such position should be reduced. In no event will the Company reduce the compensation for the position to a level below the applicable jurisdictional minimum wage rate for the position. Los Angeles County and San Francisco Candidates only: qualified applicants with arrest or conviction records will be considered for employment per the Fair Chance Ordinance and the Fair Chance Initiative for Hiring.