Senior/Staff Software Engineer, Data Engineering Team

As a Senior or Staff Software Engineer on our Data Engineering team, you will contribute to scaling and advancing our entire data operation. This includes procurement and ingestion of new datasets, enabling the use of data in research and production environments, building data-related systems and tooling, and collaborating closely with various teams to facilitate data consumption. You will work with our team lead to design, scope, and deliver large scale projects within the team. You will collaborate closely with a diverse group of engineers, and directly impact the team's productivity and successful delivery. You will help to define the team's technical roadmap towards achieving strategic-level engineering goals. You'll participate in mentorship and development of other engineers on the team, and shaping our company's engineering culture.
We seek brilliant thinkers who are passionate about taming complexity and solving problems through innovation and rigorous engineering. You’ll work in a collaborative environment that encourages creativity and experimentation, and values efficiency and attention to detail. Our engineers come from leading technology companies and top academic programs. Our team partners closely with machine learning researchers. We pride ourselves on being kind, friendly, and down-to-earth, and look for people who share those qualities.

Responsibilities

Engage and collaborate in diverse software development work, including design and implementation of data processing technologies, sourcing and delivery systems and pipelines, development of data related tools and libraries, and more.
Support our trading operations and promote our research effort through reliable delivery of high-quality data.
Build scalable and robust ingestion and distribution systems, and fault-tolerant production-critical pipelines.
Lead complex projects from start to finish, including gathering requirements, creating a robust software design, reasoning about supporting or dependent technologies, and communicating effectively with stakeholders, collaborators, and teammates.
Provide technical guidance to engineering and research staff.
Provide mentorship and support to help grow your teammates and up-level the team.

Requirements

Computer Science / Engineering bachelor’s degree (or equivalent)
5+ years of relevant software engineering experience
Proven track record of software design and implementation with focus on correctness, robustness, efficiency, and scale
Experience working with large codebases and building modular, extensible, and maintainable software
Expertise in a modern programming language, such as Python, Go, Java or C++
Hands-on experience developing in a Linux/UNIX environment
Design and implementation of scalable services, highly-available systems, and/or robust data infrastructure
Strong communication skills and a knack for explaining complex ideas with clarity and simplicity

Preferred Qualifications

Familiarity with the following strongly preferred:
Experience with data storage and management technologies (e.g. PostgreSQL, Artifactory, Ceph, Redis)
Cluster management and containerization technologies (e.g. Kubernetes, Docker)
Job scheduling and orchestration technologies (e.g. Airflow, Slurm)