Who You Are: 

You are motivated by the technical challenges that come with structured and unstructured data at an enterprise level. Even more, you are energized by bringing solutions and innovations that help the business move forward. You are passionate about building data platforms, frameworks and driving insights from complex multi structured datasets. 

Your Next Challenge: 

We’re looking for an experienced Data Engineer to continue to evolve and mature our enterprise data platform. In this role, you will partner closely with product, analytics, and technology stakeholders to continue to grow and innovate the platform by: 

Responsibilities include:

• Design, implement and deliver cloud based analytical solutions.
• Design and develop high-throughput, low-latency data processing pipelines including data quality and testing.
• Identify approaches to extract valuable insights from massive datasets.
• Research, evaluate and utilize new technologies, tools and frameworks.
• Write well designed and efficient code.
• Ensure scalability and high performance of the platform.

Requirements:

• 7+ years hands-on experience with designing and implementing solutions using distributed technologies.
• Expert knowledge in modern distributed architectures and compute / data analytics / storage technologies on AWS Cloud.
• Hands-on working experience on Snowflake and Hive/Spark
• Understanding of architectural principles and design patterns / styles using parallel large-scale distributed frameworks such as Hadoop and Spark;
• Expertise in writing ETLs with strong SQL skills.
• Advanced knowledge of a programming languages such as Java or Python
• Experience in SQL Server BI stack (SSIS, SSAS, SSRS) will be a plus
• Experience with Hadoop, Spark, Kafka and hive
• Demonstrate broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in production on Hadoop & Spark clusters.
• Outstanding analytical skills, excellent team player and delivery mindset.
• Experience in performance troubleshooting, SQL optimization, and benchmarking.
• Thorough understanding of service-oriented architectures and data processing in high-volume applications.
• Knowledge of working in UNIX environment with shell scripting.
• Experience building solutions using agile methodologies
• Strong bias for action; ability to juggle multiple priorities and create a sense of urgency in a fast-paced, dynamic environment