Brillio Logo

Brillio

Lead Data Engineer - Python, AWS, ETL - R01551402

Sorry, this job was removed Sorry, this job was removed at 04:09 p.m. (PST) on Wednesday, Jul 02, 2025
Hybrid
Chicago, IL
Hybrid
Chicago, IL

Similar Jobs

2 Hours Ago
Easy Apply
Hybrid
Chicago, IL, USA
Easy Apply
158K-219K
Senior level
158K-219K
Senior level
Fintech • Machine Learning • Mobile • Security • Software
Design and build backend systems, develop APIs, collaborate with teams on features, and enhance system performance and reliability.
Top Skills: APIsCaching SystemsRuby On RailsSQL
2 Hours Ago
Hybrid
Chicago, IL, USA
145K-172K Annually
Senior level
145K-172K Annually
Senior level
Agency • Fintech • Payments • Sharing Economy • Social Impact
The Senior Solutions Architect designs and implements cloud-based solutions, supports data platforms, and mentors junior staff while ensuring compliance with IT security and operational standards.
Top Skills: AWSAzureCloud ComputingInformation Security
2 Hours Ago
Hybrid
Chicago, IL, USA
98K-125K Annually
Mid level
98K-125K Annually
Mid level
eCommerce • Food • Information Technology • Mobile • Cybersecurity • App development • Big Data Analytics
This role involves managing hardware lifecycle, collaborating with stakeholders, implementing new technologies, and strategic planning to enhance restaurant tech operations.
Top Skills: Agile PracticesCloud PlatformsContainersHyper-VMicrosoft Windows ServerPowershellSoftware Development LifecycleVirtualiztion Technologies
Lead Data Engineer

Primary Skills

  • Python, SQL/PLSQL, AWS,Postgresql,S3, Glue Good to have : CDK, GitHub

Job requirements

  • Location: Chicago, IL - Hybrid with 2-3 days on-site in a week

  • Job Description We are looking for an experienced AWS Lead Data Engineer to design, build, and manage robust, scalable, and high-performance data pipelines and data platforms on AWS. The ideal candidate will have a strong foundation in ETL fundamentals, data modeling, and modern data architecture, with hands-on expertise across a broad spectrum of AWS services including Athena, Glue, Step Functions, Lambda, S3, and Lake Formation.

    Key Responsibilities:
  • Design and implement scalable ETL/ELT pipelines using AWS Glue, Spark (PySpark), and Step Functions.
  • Work with structured and semi-structured data using Athena, S3, and Lake Formation to enable efficient querying and access control.
  • Develop and deploy serverless data processing solutions using AWS Lambda and integrate them into pipeline orchestration.
  • Perform advanced SQL and PL/SQL development for data transformation, analysis, and performance tuning. Build data lakes and data warehouses using S3, Aurora, and Athena.
  • Implement data governance, security, and access control strategies using AWS tools including Lake Formation, CloudFront, EBS/EFS, and IAM. Develop and maintain metadata, lineage, and data cataloging capabilities.
  • Participate in data modeling exercises for both OLTP and OLAP environments.
  • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights. Monitor, debug, and optimize data pipelines for reliability and performance.

  • Required Skills & Experience:
  • Strong experience with AWS data services: Glue, Athena, Step Functions, Lambda, Lake Formation, S3, EC2, Aurora, EBS/EFS, CloudFront.
  • Proficient in PySpark, Python, SQL (basic and advanced), and PL/SQL.
  • Solid understanding of ETL/ELT processes and data warehousing concepts.
  • Familiarity with modern data platform fundamentals and distributed data processing.
  • Experience in data modeling (conceptual, logical, physical) for analytical and operational use cases.
  • Experience with orchestration and workflow management tools within AWS.
  • Strong debugging and performance tuning skills across the data stack.

  • Know more about:
    DAI: https://www.brillio.com/services-data-analytics/
    Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/
     
    Equal Employment Opportunity Declaration
    Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.
     
    #LI-SR1

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account