Build and maintain scalable batch and real-time data pipelines using Kafka, Google Dataflow, Snowflake and S3. Integrate APIs via Apigee, ensure data quality, publish data for reporting, and collaborate with stakeholders to document workflows and support analytics.
Job Description: Data Engineer – Aftersales Service & Repair (Truck Industry)
Location: Renton, WA
Department: Aftersales Information Technology
Employment Type: Contract
Reports To: Aftersales Strategy Manager
Experience Level: Mid to SeniorRole Overview
The Data Engineer will play a critical role in building scalable, reliable data pipelines to support real-time and batch processing workflows. You will work closely with cross-functional teams to integrate multiple data sources, build Operational Data Stores, ,transformations and enable timely data availability for reporting and analytics through dashboards.Key Responsibilities
Data Ingestion & Integration
Location: Renton, WA
Department: Aftersales Information Technology
Employment Type: Contract
Reports To: Aftersales Strategy Manager
Experience Level: Mid to SeniorRole Overview
The Data Engineer will play a critical role in building scalable, reliable data pipelines to support real-time and batch processing workflows. You will work closely with cross-functional teams to integrate multiple data sources, build Operational Data Stores, ,transformations and enable timely data availability for reporting and analytics through dashboards.Key Responsibilities
Data Ingestion & Integration
- Develop and maintain data ingestion pipelines for service and repair data using Confluent Kafka for event streaming.
- Implement connectors and integrations between Kafka, AWS S3, Google Dataflow, and Snowflake to facilitate batch and real-time data flows.
- Work with APIs and Apigee to securely ingest and distribute data across internal and external systems, including dealer networks.
- Build and optimize data cleansing, normalization, and transformation pipelines in Google Dataflow for real-time processing.
- Design and implement batch transformation jobs within Snowflake, building and maintaining the Operational Data Store (ODS).
- Ensure data quality, consistency, and integrity across all processing stages.
- Publish transformed and aggregated data to internal and external dashboards using APIs, Kafka topics, and Tableau.
- Collaborate with data analysts and business stakeholders to support reporting and analytics requirements.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Partner with data architects, analysts, and external dealer teams to understand data requirements and source systems.
- Document data workflows, processing logic, and integration specifications.
- Adhere to best practices in data security, governance, and compliance.
- Event Streaming: Confluent Kafka (proficiency), Kafka Connectors
- API Management: Apigee(proficiency)
- Cloud Storage & Data Warehousing: AWS S3, Snowflake
- Data Processing: Google Dataflow
- Programming: SQL, Python (proficiency)
- Batch & Real-Time Pipeline Development
- Data Visualization Support: Tableau (basic understanding for data publishing)
- Experience building Operational Data Stores (ODS) and data transformation pipelines in Snowflake
- Familiarity with truck industry aftersales or automotive service and repair data is a plus
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or related field.
- 3+ years of proven experience in data engineering, especially with streaming and batch data pipelines.
- Hands-on experience with Kafka ecosystem (Confluent Kafka, Connectors) and cloud data platforms (Snowflake, AWS).
- Skilled in Python programming for data processing and automation.
- Experience with Google Cloud Platform services, especially Google Dataflow, is highly desirable.
- Strong understanding of data modeling, ETL/ELT processes, and data quality principles.
- Ability to work collaboratively in cross-functional teams and communicate technical concepts effectively.
Top Skills
Apigee
Aws S3
Confluent Kafka
Google Cloud Platform
Google Dataflow
Kafka Connectors
Python
Snowflake
SQL
Tableau
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
The Staff Business Systems Analyst will lead the design and delivery of scalable Sales Cloud solutions, collaborating with cross-functional teams to align business goals with technical execution.
Top Skills:
Artificial IntelligenceSales CloudSalesforce
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Senior Business Systems Analyst at CrowdStrike, you will manage and enhance ServiceNow's security and risk capabilities, working with stakeholders to align solutions with business objectives and maintain a clear enhancement roadmap.
Top Skills:
AgileCmdbCsdmGenaiItilItsmKanbanScrumServicenow
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves building testing frameworks and tooling for cloud services, ensuring software reliability, and improving product quality through collaboration and automation in a fast-paced environment.
Top Skills:
Aws Ec2Aws S3C#C++CassandraDockerElasticsearchGoGrpcJavaJenkinsJSONKafkaKubernetesMemcacheMySQLNode.jsPostgresPythonRedisRestRpcScalaSqlserverXML
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
