IMC Trading Logo

IMC Trading

Data Engineer

Reposted 10 Hours Ago
Hybrid
Chicago, IL
Senior level
Hybrid
Chicago, IL
Senior level
Design, build, and operate big-data and streaming platforms (Kafka, Hadoop, Dremio). Develop, deploy, and monitor data pipelines using Java, Python, Spark/Flink; collaborate on data modeling and ingestion, ensure data integrity and availability, act as a Big Data SME, and perform root-cause analysis.
The summary above was generated by AI
We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.
Core Responsibilities
  • Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
  • Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
  • Collaborate with development teams on data modeling, data ingestion, and capacity planning
  • Work with users to ensure data integrity and availability
  • Act as a Big Data SME and consult on a variety of data-related questions from users and developers

Skills and Experience:
  • 5+ years experience working in a mature data engineering environment
  • 3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters
  • 2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)
  • Experience with Apache Spark, Apache Flink or similar tools
  • Strong Java, Python, and SQL development skills
  • Experience with common data-science toolkits, especially python-based
  • Hands-on experience with Kubernetes and Docker
  • Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie
  • Strong statistical analysis skills
  • Demonstrated ability to troubleshoot and conduct root-cause analysis
  • Unix scripting experience (bash, python, etc.)

#LI-DNP

Similar Jobs at IMC Trading

Yesterday
Hybrid
Senior level
Senior level
Fintech • Machine Learning • Software • Financial Services
Build, operate, and scale large-scale data storage platforms (Hadoop, S3-compatible, enterprise storage). Tune Linux for I/O performance, automate deployments with Ansible/Puppet, implement observability with Prometheus, and partner with engineers on storage- and Kafka-focused data solutions. Familiarity with Kubernetes and development in Java/Python required.
Top Skills: AnsibleClaudeHadoopJavaKafkaKubernetesLinuxPrometheusPuppetPythonS3S3-Compatible Enterprise StorageYarn
Mid level
Fintech • Machine Learning • Software • Financial Services
Operate and maintain the Performance Team's data platform: ensure reliability, correctness, and performance of ETLs and pipelines; implement quality checks, alerting, runbooks, and automation; troubleshoot GitLab CI/CD and resource bottlenecks; continuously tune workloads for efficiency.
Top Skills: Data PipelinesETLGitGitlab Ci/CdPandasPysparkPython
7 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
Fintech • Machine Learning • Software • Financial Services
The Data Center Engineer will manage physical servers and network hardware, ensuring their installation, maintenance, and troubleshooting, along with overseeing documentation and vendor coordination.
Top Skills: BashFiber OpticsLinuxNetwork CablingNetwork DevicesPythonServer HardwareStorage Systems

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account