Leads the hands-on design, development, and optimization of enterprise data platforms and AI-ready solutions. Builds scalable batch, streaming, CDC, and event-driven pipelines using AWS, Databricks, Spark, Snowflake, Python, and SQL. Develops RAG, vector retrieval, and agentic AI capabilities while ensuring security, governance, reliability, observability, automation, and performance. Leads integrations, CI/CD, infrastructure as code, data quality, mentoring, stakeholder management, and end-to-end ownership of data products.
Job Description Summary
This role leads the design and delivery of enterprise data platforms and AI-ready solutions using AWS, Databricks, Snowflake, Spark, and Python. It is a highly hands-on technical position focused on building scalable data pipelines, integrations, data products, RAG and agentic AI capabilities, while ensuring strong governance, security, reliability, automation, and performance
Job Description
Major Accountabilities
- Design, build, and optimize scalable batch, streaming, CDC, and event-driven data pipelines using modern data engineering best practices and production-grade Python and SQL.
- Architect secure, resilient, high-performance data platforms and translate business and technical requirements into scalable cloud-based solutions.
- Lead hands-on development and optimization of Databricks, Apache Spark, Delta Lake, and Lakehouse solutions, ensuring reliability, performance, and cost efficiency.
- Design and implement Snowflake data engineering solutions, including ingestion, transformation, governance, orchestration, and secure data consumption patterns.
- Engineer enterprise data platforms on AWS, leveraging cloud-native services to deliver secure, automated, observable, and highly available data solutions.
- Develop reusable integration frameworks, APIs, CDC processes, and connectivity patterns across enterprise applications, SaaS platforms, governance tools, ERP, and CRM systems.
- Build AI-ready data foundations, including RAG pipelines, vector retrieval, context engineering, and agentic workflows, enabling enterprise AI and GenAI use cases.
- Drive engineering excellence through CI/CD, Infrastructure as Code, security-by-design, observability, governance, mentoring, and end-to-end ownership of data products and platform capabilities.
Minimum Requirements
- Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related discipline, or equivalent practical experience.
- 12+ years of experience in software engineering and/or data engineering with proven delivery of large-scale production data platforms.
- Advanced hands-on expertise in Python, SQL, data modeling, ETL/ELT, CDC, batch, streaming, and event-driven architectures.
- Strong experience with Apache Spark (PySpark), distributed data processing, performance tuning, and troubleshooting.
- Proven hands-on experience with Databricks, Delta Lake, and Snowflake in enterprise-scale environments.
- Deep knowledge of AWS cloud services, cloud-native data architectures, security, observability, Infrastructure as Code, and automation.
- Experience implementing CI/CD pipelines, automated testing, monitoring, governance, data quality, security controls, and operational support practices.
- Practical exposure to Generative AI technologies, including RAG architectures, embeddings, vector search, LLM integration, context engineering, and agentic workflows.
- Strong understanding of enterprise integration patterns, APIs, SaaS integrations, metadata management, lineage, data governance, and access control frameworks.
- Excellent stakeholder management, communication, mentoring, problem-solving, and delivery leadership skills with a highly hands-on engineering mindset.
Why Novartis?
Our purpose is to reimagine medicine to improve and extend people’s lives and our vision is to become the most valued and trusted medicines company in the world. How can we achieve this? With our people. It is our associates that drive us each day to reach our ambitions. Be a part of this mission and join us!
Learn more here:
https://www.novartis.com/about/strategy/people-and-culture
Commitment to Diversity and Inclusion:
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.
Join our Novartis Network: If this role is not suitable to your experience or career goals but you wish to stay connected to hear more about Novartis and our career opportunities, join the Novartis Network here:
https://talentnetwork.novartis.com/network
Skills Desired
Databricks Platform, Snowflake (Platform)Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Own the vision, roadmap, architecture, and lifecycle of an AI-powered insights platform using autonomous agents to analyze CPG business data and generate recommendations. Translate commercial needs into agent capabilities, manage backlogs and delivery, define evaluation metrics, drive adoption, and ensure responsible AI, security, privacy, vendor, and budget management.
Top Skills:
Agent-To-Agent WorkflowsAgentic AiAi/MlAutogenAWSAzureCrewaiData PipelinesDatabricksGCPGenieLanggraphLlmsModel OrchestrationMulti-Agent OrchestrationUnity Catalog
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead the o9 data enablement program across AMEA and MEU, including roadmap delivery, data migration, governance, quality, integrations, reporting, vendor management, and cutover execution. Coordinate business, technical, and external stakeholders; resolve dependencies and blockers; manage testing, reconciliation, go-live command centers, hypercare, and downstream data validation. Translate technical issues into executive recommendations while building reliable analytics practices and teams.
Top Skills:
APIsAtaccamaAWSDatabricksETLGCPGenie BiJupyterMySQLO9OraclePower BIPythonQuickRRstudioSnowflakeSQLTableau
Artificial Intelligence • HR Tech • Software • Business Intelligence
Own the full enterprise sales cycle, including self-generated pipeline development, multi-channel prospecting, discovery, qualification, product demonstrations, forecasting, and deal closure. Build trusted relationships with compensation and total rewards leaders, quantify business pain, and collaborate with Marketing, Partnerships, and Insights. The role requires selling technology to large mid-market and enterprise accounts in a lean startup environment.
Top Skills:
AIClayHubspotNotionSybill
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
