Lead the design and development of Azure-based big data solutions, including batch and real-time ETL/ELT pipelines, data architecture, ingestion, curation, warehousing, and storage. Build solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, SQL, and related Azure services. Support Salesforce migration and integration while applying strong RDBMS, data management, and big data design expertise.
Expertise on Azure platforms including Azure Databricks, ADLS, and its various components, • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure SQL Database, Azure Functions, Logic apps, Spark and Python programming etc. • Expertise on Azure platforms including Azure Databricks and its various components, including Delta Lake. • Strong understanding of data architecture and data management principles. • In-dept knowledge and hands-on experience in Microsoft Azure data stack i.e., Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic apps, Spark Knowledge etc. • In-depth Knowledge on designing of ETL Piplines for Batch and Real time in Azure data factory and Azure datafactory • Hands on experience on Function apps , Event Hubs,, Web apps , API M. • Good have to experience on Migration to Salesforce • Strong experience with designing ETL/ELT Pipelines/Data flows using Azure Data Factory as Primary skill and SSIS/Informatica as additional skills. • Proficiency in programming languages such as Python, SQL, Spark notebooks and Scala. • Must have strong development & design skills in leading RDBMS environments e.g. MS SQL Server and Oracle 10g. • Experience of Big data approach, architectural concepts, data sourcing/ ingestion/ curation and storage mechanisms. • Experience with real-time / near-real-time Data warehousing concepts and Design approaches.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, develop, test, and maintain large-scale healthcare data pipelines and AWS data warehouse solutions. Build Redshift and EMR ETL processes, monitor pipeline performance, resolve data discrepancies, support deployments, conduct code reviews, and document database designs and testing. Collaborate with engineers, analysts, consultants, and cross-functional teams to improve data quality, scalability, and processing efficiency.
Top Skills:
Amazon EmrAmazon RedshiftAmazon S3Automated Testing FrameworksAWSCi/CdETLOraclePythonSQLSQL Server
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills:
AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills:
Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
