Develop datasets for data visualization and machine learning. Build data ingestion pipelines using Data Bricks and Apache Spark while partnering with various stakeholders.
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
- Education Assistance/Student Loan Repayment - up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k - 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance
Top Skills
Ci/Cd
Databricks
Pyspark
Python
Snowflake
T-Sql
Similar Jobs
Artificial Intelligence • Cloud • Database • Analytics
The Senior Enterprise Data Architect designs data architectures, manages data assets, ensures data integration, and aligns data investments with business strategy.
Top Skills:
GainsightInformaticaMulesoftSalesforceSnowflake
Information Technology
The Senior Data Architect will design scalable database architectures, perform data analysis using SQL, and collaborate with teams to meet business objectives in a healthcare setting.
Top Skills:
Apache AirflowAzure DevopsBigQueryCloud ComposerGoogle Cloud PlatformSQL
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Director in Data Architecture at PwC, you will lead data architecture strategies, promote innovation, and ensure compliance with data governance while mentoring teams and collaborating with stakeholders.
Top Skills:
AWSAzureData LakesData WarehousesFastapiGCPIamPythonSnowflakeSQL
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute