Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.
Responsibilities
Qualifications
The Databricks Data Engineer will be responsible for the hands-on build-out of a Government-owned Databricks workspace and the data ingestion/integration work needed to consolidate agency business system data. This includes designing and implementing data pipelines from core enterprise systems, implementing Unity Catalog for data governance, configuring MLflow for machine learning workflows, and developing comprehensive documentation to support sustainment beyond the pilot.
This role is 100% Remote.
Other Responsibilities Include:
- Build out and configure a dedicated Government workspace within the existing Databricks environment
- Design and implement data ingestion pipelines from core agency business systems including financial, HR, CRM, and ITSM systems
- Leverage native/built-in connectors where source systems support them; design custom integration approaches for legacy systems
- Normalize and prepare ingested data within Databricks for consumption by downstream visualization/reporting tools
- Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking
- Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements
- Develop comprehensive "as-built" documentation including physical/logical architecture diagrams, automated data dictionaries, and SOPs
- Document data sources, integration methods, and data lake architecture decisions to support sustainment
Qualifications
Required Qualifications:
- 5 years work experience with BS/BA; 3 years with MS/MA
- US Citizenship
- Active DoD Secret clearance
- 2 years working on the Databricks platform
- Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
- Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
- Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
- Experience with Delta Lake, schema evolution, time travel, and optimization techniques
- Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
- Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
- Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
- Familiarity with financial, HR, CRM, or ITSM data structures
- Git/CI-CD pipeline experience
- DoD 8570 certification
Preferred Qualifications:
- Databricks Certified Data Engineer Associate or Professional certification
Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.
Target Salary Range$112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay. EEOEEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.Similar Jobs
Aerospace • Logistics • Security • Software • Cybersecurity
Designs and implements Databricks Unity Catalog access controls, security architecture, identity governance, data classification, and compliance automation. Leads RBAC and ABAC models, dynamic views, row- and column-level security, masking, service principal integration, and infrastructure-as-code deployments using Terraform or Databricks Asset Bundles. Establishes security guardrails, templates, tagging standards, and scalable workflows while partnering with data, platform, and workspace engineering teams.
Top Skills:
AbacColumn MaskingDatabricksDatabricks Asset BundlesDatabricks LakehouseDatabricks Unity CatalogDynamic ViewsEntra IdInfrastructure As CodePythonRbacRow-Level SecurityScimService PrincipalsSQLTerraform
Information Technology • Consulting • Defense
Designs, develops, and optimizes Databricks and Spark data pipelines integrating Oracle EBS and ERP Cloud data. Builds ETL/ELT jobs, data models, validation processes, and reporting solutions across financial, purchasing, project, inventory, and HR modules. Ensures data quality, lineage, reconciliation, security, governance, and compliance while partnering with Oracle SMEs and documenting solutions for federal review and audits.
Top Skills:
AdvanaAgileSparkDatabricksEltEssbaseETLOracle E-Business SuiteOracle Erp CloudOracle OafOracle Saas Reporting ApisPythonSafeSQL
Other
Owns end-to-end delivery of production data platforms for utility clients, including discovery, architecture, ingestion, transformation, orchestration, governance, quality, deployment, and handover. Uses Databricks, Spark, Python, SQL, and AWS to modernize legacy systems, integrate utility data sources, build observable pipelines, and deliver operator-facing applications. Leads client engagements, manages scope and timelines, supports migrations, and contributes reusable engineering frameworks and reference architectures.
Top Skills:
Amazon Web Services (Aws)SparkAPIsChange Data CaptureCi/CdDashDatabricksDatabricks AppsDockerGitGraphQLKafkaPythonReactRestSQLStreamlit
What you need to know about the Seattle Tech Scene
Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.
Key Facts About Seattle Tech
- Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Amazon, Microsoft, Meta, Google
- Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
- Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Madrona, Fuse, Tola, Maveron
- Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
