Data Engineer

Spectraforce Technologies
United States, California, Floriston
Apr 11, 2026
Data Engineer 8 Months San Francisco, California(100% REMOTE) Role Summary: This role supports OEIS compliance reporting by building auditable, Foundry?native data pipelines and data checker frameworks. The engineer will be responsible for compliance transformations, validation logic, and traceable outputs that meet regulatory and audit requirements. Core Responsibilities Design and maintain Palantir Foundry pipelines for OEIS compliance reporting Build and maintain data checker / validation frameworks within Foundry Develop PySpark and Spark SQL transformations for large?scale datasets Implement compliance?driven checks (completeness, consistency, reconciliation, exception flags) Ensure full data lineage, auditability, and reproducibility of compliance datasets Partner with compliance SMEs and stakeholders to validate logic and reporting outputs Support operational monitoring, issue triage, and data quality remediation Required Technical Skills Strong Python PySpark / Spark SQL Advanced SQL Hands?on experience with Palantir Foundry Experience building data validation, QA, or data quality frameworks Understanding of compliance, audit, or regulatory reporting requirements Preferred / Nice?to?Have Experience with OEIS or regulatory compliance reporting Foundry Workshop experience Experience working with ontology?driven or curated datasets Utility, infrastructure, or asset?based domain experience