Senior Data Engineer

Senior Data Engineer

Remote

Blu Omega is seeking a Senior Data Engineer to support a federal program focused on public health analytics. This role operates within a remote environment and is responsible for designing, building, and operating enterprise-scale data platforms and pipelines supporting mission-critical health data initiatives. The position requires experience supporting data engineering and cloud data platforms within a mission-driven environment.

Program Overview

Blu Omega supports mission-focused organizations across government sectors, delivering innovative technology and cybersecurity solutions to enable impactful public health and defense initiatives.

Key Details

Location: Remote

Clearance: Ability to obtain and maintain a Public Trust suitability determination

Responsibilities

• Design, build, and maintain enterprise-scale data pipelines and platform components using Databricks, Palantir Foundry, and cloud-native technologies.
• Architect robust data solutions through schema design, medallion architecture, partitioning, and distributed processing.
• Develop and optimize data transformations with PySpark, Python, and SQL to enhance pipeline reliability and performance.
• Build and operate Databricks solutions utilizing Delta Lake, Unity Catalog, and job orchestration capabilities.
• Develop data pipelines, transformations, datasets, and data models within Palantir Foundry.
• Implement cloud-native data orchestration using Azure Data Factory, Azure Functions, and Azure Storage, or equivalent AWS and GCP services.
• Apply CI/CD practices for data services, including automated testing, validation, version control, and deployment.
• Lead onboarding and migration efforts for data platforms, facilitating team adoption of modern data solutions.
• Modernize existing Python and SQL codebases, promoting reusable engineering patterns and libraries.
• Optimize data pipelines, strategies, and queries for perfor