AEM Corporation
Data Engineer
Apply for this role
Share this job
Job Description
Position Summary
Join our team as a Data Engineer and become a key contributor to building trusted, high-quality data products for Federal clients. You will design, implement, and operate scalable data pipelines and lakehouse solutions using Microsoft Azure services including, Azure Synapse, ADLS Gen2, and Azure Functions, and Logic apps. You will collaborate closely with product owners, analysts, and stakeholders in a Scrum environment. The ideal candidate is hands-on, curious, collaborative, comfortable asking for help, offering help, and proposing ideas that improve team velocity and value.
What You’ll Do
- Design and implement secure, scalable data pipelines in Azure (Synapse Notebooks, Python, Pandas, pySpark, Synapse Pipelines, Azure Functions, Logic Apps, etc.) to ingest, profile, transform, improve data quality, and publish trusted data.
- Engineer robust lake storage on ADLS Gen2 using Parquet, Iceberg, partitioning techniques, and performance optimization techniques.
- Establish data quality controls: profiling, validation rules, reproducible transformations, and automated tests with monitoring/alerting.
- Operationalize pipelines with CI/CD, environment promotion, secrets management, and run-time observability (e.g., Azure DevOps).
- Model and serve data for analytics/BI (e.g., Power BI), including row-level security and refresh orchestration.
- Document design decisions, lineage, and data contracts; contribute to catalog/metadata management (e.g., Microsoft Purview).
- Collaborate within a Scrum team—participate in sprint planning, reviews, and retros—and partner with product owners/stakeholders to refine user stories.
- Continuously improve team ways of working: propose automation, standardization, and quality practices that increase throughput and reliability.
What You’ll Bring (Required Qualifications)
- U.S. citizen with the ability to obtain a Public Trust background investigation.
- 5+ years of professional data engin
Keep looking