Job Summary
The Cloud Data Engineer will design, implement, and maintain full lifecycle data pipeline solutions within Microsoft Azure, supporting enterprise-scale data analytics and reporting platforms. This role involves translating business requirements into data engineering solutions across Azure Data Lake, SQL, and NoSQL environments. The engineer will also maintain legacy SQL Server ETL operations while transitioning these systems to modern, cloud-native architectures. The ideal candidate demonstrates strong analytical skills, a customer-focused mindset, and a commitment to innovation and mission delivery. Job Responsibilities
Develop, maintain, and operate legacy ETL processes using Microsoft SSIS, SQL Server, SQL Agent, PowerShell, .NET, and SSAS
Design and implement full lifecycle Azure data pipelines and related cloud-native solutions
Collaborate with stakeholders to analyze data requirements and develop scalable, high-performance data solutions
Design and implement data models and pipelines for relational, dimensional, data lakehouse, data warehouse, and data mart environments
Utilize Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, and SQL to build and optimize pipelines
Redevelop existing SSIS ETL processes using Azure Data Factory and Synapse Pipelines
Prepare and manage data for analytics, reporting, visualization, and AI/ML applications
Ensure data quality, integrity, and security through effective governance, metadata management, and monitoring practices
Implement automated deployment, monitoring, and configuration control processes to support DevOps principles
Troubleshoot data pipeline issues and ensure high system availability and performance
Participate in Agile development activities and continuous learning initiatives
Job Requirements
Bachelor's degree in Computer Science or a related field and at least 8 years of relevant experience, or a Master's degree with a minimum of 6 years of experience
Minimum 4 years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages such as PowerShell
Minimum 4 years of experience with one or more of the following: SQL, T-SQL, Python, or PySpark
Proven experience working with Microsoft database and business intelligence tools including SQL Server, SSRS, SSAS (cubes), and PowerShell scripting
Experience designing and building ETL or data engineering solutions using Azure Data Lake Services, Azure Synapse Analytics, or similar cloud services
Strong understanding of data governance, data migration, data integrity, and data security practices
Excellent problem-solving, analytical, and communication skills
Ability to work effectively both independently and within a collaborative team environment
Additional Job Details
Remote position with occasional travel to the Washington, D.C. metro area as needed
Public Trust clearance required (candidates may begin with clearance pending)
Active engagement in Agile DevOps processes and continuous professional development expected
|