Position: Azure Data Engineer
Location: Durham, NC (Hybrid – 3 days onsite)
Employment Type: Full-Time

Overview:
We are looking for an experienced Azure Data Engineer to join our data engineering team based in Minneapolis, MN. This hybrid position involves working closely with cross-functional teams to develop scalable data pipelines and implement reliable Azure-based data solutions. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, and Azure Data Lake, and a strong background in building and optimizing both real-time and batch data pipelines.

Key Responsibilities:

– Develop large-scale batch and real-time data pipelines using Azure technologies.
– Design and implement high-performance data ingestion processes from various structured and unstructured sources using Azure Databricks.
– Lead the creation of ETL processes, data integration, and migration strategies.
– Build scalable, reusable frameworks for data ingestion, processing, and transformation.
– Collaborate with data architects, analysts, engineers, and business stakeholders to implement enterprise-level data platforms.
– Ensure end-to-end data pipelines—from source to destination—are reliable, consistent, and high quality.
– Utilize event-driven and streaming technologies for real-time data processing.
– Support related components such as API integrations and search functionality.
– Assess tools and platforms to ensure they meet performance and business needs.

Required Qualifications:

– Proficiency with Azure Data Factory, Azure Databricks, and Azure Data Lake Storage (ADLS)
– Experience with Azure SQL Database and Azure Data Warehouse
– Strong practical knowledge in:
– Building and optimizing Azure cloud data solutions
– Performance tuning in Databricks
– SQL, T-SQL, and/or PL/SQL
– Familiarity with:
– Azure Storage Accounts
– Azure Data Catalog and Azure Data Analytics
– Logic Apps and Function Apps
– Understanding of Agile methodologies and tools such as JIRA
– Preferred experience in managing end-to-end data ingestion projects within the Azure ecosystem

Connect with us on LinkedIn.