Senior Azure Databricks Data Engineer with one of our direct clients.
Location: Pittsburgh, PA (Onsite – 5 Days/Week)
Key Requirements:
- 8+ years of overall Data Engineering experience
- 5+ years of hands-on experience with Azure Databricks
- Mandatory experience with Unity Catalog
- Strong expertise in PySpark, SQL, and Delta Lake
- Experience with Azure Data Factory (ADF) and ADLS Gen2
- Strong background in building enterprise-scale Azure data engineering solutions
- Experience with ETL/ELT development and Apache Spark optimization
- Knowledge of data governance, metadata management, and access control
- Experience with Git, CI/CD, and Agile/Scrum environments
- Mandatory experience in the Investment/Capital Markets domain
Preferred:
- Databricks Certified Data Engineer (Associate/Professional)
- Microsoft Azure Data Engineer Associate (DP-203)
- Experience with Terraform/Bicep, Azure DevOps, or Microsoft Purview