Responsibilities
- Provide technical leadership and architectural guidance to data engineers and SQL developers, leading design discussions and architecture reviews.
- Establish engineering standards and best practices for data pipelines, lakehouse platforms, and SQL development, including code and design reviews.
- Mentor team members and support their technical growth.
- Design and evolve a modern Azure data platform using Azure Synapse Analytics, Synapse Spark, Azure Data Factory, Azure Data Lake Storage Gen2, Azure SQL Database, and Microsoft Fabric.
- Define scalable architecture patterns for lakehouse platforms, Delta Lake tables, data ingestion pipelines, and data quality frameworks.
- Optimize and troubleshoot Spark workloads, Synapse queries, and Azure SQL performance.
- Improve platform reliability, observability, monitoring, and Azure workload cost efficiency.
- Support operational processes including investigating alerts, resolving data pipeline failures, and improving operational runbooks.
Requirements
- 6+ years of experience in data development.
- 2+ years experience leading or mentoring technical teams.
- 2+ years of hands-on Azure Cloud experience, including proficiency in Synapse Analytics, Azure SQL Database, Data Lake Storage Gen2, and Delta Lake.
- Hands-on experience with PySpark, Delta Lake/lakehouse architectures, and large-scale data ingestion pipelines.
- Strong T-SQL knowledge and relational database design.
- Experience designing and implementing ETL/ELT pipelines.
- Strong troubleshooting skills in data pipeline and database performance issues.
- Experience working with hybrid environments (Azure, on-prem SQL Server).
- Strong communication and leadership skills.
Nice to Have
- Experience with Microsoft Fabric.
- Experience implementing CI/CD pipelines (Azure DevOps / Git).
- Experience with cost optimization of cloud data platforms.
- Familiarity with Azure networking and integration runtimes.
- Experience designing data quality and observability frameworks.
Work Arrangement
Hybrid
Team
Structure: Data Warehouse Services team
Additional Information
- In this role you may be exposed to adult content.
