Responsibilities
- Create and manage data workflows using Azure Databricks for reliable data processing
- Develop and tune data transformations using PySpark and SQL within the Databricks environment
- Implement and support Lakehouse designs leveraging Delta Lake technology
- Build ETL and ELT processes coordinated through Azure Data Factory
- Consolidate data from diverse sources into centralized data platforms and analytical layers
- Design and manage data models and warehouse schemas to support business analytics
- Maintain high data quality, system scalability, and efficient performance across large data pipelines
- Work closely with BI teams to enable reporting tools such as Power BI
- Maintain and enhance legacy SQL Server platforms and SSIS-based ETL processes as needed
- Support the development of modern, cloud-native data architecture strategies