Miratech is looking for a Middle Data Engineer specialized in Azure Databricks to join the data platform team. The candidate will design and develop modern data pipelines and Lakehouse architectures using Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments and evolving the data platform toward scalable, cloud-based architectures to enable advanced analytics and business intelligence.
What You'll Do
- Design, develop, and maintain data pipelines using Azure Databricks
- Build and optimize data transformations using PySpark and SQL in Databricks
- Implement and maintain Lakehouse architectures using Delta Lake
- Develop ETL/ELT pipelines orchestrated through Azure Data Factory
- Integrate data from multiple sources into the data platform and analytical layers
- Design and maintain data models and data warehouse structures for analytics
- Ensure data quality, scalability, and performance of large-scale data processing pipelines
- Collaborate with BI teams to support Power BI and reporting platforms
- Support and evolve existing SQL Server data platforms and ETL solutions (SSIS) when required
- Contribute to the design of modern cloud-based data architectures
What We're Looking For
- Specialization in Azure Databricks
- Experience designing and developing data pipelines using Azure Databricks
- Proficiency in building and optimizing data transformations using PySpark and SQL in Databricks
- Experience implementing and maintaining Lakehouse architectures using Delta Lake
- Experience developing ETL/ELT pipelines orchestrated through Azure Data Factory
- Ability to integrate data from multiple sources into the data platform and analytical layers
- Experience designing and maintaining data models and data warehouse structures for analytics
- Proven ability to ensure data quality, scalability, and performance of large-scale data processing pipelines
- Collaboration experience with BI teams to support Power BI and reporting platforms
- Experience supporting and evolving existing SQL Server data platforms and ETL solutions (SSIS)
- Contribution to the design of modern cloud-based data architectures
Technical Stack
- Azure Databricks
- Spark
- PySpark
- SQL
- Delta Lake
- Azure Data Factory
- SQL Server
- ETL
- ELT
- SSIS
- Power BI
Team & Environment
- data platform team
