Requirements
- Proficiency in Databricks at an advanced level
- Strong experience with Apache Spark
- Advanced data programming skills
- Solid background in software development for data engineering
- Working knowledge of Azure cloud services
- Experience in technical leadership roles
- Understanding of data processing architecture
- Familiarity with generative AI applications in data engineering
- Experience with CI/CD automation pipelines
- 4 to 6 years of professional experience in data engineering or similar field
- Excellent communication skills, with ability to clearly articulate technical concepts to technical and non-technical audiences
- Hands-on experience with agile methodologies and supporting tools such as JIRA and Azure DevOps
- Proven ability to work independently and take ownership of deliverables
- Ability to thrive in an agile work environment
- Practical experience designing and optimizing data storage solutions including data lakes, data warehouses, and distributed file systems
Nice to Have
- Familiarity with alternative cloud platforms, data warehousing systems, data governance practices, or business analysis is beneficial
