As a Staff Engineer, Big Data, you will lead the evolution of enterprise-grade data platforms on Microsoft Azure. Your primary responsibility is to design, implement, and maintain high-performance data architectures that support large-scale processing and analytics.
Key Responsibilities
- Provide technical leadership to data engineering teams, guiding best practices in development, mentoring team members, and advancing engineering excellence.
- Design and deploy scalable data solutions using core Azure services including Azure SQL Database, Azure Data Factory, Databricks, Synapse Analytics, and Cosmos DB.
- Develop and manage robust data pipelines and ETL/ELT workflows, ensuring data integrity, efficiency, and alignment with architectural standards.
- Oversee ongoing operations of the Azure data platform, including system monitoring, issue resolution, and performance tuning.
- Apply automation and DevOps methodologies—such as infrastructure as code and CI/CD—to improve deployment speed, system reliability, and operational efficiency.
- Ensure compliance with data security policies and governance frameworks across cloud environments.
- Lead capacity planning and scalability initiatives to support growing data demands.
- Work closely with cross-functional teams to align data platform capabilities with business objectives.
Qualifications
- Demonstrated expertise in cloud data engineering and architecture, particularly within the Microsoft Azure ecosystem.
- Strong command of Azure data services including Data Factory, Databricks, Synapse, Cosmos DB, and Azure SQL Database.
- Proven ability to build and optimize complex data integration processes and pipelines.
- Familiarity with data governance, security protocols, and regulatory compliance in cloud platforms.
- Hands-on experience with automation tools, infrastructure as code, and DevOps practices.
- Track record in leading technical teams, providing mentorship, and driving engineering standards.
Preferred Credentials
Certifications such as Microsoft Certified: Azure Solutions Architect Expert or similar credentials are strongly encouraged.
Technology Environment
Core tools include Apache Spark, Azure Data Factory, Databricks, Azure SQL Database, Azure Synapse Analytics, and Azure Cosmos DB.
