Responsibilities
- Design and deploy scalable data integration and analytics platforms using Azure technologies such as Databricks, Synapse, and ADF.
- Develop reusable frameworks for data ingestion, transformation, and analytical processing to streamline delivery.
- Ensure high-quality code output and system performance using Python, PySpark, and SQL, with additional value from C# expertise.
- Implement Azure security standards including Managed Identities, Azure AD, Key Vault, virtual networks, and role-based access controls.
- Maintain thorough and up-to-date documentation across all solution layers and operational workflows.
- Lead and mentor data engineering teams, promoting ownership and technical excellence.
- Conduct routine code reviews, pair programming, and internal knowledge transfer sessions with delivery staff.
- Plan and oversee workstreams, assigning tasks efficiently to reduce bottlenecks and technical debt.
- Lead technical client engagements, clearly documenting assumptions, expectations, and architectural decisions.
- Work closely with business teams to interpret requirements and convert them into effective technical implementations.
- Report project status, risks, key decisions, and mitigation plans clearly to both technical and non-technical stakeholders.
- Create solution roadmaps that align with enterprise goals, business needs, and architectural governance.
- Identify delivery risks early and drive alignment across teams for consistent, high-quality outcomes.
- Promote modern engineering standards such as DevOps, CI/CD, infrastructure as code, automated testing, and repeatable deployments.
Requirements
- Over 10 years of professional experience in data engineering, analytics, or solution architecture.
- Extensive hands-on work with Azure Databricks, including Spark, Delta Lake, and ML runtime environments.
- Proficiency in Azure Synapse Analytics, covering serverless SQL, pipelines, and dedicated SQL pools.
- Solid experience with Azure Data Factory or Synapse Pipelines for orchestration.
- Working knowledge of Data Lake Storage Gen2, Databricks Unity Catalog, and Spark SQL.
- Strong coding skills in Python, PySpark, and Spark performance tuning.
- Experience with Azure DevOps, CI/CD pipelines, and Infrastructure as Code (IaC) practices.
- Understanding of cloud security mechanisms: Managed Identities, Azure AD, Key Vault, RBAC, and networking fundamentals.
- Background in implementing solutions involving Computer Vision and AI/ML workloads.
- Demonstrated leadership in managing technical teams and delivering projects within Agile methodologies.
- Excellent communication and interpersonal abilities, with the ability to lead and influence cross-functional groups.
- Proven track record in stakeholder engagement, risk analysis, and project planning.
Nice to Have
- Hold relevant certifications such as Azure Solutions Architect Expert, Azure Data Engineer Associate, or Databricks credentials.
- Prior experience in oil and gas, industrial, or asset-intensive industries.
Benefits
- Paid time off varies by employee grade (A-F), including vacation (12–25 days), company-recognized holidays, personal days, and sick leave.
- Comprehensive medical, dental, and vision insurance; provincial healthcare coordination applies in Canada.
- Retirement savings options such as 401(k) in the U.S. and RRSP in Canada.
- Life and disability insurance coverage.
- Access to employee assistance programs.
- Additional benefits as defined by local policies and eligibility criteria.
Compensation
Not specified
Work Arrangement
Not specified
Team
Not specified
Preferred
- Azure certifications (e.g., Azure Solutions Architect Expert, Azure Data Engineer Associate, Databricks certifications).
- Experience in oil & gas, industrial or asset-heavy domains.
Benefits
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Other
- It is not typical for candidates to be hired at or near the top of the posted compensation range.
- In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.
Not specified
