Valtech is hiring a Data Engineer/Senior Data Engineer

Valtech is hiring a Data Engineer/Senior Data Engineer to design, build, and maintain high-performance data infrastructure. In this role, you will leverage Databricks and Azure to create reliable data pipelines and provide technical leadership for complex implementations.

What You'll Do

• Build and support both batch and real-time, highly available data pipelines.
• Develop fault-tolerant, self-healing, and highly accurate data computational pipelines.
• Provide consultation and lead the implementation of complex programs.
• Create and maintain comprehensive documentation for systems and projects.
• Tune queries running over billions of rows in a distributed query engine.
• Perform root cause analysis to identify permanent resolutions for software and process issues.

What We're Looking For

• Strong expertise in Databricks SQL and Spark SQL.
• Strong expertise in PySpark for data processing (filtering, aggregating, joining, transforming).
• Strong expertise in Pandas.
• Familiarity with Databricks workspace, clusters, jobs/workflows, and notebooks.
• Experience building ETL pipelines to move data from raw to processed zones.
• Experience with Databricks Delta Lake.
• Experience using the Databricks REST API for automation and integration.
• Collaborative, proactive, and communicative, able to work remotely while staying engaged.
• Strong analytical and design skills.
• Proven industry experience in data engineering, analytics, or data science projects, or a Bachelor's/Master's degree in a quantitative field.

Nice to Have

• Familiarity with visualization tools like Tableau and PowerBI.
• Proficiency scripting in a UNIX environment.
• Proficiency with big data tools such as Spark, Hive, Impala, and Pig.
• Proficiency with cloud architecture components (AWS, Azure, Google Cloud).
• Proficiency with data pipeline software like Airflow, Azure Data Factory, or Prefect.
• Familiarity with web application stacks (JavaScript, HTML, CSS, React/Vue/AngularJS) and API design (REST/GraphQL).
• Experience leading technical data, analytics, or machine learning projects.

Technical Stack

• Platforms & Clouds: Databricks, Azure, AWS, Google Cloud
• Languages & Query: SQL, Python, PySpark, Spark SQL
• Libraries & Tools: Pandas, Delta Lake, Hive, Impala, Pig
• Orchestration & Pipelines: ETL, Airflow, Azure Data Factory, Prefect
• APIs & Integration: REST API
• Visualization: Tableau, PowerBI
• Web Technologies: JavaScript, HTML, CSS, React, Vue, AngularJS
• Environment: UNIX

Benefits & Compensation

• Flexibility with remote and hybrid work options (country-dependent).
• Career advancement through international mobility and professional development programs.
• Learning and development with access to modern tools, training, and industry experts.

Work Mode

This role follows a hybrid work model and is located in Toronto, Canada.

We are committed to inclusion and accessibility. If you need reasonable accommodations during the interview process, please indicate it in your application or let your Talent Partner know.