Natixis in Portugal is currently seeking Google Cloud Platform (GCP) Data Engineers to join its BPCE SI (BPCE Solutions Informatiques) team, within the IT (Information Technologies) department, to work in a hybrid model in the Porto or Lisbon office.
Responsibilities
Data and Database Migration:
- Actively participate in the design and execution of the data and ETL process migration strategy from SQL Server to GCP.
- Develop and optimize scripts and pipelines for efficiently transferring and transforming data into BigQuery.
Design and Development of Data Pipelines on GCP:
- Design, develop, and maintain robust and high-performing ETL/ELT pipelines on GCP, replacing or rebuilding existing flows.
- Orchestrate and schedule these pipelines using Google Cloud Composer (or Apache Airflow) to ensure reliable migration and operationalization.
Database Management and Optimization on GCP:
- Develop and optimize complex SQL queries for BigQuery, taking into account the specificities of migrating from SQL Server to BigQuery (e.g., optimizing partitioning, clustering).
- Contribute to the design and implementation of optimized data schemas for BigQuery, adapted to new cloud architectures.
Development and Automation:
- Use Python to develop scripts for automating migration tasks, data transformation, and integration with other GCP services.
- Implement processes to ensure data quality and integrity during and after migration.
Collaboration and Support:
- Collaborate closely with current teams (SQL Server administrators, analysts) to understand the existing environment and facilitate the transition.
- Exchange with end-users (business lines, data scientists) to understand their needs and ensure the new platform meets their expectations.
- Participate in code reviews, development best practices, and testing strategies for the new platform.
- Ensure monitoring, debugging, and incident resolution related to data pipelines during the transition phase and upon production deployment.
Technological Watch and Optimization:
- Stay informed about best practices for migration and the latest developments on Google Cloud Platform.
- Propose improvements and optimizations for the new Data platform on GCP.
Portugal, Portugal, Portugal Hybrid Full-time
Natixis in Portugal is hiring a GCP Data Engineer | BPCE-SI
About company
Natixis in Portugal is a Centre of Expertise whose mission is to transform traditional banking by developing innovative solutions for the business, operations and work culture of Groupe BPCE worldwide.
As part of Groupe BPCE’s international division, Natixis in Portugal designs and delivers solutions for its two core areas – Corporate & Investment Banking and Asset & Wealth Management – as well as transversal services that support all entities across the Group.
With more than 3,000 employees representing 46 nationalities, the teams work across Information Technology, Banking Support Activities, and Compliance, in an integrated, inclusive, and cross-functional way, supporting all business lines and platforms of the Group.
A disruptive mindset and a culture of proximity and agility identify Natixis in Portugal Team and reflect the company's mission to transform traditional banking at a global scale: a perfect match in the Portuguese dynamics and entrepreneurial ecosystem.
All jobs at Natixis in Portugal Visit website