GFT Technologies SE is looking for a Senior Data Engineer (AWS) to design and implement scalable cloud solutions using AWS services. You will work with distributed data architecture, focusing on data democratization (Data Mesh), and develop robust data pipelines in Python.
What You'll Do
- Design and implement scalable cloud solutions using AWS services.
- Work with distributed data architecture, focusing on data democratization (Data Mesh).
- Develop robust data pipelines in Python, integrating various sources and destinations.
- Collaborate with multifunctional teams in an agile environment.
- Build and monitor observability solutions using Datadog (metrics, logs, traces, dashboards).
- Contribute to good versioning (Git/GitHub), testing, and automation practices.
What We're Looking For
- Solid experience with AWS services, including: SQS, SNS, API Gateway, Lambda, DynamoDB, Glue, Athena, QuickSight, RDS (Aurora), IAM, Secrets Manager, Step Functions, Batch, EC2, CloudWatch, KMS, CodePipeline.
- Practical experience with Data Mesh and data democratization.
- Strong knowledge of Python.
- Knowledge of relational and NoSQL databases.
- Experience with EMR.
- Familiarity with Git/GitHub.
- Experience with Datadog for creating and managing metrics, logs, traces, and dashboards.
- Knowledge and practice with agile methodologies.
Nice to Have
- Knowledge of Angular, Java, Kafka, and Docker.
- Experience with data governance and data products.
Technical Stack
- AWS, Python, Datadog, Git/GitHub, EMR, DynamoDB, Glue, Athena, Lambda, SQS, SNS, API Gateway, RDS (Aurora), IAM, Secrets Manager, Step Functions, Batch, EC2, CloudWatch, KMS, CodePipeline, Angular, Java, Kafka, Docker
Team & Environment
We are looking for someone who enjoys teamwork and is collaborative in their assignments. You should have the courage to challenge yourself and go beyond, embracing new growth opportunities. We value individuals who transform ideas into creative solutions, seek quality in their routine, possess problem-solving skills, and are comfortable working independently, managing their own time. Interest in handling adverse and innovative situations in the technological field is a plus.
