Truelogic Software is looking for a Senior Data Engineer - Advertising to join our team. You will build scalable and efficient ETL pipelines within the Google Cloud Platform (GCP) ecosystem, transforming raw data into actionable insights that drive business value.
What You'll Do
- Design, build, and maintain scalable ETL pipelines using PySpark and other GCP-native tools.
- Apply extensive experience utilizing the Databricks platform.
- Work with GCP infrastructure and services, including BigQuery, Dataflow, Cloud Composer, Cloud Functions, and Pub/Sub.
- Develop and optimize data ingestion, transformation, and loading processes.
- Collaborate with data scientists, product managers, and other engineers to understand data needs and deliver high-quality solutions.
- Ensure data quality, reliability, and performance across all pipelines.
- Monitor, troubleshoot, and enhance data workflows and systems.
- Apply best practices for orchestration, version control, and CI/CD in data workflows.
- Participate in design discussions, peer reviews, and code quality checks.
What We're Looking For
- 5-7 years of experience in data engineering, preferably in a cloud-native environment.
- Strong programming skills: Python & PySpark.
- Advanced SQL & experience working with large datasets.
- Proficiency with Databricks.
- Hands-on experience with GCP services, specifically: BigQuery, Dataflow, Cloud Composer (Airflow), Pub/Sub.
- Experience orchestrating data pipelines & workflow automation.
- Proven track record of improving pipeline performance & maintaining data integrity.
- Experience with performance tuning of data workflows.
- Good communication, analytical thinking, and problem-solving abilities.
- Ability to work independently and collaboratively in a cross-functional team.
- Bachelor’s or Master’s degree in Computer Science, Engineering, IT, or equivalent experience.
Technical Stack
- PySpark, Python, SQL
- Google Cloud Platform (GCP)
- BigQuery, Dataflow, Cloud Composer (Airflow), Cloud Functions, Pub/Sub
- Databricks
Benefits & Compensation
- 100% Remote Work
- Highly Competitive USD Pay
- Paid Time Off
- Work with Autonomy
- Work with Top American Companies
Work Mode
This is a global, fully remote position open to candidates based in Latin America (Latam).
Truelogic Software is an equal opportunity employer.
