Truelogic Software is hiring a Senior Data Engineer - Advertising to build scalable and efficient ETL pipelines within the Google Cloud Platform ecosystem. You will transform raw data into actionable insights that drive business value for a client in the marketing technology space.
What You'll Do
- Design, build, and maintain scalable ETL pipelines using PySpark and other GCP-native tools.
- Work with GCP infrastructure and services, including BigQuery, Dataflow, Cloud Composer, Cloud Functions, and Pub/Sub.
- Develop and optimize data ingestion, transformation, and loading processes.
- Collaborate with data scientists, product managers, and other engineers to understand data needs and deliver high-quality solutions.
- Ensure data quality, reliability, and performance across pipelines.
- Monitor, troubleshoot, and enhance data workflows and systems.
- Apply best practices for orchestration, version control, and CI/CD in data workflows.
- Participate in design discussions, peer reviews, and code quality checks.
What We're Looking For
- 5-7 years of experience in data engineering, preferably in a cloud-native environment.
- Strong programming skills in Python & PySpark.
- Advanced SQL skills and experience working with large datasets.
- Proficiency with Databricks.
- Hands-on experience with GCP services, specifically: BigQuery, Dataflow, Cloud Composer (Airflow), Pub/Sub.
- Experience orchestrating data pipelines and workflow automation.
- Proven track record of improving pipeline performance and maintaining data integrity.
- Experience with performance tuning of data workflows.
- Good communication, analytical thinking, and problem-solving abilities.
- Ability to work independently and collaboratively in a cross-functional team.
- Bachelor’s or Master’s degree in Computer Science, Engineering, IT, or equivalent experience.
Technical Stack
- PySpark
- Python
- SQL
- Databricks
- Google Cloud Platform (GCP)
- BigQuery
- Dataflow
- Cloud Composer (Airflow)
- Pub/Sub
- Cloud Functions
Team & Environment
You'll collaborate with data scientists, product managers, and other engineers.
Benefits & Compensation
- 100% Remote Work.
- Highly Competitive USD Pay.
- Paid Time Off.
- Work with Autonomy.
- Work with Top American Companies.
Work Mode
This is a global, fully remote position.
Truelogic Software is an equal opportunity employer.
