JWay Group is hiring a Cloud Data Engineer to join our team. You will leverage your deep expertise in cloud architectures and open-source technologies to build, optimize, and maintain large-scale data pipelines and integrations using AWS services and Python. Your work will ensure high-quality, reliable, and scalable data solutions that power data-driven decision-making.
What You'll Do
- Design, develop, and maintain scalable data pipelines for ingestion, transformation, and integration.
- Implement and manage big data storage formats such as Apache Parquet and ORC.
- Write high-quality Python code for data processing and API integration, following a test-driven development approach.
- Develop and optimize SQL queries for analytical and operational needs.
- Work with various data modeling techniques, including relational, dimensional, and NoSQL.
- Implement infrastructure as code (IaC) using AWS CloudFormation or CDK.
- Leverage AWS services like Glue, Lambda, IAM, DynamoDB, S3, and Step Functions to build data solutions.
- Use orchestration tools such as Apache Airflow or Dagster to manage workflows.
- Collaborate with cross-functional, multicultural teams and, where applicable, engage directly with clients.
What We're Looking For
- At least 5 years in a data engineering role focused on integration, processing, and transformation.
- Strong programming skills in Python, with an emphasis on API integration, data libraries, and test-driven development.
- Proficiency with big data storage formats (Apache Parquet, ORC) and their optimization strategies.
- Proficiency with SQL for analytical and operational queries.
- Experience with relational data modeling.
- Experience with NoSQL data modeling.
- Working knowledge of Infrastructure as Code (IaC) via AWS CloudFormation or CDK.
- Hands-on experience with AWS services: Glue, IAM, Lambda, DynamoDB, Step Functions, S3.
- Hands-on experience with orchestration tools: EventBridge, Step Functions, Lambda.
Nice to Have
- Experience with dimensional data modeling.
- Experience with AWS services: Athena, Kinesis, MSK, MWAA, SQS.
- Experience with Apache Airflow.
- Experience with data streaming using Kinesis or Kafka.
- Exposure to Apache Spark.
- Client-facing experience, multicultural collaboration, and technical leadership skills.
Technical Stack
- Languages: Python, SQL
- AWS Services: Glue, Lambda, IAM, DynamoDB, S3, Step Functions, CloudFormation, CDK, EventBridge, Athena, Kinesis, MSK, MWAA, SQS
- Data Formats & Tools: Apache Parquet, ORC, Apache Airflow, Dagster, Kafka, Apache Spark
Work Mode
This role operates on a hybrid work model based at our office in UP Technohub, Quezon City, Philippines.
JWay Group is proud to be an Equal Opportunity Employer. We value diversity and are committed to fostering an inclusive and supportive workplace for all.
