Responsibilities
- Understanding the business requirements
- Writing code and implementing the proposed solutions
- Creating data pipelines, versioning and change management
- Manage the complexity inherent in versioned data pipelines
- Develop ETL/ELT processes to help extract and manipulate data from multiple sources.
- Design, build and maintain batch or real-time data pipelines in production.
- Automate data workflows such as data ingestion, aggregation, and ETL processing.
- Logging and instrumentation of pipelines and services.
- Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
- Train and mentor junior engineers.
Requirements
- NoSQL-to-RDBMS Mapping: Flatten and normalize complex, nested JSON data from MongoDB into structured relational tables.
- Pipeline Development: Build and manage reliable ETL pipelines to ingest data from MongoDB, process it via Snowflake, and load it into MySQL.
- Database Optimization: Design, index, and tune target MySQL databases to ensure high performance and strict data integrity.
- Snowflake Utilization: Leverage Snowflake's variant handling capabilities to efficiently stage, parse, and transform semi-structured data.
- Proficiency in MongoDB, MySQL, Snowflake SQL
Nice to Have
- good to have Python (including ETL frameworks like rivery or informatica)
Work Arrangement
Hybrid
Additional Information
- Imagine a flexible work environment – whether it's the office, your home, or a blend of both.
- From interviews to onboarding, we embody a remote-first approach.
- Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams.
- We’re big on your well-being – as a company, we spend a whole trimester in our annual cycle focused on wellbeing.
- Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best.
- Our professional services model enables us to accelerate career growth and development opportunities - across projects, offerings, and industries.
- We are an equal opportunity employer.
- We live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally.
