Responsibilities
- Design, build, and maintain data pipelines for the agent platform.
- Ensure data quality, accuracy, and scalability.
- Collaborate with data scientists and engineers to integrate data into machine learning models.
- Optimize data storage and retrieval processes.
- Implement data security and privacy measures.
- Monitor and troubleshoot data pipeline issues.
- Develop and maintain data documentation.
- Contribute to the development of data governance policies.
- Work with stakeholders to understand data requirements.
- Implement data validation and testing processes.
- Participate in code reviews and pair programming sessions.
- Stay updated with the latest data engineering trends and technologies.
- Provide technical support and guidance to team members.
- Ensure compliance with data regulations and standards.
- Develop and maintain ETL (Extract, Transform, Load) processes.
- Collaborate with cross-functional teams to deliver data-driven solutions.
- Implement data monitoring and alerting systems.
- Conduct performance tuning and optimization of data systems.
- Develop and maintain data warehousing solutions.
- Ensure data consistency and integrity across systems.
- Implement data backup and recovery processes.
- Collaborate with product managers to define data requirements.
- Develop and maintain data reporting and analytics tools.
Nice to Have
- Master's degree in a related field.
- Experience with natural language processing (NLP) and machine learning.
- Proficiency in data science libraries such as Pandas, NumPy, or SciPy.
- Experience with stream processing frameworks such as Apache Flink or Apache Storm.
- Knowledge of graph databases and technologies.
- Experience with real-time data processing and analytics.
- Proficiency in data warehousing solutions such as Google BigQuery, Amazon Redshift, or Snowflake.
- Experience with data lake architectures and technologies.
- Knowledge of data governance and compliance frameworks.
- Experience with data privacy and security regulations.
- Proficiency in data visualization and reporting tools.
- Experience with cloud-native data engineering practices.
- Knowledge of data integration and API development.
- Experience with data pipeline orchestration tools such as Apache Airflow or Luigi.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with data modeling and ETL processes.
- Knowledge of machine learning and AI concepts.
- Experience with data warehousing solutions such as Google BigQuery, Amazon Redshift, or Snowflake.
- Proficiency in data science libraries such as Pandas, NumPy, or SciPy.
- Experience with stream processing frameworks such as Apache Flink or Apache Storm.
- Knowledge of graph databases and technologies.
- Experience with real-time data processing and analytics.
Compensation
Competitive salary and equity
Work Arrangement
On-site
Team
Collaborative and innovative team
About the Role
- This role involves developing and maintaining data infrastructure for an agent platform, ensuring data quality and scalability.
- You will work closely with data scientists and engineers to integrate data into machine learning models and optimize data storage and retrieval processes.
- The ideal candidate will have a strong background in data engineering, proficiency in SQL and NoSQL databases, and experience with big data technologies.
Our Benefits
- Competitive salary and equity
- Health, dental, and vision insurance
- 401(k) matching
- Unlimited PTO
- Flexible work hours
- Remote work options
- Professional development opportunities
- Employee assistance programs
- Wellness programs
- Team-building activities
- Performance bonuses
- Relocation assistance
- Tuition reimbursement
- Parental leave
- Employee discounts
- On-site amenities
- Stock options
- Employee referral program
- Volunteer time off
- Mentorship programs
- Career growth opportunities
Our Culture
- Collaborative and innovative team
- Focus on continuous learning and development
- Emphasis on work-life balance
- Inclusive and diverse work environment
- Opportunities for professional growth
- Supportive and inclusive culture
- Encourages creativity and innovation
- Values open communication and collaboration
- Promotes a healthy work-life balance
- Fosters a culture of continuous improvement
- Encourages teamwork and collaboration
- Values diversity and inclusion
- Promotes a culture of learning and development
- Encourages innovation and creativity
- Values open and transparent communication
- Fosters a supportive and inclusive work environment
- Promotes a culture of continuous learning and development
- Encourages teamwork and collaboration
- Values diversity and inclusion
- Promotes a culture of innovation and creativity
- Encourages open and transparent communication
- Fosters a supportive and inclusive work environment
Not provided
