Responsibilities
- Lead the full lifecycle of data architecture, including ingestion, storage, transformation, and delivery across multiple cloud platforms and deployment types.
- Create robust data models and semantic layers that serve analytics and production-grade machine learning systems.
- Define and enforce data contracts and interface protocols between data ingestion, machine learning, and application components.
- Assess and choose data platform tools based on functionality, cost-efficiency, and operational sustainability.
- Develop and maintain high-performance pipelines for processing varied data from customers and external providers.
- Implement pipeline orchestration and version control using tools like Airflow, dbt, or Dagster to ensure reproducibility and ease of debugging.
- Integrate monitoring for data quality, lineage, timeliness, and system observability to proactively detect issues.
- Architect solutions optimized for graph-based and highly interconnected data patterns in addition to traditional structured data.
- Enforce policies for data security, access permissions, retention periods, and privacy compliance across all customer data.
- Develop intuitive tooling and comprehensive documentation to encourage consistent and correct data usage.
- Collaborate with engineering and client-facing teams to securely and efficiently integrate new customer data sources.
- Define and promote data engineering standards and best practices, and guide team development as the organization scales.
- Convert business and product objectives into sound technical architecture decisions with transparent tradeoff analysis.
- Monitor advancements in data platform technologies and recommend adoption of impactful innovations.
Work Arrangement
Hybrid — New York City
Other
- Accepts remote candidates within the U.S. who can travel to the NYC office monthly.
- This employer values equal opportunity and considers all applicants regardless of gender, gender identity, sexual orientation, race, ethnicity, disability, veteran status, or other legally protected characteristics.
- Candidates needing accommodations during the application process may request support via join@sciemo.ai.
