Responsibilities
- Manage the entire lifecycle of CRM Bulk Import, including orchestration workers, external-import read proxy, mapping layers, and integration with downstream services
- Design and improve the import pipeline with Pub/Sub topics, Trigger and Import workers, batch hydration, and ID-mapping in Redis for accuracy and efficiency
- Develop and scale stateless proxy services using NestJS to interact with third-party CRM REST APIs like HubSpot, Salesforce, Pipedrive, and Zoho, handling authentication, pagination, batch reads, and rate limits
- Address distributed systems challenges such as idempotent imports, retries, partial-failure recovery, deduplication, fair usage across tenants, and backoff strategies for upstream rate limits
- Maintain a CRM-agnostic integration layer with clean client abstractions, mappers, app-id resolution, and a stable guard/interceptor seam for new CRM integrations
- Design import data contracts including raw and mapped response modes, camelCase transformation rules, and exclusion lists to ensure stability for worker callers
- Enhance performance and reliability for large imports involving millions of records through batching, paging, parallelism, and efficient write-side fan-out
- Implement end-to-end solutions when necessary, including UI changes in Vue for import progress, error reporting, and mapping setup, without delays from cross-functional dependencies
- Instrument the system with traceIds, structured logs, metrics, and SLOs to monitor import behavior across bulk-actions, external-import, and oauth-api
- Lead incident response, conduct postmortems, and uphold engineering practices to maintain the health of a high-traffic product dependent on third-party services
Work Arrangement
Remote (Worldwide) — Dallas, Texas, 15 countries