PLUM is seeking a Senior Data Engineer to design and implement scalable data pipelines that ingest and process data from various external client systems. This role is critical in building the data infrastructure that powers PLUM’s AI-driven fintech products, working within a modern cloud-based data stack and collaborating with cross-functional teams in a fully remote environment.
What You'll Do
- Design and architect end-to-end data processing pipelines: ingestion, transformation, and delivery to the Delta Lakehouse.
- Integrate with external systems (e.g., CRMs, file systems, APIs) to automate ingestion of diverse data sources.
- Develop robust data workflows using Python and Databricks Workflows.
- Implement modular, maintainable ETL processes following SDLC best practices and Git-based version control.
- Contribute to the evolution of our Lakehouse architecture to support downstream analytics and machine learning use cases.
- Monitor, troubleshoot, and optimize data workflows in production.
- Collaborate with cross-functional teams to translate data needs into scalable solutions.
What We're Looking For
- Experience as, or applicable to, a Senior Data Engineer role
- Significant demonstrated experience using Python in a cloud environment
- Ability to lead the design and implementation of scalable data pipelines
- Experience with architectural decisions, system design, and production readiness
Technical Stack
- Python
- Databricks
- AWS
- Delta Lake
- Git
- ETL
- Lakehouse architecture
- APIs
- CRMs
- file systems
Team & Environment
- Boutique firm where each person’s contributions and ideas are critical
- Flat corporate structure
- High-performing team
- Team stays connected through Slack, video calls, and regular meetings
- Team knows how to work hard, have fun, and make a meaningful impact
- Collaboration with a high-performing team including sales, marketers, and financial services experts
- Regular team and company-wide meetings
- In-person gatherings a few times a year
Benefits & Compensation
- Fully remote position
- Autonomy and flexibility
- Opportunity for direct input to be realized and put into action
Work Mode
Fully remote long-term, with reliable internet connection required. This position is open to candidates in the U.S.
