Parafin seeks a Senior Software Engineer to join our Infrastructure team and lead the development of our next-generation Data Platform. This role is central to ensuring our data infrastructure is reliable, scalable, and developer-friendly as we continue to power financial services for small businesses.
What You'll Do
- Design and build robust, highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS.
- Improve the data platform development experience for Engineering, Data Science, and Product by creating intuitive abstractions, self-service tooling, and clear documentation.
- Own and maintain core data pipelines and models that power internal dashboards, machine learning models, and customer-facing products.
- Own the Data & ML platform infrastructure using Terraform, including end-to-end administration of Databricks workspaces: manage user access, monitor performance, optimize configurations, and ensure high availability.
- Lead projects to improve data quality, testing, observability, and cost efficiency across existing pipelines and backend systems.
- Act as the primary engineering partner for the Data Science team—embedded closely to gather requirements, design scalable solutions, and provide end-to-end support.
- Work closely with backend engineers and data scientists to design performant data models and support new product development initiatives.
- Share best practices and mentor other engineers working on data-centric systems.
What We're Looking For
- 4+ years of experience in software engineering with a strong background in data infrastructure, pipelines, and distributed systems.
- Advanced proficiency in Python and SQL.
- Hands-on Spark development experience.
- Expertise with modern cloud data stacks—AWS (S3, RDS), Databricks, and Airflow—and lakehouse architectures.
- Hands-on experience with foundational data-infrastructure technologies such as Hadoop, Hive, Kafka, Delta Lake/Iceberg, and distributed query engines like Trino/Presto.
- Familiarity with ingestion frameworks, developer-experience tooling, and best practices for data versioning, lineage, partitioning, and clustering.
- Strong problem-solving skills and a proactive attitude toward ownership and platform health.
- Excellent communication and collaboration skills, especially in cross-functional settings.
Nice to Have
- Experience with AWS infrastructure using Terraform.
- Familiarity with observability tools (e.g., Datadog) and cost tracking in cloud environments.
- Experience with financial systems or building platforms in a fintech setting.
- Prior work on ML infrastructure: Feature stores (e.g., Tecton), ML model lifecycle, real-time inference.
- Contributions to internal tooling or open-source projects in the data ecosystem.
Technical Stack
- PySpark, Databricks, Airflow
- AWS, S3, RDS, Terraform
- Hadoop, Hive, Kafka, Delta Lake, Iceberg
- Trino, Presto, Python, SQL
Team & Environment
You will join the Infrastructure team, a tight-knit group of innovators focused on building the platform that enables Parafin's mission to grow small businesses. The company culture is driven by purpose and backed by prominent venture capitalists.
Benefits & Compensation
- Salary range: $230k-$265k + equity grant
- Medical, dental & vision insurance
- Work from home flexibility
- Unlimited PTO
- Commuter benefits
- Free lunches
- Paid parental leave
- 401(k)
- Employee assistance program
Work Mode
This position follows a hybrid work model.
