Responsibilities
- Serve as a core contributor to ClickHouse's Data engineering ecosystem, specializing in JVM-based frameworks.
- Own and maintain critical parts of data framework integrations for ClickHouse.
- Work at the intersection of high-performance database engineering and developer experience.
- Own the full lifecycle of data framework integrations — from core database drivers handling billions of records per second to SDKs and connectors making ClickHouse feel native in JVM-based applications.
- Build foundational tools used by thousands of data engineers for critical data workloads.
- Directly impact how companies process massive datasets, including real-time analytics and observability systems.
- Collaborate closely with the open-source community, internal teams, and enterprise users to ensure JVM integrations meet high standards for performance, reliability, and developer experience.
Requirements
- 6+ years of software development experience focusing on building and delivering high-quality, data-intensive solutions.
- Proven experience with the internals of streaming or data integration frameworks, with strong preference for Apache Kafka (or similar pub/sub systems), Kafka Connect, Apache Flink or Apache Beam.
- Experience developing or extending connectors, sinks, or sources for at least one streaming processing framework such as Apache Flink, Beam, or Kafka Connect, with preference for experience building or maintaining production-grade streaming connectors.
- Hands-on experience with Apache Kafka or similar distributed messaging systems (e.g., Pulsar, Kinesis), including topic design, consumer groups, and performance tuning.
- Strong understanding of database fundamentals: SQL, data modeling, query optimization, and familiarity with OLAP/analytical databases.
- A track record of building scalable data integration systems (beyond simple ETL jobs).
- Strong proficiency in Java and the JVM ecosystem, including deep knowledge of memory management, garbage collection tuning, and performance profiling.
- Solid experience with concurrent programming in Java, including threads, executors, and reactive or asynchronous patterns.
- Outstanding written and verbal communication skills to collaborate effectively within the team and across engineering functions.
- Understanding of JDBC, network protocols (TCP/IP, HTTP), and techniques for optimizing data throughput over the wire.
- Passion for open-source development.
Nice to Have
- Prior contributions to open-source projects: actively engaging with the OSS community, advocating for users, and influencing the evolution of the core system through your contributions — big advantage.
- Familiarity with ClickHouse or similar high-performance data platforms.
- Working knowledge of Python, especially in data engineering contexts (e.g., Pandas, PySpark, Airflow), and ability to contribute to Python tooling when needed.
