Remote (Global) Full-time

Oscilar is hiring a Sr./Staff Backend Engineer - Kafka

About the Role

Oscilar is looking for a Sr./Staff Backend Engineer to focus on designing, implementing, and optimizing services that leverage Apache Kafka for high-throughput, real-time data streams. You will be responsible for scaling databases like Postgres, Redis, DynamoDB, and ClickHouse within our AWS infrastructure. This is a senior technical leadership role involving cross-team collaboration, mentoring, and driving system scalability, performance, and reliability.

What You'll Do

  • Design, develop, and maintain scalable backend services using Java and AWS technologies.
  • Lead the architecture, deployment, and optimization of Apache Kafka to support real-time data streaming across distributed systems.
  • Build and manage Kafka topics, brokers, producers, and consumers, ensuring optimal performance and data consistency.
  • Implement streaming solutions with Kafka Streams and Kafka Connect, focusing on high availability and low-latency processing.
  • Collaborate with product, frontend, and data engineering teams to define technical requirements and deliver reliable, performant services.
  • Design and maintain high-performance data storage solutions using Postgres, Redis, ClickHouse, and DynamoDB.
  • Optimize database performance through schema design, indexing strategies, and resource partitioning.
  • Implement best practices for infrastructure security, performance monitoring, and data integrity.
  • Establish and maintain CI/CD pipelines for automated testing, deployment, and monitoring.
  • Provide mentorship to junior engineers, conduct code reviews, and promote best practices in software development.
  • Proactively identify and resolve performance bottlenecks and technical challenges in both streaming and database systems.

What We're Looking For

  • 8+ years of experience with Java in large-scale, distributed environments.
  • Extensive experience with Apache Kafka, including Kafka Streams, Kafka Connect, partitioning, replication, and consumer group management.
  • Strong experience with AWS services (e.g., MSK, EC2, RDS, DynamoDB, S3, Lambda).
  • Solid understanding of distributed system design, messaging patterns, and eventual consistency.
  • Proven ability to diagnose and resolve bottlenecks in streaming and database systems.

Nice to Have

  • Experience integrating Kafka with analytics solutions like ClickHouse.
  • Knowledge of event-driven architecture and streaming patterns like CQRS and event sourcing.
  • Hands-on experience with monitoring tools (e.g., Prometheus, Grafana, Kafka Manager).
  • Experience automating infrastructure with tools like Terraform or CloudFormation.
  • Proficiency with Postgres, Redis, ClickHouse, and DynamoDB. Experience with data modeling, query optimization, and high-transaction databases.
  • Familiarity with encryption, role-based access control, and secure API development.

Technical Stack

  • Languages & Frameworks: Java, Apache Kafka, Kafka Streams, Kafka Connect
  • Cloud & Infrastructure: AWS, MSK, EC2, RDS, DynamoDB, S3, Lambda
  • Databases: Postgres, Redis, ClickHouse
  • Monitoring & Tooling: Prometheus, Grafana, Kafka Manager, Terraform, CloudFormation

Team & Environment

You will collaborate across teams and mentor other engineers. Oscilar's culture is built on mission-driven teams, extreme ownership, innovating at the cutting edge, and is a family-friendly, AI-first company. Over 50% of the company is in Engineering and Product, and both Co-Founders are engineers at heart.

Benefits & Compensation

  • Competitive salary and equity packages
  • 401k
  • 100% Employer covered comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US and Canada)
  • Unlimited PTO policy
  • Home office setup assistance
  • Regular team events and offsites
  • Unparalleled learning and professional development opportunities

Work Mode

This is a global position.

Oscilar is an equal opportunity employer.

Required Skills
JavaApache KafkaKafka StreamsKafka ConnectAWSAmazon MSKEC2RDSDynamoDBS3Distributed SystemsMicroservicesData StreamingSystem DesignCloud Architecture
Earn more as a remote developer

Performance pay that rewards your skills

Iglu's revenue-sharing model means top performers earn significantly more than traditional salaries. Choose your projects, deliver great work, and see it reflected in your pay.

Revenue-sharing compensation
Project choice & autonomy
International client base
Career growth support
Check compensation
Top earners exceed market rate
About company
Oscilar

Oscilar builds the most advanced AI Risk Decisioning™ Platform. Banks, fintechs, and digitally native organizations rely on us to manage their fraud, credit, and compliance risk with the power of AI.

Visit website
Job Details
Category backend
Posted 8 months ago