Responsibilities
- Design and develop scalable backend systems using Flink, Spark, Vitess, and TiDB, leveraging scalable data modeling and pipeline design and reliability principles to support AI-driven freight matching, ensuring seamless handling of high volumes of communications and data.
- Lead the end-to-end development of features from initial concept through to deployment, applying event-driven and workflow system design patterns while making key technical and design decisions to maximize impact and user satisfaction.
- Engage directly with customers and cross-functional teams to gather insights for analytics systems architecture refinements, ITSM integration engineering, and delivery of workflow solutions that streamline freight logistics and improve user experience.
- Contribute to both backend and frontend platform development, incorporating LLM Orchestration and Tool-Calling Patterns and selecting appropriate Java, Python, Airflow, and Mysql technologies, agentic frameworks, and abstractions to maintain a balance between development speed and system reliability.
- Architect and optimize system performance through advanced analytics systems architecture, data modeling, caching strategies, and workflow integration to ensure reliability and scalability under peak load conditions.
- Collaborate with data science and product teams to integrate machine learning models into the platform, enabling real-time freight matching and predictive analytics using Flink, Spark, and TiBD for fast, reliable data ingestion and inference.
- Plan and execute the Workflow aspect of TiDB Migration and implement rigorous testing, monitoring, and observability frameworks to ensure code quality, system integrity, and operational excellence.
- Drive continuous integration and continuous delivery (CI/CD) initiatives, automating workflows and working with tech leads to implement Analytics Framework rewrite using Python to improve deployment speed and overall engineering efficiency.
- Participate in shaping the engineering culture by setting best practices and mentoring new team members to support the company's growth and innovation.
Requirements
- Bachelor’s (or foreign educ. equiv.) Degree in Computer Science, Computer Engineering, or a related field
- Three (3) years’ experience in the job offered or related occupation
- Use of Python, Agentic Frameworks, Postgres, Redis, Debugging and API Integrations
- Working with Tech Leads to implement Analytics Framework rewrite using Python
- Knowledge with LLM Orchestration & Tool-Calling Patterns
- Experience in Event-Drive/Workflow Systems Design, ITSM Integration Engineering, and Analytics Systems Architecture
- Experience in Scalable Data Modeling, and Pipeline Design and Reliability
- Use of Flink, Spark and TiBD
- Planning and executing the Workflow aspect of TiDB Migration
- Use of Java, Airflow, Vitess, Kafka, and Mysql