Netguru is hiring a part-time Senior QA Engineer with Generative AI experience for a freelance role. You will ensure the quality of Python-based web applications and their integrated AI/ML components, blending traditional software testing with specialized validation for data pipelines and predictive models.
What You'll Do
- Design and execute test scenarios for Python-based web applications.
- Assess AI model performance using metrics such as precision, recall, F1-score, bias, fairness, and explainability.
- Conduct robustness testing and validate data quality used for training models.
- Work with tools supporting AI/ML model testing (e.g., MLflow, TensorBoard, Great Expectations, Evidently AI).
- Cooperate with data scientists and engineers to define QA standards for data-driven systems.
- Apply testing methodologies suited for predictive, model-based architectures.
What We're Looking For
- Experience testing web applications, especially in Python environments.
- Fluency in Polish for communication, documentation, and collaboration.
- Understanding of the difference between classical software QA and data/model-based testing.
Nice to Have
- Practical experience in testing AI/ML models or data validation processes.
- Familiarity with model performance metrics (precision, recall, F1-score).
- Exposure to tools such as MLflow, TensorBoard, Great Expectations, Evidently AI.
- Experience with fairness, bias, or explainability validation of AI systems.
Technical Stack
- Python
- MLflow
- TensorBoard
- Great Expectations
- Evidently AI
Team & Environment
You will join the client's team, cooperating directly with data scientists and engineers.
Benefits & Compensation
- 100% remote, flexible work.
- Work with an experienced team of developers and continuous development of your hard and soft skills.
- Dev-friendly processes such as Continuous Integration, Continuous Delivery, Code Review, and bug bashes.
- Long-term collaboration on challenging products (FinTech, B2B software, E-commerce and more).
- Compensation: up to 125 PLN net+VAT/h.
Work Mode
This is a global, fully remote position, with a preference for candidates based in Poland.
Netguru is an equal opportunity employer.
