NICE Ltd. is looking for a Senior Test Engineer to ensure the quality of our SaaS-based enterprise applications, with a focus on billing systems and validating Generative AI model behaviors. You will join an Agile/SCRUM development team and collaborate closely with developers, product owners, and business analysts to validate product functionality and complex customer scenarios.
What You'll Do
- Participate as a scrum team member in product development ceremonies.
- Design and execute test cases and exploratory testing for SaaS and cloud-based applications, focusing on critical flows like invoicing, subscription lifecycle, usage metering, and AI-generated actions or insights.
- Validate the accuracy, reliability, safety, and user experience of AI-powered features, focusing on model behavior, prompt evaluation, output validation, and integration within SaaS applications or enterprise systems.
- Collaborate with product managers and developers to understand user stories, requirements, and business goals, especially in billing workflows and GenAI capabilities.
- Validate data pipelines and integrations between components, especially involving billing logic and AI-based decisioning.
- Conduct Product Risk Assessments for new features or updates.
- Support testing for customer issues, patches, and hotfixes.
- Participate in regression test planning and execution prior to feature releases.
- Maintain accurate documentation related to test cases, test results, and product quality.
- Work with cross-functional teams to ensure alignment on release readiness.
- Interface with R&D and support teams to triage and resolve customer-reported issues.
- Stay up to date with trends and developments in SaaS testing, AI quality validation, and billing platforms.
What We're Looking For
- Degree in Computer Science, Engineering, or a related field.
- 4-7 years of experience in software testing, preferably in SaaS environments.
- Solid understanding of billing platforms, subscription models, usage tracking, and revenue systems.
- Familiarity with Generative AI feature testing, including prompt-response behavior, outputs and model behavior, user-facing AI features, and adaptive system behavior.
- Strong experience in API testing using tools such as Postman (required) or RestAssured.
- Exposure to SQL and database verification, especially for financial and usage data validation.
- Experience in creating and executing test plans and test cases for business-critical applications.
- Familiarity with tools like TestLink, Jira, X-Ray, and Confluence.
- Excellent troubleshooting and problem-solving skills.
- Strong communication skills and a collaborative mindset.
- Experience working in Agile/SCRUM environments.
- Ability to contribute in a global, cross-functional team setting.
Nice to Have
- Background in validating billing engines, subscription lifecycle management, or ERP/CRM integrations.
- Understanding of GenAI behavior testing (prompt response validation, model guardrails, AI accuracy/fairness).
- Scripting experience in PowerShell or Bash for test environment setup and monitoring.
- Experience with monitoring tools or observability platforms.
- Familiarity with performance or load testing concepts (tools like JMeter are a plus).
- Experience with containerized environments (Kubernetes, Docker) is a plus.
- Knowledge of communication platforms such as Microsoft Teams or Zoom is a bonus.
Technical Stack
- Postman, RestAssured, SQL, TestLink, Jira, X-Ray, Confluence, PowerShell, Bash, JMeter, Kubernetes, Docker, Microsoft Teams, Zoom
Team & Environment
You will join an Agile/SCRUM development team in a global cross-functional team setting and report to a Tech Manager.
Benefits & Compensation
- Internal career opportunities across multiple roles, disciplines, domains, and locations.
- NICE-FLEX hybrid model.
Work Mode
This role is based on a hybrid work model and is located in India - Pune.
NICE is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, age, sex, marital status, ancestry, neurotype, physical or mental disability, veteran status, gender identity, sexual orientation or any other category protected by law.
