Quality Assurance Engineer

Job Title: Software QA Engineer (Full-Stack & AI/ML Testing)

Location: Sri Lanka (Remote working)

About Us

One of our clients who is heavily involved in AI implementations is looking for someone brilliant to join their team.

Job Overview

They are looking for a Software QA Engineer to join the team and ensure the quality, reliability, and performance of the full-stack AI application. The ideal candidate should have experience testing full-stack applications and a good understanding of machine learning (ML) model evaluation. You will work closely with developers, data scientists, and DevOps engineers to implement robust testing strategies, ensuring our AI-powered solutions meet high standards of accuracy and performance.

Key Responsibilities

Full-Stack Testing

• Test full-stack applications, ensuring functionality, security, and performance meet requirements.
• Perform UI testing using Selenium or similar frameworks to validate responsiveness, layout, and functionality.
• Conduct cross-browser and mobile compatibility testing to ensure seamless user experiences.
• Test user interactions (buttons, forms, navigation, error messages) for usability and correctness.
• Perform API testing using tools like Postman or Selenium, validating endpoints, authentication mechanisms (OAuth, JWT), and response integrity.
• Develop and execute unit tests, integration tests, and automated test scripts.
• Work with CI/CD pipelines to implement test automation frameworks for continuous testing.

AI/ML Testing

• Develop test cases covering edge cases and client requirements.
• Evaluate the quality of LLM outputs, ensuring they align with expected client requirements.
• Conduct load testing to measure latency, request handling, and scalability.
• Utilize model evaluation techniques, interpreting results based on provided evaluation metrics.
• Identify potential bottlenecks in an ML pipeline, providing insights into asynchronous vs synchronous processing, multithreading vs multiprocessing.
• Collaborate with ML engineers to improve the accuracy and efficiency of AI-driven applications.
• [Optional] Apply a basic understanding of ML concepts (regression, classification, time-series analysis) to enhance testing strategies.

Required Qualifications & Skills

• 3+ years of experience in software testing and QA.
• Strong knowledge of manual and automated testing methodologies.
• Proficiency in Selenium, Cypress, or similar UI automation tools.
• Hands-on experience with API testing tools (Postman, RestAssured, etc.).
• Familiarity with CI/CD processes and test automation frameworks.
• Understanding of RESTful APIs, OAuth, JWT authentication.
• Experience in performance and load testing tools.
• Basic knowledge of ML evaluation metrics and techniques.
• Strong analytical and problem-solving skills with attention to detail.

Preferred Qualifications

• Familiarity with ML workflows and AI-based application testing.
• Understanding of multithreading, multiprocessing, and async/sync processes.
• Experience working in an Agile development environment.
• Knowledge of cloud platforms (AWS, Azure, GCP).
• Ability to suggest performance optimizations based on test results.

You have to wait 20 seconds

Generating Apply Link...