xelys jobs xelys jobs

QA Engineer (MIS) (Remote)

KnowBe4

full-remotemidpermanentqa United States 80 days ago via LinkedIn

See how well this job matches your profile

Sign up to get an AI match score and generate a tailored application in seconds.

Get your match score

Tags

QATest StrategyTest PlanningRegression TestingIntegration TestingUATTest AutomationLarge Language Models (LLMs)Performance TestingSaaS Integrations

About the role

Role Overview

You’ll be a QA Engineer supporting MIS teams, working across a mix of SaaS platforms and internal/hosted applications. The role emphasizes both traditional QA and specialized testing for AI systems and Large Language Models (LLMs).

Responsibilities

Test Strategy & Planning

  • Develop and implement test strategies for MIS systems and projects
  • Create test plans and test cases for features, enhancements, and integrations
  • Maintain QA best practices and standards across all platforms
  • Learn new systems and requirements quickly; proactively review documentation

Test Execution

  • Perform manual testing including functional, regression, integration, and UAT
  • Conduct specialized testing for AI systems/LLMs and agentic AI, evaluating:
    • output accuracy
    • consistency
    • alignment with business requirements
  • Perform performance and load testing when needed

Automated Testing

  • Develop and maintain automated test scripts
  • Identify and implement automation for repetitive scenarios
  • Continuously improve automation coverage and efficiency

Defect Management

  • Identify, document, and track defects
  • Provide clear reproduction steps and supporting evidence
  • Collaborate with developers to resolve issues
  • Perform root cause analysis on critical defects

Cross-Platform & End-to-End Testing

  • Validate integrations for data consistency and correct data flow
  • Test end-to-end business processes spanning multiple systems

Reporting & Documentation

  • Prepare test reports and quality metrics for stakeholders
  • Maintain up-to-date QA/test documentation
  • Communicate results clearly to technical and non-technical audiences

Collaboration & Continuous Improvement

  • Work with developers, business analysts, and product owners to ensure quality
  • Participate in sprint ceremonies (planning, stand-ups, backlog refinement, retrospectives)
  • Stay current with QA methodologies/tools and propose process improvements

Requirements

  • Strong self-starter mindset and ability to quickly learn new systems and requirements
  • Ability to thoroughly understand system functionality through requirements documentation
  • Experience with manual testing across functional/regression/integration/UAT
  • Ability to evaluate AI/LLM outputs for accuracy, consistency, and business alignment
  • Experience with performance/load testing when necessary

Nice to Haves

  • Experience designing/maintaining automated test scripts
  • Experience with testing across multiple platforms and integrations (end-to-end)
  • Familiarity with AI testing for agentic AI and LLM-related behaviors

About KnowBe4

KnowBe4 is a global company in Human Risk Management (HRM), trusted by more than 70,000 organizations worldwide. It helps enterprises reduce human risk using continuous risk intelligence, advanced technical defenses, and personalized security training. The company is focused on protecting employees and AI agents, including emerging threats such as deepfakes and LLM-driven attacks.

Scraped 5/12/2026