QA Engineer (MIS) (Remote)

Role Overview

QA Engineer (MIS) supporting KnowBe4’s MIS teams. You’ll ensure high-quality delivery across a range of business systems including SaaS platforms (e.g., NetSuite, Salesforce, Workday), hosted solutions, and internal applications. The role includes specialized testing for AI systems and Large Language Models (LLMs), requiring quick ramp-up on new tools and requirements.

Responsibilities

Test Strategy & Planning

• Develop and implement comprehensive test strategies for MIS systems and projects
• Create detailed test plans and test cases for new features, enhancements, and integrations
• Maintain QA best practices and standards across all platforms
• Proactively review requirements documentation to understand system functionality
• Quickly learn new systems, platforms, and business processes with minimal guidance

Test Execution

• Perform thorough manual testing across MIS applications
• Execute functional, regression, integration, and user acceptance testing
• Conduct specialized testing for AI systems/LLMs and agentic AI (evaluate accuracy, consistency, and alignment to business requirements)
• Run performance and load testing when necessary

Automated Testing

• Develop and maintain automated test scripts for supported applications
• Identify and implement automation opportunities for repetitive scenarios
• Improve test automation coverage and efficiency over time

Defect Management

• Identify, document, and track defects using appropriate tools
• Provide clear reproduction steps and supporting evidence
• Collaborate with developers for timely resolution
• Perform root cause analysis on critical bugs to prevent recurrence

Cross-Platform Testing

• Validate integrations between systems to ensure data consistency and correct data flow
• Verify end-to-end business processes spanning multiple systems
• Provide meaningful QA feedback by ramping on business workflows

Reporting & Documentation

• Produce test reports and quality metrics for stakeholders
• Keep test documentation up to date (test cases, procedures)
• Report results clearly for both technical and non-technical audiences

Collaboration & Continuous Improvement

• Work with developers, business analysts, and product owners across the development lifecycle
• Participate in sprint planning, stand-ups, backlog refinement, and retrospectives as appropriate
• Stay current on QA methodologies/tools and propose process improvements

Requirements

• Self-starter with the ability to quickly learn new systems and requirements
• Experience creating test strategies, plans, and test cases
• Ability to perform manual testing including functional, regression, integration, and UAT
• Experience testing AI/LLM outputs for accuracy, consistency, and business alignment
• Ability to identify, document, and track defects with strong reproduction detail
• Experience collaborating with developers to resolve issues

Nice to Have

• Experience with automated testing and increasing automation coverage
• Experience with performance/load testing
• Experience with cross-platform/integration testing across multiple systems