Modus Create logo - Principal Quality Engineer (AI-Assisted & Agentic Testing)

    Principal Quality Engineer (AI-Assisted & Agentic Testing)

    Quality Assurance
    Apply Now

    "About The Role"

    About This Role

    We're looking for a Principal Quality Engineer to help transform quality engineering practices by introducing AI-assisted testing, agentic automation, and modern quality engineering frameworks within complex enterprise environments. You'll work directly within a client's engineering team, assessing existing testing practices, building scalable automation solutions, and leveraging Claude Code and AI coding agents to accelerate test creation, regression testing, and quality validation. This is a hands-on engineering and consulting role combining advanced test automation expertise with agentic AI development practices. You'll contribute directly to production testing initiatives, develop reusable AI-assisted testing workflows, and mentor QA engineers and developers through practical collaboration and hands-on pairing. You'll also work across enterprise applications involving COBOL systems, Java/Spring middleware, and TypeScript/React frontends, helping ensure quality across integrated, mission-critical systems.

    What We're Looking For

    10+ years of professional experience in Quality Assurance, Test Automation, Software Development Engineering in Test (SDET), or related software engineering roles

    Strong hands-on experience designing and building test automation frameworks from scratch, using tools such as Playwright, Cypress, or similar technologies

    Advanced expertise in API testing, integration testing, end-to-end testing, and automated regression testing

    Hands-on experience using Claude Code, Claude CLI, GitHub Copilot, or AI coding agents to generate, review, refactor, and maintain automated tests

    Experience configuring agentic testing workflows, including prompts, custom skills, repository memory files, guidelines, and reusable AI-assisted testing patterns

    Proven experience converting manual regression suites into automated tests, particularly within existing enterprise applications

    Strong experience integrating automated tests into CI/CD pipelines, using GitHub Actions, Jenkins, or similar tools

    Solid understanding of test strategy, risk-based testing, test data management, coverage analysis, and flaky-test diagnosis

    Ability to critically evaluate AI-generated test cases and scripts, identifying incomplete coverage, incorrect assumptions, unreliable assertions, and potential security risks

    Experience establishing guardrails and validation processes to ensure AI-generated tests meet production-quality standards, including secure handling of credentials, dependencies, and sensitive data

    Experience defining, tracking, and improving quality engineering metrics, such as automation coverage, test creation time, regression cycle time, flaky-test rates, and escaped defects

    Familiarity with testing AI-powered applications, including evaluating LLM-generated outputs for accuracy, consistency, hallucinations, and non-deterministic behavior

    Understanding of Agentic AI Evaluations (Evals), including evaluation datasets, scoring criteria, reliability measurements, and human review processes

    Demonstrated experience mentoring and upskilling QA engineers and developers, particularly through hands-on pairing and collaborative development

    Working knowledge of Git, Jira, and test management platforms such as Xray, TestRail, or Zephyr

    Exposure to COBOL, mainframe, legacy enterprise applications, or financial services systems, including lending or account servicing environments

    Strong communication and consulting skills, with the ability to collaborate with engineering teams and stakeholders to introduce practical improvements in quality engineering

    Bonus Points

    Experience testing COBOL-based systems of record and applications integrated with Java/Spring and modern frontend technologies

    Experience building custom Claude Code agents, testing skills, prompt libraries, and reusable AI-assisted QA toolkits

    Familiarity with LLM evaluation frameworks, automated agent evaluations, and systematic validation of AI-generated outputs

    Experience extracting complex business rules from legacy applications to develop accurate test scenarios and expected results

    Experience using AI-assisted tools for test data generation, failure triage, regression test selection, and automated defect analysis

    Background in financial services, lending, account servicing, or other highly regulated enterprise environments

    Experience introducing AI-assisted quality engineering practices across multiple engineering teams

    Experience developing QA playbooks, technical documentation, and engineering enablement programs

    Experience measuring the impact of AI-assisted testing on engineering productivity, software quality, and delivery efficiency

    Why Join Us

    Build production-ready test automation frameworks that improve software quality and engineering efficiency

    Use Claude Code and agentic AI tools to accelerate test generation, regression testing, and failure analysis

    Transform manual testing processes into scalable, AI-assisted automation workflows

    Work across complex enterprise architectures involving COBOL, Java/Spring, and modern web applications

    Mentor QA engineers and developers through hands-on pairing, shared test development, and practical knowledge sharing

    Design reusable AI testing toolkits, custom agent skills, prompts, and validation guardrails

    Have the autonomy to define testing strategies, tooling configurations, and quality engineering improvements

    See measurable improvements in test coverage, regression cycle times, and engineering team capabilities

    Be part of a team that plays to each other's strengths and celebrates every success together

    Ready to Apply?

    To submit your application for this position, please visit Modus Create's official website and follow their application process.

    Related Quality Assurance Jobs