Skip to main content

About the role

Overview: Lead the enterprise-grade test automation strategy, spanning UI, API, data, integration, and platform layers, and advance quality engineering for AI-enabled systems. You will design scalable automation frameworks, establish measurable quality gates, and embed automation into CI/CD to accelerate delivery. You’ll define validation approaches for probabilistic AI outputs and ensure reliability, robustness, and grounding across model and agent changes. This role is a technical authority shaping testing practices, driving cross-functional collaboration and production-ready quality. Compensation / Benefits Medical, Dental, & Vision plans 401(k) FSA/HSA Commuter Benefits Tuition Assistance Plan Paid Parental Leave
Responsibilities: Define and own the test automation technical design and risk-based strategy across UI, API, contract, component, integration, data, and platform testing Establish automation standards, patterns, and reference implementations for framework structure, reusable components, test data, diagnostics, and reporting Promote shift-left quality through component, contract, API, and pre-merge validation to reduce reliance on fragile end-to-end tests Design validation approaches for non-deterministic AI/agentic outcomes, including threshold-based assertions, evaluation harnesses, groundedness testing, and regression detection Define AI quality coverage and measurable acceptance criteria across accuracy, robustness, groundedness, safety, performance, and reliability Build and scale high-throughput automation suites that are fast, reliable, diagnosable, and easy to extend Improve automation execution time and stability via parallelization, intelligent test selection, deterministic data, and retry strategies Integrate automated validation into CI/CD with pull-request checks, scheduled suites, deployment gates, and release-readiness criteria Standardize test observability (logs, traces, evidence, dashboards) and provide actionable quality dashboards Define test environments, data management, service virtualization, external dependency control, and repeatable environment setup Serve as the technical authority for software test automation; lead design and code reviews, coach engineers, and establish maintainable standards Influence product and engineering roadmaps by translating risks into testing priorities and quality investments Partner with Product, Software Engineering, AI Engineering, Security, DevOps, and Operations to ensure quality across the product lifecycle Use production telemetry, incidents, and defect data to improve automated coverage and prevent recurrence
Key requirements: 8+ years in software quality engineering or test automation with ownership of automation frameworks and strategy Hands-on experience building scalable automation across API, contract, integration, UI, data, and end-to-end layers Strong programming skills in Java, Python, TypeScript/JavaScript, or C# Hands-on experience with Playwright, Cypress, Selenium, REST Assured, SuperTest, Postman/Newman, or pytest Experience integrating automated testing into CI/CD using GitHub Actions, Jenkins, or Azure DevOps Proven ability to improve test reliability and speed via parallelization, test selection, and diagnostics Experience defining test data strategies, environments, service virtualization, and dependency control for distributed systems Hands-on experience validating AI/ML, generative AI, agentic, or probabilistic capabilities including evaluation harnesses and groundedness Experience with Agentic Product Development Lifecycle and Spec-Driven Development Knowledge of security, performance, accessibility, resilience, and reliability testing in modern delivery practices Strong communication, leadership, and ability to translate risk into testing priorities Ability to balance speed, coverage, reliability, and risk without treating QA as a gate strong communication technical leadership coaching and mentoring Playwright Cypress Selenium

Matching similar jobs

JOB OVERVIEW

Experience level

Lead

Location

Coppell, TX

Occupation

Software Quality Assurance Analysts and Testers

Industry

Software Publishers

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)