Skip to main content
Johnson Jobs

QA Automation Engineer - [Apple]

purple driveSunnyvale, CA

today

Occupations

Software Quality Assurance Analysts and TestersSoftware DevelopersComputer Systems Analysts

Industries

Custom Computer Programming ServicesSoftware PublishersComputer Systems Design Services
APPLY NOW (opens in a new tab)

About the role

Overview: Job TitleQA Automation Engineer - AI/ML Testing (Apple Experience Mandatory)
Job Summary: We are seeking an experienced QA Automation Engineer with 4-6 years of experience in automation testing and quality assurance, with mandatory prior experience at Apple. The ideal candidate will have strong expertise in testing AI/ML-powered applications, data-driven systems, and enterprise web applications using Python, Selenium, PyTest, REST APIs, and SQL.This role involves designing automated testing frameworks, validating AI/ML model outputs, ensuring data quality across ETL/ELT pipelines, and integrating automated testing into CI/CD pipelines. The candidate should be comfortable working in an Agile environment alongside software engineers, data scientists, and ML engineers.
Note: This is an Onsite position, and Apple experience is mandatory.
Experience Required:
  • 4-6 years of QA Automation experience.
  • Prior Apple experience (Mandatory).Experience testing AI/ML or data-driven applications is highly preferred.
  • Employment Type
  • Contract / Full-TimeWork Environment
  • OnsiteAgile/ScrumCross-functional collaboration with Software Engineering, AI/ML, Data Engineering, and Product teams
Key Responsibilities:
  • Design and execute manual, functional, regression, integration, UAT, and non-functional test cases.
  • Develop and maintain automation frameworks using Python, PyTest, and Selenium.
  • Validate AI/ML models for accuracy, consistency, hallucination, faithfulness, and reliability.
  • Design and maintain LLM evaluation frameworks for Generative AI applications.
  • Perform REST API testing using Postman or similar tools.
  • Validate ETL/ELT pipelines and perform SQL-based data verification.
  • Integrate automated test suites into CI/CD pipelines using GitHub Actions or GitLab CI.Perform defect tracking, Root Cause Analysis (RCA), and issue reporting using Jira.
  • Conduct performance, latency, scalability, and basic security testing.
  • Collaborate with developers, data engineers, and ML engineers to ensure software quality.
  • Support production validation and release verification activities.
  • Continuously improve test automation frameworks and QA best practices.
  • Mandatory Technical SkillsQA Automation
  • Selenium WebDriverPythonPyTestAutomation Framework Development
  • Functional Testing
  • Regression Testing
  • Smoke Testing
  • Integration TestingUAT TestingAI/ML TestingAI/ML Application TestingLLM Evaluation
  • Model Validation
  • Hallucination Testing
  • Output Accuracy Validation
  • Data Quality TestingAPI & Data TestingREST API Testing
  • PostmanSQLData ValidationETL/ELT Testing
  • DevOps & CI/CDGitHub Actions
  • GitLab CIJenkins (Preferred)
  • GitDefect Management
  • JiraRoot Cause Analysis (RCA)
  • Bug Tracking
  • Test Documentation
  • Performance Testing
  • Performance Testing
  • Latency Testing
  • Basic Security Testing
Preferred Skills: TestCompleteJavaPlaywrightCypressDockerKubernetesAWS or AzureAI/ML Lifecycle Testing Data Engineering Concepts
Required Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field.4-6 years of QA Automation experience. Previous experience working at Apple (Mandatory).Strong proficiency in Selenium, Python, and PyTest. Experience testing REST APIs and SQL databases. Understanding of AI/ML testing methodologies. Experience integrating automation with CI/CD pipelines. Strong analytical, debugging, and communication skills.
Preferred Qualifications: Experience with Large Language Models (LLMs) or Generative AI testing. Experience with cloud platforms (AWS, Azure, or GCP).ISTQB Certification. Experience with performance testing tools.

Matching similar jobs

JOB OVERVIEW

Experience level

Senior

Location

Sunnyvale, CA

Occupation

Software Quality Assurance Analysts and Testers

Industry

Custom Computer Programming Services

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)