GenAI Test Automation Engineer

PB consulting
Tysons Corner, VA

We are seeking a Senior GenAI Test Automation Engineer with strong experience in AI development, agentic workflows, and intelligent test automation. The ideal candidate will design AI-powered testing solutions, build reusable automation frameworks, and integrate Generative AI capabilities into software quality processes.

Required Qualifications
  • 5+ years of experience in AI development, software engineering, or test automation.
  • Hands-on experience building LLM-powered agents and agentic workflows.
  • Experience using Generative AI tools such as GitHub Copilot and Claude.
  • Strong knowledge of AI-driven test automation, workflow automation, and quality engineering practices.
  • Experience with GitHub platform, CI/CD workflows, and automation pipelines.
Key Responsibilities
  • Design and implement reusable agentic testing frameworks for automated test generation, maintenance, failure analysis, and defect reporting.
  • Develop AI-powered solutions for requirements validation, test case generation, and quality insights.
  • Build automated reporting solutions by aggregating test results, service data, logs, and defect information.
  • Create AI-based quality gates to validate requirements, acceptance criteria, test coverage, and dependencies.
  • Establish test automation standards, templates, and best practices across teams.
Required Technical Skills

GenAI / LLM / Agent Development

  • Experience building LLM-based agents with tool usage, structured outputs, guardrails, and prompt engineering.
  • Experience designing AI workflows for test generation, analysis, and reporting.

Automation & Testing

  • Strong experience with test automation frameworks such as:
    • Karate (API testing, contract testing, data-driven testing)
    • Playwright (UI automation, selectors, parallel execution)
  • Knowledge of test strategy, coverage, regression testing, and defect analysis.

GitHub & DevOps

  • Strong experience with:
    • GitHub Copilot
    • GitHub Actions
    • CI/CD automation
    • Pull request checks and workflow integrations
    • GitHub APIs/webhooks
Preferred Skills
  • Experience with microservices architectures.
  • Experience building AI-assisted engineering tools.
  • Knowledge of cloud platforms, DevOps practices, and Agile methodologies.
Deliverables
  • AI-powered agentic testing automation framework.
  • GenAI-driven reporting and quality insights.
  • Automated quality gates integrated into development workflows.
  • Standardized testing guidelines and reusable templates.
Posted 2026-07-20

Recommended Jobs

Sample Coordinator (1st Shift)

Richmond, VA

JOB DESCRIPTION Work Schedule First Shift (Days) Environmental Conditions Some degree of PPE (Personal Protective Equipment) required (safety glasses, gowning, gloves, lab coat, ear pl…

View Details
Posted 2026-07-24

System Integrator

KBR
Dillwyn, VA

Title: System Integrator Belong. Connect. Grow. with KBR! KBR's National Security Solutions team provides high-end engineering and advanced technology solutions to our customers in the intel…

View Details
Posted 2026-07-11

Deputy Program Manager - U.S. Citizenship Required

Fairfax, VA

Deputy Program Manager - U.S. Citizenship Required Position Description CGI Federal is seeking an experienced Deputy Program Manager (DPM) to support a large‑scale federal financial management m…

View Details
Posted 2026-06-29

Capability Integration Lead (TS/SCI)

Tau Six
Arlington, VA

Tau Six, an agile small company delivering cutting edge cybersecurity and systems integration services to the US National Security market, has an immediate need for an IT Capabilities Integration Lea…

View Details
Posted 2026-08-01

Shift Lead

Mason's Famous Lobster Rolls
Falls Church, VA

Job Description Job Description Mason's Famous Lobster Rolls is looking for an energetic, dependable, and customer-focused Shift Lead to oversee restaurant operations during assigned shifts. As…

View Details
Posted 2026-08-14

Retail Sales Associate - Full Time

Boll & Branch
Fairfax, VA

Boll and Branch is looking for a Full-Time Sales Associate  to join our growing retail team. The Full-Time Sales Associate is responsible for generating sales through conversion of existing traff…

View Details
Posted 2026-08-01

Training Lead - Top Secret/SCI | Virginia Beach, VA

Cambridge International Systems Inc
Virginia Beach, VA

Training Lead – Top Secret/SCI | Virginia Beach, VA Cambridge International Systems, Inc. Join a dynamic global team united by shared values: commitment, integrity, and perseverance . At Camb…

View Details
Posted 2026-08-06

Part-Time Center Associate

The UPS Store 7721
Norfolk, VA

The Part-Time Center Associate delivers world-class customer service to all retail customers by receiving and processing packages for courier shipment and operating copiers, fax machines, binding equi…

View Details
Posted 2025-09-30

IT Accessibility Assessment Consultant (Part Time and Remote)

TestPros
Sterling, VA

TestPros delivers innovative independent IT assessment solutions to critical challenges facing the nation and the world.  We support the U.S. Federal Government and Commercial clients within the cont…

View Details
Posted 2026-06-15

Janitorial Worker

Radford, VA

Job Title: Janitorial Worker Job Description Join our team as a Janitorial Worker at various rest areas, where you will play a crucial role in maintaining cleanliness and safety. Your primary respo…

View Details
Posted 2026-08-14