Test Automation Engineer - Focus on AI Testing

SPIRIT-TESTING Software & Services GmbH

Job

In this role, you will design automated testing frameworks and conduct tests for AI-based systems, including validating NLP components and test architectures for GenAI integrations.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • Consulting clients on test strategy and testing methods (traditional & agile)
  • Design, implementation, and further development of automated test frameworks
  • Planning and execution of automated unit, integration, system, UAT, and E2E tests
  • Test automation for GUIs, web services, and interfaces
  • Creation and maintenance of test documentation, test cases, and test reports
  • Analysis, documentation, and tracking of defects
  • Close collaboration with international, interdisciplinary teams
  • Optimization of testing processes, methods, and tools
  • Testing AI chatbots and AI-supported systems
  • Test architectures for GenAI and MCP integrations
  • Validation of NLP/NLU components including end-to-end testing and quality assessment of AI systems

Our expectations of you

Qualifications

  • Proven experience in automating tests for conversational interfaces
  • Knowledge of testing methods for AI components (NLP/NLU validation, E2E testing, ethical assessment)
  • Very good German and good English skills
  • Testing tools such as Selenium, Cypress, Cucumber, JUnit, Appium, SoapUI, etc.
  • CI/CD & DevOps environments such as Jenkins, Git, Maven, Jira, Azure DevOps
  • Programming skills, e.g., in Java or Python
  • ISTQB certification, (e.g., Foundation Level)
  • Agile methodologies (Scrum, Kanban)

Experience

  • Several years of practical experience in testing AI chatbot solutions (e.g., Cognigy, AI or live agent systems)
  • Initial experience in designing test architectures for AI and GenAI integrations
  • Experience with Cognigy and MCP platforms
  • Experience with modern testing frameworks and monitoring solutions

What we offer

  • Exciting and challenging projects with renowned companies across the entire DACH region
  • A largely remote work with occasional on-site assignments
  • Permanent employment contract with attractive compensation, bonuses, as well as company pension scheme & capital-forming benefits
  • Flexible working hours & 30 days of vacation
  • Individual onboarding and personal, annual training budget
  • Family-oriented atmosphere, flat hierarchies, and quick decision-making processes
  • Regular team events & open corporate culture

Benefits

Work-Life-Integration

Health, fitness & fun

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Munich
    Bayern, Germany

About your employer

SPIRIT-TESTING Software & Services GmbH specializes in software quality assurance. We offer tools and services related to software testing, and through our sister company SPIRIT-ONSIDE Consulting GmbH, we have a team of experienced consultants.

Company type
Established Company
Work model
Onsite, Hybrid, Full Remote
Industry
Internet, IT, Telecommunication
  • syracom AGWiesbaden

    • Easy Apply
    • €50k – €65k
    • Hybrid
    • Onsite
    • Full Time

    Participation in security analyses and assessment of applications and IT systems. Support in the design and implementation of technical security measures (e.g., WAF, Load Balancing, Firewall, etc.). Conducting and supporting penetration tests,...

    • WAF
    • XDR
    • SIEM
    • AWS IAM
  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Full Time

    Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...

    • Java
    • Spring Boot
    • Apache Kafka
  • Tröger & Cie. AktiengesellschaftNuremberg, Regensburg, Bayreuth

    • Easy Apply
    • Hybrid
    • Onsite
    • Full Time

    Anyone who joins here not only designs software – they bring machines to life that are recognizable on real construction sites. Software Developer (m/f/d) Basic Engineering Our client is an internationally leading manufacturer of technically...

    • Ethernet
    • C
    • Git
    • Python
    • Bash
    • Linux
    • C++
    • CAN
    • J1939
    • +4
    • +5

Test Automation Engineer - Focus on AI Testing

SPIRIT-TESTING Software & Services GmbH