Logo BMW AG

Validation Engineer - Multi-Agent AI Systems

Job

  • Level
    Experienced
  • Job Field
    IT, DevOps, Test/QA
  • Employment Type
    Full Time
  • Contract Type
    Permanent employment
  • Location
    Munich
  • Working Model
    Onsite
  • Job Summary

    In this role, you develop AI-assisted validation strategies for an inter-domain multi-agent system, testing behavioral boundaries, utilizing cloud environments, and optimizing test architectures for autonomous vehicles.

    Job Technologies

    Your role in the team

    • We are building an inter-domain multi-agent system that spans ADAS, infotainment, and backend services for the intelligent vehicle of the future. A dedicated team designs and implements this system - your job is to prove it works. You will own the virtual validation of this multi-agent AI system in a cloud-based test environment, developing AI-assisted validation strategies that systematically explore the behavioral space of interacting agents and uncover failures that conventional testing would miss.
    • You build and operate cloud-based validation environments for a multi-agent system that operates across ADAS, infotainment, and backend-service domains - defining test architectures, scenario pipelines, behavioural oracles, and regression suites.
    • Also, you design AI-assisted exploration strategies to navigate the semantic search space of the system under test: agent-based probing of behavioural boundaries, adaptive test strategies, and optimization techniques to surface edge cases and failure modes.
    • It is your responsibility to develop coverage models and metrics for non-deterministic multi-agent systems and use them to steer test generation and assess release readiness.
    • You establish validation methodologies suited to stochastic AI behaviour: metamorphic testing, property-based testing, adversarial probing and acceptance criteria grounded in confidence intervals rather than binary pass/fail.
    • You build observability and diagnostics tooling for validation runs - distributed tracing, trajectory replay, automated failure clustering and root-cause triage - so that discovered issues can be rapidly understood and communicated to the design team.
    • Furthermore, you evaluate and select the LLMs/SLMs that power your validation agents and test-generation systems, balancing latency, cost and accuracy for large-scale test campaigns.
    • You close the feedback loop between validation findings and system improvement by structuring discovered failures, coverage gaps, and behavioural anomalies into actionable knowledge for the design and context-engineering teams.

    This text has been machine translated. Show original

    Our expectations of you

    Education

    • University degree in Computer Science, AI/ML, Systems Engineering, or a related field.

    Qualifications

    • Expert-level programming skills in at least one high-level language (C++, Java, Kotlin or Python).
    • Proficiency in AI-assisted development using coding agents such as Claude Code, GitHub Copilot, or OpenCode.
    • Understanding of agentic AI architectures, agent patterns and multi-agent interaction.
    • Ability to apply optimization, search or operational-research techniques (genetic/evolutionary algorithms, Bayesian optimisation, Monte Carlo methods) to testing or exploration problems.

    Experience

    • 3-5 years of hands-on experience in validation, verification or quality engineering for complex AI, ML or software-intensive systems.
    • Experience with automotive software quality processes (e.g., ASPICE, ISO 26262) is a plus.

    This text has been machine translated. Show original

    What we offer

    • Challenging projects with which we are shaping the mobility of tomorrow together.
    • Wide range of personal and professional development opportunities.
    • Attractive, fair and performance-related remuneration.
    • High level of job security.
    • Annual special payments such as vacation pay, Christmas bonus, and profit sharing.
    • Flexible working hours including 6 weeks annual leave and overtime compensation.
    • Discounted BMW & MINI conditions.

    This text has been machine translated. Show original

    Benefits

    Work-Life-Integration

    Health, Fitness & Fun

    Topics that you deal with on the job

    Job Locations

    • Location Munich

      Bayern

      Germany

    This is your employer

    BMW AG

    BMW AG

    Our world-leading premium automotive brands BMW, MINI, Rolls-Royce and our motorcycles, along with our comprehensive range of high-quality financial and mobility services make us a unique provider.

    Description

  • Company Type
    Established Company
  • Working Model
    Hybrid, Onsite
  • Industry
    Vehicle Manufacturing, Supplier, Industry, Production
  • Dev Reviews

    by devworkplaces.com

    Total

    (2 Reviews)
    3.1
    • Career Growth

      3.1
    • Engineering

      2.3
    • Culture

      3.1
    • Workingconditions

      4.1
    Show All Dev Reviews
    Logo BMW AG

    Validation Engineer - Multi-Agent AI Systems

    Location
    Munich
    Working Model
    Onsite
    Diversity
    Open for all genders
    English Only
    English only required

    More Jobs