Senior AI Architect

EPAM Systems GmbH

Job

In this role, you will develop scalable AI platforms on Microsoft Azure, conduct architecture designs, and implement responsible AI practices to support enterprises.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • We're looking for a Senior AI Architect to join our team in Germany in a hybrid working mode. In this role, you will help clients design and scale production-grade AI platforms and solutions on Microsoft Azure. You will work at the intersection of enterprise architecture, cloud-native engineering, GitHub-enabled software delivery and responsible AI adoption.
  • This position focuses on shaping large-scale AI transformation programs that connect business outcomes with practical architecture design. You will engage in areas such as Azure AI platforms, copilots, RAG, agentic systems, governance, observability, evaluation, security and Responsible AI practices.
  • Unlike roles centered on proofs of concept, this opportunity involves delivering enterprise-grade AI systems embedded into real workflows, including engineering productivity, knowledge retrieval, automation and AI-enabled delivery. The challenges go beyond basic API calls and span AI-native software engineering, GitHub Copilot integration, secure architectures, FinOps and governance at scale.
  • You will collaborate with architects, engineers, Microsoft/GitHub specialists, and client leadership teams to drive secure and governed AI adoption.
  • Define target-state architectures for AI platforms, assistants, RAG systems, agents, AI gateways and AI-native engineering workflows.
  • Lead architecture discovery, maturity assessments, technical roadmaps, platform decisions, and delivery governance.
  • Design Azure-first architectures using Microsoft Foundry, Azure OpenAI, Azure AI Search, Azure API Management, AKS, Azure Functions, Application Insights, Azure Monitor, Key Vault, Microsoft Entra ID, Cosmos DB, PostgreSQL, and Microsoft Fabric where applicable.
  • Design AI-native engineering systems using GitHub Copilot, GitHub Enterprise, GitHub Advanced Security, agent-ready repositories, secure pull-request practices and AI-assisted delivery patterns.
  • Design harnesses around AI systems, including agent instructions, tool contracts, MCP integrations, retrieval grounding, evaluation suites, telemetry, cost controls, policy controls and human approval gates.
  • Define governance and operational frameworks for Responsible AI, security, identity, FinOps, and observability.
  • Translate business outcomes into target architecture, executive narratives, platform decisions and delivery governance across client leadership, architecture, engineering and security teams.
  • Facilitate workshops, hackathons, and enablement sessions focused on AI adoption, Copilot integration, and engineering excellence.
  • Convert practical experience into reusable patterns, accelerators and architectural blueprints.
  • Mentor architects and engineers and contribute to presales and solution design initiatives.

Our expectations of you

Qualifications

  • Proficiency with Microsoft Azure and modern cloud-native architecture.
  • Knowledge of GitHub workflows (CI/CD, DevOps, IaC) and secure engineering practices.
  • Track record of moving AI initiatives beyond PoC to enterprise-grade production environments.
  • Hands-on capability to validate prototypes, review code and guide engineering decisions.
  • Ability to explain how to make AI useful in production, not just impressive in a demo.
  • Capability to design platform architecture, governance models, adoption plans and AI delivery workflows.
  • Confidence working across enterprise realities, leveraging Azure and GitHub pragmatically.
  • Strong communication skills with both executives and technical stakeholders.
  • Vertrautheit mit Agenten-Frameworks wie Semantic Kernel, LangChain, LangGraph, AutoGen, LlamaIndex, CrewAI oder ähnlichen.
  • Knowledge of Microsoft 365 Copilot, Copilot Studio, Microsoft Graph, Teams, SharePoint or Power Platform integration.
  • Understanding of AI gateways, model routing, semantic caching, model abstractions, usage telemetry, and AI FinOps.
  • Background in enterprise infrastructure with Terraform/IaC, Kubernetes/AKS, CI/CD and secure API gateway practices.
  • Awareness of agent reliability and security techniques, including workflow state, recovery, tool-permission boundaries, evaluation gates, prompt-injection defense, audit trails, rollback mechanisms and human approval workflows.
  • Vertrautheit mit Compliance- und Governance-Standards wie GDPR, EU AI Act-Bereitschaft oder ISO/IEC 42001.
  • Knowledge of other AI ecosystems, including AWS Bedrock, Google Vertex AI, Databricks, Snowflake, Anthropic, OpenAI API or Hugging Face.

Experience

  • 10+ years in solution architecture, cloud platforms or platform engineering.
  • Strong experience with enterprise AI, GenAI, agentic systems, RAG and AI-native engineering.
  • Experience with GitHub Copilot Enterprise adoption, AI-native SDLC transformation, GitHub Actions, and GitHub Advanced Security.
  • Experience in regulated industries such as finance, healthcare, energy, retail, manufacturing or public sector.

What we offer

  • 30 days holiday per annum.
  • Company Pension Scheme.
  • Regular performance assessments.
  • Discount on Fitness-First Black Membership.
  • bitkom - Corporate Benefits.
  • Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements).
  • Learning and development opportunities, including in-house training and coaching, professional certifications, and courses.
  • Friendly and enjoyable working team.
  • Regular corporate and social events.
  • Flexible and remote working opportunities.
  • Award-winning workplace: Great Place To Work® certified in 2026, Kununu (Top Company 2022-2026), NewWork Business Award 2025 for outstanding culture, innovation and employee satisfaction.

Benefits

Work-Life-Integration

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Frankfurt
    Hessen, Germany

About your employer

We help our customers redefine their business through a digital lens. Our legacy in software development, combined with our strategic corporate and innovation consulting, design thinking, and physical-digital capabilities provides our customers with true business value through human-centered innovation.

Company type
Established Company
Work model
Full Remote, Hybrid, Onsite
Industry
Internet, IT, Telecommunication
  • syracom AGWiesbaden

    • Easy Apply
    • €50k – €65k
    • Hybrid
    • Onsite
    • Full Time

    Participation in security analyses and assessment of applications and IT systems. Support in the design and implementation of technical security measures (e.g., WAF, Load Balancing, Firewall, etc.). Conducting and supporting penetration tests,...

    • WAF
    • XDR
    • SIEM
    • AWS IAM
  • syracom AGWiesbaden

    • Easy Apply
    • €68k – €85k
    • Hybrid
    • Onsite
    • Full Time
    • Senior

    As a Senior Software Engineer (m/f/d), you will take on a central technical role in challenging client projects and develop sustainable, scalable software solutions in complex enterprise environments. In your role, you will primarily be responsible for:...

    • SQL
    • TypeScript
    • Kubernetes
    • OpenShift
    • NoSQL
    • React
    • Java
    • Spring
    • JavaScript
    • Angular
    • +8
  • HUK-COBURG VersicherungsgruppeCoburg

    • Hybrid
    • Onsite
    • Full Time

    Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...

    • Java
    • Spring Boot
    • Apache Kafka

Senior AI Architect

EPAM Systems GmbH