AI & DevOps Architect

Deutsche Telekom AG

Job

In this role, you will develop scalable AI architectures for B2B clients, lead interdisciplinary teams, evaluate open-source language models, and implement modern DevOps practices and security standards.

Job summary

This listing has been machine translated. Show original

Job technologies

Your role in the team

  • Architecture & Solution Design: You translate B2B customer requirements into scalable AI architectures (especially for RAG chatbots) and are responsible for the design from the initial idea to rollout.
  • Technical Leadership: You take over the technological steering of AI projects, advise our clients at eye level, and professionally lead interdisciplinary developer teams.
  • Hands-on solution development: You actively participate in software development and bring your extensive programming experience directly into the implementation of AI applications.
  • Confident AI Operation: You design the secure and data protection-compliant operation outside of hyperscalers (on-premise or Open Telekom Cloud) and are responsible for resource management.
  • Model Evaluation: You continuously assess the ecosystem of open-source language models and select the appropriate models for customer use cases based on technical and economic considerations.
  • DevOps & Observability: You embed modern automation and deployment practices into the project daily routine and establish comprehensive monitoring for infrastructure and model performance.

Our expectations of you

Education

  • Completed degree with a focus on IT (e.g., Computer Science, Business Informatics, Data Science, Mathematics) or a comparable qualification.

Qualifications

  • LLMs & RAG Architectures: Excellent knowledge in working with open-source language models, model inference (vLLM), and building Retrieval-Augmented Generation (RAG) pipelines, including integration of vector databases (e.g., Qdrant, Milvus, or pgvector).
  • Kubernetes & Containerization: Extensive hands-on experience in architecture, scaling, and optimization of applications on Kubernetes clusters as well as in general container management.
  • Monitoring & Observability: Expertise in establishing a comprehensive and high-performance monitoring system for both the system infrastructure (Prometheus, Grafana) and AI models (e.g., LangSmith).

Experience

  • Software Development & AI Frameworks: In-depth, hands-on programming experience optionally in the Python ecosystem (including LangChain) OR in Java development (specifically with Spring AI).
  • DevOps & Infrastructure Automation: Proficient in Infrastructure as Code (e.g., Terraform, Ansible) and established experience with CI/CD pipelines and GitOps approaches (particularly ArgoCD).
  • Confident operation & hardware: Practical experience in GPU management and the secure deployment of applications in sovereign infrastructures (On-Premise, Bare-Metal, or Open Telekom Cloud).

What we offer

  • For this position, we anticipate a gross annual salary of €60,000.00 to €85,000.00.
  • The specific classification is based on objective and gender-neutral criteria, particularly professional qualifications, relevant work experience, and the scope of responsibilities associated with the role.
  • People matter to us.
  • We actively promote pay equity and design our compensation structures to be transparent and non-discriminatory.
  • Regardless of gender, ethnicity, religion, age, sexual orientation, or disability, we embrace diversity and reject all forms of discrimination.

Benefits

Topics you will work on

Job locations

Map of the job locations
© OpenMapTiles, © OpenStreetMap contributors
  • Location Munich
    Bayern, Germany
  • Location Dresden
    Sachsen, Germany
  • Location Leipzig
    Sachsen, Germany
  • Location Berlin
    Germany
  • Location Rostock
    Mecklenburg-Vorpommern, Germany

About your employer

We are paving the way for a Gigabit society: As one of the leading companies in communications and information technology, we are shaping the digital world of tomorrow with innovative solutions for private and business customers.

Company type
Established Company
Work model
Onsite, Hybrid, Full Remote
Industry
Internet, IT, Telecommunication

Employer reviews

3.5Total(1 review)
Working conditions
x
4.0
Career growth
x
3.8
Team culture
x
3.5
Engineering
x
2.9
  • Tröger & Cie. AktiengesellschaftNuremberg, Regensburg, Bayreuth

    • Easy Apply
    • Hybrid
    • Onsite
    • Full Time

    Anyone who joins here not only designs software – they bring machines to life that are recognizable on real construction sites. Software Developer (m/f/d) Basic Engineering Our client is an internationally leading manufacturer of technically...

    • Ethernet
    • C
    • Git
    • Python
    • Bash
    • Linux
    • C++
    • CAN
    • J1939
    • +4
    • +5
  • Öko-Institut Consult gGmbHFreiburg im Breisgau, Berlin

    • Easy Apply
    • Hybrid
    • Onsite
    • Part Time/Full Time

    Operation, monitoring, and further development of the network infrastructure. Administration and configuration of firewalls, routers, and switches. Ensuring network availability, performance, and security. Participation in IT security concepts and...

    • TCP/IP
    • Active Directory
    • Windows
    • Microsoft Exchange
    • Office 365
    • Linux
    • VLAN
    • +4
  • Die Deutsche RentenversicherungBerlin

    • Hybrid
    • Onsite
    • Part Time/Full Time

    Area of responsibility “DRV Bund IT” is the service provider for Deutsche Rentenversicherung Bund, developing and operating a complex IT system landscape in close coordination with its customers. Our “IT4IT” domain provides IT departments across DRV...

    • Docker
    • GitLab
    • Jenkins
    • OpenShift
    • Grafana
    • PostgreSQL
    • ArgoCD
    • +2
    • +4

AI & DevOps Architect

Deutsche Telekom AG