Job
- Level
- Experienced
- Job Field
- IT, Data, System
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Munich
- Working Model
- Onsite
Job Summary
In this role, you will build LLM platforms and on-prem GPU clusters, monitor performance, and scale hybrid architectures while collaborating closely with data scientists and developers for optimal AI solutions.
Job Technologies
Your role in the team
- Development, operation, and scaling of LLM platforms and on-prem GPU clusters for LLM workloads (NVIDIA).
- Monitoring of token throughput, latencies, GPU utilization, and costs.
- Development of hybrid architectures (cloud + on-premises).
- Implementation of compliance, data protection, and AI governance requirements.
- Close collaboration with Data Scientists, AI developers, and business units.
- Consulting on model selection, architecture decisions, and deployment scenarios, as well as evaluating new LLM technologies and frameworks.
This text has been machine translated. Show original
Our expectations of you
Education
- Completed degree in Computer Science, Data Science, or a comparable qualification.
Qualifications
- Very good knowledge of Infrastructure as Code (Terraform, Bicep, or similar), containerization technologies, and Linux administration.
- A good understanding of RAG architectures, vector databases, and prompting strategies is advantageous.
- Very good German skills (at least C1 level) and good English skills (at least C1 level).
Experience
- Experience with at least one cloud platform (Azure, AWS, or GCP), ideally with Managed AI Services or GPU instances.
- Experience with LLM inference stacks (e.g., vLLM, TGI, Triton Inference Server, Ray) and/or knowledge of LLMOps / MLOps (e.g., MLflow, Kubeflow, Hugging Face, Weights & Biases) are desirable.
This text has been machine translated. Show original
What we offer
- Working in the heart of Munich at Max-Weber-Platz with excellent accessibility by public transport such as subway, S-Bahn, or tram.
- Company pension scheme through the Versorgungskasse des Bundes und der Länder (VBL).
- Self-fulfillment through a diverse and technically challenging activity with interdisciplinary collaboration across various departments of TUM Klinikum Rechts der Isar.
This text has been machine translated. Show original
Benefits
Health, Fitness & Fun
Topics that you deal with on the job
Job Locations
This is your employer
TUM Klinikum Rechts der Isar
The TUM Klinikum Rechts der Isar in Munich is a respected university hospital that treats numerous inpatient and outpatient patients each year. With over 6,600 employees and a broad infrastructure of clinics and interdisciplinary centers, it ensures comprehensive medical care and is actively involved in research and teaching. As a public institution, it collaborates closely with the Technical University of Munich.
Description
- Company Type
- Established Company
- Working Model
- Hybrid, Onsite
- Industry
- Healthcare, Social Sector
IT staff - AI in IT
- Location
- Munich
- Working Model
- Onsite
- Diversity
- Open for all genders
