Job
In this role, you will build and operate infrastructure for production-grade AI applications, automate deployments, and ensure quality and security in LLM systems and Agentic AI projects through monitoring.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- Build and operate infrastructure for production AI applications—from the development environment and CI/CD to stable operation at the customer’s site, and also:
- Put LLM and agentic AI systems into production: inference and model-serving endpoints, vector databases, RAG pipelines, MCP servers—scalable, secure, and cost-conscious.
- Own observability and quality: latency, token and infrastructure costs, agent tracing, automated evaluations and regression tests.
- Automate consistently instead of doing things manually: Infrastructure as Code, GitOps, containerized, reproducible deployments.
- Ensure security and compliance: secrets and access management, guardrails, traceability in accordance with the EU AI Act.
- Advise customers on architecture and operational decisions—as a technical sparring partner, not as an account manager.
Our expectations of you
Education
- Degree in (Business) Informatics, Data Science, AI, or a related field—or equivalent practical experience as a career changer, e.g. with completed vocational training as an IT specialist in system integration.
Qualifications
- Solid DevOps foundation: containers/Kubernetes, CI/CD, agile development environment.
- Experience with Infrastructure as Code (e.g., Terraform, Ansible, Helm, or GitOps).
- Python plus at least one other language (Go, TypeScript/JavaScript, Java, C# or Shell).
- Basic understanding of LLM systems: RAG architectures, prompting, agent frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI).
- German at C1 level, English at B2 level – confident in customer interactions and able to lead a workshop when needed.
Experience
- Several years of experience in software development and operations.
- Senior role: several years of hands-on experience designing and operating production systems.
- Cloud experience (AWS, Azure, or GCP), deployment as a container, API, or serverless.
What we offer
- Remote work is not just tolerated here—it’s an option: anywhere in Germany, hybrid, or fully remote.
Benefits
Higher take-home pay
Health, fitness & fun
Food & drink
Work-Life-Integration
Topics you will work on
Job locations
About your employer
UNITY ist die Managementberatung für Innovation und Digitale Transformation. Wir machen unsere Kunden zu Gewinnern der Digitalisierung. Wir steigern ihre Innovationskraft und ihre operative Exzellenz. UNITY vereint eine ausgeprägte Technologietiefe und die Kompetenzen, die für eine erfolgreiche Digitale Transformation erforderlich sind.
- 1-49 Employees
- Established Company
- Onsite, Hybrid
- Consulting
More jobs
These jobs might also interest you
Lead our Stuttgart IT team, both professionally and as line manager, set priorities, and support each team member's development. Ensure the secure, reliable, and efficient operation of our heterogeneous IT infrastructure, including networks, servers,...
Operation, monitoring, and further development of the network infrastructure. Administration and configuration of firewalls, routers, and switches. Ensuring network availability, performance, and security. Participation in IT security concepts and...
Area of responsibility “DRV Bund IT” is the service provider for Deutsche Rentenversicherung Bund, developing and operating a complex IT system landscape in close coordination with its customers. Our “IT4IT” domain provides IT departments across DRV...
