Job
In this role, you will develop scalable AI architectures for B2B clients, lead interdisciplinary teams, evaluate open-source language models, and implement modern DevOps practices and security standards.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- Architecture & Solution Design: You translate B2B customer requirements into scalable AI architectures (especially for RAG chatbots) and are responsible for the design from the initial idea to rollout.
- Technical Leadership: You take over the technological steering of AI projects, advise our clients at eye level, and professionally lead interdisciplinary developer teams.
- Hands-on solution development: You actively participate in software development and bring your extensive programming experience directly into the implementation of AI applications.
- Confident AI Operation: You design the secure and data protection-compliant operation outside of hyperscalers (on-premise or Open Telekom Cloud) and are responsible for resource management.
- Model Evaluation: You continuously assess the ecosystem of open-source language models and select the appropriate models for customer use cases based on technical and economic considerations.
- DevOps & Observability: You embed modern automation and deployment practices into the project daily routine and establish comprehensive monitoring for infrastructure and model performance.
Our expectations of you
Education
- Completed degree with a focus on IT (e.g., Computer Science, Business Informatics, Data Science, Mathematics) or a comparable qualification.
Qualifications
- LLMs & RAG Architectures: Excellent knowledge in working with open-source language models, model inference (vLLM), and building Retrieval-Augmented Generation (RAG) pipelines, including integration of vector databases (e.g., Qdrant, Milvus, or pgvector).
- Kubernetes & Containerization: Extensive hands-on experience in architecture, scaling, and optimization of applications on Kubernetes clusters as well as in general container management.
- Monitoring & Observability: Expertise in establishing a comprehensive and high-performance monitoring system for both the system infrastructure (Prometheus, Grafana) and AI models (e.g., LangSmith).
Experience
- Software Development & AI Frameworks: In-depth, hands-on programming experience optionally in the Python ecosystem (including LangChain) OR in Java development (specifically with Spring AI).
- DevOps & Infrastructure Automation: Proficient in Infrastructure as Code (e.g., Terraform, Ansible) and established experience with CI/CD pipelines and GitOps approaches (particularly ArgoCD).
- Confident operation & hardware: Practical experience in GPU management and the secure deployment of applications in sovereign infrastructures (On-Premise, Bare-Metal, or Open Telekom Cloud).
What we offer
- For this position, we anticipate a gross annual salary of €60,000.00 to €85,000.00.
- The specific classification is based on objective and gender-neutral criteria, particularly professional qualifications, relevant work experience, and the scope of responsibilities associated with the role.
- People matter to us.
- We actively promote pay equity and design our compensation structures to be transparent and non-discriminatory.
- Regardless of gender, ethnicity, religion, age, sexual orientation, or disability, we embrace diversity and reject all forms of discrimination.
Benefits
Work-Life-Integration
Health, fitness & fun
Higher take-home pay
Topics you will work on
Job locations
About your employer
We are paving the way for a Gigabit society: As one of the leading companies in communications and information technology, we are shaping the digital world of tomorrow with innovative solutions for private and business customers.
- Established Company
- Onsite, Hybrid, Full Remote
- Internet, IT, Telecommunication
Employer reviews
- Working conditions
- 4.0
- Career growth
- 3.8
- Team culture
- 3.5
- Engineering
- 2.9
More jobs
These jobs might also interest you
Anyone who joins here not only designs software – they bring machines to life that are recognizable on real construction sites. Software Developer (m/f/d) Basic Engineering Our client is an internationally leading manufacturer of technically...
Operation, monitoring, and further development of the network infrastructure. Administration and configuration of firewalls, routers, and switches. Ensuring network availability, performance, and security. Participation in IT security concepts and...
Area of responsibility “DRV Bund IT” is the service provider for Deutsche Rentenversicherung Bund, developing and operating a complex IT system landscape in close coordination with its customers. Our “IT4IT” domain provides IT departments across DRV...