Level
Experienced
Location
Stuttgart
Working Model
Hybrid, Onsite
Job Field
IT, DevOps, Back End
Employment Type
Full Time
Contract Type
Permanent employment

Job Summary

In this role, you design and optimize LLMOps pipelines and cloud AI service integrations while implementing inference optimizations and overseeing AI FinOps for cost control.

Job Technologies

Your role in the team

LLMOps Infrastructure: You design and operate robust pipelines for the deployment, monitoring, and tracing of LLMs (e.g., with LangSmith or Arize Phoenix).
Inference Optimization: You optimize the performance and latency of models in production through techniques such as quantization.
Enterprise Cloud Integration: You seamlessly connect cloud AI services (such as Azure OpenAI Service or AWS Bedrock) to existing enterprise infrastructures.
AI FinOps: You monitor and optimize token consumption and cloud infrastructure costs (Cost Optimization).
Automation: You write "Infrastructure as Code" (e.g., via Terraform) to set up AI environments automatically and reproducibly.
Interface Bridge: You are the link between AI software developers and traditional IT operations

This text has been machine translated. Show original

Our expectations of you

Education

German (very good) and English (good) as well as a completed IT degree or a

Qualifications

Excellent knowledge
Design, development, and operation of LLMOps pipelines (e.g., deployment, monitoring, evaluation, and tracing with LangSmith or Arize Phoenix).
Cloud platforms (Azure, AWS, or GCP) and their specific AI services (e.g., Azure OpenAI Service, AWS Bedrock).
DevOps tools for container orchestration (Docker, Kubernetes) and designing CI/CD pipelines.
Solid knowledge
Infrastructure as Code (IaC) with tools like Terraform.
Concepts for inference optimization (quantization, caching) and cost control (AI FinOps).
Security and compliance standards in handling corporate data in cloud environments.
Systemic thinking: You always keep an eye on the system stability, scalability, and cost efficiency of infrastructures.
Communication skills: You act confidently and clearly as a link between AI software development and the IT operations of our clients.

This text has been machine translated. Show original

What we offer

You can work in a role-based company #NoHierarchyBehavior.
You will find open corporate communication and short decision-making paths with us.
An extensive and tailored onboarding program is ready to ensure your optimal start at BCM.
Colleagues at eye level and our HR development support you in advancing both professionally and personally to the next level.
You work predominantly remotely and enjoy maximum flexibility.
Depending on the project, you are ready to support our clients remotely or on-site.
Unforgettable employee events: monthly team activities and a BCM vacation in summer.
BCM strengthens your balance, whether work or life, we are always behind you.
Casual or suit? Office or home office? Early bird or night owl? You decide, with us you have the freedom to work in the way that suits you best.
You kick off the weekend with our BCM Community with a (hoppy) refreshing drink.