Job
In this role, you design and optimize LLMOps pipelines and cloud AI service integrations while implementing inference optimizations and overseeing AI FinOps for cost control.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- LLMOps Infrastructure: You design and operate robust pipelines for the deployment, monitoring, and tracing of LLMs (e.g., with LangSmith or Arize Phoenix).
- Inference Optimization: You optimize the performance and latency of models in production through techniques such as quantization.
- Enterprise Cloud Integration: You seamlessly connect cloud AI services (such as Azure OpenAI Service or AWS Bedrock) to existing enterprise infrastructures.
- AI FinOps: You monitor and optimize token consumption and cloud infrastructure costs (Cost Optimization).
- Automation: You write "Infrastructure as Code" (e.g., via Terraform) to set up AI environments automatically and reproducibly.
- Interface Bridge: You are the link between AI software developers and traditional IT operations
Our expectations of you
Education
- German (very good) and English (good) as well as a completed IT degree or a
Qualifications
- Excellent knowledge
- Design, development, and operation of LLMOps pipelines (e.g., deployment, monitoring, evaluation, and tracing with LangSmith or Arize Phoenix).
- Cloud platforms (Azure, AWS, or GCP) and their specific AI services (e.g., Azure OpenAI Service, AWS Bedrock).
- DevOps tools for container orchestration (Docker, Kubernetes) and designing CI/CD pipelines.
- Solid knowledge
- Infrastructure as Code (IaC) with tools like Terraform.
- Concepts for inference optimization (quantization, caching) and cost control (AI FinOps).
- Security and compliance standards in handling corporate data in cloud environments.
- Systemic thinking: You always keep an eye on the system stability, scalability, and cost efficiency of infrastructures.
- Communication skills: You act confidently and clearly as a link between AI software development and the IT operations of our clients.
What we offer
- You can work in a role-based company #NoHierarchyBehavior.
- You will find open corporate communication and short decision-making paths with us.
- An extensive and tailored onboarding program is ready to ensure your optimal start at BCM.
- Colleagues at eye level and our HR development support you in advancing both professionally and personally to the next level.
- You work predominantly remotely and enjoy maximum flexibility.
- Depending on the project, you are ready to support our clients remotely or on-site.
- Unforgettable employee events: monthly team activities and a BCM vacation in summer.
- BCM strengthens your balance, whether work or life, we are always behind you.
- Casual or suit? Office or home office? Early bird or night owl? You decide, with us you have the freedom to work in the way that suits you best.
- You kick off the weekend with our BCM Community with a (hoppy) refreshing drink.
Benefits
Work-Life-Integration
Food & drink
Health, fitness & fun
Topics you will work on
Job locations
About your employer
BCM Solutions GmbH stands for high-quality software solutions and services in the field of software development.
- Digital Agency
- Onsite, Hybrid, Full Remote
- Internet, IT, Telecommunication
Employer reviews
- Engineering
- 3.3
- Working conditions
- 4.1
- Team culture
- 4.1
- Career growth
- 4.3
More jobs
These jobs might also interest you
Operation, monitoring, and further development of the network infrastructure. Administration and configuration of firewalls, routers, and switches. Ensuring network availability, performance, and security. Participation in IT security concepts and...
sino AG, based in downtown Düsseldorf, has been an innovative financial service provider for over 25 years. We specialize in the execution of securities transactions for the most active and demanding traders in Germany. With currently 26 employees, we...
As a Senior Software Engineer (m/f/d), you will take on a central technical role in challenging client projects and develop sustainable, scalable software solutions in complex enterprise environments. In your role, you will primarily be responsible for:...