Job
In this role, you will develop productive AI agent solutions on Databricks and Azure, implement multi-agent workflows, and ensure integration of health and safety standards into business processes.
This listing has been machine translated. Show original
Job technologies
Your role in the team
- Design, development, and operation of production-ready AI agent solutions on Databricks and Azure—from the initial prototype to scalable deployment.
- Development of AI agents and multi-agent workflows that purposefully connect large language models, enterprise data, APIs, and internal systems.
- Implementation of RAG, tool calling, and agent orchestration, as well as development of reusable tools, prompts, and state and context components.
- Integration of Azure OpenAI and other foundation models into Databricks and existing application and data landscapes.
- Development of Python-based agent services and APIs, and their integration into existing backend and cloud architectures.
- Use of Databricks Mosaic AI, Model Serving, and MLflow to version, evaluate, deploy, and monitor models and agents.
- Implementation of vector search, embeddings, and retrieval pipelines for controlled access to relevant company data.
- Orchestration of agent, data, and automation processes using Databricks Workflows and defined tool access.
- Automating deployments with GitLab CI/CD and Terraform, including reproducible environments, testing, and traceable releases.
- Development of evaluations, tracing, and monitoring for response quality, groundedness, safety, latency, cost, and reliability.
- Establishing guardrails, permission models, and human-in-the-loop processes for the responsible use of AI agents.
- Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and logging.
- Close collaboration with the Product Owner, business units, Data, Backend, and Cloud teams, as well as Security and Privacy teams, on production agent use cases.
- Documentation of agent logic, tool interfaces, data flows, architecture, evaluation procedures, and runbooks for sustainable operations.
Our expectations of you
Qualifications
- Very good knowledge of Python, as well as API integration, automated testing, code reviews, and modular software development.
- Good knowledge of the Microsoft Azure platform, particularly Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking.
- Solid understanding of LLMOps, agent evaluation, and observability, including systematic quality checks.
- Knowledge of AI security, data protection and governance, secure model access, guardrails, and the protection of sensitive information.
- Ability to deploy AI agents in production reliably and at scale, and to translate business requirements into robust solutions.
Experience
- Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role.
- Practical experience with LLM applications and AI agents, ideally with RAG, agent orchestration, tool calling, and production deployment.
- Extensive experience with Databricks, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog.
- Experience with agent and LLM frameworks such as LangGraph, LangChain, or Semantic Kernel, and with stateful workflows.
- Hands-on experience with GitLab CI/CD for testing, version control, and automated deployment of AI applications.
- Hands-on experience with Terraform (Infrastructure as Code) for provisioning Azure and Databricks resources.
What we offer
- Term: Immediately until December 31, 2027 (extension possible).
- Location: Cologne, one to two days per week in the office, otherwise remote; by agreement, up to 50% remote work is possible.
- Engagement as a freelancer or as a permanent employee of the provider.
Topics you will work on
Job locations
About your employer
Als zuverlässiger Premium-Dienstleister mit der Erfahrung aus über zehn Jahren Softwareentwicklung und der Zusammenarbeit mit nennenswerten Großkunden sind wir prädestiniert für langfristige Partnerschaften und dem Lösen komplexer Problemstellungen.
- Established Company
- Onsite, Hybrid, Full Remote
- Internet, IT, Telecommunication
More jobs
These jobs might also interest you
sino AG, based in downtown Düsseldorf, has been an innovative financial service provider for over 25 years. We specialize in the execution of securities transactions for the most active and demanding traders in Germany. With currently 26 employees, we...
Hello, let's say WE! We - the HUK-COBURG Insurance Group - are among the top 10 in Germany. Founded over 90 years ago, we are now the leading insurer for private households with over 13 million customers and the largest German auto insurer. Our...
As a Senior Software Engineer (m/f/d), you will take on a central technical role in challenging client projects and develop sustainable, scalable software solutions in complex enterprise environments. In your role, you will primarily be responsible for:...