As an IT service provider, we’re driving the digital transformation of the public sector and creating real added value for millions of people in Germany. We’re really good at a lot of things—but not everything yet. That’s why we’re always looking for new colleagues who want to make a difference with their ideas, skills, and dedication. Does this sound like you? Then help shape a better world and become part of our Customer Cluster Environment, Transportation & Energy.
As an AI Solution Architect (m/f/d), you’ll design the overall AI/ML architecture for complex enterprise environments on Azure. You combine in-depth expertise in ML engineering, RAG architectures, and MLOps with a strong understanding of governance, compliance, and technical leadership. In this role, you’ll help ensure that AI solutions are production-ready, scalable, and compliant with regulations.
Your Responsibilities:
Design and further develop the overall AI/ML architecture on Azure as an enterprise AI platform
Technical leadership of ML pipeline projects, particularly in the areas of training, deployment, monitoring, and drift detection, as well as the design and optimization of RAG architectures—for example, regarding chunking, retrieval, guardrails, and context orchestration
Defining MLOps strategies, including CI/CD for models, experiment tracking, and the model registry
Providing technical leadership and coordinating an interdisciplinary team of ML/AI engineers, LLM engineers, and MLOps engineers
Providing advice on AI governance, Responsible AI, and EU AI Act compliance, as well as stakeholder management through architecture presentations to IT leadership and business units
Extensive experience with Azure-based AI/ML solutions, particularly Azure Machine Learning and Azure OpenAI Service; knowledge of other Azure AI services is a plus. Additionally, you have hands-on experience with MLOps concepts and related tools, such as MLflow, Kubeflow, or Azure ML Pipelines.
Experience building RAG architectures, in prompt engineering, and working with vector databases, as well as knowledge of integrating language models via APIs. Experience with orchestration frameworks such as LangChain or LlamaIndex is a plus.
Experience with CI/CD for ML applications and a solid command of Python. Hands-on experience with at least two common machine learning frameworks, such as scikit-learn, PyTorch, or TensorFlow.
Experience building enterprise architectures in cloud environments. Knowledge of related areas such as data platforms, containerization, container orchestration, Infrastructure as Code, and observability is a plus, for example, with Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, or Application Insights.
Understanding of governance, security, and compliance requirements in regulated environments. Knowledge of relevant standards and regulations such as ISO 27001, NIS2, BSI guidelines, or the EU AI Act, as well as corresponding governance tools, is a plus.
Several years of experience with ML/AI architectures or comparable technical tasks in enterprise environments.
Experience in a technical leadership or architecture role is desirable; relevant Azure certifications are a plus.
Ideally, experience in the energy or utilities sector, with predictive maintenance, time-series analysis, or public procurement procedures such as VgV and EVB-IT.
Excellent German language skills (native-level) and good English language skills
What matters to us? Clearly defined roles, genuine collaboration, and a shared goal. We call this “Responsiveness”—transparent, respectful, and goal-oriented.
Here, you’ll be directly involved in driving change—if you choose to be. – Take part in projects that help us grow as a company.
Flexible hours and remote work? – They’re a given.
Personal hardware budget? – Set up your workspace however you feel most comfortable.
Mental health? – Your mental well-being is important to us. With OpenUp, we support you and offer you free access to professional psychological support at any time.
Personal training budget? – Whether it’s your next certification or a long-awaited language course—you decide what to learn and when.
Employee PC program? – Simply lease your next device for purely personal use through virtual7.
JobRad or company car? – We’ll help you stay as mobile as you need to be.
Requirements
Tell me who you are and when you can start. Feel free to reach out via . I look forward to getting to know you.
Laura Korth
Senior HR Recruiter
+49 170 3600221
Highlights
As an AI Solution Architect (m/f/d), you’ll design the overall AI/ML architecture for complex enterprise environments on Azure.
virtual7 GmbH is an IT service provider specializing in driving digital transformation for the public sector in Germany. The company creates added value for millions of people by delivering enterprise-scale solutions, particularly in AI/ML architectures on Azure. They serve the Customer Cluster Environment, Transportation & Energy sectors with advanced technical capabilities including cloud platforms, data solutions, and AI governance implementations. The company focuses on production-ready, scalable, and compliant solutions for regulated enterprise environments.
