JJobsSonar

Senior AI Architect

Trust In SODA · Zurich, Switzerland

AI/MLOn-site

About this role

The Senior AI Architect will define and own the enterprise AI architecture across the firm, setting the technical direction for LLM and agent-based systems. They will establish standards and guardrails for safe, secure, scalable, and auditable AI platforms in a regulated environment. Responsibilities include designing LLM, RAG, and agent-based systems, defining governance frameworks for AI agents, leading architecture reviews, and producing reference implementations. They will also collaborate with Security, Risk, and Compliance teams to ensure AI solutions meet regulatory requirements. The role involves overseeing containerized deployments on OpenShift and Kubernetes, maintaining analytics tooling like Power BI and Tableau, and leading the AI Developer Guild to raise engineering standards across the organization.

Skills & technologies

Must have

  • Azure AI Foundry
  • Copilot Studio
  • Power Platform
  • Power Automate
  • Python
  • OpenShift
  • Kubernetes
  • Terraform
  • CI/CD
  • Observability
  • Secure Cloud-Native Architecture
  • MLOps
  • Prompt Management
  • Drift Detection
  • Auditability
  • RAG Architecture
  • Private Link
  • AI Governance
  • Agent Monitoring
  • Data Exposure Prevention

Nice to have

  • German
  • FINMA Awareness

Read full description

About the job Senior AI Architect 🟣 Hiring | Senior AI Architect | Zurich | Leading Private Bank The Role This is an enterprise AI architecture leadership role with a strong governance remit. You'll define and own the AI architecture across the firm — setting the technical direction for LLM and agent-based systems, establishing the standards and guardrails that make them work safely in a regulated environment, and ensuring the platforms that support them are secure, scalable and auditable. You'll work closely with Security, Risk, Compliance, Legal and IT. You'll lead architecture and design reviews, mentor senior engineers, and run the AI Developer Guild to raise engineering standards firm-wide. You'll also engage directly with the Microsoft product team on roadmap discussions. This is not a hands-on build role day-to-day — but you must have done the hands-on work to credibly lead it. What You'll Be Doing Own and continuously evolve the enterprise AI architecture across the firm Design LLM, RAG and agent-based AI systems — with a clear understanding of Private Link network constraints and their impact on RAG architecture Define and implement governance frameworks for AI agents — including agent monitoring, cataloguing and prevention of private data exposure Lead architecture and design reviews; produce reference implementations where needed Establish best practices across Azure AI Foundry, Copilot Studio and Power Platform Work across low-code and pro-code lifecycles — Power Platform, Power Automate and pro-code Python development Oversee containerised deployment patterns — OpenShift and Kubernetes Collaborate with Security, Risk and Compliance to ensure all AI solutions meet regulatory and model-risk requirements Maintain oversight of analytics tooling — Power BI and on-prem Tableau Lead the AI Developer Guild and raise engineering capability across the organisation Manage senior stakeholders and own elements of project and process governance What We're Looking For 8+ years in software engineering; several in architecture or technical leadership Delivered production-grade LLM solutions — not just designed them Deep hands-on experience across Azure AI Stack — Azure AI Foundry and Copilot Studio are non-negotiable Strong RAG architecture experience — including understanding of networking constraints such as Private Link Proven AI governance experience — agent monitoring, cataloguing, data exposure prevention MLOps and AI platform engineering — model lifecycle, prompt management, drift detection, auditability Containerisation — OpenShift and/or Kubernetes IaC — Terraform CI/CD, observability and secure cloud-native architecture on Azure Experience working in regulated enterprise environments — FINMA awareness a strong advantage Power BI and on-prem Tableau familiarity Strong stakeholder management and communication — you can present complex technical topics to non-technical audiences Python as your primary language 📍 Zurich 🏦 Regulated banking FINMA-aware candidates an advantage 🗣️ English essential | German a strong plus Interested or know someone who is? Drop me a message. #AIArchitect #LLM #RAG #AgenticAI #Python #Azure #MLOps #Kubernetes #Zurich #Switzerland #AIHiring #BankingTech #FinTech #DataEngineering
Ready to apply?Apply now

Similar AI/ML jobs

All AI/ML jobs