JJobsSonar

Generative AI Systems Architect

EPAM Systems · Poland

AI/MLRemote

About this role

EPAM is hiring a Generative AI Platforms Architect to lead and define the architecture for its enterprise GenAI platform, creating reference architectures, guardrails, and roadmaps for scalable, secure AI solutions including LLMs, agentic applications, and tool integrations across multiple clouds. The architect defines multi-cloud platform foundations for networking, identity, and secrets management, leads LLMOps/ModelOps efforts covering model evaluation, safety, observability, and rollout strategies, and creates governance frameworks for agentic systems including tool governance and the Model Context Protocol. They ensure compliance with security, risk, and Responsible AI standards, establish cost-efficiency strategies using FinOps, and improve developer experience through CI/CD, golden paths, templates, and IaC. Requirements include cloud platform knowledge (Azure, AWS, GCP), IaC tools, containerization, CI/CD for ML/LLM workloads, and understanding of LLM platforms such as Azure OpenAI, AWS Bedrock, or Vertex AI; the role is remote within Poland.

Skills & technologies

Must have

  • Azure
  • AWS
  • GCP
  • Terraform
  • Docker
  • Kubernetes
  • LLMOps
  • CI/CD
  • Azure OpenAI
  • AWS Bedrock
  • Vertex AI

Read full description

About the job We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform. The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions — including LLMs, agentic applications, and tool integrations — across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps. Responsibilities Design enterprise generative AI reference architectures, blueprints, and reusable patterns Define multi-cloud platform foundations addressing networking, identity, and secrets management Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP) Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques Collaborate with cross-functional teams to align system requirements with strategic objectives Requirements Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience 1+ years in architecture roles involving cloud, data, or production Generative AI/LLM systems Knowledge of cloud platforms (Azure, AWS, GCP) and IaC tools (Terraform, Bicep, CDK, CloudFormation) Competency in containerization and orchestration technologies (Docker, Kubernetes), as well as API gateways/service meshes Proficiency in CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps) Understanding of Large Language Model (LLM) platforms like Azure AI Foundry, Azure OpenAI, AWS Bedrock, or Google Vertex AI Familiarity with security-by-design principles and compliance frameworks tailored to GenAI systems Advanced proficiency in English (B2+/C1) We offer We gather like-minded people: Engineering community of industry professionals Friendly team and enjoyable working environment Flexible schedule and opportunity to work remotely within Poland Chance to work abroad for up to 60 days annually Business-driven relocation opportunities We provide growth opportunities: Outstanding career roadmap Leadership development, career advising, soft skills, and well-being programs Certification (GCP, Azure, AWS) Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru English classes We cover it all: Stable income (Employment Contract or B2B) Participation in the Employee Stock Purchase Plan Benefits package (health insurance, multisport, shopping vouchers) Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more Referral bonuses Corporate, social and well-being events Please, note: The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview. We will reach out to selected candidates exclusively. EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Ready to apply?Apply now

Similar AI/ML jobs

All AI/ML jobs