JJobsSonar

Lead Platform Engineer - Data Mesh & Governance (Python)

Billennium · Wroclaw Metropolitan Area

Data EngineeringRemote

About this role

The Lead Platform Engineer - Data Mesh & Governance (Python) will lead the design and development of backend services for enterprise Data Governance and Data Mesh platforms. This role involves creating scalable, secure, and reliable backend services, working with a cross-functional team of engineers, data architects, data scientists, and business stakeholders. Responsibilities include developing cloud-native applications on Kubernetes, building RESTful APIs with Python and FastAPI, managing deployment processes with GitOps tools, and contributing to architectural decisions for distributed systems. The role also involves driving Data Governance capabilities, collaborating with multiple teams, and providing technical leadership and mentorship.

Skills & technologies

Must have

  • Python
  • FastAPI
  • Kubernetes
  • Helm Charts
  • ArgoCD
  • Azure DevOps
  • REST APIs
  • CI/CD
  • microservices
  • event-driven systems
  • data governance
  • data mesh
  • data contracts
  • data quality
  • Backstage

Nice to have

  • Angular
  • React

Read full description

About the job Why Billennium? Billennium is a global technology company with over 20 years of experience, committed to innovation and empowering businesses. As an employer, we offer a supportive, growth-focused environment where collaboration and creativity thrive. Join us to shape the future of technology together. Role Summary: We are looking for an experienced Lead Platform Engineer - Data Mesh & Governance (Python) to join a dedicated team building the next generation of Data Governance and Data Mesh platforms. The team is responsible for developing tools and services that document and visualize data flows across modularized services and data-producing/consuming applications, enabling transparent and secure data management across a federated software architecture. In this role, you will combine hands-on software development with technical leadership, driving the design and implementation of highly scalable, secure, and reliable backend services. You will work closely with backend engineers, data architects, data engineers, data scientists, frontend developers, and business stakeholders to create innovative solutions supporting enterprise-wide Data Governance capabilities. This is an excellent opportunity for a senior technology professional who enjoys working at the intersection of cloud-native backend development, platform engineering, distributed systems architecture, and modern data management concepts. Core Responsibilities: Lead the design and development of backend services supporting enterprise Data Governance and Data Mesh initiatives. Design and implement scalable, secure, and highly available solution architectures for a distributed family of services. Develop and maintain cloud-native applications running on Kubernetes clusters (cloud-based and on-premises). Build and operate RESTful APIs using Python and FastAPI. Design, develop, and maintain internal platform services and developer platforms (e.g., Backstage). Manage deployment and operational processes using Kubernetes, Helm Charts, ArgoCD (or similar GitOps solutions), and Grafana. Develop and optimize CI/CD pipelines and deployment processes using Azure DevOps. Contribute to architectural decisions related to microservices and event-driven systems, ensuring scalability, resilience, and maintainability. Drive implementation of Data Governance capabilities, including data ownership, data quality improvements, metadata management, and technical documentation. Collaborate closely with Data Architecture, Data Engineering, Data Science, Frontend Development, and Backend Development teams. Consult project stakeholders on technical, infrastructure, and data-related topics, helping define and refine requirements. Participate in Security Guilds, Dev Guilds, and architectural reviews, ensuring compliance with security and quality standards. Prepare and maintain technical documentation for implemented solutions, including security and architecture reviews. Actively participate in Scrum ceremonies and contribute to continuous improvement of development processes. Provide technical leadership and mentorship within a backend-focused engineering team. Role Requirements: Must-have Experience & Technical Skills Proven experience in a Lead Development or Senior Technical Leadership role within a backend-focused engineering team. Extensive experience in designing and implementing distributed systems, with a strong understanding of microservices architectures and event-driven systems. At least 3 years of professional experience developing robust backend applications using Python. Practical experience in designing and developing internal developer platforms, such as Backstage or comparable platform engineering solutions. Hands-on experience with Kubernetes, including Helm Charts, and ArgoCD or similar GitOps deployment tools. Solid understanding of software engineering best practices, including design patterns, scalability principles, and CI/CD methodologies. Experience with Azure DevOps and Azure Deployment Pipelines. Experience in building and maintaining REST APIs using FastAPI or similar Python frameworks. Working knowledge of Angular and/or React, enabling effective collaboration with frontend teams. Practical experience with modern data architecture concepts, including: Data Mesh, Data Contracts, Data Quality, Data Governance. Experience working in Agile/Scrum environments. Language Requirements: English - minimum B2 German - minimum B2
Ready to apply?Apply now

Similar Data Engineering jobs

All Data Engineering jobs

Data Architect

co.brick · Gliwice, Śląskie, Poland

Data EngineeringRemoteEasy apply1mo ago

Data Architect

Haystack · London, England, United Kingdom

Data EngineeringRemoteEasy apply1mo ago