
Senior Platform Engineer
Metaphor Services · Mexico
Remote
About the job
Job Summary
We are looking for a hands-on Data Architect with strong expertise in Azure and Databricks to design, build, and optimize enterprise data platforms. The ideal candidate should have an architecture mindset while remaining actively involved in coding, data engineering, and platform implementation.
Required Skills8+ years of Data Engineering or Data Architecture experience
Strong expertise in Azure Data Services and Databricks
Hands-on experience with Apache Spark, PySpark, and/or Scala
Strong programming skills in Python
Advanced SQL and query optimization
Experience with Delta Lake, Unity Catalog, and Lakehouse architecture
Experience building batch and streaming data pipelines
Knowledge of Terraform, CI/CD, and Infrastructure as Code
Understanding of data governance, security, and best practices
Key ResponsibilitiesDesign and build scalable data platforms on Azure and Databricks.
Develop production-grade data pipelines using PySpark and Spark.
Implement Lakehouse architectures using Delta Lake.
Optimize Spark jobs, clusters, and data processing performance.
Build streaming and batch data solutions.
Implement data governance using Unity Catalog and Azure services.
Collaborate with engineering teams to deliver scalable data products.
Participate in architecture reviews, code reviews, and technical mentoring.
Preferred SkillsAzure Data Factory, Synapse Analytics, Event Hubs, and Purview
Kafka and Structured Streaming
Azure Solutions Architect or Databricks Certification
MLOps and cloud migration experience
Experience with AWS or GCP
Ready to apply?Apply now