JJobsSonar

MLOps Engineer

Evlo AI · Austin, TX

Remote
About the job About The Role The role is responsible for bridging the gap between machine learning development and production systems by building and maintaining scalable, reliable MLOps infrastructure. This involves designing automated pipelines that take models from training to deployment, ensuring consistency across environments and minimal downtime. The team works closely with data scientists, ML engineers, and infrastructure architects to standardize tools, streamline model delivery, and monitor the health and performance of systems handling large-scale production inference. Key Responsibilities Design and implement automated end-to-end ML pipelines for model training, evaluation, registration, and deployment using tools like Kubeflow or MLflow Deploy, scale, and manage ML inference services on Kubernetes (EKS/GKE) using modern serving frameworks such as Triton Inference Server, Seldon Core, or TorchServe Build robust feature store integrations to serve real-time and batch features consistently across training and serving environments Develop automated monitoring, alerting, and logging systems to detect data drift, concept drift, and latency anomalies in production models Collaborate with infrastructure teams to manage GPU and CPU resource allocation, optimizing compute costs and latency for high-throughput model endpoints What We Are Looking For 3–6 years of experience in MLOps, DevOps, or Software Engineering, with a strong focus on deploying machine learning models to production Proficiency with containerization and orchestration tools, specifically Docker and Kubernetes (including Helm charts and operators) Hands-on experience with ML lifecycle management tools like MLflow, Kubeflow, Prefect, or Airflow Strong Python development skills alongside experience in managing infrastructure as code using Terraform Familiarity with cloud platforms (AWS, GCP, or Azure) and their native machine learning services Bonus: Experience with Triton Inference Server, custom CUDA optimization, or real-time feature engineering using Redis or Feast
Ready to apply?Apply now

Similar jobs

Browse all

Cloud Platform Engineer

ASE (Analysis Simulation Engineering) AG · Zurich, Zurich, Switzerland

On-siteEasy apply2w ago

DevOps Engineer

Sundayy · United States

RemoteEasy apply401(k), Medical2w ago