Search Jobs

ML Infrastructure Engineer

Pleasanton, CA 94016

Posted: 03/10/2025 Employment Type: Direct Hire Job Category: Software Engineer Job Number: 24470 Workplace Type: Hybrid

Job Description

Your mission & key responsibilities
Your mission will be to design and implement a robust, scalable, and efficient ML infrastructure for training, deploying, and monitoring models in production:

  • Build and optimize automated ML training pipelines (MLflow, Dagster)

  • Improve scalability and performance (multi-GPU, caching, distributed architectures)

  • Deploy and optimize real-time inference systems to ensure sub-20ms latency at scale

  • Implement monitoring and observability for models (Prometheus, Grafana, Evidently AI)

  • Optimize cloud costs and resource management (AWS Spot Instances, auto-scaling Kubernetes, FinOps)

 
We’d love to work with you if

  • You have 6+ years of experience in relevant technical roles (Software Engineering, Data Engineering, ML Ops, or Infrastructure), with a strong foundation to build and scale ML infrastructure

  • You have strong coding skills in Python, CI/CD, and Infrastructure as Code (Terraform, Ansible)

  • You have deep expertise in ML Infrastructure: training orchestration (Dagster, Airflow), feature stores, live model monitoring, and distributed/multi-GPU training (TensorFlow, PyTorch)

  • You have extensive cloud & scalability experience: deploying ML models on AWS/GCP, optimizing real-time inference, handling large-scale data pipelines, and implementing cost-efficient FinOps strategies

Compensation: $220k
We look forward to reviewing your application. We encourage everyone to apply - even if every box isn’t checked for what you are looking for or what is required.

PDSINC, LLC is an Equal Opportunity Employer.

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

About Pleasanton, CA

Ready to embark on a fulfilling career journey in the vibrant region of Pleasanton, California? This picturesque city nestled in Alameda County offers a unique blend of suburban charm and exceptional growth opportunities for job seekers. Known for its charming downtown area with historic buildings, Pleasanton boasts a thriving arts scene with galleries like Firehouse Arts Center and Bankhead Theater. Indulge in the region's diverse cuisine, explore the scenic trails of Shadow Cliffs Regional Recreation Area, and catch a game of the Oakland Athletics at the nearby RingCentral Coliseum. Embrace the enchanting culture and endless possibilities that Pleasanton has to offer as you explore our curated job listings to find your perfect match. Let's kickstart your career journey in Pleasanton, CA today!