Machine Learning Engineer, Infra, AI for Drug Discovery
genentechBrooklyn, NY
Machine Learning Engineer, Infra, AI for Drug Discovery
genentechBrooklyn, NY
today
Occupations
Computer Systems Engineers/ArchitectsSoftware DevelopersComputer and Information Research ScientistsAbout the role
Overview:
In this role you will design and operate scalable model-serving infrastructure for ML and scientific workloads within Roche's AI4DD program. You will evolve a self-serve deployment platform used across gRED and pRED, focusing on reliability, scalability, and observability. You will implement tooling for metrics, cost, and lifecycle management, and connect publication, evaluation, deployment, and retraining workflows. You will collaborate with cross-functional teams to translate requirements into practical platform solutions and deliver incremental improvements from design to production. Compensation / Benefits discretionary annual bonus career development opportunities competitive compensation health and wellness programs retirement plans employee assistance programs
Responsibilities:
Design, implement, ship, and operate scalable model-serving infrastructure for ML, scientific, LLM, and agentic workloads Advance internal deployment platform into a reliable self-service platform for teams across the organization Improve scalability and reliability (scale-to-zero, faster startup, workload isolation, traffic management, latency reduction) Build observability and tooling for usage, latency, reliability, and cost metrics Enhance usability of deployment via validated interfaces, APIs, and documentation Unify real-time and batch inference workflows on shared platform capabilities Oversee model lifecycle infrastructure (registration, versioning, promotion, monitoring, rollback) Develop event-driven integrations linking publication, evaluation, promotion, deployment, and retraining workflows Create metrics and signals for cost, quality, reliability, and fitness for downstream workflows Collaborate with ML, data, scientific, and platform teams to remove bottlenecks and translate requirements Own workstreams from design to production support with strong software-engineering practices
Key requirements:
BS or MS in Computer Science, Engineering, or related field, or equivalent practical experience 3+ years in software/infra/platform/DevOps/MLOps or related area Strong Python programming and production software delivery experience Experience designing, deploying, or operating cloud systems (preferably AWS) with EKS, EC2, S3, IAM, SQS, SNS, CloudWatch Experience with containers, Kubernetes, Helm, and IaC tools (Terraform or Pulumi) Experience with CI/CD, Git workflows, automated testing, and software release practices Ability to troubleshoot complex systems using metrics, logs, traces, and observability tools (Datadog, Prometheus, Grafana, OpenTelemetry) Understanding of distributed-systems concepts (concurrency, queuing, timeouts, retries, idempotency, backpressure, failure recovery) Ability to gather requirements, communicate tradeoffs, and document systems for varied users Demonstrated ability to deliver practical, incremental solutions independently Collaborative mindset Strong communication of technical tradeoffs Problem-solving mindset Python production software engineering AWS cloud services (EKS, EC2, S3, IAM, SQS, SNS, CloudWatch) Kubernetes, Helm, IaC (Terraform, Pulumi)
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Brooklyn, NY
Occupation
Computer Systems Engineers/Architects
Industry
Computer Systems Design Services
Posted
today
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)