Staff Data Platform Engineer - Petabyte-Scale Pipelines
kindredventuresMillbrae, CA
Staff Data Platform Engineer - Petabyte-Scale Pipelines
kindredventuresMillbrae, CA
2 days ago
Industries
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related ServicesSoftware PublishersComputer Systems Design ServicesAbout the role
Kindredventures is building a Large Physics foundation Model and seeks a data engineer to design and operate the data platform for petabyte-scale storage, real-time and batch queries, and scalable ingestion.
You will own the compute and orchestration platforms (Spark, Ray, Beam), optimize data loading to training, and implement cataloging, lineage, and monitoring across the data lifecycle. Collaboration across research and engineering is essential.
Matching similar jobs
JOB OVERVIEW
Experience level
Mid
Location
Millbrae, CA
Occupation
Data Warehousing Specialists
Industry
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
Posted
2 days ago
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)