Senior Engineer - Data Ingestion
chicago trading companyChicago, IL
Senior Engineer - Data Ingestion
Industries
Computer Systems Design ServicesComputing Infrastructure Providers, Data Processing, Web Hosting, and Related ServicesSoftware PublishersAbout the role
Overview:
As Data Ingest Engineer at CTC, you will own the health and reliability of core data pipelines used across desks. You’ll partner with traders and quantitative researchers to understand needs and design reliable data delivery. You will optimize pipelines to improve SLA and reduce compute/storage footprint, and migrate workloads to modern platforms. You’ll collaborate across the data organization to enhance our platform and surface issues before users see them. This role offers a meaningful impact by enabling data-driven decisions across the firm. Compensation / Benefits generous time off insurance coverage paid parental leave free breakfast and lunch wellness reimbursement other employee benefits
Responsibilities:
Own data pipeline quality, reliability and health Collaborate with traders and researchers to understand data usage Design reliable and efficient data sourcing for stakeholder needs Optimize pipelines to improve SLA and reduce compute/storage Migrate pipelines to modern data platforms and support future migrations Collaborate with broader data organization to improve platform Detect and surface data quality issues to prevent downstream impact
Key requirements:
Hands-on experience building and operating large-scale data pipelines (hundreds of TB to PB) Strong software architecture and large-scale system design skills Proficiency in SQL and Python (OOP) Experience with at least one major cloud provider (AWS/Azure/GCP) and/or HPC workloads Strong interpersonal skills and teamwork ability strong interpersonal skills team-oriented collaboration communication with traders and researchers SQL Python cloud platforms (AWS/Azure/GCP)
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Chicago, IL
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)