Data Engineer - Databricks
open systems technologiesBrooklyn, NY
About the role
Overview:
In this role, you will design and build large-scale data solutions within a cloud-enabled enterprise setting, focusing on data platforms and governance. You will work with Databricks Lakehouse and cloud databases to enable scalable, secure data pipelines that support analytics and decision-making. You will collaborate with cross-functional teams to implement modern data warehousing concepts and maintain system reliability. This is a remote opportunity at a financial firm, offering exposure to advanced data technologies and a strong emphasis on security and uptime. Responsibilities design and implement large-scale data solutions in an enterprise environment build and manage cloud databases (AWS RDS, DynamoDB, DocumentDB) and Databricks Lakehouse develop and maintain data pipelines with a focus on security, scale, uptime, and reliability apply data warehousing concepts using both traditional and modern distributed technologies perform data modeling (relational and dimensional) and ensure data governance utilize CI/CD pipelines in data engineering workflows work with ETL/ELT tools and technologies engage in Agile methodologies to deliver iterations and improvements perform UNIX server administration and general IT tasks as needed
Key requirements:
Bachelor in Computer Science 7 years designing and building large-scale enterprise solutions 3 years cloud design/build experience expertise in cloud databases (AWS RDS, DynamoDB, DocumentDB) or similar expertise in Databricks Lakehouse or similar deep SQL, data modeling, and governance in relational databases experience with data warehousing concepts (Vertica, Teradata) and distributed tech (SparkSQL, Hadoop, Kafka) scripting skills (Python, bash) data platform thinking for secure, scalable pipelines CI/CD pipeline experience knowledge of Presto, Hive, SparkSQL, Cassandra, Solr is a plus experience with Spark, Kafka, Hadoop or similar is a plus experience with Agile methodologies ETL/ELT tools experience (Talend, Informatica) is a plus Cloud Data Warehouses experience (Redshift, BigQuery) is a plus agile mindset collaboration problem-solving Databricks Lakehouse AWS RDS DynamoDB
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Brooklyn, NY
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)