Senior Developer Hadoop
ace stackCharlotte, NC
Senior Developer Hadoop
APPLY NOW (opens in a new tab)About the role
Senior Developer
Location: Charlotte, NCFull Time – Permanent
Job Description
Must Have Technical/Functional Skills:
Primary Skill: Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.
Roles & Responsibilities:
- Bachelor’s or master’s degree in computer science or related field.
- Deep Expertise in PySpark, including performance tuning and optimization
- Strong python development experience in large-scale distributed environment
- Solid knowledge of Hadoop ecosystem (HDFS, Hive/Impala, YARN)
- Proven experience designing and governing enterprise, regulatory facing data platforms.
- Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solution
- Proficiency in programming languages such as Java, Scala and SQLStrong understanding of non-functional requirements and production support models
- Clear written and verbal communication skills with ability to influence across organizations
- Preferred Skills / Experience
- Financial services experience, particularly in Market Surveillance, AML, Fraud, Or Risk Technology
- Experience supporting regulatory or audit facing platforms
- Kafka and Spark Structured streaming exposure
- Familiarity with Orchestration tools(Airflow, Control-M, Oozie)
- Knowledge of data governance, lineage, and data quality controls
- Daily Responsibilities/Priorities
- Enterprise & Surveillance Architecture
- Define target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop, Spark, Pyspark and Python
- Establish standard architectural patterns for alert generation, enrichment, aggregation and reporting pipelines.
- Ensure architecture aligns with enterprise technology standards and Surveillance control expectation
- Solution Design and Delivery Support
- Translate surveillance business requirements(e.g, market misconduct detection, regulatory coverage) into scalable technical designs
- Review and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards.
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Charlotte, NC
Occupation
Software Developers
Industry
Computer Systems Design Services
Posted
11 days ago
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)