Data Architect
kaavScottsdale, AZ
Data Architect
kaavScottsdale, AZ
6 days ago
Industries
Computer Systems Design ServicesComputing Infrastructure Providers, Data Processing, Web Hosting, and Related ServicesCustom Computer Programming ServicesAbout the role
Job TitleMandatory RequirementsMust have minimum 7-10 years of hands-on experience on building data ingestion highly robust and scalable pipelines using AWS native services Cloud Formation AWS Glue Crawlers Catalog Step Functions Event Bridge Lambda S3 SNS Kinesis other data related servicesMust be proficient in Python JavaMust be proficient with SQL and HQLMust have handled structured and unstructured data ingestion from different file formats TXT CSV JSON XML Parquet etcMust have handled data streaming from Kafka topics using Apache Flink etcMust have prior experience with open table formats like Apache Iceberg Hudi etcMust have exposure to Cloudera data lake environment should have exposure to Snowflake environmentMust be proficient with Github versioning activitiesPrior experience on CICD using Jenkins would be an added advantageShould be able to envision the ingestion end to end while keeping up with all the data privacy lineage the cost optimization requirementsMust possess clear written verbal communication skills along with interpersonal skill to collaborate with the team is very importantShould be willing to coordinate own the delivery with the team located in IndiaMust have a positive attitude should be open for discussions stay hungry to learn try out something newMust have prior hands-on working experience in Cloudera Hadoop implementation Should be able to reverse engineer the current processes running on itPrior Apache Flink experience would be idealSkillsMandatory Skills : AWS Cloud Architecture, AWS Well Architected Tools, Cloud Architecture, Cloud Solution Architecture, Enterprise Cloud ArchitectureRequired Skills : AWS CloudWatchBasic Qualification :Additional Skills :Background Check : NoDrug Screen : No
Matching similar jobs
JOB OVERVIEW
Experience level
Lead
Location
Scottsdale, AZ
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
6 days ago
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE (opens in a new tab)