Sr. Data Engineer
omni inclusiveEl Segundo, CA
About the role
Job Title Mandatory skills - GBQ (Google BigQuery), ETL, Python Experience in Google Cloud Platform (GBQ, GCS, Kubernetes POD operator and Image creation, Composer, DAG creation) Python Programming Expert Experience in Ascend tool Create Data flow, Data service, Read and Write connection for the various sources. Failure Notification settings (Ascend Webhook notification, Scheduling in Ascend) Big query merge to perform merge Custom Read and Write connector using python framework Good understanding in Error logging Experience in Airflow (Create DAG, Configure the variables in Airflow, Scheduling) Experience in DBT to create the lineage in GCP. – Optional Worked in Dev-Sec-Ops (CI/CD) environment. Experienced with containerized execution/code containerization Interact with the platform leads and 3rd party application leads to understand and analyze the various interfaces and data integration needs to create technical user stories Contribute to the creation of technical design, estimation as applicable for the user stories and review with the EAC team and Product Owner Conduct and participate in code review sessions for the team deliverables Guides the team members and involves in development and unit testing Work with business users for UAT and assist QA team accordingly for defects fixing Help the team to troubleshoot critical issues in development, staging or prod Retail & Manufacturing Domain expertise.
Matching similar jobs
JOB OVERVIEW
Experience level
Senior
Location
El Segundo, CA
Occupation
Data Warehousing Specialists
Industry
Computer Systems Design Services
Posted
today
Tired of running searches?
Rank the roles you'd take once, and matches like these arrive on their own.
CREATE PROFILE