Skip to main content

About the role

Role Overview: We’re looking for a senior, hands-on Databricks Integration Lead to oversee the integration architecture for a large-scale migration from Veeva CRM to Vault CRM. The project involves five Veeva CRM environments and 46 unique integration points that need to be analyzed, streamlined, and optimized before transitioning to the new platform. This individual will be responsible for setting technical direction, making key architectural decisions, and leading a team of Databricks engineers, including offshore resources. Deep, recent, hands-on Databricks experience is the top priority, as this role requires someone who can actively design, build, and implement integrations rather than solely oversee the work.The position is fully remote, but candidates must be willing and able to travel to Indianapolis approximately 2 to 4 times per year.Key Responsibilities
  • Own end-to-end integration architecture across Databricks, 5 Veeva CRM orgs, Vault CRM, and connected systems
  • Catalog and analyze all 46 integration points; consolidate, retire, or standardize rather than lift-and-shift
  • Define standards: medallion architecture, Delta Lake, Unity Catalog governance, workflow orchestration, CI/CD
  • Design coexistence patterns while Veeva CRM and Vault CRM run in parallel
  • Define Veeva-to-Vault data mapping (accounts, HCP/HCO, calls, samples, consents, territories)
  • Review designs, notebooks, and pipelines; act as technical escalation point for the team
  • Establish validation/reconciliation frameworks and support GxP, privacy, and audit requirements
  • Own technical cutover plan, rollback strategy, and monitoring/operational support modelRequired Qualifications
  • 10+ years in data integration/architecture; 5+ years deep, hands-on Databricks in enterprise production
  • Expert in PySpark/Spark SQL, Delta Lake, Workflows/Jobs, Delta Live Tables, Auto Loader, Unity Catalog, performance and cost tuning
  • Delivered large multi-source integration programs (dozens of interfaces)
  • Hands-on Veeva CRM data model and integration experience; Vault CRM knowledge strongly preferred
  • Life sciences / pharma commercial experience (HCP/HCO data, call activity, samples, consent, MDM)
  • Strong REST/SOAP API, bulk load, and file/event-based integration skills
  • Proven technical leadership of engineering teams, including distributed/offshore teams
  • Familiarity with GxP validation and regulated-environment deliveryPreferred Qualifications
  • Databricks certifications (Data Engineer Professional, Solution Architect, or equivalent)
  • Prior Veeva CRM to Vault CRM or other CRM-to-CRM migration experience
  • Experience with Veeva Network, OpenData, or multi-org integration rationalization
  • DevOps for Databricks (Terraform, Azure DevOps, GitHub Actions); AWS, Azure, or GCP

Matching similar jobs

JOB OVERVIEW

Experience level

Manager

Location

New Orleans, LA

Occupation

Data Warehousing Specialists

Industry

Computer Systems Design Services

Posted

today

Tired of running searches?

Rank the roles you'd take once, and matches like these arrive on their own.

CREATE PROFILE (opens in a new tab)