Lead Data Engineer Hybrid Only W2 Profiles

Role: Lead Data Engineer

Location: Dallas, TX – Hybrid

Key Responsibilities: Design, develop, and maintain scalable enterprise data platforms and pipelines. Build and support ETL/ELT pipelines using Snowflake, Nexla, Apache Airflow, and related technologies. Develop efficient and complex SQL queries, data transformations, and Python-based solutions. Design data solutions that support analytics, AI, and machine learning workloads. Work with AI/GenAI technologies and develop AI-ready data architectures. Collaborate with AI/ML teams on LLMs, RAG, vector databases, semantic search, and Agentic AI solutions. Perform data pipeline optimization, performance tuning, troubleshooting, and production support. Implement data quality, governance, security, privacy, and data lineage practices. Participate in Agile ceremonies, sprint planning, estimation, development, testing, and deployment. Collaborate with onsite, offshore, and cross-functional teams. Work closely with Product Engineering, Architecture, AI/ML, Data Engineering, and business stakeholders. Create and maintain technical documentation and data architecture documentation. Support CI/CD, DevOps, Infrastructure as Code, and MLOps processes where applicable.

Required Skills: Strong hands-on experience with Snowflake. Strong SQL and Python development skills. Experience with Nexla or similar ETL/ELT platforms. Experience with Apache Airflow. Experience with AI/GenAI development tools such as: Microsoft Copilot Claude Cursor GitHub Copilot Understanding OfLarge Language Models (LLMs) Retrieval-Augmented Generation (RAG) Vector Databases Semantic Search Agentic AI Experience building data platforms supportinganalytics, AI, and machine learning .Strong understanding ofdata governance, security, privacy, and data lineage .Strong Agile development experience. Excellent stakeholder management and communication skills. Strong troubleshooting and problem-solving abilities.

Preferred Skills: Experience with Azure and Snowflake on Azure. Experience with Azure OpenAI, Microsoft Fabric, Databricks, Amazon Bedrock, or similar platforms. Hands-on experience with RAG, semantic search, vector databases, and AI agents. Experience with AI frameworks such as: LangChain LangGraph CrewAI AutoGen Semantic Kernel Education Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field preferred.