Data Engineer

💼 Employment Type: Contract – 7 Months💰 Pay Rate: $50–$60/hour on W2Job Description We are looking for an experienced Data Engineer with strong expertise in Python, PySpark, and AWS services to design, develop, and optimize scalable data pipelines. The ideal candidate will have hands-on experience processing large datasets, implementing data quality frameworks, and ensuring data integrity and lineage.

Key Responsibilities: Design, develop, and maintain high-performance data pipelines for large-scale data processing. Build and optimize ETL workflows using Python, PySpark, AWS Glue, and Amazon EMR.Implement data quality checks, validation frameworks, and data lineage tracking. Work with Amazon S3 data lakes and relational databases such as PostgreSQL and MySQL.Optimize Spark jobs for performance, scalability, and cost efficiency. Troubleshoot pipeline failures and ensure data accuracy and reliability.

Required Skills & Qualifications: Strong hands-on experience with Python and PySpark. Extensive experience with AWS Glue and Amazon EMR.Experience building scalable data pipelines for large volumes of data. Knowledge of data quality, data validation, and data lineage frameworks. Experience working with Amazon S3 and relational databases (RDS, PostgreSQL, MySQL).