Big Data Engineer

Job Title: Big Data Engineer 
Location: Alpharetta, GA (Local candidates only)
Duration: 12 months (Contract)
Pay Rate: $79.71/hr W2 (No benefits)

Role Summary
We are seeking an experienced Big Data Engineer to join the CPS Data Center of Excellence team. This role focuses on designing, enhancing, and governing data platform automation frameworks, with a strong emphasis on Spark-based ETL processing, performance optimization, and innovation.

Key Responsibilities

• Design and develop ETL automation frameworks for big data platforms.

• Enhance and support existing frameworks; act as technical POC for related teams.

• Perform performance tuning for Spark and Snowflake ETL jobs.

• Drive automation, process optimization, and utility development.

• Conduct code development, reviews, testing, and participate in architecture/design discussions.

• Support batch operations, troubleshoot issues, and assist application teams.

• Evaluate new technologies and support cloud migration POCs.

Required Skills

• 7+ years of data engineering experience.

• Strong hands-on expertise in Python, Apache Spark, SQL, and UNIX Shell scripting.

• Solid understanding of HDFS, Hive, Impala, and Spark internals.

• Experience with GitHub, DevOps, and CI/CD tools.

• Strong problem-solving, communication, and collaboration skills.

• Ability to work independently with a strong sense of ownership.

Preferred Skills

• Experience with Snowflake and cloud platforms (AWS, Azure).

• Exposure to ETL/data integration tools (e.g., Informatica/IDMC).

Primary Skills: Python, Big Data, Apache Spark