Specialist - Data Engineering

Job : Spark and scala developer

Location : Irving,Texas

Job Summary

Seeking a Specialist with 7 years of experience in Scala and Big Data technologies including Hadoop Spark and SparkSQL to design and develop scalable data solutions

Job Description

Minimum 5 years of handson experience in Scala programming within Big Data ecosystems Strong expertise in Hadoop Spark and SparkSQL for data processing and analytics Experience in designing and implementing data ingestion persistence and retrieval solutions Familiarity with building and optimizing largescale data pipelines and workflows Good understanding of distributed computing frameworks and data warehousing concepts Exposure to shell scripting and automation tools is advantageous Ability to work independently and deliver highquality technical solutions Knowledge of version control systems like Git and build tools such as Maven or SBT Excellent communication skills to articulate technical concepts clearly Certification in Spark or Hadoop development is preferred

Roles and Responsibilities

Collaborate with crossfunctional teams to gather and analyze data requirements

Design develop and optimize scalable data pipelines using Scala and Spark

Implement data ingestion and transformation processes on Hadoop and Spark platforms

Troubleshoot and resolve performance issues in Spark applications

Provide technical solutions across multiple modules and ensure timely delivery

Maintain documentation and adhere to best practices in coding and deployment

Participate in code reviews and mentor junior developers

Stay updated with emerging Big Data technologies and recommend improvements

Work flexibly across different time zones as per project needs