EI
Senior Big Data Engineer – Scala/Spark
eTeam Inc.
🇺🇸 United States
On-site
Senior
4 weeks ago
- Scala
- Python
- SQL
- Hadoop
- Hive
- Apache Spark
- ETL
- NoSQL
- Unix
- Agile
- Scrum
4 weeks ago
Location: Irving, TX 75039 (Onsite-Hybrid. Client to consider candidates willing to relocate)
Duration: 12 months
Must Have Skills:
- Spark
- Scala
- Python
- SQL
- Spark Streaming
- Hadoop
- Hive
- SQL
- Sqoop
- Impala
Detailed Job Description:
- At least 8 years of experience and strong knowledge in Scala programming language.
- Able to write clean, maintainable and efficient Scala code following best practices.
- Good knowledge on the fundamental Data Structures and their usage
- At least 8 years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
- Having expertise in Spark Core, Spark SQL and Spark Streaming.
- Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.
- Familiarity with Data warehousing and ETL concepts and techniques
- Having expertise in Database concepts and SQL/NoSQL operations.
- UNIX shell scripting will be an added advantage in scheduling/running application jobs.
- At least 8 years of experience in Project development life cycle activities and maintenance/support projects.
- Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
- Understand project requirements and translate them into technical solutions which meets the project quality standards
- Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
- Strong problem solving and Good Analytical skills.
- Excellent verbal and written communication skills.
- Experience and desire to work in a Global delivery environment.
- Stay up to date with new technologies and industry trends in Development.
- Minimum Years of Experience:
- 8 years
Certifications Needed:
- Karat assessment. Need to be cleared before onboarding
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
- Coding
- Requirement gathering
- Team lead
Senior Big Data Engineer – Scala/Spark · eTeam Inc.