DL
Bigdata_Pan India
Diverse Lynx India
- Location not stated
- Staff / Principal
- 10 months ago
- Scala
- Hadoop
- Hive
- PySpark
- ELT
- Talend
- Unix
- Python
- CI/CD
- Git
- Jira
- Snowflake
10 months ago
Job Description:
We are seeking an experienced Big Data Senior Developer to lead our data engineering efforts. In this role, you will design, develop, and maintain large-scale data processing systems. You will work with cutting-edge technologies to deliver high-quality solutions for data ingestion, storage, processing, and analytics. Your expertise will be critical in driving our data strategy and ensuring the reliability and scalability of our big data infrastructure.
Profile
· 3 to 8 years of experience on application development with Spark/Scala
· Good hands-on experience of working on the Hadoop Eco-system ( HDFS, Hive, Spark )
· Good understanding of the Hadoop File Formats
· Good Expertise on Hive / HDFS, PySpark, Spark, JupiterNotebook, ELT Talend, Control-M, Unix/Script, Python, CI/CD, Git / Jira, Hadoop, TOM, Oozie, Snowflake
· Expertise in the implementation of the Data Quality Controls
· Ability to interpret the Spark UI and identify the bottlenecks in the Spark process and provide the optimal solution.
Tools
Bigdata_Pan India · Diverse Lynx India