DL
Hadoop Admin
Diverse Lynx India
Location not stated
2 months ago
- Hadoop
- Yarn
- Hive
- HBase
- Kerberos
- LDAP
- Disaster Recovery
- Python
- Ansible
- Linux
- Unix
- Grafana
- Prometheus
- Splunk
- CI/CD
- AWS
- Azure
- GCP
- Docker
- Kubernetes
- Devops
- Agile
- Scrum
2 months ago
- Lead the design, architecture, deployment, and administration of Cloudera Hadoop clusters.
- Manage and support Hadoop ecosystem components including HDFS, YARN, Hive, HBase, Impala, Spark, Kafka, Sqoop, Oozie, and ZooKeeper.
- Configure, monitor, troubleshoot, and optimize Cloudera Data Platform (CDP) environments.
- Ensure cluster availability, reliability, scalability, and performance.
- Implement security controls including Kerberos, Ranger, Knox, LDAP/AD integration, and encryption.
-Perform capacity planning, disaster recovery planning, backup, and cluster upgrades.-
- Automate administration tasks using Shell Scripting, Python, or Ansible.
- Work closely with data engineering, analytics, and infrastructure teams to support business requirements.
- Lead root cause analysis and resolution of production issues.
- Define architecture standards, best practices, and governance policies.
- Provide technical mentorship and guidance to junior administrators and engineers.
- Support migration initiatives from legacy Hadoop environments to CDP or cloud platforms.
Required Skills
Strong hands-on experience with Cloudera Hadoop Administration.
Expertise in Cloudera Manager, CDP, and cluster lifecycle management.
Deep understanding of Hadoop ecosystem technologies:
HDFS, YARN,Hive,Spark,HBase,Impala,Kafka,Sqoop,Oozie,ZooKeeper
Experience with Linux/Unix administration.
Strong knowledge of Hadoop security frameworks (Kerberos, Ranger, Knox).
Experience with performance tuning and troubleshooting large-scale clusters.
Proficiency in Shell Scripting and Python.
Experience with monitoring tools such as Grafana, Prometheus, Splunk, or similar.
Knowledge of CI/CD and infrastructure automation tools.
Preferred Skills
Experience with cloud platforms such as AWS, Azure, or GCP.
Cloudera CDP certification or Hadoop-related certifications.
Experience with containerization technologies (Docker, Kubernetes).
Knowledge of data governance and metadata management tools.
Familiarity with DevOps and Site Reliability Engineering (SRE) practices.
Educational Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Key Competencies
Technical Leadership
Solution Architecture
Problem Solving and Analytical Skills
Stakeholder Management
Communication and Collaboration
Mentoring and Team Leadership
Nice to Have
Experience in enterprise-scale data lake implementations.
Exposure to data migration and modernization projects.
Experience working in Agile/Scrum environments.
Hadoop Admin · Diverse Lynx India