Cloudera Hadoop Admin- Pune
- Hadoop
- Linux
- Unix
- CentOS
- Ubuntu
- Yarn
- Hive
- HBase
- Kerberos
- Disaster Recovery
- Bash
- Python
- SSL
- AWS
- Azure
- Devops
- Ansible
- Terraform
- Puppet
- Nagios
- Grafana
Key Responsibilities:
-
Install, configure, manage and maintain Hadoop clusters based on Cloudera CDH or CDP, and/or Hortonworks HDP distributions. (e.g., CDH/CDP)
-
Perform system administration for Linux/Unix servers (Red Hat, CentOS, Ubuntu etc.).
-
Ensure high availability, scalability and reliability of the Hadoop ecosystem (HDFS, YARN, ZooKeeper, Hive, Spark, HBase, etc.).
-
Setup and manage security for Hadoop clusters — Kerberos authentication, data-at-rest encryption, data-in-transit encryption.Configure and manage data replication, cluster backup and disaster recovery policies.
-
Monitor cluster performance, troubleshoot issues, conduct root-cause analysis and tune systems for optimal performance.
-
Automate routine tasks using shell/bash, Python, or other scripting languages.
-
Work closely with infrastructure, network, development and big data teams for integration and support.
-
Maintain documentation of cluster configuration, maintenance procedures, security policies, and operational runbooks.
-
Occasionally work in a 24×7 support model (if required) including shifts, weekends or holidays.
Required Skills & Qualifications:
-
Bachelor's degree in Computer Science, Information Technology or related field.
-
4+ years of hands-on experience in Hadoop cluster administration (or for senior roles 8+ years) including Cloudera or Hortonworks distros.hirist.tech+1
-
Strong Linux/Unix system administration skills.
-
Experience with Hadoop ecosystem components: HDFS, YARN, Hive, Spark, HBase, ZooKeeper, etc.
-
Experience with Cloudera Manager, Ambari, or equivalent tools for cluster management.
-
Security experience: Kerberos, Ranger, SSL, Atlas etc
-
Scripting skills: Shell/bash, Python, others preferred.
-
Experience working both on-premises and cloud (AWS, Azure) deployments preferred.
-
Excellent communication and team-working skills.
-
Ability to work in high-pressure production environments, perform root-cause analysis and provide solutions.
Desired Skills (nice-to-have):
-
Experience with DevOps/automation tools (Ansible, Terraform, Puppet, Chef).
-
Experience with monitoring tools (Nagios, Ganglia, Grafana) and infrastructure metrics.
-
Understanding of big data ingestion tools (Sqoop, Flume, Kafka).
-
Experience with cloud-native big data services and migration from on-premises to cloud.
-
Certification like Cloudera Certified Administrator (CCA) or Hortonworks Administrator.
Cloudera Hadoop Admin- Pune · Diverse Lynx India