PL
DevOps Engineer – Cloudera Administration
PeopleNTech LLC
🇺🇸 United States
On-site
6 months ago
- Devops
- Airflow
- AWS
- Hive
- HBase
- Apache Solr
- Linux
- RHEL
- CentOS
- Ubuntu
- Bash
- Kerberos
- TLS
- LDAP
- Ansible
- Python
- Grafana
- Prometheus
- Elastic
- DNS
- Load Balancing
- JVM
- Git
- CI/CD
- Change Management
- Machine Learning
- SSL
- Yarn
- Incident Response
- IaC
- Terraform
6 months ago
Location : Scottsdale AZ (100% Onsite)
Rate : $65
Indents : SF_OP_201450-1-1 / SF_OP_201450-1-2
"Must be legally authorized to work in US without need for employer sponsorship now or at any time in the future.”
Must have :
- Strong on-prem Cloudera expertise
- candidates with experience in Ozone, Airflow, Ranger configuration, Atlas
- Strong architectural understanding, ability to guide application teams and implement best practices.
- Good to know - AWS and Cloudera on AWS
Identified candidates should:
- Ensure the reliability and ongoing monitoring of the infrastructure, its stability and maintainability.
- architect solutions, support application teams, and effectively utilize automation (viz just executing routine tasks)
Role Summary
We are seeking a DevOps Engineer with strong hands‐on experience inCloudera platform deployment, configuration, and administration. The ideal candidate will manage, automate, and optimize enterprise data platforms built onCloudera (CDP/CDH), ensuring availability, performance, security, and cost efficiency. The role requires advanced knowledge ofHDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Cloudera Data Services, and Ranger, along with solid DevOps and automation practices.
Required Qualifications
- 3–8 years (adjustable) of hands‐on experience administeringCloudera (CDH/CDP) in production.
- Strong administration skills withHDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Cloudera Data Services, and Ranger.
- Proficiency inLinux (RHEL/CentOS/Ubuntu) systems administration and shell scripting (Bash).
- Practical experience withKerberos,TLS,LDAP/AD, and Ranger policy management.
- Automation withAnsible and scripting inPython for operational tasks.
- Experience with monitoring and logging tools (Cloudera Manager, Grafana/Prometheus/Elastic or equivalents).
- Solid understanding of networking (DNS, load balancing, firewalls), storage, and JVM/GC fundamentals.
- Git‐basedCI/CD familiarity and change management practices in regulated environments.
Key Responsibilities
- Platform Deployment & Configuration
- Install, configure, and upgradeCloudera clusters usingCloudera Manager across on‐prem and/or cloud environments.
- Provision and configure services:HDFS, Hive, HBase, Solr (Cloudera Search), Ozone, Data Services (e.g., Data Engineering, Data Warehouse, Machine Learning), andRanger.
- Set up and manageKerberos,TLS/SSL,AD/LDAP integration, and Ranger policies for fine‐grained access control.
- Operations & Reliability
- Own day‐to‐day cluster administration: capacity planning, quota management, service restarts, rolling upgrades/patching, andbackup/restore.
- Monitor and tune cluster and service performance (NameNode/ResourceManager health, GC tuning, YARN queues, Hive LLAP/Tez, HBase region servers, Solr cores/collections).
- ImplementSLA/SLO monitoring, alerting, and dashboards; drive root‐cause analysis and incident response.
- Security & Governance
- Maintain a secure environment viaRanger policies, Kerberos principals/keytabs, TLS certificates, and compliance checks.
- Support data governance and auditing requirements, integrate with enterprise secrets and key management as needed.
- Automation & DevOps
- Build and maintainInfrastructure as Code (IaC) and configuration automation (e.g.,Ansible,Terraform).
- Develop operational runbooks and automation inPython/Bash for provisioning, patching, and routine admin tasks.
- Integrate platform workflows withCI/CD (Git, pipelines) for repeatable, version‐controlled changes.
- Data Services & Ecosystem Support
- Administer and optimizeHive metastore, ACID tables, compactions, and query engines (Tez/Spark).
- ManageHBase schemas, region splitting/balancing, and performance tuning.
- OperateSolr (Cloudera Search) for indexing, schema management, and query performance.
- SupportOzone object store operations, storage policies, and migration use cases.
- Collaborate with data engineering teams on job orchestration, resource management, and troubleshooting.
- Reliability Engineering
- Implementhigh availability (HA) for critical components; designDR strategies and execute failover tests.
- Capacity and cost optimization across compute/storage; recommend right‐sizing and lifecycle policies.
- Documentation & Collaboration
- Create and maintain architecture diagrams, topology, SOPs/runbooks, and security documentation.
- Partner with platform, security, and data engineering teams; provide L2/L3 support and knowledge transfer.
DevOps Engineer – Cloudera Administration · PeopleNTech LLC