PL
Data Platform Infrastructure Engineer
PeopleNTech LLC
🇺🇸 United States
On-site
2 months ago
- Databricks
- Terraform
- AWS
- Ansible
- Hadoop
- Hive
- Yarn
- IaC
- Configuration Management
- Devops
- EC2
- IAM
- VPC
- EMR
- CI/CD
- Docker
- Kubernetes
2 months ago
Role : Data Platform Infrastructure Engineer
Location : Scottsdale AZ (100% onsite)
Rate : $65
Indent :
SF_OP_204640-8-2
Preferred Skill Combination (Must-Have Exposure to One or Both):
- Cloudera + Databricks + Terraform + AWS
Role Overview
We are seeking a highly skilledData Platform Infrastructure Engineer to design, build, and manage scalable data platforms acrosson-premise and cloud environments. The role involves working withcluster technologies, infrastructure automation, and modern data ecosystems to enable reliable and high-performing data platforms.
Key Responsibilities
- Design, deploy, and managedata platform infrastructure acrosson-prem (Cloudera) and cloud (AWS, Databricks) environments
- Build and maintaindistributed data clusters ensuring high availability, scalability, and performance
- Automate infrastructure provisioning usingTerraform and Ansible
- Manage and optimizeCloudera Hadoop ecosystems (HDFS, Hive, Spark, YARN, etc.)
- Deploy and manageDatabricks workspaces, clusters, and integrations on AWS
- Implementinfrastructure-as-code (IaC) and configuration management best practices
- Monitor cluster performance, troubleshoot issues, and ensure system reliability
- Collaborate with data engineers, architects, and DevOps teams to support data pipelines and analytics workloads
- Ensure security, compliance, and governance across data platforms
- Support migration fromon-prem to cloud-based data platforms
Technical Skills Required
Core Technologies
- Strong experience inCloudera (CDH/CDP) cluster setup and administration
- Hands-on experience withDatabricks (cluster management, jobs, notebooks)
- Strong exposure toAWS (EC2, S3, IAM, VPC, EMR, networking concepts)
- Expertise inTerraform (mandatory) for infrastructure provisioning
- Proficiency inAnsible for configuration management and automation
- Experience withCI/CD pipelines for infrastructure deployments
- Experience managingdistributed systems / cluster technologies
- Strong understanding of:
- Hadoop ecosystem (HDFS, Hive, Spark, Kafka, etc.)
- Spark performance tuning and cluster optimization
- Knowledge of containerization (Docker/Kubernetes) is a plus
Data Platform Infrastructure Engineer · PeopleNTech LLC