PL
Core Platform Engineer
PeopleNTech LLC
🇺🇸 United States
On-site
1 month ago
- OpenShift
- Trino
- OAuth
- TLS
- RBAC
- Python
- Bash
- SQL
- Java
- Scala
- Linux
- Kubernetes
- Helm
- Terraform
- Apache Spark
- Hadoop
- Hive
- ETL
- Apache Airflow
- Apache NiFi
- Flink
- Parquet
- Apache Avro
- JSON
- AI/ML
- MLflow
- Kubeflow
- ABAC
- SSL
- KMS
- GDPR
- HIPAA
- IAM
- System Design
- Microservices
- Event-Driven Architecture
- Load Balancing
- Redis
- Memcached
- Disaster Recovery
- Prometheus
- Grafana
1 month ago
Role : Core Platform Engineer
Location : Charlotte-Concord-Gastonia, NC-SC (Hybrid)
Rate: $65/hr - $67/hr
Core Platform Engineer
- Primary Role: Build and maintain secure, scalable infrastructure and services.
- Responsibilities:
- Support a highly available and scalable infrastructure containing Object storage, Openshift, Spark, Iceberg, Yunikorn, Trino
- Monitor for configuration drift and enforce infrastructure policies.
- Configure and monitor Big Data ecosystem components with various BI tools, observability tools etc
- Build automated regression and performance test suite to ensure health checks of all components of the platform
- Tasks:
- Monitor system health and enforce runtime policies.
- Implement and manage security protocols, including Oauth authentication, TLS encryption, and role-based access control (RBAC).
- Conduct regular maintenance, including cluster scaling, perform regular security audits.
- Languages: Python, Bash, Shell, SQL, Java (basic), Scala (for big data, good to have)
- Automation & Scripting: Python scripting for automation, Linux shell scripting
- System programing, performance tuning, networking
- OCP, Kubernetes (K8s), Helm, Terraform, container orchestration and deployment
- Frameworks: NexusOne, Apache Spark, Hadoop, Hive, Trino, Iceberg
- ETL Tools: Apache Airflow, NiFi (good to have)
- Data Pipelines: Batch and streaming (Kafka, Flink)
- Object Storage: S3, NetApp StorageGrid
- Data Formats: Parquet/Avro, ORC, JSON, CSV
- Frameworks or LLM modeling
- Model Ops: MLflow, Kubeflow, SageMaker
- Data Science: Feature engineering, model deployment, inference pipelines
- Access Models: RBAC (Role-Based Access Control), ABAC (Attribute-Based Access Control)
- Data Protection: Encryption at rest and in transit, TLS/SSL, KMS (Key Management Services)
- Compliance: GDPR, HIPAA (if applicable), IAM policies
- Design Principles: Microservices, Event-driven architecture, Serverless
- Scalability: Load balancing, caching (Redis, Memcached), horizontal scaling
- High Availability: Failover strategies, disaster recovery, monitoring (Prometheus, Grafana)
Core Platform Engineer · PeopleNTech LLC