EI
Senior Python Platform Engineer – PySpark / FastAPI / GCP
eTeam Inc.
🇺🇸 United States
On-site
Senior
2 weeks ago
- Python
- PySpark
- FastAPI
- GCP
- Microservices
- CI/CD
- ETL
- Apache Spark
- Docker
- Kubernetes
- GitHub Actions
- pytest
2 weeks ago
Work Location & Reporting Address: Charlotte, NC 28202 (Onsite-Hybrid. Local Candidates only!)
Must Have Skills:
⦁Python
⦁Pyspark
⦁API
⦁Microservices CI/CD
⦁GCP
⦁ETL
Nice to Have Skills:
⦁ETL
Detailed Job Description:
⦁At least 10 years of experience in IT industry.
⦁We are seeking a Python-based platform engineer to design and build a containerized API layer that abstracts and governs interactions with Apache Spark through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools—enabling consistent, secure, and scalable access to Spark-based data pipelines.
⦁The ideal candidate has strong experience developing production-grade APIs in Python that interface with data frameworks or pipeline orchestration systems, packaging services using containers (Docker/Kubernetes), and operating them as reusable platform services. A proven background in CI/CD automation using GitHub Actions is required, along with solid software engineering practices around testing, versioning, and deployment.
⦁Should have good hands-on experience in GCP skills. Should be able to interact, coordinate with the client.
⦁Should be able to manage offshore resources also.
⦁Should be able to work with other onsite team members and client.
Tech Skills
⦁Python
⦁Pyspark
⦁Experience building control planes
⦁Design patterns
o Modular containerized services
o Asynchronous processing
o Job-based work queue execution
o Immutability and idempotency
o Metadata management
o Policy enforcement
o Semantic modeling
o Observability and telemetry
o Side effect capability injection
⦁GCP
Testing
⦁Functional testing
⦁Behavioral testing
Languages
⦁Python
Frameworks and Platforms
⦁FastAPI
⦁ARQ
⦁Kubernetes
• Pytest
Minimum Years of Experience:
⦁10 years
Certifications Needed:
⦁None
Senior Python Platform Engineer – PySpark / FastAPI / GCP · eTeam Inc.