ES
Software Engineer
Expedite Software Services Private Ltd - India Instance
Location not stated
Hybrid
4 months ago
- Java
- Python
- Apache Spark
- GCP
- Microservices
- BigQuery
- Pub/Sub
- Composer
- GKE
- ETL
- REST API
- Spring Boot
- CI/CD
4 months ago
- The ideal candidate should possess strong expertise in Java, Python, Apache Spark, and Google Cloud Platform (GCP), along with hands-on experience in distributed systems, data engineering, and microservices architecture.
- Lead the design and development of scalable big data applications using Java, Python, and Apache Spark.
- Build and optimize batch and real-time data processing pipelines on Google Cloud Platform.
- Develop cloud-native solutions using GCP services such as Dataproc, BigQuery, Pub/Sub, Cloud Storage, Composer, and GKE.
- Design and implement Spark-based ETL frameworks and distributed data processing solutions.
- Collaborate with architects, business analysts, and stakeholders to define technical solutions and project roadmaps.
- Develop RESTful APIs and microservices using Java/Spring Boot or related frameworks.
- Optimize Spark jobs for performance, scalability, reliability, and cost efficiency.
- Implement CI/CD pipelines, automated testing, and cloud deployment strategies.
- Ensure data quality, governance, security, and compliance standards across platforms.
- Mentor development teams, conduct code reviews, and provide technical leadership.
- Troubleshoot and resolve production issues related to cloud infrastructure, Spark jobs, and application performance.
Software Engineer · Expedite Software Services Private Ltd - India Instance