SS
Mid-level Big Data Engineer
Sky Systems, Inc
- 🇮🇳 India
- Hybrid
- Mid level
- 15 hours ago
- AWS Cloud
- Java
- Scala
- Kotlin
- Cassandra
- Python
- Hadoop
- PySpark
- REST API
- SOAP
- AWS
- Microservices
- EMR
- EC2
- ECS
- Airflow
- Step Functions
- API Gateway
- Linux
- Devops
- Git
- GitHub
- GitLab
- CI/CD
- Maven
- Gradle
- Jenkins
- Artifactory
- CloudFormation
15 hours ago
Position Type: Full-Time Contract (40hrs/week)
Contract Duration:6 months+
Work Schedule: 8 hours/day (Mon-Fri)
Location: Hybrid in Hyderabad, India
Roles and Responsibilities:
- 6+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
- Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
- Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
- Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
- Must have Linux experience (Shell scripting/Python
Required Skills:
- Experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop, HDFS, Spark, MapReduce framework
- Good Scala, Pyspark, Java coding experience for REST API and SOAP webservices
- Good AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
- Good Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
- Must have Linux experience (Shell scripting/Python)
Preferred Skills:
- Good to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
- Good to have experience creating CI/CD pipelines – Maven, Gradle, Jenkins, Artifactory, AWSCodeCommit Cloudformation
Mid-level Big Data Engineer · Sky Systems, Inc