Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
U

Lead I - Data Engineering

UST
  • 🇮🇳 India
  • On-site
  • Staff / Principal
  • 6 days ago
  • AWS Cloud
  • Scala
  • Python
  • PySpark
  • Hadoop
  • EMR
  • Microservices
  • AI
  • Apache Spark
  • Hive
  • AWS
  • EC2
  • ECS
  • EKS
  • Airflow
  • Step Functions
  • API Gateway
  • DynamoDB
  • Aurora
  • RDS
  • Linux
  • Data Modeling
  • Agile
  • Scrum
  • Machine Learning
  • Cursor
  • Large Language Models
  • RAG
  • AI/ML
  • Devops
  • CI/CD
  • Git
  • GitHub
  • GitLab
  • Bitbucket
  • Jenkins
  • Maven
  • Gradle
  • Artifactory
  • Docker
  • Kubernetes
  • Databricks
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

.

Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at UST.com.


Summary:

we have a opening for big data developer.

Roles and Responsibilities:

1.Design, develop, test, and deploy scalable Big Data solutions on AWS Cloud.
2. Build and maintain batch and streaming data pipelines using Scala, Python, Spark, and PySpark.
3. Analyze, process, and transform large volumes of structured and unstructured data.
4. Develop and support distributed data processing frameworks and data ingestion platforms.
5. Integrate new data sources and tools into existing big data ecosystems. 6. Optimize performance of Spark, Hadoop, EMR, and distributed computing workloads.
7. Design and implement cloud-native APIs and microservices supporting data products and operational platforms.
8. Collaborate with product owners, architects, QA teams, and business stakeholders throughout the software development lifecycle.
9. Automate data workflows, deployments, monitoring, and operational processes.
10. Evaluate emerging Big Data, AI, and cloud technologies and prototype innovative solutions.
11. Ensure adherence to security, governance, reliability, and software engineering best practices.
Required Qualifications
1. Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent experience.
2. 5-8 years of experience in software engineering and Big Data application development.
3. Strong hands-on experience with: Scala Python Apache Spark / PySpark Hadoop ecosystem (HDFS, MapReduce, Hive) Kafka or similar event-streaming technologies
4. Strong AWS experience with services such as: EMR S3 EC2 ECS/EKS Airflow (MWAA preferred) Step Functions API Gateway Lambda DynamoDB and/or Aurora/RDS
5. Experience building and supporting large-scale batch and API-based data processing solutions in AWS.

6. Strong Linux and shell scripting skills.
7. Experience with data ingestion, transformation, data modeling, schema design, and data lifecycle management.
8. Strong understanding of performance tuning for Spark, Hadoop, EMR, and distributed systems.
9.. Experience with Agile/Scrum development methodologies.
10. Understanding of secure software development practices and cloud security fundamentals.
11. Strong analytical, troubleshooting, and problem-solving skills.
12. Excellent written and verbal communication skills.
Preferred Qualifications
1. Experience with Generative AI, AI-assisted development tools (GitHub Copilot, Amazon Q, Cursor, etc.), and AI-driven automation.
2. Understanding of Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Vector Databases, and AI/ML solution integration.
3. Experience building AI-enabled data platforms and data pipelines supporting ML workloads.
4. Experience with DevOps and CI/CD tools such as Git, GitHub, GitLab, Bitbucket, Jenkins, Maven, Gradle, and Artifactory.
5. Experience with containerization technologies such as Docker and Kubernetes.
6. Knowledge of automated testing frameworks and data quality validation tools.
7. Experience working in enterprise-scale cloud environments.
8. AWS certification(s) and/or Databricks certification(s) are a plus.

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

• To support and promote the values of UST.

• Comply with all Company policies and procedures

Lead I - Data Engineering · UST

Auto apply with Likeremote