Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
DL

Data Engineer- Bigdata

Diverse Lynx India
๐Ÿ‡ฎ๐Ÿ‡ณ India
On-site
10 months ago
  • Hadoop
  • Hive
  • Azure Cloud
  • Azure Synapse
  • Azure Blob Storage
  • Azure Functions
  • Azure DevOps
  • CI/CD
  • Databricks
  • ETL
  • Yarn
  • Apache Spark
  • PySpark
  • Scala
  • SQL
  • Python
  • Devops
  • Data Modeling
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV
Data Engg โ€“
Country India
Detailed JD (Roles and Responsibilities)
  • Key Responsibilities
  • Design, develop, and maintainBig Data solutions usingHadoop ecosystem tools (HDFS, Hive, Spark, Sqoop, Oozie, etc.).
  • Implement and optimizedata pipelines for large-scale data ingestion, transformation, and storage.
  • Work onAzure Cloud services such asAzure Data Lake, Azure Synapse, Azure Blob Storage, Azure Functions, andAzure DevOps for CI/CD.
  • Develop and manageDatabricks notebooks for ETL, data processing, and advanced analytics.
  • Ensuredata security, governance, and compliance across cloud and on-prem environments.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver scalable solutions.
  • Monitor and troubleshoot performance issues in distributed systems and optimize resource utilization.
  • Required Skills
  • Strong experience withHadoop ecosystem (HDFS, Hive, Spark, YARN).
  • Proficiency inApache Spark (PySpark/Scala) for big data processing.
  • Hands-on experience withAzure Cloud services (Data Lake, Synapse, Blob Storage, Functions).
  • Expertise inDatabricks for data engineering and analytics workflows.
  • Knowledge ofSQL,Python, andScala.
  • Familiarity withCI/CD pipelines andDevOps practices.
  • Understanding ofdata modeling,data governance, andsecurity best practices.
Total Experience 6+ yrs
Relevant Experience 6+ yrs
Mandatory skills experience in Big Data Hadoop, Azure Cloud and Databricks
Desired skills experience in Big Data Hadoop, Azure Cloud and Databricks
Domain (Industry) ANY
Work Location Hyderabad/Pune/Bangalore/Chennai
WFO / WFH / Hybrid HYBRID

Location- PAN India Infosys Locations
Yrs of Exp-5+Yrs

Data Engineer- Bigdata ยท Diverse Lynx India

Auto apply with Likeremote