Databricks Data Engineer

Diverse Lynx India

🇮🇳 India

On-site

2 months ago

Databricks
PySpark
SQL
Python
Delta Lake
Data Modeling
Unity Catalog
AWS
Azure
GCP
CI/CD
Devops
Git
Azure DevOps
GitHub
IaC
Snowflake
Airflow
dbt
MLflow

2 months ago

Auto apply with Likeremote

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

Relevant Experience

5+ Years

Mandatory skills

Mandatory Skills & Experience
• 5+ years of data engineering experience.
• 5+ years of Databricks platform experience.
• Strong expertise in:
o PySpark
o Spark SQL
o Python
o Delta Lake
o Databricks Workflows
• Strong understanding of:
o Lakehouse Architecture
o Medallion Architecture
o Data Modeling
o Data Warehousing Concepts
• Experience building scalable data pipelines handling large data volumes.
• Strong SQL development and optimization skills.
Databricks-Specific Skills
• Databricks Workspace Administration
• Jobs and Workflows
• Delta Tables
• Delta Live Tables (DLT)
• Unity Catalog
• Databricks SQL
• Structured Streaming
• Auto Loader
• Delta Optimization Techniques
Cloud Skills (Any One Preferred)
• AWS
• Azure
• GCP
CI/CD & DevOps
• Git
• Azure DevOps / GitHub
• CI/CD pipelines
• Infrastructure as Code concepts

Desired skills

Preferred Skills
• Snowflake integration
• Kafka/Event Streaming
• Airflow
• dbt
• MLflow exposure
Soft Skills
• Strong debugging and performance tuning abilities.
• Excellent communication and stakeholder interaction skills.
• Ability to independently drive technical solutions.

Domain (Industry)

Oil & Gas

BGC (Before onboarding / After onboarding)

PostOB

Total Experience (Ex. 5-7 Years)

7+ Years

BGC Details

Post Onboarding

BGC Vendor

Any NASSCOM

Mode of Interview

Face to Face

WFO / WFH / Hybrid

Hybrid

Please enter shift timings

Databricks Data Engineer · Diverse Lynx India

Auto apply with Likeremote