DL
Senior Data Engineer (Databricks & AWS Migration)
Diverse Lynx India
🇮🇳 India
On-site
Senior
2 months ago
- SQL
- Oracle
- PostgreSQL
- ETL
- ELT
- Python
- Scala
- Apache Spark
- PySpark
- Databricks
- Delta Lake
- AWS
- AWS Glue
- Amazon EventBridge
- SQS
- Redshift
- CloudWatch
- Data Modeling
2 months ago
Location- Pan India
|
4+ Years | ||
|---|---|---|---|
|
Strong proficiency in SQL and relational databases (Oracle, PostgreSQL, etc.) | ||
|
Strong proficiency in SQL and relational databases (Oracle, PostgreSQL, etc.) • Hands-on experience with ETL/ELT pipeline development and migration projects • Strong programming skills in Python and/or Scala • Good experience with Apache Spark (preferably PySpark) • Hands-on experience with Databricks (Delta Lake, notebooks, jobs, workflows) • Strong knowledge of AWS data engineering services including: o AWS Glue, Lambda, S3, EventBridge, SQS o Amazon Redshift, Firehose, CloudWatch • Strong understanding of data modeling, data warehousing concepts, and data lake architectures • Experience working with large-scale datasets and distributed processing • Knowledge of pipeline orchestration and workflow management |
||
|
Oil & Gas | ||
|
PostOB | ||
|
6+ Years | ||
|
Post Onboarding | ||
|
Any NASSCOM | ||
|
Face to Face | ||
|
Hybrid | ||
|
UK | ||
|
Others |
Senior Data Engineer (Databricks & AWS Migration) · Diverse Lynx India