DL
AWS Databricks Data Engineer_Hyderabad
Diverse Lynx India
Location not stated
1 month ago
- AWS
- Databricks
- ETL
- ELT
- Delta Lake
1 month ago
Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Delta Lake, Auto Loader and Delta Live Tables (DLT).
• Design and implement metadata-driven data ingestion and transformation frameworks to enable scalable, reusable and configuration-based pipeline development across multiple data sources.
• Develop framework components for managing source configurations, ingestion rules, schema evolution, data quality validations, audit logging and pipeline execution monitoring.
• Implement Medallion Architecture (Bronze, Silver, Gold) with appropriate data quality checks, validation frameworks, testing, and monitoring.
AWS Databricks Data Engineer_Hyderabad · Diverse Lynx India