Databricks_Bangalore

Design, develop, and maintainETL/ELT pipelines usingAzure Databricks,PySpark, andDelta Lake.

Build and optimizedata pipelines for large-scale data ingestion, transformation, and processing.

Collaborate withdata analysts, data scientists, and business teams to deliver reliable and high-performing datasets.

Developdata models, managedata lakehouse architectures, and ensuredata quality, lineage, and governance.

Integrate data from multiple sources, includingAzure Data Lake, SQL databases, APIs, and streaming systems.

Automate and orchestrate workflows usingDatabricks Workflows,Azure Data Factory (ADF), orAirflow.

OptimizeSpark jobs for performance and cost efficiency.

Implementmonitoring, logging, and alerting for data pipelines and jobs.

Ensure compliance withdata security and governance policies