Specialist - Data Engineering

Role :Databricks Python Developer

Experience :5-8 Years

Location :Hyderabad

Primary Skills :Databricks Python PySpark Data Engineering

Databricks with Python more of a reports Specialist or Data Engineer ReportingAnalytics focusing on building automating and maintaining data pipelines to transform raw data into optimized reporting assets

Secondary Skills :Cloud Data Platforms, SQL Data Warehousing ETL,ELT Development

MustHave Skills:

Strong handson experience in Databricks platform development and administration

Expertise in Python programming for data processing automation and application development

Strong experience with PySpark for largescale distributed data processing

Excellent SQL skills for data extraction transformation and optimization

Experience building and maintaining ETLELT pipelines in Databricks

Strong understanding of Delta Lake Lakehouse architecture and data lifecycle management

Experience working with structured semistructured and unstructured data sources

Expertise in data modeling performance tuning and query optimization

Experience integrating Databricks with cloud platforms such as Azure AWS or GCP

Proficiency in developing scalable and reusable data engineering frameworks

Strong understanding of data quality governance security and monitoring practices

Experience with version control tools such as Git and CICD implementation

Strong analytical and problemsolving skills with the ability to troubleshoot complex data issues

Experience collaborating with business stakeholders to translate requirements into technical solutions

Excellent communication and stakeholder management skills

GoodtoHave Skills

Experience with Azure Databricks and Azure Data Services ADF ADLS Synapse

Handson experience with Apache Kafka or streaming data solutions

Knowledge of orchestration tools such as Airflow Azure Data Factory or similar platforms

Experience working with Unity Catalog metadata management and data governance frameworks

Understanding of Data Warehousing concepts and modern Lakehouse implementations

Experience with BI and reporting tools such as Power BI Tableau or Looker

Exposure to machine learning workflows and MLOps on Databricks

Knowledge of cloudnative architecture security and cost optimization practices

Experience building reusable data products and enterprise data assets

Familiarity with DevOps practices automated testing and deployment pipelines

Experience in AgileScrum delivery environments

Databricks Cloud or Data Engineering certifications preferred

Experience supporting enterprisescale analytics and digital transformation programs