Senior Data Engineer - Azure Databricks

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. We help organisations solve complex business challenges by combining deep domain understanding with modern data and AI capabilities.

Our teams work across strategy, analytics, engineering, and product delivery to create scalable, high-value solutions that improve decision-making, efficiency, and growth.

We are looking for a skilledData Engineer with 5+ years of experience to design, build, and maintain scalable data pipelines and platforms usingAzure and Databricks. The ideal candidate will work closely with analytics, data science, and business teams to deliver reliable, high-performance data solutions that enable data-driven decision-making.

Key Responsibilities

• Design, develop, and optimizeend-to-end data pipelines usingAzure Databricks
• Build and maintain scalableETL/ELT frameworks for structured and unstructured data
• Ingest data from multiple sources including APIs, databases, files, and streaming systems
• Work withAzure Data Lake Storage (ADLS Gen2) for efficient data storage and retrieval
• Develop data transformation logic usingPySpark andSpark SQL
• Ensure data quality, reliability, and performance across pipelines
• Implement data modeling concepts to support analytics and reporting use cases
• Collaborate with Data Scientists, BI teams, and business stakeholders to understand data requirements
• Monitor, troubleshoot, and optimize Databricks jobs for performance and cost efficiency
• Apply best practices aroundsecurity, governance, and compliance within Azure
• Participate in code reviews, documentation, and continuous improvement initiatives

• 5+ years of hands-on experience as aData Engineer
• Strong experience withAzure Databricks
• Proficiency inPySpark,Spark SQL, and Python
• Experience working withAzure Data Lake Storage (ADLS Gen2)
• Solid understanding ofdata warehousing and data modeling concepts
• Experience building batch and/or streaming data pipelines
• Familiarity withAzure Data Factory or similar orchestration tools
• Strong SQL skills and experience with relational databases
• Experience usingGit or similar version control systems
• Strong analytical, problem-solving, and communication skills

• Experience withDelta Lake
• Knowledge ofstreaming technologies (Kafka, Azure Event Hubs, Spark Structured Streaming)
• Exposure toCI/CD pipelines using Azure DevOps
• Experience working inAgile/Scrum environments
• Understanding ofcloud cost optimization strategies