LikeRemoteSenior Data Engineer – Azure Databricks
from 🌏 Worldwide
Who are we?
Billigence is a boutique data consultancy with global reach, helping organisations transform the way they work with data. We specialise in delivering high-impact data solutions across Business Intelligence, Data Engineering, Data Governance, Cloud Data Platforms, and Advanced Analytics. Headquartered in Sydney with offices across the UK, Europe, and APAC, Billigence partners with organisations to design and implement modern data platforms that drive better decision-making and business outcomes.
Our teams work on complex, enterprise-scale data programmes across a variety of industries including retail, financial services, and technology.
About the role:
Billigence is currently supporting aglobal Financial Services client on a majordata platform modernisation initiative centred around Azure Databricks.
We are looking for an experiencedSenior Data Engineer based in India to support the delivery of scalable enterprise data pipelines as part of a distributed global engineering team.
The role will focus on building pipelines that ingest accounting and operational data from the client’sback-office providerand exposing curated datasets throughDatabricks SQL and APIs.
The client currently operates ingestion pipelines throughAzure Synapse notebooks but is transitioning toAzure Databricks, creating an opportunity to modernise and improve pipeline design, performance, and scalability.
You will help establishbest-practice patterns for data ingestion, transformation, and storage within the Databricks Delta Lake environment, supporting both historical data ingestion and ongoing operational data flows.
This role will begin as a6-month contract, with a strong likelihood of extension based on performance and project requirements.
What you’ll do:
- Build and optimisedata pipelines within Azure Databricks
- Support migration of existingAzure Synapse notebook pipelines
- Design scalabledata models and storage patterns within Delta Lake
- Integrate historical data fromon-premise data warehouses
- Build new ingestion pipelines fromSQL Server stored procedures
- Implement scalableingestion frameworks and reusable pipeline patterns
- Collaborate withglobal data engineering teams across the UK and India
- Contribute tobest practices and platform standards for future pipeline development
What you’ll need:
- Strong experience working as aData Engineer or Senior Data Engineer
- Hands-on experience withAzure Databricks
- Strong understanding ofDelta Lake architecture
- Experience withAzure Synapse, Spark, and modern cloud data platforms
- Strong SQL and experience working withenterprise data systems
- Experience buildingdata pipelines and ETL/ELT frameworks
- Ability to work effectively indistributed global teams
- Experience withinFinancial Services or regulated industries is beneficial
