VI
Data Platform Engineer
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- Hybrid
- 5 hours ago
- Azure
- Databricks
- Microsoft Fabric
- Fabric
- CI/CD
- RBAC
- DNS
- Load Balancing
- AKS
- Azure SQL
- Azure Monitor
- Dynatrace
- Datadog
- New Relic
- Splunk
- Grafana
- Key Vault
- Defender
- IaC
- Terraform
- Bicep
- PowerShell
- Git
- Delta Lake
- Python
- PySpark
- SQL
- Entra
- Unity Catalog
- Microsoft Purview
- Power BI
- MLflow
- AI
5 hours ago
About The Job:
Job Profile: Data Platform Engineer (Azure)
Senior engineer who builds and runs the enterprise data platform on Azure, centred on Databricks and Microsoft Fabric: workspaces, governance, networking, automation and cost controls that let data teams build and ship automatically.Accountabilities
- Build and run the Databricks and Fabric platforms as code: workspaces, capacities, compute policies, networking, identity
- Own data governance controls: catalogues, access model, lineage, data classification and audit
- Provide golden-path templates and CI/CD pipelines for data engineering and analytics teams
- Secure the platform: private connectivity, managed identities, secrets, encryption, data exfiltration controls
- Manage cost: cluster and capacity sizing, usage monitoring, chargeback by team
- Monitor platform health, job reliability and capacity; act on failures and throttling
- Own platform lifecycle: runtime upgrades, feature rollout, deprecations
- Work with the cloud platform, security and data engineering teams on shared design decisions
Must-have skills
Strong Azure fundamentals are the main requirement. Candidates must evidence the Azure baseline and the core role skills below; everything under Preferred skills can be developed in role.Azure baseline
| Area | Baseline expected |
|---|---|
| Resource organisation | Management groups, subscriptions, resource groups, tagging; how landing zones separate platform from workloads |
| Identity and access | Entra ID, RBAC assignment and scoping, managed identities, service principals |
| Networking | VNets, subnets, NSGs, peering, private endpoints, private DNS, load balancing options |
| Compute | VMs and scale sets, App Service, containers on AKS at operator level |
| Storage and data | ADLS Gen2: hierarchical namespace and access control; storage redundancy options; Azure SQL basics |
| Governance | Azure Policy: reading, assigning and remediating; audit versus deny effects |
| Monitoring | Azure Monitor, Log Analytics and KQL, or an equivalent platform such as Dynatrace, Datadog, New Relic, Splunk or Grafana; dashboards, alerts and everyday queries |
| Security basics | Key Vault, Defender for Cloud recommendations, encryption, least privilege |
| Infrastructure as code | Terraform or Bicep in regular use, with changes through pull request |
| Tooling | Azure CLI or PowerShell, Git |
Core role skills
| Skill | Evidence expected |
|---|---|
| Data platform on Azure | Hands-on with Databricks or Microsoft Fabric; either one is enough, with willingness to learn the other |
| Lakehouse fundamentals | Delta Lake basics; working Python (PySpark) and SQL |
| Data access and security | Controls access to data with Entra groups and platform permissions; understands private connectivity |
Preferred skills
These strengthen a candidate and can be developed in role. None is required at hire.- Running Databricks in production: workspace deployment, cluster and SQL warehouse policies, runtime upgrades
- Unity Catalog design: catalogs, access model, row filters and column masks, lineage
- Fabric administration: capacities, workspaces, domains, tenant settings, OneLake
- How Databricks and Fabric share data: OneLake shortcuts, mirroring, Delta
- Terraform with the Databricks and Fabric providers
- CI/CD for data: Declarative Automation Bundles (formerly Databricks Asset Bundles), Fabric Git integration and deployment pipelines
- Spark performance tuning and medallion architecture
- Cost management: sizing clusters, warehouses and capacities; attributing spend by team
Desirable skills
- Lakeflow Jobs and Lakeflow Spark Declarative Pipelines (formerly Workflows and Delta Live Tables)
- Streaming: Structured Streaming, Auto Loader, Event Hubs, Fabric Real-Time Intelligence
- Microsoft Purview: catalogue, classification, data loss prevention
- Power BI administration and Direct Lake semantic models
- Delta Sharing and Lakehouse Federation
- MLflow, model serving and support for AI workloads
- Migration from Synapse, Data Factory or on-premises warehouses
- Backup, recovery and DR design for data platforms
Certifications
Certifications are desirable and never a substitute for the evidence above.- Microsoft: Fabric Data Engineer Associate (DP-700)
- Microsoft: Fabric Analytics Engineer Associate (DP-600)
- Databricks: Certified Data Engineer Professional
- Microsoft: Azure Administrator Associate (AZ-104)
Experience and behaviours
- 5+ years in data, platform or cloud engineering, including 2+ years hands-on with Azure
- Experience on a data platform such as Databricks, Fabric or Synapse; production administration is an advantage
- Product mindset: treats data engineering and analytics teams as customers
- Balances governance with speed; prefers guardrails to gates
- Explains platform trade-offs clearly to non-specialists
Success measures
- Share of data workloads deployed through platform templates and CI/CD
- Lead time from request to a governed workspace
- Platform availability and scheduled job success rate
- Spend against budget by team, and share of idle compute
- Share of data assets under catalogue governance with a named owner
How to Apply:Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visitJobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Data Platform Engineer · VARITE INDIA PRIVATE LIMITED