AL
Azure Data Lake Engineer
Artech LLC
🌏 Worldwide
Remote
4 months ago
$55 – $58 / hour
- SQL
- Databricks
- SAP
- Collibra
- Azure Data Factory
4 months ago
Title: Azure Data Lake Engineer
Locations: Remote
Duration: 6+ Months
Pay Range: $55 - $58/Hour on W2 (All inclusive) - Applicants must be willing to work on W2
Role Descriptions:
3-7 years of experience required
Data Feed Review & Optimization
• Assess existing MDL data tables and create a structured inventory.
• Conduct data feed reviews with the MDL community.
• Improve data structures, performance, and documentation.
New Data Feed Engineering
• Support the identification of relevant Marketing & non Marketing data products.
• Implement and test new data feeds; ensure quality and consistency.
• Align with data stakeholders and support enablement.
Automation & Data Quality
• Replace manual uploads with automated pipelines.
• Develop concepts and PoCs for data quality checks (top 20 tables).
• Execute in depth quality reviews and implement corrective actions.
Documentation, Lineage & Governance
• Document lineage, transformations, and table-level metadata.
• Set up data dictionaries, PII-handling concepts, and taxonomy standards.
• Contribute to ER model development and artefact standardization.
Community Support & Enablement
• Coordinate across the MDL community.
• Support access requests, platform education, and use-case repository updates.
Required Qualifications
• Strong data engineering background (3–5+ years).
• Proficiency with Azure data lake, SQL, Databricks, and modern data pipelines.
• Experience with data lineage, metadata, documentation, and data quality frameworks.
• Ability to structure complex datasets and communicate with cross-functional teams.
Preferred Qualifications
• Experience with SAP Data Lake, SAP Datasphere, BDC, or Collibra.
• Background in Marketing data or large-scale data lake optimization.
What You Gain
• Direct influence on the future state of MDL.
• Collaboration with a skilled, cross-functional data community.
• A dynamic environment with room for engineering innovation.
Role Descriptions:
Azure Data Lake with Databricks Assess existing MDL data tables and create a structured inventory Assess existing MDL data tables and create a structured inventory. Conduct data feed reviews with the MDL community. Improve data structures| performance| and documentation. New Data Feed Engineering Support the identification of relevant Marketing non Marketing data products. Implement and test new data feeds ensure quality and consistency. Align with data stakeholders and support enablement. Automation Data Quality Replace manual uploads with automated pipelines. Develop concepts and PoCs for data quality checks (top 20 tables). Execute in depth quality reviews and implement corrective actions. Documentation| Lineage Governance Document lineage| transformations| and table-level metadata. Set up data dictionaries| PII-handling concepts| and taxonomy standards. Contribute to ER model development and artefact standardization. Community Support Enablement Coordinate across the MDL community. Support access requests| platform education| and use-case repository updates. Required Qualifications Strong data engineering background (35 years). Proficiency with Azure data lake| SQL| Databricks| and modern data pipelines. Experience with data lineage| metadata| documentation| and data quality frameworks. Ability to structure complex datasets and communicate with cross-functional teams. Preferred Qualifications Experience with SAP Data Lake| SAP Datasphere| BDC| or Collibra. Background in Marketing data or large-scale data lake optimization. What You Gain Direct influence on the future state of MDL. Collaboration with a skilled| cross-functional data community. A dynamic environment with room for engineering innovation.
Essential Skills: Azure Data Lake with Databricks
Desirable Skills:
Skills: Digital : Databricks~Azure Data Factory
Experience Required: 4-6
Company Benefits & Culture
- Inclusive and diverse work environment
- Opportunities for professional growth and development
- Comprehensive health and wellness benefits
Appreciate your quick response and please feel free to reach me out for any query you may have.
Thanks
Azure Data Lake Engineer · Artech LLC