DL
Data Engineer
Diverse Lynx India
๐ฎ๐ณ India
On-site
4 weeks ago
- Databricks
- Alteryx
- Python
- PySpark
- SQL
- Delta Lake
- ETL
- ELT
- Unity Catalog
4 weeks ago
We are looking for aData Engineer with strong hands-on experience inDatabricks, Python, PySpark, Spark SQL, and Delta Lake to build and optimize data solutions for JLL's global real estate operations.
Key Responsibilities
- MigrateAlteryx ETL workflows to optimized, code-based Databricks pipelines.
- Recreate Alteryx parameter-driven and conditional logic usingPython/PySpark.
- Develop scalableETL/ELT pipelines using PySpark, Delta Lake and Databricks Workflows.
- Validate migrated pipelines for data accuracy, performance and scalability.
- Monitor and optimize Databricks workloads and data pipelines.
- Work with source systems to understand data flows and improve integration solutions.
- Maintain technical documentation covering data flows, architecture and operational processes.
- Collaborate with senior engineers and business teams to deliver reliable data solutions.
- Strong hands-on experience withDatabricks, Alteryx, Python, PySpark, Spark SQL and Delta Lake.
- Experience withUnity Catalog, data governance, access control and lineage.
- Good understanding of ETL/ELT, distributed data processing and pipeline optimization.
- Strong problem-solving and communication skill
Data Engineer ยท Diverse Lynx India