VP
Databricks Architect
Vantage Point Consulting
- ๐จ๐ฆ Canada
- Remote
- Mid level
- 17 hours ago
- Databricks
- PySpark
- SQL
- Python
- Delta Lake
- Unity Catalog
- ETL
- ELT
- Apache Spark
- Data Modeling
- Azure
- AWS
- GCP
- CI/CD
17 hours ago
Duration:Long-Term
Job Summary:
We are looking for an experienced Databricks Architect to design and implement scalable, secure, and high-performance data solutions using Databricks and cloud technologies.
Key Responsibilities:
- Design and implement Databricks Lakehouse architecture and Medallion Architecture.
- Develop and optimize data pipelines using PySpark, Spark SQL, Python, and Delta Lake.
- Implement Unity Catalog for data governance, security, and access control.
- Design ETL/ELT workflows, batch, and real-time data processing solutions.
- Optimize Spark performance, platform scalability, and cloud costs.
- Lead technical design discussions and mentor data engineering teams.
- Strong expertise in Databricks, Apache Spark, PySpark, Python, and SQL.
- Hands-on experience with Delta Lake, Unity Catalog, and data modeling.
- Experience with Azure, AWS, or GCP cloud platforms.
- Knowledge of CI/CD, data governance, and performance tuning.
- Strong solution architecture and stakeholder management skills.
Databricks Architect ยท Vantage Point Consulting