IL
Data Analyst – Expert
ICONMA, LLC
- 🇨🇦 Canada
- Hybrid
- 21 hours ago
- $76.18 – $80.17 / hour
- Databricks
- Azure Functions
- C#
- Python
- Unity Catalog
- Hive
- Devops
- Azure DevOps
- GitHub
- Azure
- RBAC
- Azure SQL
- SQL
- Windows
- Delta Lake
- CI/CD
21 hours ago
Requirements:
- 7+ Years experience with ADF, Databricks and Azure Functions (C#)
- In depth development experience python/notebook on Databricks/Spark/panda
- Expert working knowledge of Unity Catalog and data governance setup/configuration
- Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
- Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
- Creating delta table schema/tables with proper design/properties & security permissions
- Nice to have experience on Delta Live Table.
- DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
- In depth experience on Azure Entra ID for SSO/RBAC setup
- In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
- Familiar to work in lock down windows environment for highly regulated industry
- Ability to work independently and lead a small team.
- Proven ability to work independently with minimum supervision
- Ability to lead a small team and technical problem-solving sessions
- Financial Services Industry experience is an Asset.
- Excellent Communication skills
- Must Have Requirements:
- ADF orchestrations with Databricks
- Experience with set up and configuration of data governance
- Databricks (Python notebooks, jobs, clusters, Delta Lake, medallion architecture, performance tuning/cost optimization)
- CI/CD, security
- Monitoring
- How many years of experience?: 10+ total but experience but experience for Databricks can be 5-8 years experience.
- Nice to Have:
- Previous client experience or experience in a financial institution.
- Soft Skills:
- Meticulous
- Attention to detail
- Autonomous
- Works well in a team environment
Why Should You Apply?
- Health Benefits
- Referral Program
- Excellent growth and advancement opportunities
Data Analyst – Expert · ICONMA, LLC