Senior Data Engineer

Role – Senior Data Engineer

Location – Halifax, Nova Scotia, Canada

Terms: Contract

Job Description:

What will you do?

• Design, develop, and implement end-to-end data integration solutions using Azure Data Factory (ADF) and Azure Databricks (ADB)
• Stay updated with the latest Azure Data Engineering trends, best practices, and technologies, and provide recommendations for process improvements and tool enhancements.
• Provide technical guidance and mentorship to junior team members.
• Collaborate with Platform Support/DevOps team for CI/CD set up and deployments.
• Conduct pre/post-implementation activities ensuring project deliverables are met.
• Aid and support in training for support staff

Must have:

• Bachelor's degree in computer science, or related field
• Hands on Experience in ADB & ADF , Python & Spark .
• Exp in Reporting tools, Power Bi / Tableau
• Azure Data Engineer with minimum 5 years' experience
• Prior experience in big data implementations (Batch/Stream/Real-time processing), ELT/ETL and Hadoop.
• Proficient with writing SQL queries, Stored Procedures and Views
• Experience in executing various development methodologies such as Agile etc.

Nice-to-have:

• Preferred a background in Finance / Capital Markets, demonstrating basic Understanding in industry practice and terminology including financial data concepts (client, product, account, transaction, settlement, payments, tax, balances and valuation)
• Experience in Kafka.
• Prior experience in data analytics