Senior Specialist - Data Engineering

Must-Have Skills

·Strong SQL skills, including complex queries, joins, data analysis, and experience with SQL Data Warehouse or Azure SQL.

·Experience with Azure Synapse and PySpark for data processing and transformation.

·Hands-on experience building, maintaining, and enhancing ETL/ELT and big data pipelines.

·Working knowledge of the MSBI stack on Azure.

·Working knowledge of Azure Data Factory and Azure Data Lake Storage.

·Experience with data validation, data quality checks, and pipeline monitoring.

·Strong troubleshooting and problem-solving skills, with the ability to resolve data and pipeline-related issues.

·Experience with Azure DevOps, Git version control, and CI/CD practices.

·Ability to perform requirement analysis and translate business needs into technical solutions.

·Strong analytical thinking, with the ability to derive insights and inferences from data.

·Good verbal and written communication skills, along with effective coordination abilities.

·Ability to work independently as an individual contributor while collaborating effectively with technical leads and stakeholders.

·Experience creating and maintaining technical specifications, wiki documentation, and implementation documents.

·Ability to provide regular status updates and maintain Azure DevOps work items.

Good-to-Have Skills

·Hands-on experience with Power BI and BI reporting or dashboard development.

·Knowledge of Cosmos DB, Cosmos scripting, and experience implementing pipelines using Cosmos DB.

·Experience with version control tools and practices, including Azure DevOps, Git, and CI/CD.

·Experience with Azure Analytics services.

·Experience working with marketing campaign data and campaign analytics.

·Knowledge of data platform product telemetry analytics.

·Understanding of big data architecture and data engineering best practices.

·Experience with advanced data visualization and dashboarding using Power BI.

·Experience with data pipeline optimization, performance tuning, and cost optimization.

·Strong presentation and whiteboarding skills, with the ability to communicate technical solutions to stakeholders.

·Software engineering mindset, with a focus on clean, scalable, reusable, and maintainable code.