Senior Data Engineer

Key Responsibilities : • Design, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory, Azure Data Bricks, and. other Azure services. • Implement and optimize data storage solutions using Azure Data Lake, Azure SQL Database, and Delta Lake to support analytics and reporting needs. • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality, reliable datasets. • Ensure data security, compliance, and governance by applying best practices, role-based access control (RBAC), and encryption. • Monitor and troubleshoot data workflows, ensuring performance, reliability, and cost-efficiency across Azure cloud environments. • Automate data integration and transformation tasks using Azure Functions, Logic Apps, and scripting languages like Python. • Mentor junior engineers and foster a collaborative team environment.

Essential Qualifications: • Bachelor's degree in computer engineering, Computer Science, or a related discipline • 7+ years of experience in ETL design, development, and performance tuning using the Microsoft Stack in a multi-dimensional data warehousing environment. • 7+ years of advanced SQL programming expertise (PL/SQL, T-SQL) • 5+ years of experience in Enterprise Data & Analytics solution architecture • 3+ years of experience in Python Programming • 3+ years of hands-on experience with Azure, especially for data-heavy/analytics applications leveraging relational and NoSQL databases, Data Warehousing, and Big Data solutions. • 3+ years of experience with key Azure services: Azure Data Factory, Data Lake Gen2, Analysis Services, Databricks, Blob Storage, SQL Database, Cosmos DB, App Service, Logic Apps, and Functions • 2+ years of experience designing data models aligning with business requirements and analytics needs. • 2+ years of experience defining and implementing data security standards, including encryption, auditing, and monitoring. • Strong analytical skills and a passion for intellectual curiosity

Preferred Skills: • 2+ years of experience setting up and operating data pipelines using Python or SQL • Familiarity with DevOps processes (CI/CD) and infrastructure as code • Knowledge of Master Data Management (MDM) and Data Quality tools • Experience developing REST APIs using Java Spring Boot, Python • Experience building and supporting AL/ML software solutions • Familiarity with stream-processing systems (e.g., Event Hubs, Storm, Spark-Streaming) • Experience with API integrations (RESTful, SOAP) for both internal and external systems to enhance data flow and automation. • Experience working in Agile environments, familiarity with Agile tools like Jira or Azure DevOps. • Experience in data and analytics within the Life Sciences