Senior Data Software Engineer

We are seeking aSenior Data Software Engineer to design and build scalable data pipelines and platforms that power analytics, reporting, and AI-driven initiatives. In this role, you will work closely with Product, Engineering, and Business teams to deliver robust, high-quality data solutions using modern cloud and big data technologies.

Responsibilities

• Design and develop scalable batch and streaming data pipelines
• Build and optimize Databricks, Spark, and Kafka-based solutions
• Implement data quality, governance, and observability standards
• Develop data models and reporting foundations for analytics and AI initiatives
• Partner with Product, Engineering, and Business teams to deliver data-driven solutions
• Support enterprise reporting, dashboards, and self-service analytics platforms
• Leverage AI tools such as Claude Code, GitHub Copilot, and similar platforms for development, testing, and productivity improvements
• Apply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflows

Requirements

• 3+ years of experience in data engineering or a related field
• Proficiency in SQL, Python, PySpark, Scala, and Java
• Expertise in Apache Spark, Spark SQL, Kafka, and Delta Lake
• Skills in Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB)
• Familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB, and Azure Monitor
• Knowledge of Data Modeling, Data Quality, Data Governance, and PII Handling
• Background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2
• Competency in Azure DevOps, Git, CI/CD, and Gradle
• Proficiency in English at a B2+ level

Nice to have

• Familiarity with Tableau, ThoughtSpot, Cognos, and Data Visualization Best Practices
• Knowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks Genie
• Understanding of scalable data platforms, analytics, and reporting solutions