Sr. Data Engineer- AWS

Job Title: Senior Data Engineer (AWS)

Location: Ahmedabad, Gujarat

Experience: 5+ years

Job Type: Full Time

Department: Data Engineering

About Simform:

Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to create seamless digital experiences and scalable products. Simform is a strong partner for Microsoft, Google Cloud, and Databricks. With a presence in 5+ countries, Simform primarily serves North America, the UK, and the Northern European market. Simform takes pride in being one of the most reputed employers in the region, having created a thriving work culture with a high work-life balance that gives a sense of freedom and opportunity to grow.  

Role Overview:

As Senior data engineer you will own end-to-end data pipelines and models across medallion layers, from ingestion to the semantic layer powering our AI query interface. This is an engineering-focused role involving a multi-tenant SaaS data platform with high standards for accuracy, freshness, cost, and reliability.

We use AI-driven, spec-based development, where agents generate Silver, Gold, and Semantic models from source specifications and data contracts. You will build and maintain these contracts, tests, and guardrails to ensure data quality, prevent incorrect joins or duplication, and deliver reliable AI-driven insights across clients.

Key Responsibilities:

• Build and run ingestion across many sources and tenants: managed Fivetran connectors, and custom connector or SFTP builds for sources without coverage (POS, loyalty, Wishlist and email platforms).

• Model data across the medallion layers: source-agnostic Silver, cross-client Gold, and wide, grain-scoped Metric Views that Lexi AI queries.

• Write and maintain the source specs and data contracts our agents generate models from, and the tests that prove generated models are correct.

• Own data correctness: grain, join keys, fan-out, reconciliation back to source, and metric definitions that return the right number.

• Own the engineering workflow for the data platform: CI/CD pipelines, branching strategy, and versioning of pipelines, models and schemas, so changes are reviewed, ship safely, and can be traced and rolled back.

• Keep the platform fast and affordable: decide what to materialise versus keep virtual, tune compute, and watch ingestion volumes and Databricks spend.

• Contribute to platform capabilities such as identity resolution across sources and third-party data enrichment.

• Design for reliability and observability from the start: freshness, volume and quality checks, alerting, and clear runbooks.

• Lift the engineers around you through pairing, code review, ADRs and the standard your own work sets.

Must-Have Skills:

• Strong software engineering fundamentals and experience building, deploying, and maintaining production data pipelines.

• Hands-on experience with Spark, Databricks (or Snowflake/BigQuery), advanced SQL, and Python.

• Strong data modelling skills, including grain, keys, SCDs, metrics, and data reconciliation.

• Experience with multi-tenant SaaS platforms, tenant isolation, and large-scale data processing.

• Experience handling hundreds of millions to billions of rows across multiple data sources.

• Expertise in ELT tools (Fivetran, Airbyte), REST API integrations, and file-based ingestion.

• Experience using AI coding agents for production development, with appropriate testing and guardrails.

• Strong CI/CD, Git, version control, and schema management practices.

• Excellent communication and ability to explain data architecture using C4 or lineage diagrams.

• Working knowledge of AWS.

Strongly Preferred:

• Databricks Unity Catalog and data governance.

• Semantic and metrics layers (Databricks Metric Views, dbt, LookML, Cube).

• CDP, marketing technology, or retail data experience (Shopify, Klaviyo, Braze, POS).

• XP practices, including test-first development, continuous integration, and shared ownership.

Nice to Have:

• Customer identity resolution and entity matching.

• Cloud data platform cost optimisation.

• Legacy data platform modernisation and lakehouse migration.

Why Join Us:

• Young Team, Thriving Culture

• Flat-hierarchical, friendly, engineering-oriented, and growth-focused culture.

• Well-balanced learning and growth opportunities

• Free health insurance.

• Office facilities with a game zone, an in-office kitchen with affordable lunch service, and free snacks.

• Sponsorship for certifications/events and library service.

• Flexible work timing, leaves for life events, WFH, and hybrid options.