TC
AWS Data Engineer
TechDigital Corporation
Location not stated
Remote
11 months ago
- AWS
- PySpark
- AWS Glue
- ETL
- EMR
- SQL
- Redshift
- Kinesis
- Airflow
- Step Functions
- Snowflake
11 months ago
- Skill Matrix: Overall 10+ years of specialization in data engineering in data warehouse and data mesh implementations
- Must have 4 years of relevant experience in AWS tech stack - Writing PySpark, AWS Glue scripting (ETL & Crawler), EMR, Datasync, DMS, SQL, Redshift
- Possesses experience in technologies such change data capture(CDC), data quality, Kafka and Kinesis data streams, Airflow, Step Functions, and Lambda
- Knowledge on table formats such as Iceberg and Delta tables
- Has experience in metadata management building data catalog in alignment with business glossary
- Has knowledge of data governance aspects such as data lineage, data quality. Should have built data validation frameworks to reconcile source and target data
- Hands-on expertise with data modelling, ETL pipelines, and performance optimization.
- Solid background in Data Warehousing concepts (star/snowflake schema design, dimensional modelling, and reporting enablement)
AWS Data Engineer · TechDigital Corporation