AWS Data Engineer / DataBricks Data Engineer

Data Engineer Job Description
We are searching for a talented and motivated Data Engineer with experience designing and deploying end to end data lake solution in AWS , AWS ETL tools, AWS Databases, Python, Kafka, Spark, Advance SQL

You will:

Design, develop, and maintain scalable and efficient data pipelines
Collaborate with various stakeholders to define and implement data engineering strategies
Lead the establishment of CI/CD pipelines for data operations
Help define and set up the development environment for data engineering projects
Utilize AWS data services (e.g., AWS Glue, AWS databases) to optimize data processes

About you:

Proven experience in a Data Engineer or similar role, with a solid background in data architecture and pipeline design
Expertise in CI/CD tools and methodologies
Proven experience with AWS data services
Proficient in at least one programming language suitable for ETL development (Python preferred)
Ability to work in a rapidly evolving environment and to contribute to the establishment of new engineering capabilities
Advanced problem-solving skills and ability to think strategically
Solid communication and collaboration skills
AWS Certified Data Engineer (would be a bonus)


Technical Skills
-----------------
# Primary : Lead Data Engineer Proficient in AWS and advanced SQL. Designing and building pipelines, Data Ingestion, Transformation, Orchestration.
# Secondary: Python, Pyspark, CI/CD exposure, ETL, Airflow on Prem, API development, Airflow on AWS, Batch data ingestion , transformation