Data Engineer (DBT + Airflow + Python)

About The Job:

• Shift- 11 am to 9 pm
• 5-8 yrs exp
• Data Engineer (DBT + Airflow + Python) | 5+ Years
• Experience: 5+ Years
• We are looking for an experienced Data Engineer with strong expertise in DBT, Apache Airflow, and Python to design, develop, and maintain scalable data pipelines and transformation frameworks.
• The ideal candidate will have hands-on experience in building modern data platforms, workflow orchestration, ETL/ELT development, and cloud-based data warehousing solutions.

Essential Job Functions:

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python, DBT, and Apache Airflow.
• Build and manage Airflow DAGs for workflow orchestration, scheduling, monitoring, and dependency management.
• Develop reusable and optimized DBT models, snapshots, tests, and macros for data transformation.
• Implement data quality checks, validation frameworks, and reconciliation processes across data pipelines.
• Develop and optimize Python scripts for data ingestion, transformation, automation, and exception handling.
• Work with structured and semi-structured data formats such as JSON, CSV, and Parquet.
• Integrate data from multiple sources into enterprise data warehouses and analytics platforms.
• Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks.
• Collaborate with Data Architects, Analysts, and Business stakeholders to understand and deliver data requirements.
• Ensure adherence to best practices around coding standards, version control, testing, and deployment.
• Participate in production support, incident resolution, and root cause analysis activities.

Qualification
Mandatory Skills

• 5+ years of experience in Data Engineering.
• Strong hands-on experience with DBT (Data Build Tool).
• Strong experience with Apache Airflow including DAG development, scheduling, monitoring, and workflow orchestration.
• Proficiency in Python for ETL development, automation, and data processing.
• Strong SQL skills with experience in writing complex queries and performance tuning.
• Experience developing and supporting enterprise-scale ETL/ELT pipelines.
• Knowledge of data modeling concepts including Star Schema and Dimensional Modeling.
• Experience with Git-based version control systems.

Preferred Skills

• Experience with Snowflake, Redshift, BigQuery, or other cloud data warehouses.
• Experience with AWS services such as S3, Glue, Lambda, or EMR.
• Exposure to CI/CD pipelines and DevOps practices.
• Experience working in Agile/Scrum environments.
• Familiarity with data quality, governance, and observability frameworks.

Nice to Have

• Snowflake Streams, Tasks, Snowpipe.
• DBT Cloud.
• PySpark or Spark.
• Terraform or Infrastructure as Code.
• Monitoring and alerting tools.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.

Key Skills

• DBT
• Apache Airflow
• Python
• SQL
• ETL
• ELT
• Data Engineering
• Snowflake
• AWS
• Data Warehousing
• Data Modeling
• CI/CD
• Git
• Cloud Data Platforms

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral Program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

• 0-2 years – INR 5,000
• 2-6 years – INR 7,500
• 6+ years – INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.