VI
Senior Data Engineer Apache airflow expert
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- On-site
- Senior
- 10 months ago
- Salesforce
- Adobe
- AWS
- Apache Airflow
- Airflow
- PySpark
- ETL
- dbt
- Snowflake
- AWS Cloud
- ELT
- Redshift
- SQL
- Devops
- CI/CD
- Python
- ECS
- EKS
- IAM
- Docker
- Terraform
- GitHub Actions
- Jenkins
- Kubernetes
10 months ago
About The Client:
Visionet is a premier digital technology solutions company built on the premise of disruptive innovation. For over 27 years, our innovation-centric and engineering-first approach has unlocked digital-driven success to over 350+ global enterprises across Client, Retail, Banking & Financial Services, Food & Beverage, Manufacturing & Distribution, and Life Sciences industries. Our strategic technological alliances with Microsoft, Google, Salesforce, Adobe and AWS, as well as accolades like Microsoft Partner of the Year 2021 and EY Entrepreneur of the Year 2021, are a testament to our expertise in delivering seamless digital transition. With a talent pool of more than 9,500 passionate engineers and digital consultants across 14 distinct locations around the world, we engineer agility and provide innovation-driven value to our clients.
About The Job:
- We are looking for an experienced Apache Airflow Expert to design and manage complex data workflows in our AWS-based data platform.
- The ideal candidate will have deep expertise in Airflow orchestration, PySpark ETL development, dbt transformations, and Snowflake data pipelines, with a strong background in data engineering and AWS cloud technologies.
- Design, build, and maintain complex Airflow DAGs for orchestrating ETL/ELT workflows across AWS, PySpark, dbt, and Snowflake.
- Integrate and optimize data pipelines using AWS services (S3, Glue, Lambda, Redshift) and ensure reliability, scalability, and cost efficiency.
- Develop and manage PySpark-based data processing workflows for batch and streaming data.
- Implement and orchestrate dbt transformations within Airflow for modular and version-controlled SQL workflows in Snowflake.
- Ensure data quality, observability, and lineage tracking with robust monitoring, logging, and alerting systems.
- Collaborate with data, analytics, and DevOps teams to streamline CI/CD, automate deployments, and enforce data governance standards.
- 6 to 8 years of experience in data engineering with hands-on expertise in Apache Airflow (core and MWAA).
- Strong Python and PySpark skills for data processing and Airflow customization (custom operators, sensors, hooks).
- Proven experience with dbt (data build tool) for SQL transformation pipelines and Snowflake for data warehousing.
- Deep understanding of AWS services: S3, Glue, Lambda, ECS/EKS, Redshift, and IAM.
- Experience with Docker, Terraform, and CI/CD pipelines (GitHub Actions, Jenkins, or similar).
- Apache Airflow, Pyspark, DBT, Snowflake, AWS,
- Desirable Skills
- Terraform, CICD, Kubernetes, AWS Data Catalog, AWS DQ, PyDQ, PyDqoo
How to Apply:Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Senior Data Engineer Apache airflow expert · VARITE INDIA PRIVATE LIMITED