Data Engineer
- ๐ฎ๐ณ India
- On-site
- Mid level
- 6 hours ago
- AI
- Machine Learning
- Snowflake
- SQL
- ETL
- ELT
- Python
- AWS
- Azure
- GCP
- AWS S3
- Informatica
- Talend
- Azure Data Factory
- Apache Airflow
- dbt
- CI/CD
- Git
About The Client:
A global IT services and consulting company, multinational information technology (IT), headquartered in Tokyo, Japan. The Client offers a wide array of IT services, including application development, infrastructure management, and business process outsourcing. Their consulting services span business and technology, while their digital solutions focus on transformation and user experience design. It excels in data and intelligence services, emphasizing analytics, AI, and machine learning. Additionally, their cybersecurity, cloud, and application services round out a comprehensive portfolio designed to meet the diverse needs of businesses worldwide.
About The Job:
- We are looking for an experienced Data Engineer with strong Snowflake expertise to design, develop, and maintain scalable data pipelines and data solutions.
- The ideal candidate should have hands-on experience with Snowflake, SQL, ETL/ELT processes, cloud data platforms, and data integration.
Essential Job Functions:
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
- Develop and optimize data solutions using Snowflake.
- Write complex and performance-optimized SQL queries.
- Develop data transformations, stored procedures, views, and tables in Snowflake.
- Work with large and complex datasets and ensure data quality and consistency.
- Integrate data from multiple sources into Snowflake.
- Develop and maintain batch and incremental data pipelines.
- Implement data validation, monitoring, and error-handling mechanisms.
- Optimize Snowflake queries, warehouse usage, and overall data-processing performance.
- Collaborate with Data Analysts, Data Scientists, Architects, and business stakeholders to understand data requirements.
- Troubleshoot data pipeline and production issues.
- Follow data governance, security, and development best practices.
Qualifications:
Mandatory Skills
- Strong hands-on experience with Snowflake.
- Strong SQL skills.
- Experience in ETL/ELT development.
- Strong experience with Python for data engineering.
- Experience with data warehousing concepts and dimensional modeling.
- Experience working with large datasets and complex data transformations.
- Good understanding of cloud-based data platforms.
Good to Have
- Experience with AWS / Azure / GCP.
- Experience with AWS S3, Azure Data Lake, or equivalent cloud storage.
- Experience with ETL tools such as Informatica, Talend, Matillion, or Azure Data Factory.
- Experience with Apache Airflow or similar orchestration tools.
- Experience with dbt.
- Knowledge of CI/CD and Git.
- Experience with data governance and security in Snowflake.
- Knowledge of Snowflake features such as Streams, Tasks, Snowpipe, Dynamic Tables, and Time Travel.
Education
- Bachelors degree in computer science, Information Technology, Engineering, or a related field.
Key Competencies
- Strong analytical and problem-solving skills.
- Good communication and stakeholder-management skills.
- Ability to work independently as well as in a team.
- Strong focus on data quality, performance, and reliability.
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visitJobs In India โ VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the preferred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
- 0-2 years - INR 5,000
- 2-6 years - INR 7,500
- 6+ years - INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Data Engineer ยท VARITE INDIA PRIVATE LIMITED