VI
GCP Big Query, Dataproc, Pub Sub, Airflow
VARITE INDIA PRIVATE LIMITED
- 🇮🇳 India
- On-site
- 10 months ago
- Python
- PySpark
- SQL
- NoSQL
- ETL
- Apache Airflow
- Talend
- Informatica
- Devops
- GCP
- Data Modeling
- Git
10 months ago
About The Client:
Client is an Indian multinational technology company specializing in information technology services and consulting. Headquartered in Mumbai, it is a part of the Tata Group and operates in 150 locations across 46 countries.
Essential Job Functions:
- Design, develop, and maintain scalable data pipelines for extracting, transforming, and loading data from various sources to ensure seamless data flow and accessibility.
- Collaborate with cross-functional teams to integrate data from multiple disparate sources, ensuring consistency, accuracy, and reliability of data.
- Optimize data processing workflows and storage solutions for performance, scalability, and cost-efficiency
- Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data throughout the data lifecycle.
- Monitor the performance of data pipelines and infrastructure, identifying and resolving issues to maintain system stability and reliability.
- Experience: 6+ yrs.
Must-Have**(Ideally should not be more than 3-5)
- Expertise in Google Data Engineering services – Big Query, Dataproc etc
- Strong experience in programming languages such as Python, PySpark data manipulation and engineering tasks.
- Expertise in SQL and NoSQL databases
- In-depth knowledge of data warehousing solutions
- Deep understanding on data warehousing concepts
- Proficiency in designing, developing, and maintaining ETL (Extract, Transform, Load) processes using tools like Apache Airflow, Talend, or Informatica.
Good-to-Have(Ideally should not be more than 3-5)
- Understanding of DevOps Concepts in GCP.
- Strong understanding of data modeling concepts and techniques to create efficient and scalable data models.
- Experience with version control systems such as Git for code management and collaboration.
- Knowledge of data governance, data quality standards, and data security practices to ensure compliance and protection of sensitive information
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
GCP Big Query, Dataproc, Pub Sub, Airflow · VARITE INDIA PRIVATE LIMITED