VI
Principal Data Engineer(Aws)
VARITE INDIA PRIVATE LIMITED
🇮🇳 India
On-site
Staff / Principal
11 months ago
- Python
- JVM
- GCP
- Databricks
- dbt
- Airflow
- Docker
- Kubernetes
- Parquet
- Delta Lake
- IaC
- Terraform
- CloudFormation
- Datadog
- Prometheus
- Grafana
- CI/CD
- GitHub Actions
- ArgoCD
- Jenkins
- Unit Testing
- Test Automation
11 months ago
About The Client:
Client is a pioneering Software Engineering and IT consultancy company, transforming and executing at the intersection of Domain and Technology to create digital leaders for our people, clients, partners, and communities.
About The Job:
- About the team: As a Principal Data Engineer in the Data Warehouse team you will be relied on to lead a team of Sr. Data Engineers, propose Architecture, solve complex situations and data model, interact directly with client for requirement gathering, build a holistic roadmap, identify risks and have mitigation strategy,
- develop and deliver high-quality features and finish tasks to a high standard.
- You’ll be part of an emerging team, focussing on building and improving our innovative BNL Data Warehouse offerings applying marketing suites.
What we are looking for
- For this position the ideal candidate has 10+ years of experience in software development, and with data structures/algorithms with a focus on backend and data engineering.
- overall 10 + years of experience in data engineering with 4+ years leading team
- 8+ years of hands-on experience in using Python, JVM and Shell Scripting with production experience.
- 5+ years of proven experience on building cloud native data intensive applications, Client Web Service experience is a must and good to have experience in GCP.
- Experience on Data Warehouse design and development per the business nature using any of the modern data warehouses.
- Having experience in Databricks and dbt experience is required.
- Highly proficient in architecting and implementing workflow management systems, Airflow is a must.
- Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
- Hands-on experience of building and maintaining Spark applications.
- Fundamental understanding of Parquet, Delta Lake and other OTFs file formats.
- Proficiency on an IaC tool such as Terraform, CDK or CloudFormation is a must.
- Experience with observability systems (such as Datadog or Prometheus/Grafana)
- Strong experience on building CI/CD processes, experience with GitHub Actions, ArgoCD or Jenkins is good to have.
- Experience with unit testing and test automation frameworks.
- propose and review Architecture
- solve complex situations and data model
Soft skills:
- Lead a team of 4-5 Sr.Engg
- client communication and Requirement gathering
- interact directly with client for requirement gathering
- build a holistic roadmap
- identify risks and have mitigation strategy
- Comfortable providing, receiving constructive feedback, particularly while participating in code reviews and ability to not only code, but also provide good quality readable business documentation.
- Focus on business value vs engineering interest and focus on business value vs engineering interest.
- Pro-active / service-oriented towards our internal customers
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral:
| 0-2 years | INR 5,000 |
| 2-6 years | INR 7,500 |
| 6+ years | INR 10,000 |
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer:
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
Principal Data Engineer(Aws) · VARITE INDIA PRIVATE LIMITED