NC
Senior Architect- Databricks
NR Consulting - India
- 🇮🇳 India
- On-site
- Senior
- 17 hours ago
- Databricks
- triage
- Airflow
- ETL
- Snowflake
- AI
- Delta Lake
- SQL
- Python
- PySpark
- AWS
- Azure
- Kinesis
- Apache Kafka
- Hadoop
- Hive
- NoSQL
- MongoDB
- Cassandra
- Neo4j
- Terraform
- CircleCI
- Git
- PL/SQL
- Unix
- Agile
- GCP
- Unity Catalog
- dbt
17 hours ago
Location: PAN India
Exp: 14-19 Years
Job Description:
requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications:
● Bachelor's and/or master's degree in computer science or equivalent experience.
● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in AWS/ Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
● Experience working with structured and unstructured data including imaging & geospatial data.
● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
● Should have experience working in Agile methodology.
Job Description:
• 15+ Years of experience in Data & Analytics with Good Communication and presentations skills.
• At least 2 years' experience in Databricks implementations, 2 large scale data warehouse end-to- end
implementation experience.
• Must have Databricks certified architect.
• Proficiency in SQL and experience with scripting languages (e.g., Python, spark, Py spark) for data manipulation
and automation.
• Solid understanding of cloud platforms (AWS, Azure, GCP) and their integration with Databricks.
• Familiarity with data governance and data management practices. exposure to Data sharing, unity catalog, DBT,
replication tools, performance tuning will be added advantage / must have skills
Senior Architect- Databricks · NR Consulting - India