Technical Leader - Software

Altimetrik

🇮🇳 India

On-site

5 months ago

Apache Spark
PySpark
Databricks
AWS
Azure
SQL
Devops
CI/CD
Jenkins
Git
GitHub
Python
AWS S3
EMR
EC2
IAM
CloudWatch
Apache Kafka
Snowflake
Airflow
Delta Lake
ETL
ELT
Apache Airflow
Bitbucket

5 months ago

Auto apply with Likeremote

Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV

Core Technologies• Apache Spark (Core, Structured Streaming)• PySpark• Databricks (AWS/Azure)• Advanced SQL DevOps & CI/CD• Jenkins• Git/GitHub/BitbucketProgramming• Python• SQLCloud & Infrastructure• AWS (S3, EMR, EC2, IAM, CloudWatch)• Databricks Runtime & Cluster Management- PreferredStreaming & Integration• Apache Kafka• Snowflake integration (preferred)• Airflow (preferred)Preferred Qualification• Experience in financial services, payouts, or enterprise data platforms.• Hands-on experience in Delta Lake optimization and incremental processing strategies.• Experience with Snowflake data warehousing.• Strong understanding of distributed computing principles. Key Responsibilities• Design and develop scalable batch and near-real-time ETL/ELT pipelines using Snowflake (AWS) and Apache Spark (PySpark, Spark SQL, Structured Streaming).• Build structured streaming pipelines using Kafka and Spark Structured Streaming.• Design dimensional data models (Fact/Dimension, SCD Type 2).• Orchestrate pipelines using Databricks Workflows / Apache Airflow.• Integrate CI/CD pipelines using Jenkins, Git, Bitbucket/GitHub for automated deployment across DEV/UAT/PROD.

Technical Leader - Software · Altimetrik

Auto apply with Likeremote