Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com

Sr Data Specialist - R01564133

Brillio
🇮🇳 India
Hybrid
Senior
5 months ago
  • Athena
  • Step Functions
  • PySpark
  • ETL
  • SQL
  • Python
  • EBS
  • AWS
  • EC2
  • Aurora
  • PL/SQL
  • Databricks
  • ELT
  • EMR
  • Hadoop
  • Airflow
  • Apache Spark
  • PostgreSQL
  • Hive
  • Scala
  • Unix
  • Elasticsearch
  • Git
  • SVN
  • HTML
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV
Lead Data Engineer

Primary Skills

  • Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front

Specialization

  • AWS Data EngineerIng Basic: Senior Data Engineer

Job requirements


    Job Description – AWS Senior Data Engineer

    Company: Brillio Technologies
    Role: Senior Data Engineer
    Experience: 5–10 Years
    Location: India (Hybrid/Remote)
    Employment Type: Full-time


    Role Overview

    We are looking for aSenior Data Engineer with strong Databricks and Big Data expertise to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have hands-on experience withSpark, PySpark, AWS ecosystem, and modern data architectures, along with exposure to APIs and real-time data processing.


     Key Responsibilities

    • Design and buildscalable data pipelines using Spark / PySpark on Databricks
    • Develop and optimizeETL/ELT workflows for large-scale data processing
    • Work withAWS EMR, S3, and Hadoop ecosystem for distributed data processing
    • Build and maintaindata lake and data warehouse solutions
    • Develop and integrateAPIs for data ingestion and consumption
    • Implement data processing workflows usingAirflow / Autosys
    • Optimize data performance usingpartitioning, caching, and query tuning
    • Handle structured and semi-structured data from multiple sources
    • Ensuredata quality, governance, and reliability of pipelines
    • Collaborate with cross-functional teams (Analytics, Product, Engineering)

    • Technical Skills (Must-Have)

      • Strong expertise in:
        • Apache Spark / PySpark
        • Databricks (mandatory)
        • SQL (PostgreSQL or similar)
        • Hands-on experience with:
          • AWS EMR, S3
          • Hadoop, Hive ecosystem
          • Programming skills:
            • Python (must-have)
            • Scala (good exposure)
            • Strong knowledge of:
              • UNIX / Shell scripting
              • ETL pipelines and data engineering fundamentals

              • Additional Skills

                • Experience with:
                  • Elasticsearch (data storage & retrieval)
                  • Workflow orchestration tools (Airflow, Autosys)
                  • Exposure to:
                    • API development & integration
                    • Version control tools (Git / SVN)
                    • Basic knowledge ofHTML (for web/data tasks)

                    • Experience Required

                      • Minimum5+ years of Data Engineering experience
                      • Strong hands-on experience inDatabricks + Big Data stack
                      • Proven experience working onlarge-scale distributed systems

                      •  Education

                        • Bachelor’s or Master’s degree inComputer Science, Engineering, or related field

                        • Why Join Brillio

                          • Work oncloud-native, large-scale data platforms
                          • Exposure tocutting-edge Databricks & AWS ecosystems
                          • Collaborative and high-performance engineering culture
                          •  

Sr Data Specialist - R01564133 · Brillio

Auto apply with Likeremote