Likeremote

Subscribe to the latest remote jobs:

  • Likeremote jobs on https://LinkedIn.com/
  • Likeremote jobs on https://telegram.org/
  • Likeremote jobs on Reddit.com
VS

Big Data Sr. Big Data Engineer (Framework CoE)

Veterans Sourcing Group
  • 🇺🇸 United States
  • On-site
  • Senior
  • 9 months ago
  • Hadoop
  • Snowflake
  • Apache Spark
  • Unix
  • Python
  • SQL
  • GitHub
  • Devops
  • CI/CD
  • AWS
  • Informatica
  • ETL
  • Hive
  • Azure
9 months ago
Auto apply with Likeremote
Not scoredNo CV on file. Upload one and this job gets a score out of 100.Upload CV
JOB DESCRIPTION

Sr. Big Data Engineer (Framework CoE)
Work Type: Hybrid (Alpharetta, GA)
Type: Contract-to-Hire ( must be able to convert)
Work Authorization: US Citizen or GC holders only
Interview Process: 1st round Zoom (1 hour) + 2nd round interview
Education: Bachelor's degree required

Role Snapshot
This role supports Client's Wealth Management's Framework CoE team (Data Platforms Governance). You'll split time between:
  • 50% supporting existing Hadoop production (hands-on)
  • 50% building / enhancing frameworks for Hadoop → Snowflake migration (understanding existing frameworks + modernization)
The team needs someone with a strong sense of ownership who can automate processes, build utilities, code, review code, test frameworks, and contribute to architecture/design.

MUST-HAVE Skills (Non-Negotiable)
  • Hadoop / Big Data experience
  • Hands-on Apache Spark
  • Strong UNIX + Python & Shell scripting
  • Strong hands-on SQL (querying + optimization)
  • Working knowledge of GitHub, DevOps, and CI/CD pipelines
Important: Candidate resume must clearly show how they used Hadoop/Spark/Unix/Python/SQL + CI/CD (projects, environment, impact).

NICE-to-Have
  • 7+ years of experience
  • Snowflake and/or AWS exposure
  • IDMC (Informatica Cloud) or any ETL/Data Integration tool
  • Financial Services experience (highly desirable)

Key Responsibilities
  • Design & develop new automation framework for ETL processing
  • Support the existing framework; become technical POC for related teams
  • Enhance ETL automation framework based on requirements
  • Performance tuning for Spark and Snowflake ETL jobs
  • Run POCs and suitability analysis for cloud migration
  • Process optimization through automation + utility development
  • Partner with teams on issues and new features
  • Support batch issues and application team queries

Required Skills
  • 7+ years data engineering experience
  • Strong in UNIX Shell + Python scripting
  • Strong in Spark
  • Strong SQL
  • Hands-on knowledge: HDFS / Hive / Impala / Spark
  • Logical reasoning + problem-solving mindset
  • Familiar with GitHub, DevOps, CI/CD / enterprise code management tools
  • Strong communication + collaboration
  • Self-driven; able to prioritize and resolve issues with minimal supervision
  • Good to have: Snowflake + any integration tool (ex: Informatica Cloud)

Primary Skills
  • Python | Big Data | Apache Spark
  • Desired Skills
  • Snowflake / Azure / AWS (any cloud)
  • IDMC / any ETL tool

Big Data Sr. Big Data Engineer (Framework CoE) · Veterans Sourcing Group

Auto apply with Likeremote