Lead Data Engineer - R01553055

Primary Skills

• GCP, Big Query, Python, Airflow, SQL, DBT

Job requirements

• About the Role
• We are seeking aSenior Data Engineer with deep expertise inGoogle Cloud Platform (GCP) andBigQuery to lead cloud modernization initiatives, develop scalable data pipelines, and enable real-time data processing for enterprise-level systems. This is a high-impact role focused on driving the transformation of legacy infrastructure into a robust, cloud-native data ecosystem.
• 
  
• Key Responsibilities
• 1.Data Migration & Cloud Modernization
• Analyze legacy on-premises and hybrid cloud data warehouse environments (e.g., SQL Server).
• Lead the migration of large-scale datasets toGoogle BigQuery.
• Design and implement data migration strategies ensuring dataquality,integrity, andperformance.
• 2.Data Integration & Streaming
• Integrate data from various structured and unstructured sources, includingAPIs,relational databases, andIoT devices.
• Buildreal-time streaming pipelines for large-scale ingestion and processing of IoT and telemetry data.
• 3.ETL / Data Pipeline Development
• Modernize and refactor legacySSIS packages intocloud-native ETL pipelines.
• Develop scalable, reliable workflows usingApache Airflow,Python,Spark, andGCP-native tools.
• Ensure high-performance data transformation and loading intoBigQuery for analytical use cases.
• 4.Programming & Query Optimization
• Write and optimize complexSQL queries, stored procedures, and scheduled jobs within BigQuery.
• Developmodular,reusable transformation scripts usingPython,Java,Spark, and SQL.
• Continuously monitor and optimizequery performance andcost efficiency in the cloud data environment.
• 
  
• Required Skills & Experience
• 5+ years inData Engineering with a strong focus on cloud and big data technologies.
• Minimum2+ years of hands-on experience with GCP, specificallyBigQuery.
• Proven experience migrating on-premise data systems to thecloud.
• Strong development experience withApache Airflow,Python, andApache Spark.
• Expertise instreaming data ingestion, particularly inIoT or sensor data environments.
• StrongSQL development skills; experience withBigQuery performance tuning.
• Solid understanding ofcloud architecture,data modeling, anddata warehouse design.
• Familiarity withGit and CI/CD practices for managing data pipelines.
• 
  
• Preferred Qualifications
• GCP Professional Data Engineer certification.
• Experience with modern data stack tools likedbt,Kafka, orTerraform.
• Exposure toML pipelines,analytics engineering, orDataOps/DevOps methodologies.
• 
  
• Why Join Us?
• Work with cutting-edge technologies in a fast-paced, collaborative environment.
• Lead cloud transformation initiatives at scale.
• Competitive compensation and benefits.
• Remote flexibility and growth opportunities.