DL
GCP Data Engineer
Diverse Lynx India
- Location not stated
- 13 hours ago
- GCP
- SQL
- SSIS
- ETL
- ELT
- Microsoft SQL Server
- BigQuery
- Cloud SQL
- T-SQL
- Compute Engine
- Data Modeling
- Snowflake
- Core Data
- Composer
- Apache Airflow
- Dataflow
- CI/CD
- GitHub Actions
- GitLab CI
- Python
- PowerShell
13 hours ago
PFB JD:
Company: Wipro
Location: PAN India
Employment Type: Full-Time
Experience: 8+ Years
Job Overview
We are seeking a skilled and versatile Data Engineer with strong expertise inGoogle Cloud Platform (GCP),SQL, andMicrosoft SSIS (SQL Server Integration Services). In this role, you will bridge the gap between traditional Microsoft-based data architectures and modern cloud data environments. You will be responsible for designing, building, optimizing, and migrating robust data pipelines, supporting hybrid-cloud structures, and ensuring high-performance data delivery.
Key Responsibilities
- ETL & Data Pipeline Development:
- Design, develop, test, and deploy complex ETL/ELT pipelines usingSSIS and GCP-native data services.
- Migrate, transform, and integrate data from legacy on-premises Microsoft SQL Server environments intoGoogle Cloud Platform (BigQuery, Cloud SQL, Cloud Storage).
- Database & SQL Optimization:
- Write, analyze, and optimize advanced T-SQL/SQL queries, stored procedures, views, and functions.
- Tune database performance, troubleshoot bottlenecks, and manage indexing strategies across relational and cloud databases.
- GCP Infrastructure & Integration:
- Administer and configure data workloads onGCP (Google Cloud SQL for SQL Server, BigQuery, Compute Engine).
- Integrate on-premises or VM-hosted SSIS packages with GCP data repositories using secure cloud connectors or hybrid architectures.
- Monitoring & Maintenance:
- Monitor scheduled ETL jobs, automate maintenance tasks, and configure alerting mechanisms for failures or performance drops.
- Troubleshoot package execution errors, handle exception logic, and ensure data integrity across multi-platform sources.
- Collaboration & Documentation:
- Collaborate with data architects, business analysts, and stakeholders to translate business requirements into technical data mappings.
- Maintain thorough technical documentation for data flows, system architecture, and operational processes.
- Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- SQL Mastery: Deep expertise in Microsoft SQL Server, T-SQL development, query tuning, performance optimization, and relational data modeling (Star/Snowflake schemas).
- SSIS Expertise: Proven track record of designing, deploying, and troubleshooting complexSSIS packages, control flows, data flows, and custom error handling.
- GCP Knowledge: Hands-on experience working withGoogle Cloud Platform (GCP) core data services, specificallyGoogle BigQuery, Cloud SQL, and Compute Engine.
- Hybrid Data Experience: Demonstrated ability in bridging legacy Microsoft tech stacks with cloud environments.
- GCP Data Certifications (e.g.,Google Cloud Professional Data Engineer).
- Experience with modern cloud-native orchestration tools (e.g., Cloud Composer / Apache Airflow, Dataflow).
- Familiarity with CI/CD pipelines (GitHub Actions, GitLab CI, or Cloud Build) for database and ETL deployment.
- Basic scripting skills in Python or PowerShell for automation.
GCP Data Engineer · Diverse Lynx India