Data Engineer – GCP Data Products Team

Key Responsibilities

• Develop and maintain scalable data solutions for cloud-based data products.
• Design and implement data processing solutions using distributed data processing frameworks.
• Build and manage data ingestion, transformation, and messaging pipelines.
• Design scalable data models to support varied access patterns and business requirements.
• Work with multiple database technologies, including relational, NoSQL, MPP, and columnar databases.
• Develop and optimize data solutions using cloud data services, preferably on GCP.
• Collaborate on data engineering initiatives involving large-scale and distributed data processing.

Required Technical Skills

• Strong programming skills in Java (preferred), Python, or Scala.
• Hands-on experience with cloud data services, preferably GCP; Azure/AWS experience is also acceptable.
• Practical experience with distributed data processing frameworks such as Spark (Core/SQL/Streaming), Flink, or Storm.
• Experience with multiple database technologies, including relational, NoSQL, MPP, and columnar databases.
• Strong knowledge of data ingestion, transformation, and messaging systems such as Kafka, Pulsar, and Pub/Sub.
• Strong understanding of scalable data modeling for varied access patterns.