Data Engineer
- ETL
- SQL
- Agile
- Java
- Scala
- Python
- Apache Spark
- Hadoop
- AWS Glue
- JSON
- Parquet
- YAML
- Apache Avro
- Apache Airflow
- Redshift
- Data Visualization
- Tableau
- Kubernetes
- Machine Learning
Position Summary
We are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.Role and Responsibilities
Duties & Responsibilities:
Responsibilities Include:
• Implement, maintain and evolve cloud-based Big Data products and services
• Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
• Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
• Modify structured and unstructured data to provide meaningful reports to business
• Write large amounts of code, perform code reviews, write unit tests
• Write documentation
• Interface with other groups including Product Management, QA and Operations
• Create quick proof-of-concept prototypes
• Participate in an agile team
Work Experience:
At least 2 years relevant work experience
Skills & Competencies:
• Working experience in software development using Java, Scala, or Python is a must
• Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
• Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
• Experience managing and scheduling workflows (Apache Airflow experience is preferred)
• Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
• Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
• Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
• Ability to perform ad-hoc complex SQL queries and query optimization
• Team player with strong communication skills
• Desire to learn fast and pick up latest technologies and tools
• Experience with data visualization software (Tableau preferred) is a plus
• Experience with Kubernetes and Machine Learning is a plus
Skills and Qualifications
* Please visitSamsung membership to see Privacy Policy, which defaults according to your location. You can change Country/Language at the bottom of the page. If you are European Economic Resident, please clickhere.
Data Engineer · Samsung Electronics America, Inc.