Senior Data Software Engineer

We are looking for an experiencedSenior Data Software Engineer to play a key role in designing, developing, and maintaining scalable data systems and pipelines.

Responsibilities

• Build, optimize, and maintain data processing pipelines to handle large-scale datasets
• Develop software solutions to integrate, transform, and analyze data effectively
• Collaborate with cross-functional teams, including data scientists, analysts, and cloud architects, to deliver high-quality solutions
• Ensure the reliability, scalability, and security of data systems
• Leverage cloud platforms to deploy and manage data solutions
• Work with distributed computing technologies like Apache Spark to process and analyze large datasets
• Monitor and debug systems, resolving issues, and optimizing performance
• Document technical processes and ensuring adherence to best practices
• Stay updated with the latest advancements in data engineering tools, frameworks, and technologies

Requirements

• 3+ years of experience in a data engineering role
• Proficiency in Python, with solid experience developing robust and scalable code
• Hands-on experience with cloud platforms (e.g., AWS, Microsoft Azure, or Google Cloud Platform) for deploying and managing data solutions
• Expertise in working with Apache Spark/PySpark for large-scale data processing
• Strong understanding of data modeling, ETL processes, and database design
• Familiarity with containerization technologies (e.g., Docker, Kubernetes)
• Knowledge of version control systems such as Git
• Excellent command of professional English (B2 level), both written and verbal, to effectively communicate with the engineering team

Nice to have

• Experience with workflow orchestration tools (e.g., Apache Airflow)
• Familiarity with machine learning pipelines and tools
• Knowledge of CI/CD processes for automating deployments