EI
Data Engineer
Expert In Recruitment Solutions
🇺🇸 United States
Remote
2 months ago
- Azure
- GCP
- AWS
- SQL
- Python
- Snowflake
- BigQuery
- Composer
- Dataflow
- Azure Databricks
- Azure Data Factory
- Delta Lake
- Apache Airflow
- Databricks
- CI/CD
- Devops
2 months ago
This person would be joining their PUMA project for the PBM underwriting team, specifically the Data forecasting modeling side.
**This person needs to have experience handling large Data volume sets, as this project is primarily around a data processing engine which is built in Azure/ GCP.
Core Skills:
-GCP/ Azure (not AWS)
-SQL
-Python
-Backend API development
-Spark
-Need at least 5-7 years of experience
·also wants someone to have at minimum 2-3 years of experience outside of their masters as well.
Start:ASAP
Location: Prefers Dallas because team is there they go in once every other week they will have to follow the team cadence. Would do remote for the right person.
Please see the JD he shared below:
We are seeking a skilled Data engineer with 5-6+ years of experience for our DFM Team.
·Professional experience in building data transformation and processing solutions using SQL, Python or similar programming language.
·Experience on handling large volume of data using Spark, on any cloud platform like GCP, Azure, AWS, Snowflake.
·Experience in multiple tools and programming languages to analyze and manipulate data sets from disparate data sources.
·Hands-on experience in programming using Python, SQL, and/or shell scripting.
·Experience with Google Cloud Platform (GCP) using tools like BigQuery, Cloud Composer, Dataproc and Dataflow.
·Experience with Azure ,Data Bricks, Azure Data Factory and Delta Lake.
·Experience building APIs in Python.
·Experience building large-scale applications and high-volume data pipelines.
·Working knowledge of orchestration tools, such as Apache Airflow, Azure Data Factory, Databricks Workflow.
·Ability to understand complex systems and solve challenging analytical problems.
·Excellent problem-solving skills and critical thinking ability.
·Strong collaboration and communication skills within and across teams.
To provide you more context around what we are seeking, along with other qualifications mentioned above we are looking for following experience -
1.Candidates having at least 2-3 years' experience after Master or having 6+ years of hands-on experience .
2.We are seeking strong candidates with diverse experience such asData engineer with API integration Expertise,DE with UI Development experience or a combination of different skillsets.
3.We are looking for actual backend API development using python(preferable) or programming language not CICD or Devops kinds of Integration development.
A combination of technical proficiency ,practical expertise and capability to work effectively in collaborative environment is essential for this role.
Data Engineer · Expert In Recruitment Solutions