PL
data engineer/Big Data Engineer
PeopleNTech LLC
🇺🇸 United States
On-site
10 months ago
- ETL
- ELT
- Python
- SQL
- Redshift
- Snowflake
- PySpark
- AWS
- Hadoop
- Hive
- EMR
- NoSQL
- Databricks
10 months ago
Location- Richmond, VA, VA -Hybrid – Need ex cap1
Contract
Rate 65/hr on C2C
Type: Contractor
Job Description: A data engineer on a project team, responsible for designing, building, and optimizing data pipelines and data stores to support various business intelligence and analytical needs. This role requires a strong understanding of data warehousing concepts, ETL/ELT processes, and experience working with large-scale distributed systems.
Key Responsibilities:
Design, construct, install, test, and maintain robust data management systems.
Build high-performance, scalable data pipelines for data ingestion, transformation, and loading using Python, SQL, and cloud services.
Develop and manage data warehouse solutions (e.g., Redshift, Snowflake) to ensure data integrity and accessibility.
Collaborate with Data Scientists, Analysts, and other stakeholders to understand data requirements and deliver solutions.
Implement monitoring and alerting systems for data pipelines to ensure operational stability and data quality.
Optimize data retrieval and consumption for various analytical use cases.
Ensure compliance with data governance, security, and privacy policies.
Evaluate and recommend new technologies and best practices to improve the data infrastructure.
Basic Qualifications:
Bachelor's Degree with at least 6+ years of work experience
4+ years of experience in application development including Python, PySpark, SQL, etc.
4+ years of experience with a public cloud (AWS preferred)
2+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark)
4+ years of data warehousing experience (Redshift or Snowflake)
2+ years of experience with NoSQL implementation
2+ years of experience with databricks.
data engineer/Big Data Engineer · PeopleNTech LLC