EI
Data Engineer (ETL Developer)
Expert In Recruitment Solutions
🇺🇸 United States
On-site
1 month ago
- ETL
- PostgreSQL
- SQL
- Python
- GitLab
- Bash
- Linux
- Unix
- RHEL
- Kubernetes
- Helm
- AWS
- EC2
- RDS
- JSON
- YAML
- CI/CD
- CISSP
- Agile
- Jira
- Confluence
- Oracle
- MySQL
- Git
- Docker
- SFTP
- Flink
- ArgoCD
- Grafana
- Kibana
- Java
1 month ago
we have an immediate need for a Data Engineer. Think lift and shift of data from various data sources.
Preferred Clearance Requirement: TS/SCI w/ CI Poly
Must Clearance Requirement: Top Secret Clearance w/ SCI Eligibility
- They will sponsor CI Poly for candidates who only have Top Secret Clearance
Must have skills/technologies:
- PostgreSQL
- SQL
- Python
Additionally need to have as many as the below as possible but not all required:
- GitLab
- Bash
- Linux/Unix/RHEL
- Kubernetes/Helm
- AWS: EC2, S3, RDS
- Interfaces: REST, Kafka, AMQ, Socket
- Data Configuration: Delimited, JSON, GeoJSON, YAML
he Opportunity:
- Our engineering teams are highly adept at solving complex problems with the application of leading-edge technology, empowering the intelligence and defense communities as they make mission-critical decisions.
- Work in a fast-paced environment with many moving parts while managing several tasks at once. All while bringing a continuous delivery mindset to achieve high availability goals for the flow of data to and through the system.
- Work with external data providers, users, and stakeholders to engineer the ingest and distribution of mission-relevant data feeds into the FADE data ecosystem.
- Utilize modern technologies to create and maintain hundreds of integrated data pipelines across multiple networks, while ensuring data resiliency and reliability.
- Focus on the operations of COTS and GOTS software to ensure low latency and high integrity of quality data through hundreds of pipelines.
- Responsibilities:
- Configure and maintain data ingest workflows (ETL) across multiple production systems
- Install, configure, and update a wide array of COTS/GOTS software applications
- Support and troubleshoot diverse IT infrastructure hardware platforms and protocols
- Work with software development and systems administration staff to monitor and troubleshoot production systems
- Generate and maintain systems documentation and diagrams
- Troubleshoot network issues and establish new connectivity
- Monitor and maintain a variety of databases
Qualifications:
Required:
- Education: Bachelor's degree or equivalent (master's preferred)
- Minimum 3 years of experience with software development programs
- Must be certified to meet DoD 8570 level IAT-II qualifications. Security+ certification or CISSP preferred. This certification must be obtained within 6 months of hire if not already certified and maintained throughout your time in the position.
- Ability to work in a dual-hatted, agile environment while juggling multiple tasks with shifting priorities
- Strong systems engineering background including scripting skills in Python and Bash
- Developing in a Linux environment, Commercial Cloud Systems, (AWS – EC2, RDS, S3)
- Engineering management tools (JIRA/Confluence), RDBMS databases (PostgreSQL, Oracle, MySQL)
- Git version-control system, CI/CD tools such as Docker, Kubernetes, Helm, GITLAB Runners,
- Common data/configuration formats: Delimited, JSON, GeoJSON, YAML, Common API/interfaces: REST, SFTP, Kafka, AMQ, Socket
- Experience with: AWS: Diode, Flink, ArgoCD
- Monitoring tools (Grafana and Kibana)
- Understanding of compiled languages including Java
Data Engineer (ETL Developer) · Expert In Recruitment Solutions