A
Sr. Automation Data Integration Administrator
Apolis
- 🇺🇸 United States
- Remote
- Senior
- 8 hours ago
- $85 – $90 / hour
- IoT
- ETL
- ELT
- Apache Airflow
- Prefect
- CI/CD
- Data Architecture
- Python
- SQL
- IaC
- Terraform
- CloudFormation
- Jenkins
- GitLab
- GitHub Actions
- AWS
- Azure
- GCP
8 hours ago
Senior Automation Data Integration Administrator
Location: Remote- must be local to DMV area
Onsite expectation: Must be willing to go onsite if client asks
Clearance Level: EOD PT, can hold up to a TS/SCI
Must be able to obtain and/or maintain an EOD Public Trust security clearance as a condition and continuation of employment*
This is with a large federal client. As a Senior Automation Data Integration Administrator, you will play a crucial role in enhancing the efficiency and effectiveness of cybersecurity operations. You will work in a dynamic environment, collaborating with cybersecurity professionals, data analysts, and system owners to design and implement automated solutions that reduce manual effort and improve risk visibility.
LCAT:
BS & 15yrs
AS & 18yrs
21 yrs no degree
Project Details / Mission Supported:
- Design, build, and maintain automated data integration pipelines that pull data from multiple sources, including APIs, databases, and IoT systems.
- Develop and support ETL/ELT processes to extract, transform, and load data into enterprise data warehouses and data lakes.
- Monitor data pipelines to ensure data quality, consistency, and accuracy through automated validation, testing, and anomaly detection.
- Troubleshoot and resolve data flow issues, schema changes, and pipeline failures before they impact downstream reporting and analytics.
- Schedule, manage, and optimize data workflows using orchestration tools such as Apache Airflow or Prefect.
- Build resilient, self-healing automation that can automatically recover from failures and scale based on workload demands.
- Create and maintain scripts that identify data anomalies, handle missing data, and ensure sensitive information is properly sanitized and protected.
- Implement CI/CD processes for data pipelines to support reliable deployments and ongoing enhancements.
- Collaborate with technical teams to design integrated data solutions that improve accessibility, performance, and operational efficiency.
- Document data integration processes, workflows, and best practices to support long-term maintainability.
- Ensure all data management activities comply with organizational security, privacy, and governance requirements.
- Continuously evaluate and recommend improvements to data architecture, pipeline performance, and automation capabilities.
Qualified candidates will have the following experience and skills:
- BS/BA and 15 years of applicable experience in data integration and automation
- Demonstrated expertise in Apache Airflow, Prefect, or similar orchestration tools
- Experience with ETL/ELT processes and automation tools
- Knowledge of data quality frameworks and observability systems
- Experience with APIs, databases, and data warehouse/lake technologies
- Strong programming skills in Python, SQL, or similar languages
- Experience with Infrastructure as Code (IaC) tools (Terraform, CloudFormation)
- Knowledge of data catalog and metadata management solutions
- Experience with CI/CD pipelines (Jenkins, GitLab, GitHub Actions)
- Familiarity with cloud platforms (AWS, Azure, GCP)
Sr. Automation Data Integration Administrator · Apolis