RC
Software Engineer III
Reflexive Concepts
🇺🇸 United States
6 months ago
- Dataflow
- Apache Spark
- Linux
- Bash
- Python
- Java
- Apache Airflow
- SQL
- MySQL
- MariaDB
- PostgreSQL
- Jupyter
- Pandas
- NumPy
- Parquet
- JSON
- XML
- Git
- Slurm
- Atlassian
- Jira
- Confluence
6 months ago
In this role, the engineer will leverage extensive expertise in dataflow design, data transport mechanisms, and Apache Spark-based distributed processing to design, implement, and optimize data ingress/egress pathways, ensuring efficient, scalable, and reliable processing of the organization's analytics workloads.
Qualifications:
- Active TS/SCI + FS Polygraph
- Master's degree in Computer Science or related discipline from an accredited college or university, plus 5 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
- Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus 7 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR
- 9 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.
- Experience using the Linux CLI and Linux tools
- Experience developing Bash scripts to automate manual processes
- Recent software development experience using Python and Java
- Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
- Experience with Distributed Big Data processing engines including Apache Spark
- Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
- Experience using Jupyter Notebook
- Experience with data wrangling and preprocessing using tools such as pandas, NumPy
- Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
- Familiarity with data quality concepts, data validation, and anomaly detection
- Experience with Git Source Control System
- Familiar with HPC Job Scheduling tools including Slurm
- Experience using the Atlassian Tool Suite (JIRA, Confluence)
Software Engineer III · Reflexive Concepts