A
Apache NiFi Resource
Apolis
🇺🇸 United States
Hybrid
3 months ago
$65 – $68 / hour
- Apache NiFi
- ETL
- JSON
- XML
- Apache Avro
- Parquet
- IoT
- PLC
- SCADA
- MQTT
- OPC UA
- Modbus
- DNP3
- Ethernet/IP
- TLS
- Groovy
- Python
- Java
- Elasticsearch
- Linux
- Unix
- SSL/TLS
- CI/CD
- Git
3 months ago
- Strong understanding of Apache NiFi:
- Experience designing, developing, and deploying data flows using NiFi.
- Knowledge of NiFi processors, controller services, templates, and reporting tasks.
- Ability to configure and optimize NiFi for performance and reliability.
- Data Integration and ETL skills:
- Experience with data ingestion, transformation, routing, and system integration.
- Familiarity with common data formats (JSON, XML, CSV, Avro, Parquet).
- Understanding of batch and real-time data processing concepts.
- IoT Data Processing with NiFi:
- Experience ingesting and processing IoT data from industrial sensors, PLCs (Programmable Logic Controllers), SCADA systems, and other ICS devices.
- Familiarity with industrial communication protocols such as MQTT, OPC-UA, Modbus, DNP3, and Ethernet/IP.
- Ability to design NiFi flows for real-time telemetry data collection, anomaly detection, filtering, enrichment, and routing within ICS environments.
- Handling high-volume, time-sensitive data streams with strict latency and reliability requirements.
- Integration with industrial IoT platforms, historians, time-series databases, and analytics/monitoring tools.
- Understanding of ICS-specific security concerns, including network segmentation, secure communication (TLS), and role-based access control.
- Programming and Scripting:
- Proficiency in scripting languages such as Groovy, Python, or Shell for custom processors or extensions.
- Knowledge of Java is a plus for developing custom NiFi processors.
- Big Data and Streaming Technologies:
- Experience with MSSQL, Elasticsearch or other big data ecosystems is beneficial.
- Understanding of messaging systems and streaming data pipelines.
- System and Network Knowledge:
- Familiarity with Linux/Unix environments where NiFi typically runs.
- Understanding of networking concepts, security (SSL/TLS), and authentication mechanisms.
- Monitoring and Troubleshooting:
- Ability to monitor NiFi flows, troubleshoot issues, and optimize resource usage.
- Experience with NiFi logs, provenance data, and metrics.
- Version Control and CI/CD:
- Experience with Git or other version control systems.
- Familiarity with CI/CD pipelines for deploying NiFi flows.
- Soft Skills:
- Strong problem-solving and analytical skills.
- Good communication skills to collaborate with data engineers, architects, and stakeholders.
Apache NiFi Resource · Apolis