DevOps / Platform Engineer (AI Evaluation)
DevOps / Platform Engineer (AI Evaluation)
from
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
Our client is supporting the development of advanced AI systems through realistic engineering tasks based on modern cloud and infrastructure environments.
We are looking for experiencedDevOps, SRE, and Platform Engineers to design and review production-style technical scenarios acrossCI/CD, containers, Kubernetes, cloud infrastructure, Infrastructure as Code, observability, and incident response. The role combines hands-on engineering with evaluation and technical review.No prior AI experience is required.
COMMITMENT: Minimum 20 hours per week
LOCATIONS: Remote
NOTES: This role requires hands-on coding ability in addition to infrastructure and automation expertise.
Responsibilities
- Design realisticDevOps and infrastructure tasks based on production-style scenarios.
- Create working reference solutions with clear setup, execution, and validation steps.
- Develop scenarios covering CI/CD, containers, orchestration, Infrastructure as Code, monitoring, and incident response.
- Review AI-generated technical outputs for correctness, completeness, and reproducibility.
- Identify configuration, infrastructure, or implementation failures and provide precise corrections.
- Validate that technical tasks can be reproduced consistently in the intended environment.
- Apply a high quality bar to infrastructure design, automation, and operational workflows.
- Document technical reasoning, expected outcomes, and troubleshooting steps clearly.
- Provide structured feedback to improve future task and evaluation design.
- At least3 years of professional experience in DevOps, SRE, Platform Engineering, or Infrastructure Engineering.
- Strong programming ability inPython, Go, Bash, or TypeScript, beyond basic scripting.
- Hands-on experience withCI/CD using tools such as GitHub Actions, GitLab CI, or Jenkins.
- Strong practical experience withDocker and Kubernetes.
- Professional experience with at least one major cloud platform:AWS, GCP, or Azure.
- Hands-on Infrastructure as Code experience withTerraform, Ansible, Pulumi, or CloudFormation.
- Advanced working knowledge ofLinux and Git.