Job Title: Senior DevOps Software Engineer (AI)

Company Name: Brahma consulting group

Job Url: https://www.simplyhired.com/job/gOFSTN2pyJukvEls9vBEEMNijqjzdChkqorweV7SRLk3S4_BH-UIkg

Job Description: 
Senior DevOps Software Engineer (AI)
Brahma consulting group
Remote

Job Details
Full-time
$200,093.56 - $250,628.80 a year
13 days ago
Benefits
Health insurance
Dental insurance
Parental leave
Vision insurance
401(k) matching
Life insurance
Retirement plan
Qualifications
Ansible
IT system monitoring
Application deployment
Scalable systems
Bash
Automating deployment processes
Infrastructure architecture design
OpenStack
AWS
Docker
Cloud security
SRE
Terraform
Splunk
APIs
Scalability
Model training
Cloud Architecture Design (Architecture design skills)
Prometheus
Grafana
Senior level
Chef
AI
Cross-functional collaboration
Cloud monitoring
GitLab
Communication skills
Python
PowerShell
MLOps
Cross-functional communication
Full Job Description
Senior DevOps Software Engineer / SRE
AI & LLMsWe’re looking for a skilled Senior DevOps Engineer to build and manage the infrastructure powering our AI and Large Language Model (LLM) systems. You’ll design scalable cloud environments, automate deployments, and streamline pipelines that accelerate model training and inference across distributed platforms. If you enjoy solving complex infrastructure challenges for next-gen AI, this role is for you.
Key Responsibilities

Architect and maintain AI/LLM infrastructure on AWS, GCP, or OpenStack, including GPU clusters and scalable compute environments.
Develop CI/CD pipelines and automate deployments using Terraform, Ansible, Jenkins, and GitLab CI.
Manage containerized systems with Docker and Kubernetes for seamless model training, fine-tuning, and serving.
Implement monitoring, observability, and security for cloud and model environments using tools like Prometheus, Grafana, and Splunk.
Collaborate with software and ML teams to support efficient model versioning, inference APIs, and continuous delivery cycles.
Qualifications

Strong background in DevOps/MLOps with experience supporting AI or LLM workloads.
Expertise with cloud (AWS/GCP/OpenStack) and containerization (Docker/Kubernetes).
Proficiency in scripting (Python, Bash, or PowerShell) and automation tools (Terraform, Ansible, Chef).
Familiarity with distributed training (Ray, DeepSpeed, or Horovod) and inference frameworks (Triton, FastAPI).
Excellent communication and problem-solving skills in fast-paced, cross-functional environments.
Job Type: Full-time

Pay: $200,093.56 - $250,628.80 per year

Benefits:

401(k) matching
Dental insurance
Health insurance
Life insurance
Parental leave
Retirement plan
Vision insurance
Work Location: Remote