AI Operations Platform Consultant Sr.

Location: Charlotte, NC or Jersey City, NJ - Hybrid; 3 days a week onsite. Resource will choose which site hybrid schedule

Job Description:
Must have skills: LLM and Kubernetes

Project Tasks:
AI Operations Platform Consultant

• Experience deploying, managing, operating, and troubleshooting containerized services at scale on Kubernetes for mission-critical applications (OpenShift).
• Experience with deploying, configuring, and tuning LLMs using TensorRT-LLM and Triton Inference server.
• Managing MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production.
• Setup and operation of AI inference service monitoring for performance and availability.
• Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
• Operation and support of MLOps/LLMOps pipelines, using TensorRT-LLM and Triton Inference server to deploy inference services in production.
• Experience deploying and troubleshooting LLM models on a containerized platform, monitoring, load balancing, etc.
• Experience with standard processes for operation of a mission critical system – incident management, change management, event management, etc.
• Managing scalable infrastructure for deploying and managing LLMs.
• Deploying models in production environments, including containerization, microservices, and API design.
• Triton Inference Server, including its architecture, configuration, and deployment.
• Model Optimization techniques using Triton with TRTLLM.
• Model optimization techniques, including pruning, quantization, and knowledge distillation.
  

Position Details:

• Pay Rate / Range:____$74.91-$84.91_____

The above salary range represents the range expected for the position; however, final salary offers are based on a number of factors such as the position’s responsibilities; the candidate’s experience, education, and skills; location; travel required; and current market conditions.

• Benefits (Regular, Full Time Employees):
  1. Medical, Dental, and Vision offerings
  2. Weekly Direct Deposit
  3. Paid Holidays and Personal Time Off
  4. 401(k) with match
  5. Voluntary Life and AD&D, Short / Long Term Disability, plus other voluntary coverages
  6. Pre-Paid Legal and Employee Assistance Programs
  7. Northwest Federal Credit Union Membership
  8. BB&T @ Work Program

This program requires US Citizenship or Green Card (Lawful Permanent Residents)

ABBTECH is an EOE/Minorities/Women/Disabled Individuals/Veterans

tag#IND1