JobMesh

LLMOps Engineer

Steampunk · Mclean, Virginia, US

Overview We are looking for a skilled LLMOps Engineer to help build, operate, and optimize the infrastructure and pipelines that power our predictive and gen...

Job description

Overview We are looking for a skilled LLMOps Engineer to help build, operate, and optimize the infrastructure and pipelines that power our predictive and generative AI capabilities. The LLMOps Engineer will work closely with AI Product Engineers, Data Scientists, and senior LLMOps staff to support the deployment, monitoring, and continuous improvement of LLM-based systems. This role is highly technical and hands-on, with opportunities to grow into senior roles through increasing independence, system ownership, and architectural contributions. Contributions: - Implement and maintain core LLM pipelines, including model hosting endpoints, embedding pipelines, retrieval layers, and vector database integrations. - Build automation for model versioning, dataset management, and configuration tracking to support reproducible and reliable GenAI development. - Develop monitoring and observability components for LLM-based applications, including metrics dashboards, alerting, and logging of model outputs and performance. - Collaborate with AI Product Engineers to move prototypes into production environments, supporting scalability, testing, and integration with mission systems. - Assist in con...