C++ Systems Engineer
LM Studio · New York City, New York, US
The Role We are hiring a C++ Systems Software Engineer in New York City. You design, build, and optimize the core native runtime that powers LM Studio and th...
Job description
The Role We are hiring a C++ Systems Software Engineer in New York City. You design, build, and optimize the core native runtime that powers LM Studio and the C++ libraries powering the app and our APIs. You will work across our runtime, LLM engines, llama.cpp/MLX integrations, build infrastructure, and the future of our on-device AI software. Your work centers on system and library integration: wiring our C++ runtime to GPU backends, vendor SDKs, and operating-system services to support user-facing applications. You will implement and harden system-level code (threading, memory, files, IPC, scheduling) and integrate platform acceleration paths (Metal, CUDA, Vulkan) across macOS, Windows, and Linux. You will profile, debug, and tune the execution paths that make local AI fast and dependable, and our software well architected and maintainable. Responsibilities: - Contribute to the C++ runtime that powers LM Studio - Extend our LLM engine integrations and build platform-aware performance features for desktop operating systems. - Implement resilient IPC, resource management, and scheduling logic to support concurrent model execution. - Improve our build, packaging, and release infrast...