AI Kernel Optimization Senior Engineer

Job description

The role As Senior AI Kernel Optimization Engineer, you will lead the optimization of high-performance kernels to push the limits of AI Inference on Openchip RISC-V platforms. You will design, implement, and optimize AI compute kernels (Gen AI Large Language Model, AI Vision, CNNs, etc) and runtime components to fully exploit the underlying hardware architecture — from vector/matrix units and memory hierarchies down to the assembly level. Your work will directly influence how efficiently AI models run on Openchip SoCs, shaping the performance of next-generation inference accelerators. You will collaborate closely with hardware architects, compiler engineers, and AI framework developers to achieve optimal hardware–software co-design. Key responsibilities: Drive the development, optimization, profiling of AI compute-intensive kernels (e.g., GEMM, attention, activations) targeting Openchip RISC-V architectures. Identify and resolve performance bottlenecks at the ISA, compiler, and runtime levels. Collaborate with the hardware and architecture teams to guide design decisions that improve real-world performance. Give orientation for the development and tuning of AI runtime and graph exe...