IT & Software

Senior AI Inference Platform Architect

CoreWeave

London · England · United Kingdom

CoreWeave is seeking an experienced Staff Software Engineer for the Inference team to lead architecture, performance, and reliability across multi-team services. You will shape cross-cutting design initiatives in request routing, scheduling, and GPU resource management, targeting strict P99 SLAs.

You will implement advanced optimizations like speculative decoding and KV-cache reuse while establishing benchmarking and observability practices across infrastructure boundaries.

#J-18808-Ljbffr

Reference: WJ-766_21084838

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.