IT & Software

TPU Performance Engineer - vLLM Inference Backends

INFERACT SINGAPORE PTE. LTD.

Penarth · Wales · United Kingdom

Inferact Singapore PTE. LTD. is seeking a TPU performance engineer to make vLLM a first-class inference engine on Google TPUs.

You will build and optimize TPU backends, compiler integrations, runtime paths, and benchmarking infrastructure using JAX, XLA, Pallas, and related tooling so vLLM can deliver frontier inference performance on TPU hardware. You'll work at the boundary of inference systems, kernels, compilers, and hardware architecture, improving production-relevant model serving on TPU

#J-18808-Ljbffr

Reference: WJ-766_22548525

Apply now

Continue on the employer's official application - the same link they use for every candidate.

More jobs

Find more on GigBlows

This role is listed on GigBlows for discovery and search. Hiring decisions and applications are handled by the employer or their chosen application system.