• *for certain definition of self hosted.

Developed by Chinese open weights model dev Z.ai, GLM 5.1 isn't exactly a small model. At roughly 754 billion total parameters (40 billion activated for each token generated), the model requires roughly 380 GB of GPU memory just to hold the weights and another 6-26 GB per user to maintain context depending on precision.

To serve GLM-5.3 at scale, Revolut deployed 56 Nvidia B200 GPUs, equivalent in GPU count to seven eight-GPU DGX B200 systems. But as Abitbol noted, the greatest performance gains didn't come from adding GPUs, but rather tuning the model's hyperparameters along with switching to NVFP4 quantization, implementing disaggregated prefill and decode, and tuning context lengths.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 8 points 20 hours ago* (3 children)

Cute that they called it $0.3 / 1 M tokens.

GPU WORLD
US$559,950 per unit: https://gpuworld.ai/gpu/nvidia-blackwell-b-series-gpus

So, IRL...about $3.5 million dollary-doos capex. Given they probably have thousands of engineers on staff, yeah, I can see it being worth it.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -2 points 20 hours ago (2 children)

    That username's great, so no shade here: I don't often engage with fresh accounts until they're no longer wet from the hatching. Nothing personal, just basic hygiene. Thank you for the reply, though!🤘🏼

  • source
  • parent
  • hideshow 2 child comments