650 Group AI tests large language models on real GPU hardware, measuring speed, quality and cost per token, and serves the models that come out ahead.
We measure output speed, prompt processing speed and time to first token across GPU generations under identical settings, and price the results per million tokens.
Our own test suites cover maths, knowledge, instruction following and tool calling, checked against public benchmarks, so we know a model behaves before we serve it.
We run open-weight models on rented data-center GPUs behind an OpenAI-compatible API, with spending limits and capacity controls built in.
For partnerships, model hosting or benchmark data, email chris@650group.ai.