AI推理算力AI inference compute
运行模型生成输出的算力
每条都摘自下方编号的来源原文;只写事实,不写预测或建议。
已有应用
- Cerebras已运行Moonshot AI的Kimi K3.1开放权重模型。2
Cerebras was a day-zero launch partner for Kimi K3.1, Moonshot AI’s 2.8 trillion-parameter frontier class open-weight model.
主要参与者
- AWS提供用于AI推理的云基础设施,包括EC2专用GPU和Inferentia机器学习芯片。1
AWS offers a large range of cloud infrastructure for AI inference, including specialized GPUs on Amazon EC2 or machine learning chips like AWS Inferentia.