技术档案

AI推理算力AI inference compute

运行模型生成输出的算力

每条都摘自下方编号的来源原文;只写事实,不写预测或建议。

主要参与者

  • AWS提供用于AI推理的云基础设施,包括EC2专用GPU和Inferentia机器学习芯片。1
    AWS offers a large range of cloud infrastructure for AI inference, including specialized GPUs on Amazon EC2 or machine learning chips like AWS Inferentia.

来源

  1. aws.amazon.com · What is Inferencing? - AI Inference Explained - AWS