返回首页
LLM-inference
找到 2 篇关于此标签的文章
PyConAnthropic
Join us at PyCon US 2026 in Long Beach - we have new AI and security tracks this year
PyCon US 2026 debuts a standalone AI track on May 16 in Long Beach, co-chaired by an Anthropic engineer.
Apr 183 分钟
AWS-Trainium2vLL M
Speculative Decoding on AWS Trainium2 Cuts LLM Lat ency Up to 3x
AWS benchmarks show speculative decoding with vLLM on Trainium2 reduces inter -token latency up to 3x for decode-heavy workloads.
Apr 154 分钟