Orin NX 16G 可以运行 llama3 大模型 - V2EX

Home Sign Up Sign In

› 下载 GeForce Experience

› NVIDIA SHIELD

› GPU Ray Tracing

› NVIDIA Unix Driver

This topic created in 828 days ago, the information mentioned may be changed or developed.

参考 BV1rD421g7NT ，应该是 4bit 量化

No Comments Yet

orin llama3 quantization

About · Help · Advertise · Blog · API · FAQ · Privacy · Solana · 3337 Online Highest 6679 ·

Select Language

创意工作者们的社区

World is powered by solitude

VERSION: 3.9.8.5 · 26ms · UTC 10:45 · PVG 18:45 · LAX 03:45 · JFK 06:45
♥ Do have faith in what you're doing.