Inference - not really, with one caveat (see below). Most models don't need this. The industry "standard" is 48GB meaning most models assume at least that. You'll be able to get even the largest models running on these with fewer parameters. Most image, video models are 48GB.

NOT-4%
DON-14.93%
LL-1.36%
GET-1.64%
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 1
  • Share
Comment
0/400
MeltdownSurvivalistvip
· 07-30 11:19
The parameter standards still need to drop.
View OriginalReply0
Trade Crypto Anywhere Anytime
qrCode
Scan to download Gate app
Community
English
  • 简体中文
  • English
  • Tiếng Việt
  • 繁體中文
  • Español
  • Русский
  • Français (Afrique)
  • Português (Portugal)
  • Bahasa Indonesia
  • 日本語
  • بالعربية
  • Українська
  • Português (Brasil)