The Q4 quantization requires about 600GB of RAM without context, not exactly con... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

cbg0 19 days ago | parent | context | favorite | on: AI subscriptions are a ticking time bomb for enter...

The Q4 quantization requires about 600GB of RAM without context, not exactly consumer hardware friendly.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact