Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
HumanOstrich
56 days ago
|
parent
|
context
|
favorite
| on:
Speed up responses with fast mode
How much extra power do you think you would need to run an LLM on a CPU (that will fit in RAM and be useful still)? I have a beefy CPU and if I ran it 24/7 for a month it would only cost about $30 in electricity.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: