Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

How much are you going to spend on electricity though? Is this really going to be more cost-effective than just using openrouter?
 help



There are many other reasons someone might want to run a model locally outside of cost savings, ownership of data flow and use in locations without internet to name a couple.

If my options are run Opus 4.6 in the cloud for $200/mo or run Opus 4.6 locally for $275, I am absolutely going to self-host 100% of the time. Sending all that data to the cloud presents tremendous legal risk for companies. There's currently no retention rules about privately hosted AI.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: