Hacker Newsnew | past | comments | ask | show | jobs | submit login

user: sleepyeldrazi created: June 3, 2021 karma: 72 about: Personal projects at https://git.kokoham.com/sleepy . Trying to optimize LLM inference frameworks for local models in speed, and explore interesting quants for size. submissions comments favorites