Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

OK, fair enough. Please give me an example of a customer facing chatbot that Llama 2 (and unbearable to use) and GPT 4 customer facing chatbot that is a joy to use. I think at the end of the day, you still have customers dreading such interactions.


Using GPT3.5/4 in our language learning app and people seem to enjoy it. [1]

Tried Llama2 and it definitely doesn’t even come close for what we’re doing. Would absolutely need fine tuning.

Maybe customers don’t enjoy chat bots for customer support, but there are a million other uses for these models. I, for example, LOVE github copilot.

1. https://squidgies.app


Cool app.

Wonder if you can potentially use a combination of Llama2 and GPT - to save costs on using the OpenAI API.


Costs really aren’t a concern compared to speed of development and quality.


A lot of people who were using say Google Maps in their apps thought the same thing, until Google drastically increased the prices...


Is it cost prohibitive


It's early, and this definitely isn't customer facing in the traditional sense, but a team member of mine set up a Discord bot running Llama 2 70B on a Mac studio and we've been quite impressed by its responses to folks who test it.

IIRC chat bots are central the vision Facebook has with LLMs (e.g. every instagram account has a personal chat bot), so I would expect the Llama models to get increasingly better at this task.

That said the 7B and 13B models definitely don't quite seem ready yet for production customer interaction :-)


> (e.g. every instagram account has a personal chat bot)

That made me think of the Black Mirror episode Joan is Awful, where every human gets their life turned into a series for the company to own and promote. Kinda like instagram content.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: