Good job putting to words one of the core issues I’ve had with using LLM chat for work. Stop trying to design an entire fucking system or solution and just answer the damn question I actually asked, by using natural language to search documentation and existing implementations.
I would tell it to only answer exactly what I asked, but sometimes I do get value from it “exploring” on occasion. It’s just so much damn worse with it than my newest junior co-worker who is known on our team for getting hours deep into tangential rabbit holes before coming up for air and asking seemingly nonsequiteur questions.
Back when search engines were becoming a thing, people would search more or less using natural language, e.g., “I want to see cat pictures and also cute kittens.” but early search engines performed poorly with that kind of query; it was much better to just type keywords, e.g. “cat kitten pictures”. Exacerbating the situation was the fact that search engines weren’t very good at the time, even if you used carefully considered keywords.
It might seem silly now, but using a search engine effectively was a skill people had to learn, and a skill not everyone had.
Using chatbots is the same thing, I think. They’re not super reliable to begin with, and on top of that, I don’t think people understand the importance of a well crafted prompt. The combination can make using them very frustrating.
I read somewhere that teaching people about how LLMs work is way better at protecting them from the harms of LLMs than trying to convince them not to use them.
This would include prompt engineering i guess! Which to be fair i do not know about.
Good job putting to words one of the core issues I’ve had with using LLM chat for work. Stop trying to design an entire fucking system or solution and just answer the damn question I actually asked, by using natural language to search documentation and existing implementations.
I would tell it to only answer exactly what I asked, but sometimes I do get value from it “exploring” on occasion. It’s just so much damn worse with it than my newest junior co-worker who is known on our team for getting hours deep into tangential rabbit holes before coming up for air and asking seemingly nonsequiteur questions.
Back when search engines were becoming a thing, people would search more or less using natural language, e.g., “I want to see cat pictures and also cute kittens.” but early search engines performed poorly with that kind of query; it was much better to just type keywords, e.g. “cat kitten pictures”. Exacerbating the situation was the fact that search engines weren’t very good at the time, even if you used carefully considered keywords.
It might seem silly now, but using a search engine effectively was a skill people had to learn, and a skill not everyone had.
Using chatbots is the same thing, I think. They’re not super reliable to begin with, and on top of that, I don’t think people understand the importance of a well crafted prompt. The combination can make using them very frustrating.
I read somewhere that teaching people about how LLMs work is way better at protecting them from the harms of LLMs than trying to convince them not to use them.
This would include prompt engineering i guess! Which to be fair i do not know about.
The video makes fun of it by having the vibe coder put "… or you go to jail " at the end of every prompt. https://www.youtube.com/watch?v=JeNS1ZNHQs8