Inaccurate - Blog Posts

Is Chat GPT a good replacement for learning a language? (part 1)

It's a legitimate question. Of course I am biased as a language instructor, I want to shout 'no!' I have already spent time in classes arguing why it is not a healthy path to take, but my counter-arguments are thinning out as the technology gets better.

Around this time last year, I had just heard about Chat GPT when a few students were rumbling about it. I thought it was just a chat bot like a lot of websites use, so I brushed it aside. When I finally read about it, I had to check it out. I did as a lot of people did the first time, entering into an argument about which movie robot character was the GOAT (Greatest of All Time) or launching into some juvenile chat thread. It impressed me suitably. Since then, I got it to write a sales e-mail for me, correct my Japanese in another e-mail I was writing and help me with a difficult calculus question I was studying.

Math has been a tough one for me and it was here that I had my first instance where I doubted the integrity of the AI's ability. It gave me a wrong answer. It was a minor miracle that I could spot that the answer was wrong in the first place, if I was relying on it as my tutor, I was in trouble! When I called it on its error, it did remind me that it is a language engine, not a mathematical one but it left me wondering where else it might let us down.

I then started searching the web for articles about Chat GPT's accuracy and I found an article where they asked the AI service to write a summary of a book. It gave a great description and school-worthy report that would have scored top marks. The thing is, the book didn't exist! Okay, I can't find the link, but here is a case where it summarizes a book completely incorrectly. And here are some links where Chat GPT makes up reference lists with non-existent resources (LINK) (LINK).

On top of these academic shortcomings, last year I was trying out a job representing a beverage-related company and asked Chat GPT to give me a list of up and coming beverage companies in Japan. You guessed it, the list contained all companies that don't exist at all.

I have a theory of why this is. You can imagine the panic spreading from educational institutes over the implications of having such a powerful automatic writing tool available for free. The integrity of schools is in peril as more and more students are handing in Chat GPT generated reports as we speak. The key is to build in some fallibility to deter students from cheating. The prospect of saving themselves hours of research which would take previous generations months to compile is too alluring for young students. Therefore, the mistakes are put in on purpose to keep it a fun, yet powerful service for students. But business owners know that it can be adapted for business needs and help make money for the developers.

This chink in the armor is one reason why I would not trust the new powerful AI sites to handle a company's communication requirements. When you consider how important communication is for the success of your business, you can see why it is better to stay in control of your destiny by doing the communication yourself.