Page 1 of 2 12 LastLast
Results 1 to 15 of 19

Thread: Can an AI ChatBot Make Stuff Up Just to Get Your Business?

  1. #1
    Join Date
    Sep 2007
    Location
    Longview WA
    Posts
    27,479
    Blog Entries
    1

    Can an AI ChatBot Make Stuff Up Just to Get Your Business?

    Saw this in my Morning Update >

    Morning Update.png

    Talk about a Strange New World.

    jtk
    "A pessimist sees the difficulty in every opportunity; an optimist sees the opportunity in every difficulty."
    - Sir Winston Churchill (1874-1965)

  2. #2
    Join Date
    Oct 2008
    Location
    Columbus, OH
    Posts
    3,064
    To answer your question - yes it can if the rules for an AI chatbot are not sufficently restrictive, or the AI language model learned to be more aggressive than accurate. In this case, the chatbot may not be AI. I'm willing to bet on poor programming vs anything more nefarious.
    Brian

    "Any intelligent fool can make things bigger or more complicated...it takes a touch of genius and a lot of courage to move in the opposite direction." - E.F. Schumacher

  3. #3
    Join Date
    Sep 2007
    Location
    Longview WA
    Posts
    27,479
    Blog Entries
    1
    I'm willing to bet on poor programming vs anything more nefarious.
    The first rule of programming: GIGO = Garbage In - Garbage Out.

    jtk
    "A pessimist sees the difficulty in every opportunity; an optimist sees the opportunity in every difficulty."
    - Sir Winston Churchill (1874-1965)

  4. #4
    The best way to describe an AI chatbot is that it's a very complex autocomplete. They're not like traditional software in that they are rigidly programmed to complete a specific task or whatever. Instead, they're just fed tons of information and allowed to draw from any of it to complete any possible task. As such, they're inherently unpredictable. It's not necessarily bad programming, so much as it is a bad application of programming.

  5. #5
    Somewhere in the dataset it learned from it either said, Yes you can get a refund in certain situations or didn't specify that you couldn't.

  6. #6
    Join Date
    Oct 2006
    Location
    Minneapolis, MN
    Posts
    5,462
    Most chatbots are not AI. They are just programmed with certain responses to what the user types. The programming is often very good and can look like a human. You'll notice that most can only do really basic tasks. They can often do things like tell you when the order is scheduled to be delivered. I don't need a chatbot for that as any halfway modern ecommerce site has an order tracking function. The times I really need customer service for a chatbot can't help me. One time an Amazon delivery was damaged during shipping so they cancelled the order. After weeks I had not been refunded for the cancelled order and a chatbot couldn't help with that.

    When ChatGPT first came out it had only been loaded with data up until 2021. I don't know if it has been updated since. If AI was truly intelligent the AI would go able to update itself with the latest data.

  7. #7
    Join Date
    Mar 2018
    Location
    Moscow, ID
    Posts
    433
    Air Canada recently got into some trouble because their AI Chatbot made up its own policy instead of using the company's. Air Canada was forced to honor this policy to the customer.

    https://arstechnica.com/tech-policy/...lines-chatbot/

  8. #8
    Join Date
    Oct 2006
    Location
    Minneapolis, MN
    Posts
    5,462
    Quote Originally Posted by Derek Meyer View Post
    Air Canada recently got into some trouble because their AI Chatbot made up its own policy instead of using the company's. Air Canada was forced to honor this policy to the customer.

    https://arstechnica.com/tech-policy/...lines-chatbot/
    The interesting thing is the article states Air Canada has spent more money on their chatbot than they have saved in other customer service costs. The airline says the investment in the chatbot is a long term investment.

  9. #9
    Join Date
    Sep 2007
    Location
    Longview WA
    Posts
    27,479
    Blog Entries
    1
    Quote Originally Posted by Brian Elfert View Post
    The interesting thing is the article states Air Canada has spent more money on their chatbot than they have saved in other customer service costs. The airline says the investment in the chatbot is a long term investment.
    My last employer spent a five million on a employee payroll time tracking system that was going to save them $50,000 a year. They quickly took down the announcement when employees pointed out how dumb it sounded. The confusion of everyone having to constantly change their password cost more than that in support. But that was the tech department, it was supposed to save money for the payroll department.

    There was also confusion caused by the remote log in stations having clocks that were not in synch with the master clock. This had people clocking in at remote locations with the local clock saying they were on time but the master clock said they were late or sometimes it nicked people for clocking out early. But somehow it saved the payroll department money.

    Sometimes it makes me think that some people were promoted to management because they couldn't do any of the other work that needed doing.

    jtk
    "A pessimist sees the difficulty in every opportunity; an optimist sees the opportunity in every difficulty."
    - Sir Winston Churchill (1874-1965)

  10. #10
    Quote Originally Posted by Jim Koepke View Post
    My
    But somehow it saved the payroll department money.
    I’m going off topic here because the payroll dept’s well intended change made me think of it… This is what happens when people only look at one side of the problem, instead of the whole picture. You have to look at the end to end impacts on all parts of a change. For example, think about the push for electric cars. Reducing emissions is a good thing and we should find more ways to do that. But advocates also need to consider the state of our power grid, the potential impact to other ecological matters (strip mining, etc), the impact of additional weight-per-car on road and bridge maintenance, how to build up a charging infrastructure and so on.

    My point being that decisions have consequences and everyone (usually) gets a better result when we think it all the way through, from the start.
    Last edited by Frederick Skelly; 02-21-2024 at 8:40 AM.
    "All that is necessary for the triumph of evil is that good men do nothing."

    “If you want to know what a man's like, take a good look at how he treats his inferiors, not his equals.”

  11. #11
    Join Date
    Sep 2007
    Location
    Longview WA
    Posts
    27,479
    Blog Entries
    1
    My point being that decisions have consequences and everyone (usually) gets a better result when we think it all the way through, from the start.
    Very True.

    jtk
    "A pessimist sees the difficulty in every opportunity; an optimist sees the opportunity in every difficulty."
    - Sir Winston Churchill (1874-1965)

  12. #12
    Join Date
    May 2007
    Location
    Colorado Springs
    Posts
    2,757
    ChatGPT is AI. Most of the AI images we see online came from ChatGPT. Its ability comes from scraping the Internet for images and text information. It mashes all that together into something both impressive and ridiculous at the same time.

    My friend's son was attending college and told us about two classmates who turned in papers written by ChatGPT. They were found out because the papers contained text like, "As an Artificial Intelligence Application, I can't determined which theory is most accurate." So yeah. Those students didn't even bother to read the papers they submitted. They were both expelled.

  13. #13
    Join Date
    Nov 2021
    Location
    Mid West and North East USA
    Posts
    2,945
    Blog Entries
    2
    I took down a lot of my web presence after getting some phony business inquiry emails that included things the alleged client wanted me to download. The emails were strangely connected to my "about me" on forums as well as the latest things that I had googled. A Canadian YouTuber has some insights on this.

    Best Regards, Maurice

  14. #14
    Join Date
    Dec 2019
    Location
    The old pueblo in el norte.
    Posts
    1,906
    Quote Originally Posted by Pat Germain View Post
    ChatGPT is AI. Most of the AI images we see online came from ChatGPT. Its ability comes from scraping the Internet for images and text information. It mashes all that together into something both impressive and ridiculous at the same time.

    My friend's son was attending college and told us about two classmates who turned in papers written by ChatGPT. They were found out because the papers contained text like, "As an Artificial Intelligence Application, I can't determined which theory is most accurate." So yeah. Those students didn't even bother to read the papers they submitted. They were both expelled.
    The plagiarism bots now also look for signs that text was AI generated. Bots patrolling for bots.
    ~mike

    happy in my mud hut

  15. #15
    Join Date
    Mar 2003
    Location
    SE PA - Central Bucks County
    Posts
    65,910
    If other humans can "make stuff up" to get your "business", why wouldn't an AI be able to do that? I help manage multiple forum sites and there is a constant battle with AI created content being used to try and influence folks. It gets shut down quickly (by humans in many cases, although forum software is trying to get better at it) but stuff still sneaks through. The same is true in all kinds of media, both online and not.
    --

    The most expensive tool is the one you buy "cheaply" and often...

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •