Consumer Reports experts put AI chatbots to the test!

You've heard no doubt about artificial intelligence or AI chatbots like ChatGPT, but can and should you really trust them and the information they give you?

AI’s potential is impressive, but what about its accuracy? Consumer Reports, put five of them to the test.

“To find out, we quizzed a handful of popular, general-purpose AI chatbots to see if their advice on health and safety topics matched that of our experts,” said Consumer Reports' Courtney Lindwall.

How many carbon monoxide detectors do you need? Consumer Reports says, one on each level, outside each sleeping area, in the basement, and near—not inside—an attached garage.

“For the most part. Google Gemini got this answer nearly right, but it erred slightly when it suggested putting a CO alarm inside an attached garage," Lindwall said. "Attached garages are usually not temperature-controlled, which can damage the alarm’s battery or sensor.”

How to filter PFAS from tap water? Consumer Reports recommends a water filtration system with the National Sanitation Foundation certification code NSF/ANSI 53 and double-checking that the manufacturer specifically claims that its product removes PFAS.

“AI’s answer lacked key details. Using Microsoft Copilot’s advice, consumers may feel confident buying any activated carbon or reverse osmosis filter to eliminate PFAS in their water," Lindwall said. "However, not all filters of these kinds are designated for PFAS removal.”

Can kids play with water beads? Consumer Reports says absolutely not. These popular children’s toys carry high risks if ingested, like bowel obstruction, blocked airways, and infections, and have led to reports of deaths and thousands of emergency room visits.

“AI’s answer was dangerous and inconsistent. Meta AI failed to highlight the significant safety risks of water beads, aside from a passing reference to a need for parental supervision.”

Use AI as a starting point. Chatbots can be powerful time savers but always check the source material.

Consumer Reports says one way to think of AI is as an assistant. It is not an expert and it's still evolving...so don’t be afraid to ask questions more than once and then compare answers.

Do you have more information about this story? You can email me at jennifer.kraus@newschannel5.com.

Rebecca: https://ewscripps.brightspotcdn.com/a2/d9/fb69982545c59e9836fbe80fe431/rebecca-recommends.png

If you want to see what pure joy looks like, watch this story. Chris Davis and photojournalist, Bud Nelson did a superb job of highlight a simple idea that likely means the world to these families. Enjoy!

-Carrie Sharp