It’s an extremely powerful pattern recognition tool. There are uses for that, but your right that people are going the “if you only have a hammer, everything looks like a nail” route.

Yeah, here you go.

https://www.bdo.com/insights/digital/unpacking-ai-bias

Didn’t one ai have a lot of false positives because it would say any picture of skin with a ruler in it was cancer? The moment it saw a ruler it responded with cancer because all the data it was fed about confirmed cancers had rulers in them.