AI Problems Index
Back to Real AI Issues
Ongoing

LLM-Systems Can Be Untrustworthy

Users may struggle to trust LLMs due to biases, inconsistent performance, and risks of overreliance.

Description

Users may struggle to trust LLMs due to various issues. Models can perpetuate harmful biases and stereotypes, especially in low-resource languages or concerning marginalized groups. Their performance can be inconsistent, leading users to misjudge their capabilities and potentially rely on incorrect information. Overreliance can also lead to users not verifying information or even inheriting biases from the AI.