So it’s worth reminding the public: AI models are not your friends. They’re not designed to help you answer the questions you ask. They’re designed to provide the most pleasing response possible, and to ensure that you are fully engaged with them. What happened this week wasn’t really a bug. It was a feature.
www.theguardian.com

How an embarrassing U-turn exposed a concerning truth about ChatGPT | Chris Stokel-Walker
Always remember that it’s designed not to answer your question, but to give you the answer you wanted, says author Chris Stokel-Walker