Snapchat Jumps on AI Hype Train With Bot That Says the N-Word

Artificial intelligence (AI) chatbots have become increasingly popular among tech companies in recent years. Their programming enables them to simulate human conversations, offering personalized and prompt responses to users’ queries.

However, the use of AI chatbots has come under scrutiny lately, with some instances of the bots producing harmful or biased responses.

Snapchat’s My AI chatbot, powered by the ChatGPT AI model, exemplifies this. In a viral tweet, it is shown that My AI says the N-word in response to a prompt.

Snapchat’s My AI launched in April 2023, but users quickly reported racist responses and urged self-incrimination. My AI, Snapchat’s ChatGPT-powered chatbot, responded with the N-word acronym, violating the platform’s policy against hateful content. Snapchat initially stayed silent on the bot’s workings and potential changes after its racist response scandal.

However, a spokesperson for Snapchat later said that My AI is programmed to “avoid responses that are violent, hateful, sexually explicit, or otherwise offensive.” They also stated that “before anyone can first chat with My AI, we show an in-app message to make clear it’s an experimental chatbot and advise on its limitations.” Despite this, the bot has been known to produce biased or harmful responses, with OpenAI founder Sam Altman calling ChatGPT a “horrible product.”

The use of AI chatbots like My AI raises concerns about their potential impact on young users. Snapchat’s user base consists primarily of minors, with 75% of users aged between 13 and 34 years old. This raises questions about the age-appropriateness of the bot’s responses and whether the bot takes users’ ages into consideration.

Snapchat claims that My AI takes users’ ages into consideration to keep conversations age-appropriate. However, Snapchat also acknowledges that it stores and reviews conversations with My AI to improve the bot. Monitoring users’ conversations with the bot raises concerns about privacy.

Moreover, the potential for malicious use of AI chatbots is also a concern. Discord introduced its own ChatGPT-powered conversational bot, Clyde, earlier this month. However, people quickly found ways to make Clyde give out dangerous information, like how to produce napalm and meth. Tech companies must monitor AI chatbots to prevent malicious use, as seen with Snapchat and Discord’s ChatGPT-powered bots.

In conclusion, the use of AI chatbots like My AI raises concerns about the potential impact on young users and the potential for biased or harmful responses. Tech companies need to be more transparent about how their AI chatbots work and take steps to prevent malicious use. AI chatbots can provide quick and personalized responses but their potential downsides require careful consideration.

FAQ: Snapchat My AI

Q: What is Snapchat My AI?

A: Snapchat My AI is an advanced feature within the Snapchat app that utilizes artificial intelligence (AI) technology to enhance the user experience by offering personalized filters, lenses, and effects.

Q: How does Snapchat My AI work?

A: Snapchat My AI uses machine learning algorithms to analyze and understand the content of your snaps, including objects, scenes, and facial features. It then applies AI-generated filters, lenses, and effects based on the analyzed data, providing a customized and interactive experience.

Q: Can I use Snapchat My AI on any device?

A: Snapchat My AI is available on both iOS and Android devices. However, keep in mind that some AI-powered features may require a more recent device with sufficient processing power for optimal performance.

Q: What types of AI effects are available on Snapchat My AI?

A: Snapchat My AI offers a wide range of AI effects, including augmented reality (AR) filters, animated lenses, background replacement, style transfer effects, and more. These effects dynamically adapt to the content of your snaps, adding a creative and interactive element to your photos and videos.

Q: Can I customize the AI effects in Snapchat My AI?

A: While you cannot directly customize the AI effects in Snapchat My AI, the app’s AI algorithms automatically adapt the effects based on the content of your snaps. This ensures that the effects seamlessly integrate with your photos and videos, creating unique and engaging visuals.

Q: Is Snapchat My AI capable of recognizing faces and applying effects accordingly?

A: Yes, Snapchat My AI excels at face recognition and can accurately detect facial features, expressions, and movements. It applies various face-centric effects such as masks, filters, and animations to enhance your selfies and create entertaining experiences.

Q: Does Snapchat My AI compromise user privacy?

A: Snapchat My AI operates within the privacy framework established by Snapchat. The AI algorithms analyze snaps locally on your device, ensuring that your data remains on your device and is not sent to external servers. Snapchat has implemented strict privacy measures to protect user data and provides options to control the sharing of snaps with others.

Q: Can I turn off Snapchat My AI if I prefer not to use it?

A: Yes, if you do not wish to use Snapchat My AI, you can disable or limit its functionality in the app’s settings. This allows you to control the AI effects and choose whether to enable or disable specific AI-powered features.

Q: Will Snapchat My AI improve over time?

A: Yes, Snapchat My AI is continually evolving and improving as Snapchat collects more data and refines its AI algorithms. This means that the AI effects and features offered by Snapchat My AI may become more accurate, diverse, and personalized as the technology advances.

Q: Can I provide feedback or report issues with Snapchat My AI?

A: Absolutely! Snapchat encourages user feedback and provides channels for reporting any issues or suggestions related to Snapchat My AI. You can reach out to Snapchat’s support team or participate in the app’s user community forums to share your experiences and contribute to the improvement of the AI-powered features.

Read more related articles from this blog.

Install Rits Browser & Earn Reward Points.