To help tackle cyberbullying and online hate in the digital world, Instagram has rolled out a new feature that flags content considered as being offensive.
Starting today, Instagram is rolling out a new feature that notifies people when their captions on a photo or video may be considered offensive and give them a chance to pause and reconsider their words before posting.
As part of Instagram’s long-term commitment to lead the fight against online bullying, we’ve developed and tested AI that can recognize different forms of bullying on Instagram. Earlier this year, Instagram launched a feature that notifies people when their comments may be considered offensive before they’re posted. Results have been promising, and have found that these types of nudges can encourage people to reconsider their words when given a chance.
Today, when someone writes a caption for a feed post and Instagram’s AI detects the caption as potentially offensive, they will receive a prompt informing them that their caption is similar to those reported for bullying. They will have the opportunity to edit their caption before it’s posted.
In addition to limiting the reach of bullying, this warning helps educate people on what’s allowed on Instagram, and when an account may be at risk of breaking our rules. To start, this feature will be rolling out in select countries, and Instagram will begin expanding globally in the coming months.
See more articles and resources to help children stay safe online.