Instagram banning pro-ED words making things worse

Washington: With Instagram no longer letting people use certain hashtags and words, a new study has suggested that it doesn't help. Rather, it brings the situation to a head.

The new Georgia Tech study finds that Instagram's decision to ban certain words commonly used by pro-eating disorder (pro-ED) communities has produced an unintended effect. The use of those terms decreased when they were censored in 2012.

However, users adapted by simply making up new, almost identical words, driving up participation and support within pro-ED groups by as much as 30 percent. The researchers found that these communities are still very active and thriving despite Instagram's efforts to moderate discussion of the dangerous lifestyle.

The team looked at 2.5 million pro-ED posts from 2011 to 2014 to study how the community reacted to Instagram's content moderation.

"People pretty much stopped using the banned terms, but they gamed the system to stay in touch," said Stevie Chancellor, a doctoral student who led the study. "'Thinspiration' was replaced by 'thynspiration' and 'thynspo.' 'Thighgap' became 'thightgap' and 'thygap.'"

The 17 moderated terms morphed into hundreds of similar, new words. Each had an average of 40 variables. Some had more: the researchers found 107 variables of "thighgap."

Instagram's censorship polarized the pro-ED community.

"Likes and comments on these new tags were 15 to 30 percent higher compared to the originals," said researcher Munmun De Choudury. "Before the ban, a person searching for hashtags would only find their intended word. Now a search produces dozens of similar, non-censored pro-ED terms. That means more content to view and engage with."

The team also found that the content on these so-called lexical variants discussed self-harm, isolation and thoughts of suicide more often than the larger community of sufferers of eating disorders.

Instagram has also blacklisted words related to sex, racism and self-harm. What is more effective than banning tags? The Georgia Tech team suggests a few alternatives.

"Allow them to be searchable. But once they're selected, the landing page could include links for help organizations," said Chancellor. "Maybe the search algorithms could be tweaked. Instead of similar terms being displayed, Instagram could introduce recovery-related terms in the search box."

The study has been presented at the ACM Conference on Computer-Supported Cooperative Work and Social Computing on March 1 in San Francisco.