Content Moderation Case Study: Dealing With Misinformation In Search (2004)

Furnished content.


This series of case studies is published in partnership with the Trust & Safety Foundation to examine the difficult choices and tradeoffs involved in content moderation. Learn more »Summary: Google's biggest early innovation in search was that it used inbound links as a tool for determining the popularity of a website, and thus what its relevance to a particular search might be. That feature, however, created some side effects that raised concerns about how search results might lead to misinformation, or how the search engine might be gamed.One of the earliest examples of this was the discovery in 2004 that the first result of a search on the word jew pointed to a blatantly anti-semitic website, Jewwatch. It was widely theorized that the reason for this was that the singular noun jew was more likely to be used by those pushing anti-semitic arguments, rather than the more common adjective jewish or the phrase jewish wo/man etc. Also, the site Jewwatch had been in existence for many years, and had many inbound links from other sources.Some also believed that the people behind Jewwatch had used an early search engine optimization technique known as Googlebombing to purposefully game the results deliberately linking to Jewwatch from other sites, and using the word jew as the link text.As this result got attention, Google came under tremendous pressure to change the search result, as people accused the company of anti-semitism or deliberately pointing to the Jewwatch site in search results. The Anti-Defamation League sent a letter to Google asking it to explore whether or not its ranking system needed to be changed (though the ADL also posted an article to its own site telling people that it was clear that the result was not intentional, or done for nefarious reasons). Some politicians, including Senator Chuck Schumer, also got involved to pressure Google to change its results.Decisions to be made by Google:

• Should the top search results be manually changed when it is discovered they lead to misinformation and hate?
• Should the algorithm be changed to try to avoid these results?
• Should the company do nothing and say that the algorithm decides the results, period?
• Should any decision set a precedent for future decisions, and if so, what policies and guidelines need to be put in place to deal with future cases?
• Are there other ways to respond to this situation?
• How should Google handle attempts to game search via things like Googlebombing?

• If any changes are made, will lots of others expect similar changes to be made as well?
• Will making changes lead to questions regarding the credibility of search results and the Google algorithm?
• What sorts of policies and processes need to be in place to deal with these kinds of requests?
• Will any changes have other, unintended consequences as well?
• Are search engine optimization techniques nefarious? Can they be? If so, how do you distinguish between good intentions and bad intentions?
• If you block certain techniques, such as Googlebombing, will that stop the practice when used for good purposes as well?

People have asked about how we feel about Googlebombs, and we have talked about them in the past. Because these pranks are normally for phrases that are well off the beaten path, they haven't been a very high priority for us. But over time, we've seen more people assume that they are Google's opinion, or that Google has hand-coded the results for these Googlebombed queries. That's not true, and it seemed like it was worth trying to correct that misperception. So a few of us who work here got together and came up with an algorithm that minimizes the impact of many Googlebombs.The next natural question to ask is "Why doesn't Google just edit these search results by hand?" To answer that, you need to know a little bit about how Google works. When we're faced with a bad search result or a relevance problem, our first instinct is to look for an automatic way to solve the problem instead of trying to fix a particular search by hand. Algorithms are great because they scale well: computers can process lots of data very fast, and robust algorithms often work well in many different languages. That's what we did in this case, and the extra effort to find a good algorithm helps detect Googlebombs in many different languages. We wouldn't claim that this change handles every prank that someone has attempted. But if you are aware of other potential Googlebombs, we are happy to hear feedback in our Google Web Search Help Group.

0 comments, click here to add the first

Fan Uses AI Software To Lipread What Actors Really Said In TV Series Before Chinese Authorities Censored Them

Furnished content.


It's hardly news to Techdirt readers that China carries out censorship on a massive scale. What may be more surprising is that its censorship extends to even the most innocuous aspects of life. The ChinAI Newsletter, which provides translations by Jeff Ding of interesting texts from the world of Chinese AI, flags up one such case. It concerns a Chinese online TV series called "The Bad Kids". Here's how the site Sixth Tone describes it:

Since its first episodes were released on China's Netflix-like video platform iQiyi in mid-June, "The Bad Kids" has earned sweeping praise for its plot, cinematography, casting, dialogue, pacing, and soundtrack. It's also generated wide-ranging online discussion on human nature due to the psychology and complex motivations of its characters.

Two days ago, I watched the TV series "The Bad Kids" in one go, and the plot was quite exciting. The disadvantage is that in order for the series to pass the review (of the National Radio and Television Administration), the edited sequences for episodes 11 and 12 were disrupted, even to the point that lines were modified, so that there are several places in the film where the actor's mouth movements and lines are not matched, which makes the plot confusing to people. Therefore, I tried to restore the modified lines through artificial intelligence technology, thereby restoring some of the original plot, which contained a darker truth.

0 comments, click here to add the first