TY - GEN
T1 - Online Hate Interpretation Varies by Country, but More by Individual
T2 - 5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018
AU - Salminen, Joni
AU - Veronesi, Fabio
AU - Almerekhi, Hind
AU - Jung, Soon Gvo
AU - Jansen, Bernard J.
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/11/30
Y1 - 2018/11/30
N2 - Hate is prevalent in online social media. This has resulted in a considerable amount of research in detecting and scoring it. Most computational efforts involve machine learning with crowdsourced ratings as training data. A prominent example of this is the Perspective API., a tool by Google to score toxicity of online comments. However., a major issue in the existing approaches is the lack of consideration for the subjective nature of online hate. While there is research that shows the intensity of hate varies and the hate depends on the context., there is no research that systematically investigates how hate interpretation varies by country or individual. In this exploratory research, we undertake this challenge. We sample crowd workers from 50 countries, have them score the same social media comments for toxicity and then evaluate the differences in the scores., altogether 18.,125 ratings. We find that the interpretation score differences among countries are highly significant. However., the hate interpretations vary more by the individual raters than by countries. These findings suggest that hate scoring systems should consider user-level features when scoring and automating the processing of online hate.
AB - Hate is prevalent in online social media. This has resulted in a considerable amount of research in detecting and scoring it. Most computational efforts involve machine learning with crowdsourced ratings as training data. A prominent example of this is the Perspective API., a tool by Google to score toxicity of online comments. However., a major issue in the existing approaches is the lack of consideration for the subjective nature of online hate. While there is research that shows the intensity of hate varies and the hate depends on the context., there is no research that systematically investigates how hate interpretation varies by country or individual. In this exploratory research, we undertake this challenge. We sample crowd workers from 50 countries, have them score the same social media comments for toxicity and then evaluate the differences in the scores., altogether 18.,125 ratings. We find that the interpretation score differences among countries are highly significant. However., the hate interpretations vary more by the individual raters than by countries. These findings suggest that hate scoring systems should consider user-level features when scoring and automating the processing of online hate.
UR - http://www.scopus.com/inward/record.url?scp=85060014671&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85060014671&partnerID=8YFLogxK
U2 - 10.1109/SNAMS.2018.8554954
DO - 10.1109/SNAMS.2018.8554954
M3 - Conference contribution
AN - SCOPUS:85060014671
T3 - 2018 5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018
SP - 88
EP - 94
BT - 2018 5th International Conference on Social Networks Analysis, Management and Security, SNAMS 2018
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 October 2018 through 18 October 2018
ER -