Today I went to a seminar titled "Texts Come from People - How Demographic Factors Influence NLP Models" by @Dirk_Hovy
The abstract of the talk is here. Dirk’s scholar profile is here and his personal site here.
Live blogging below - hope you can extract something meaningful out of my confusing notes ;)
Big problem in NLP: part-of-speech (POS) tagging is racist and ageist (represent a certain segment of the population)
Q1: How to partly tackle this problem? Get training data! On trustpilot.com, people write reviews (and they provide their gender, age, location). The outcome of this research is a web site under http://languagevariation.com/index.html This is a web interface that allows the user to query for lexical phenomena in several languages, and to get both statistical analysis and map representations of the results along several demographic factors.
Fun Finding: In NYC, there is an anti-correlation between the prestige of a clothing store and the number of dropped r’s by the store’s typical customer
(more on the "smiley" paper titled “User Review Sites as a Resource for Large-Scale Sociolinguistic Studies” pdf)
Q2: How *syntax* varies over age and gender?
Feature selection is done with a randomized logistic regression (see Meinshausen and Buhlmann (2010) & Johannsen/Hovy/Sogaard (CoNLL 2015))
Cross-lingual syntactic variation over age and gender. pdf
Q3: How much sexism Hillary Clinton faces on Twitter ?
Q4: Can "regio-lects" be derived from geographic studies of social media?
Q5: How tagging differ in terms of gender and age? The tag “machine” is used differently by males vs. females. It might be useful to incorporate sex and age into NLP models for personalized NLP (e.g., to improve disambiguation)