๐Ÿ“„ Book chapter ยท CRC Press 2022 ยท ๐Ÿ† Best Paper, GCAIA

Assessing the Concerns of People in the Pandemic Situation: An Analytical Approach on the Social Media Data

Ankita Roy, Simran Agarwal, Koushik Deb ยท Applications of Machine Intelligence in Engineering (CRC Press)

๐Ÿ† Best Paper Award๐Ÿ“š CRC Press๐Ÿ—‚ LDA topic modelling๐Ÿ’ฌ Reddit data
health worries symptoms? hospital beds livelihood job losses savings daily life lockdown school topic modelling groups millions of posts into what people actually worry about

Thousands of scattered posts drift into clusters โ€” health, livelihood, daily life โ€” revealing the shape of public worry without reading a single post by hand.

In plain words

During the COVID-19 outbreak, everyone was worried โ€” but about what, exactly, and in what proportion? Health? Jobs? School closures? This study let the public answer in their own words, at scale.

Pandemic-related posts from Reddit were analysed with LDA (Latent Dirichlet Allocation) topic modelling โ€” an unsupervised technique that groups documents by the themes they share, without anyone pre-deciding what the themes should be. The extracted topics form a map of public concern during the outbreak.

How it works

  1. Collect the corpusPandemic-related Reddit posts are gathered and cleaned.
  2. Model the topicsLDA discovers clusters of words that travel together โ€” each cluster a theme of concern.
  3. Name the themesThe clusters are interpreted into human-readable concerns: health, livelihood, daily-life disruption and more.
  4. Read the mapThe relative weight of each theme shows what the public actually worried about, over time.

Why it matters

Governments and health agencies communicated constantly during the pandemic, but rarely knew whether they were answering the questions people were actually asking. Topic-modelled social media is a cheap, honest, continuously-updating survey of public concern โ€” useful in any crisis, not just this one.

Read the chapter โ†— โ† All research
โ† PreviousCrime by Crowd โ€” riot prediction (2022)