Visualizing Twitter: Public Discourse and the 2018 Florida Midterm Election Recounts

Project Summary

This two-week teaching module in an introductory-level undergraduate course invites students to explore the power of Twitter in shaping public discourse. The project supplements the close-reading methods that are central to the humanities with large-scale social media analysis. This exercise challenges students to consider how applying visualization techniques to a dataset too vast for manual apprehension might enable them to identify for granular inspection smaller subsets of data and individual tweets—as well as to determine what factors do not lend themselves to close-reading at all. Employing an original dataset of almost one million tweets focused on the contested 2018 Florida midterm elections, students develop skills in using visualization software, generating research questions, and creating novel visualizations to answer those questions. They then evaluate and compare the affordances of large-scale data analytics with investigation of individual tweets, and draw on their findings to debate the role of social media in shaping public conversations surrounding major national events. This project was developed as a collaboration among the English Department (Emma Davenport and Astrid Giugni), Math Department (Hubert Bray), Duke University Library (Eric Monson), and Trinity Technology Services (Brian Norberg).

Themes and Categories
Year
2019

Graduate Student: Emma Davenport

Faculty: Dr. Astrid Giugni

Course: “Democracy, Game Theory, and Persuasion” (English 190-1-01 / Math 190-01 / ISS 190-01; Spring 2019)

This Data Expedition introduces students to data visualization techniques and invites students to consider the advantages and limitations of large-scale data analysis as compared to close-readings of individual texts. What might be gained through employment of each method individually, and what is obscured? How can these techniques be used to support and extend each other? And what might we be able to conclude about the role of digital technologies in public discourse today?

In spring 2019, in the wake of the 2018 midterm elections, twenty-seven students enrolled in the introductory-level, interdisciplinary course “Democracy, Game Theory, and Persuasion,” a cross-listed English, math, and Information Science + Studies course investigating quantitative and qualitative approaches to understanding how democracy works. The course explored techniques of political persuasion through perspectives drawn from mathematical game theory, political theory, and literature. Emma Davenport, a fifth-year graduate student in the English department, designed this Data Expedition to supplement students’ theoretical and literary engagements with the question of how democratic discourse is shaped.

November 2018 saw two midterm election recounts in Florida (gubernatorial and US Senatorial) that attracted national attention and prompted massive activity on Twitter and other social media networks. This event and the public conversation it generated provided Emma an occasion for conceiving a project in which students could complete novel analyses using original data generated by a platform with which most of the students had daily contact, on a topic of national significance occurring just six weeks previous to the semester’s commencement. The dataset for this project consisted of a collection of 900,270 tweets and their associated metrics, which represented a ten-percent sample of all tweets mentioning any of eight specific hashtags related to the Florida 2018 midterm election recounts, from November 6 (election day) through November 23 (five days after the resolution of the recounts).

Over the course of four class sessions, students trained using visualization software, generated research questions, created novel visualizations to answer those questions, evaluated and compared the affordances of large-scale data analytics with close-readings of individual tweets, and drew on their findings to debate the role of Twitter in shaping the public conversation surrounding the event. On the first day of the unit, Emma guided students to think through the role of social media in their experience of current events and to discuss the ways that Twitter has developed and changed over its thirteen-year life. A central goal of this introductory discussion was to scaffold students’ integration of contextual information from outside of the dataset with phenomena that might be revealed by data visualization. Emma thus encouraged students to bring their existing background knowledge to bear on a timeline of the major events of the recount to articulate tentative expectations regarding relationships between individual events and Twitter trends.

The goals for the second and third day of the unit were to familiarize students with the dataset and with visualization software Tableau and to support students in planning and executing an inquiry into a research question of their own design. Thus, on the second day, Emma conducted students through an exploration of the dataset’s variables and a discussion of the opportunities and limitations of Twitter’s API; trained students in Tableau; and assisted them in completing visualization exercises that prompted examination of patterns and anomalies in the dataset. Students devoted the third day to working in groups of three or four to pose questions about the data, record hypotheses, create visualizations to assist in answering their queries, compare conclusions drawn from the large-scale data to those offered by granular examination of individual tweets, and suggest further questions for examination. Students recorded their process on a planning template designed to assist them in focusing their inquiries, organizing their findings, and developing their methods and conclusions for presentation.

On the final day of the unit, students shared their findings with their classmates and drew on their explorations of the data to debate questions including:

  • How “objective” are the measures of this dataset? Who are the actors whose decisions help determine the conclusions that we draw—and even the questions that we can ask—about the data? Where in the processes of collecting, analyzing, and presenting data do human factors intervene?
  • What is the role of Twitter in shaping public conversations about current events? How is that role changing as Twitter and its users influence each other? What are the advantages to democratic discourse of the rapid rise of social media? What are the drawbacks?
  • What questions and objectives oblige us to use large-scale quantitative analyses? What questions and objectives oblige us to closely analyze individual texts? What inquiries might benefit from the use of both, and how?

You are invited to explore the complete dataset, project materials, and student work via the download links below.

(all student work and photography posted with permission)

Images

Are Most Original Tweets by Verified Users?

User Activity and Visibility

Popular Hashtags

Hashtags per Day

 

Students in project

Students in project

Students in project

Students in project

Students in project

Students in project

 

Students in project

Students in project

 

Downloads

Data-Exped-Schedule.pdf (PDF of four-day schedule)

Intro-Election-Twitter.pdf (PDF introducing the election recount event and the Twitter dataset)

Twitter-data-Master.xlsx (Excel data)

Tableau-Training-Exercises.pdf (PDF of instructions for completing training exercises)

Presentation-Assignment-and-Planning-Sheet.pdf (PDF of presentation assignment and planning sheet)

Student-Presentations (combined PDF of all seven student group presentations)

Elections-Twitter-Data.twbx (Tableau workbook with data packaged)

DEMO.twbx (Tableau workbook with completed training exercises)

Related People

Related Projects

KC and Patrick led two hands-on data workshops for ENVIRON 335: Drones in Marine Biology, Ecology, and Conservation. These labs were intended to introduce students to examples of how drones are currently being used as a remote sensing tool to monitor marine megafauna and their environments, and how machine learning can be used to efficiently analyze remote sensing datasets. The first lab specifically focused on how drones are being used to collect aerial images of whales to measure changes in body condition to help monitor populations. Students were introduced to the methods for making accurate measurements and then received an opportunity to measure whales themselves. The second lab then introduced analysis methods using computer vision and deep neural networks to detect, count, and measure objects of interest in remote sensing data. This work provided students in the environmental sciences an introduction to new techniques in machine learning and remote sensing that can be powerful multipliers of effort when analyzing large environmental datasets.

Understanding how to generate, analyze, and work with datasets in the humanities is often a difficult task without learning how to code or program. In humanities centered courses, we often privilege close reading or qualitative analysis over other methods of knowing, but by learning some new quantitative techniques we better prepare the students to tackle new forms of reading. This class will work with the data from the HathiTrust to develop ideas for thinking about how large groups and different discourse communities thought of queens of antiquity like Cleopatra and Dido.

Please refer to https://sites.duke.edu/queensofantiquity/ for more information.

We introduced students to spatial analysis in QGIS and R using location data from two whale species tagged with satellite transmitters. Students were given satellite tracks from five Cuvier’s beaked whales (Ziphius cavirostris) and five short-finned pilot whales (Globicephala macrorhynchus) tagged off the North Carolina coast. Students then used RStudio to calculate two metrics of these species' spatial ranges: home range (where a species spends 95% of its time) and core range (where a species spends 50% of its time). Next, students used QGIS to visualize the data, producing maps that displayed the whales' tracks and their ranges.