Sentiment in New York City: A High Resolution Spatial and Temporal View


Cite as:

K.Z. Bertrand, M. Bialik, K. Virdee, Andreas Gros, Y. Bar-Yam, Sentiment in New York City: A High Resolution Spatial and Temporal View. arXiv:1308.5010 (August 20, 2013).


Scientific Abstract

Measuring public sentiment is a key task for researchers and policymakers alike. The explosion of available social media data allows for a more time-sensitive and geographically specific analysis than ever before. In this paper we analyze data from the micro-blogging site Twitter and generate a sentiment map of New York City. We develop a classifier specifically tuned for 140-character Twitter messages, or tweets, using key words, phrases and emoticons to determine the mood of each tweet. This method, combined with geotagging provided by users, enables us to gauge public sentiment on extremely fine-grained spatial and temporal scales. We find that public mood is generally highest in public parks and lowest at transportation hubs, and locate other areas of extreme sentiment such as cemeteries, medical centers, a jail, and a sewage facility. Sentiment progressively improves with proximity to Times Square. Periodic patterns of sentiment fluctuate on both a daily and a weekly scale: more positive tweets are posted on weekends than on weekdays, with a daily peak in sentiment around midnight and a nadir between 9:00 a.m. and noon.


Press Release: High resolution and temporal dynamics of sentiment in New York City

CAMBRIDGE (Aug 20, 2013) — Imagine having your finger on the pulse of an entire city, in real time. To see its heartbeat -- changes in people opinions and moods -- as a cascade of color, sweeping over the terrain. Researchers at the New England Complex Systems Institute (NECSI) used the explosion of data from Twitter to take snapshots of the mood of New York City, and follow its ups and downs in real time and high resolution. They discovered that there are clear patterns in the fluctuations of Twitter users' feelings. On the whole, tweets are most positive near public parks like Central Park and the New York Botanical Garden, and most negative around transportation hubs such as the entrance to the Midtown Tunnel and the Brooklyn Bridge, Penn Station and Port Authority, and the two airports: JFK and LaGuardia. People closer to Times Square are happiest and the mood generally worsens the further away you go. Within each day, sentiment peaks at midnight, and dips between 9am-12pm. The analysis was able to use precise data about the time and location of the tweets in order to create an accurate map and see fine grained patterns. The report, "Sentiment in New York City: A High Resolution Spatial and Temporal View," by Karla Bertrand, Maya Bialik, Kawandeep Virdee, Andreas Gros and Yaneer Bar-Yam, created an algorithm to automatically classify tweets as positive or negative, and use their geotags and time information to paint a map. The algorithm started with emoticons like :) and :(, and by looking at other features of those tweets, learned to identify sentiment even in tweets that relied on words to express emotions. Due to the great detail in the analysis, the researchers were able to locate specific areas of extreme sentiment such as cemeteries and medical centers. One area, Maspeth Creek, that has extremely negative tweets coming from it, they discovered has a foul smell not only because of the gaseous mudflats, but also because it is the site of the largest oil spill in the country and receives 288 million gallons of untreated sewage each year. While previous reports have speculated on the effect of surroundings on people's quality of life, the new analysis shows very clearly that people are upset by an odorous creek, traffic, and trains, buses, and airplanes running late, and happiest in public parks. "This is the first time we are able to easily and precisely map people's mood to their time and location" said Bar-Yam. "The possible uses of this tool are endless."

Sentiment distribution of
geo-tagged tweets in New York City

Public sentiment map of the Manhattan and surrounding areas according to analysis of over 600,000 tweets, organized by census block. Cyan represents the most positive sentiment and magenta the most negative. White represents areas with insufficient tweet density for analysis. Areas of strong sentiment are labeled by A – F as follows: A: Parks; B: Transportation Hubs; C: Cemeteries; D: Riker's Island ; E: Maspeth Creek; F: Medical Centers.



News Coverage

Science Magazine ScienceShot: The Saddest Spot in New York
by John Bohannon
Atlantic Cities Twitter Knows Which Parts of New York City Smell Bad
by Emily Badger
motherboard The Best Map Porn of 2013
by Meghan Neal
New Scientist Twitter reveals the happiest spots in New York
by Anil Ananthaswamy
PhysOrg A Map of New York City's Happiness, According to Twitter
by Brian Merchant
iq Mapping the Moods of teh Entire City
by Ben Kaplan
La Repubblica E Twitter legge l'umore delle città
by Elena Dusi
phys.org Sentiment in New York City: A high resolution spatial and temporal view
Gothamist Twitter Sentiment Map Claims Times Square Is Happiest Place In NYC
by Ben Yakas
DNA Info Fort Tryon Park is the Happiest Spot in Manhattan, Study Finds
by Nigel Chiwaya
Slashdot Twitter-Based Study Figures Out Saddest Spots In New York City
by samzenpus
Stuff.co.nz The Saddest Spot in New York Geekosystem New Study Confirms (My) Upper East Side School Is the Saddest Place in NYC
by Maia Brown-Jackson
inquisitr Saddest, Happiest Spots In New York City Mapped Using Twitter
leaderswest Study: NYC Twitter sentiment highest in parks, lowest in transit
by Jim Dougherty
Lai Look The Saddest Spot in New York EarthSky Twitter data takes snapshots of mood of New York City The Real Deal JLo fends off Hamptons pool house squatter, New Yorkers happiest near Times Square … and more
Lowe Counsel City "Sentiment Maps" May be the Future of Everything
Daily Collegian NESCI conducts Twitter-based study determining mood of entire city
by Catherine Ferris

 

 

Phone: 617-547-4100 | Fax: 617-661-7711 | Email: office at necsi.edu

238 Main St. Suite 319 Cambridge, MA USA