
Mapping a Day in the Life of Twitter
1 year ago
Blog post on this here: sciblogs.co.nz/seeing-data/2010/11/25/mapping-a-day-in-the-life-of-twitter/
Last week I hooked a computer up to the Twitter data streaming API and, over the course of a day, grabbed every tweet that had geographic coordinates. I wrote a Python script to parse the 2GB of JSON files and used Matplotlib with the Basemap extension to animate 25 hours of data on a world map. The resulting animation plots almost 530,000 tweets -- and remember these are just tweets with geo-coordinates enabled.
I recommend you full-screen this video, turn scaling off and high definition on.
The animation begins at 5am on November 18, Greenwich Mean Time (United Kingdom). This corresponds to midnight Eastern Standard Time, 9pm Pacific Time (Nov 17) and 6pm in New Zealand (Nov 18).
There are some interesting things to note:
- It is possible to infer the passage of the sun across the map as data begins to stream out of mobile phones and desktops and previously dark patches of the map begin to glow white.
- At 8:00, 9:00 and 10:00 GMT waves of tweets pass across the United States from East to West. This is an automated Twitter service that tweets local news for specific ZIP codes.
- Turn your attention to Indonesia. Jakarta glows as brightly as New York and San Francisco.
- Note the black spots. With the exception of a few cities, such as Lagos and Johannesburg, Africa remains the dark continent.
Each frame of the animation represents one minute of tweets. The animation runs at ten frames per second. I represent each tweet as a small white circle at two percent opacity. At the moment a tweet occurs I plot it at ten point size. Every minute that passes I drop the marker size by one point until it disappears.
Many thanks to Pierre Roudier ( twitter.com/#!/pierreroudier ) for his sage counsel and bug spotting skills.
Last week I hooked a computer up to the Twitter data streaming API and, over the course of a day, grabbed every tweet that had geographic coordinates. I wrote a Python script to parse the 2GB of JSON files and used Matplotlib with the Basemap extension to animate 25 hours of data on a world map. The resulting animation plots almost 530,000 tweets -- and remember these are just tweets with geo-coordinates enabled.
I recommend you full-screen this video, turn scaling off and high definition on.
The animation begins at 5am on November 18, Greenwich Mean Time (United Kingdom). This corresponds to midnight Eastern Standard Time, 9pm Pacific Time (Nov 17) and 6pm in New Zealand (Nov 18).
There are some interesting things to note:
- It is possible to infer the passage of the sun across the map as data begins to stream out of mobile phones and desktops and previously dark patches of the map begin to glow white.
- At 8:00, 9:00 and 10:00 GMT waves of tweets pass across the United States from East to West. This is an automated Twitter service that tweets local news for specific ZIP codes.
- Turn your attention to Indonesia. Jakarta glows as brightly as New York and San Francisco.
- Note the black spots. With the exception of a few cities, such as Lagos and Johannesburg, Africa remains the dark continent.
Each frame of the animation represents one minute of tweets. The animation runs at ten frames per second. I represent each tweet as a small white circle at two percent opacity. At the moment a tweet occurs I plot it at ten point size. Every minute that passes I drop the marker size by one point until it disappears.
Many thanks to Pierre Roudier ( twitter.com/#!/pierreroudier ) for his sage counsel and bug spotting skills.
-
katina 1 year agoReally really awsome!!!! -
Noche de Luces 1 year agoNos hemos visto, nos hemos visto.... -
Sebastian Bauer 1 year agoVery cool! Is there a chance to get the daylight (sunrise to sunset) into this? Woulc be really great, if there goes a bright stripe over the world. :) -
Chris McDowall 1 year ago@sebastian I have been thinking something similar. If I get some free time I will see what I can do. Thanks for the comment! -
mjhall 1 year agoWonder if this could be laid on top of Google Earth as a layer? Now that would be cool! -
Klau Fimiani 1 year agoBuenos Aires siempre titilando :) -
Ken Day 1 year agoGreat stuff Chris. Well done. Keep up the good work. Cheers. Ken. -
Nigel Cato 1 year agoFantastic, Chris, my 12 Geography class will love this animated map.
This conversation is missing your voice. Take five seconds to join Vimeo or log in.
| Date | Plays | Likes | Comments |
|---|---|---|---|
| Totals | 23.3K | 60 | 8 |
| Feb 23rd | 2 | 0 | 0 |
| Feb 22nd | 1 | 0 | 0 |
| Feb 21st | 3 | 0 | 0 |
| Feb 20th | 7 | 0 | 0 |
| Feb 19th | 6 | 0 | 0 |
| Feb 18th | 4 | 0 | 0 |
| Feb 17th | 5 | 0 | 0 |
Check out these lessons to learn more about how you can make videos like this one!
-
Vimeo: About / Blog / Developers / Jobs /
Community Guidelines /
Help Center / Video School / Music Store / Site Map
/ Vimeo
or
-
Legal: TM + ©2012 Vimeo, LLC. All rights reserved. / Terms of Service / Privacy Statement / Copyright

Prev week