Library of Congress Sits On 170-Billion Tweets Archive (Every Tweet Ever Posted)

By Alexandra Burlacu email: a.burlacu@mobilenapps.com | Jan 08, 2013 01:46 PM EST

Share This Story

  • Print
  • Email

The Library of Congress has started collecting an archive of Twitter messages since 2010, and it has now collected roughly 170 billion tweets.

As part of this effort, the U.S. government institution made a deal with Twitter in 2010. Under the terms of the agreement, Twitter is donating a full stream of all public tweets to the Library of Congress. That archive includes 21 billion tweets generated between 2006 and April 2010, as well as 150 billion more tweets posted since then.

Follow us

"Twitter is a new kind of collection for the Library of Congress but an important one to its mission," wrote the Library in blog post on Friday, Jan. 4. "As society turns to social media as a primary method of communication and creative expression, social media is supplementing, and in some cases supplanting, letters, journals, serial publications, and other sources routinely collected by research libraries."

It remains unclear at this point, however, how the Library of Congress is planning to utilize this ongoing archive. The institution gave no clue of whether it will make that archive public at some point, but it did issue a white paper outlining the project.

"Though the Library has been building and stabilizing the archive and has not yet offered researchers access, we have nevertheless received approximately 400 inquiries from researchers all over the world," explained the Jan. 4 announcement. "Some broad topics of interest expressed by researchers run from patterns in the rise of citizen journalism and elected officials' communications to tracking vaccination rates and predicting stock market activity."

According to the Library of Congress, its two full copies of the entire Twitter archive, i.e. 170 billion tweets, amount to roughly 133 Terabytes of data, and each tweet carries about 50 accompanying metadata fields. The Library has not yet started sorting or filtering that 133TB of Twitter data, which is why it hasn't been able to make this massive archive available to researchers.

In today's tech-driven world, the Internet and social media have gained considerable ground, and in many instances, platforms such as Twitter and Facebook are the fastest way to spread the word. In some ways, such social media services are modern-day versions of journals, log-books, or history books, with activity logs from millions and millions of users.

Get the Most Popular Mobile&Apps Stories in a Weekly Newsletter

© 2014 Mobile & Apps All rights reserved. Do not reproduce without permission.

Join Our Conversation

Smartphones
Motorola invite for Nov. 5 event Droid Turbo global version launching on Nov. 5 as Moto Maxx?
Microsoft Band fitness tracker debuts alongside Microsoft Health service: Here's the deal (VIDEO)
Motorola Nexus 6 goes in and out of stock in no time on Google Play
Meet the new OPPO N3 and R5 smartphones – What you need to know
Tablet / Laptop / PC
Dell Venue 7 and Venue 8 Dell unveils Venue 7 and Venue 8 Android 4.3 Jelly Bean tablets
Retina iPad Mini facing delays, may not launch until early next year
Refurbished 128GB iPad with Retina Display now available on the Apple Online Store
Samsung Galaxy Note 10.1 – 2014 Edition: Pricing and availability now official
Gadgets
Amazon Logo Amazon reportedly to launch ‘Firetube’ set-top box before 2013 holidays
Samsung Galaxy Note 3 and Galaxy Gear India launch: Pricing and availability
Samsung Galaxy Gear Android smartwatch now up for pre-order in Canada
Samsung Galaxy Gear 2 reportedly in the works already, may debut at CES or MWC 2014
OS / Software
HTC Logo HTC reportedly considering Android/Windows Phone dual-booting smartphone as Microsoft pushes for deeper Windows mobile integration
iOS 7 Chrome Incognito mode leaks private searches due to bug
Sprint HTC One Android 4.3 Jelly Bean already rolling out, AT&T, T-Mobile & Verizon to follow
Microsoft Windows 8.1 now available for pre-order
Internet / Social Media
Google Downtime Google blacks out for two minutes, causes 40 percent drop in world’s Internet traffic
Xbox Music web player is live and ready for Xbox Music Pass subscribers
Facebook Android app collected phone numbers even if users never logged in
Firefox 22 brings support for web video calls, 3D gaming, and Unreal Engine 3
What's App
Flipboard for Windows Phone Flipboard for Windows Phone finally available, but requires 1GB of RAM (VIDEO)
Vine gets major update, lets you upload previously-shot videos & more (VIDEO)
BlackBerry Messenger (BBM) finally hits Windows Phone – Available as a free download now
Instagram releases Bolt ephemeral messaging app in select markets to challenge Snapchat
Copyright © 2014 Mobile & Apps All rights reserved. mobilenapps
Real Time Analytics