Amazon Exposes 1 Terabyte of Public Data to Developers
Feb 25, 2009 Read/Write Web
pimg src=”http://www.readwriteweb.com/aws_nov_08.jpg”Amazon.com changed the retail world. In the process the company built up so much surplus computing power that it started a dirt cheap “computing in the cloud” business that changed the computing world. This week the company’s newest project a href=”http://aws.amazon.com/publicdatasets”Public Data Sets on Amazon Web Services/a began offering more than 1 Terabyte (1000 GB) of fascinating public data for developers to access on the fly through Amazon’s cloud computing service./p
pWe’re talking about an annotated collection of all publicly available DNA sequences, including the Human Genome, huge amounts of chemistry data, machine readable encyclopedic entries about millions of different topics and an entire dump of Wikipedia. US Census data, data from the US Department of Transportation and more. It’s all accessible by web applications in no time at all. What do you think emthis/em is going to change?/p
p align=”right”emSponsor/embr /a href=’http://d1.openx.org/ck.php?n=13992amp;cb=13992′ target=’_blank’img src=’http://d1.openx.org/avw.php?zoneid=11205amp;cb=13992amp;n=13992′ border=’0′ alt=” align=”right” //a/p
pThe company made a href=”http://aws.typepad.com/aws/2009/02/new-aws-public-data-sets-economics-dbpedia-freebase-and-wikipedia.html”a blog post last night/a announcing the availability of four new public data sets./p
pimg alt=”aws350.jpg” src=”http://www.readwriteweb.com/images/aws350.jpg” width=”350″ height=”238″ align=”right”This includes data from:br /
ulli The a href=”http://www.bts.gov/”Bureau of Transportation Statistics./a/libr /
lia href=”http://dbpedia.org/”DBPedia Knowledge Base/a – which “currently describes more than 2.6 million things including 213,000 people, 328,000 places, 57,000 music albums, 36,000 films, and 20,000 companies.” All in handy semantic markup./libr /
liThe a href=”http://download.freebase.com/datadumps/”Freebase Data Dump/a – the giant collaboratively build semantic database on a wide variety of topics, data that high profile startup Metaweb has spent millions of dollars assembling./libr /
liThe entire English section of Wikipedia, dumped into a machine readable format./libr /
liA number of large genetic and scientific databases./li/ul/p
pWe counted all the databases up and it passed 1 TB of available data. The company says that accessing this data is “trivial” for developers. /p
pWhat are developers going to do with this data? We can’t wait to find out. The prospect of mashing up, cross referencing and user interfacing with this amount of data is nearly unfathomable. Really. This data will be leveraged by all kinds of different web applications, for a long time./p
pYou’ve read, or can imagine, the impact that the first Public Libraries had on human culture. Now imagine the opening up of not just this, but other libraries of data, so huge that economies of scale blast the project off beyond any analogy that could be drawn with our everyday experience or historical memories. It won’t just be Amazon that offers up this kind of data – it will be relatively commonplace soon, we imagine. /p
pIt will be like a network of libraries – for robots. Robots that go to the library frequently, read very fast and make serious use of what they’ve learned./p
pCongratulations, Amazon, on passing 1 TB of public data made available. May all our robots of the future please live in peace./p
stronga href=”http://www.readwriteweb.com/archives/amazon_exposes_1_terrabyte_of.php#comments-open”Discuss/a/strong
pa href=”http://feedads.googleadservices.com/~at/eD9KwouhzxGLznMOfMAPAw01AiQ/a”img src=”http://feedads.googleadservices.com/~at/eD9KwouhzxGLznMOfMAPAw01AiQ/i” border=”0″ ismap=”true”/img/a/pdiv
a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:5FKgXYexu4Y”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?d=5FKgXYexu4Y” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:yIl2AUoC8zA”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?d=yIl2AUoC8zA” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:V_sGLiPBpWU”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?i=4asgE6hnL1U:k3vBPB8KAKc:V_sGLiPBpWU” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:gIN9vFwOqvQ”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?i=4asgE6hnL1U:k3vBPB8KAKc:gIN9vFwOqvQ” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:F7zBnMyn0Lo”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?i=4asgE6hnL1U:k3vBPB8KAKc:F7zBnMyn0Lo” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:qj6IDK7rITs”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?d=qj6IDK7rITs” border=”0″/img/a a href=”http://feeds2.feedburner.com/~ff/readwriteweb?a=4asgE6hnL1U:k3vBPB8KAKc:OqabYuBsmOY”img src=”http://feeds2.feedburner.com/~ff/readwriteweb?d=OqabYuBsmOY” border=”0″/img/a
/divimg src=”http://feeds2.feedburner.com/~r/readwriteweb/~4/4asgE6hnL1U” height=”1″ width=”1″/
Popularity: 1% [?]
