Project in Mining Massive Data Sets
When dealing with these datasets please be careful and responsible. The datasets are meant to be used strictly for the purposes of the class project and nothing else. This means: (1) Do not do anything ''funny'' with the dataset; (2) Do not try to break the anonymization; (3) Do not share that data outside the class; (4) do not copy the data off the Amazon EC2; (4) After the class is over destroy all data.
Stanford CS341 only datasets
- See the slides from the info session for more information about what datasets are available to work with.
- New: Traffice and weather data from Didi (Didi Chuxing). The dataset is available at this but is password protected.Please contact the course staff for username and password details.
- New: Jasper Ridge Biological Preserve 200,000 images of motion-triggered day-and-night photos of animals in the Preserve, and terabytes of ultrasound recordings to identify bats. More information is available here.
- DBpedia. Richly labeled network containing extracted
data from Wikipedia (based on infoboxes). Labeled network of multiple
types of nodes and edges
About 2.6 million concepts described by 247 million triples, including
abstracts in 14 different languages. http://dbpedia.org. Some project ideas:
Other OpenLinkedData datasets available at http://esw.w3.org/DataSetRDFDumps.
- Detecting of missing links (and relation types)
- Classification of nodes into the onthology.
- SNAP network datasets. 60 large social and information network datasets
- Ratings and purchases (movies, music, etc.)
- Yahoo! Webscope Catalog of datasets
- Yahoo! Webscope dataset collection. Contains Language Data, Graph and Social Data, Ratings Data, Advertising and Market Data, Competition Data
Jure Leskovec will have to apply for any sets you want, and we must
agree not to distribute them further. There may be a delay, so get
requests in early.
- 1.usa.gov data set
It would enable questions around link propagation, half-life by
referrer, geographical analysis, and I'm sure a ton of other fun