Menggy Lab Menggy Lab: Internet Data Collection and Extraction


Modern Internet has massive data, which caught many academic researchers' attention. However, how to handle big data (collect, extract, clease, format and organize) becomes an urgent problem, especially for those who are not major in C.S.. Collect data manually is too time-consuming; Buy data from a third-party company is too expensive, many projects have to be stopped before it even gets started.
Menggy Lab aims to provide data support for academic researchers, universities or other academic institutions for FREE.

Data Explore          Customize a Dataset

Diven by Data

“Future world will be driven by the Data rather than Petroleum.” - Jack Ma

How much BIG the Internet is

It is estimated that the size of the data that Four Giants owned exceeds 1200PB, i.e., 120w terabytes

The value of the data

“By measuring the entropy of each individual's trajectory, we find a 93% potential predictability in user mobility across the whole user base.” -
Science 19 February 2010

The size of data they collected

Google

5,000 PB

Baidu

2,000 PB

Facebook

300 PB

eBay

90 PB

Menggy Lab collected

Datasets

76

Records

48,731,056

Size

20.29 GB

Web Page

22,309,008

Data Explore

虎扑

虎扑体育论坛主贴所有数据 - bbs.hupu.com
Update:2016/08/05 - Create:2016/08/01

Records:595,717 | Variables:15 | Size:1.29 GB | Downloads:0 | Views:82
Allen - 23天前
猫扑网

猫扑大杂烩数据-猫扑网 - dzh.mop.com
Update:2016/07/31 - Create:2016/07/30

Records:23,186 | Variables:18 | Size:52.27 MB | Downloads:0 | Views:100
Allen - 25天前
老杳吧

集微网分类资讯数据 - laoyaoba.com
Update:2016/07/26 - Create:2016/07/25

Records:285,055 | Variables:10 | Size:915.85 MB | Downloads:0 | Views:102
Allen - 1月前
新加坡狮城论坛

新加坡狮城论坛全部数据(包含主贴及全部回复数据) - bbs.sgcn.com
Update:2016/07/29 - Create:2016/07/11

Records:11,160,252 | Variables:11 | Size:5.15 GB | Downloads:0 | Views:118
Allen - 1月前
新加坡狮城论坛

新加坡狮城论坛主贴数据 - bbs.sgcn.com
Update:2016/07/09 - Create:2016/07/08

Records:997,723 | Variables:12 | Size:1020.84 MB | Downloads:0 | Views:140
Allen - 1月前
hclip

成人视频网站数据集, 适用于文本分析, 关键字过滤 - hclips.com
Update:2016/07/05 - Create:2016/07/05

Records:1,166,950 | Variables:19 | Size:533.17 MB | Downloads:0 | Views:161
Allen - 1月前
无忧保姆网

无忧保姆网全部保姆信息 - www.51baomu.cn
Update:2016/07/03 - Create:2016/07/03

Records:90,652 | Variables:13 | Size:22.28 MB | Downloads:0 | Views:159
Allen - 1月前
Digi-Key

得捷电子所有电子元件数据(英文主站) - www.digikey.com
Update:2016/07/01 - Create:2016/07/01

Records:4,439,460 | Variables:18 | Size:2.63 GB | Downloads:0 | Views:128
Allen - 1月前
中華黃頁網路電話簿

SuperhiPage中華黃頁網路電話簿 - www.iyp.com.tw
Update:2016/06/30 - Create:2016/06/29

Records:479,722 | Variables:14 | Size:235.15 MB | Downloads:0 | Views:115
Allen - 1月前
Digi-Key

得捷电子所有电子元件数据 - www.digikey.com.cn
Update:2016/06/27 - Create:2016/06/22

Records:4,072,575 | Variables:17 | Size:2.33 GB | Downloads:0 | Views:107
Allen - 2月前