Menggy Lab Menggy Lab: Internet Data Collection and Extraction


Modern Internet has massive data, which caught many academic researchers' attention. However, how to handle big data (collect, extract, clease, format and organize) becomes an urgent problem, especially for those who are not major in C.S.. Collect data manually is too time-consuming; Buy data from a third-party company is too expensive, many projects have to be stopped before it even gets started.
Menggy Lab aims to provide data support for academic researchers, universities or other academic institutions for FREE.

Data Explore          Customize a Dataset

Diven by Data

“Future world will be driven by the Data rather than Petroleum.” - Jack Ma

How much BIG the Internet is

It is estimated that the size of the data that Four Giants owned exceeds 1200PB, i.e., 120w terabytes

The value of the data

“By measuring the entropy of each individual's trajectory, we find a 93% potential predictability in user mobility across the whole user base.” -
Science 19 February 2010

The size of data they collected

Google

5,000 PB

Baidu

2,000 PB

Facebook

300 PB

eBay

90 PB

Menggy Lab collected

Datasets

79

Records

75,587,489

Size

29.67 GB

Web Page

24,113,373

Data Explore

中国高校导航

中国所有大学数据 - 中国高校导航 - www.ccug.net
Update:2016/09/11 - Create:2016/09/11

Records:2,204 | Variables:16 | Size:4.78 MB | Downloads:0 | Views:96
Allen - 14天前
虎扑

虎扑体育论坛全部用户数据 - bbs.hupu.com
Update:2016/08/25 - Create:2016/08/25

Records:114,285 | Variables:17 | Size:48.73 MB | Downloads:0 | Views:122
Allen - 1月前
虎扑

虎扑体育论坛全部回复数据 - bbs.hupu.com
Update:2016/08/26 - Create:2016/08/05

Records:26,739,944 | Variables:14 | Size:9.33 GB | Downloads:0 | Views:107
Allen - 1月前
虎扑

虎扑体育论坛主贴所有数据 - bbs.hupu.com
Update:2016/08/05 - Create:2016/08/01

Records:595,717 | Variables:15 | Size:1.29 GB | Downloads:0 | Views:134
Allen - 1月前
猫扑网

猫扑大杂烩数据-猫扑网 - dzh.mop.com
Update:2016/07/31 - Create:2016/07/30

Records:23,186 | Variables:18 | Size:52.27 MB | Downloads:0 | Views:134
Allen - 1月前
老杳吧

集微网分类资讯数据 - laoyaoba.com
Update:2016/07/26 - Create:2016/07/25

Records:285,055 | Variables:10 | Size:915.85 MB | Downloads:0 | Views:152
Allen - 2月前
新加坡狮城论坛

新加坡狮城论坛全部数据(包含主贴及全部回复数据) - bbs.sgcn.com
Update:2016/07/29 - Create:2016/07/11

Records:11,160,252 | Variables:11 | Size:5.15 GB | Downloads:0 | Views:183
Allen - 2月前
新加坡狮城论坛

新加坡狮城论坛主贴数据 - bbs.sgcn.com
Update:2016/07/09 - Create:2016/07/08

Records:997,723 | Variables:12 | Size:1020.84 MB | Downloads:0 | Views:223
Allen - 2月前
hclip

成人视频网站数据集, 适用于文本分析, 关键字过滤 - hclips.com
Update:2016/07/05 - Create:2016/07/05

Records:1,166,950 | Variables:19 | Size:533.17 MB | Downloads:0 | Views:207
Allen - 2月前
无忧保姆网

无忧保姆网全部保姆信息 - www.51baomu.cn
Update:2016/07/03 - Create:2016/07/03

Records:90,652 | Variables:13 | Size:22.28 MB | Downloads:0 | Views:208
Allen - 2月前