Webarc:Input Dataset Statistics: Difference between revisions
From Adapt
No edit summary |
No edit summary |
||
(5 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
From the English Wikipedia XML dump crated on April 25th 2007, we extracted 83 monthly snapshots. All the experiments have been performed on these monthly snapshots. | |||
{| class="wikitable" style="margin: 1em auto 1em auto" border="1" | {| class="wikitable" style="margin: 1em auto 1em auto" border="1" | ||
|- | |- | ||
| | | Original Data || English Wikipedia XML Dump created on April 25th 2007 | ||
|- | |||
| Extracted Data || 83 monthly snapshots between February 2001 ~ December 2007 | |||
|- | |||
| Included in Each Snapshot || Most recent revision of each article as of the end of the month. | |||
|- | |- | ||
| Number of Articles || 2,077,745 | | Number of Articles || 2,077,745 | ||
Line 14: | Line 19: | ||
|- | |- | ||
| The Least Frequently-Updated Article || "Buzz!! The Movie" and 317,126 others - 1 revision each | | The Least Frequently-Updated Article || "Buzz!! The Movie" and 317,126 others - 1 revision each | ||
|} | |||
<center>[[Image:wiki_update_frequency.png|640px]]</center> | |||
The following table shows the number of articles in each monthly snapshot. In each month, we separately counted the articles that were newly updated within the month, and the articles that were last updated in a previous month. | |||
In the following table, February 2001 is short-written as month-001, March 2001 as month-002, ..., December 2007 as month-083. | |||
{| class="wikitable" style="text-align:right; margin: 1em auto 1em auto " border="1" | |||
|-align="center" | |||
!width="100"|Snapshot || Number of Carried-Over Articles || Number of Newly-Updated Articles || Total Number of Articles | |||
|- | |||
| month-001 || 0 || 23 || 23 | |||
|- | |||
| month-002 || 21 || 160 || 181 | |||
|- | |||
| month-003 || 179 || 212 || 391 | |||
|- | |||
| month-004 || 385 || 670 || 1,055 | |||
|- | |||
| month-005 || 1,046 || 186 || 1,232 | |||
|- | |||
| month-006 || 1,207 || 349 || 1,556 | |||
|- | |||
| month-007 || 1,534 || 695 || 2,229 | |||
|- | |||
| month-008 || 2,163 || 1,190 || 3,353 | |||
|- | |||
| month-009 || 3,266 || 1,917 || 5,183 | |||
|- | |||
| month-010 || 4,972 || 1,939 || 6,911 | |||
|- | |||
| month-011 || 6,364 || 2,491 || 8,855 | |||
|- | |||
| month-012 || 8,129 || 2,277 || 10,406 | |||
|- | |||
| month-013 || 8,626 || 3,408 || 12,034 | |||
|- | |||
| month-014 || 10,145 || 3,669 || 13,814 | |||
|- | |||
| month-015 || 12,149 || 2,890 || 15,039 | |||
|- | |||
| month-016 || 13,197 || 3,797 || 16,994 | |||
|- | |||
| month-017 || 13,967 || 5,192 || 19,159 | |||
|- | |||
| month-018 || 15,825 || 6,291 || 22,116 | |||
|- | |||
| month-019 || 17,560 || 10,200 || 27,760 | |||
|- | |||
| month-020 || 21,135 || 16,112 || 37,247 | |||
|- | |||
| month-021 || 29,871 || 28,525 || 58,396 | |||
|- | |||
| month-022 || 52,325 || 10,311 || 62,636 | |||
|- | |||
| month-023 || 51,434 || 27,957 || 79,391 | |||
|- | |||
| month-024 || 71,448 || 13,466 || 84,914 | |||
|- | |||
| month-025 || 76,908 || 12,617 || 89,525 | |||
|- | |||
| month-026 || 81,189 || 13,327 || 94,516 | |||
|- | |||
| month-027 || 85,235 || 14,343 || 99,578 | |||
|- | |||
| month-028 || 87,799 || 17,513 || 105,312 | |||
|- | |||
| month-029 || 87,679 || 23,705 || 111,384 | |||
|- | |||
| month-030 || 92,631 || 26,438 || 119,069 | |||
|- | |||
| month-031 || 102,220 || 23,983 || 126,203 | |||
|- | |||
| month-032 || 109,987 || 24,068 || 134,055 | |||
|- | |||
| month-033 || 116,297 || 24,339 || 140,636 | |||
|- | |||
| month-034 || 119,494 || 29,287 || 148,781 | |||
|- | |||
| month-035 || 125,761 || 33,126 || 158,887 | |||
|- | |||
| month-036 || 133,969 || 34,961 || 168,930 | |||
|- | |||
| month-037 || 137,032 || 46,191 || 183,223 | |||
|- | |||
| month-038 || 139,282 || 63,119 || 202,401 | |||
|- | |||
| month-039 || 153,382 || 66,120 || 219,502 | |||
|- | |||
| month-040 || 164,852 || 70,693 || 235,545 | |||
|- | |||
| month-041 || 150,747 || 101,445 || 252,192 | |||
|- | |||
| month-042 || 186,426 || 84,940 || 271,366 | |||
|- | |||
| month-043 || 201,801 || 88,208 || 290,009 | |||
|- | |||
| month-044 || 213,105 || 95,792 || 308,897 | |||
|- | |||
| month-045 || 230,877 || 99,329 || 330,206 | |||
|- | |||
| month-046 || 208,679 || 146,893 || 355,572 | |||
|- | |||
| month-047 || 239,545 || 140,840 || 380,385 | |||
|- | |||
| month-048 || 289,942 || 111,292 || 401,234 | |||
|- | |||
| month-049 || 310,721 || 109,583 || 420,304 | |||
|- | |||
| month-050 || 309,097 || 136,095 || 445,192 | |||
|- | |||
| month-051 || 311,723 || 162,419 || 474,142 | |||
|- | |||
| month-052 || 332,785 || 171,091 || 503,876 | |||
|- | |||
| month-053 || 346,613 || 189,980 || 536,593 | |||
|- | |||
| month-054 || 362,863 || 215,235 || 578,098 | |||
|- | |||
| month-055 || 387,670 || 233,548 || 621,218 | |||
|- | |||
| month-056 || 430,610 || 227,345 || 657,955 | |||
|- | |||
| month-057 || 438,169 || 263,848 || 702,017 | |||
|- | |||
| month-058 || 477,553 || 266,604 || 744,157 | |||
|- | |||
| month-059 || 462,758 || 326,800 || 789,558 | |||
|- | |||
| month-060 || 484,083 || 356,435 || 840,518 | |||
|- | |||
| month-061 || 536,424 || 349,439 || 885,863 | |||
|- | |||
| month-062 || 535,708 || 400,751 || 936,459 | |||
|- | |||
| month-063 || 574,904 || 409,781 || 984,685 | |||
|- | |||
| month-064 || 605,089 || 430,124 || 1,035,213 | |||
|- | |||
| month-065 || 646,905 || 439,811 || 1,086,716 | |||
|- | |||
| month-066 || 674,061 || 472,054 || 1,146,115 | |||
|- | |||
| month-067 || 699,421 || 510,847 || 1,210,268 | |||
|- | |||
| month-068 || 776,674 || 485,047 || 1,261,721 | |||
|- | |||
| month-069 || 806,557 || 506,063 || 1,312,620 | |||
|- | |||
| month-070 || 833,026 || 530,075 || 1,363,101 | |||
|- | |||
| month-071 || 882,059 || 531,460 || 1,413,519 | |||
|- | |||
| month-072 || 895,075 || 571,286 || 1,466,361 | |||
|- | |||
| month-073 || 956,064 || 561,065 || 1,517,129 | |||
|- | |||
| month-074 || 982,413 || 587,120 || 1,569,533 | |||
|- | |||
| month-075 || 1,024,155 || 597,422 || 1,621,577 | |||
|- | |||
| month-076 || 1,068,145 || 604,626 || 1,672,771 | |||
|- | |||
| month-077 || 1,133,363 || 605,840 || 1,739,203 | |||
|- | |||
| month-078 || 1,188,351 || 634,385 || 1,822,736 | |||
|- | |||
| month-079 || 1,233,461 || 654,324 || 1,887,785 | |||
|- | |||
| month-080 || 1,306,141 || 629,149 || 1,935,290 | |||
|- | |||
| month-081 || 1,329,029 || 654,937 || 1,983,966 | |||
|- | |||
| month-082 || 1,405,930 || 621,105 || 2,027,035 | |||
|- | |||
| month-083 || 1,441,438 || 636,307 || 2,077,745 | |||
|- | |||
| total || 30,070,825 || 16,618,497 || 46,689,322 | |||
|} | |} |
Latest revision as of 22:20, 20 November 2009
From the English Wikipedia XML dump crated on April 25th 2007, we extracted 83 monthly snapshots. All the experiments have been performed on these monthly snapshots.
Original Data | English Wikipedia XML Dump created on April 25th 2007 |
Extracted Data | 83 monthly snapshots between February 2001 ~ December 2007 |
Included in Each Snapshot | Most recent revision of each article as of the end of the month. |
Number of Articles | 2,077,745 |
Number of Revisions | 16,618,497 |
Average Number of Revisions per Article | 8 |
Average Lifespan per Revision | 27.4 months |
The Most Frequently-Updated Article | "Cannabis", "Chess", and "Sport" - 73 revisions each |
The Least Frequently-Updated Article | "Buzz!! The Movie" and 317,126 others - 1 revision each |
The following table shows the number of articles in each monthly snapshot. In each month, we separately counted the articles that were newly updated within the month, and the articles that were last updated in a previous month.
In the following table, February 2001 is short-written as month-001, March 2001 as month-002, ..., December 2007 as month-083.
Snapshot | Number of Carried-Over Articles | Number of Newly-Updated Articles | Total Number of Articles |
---|---|---|---|
month-001 | 0 | 23 | 23 |
month-002 | 21 | 160 | 181 |
month-003 | 179 | 212 | 391 |
month-004 | 385 | 670 | 1,055 |
month-005 | 1,046 | 186 | 1,232 |
month-006 | 1,207 | 349 | 1,556 |
month-007 | 1,534 | 695 | 2,229 |
month-008 | 2,163 | 1,190 | 3,353 |
month-009 | 3,266 | 1,917 | 5,183 |
month-010 | 4,972 | 1,939 | 6,911 |
month-011 | 6,364 | 2,491 | 8,855 |
month-012 | 8,129 | 2,277 | 10,406 |
month-013 | 8,626 | 3,408 | 12,034 |
month-014 | 10,145 | 3,669 | 13,814 |
month-015 | 12,149 | 2,890 | 15,039 |
month-016 | 13,197 | 3,797 | 16,994 |
month-017 | 13,967 | 5,192 | 19,159 |
month-018 | 15,825 | 6,291 | 22,116 |
month-019 | 17,560 | 10,200 | 27,760 |
month-020 | 21,135 | 16,112 | 37,247 |
month-021 | 29,871 | 28,525 | 58,396 |
month-022 | 52,325 | 10,311 | 62,636 |
month-023 | 51,434 | 27,957 | 79,391 |
month-024 | 71,448 | 13,466 | 84,914 |
month-025 | 76,908 | 12,617 | 89,525 |
month-026 | 81,189 | 13,327 | 94,516 |
month-027 | 85,235 | 14,343 | 99,578 |
month-028 | 87,799 | 17,513 | 105,312 |
month-029 | 87,679 | 23,705 | 111,384 |
month-030 | 92,631 | 26,438 | 119,069 |
month-031 | 102,220 | 23,983 | 126,203 |
month-032 | 109,987 | 24,068 | 134,055 |
month-033 | 116,297 | 24,339 | 140,636 |
month-034 | 119,494 | 29,287 | 148,781 |
month-035 | 125,761 | 33,126 | 158,887 |
month-036 | 133,969 | 34,961 | 168,930 |
month-037 | 137,032 | 46,191 | 183,223 |
month-038 | 139,282 | 63,119 | 202,401 |
month-039 | 153,382 | 66,120 | 219,502 |
month-040 | 164,852 | 70,693 | 235,545 |
month-041 | 150,747 | 101,445 | 252,192 |
month-042 | 186,426 | 84,940 | 271,366 |
month-043 | 201,801 | 88,208 | 290,009 |
month-044 | 213,105 | 95,792 | 308,897 |
month-045 | 230,877 | 99,329 | 330,206 |
month-046 | 208,679 | 146,893 | 355,572 |
month-047 | 239,545 | 140,840 | 380,385 |
month-048 | 289,942 | 111,292 | 401,234 |
month-049 | 310,721 | 109,583 | 420,304 |
month-050 | 309,097 | 136,095 | 445,192 |
month-051 | 311,723 | 162,419 | 474,142 |
month-052 | 332,785 | 171,091 | 503,876 |
month-053 | 346,613 | 189,980 | 536,593 |
month-054 | 362,863 | 215,235 | 578,098 |
month-055 | 387,670 | 233,548 | 621,218 |
month-056 | 430,610 | 227,345 | 657,955 |
month-057 | 438,169 | 263,848 | 702,017 |
month-058 | 477,553 | 266,604 | 744,157 |
month-059 | 462,758 | 326,800 | 789,558 |
month-060 | 484,083 | 356,435 | 840,518 |
month-061 | 536,424 | 349,439 | 885,863 |
month-062 | 535,708 | 400,751 | 936,459 |
month-063 | 574,904 | 409,781 | 984,685 |
month-064 | 605,089 | 430,124 | 1,035,213 |
month-065 | 646,905 | 439,811 | 1,086,716 |
month-066 | 674,061 | 472,054 | 1,146,115 |
month-067 | 699,421 | 510,847 | 1,210,268 |
month-068 | 776,674 | 485,047 | 1,261,721 |
month-069 | 806,557 | 506,063 | 1,312,620 |
month-070 | 833,026 | 530,075 | 1,363,101 |
month-071 | 882,059 | 531,460 | 1,413,519 |
month-072 | 895,075 | 571,286 | 1,466,361 |
month-073 | 956,064 | 561,065 | 1,517,129 |
month-074 | 982,413 | 587,120 | 1,569,533 |
month-075 | 1,024,155 | 597,422 | 1,621,577 |
month-076 | 1,068,145 | 604,626 | 1,672,771 |
month-077 | 1,133,363 | 605,840 | 1,739,203 |
month-078 | 1,188,351 | 634,385 | 1,822,736 |
month-079 | 1,233,461 | 654,324 | 1,887,785 |
month-080 | 1,306,141 | 629,149 | 1,935,290 |
month-081 | 1,329,029 | 654,937 | 1,983,966 |
month-082 | 1,405,930 | 621,105 | 2,027,035 |
month-083 | 1,441,438 | 636,307 | 2,077,745 |
total | 30,070,825 | 16,618,497 | 46,689,322 |