Personal tools

Webarc:Input Dataset Statistics: Difference between revisions

From Adapt

Jump to: navigation, search
No edit summary
No edit summary
 
(5 intermediate revisions by the same user not shown)
Line 1: Line 1:
From the English Wikipedia XML dump crated on April 25th 2007, we extracted 83 monthly snapshots. All the experiments have been performed on these monthly snapshots.
{| class="wikitable" style="margin: 1em auto 1em auto" border="1"
{| class="wikitable" style="margin: 1em auto 1em auto" border="1"
|-
|-
| Number of Possible Update Points || 83 (End of each month between February 2001 ~ December 2007)
| Original Data || English Wikipedia XML Dump created on April 25th 2007
|-
| Extracted Data || 83 monthly snapshots between February 2001 ~ December 2007
|-
| Included in Each Snapshot || Most recent revision of each article as of the end of the month.
|-
|-
| Number of Articles || 2,077,745
| Number of Articles || 2,077,745
Line 14: Line 19:
|-  
|-  
| The Least Frequently-Updated Article || "Buzz!! The Movie" and 317,126 others - 1 revision each
| The Least Frequently-Updated Article || "Buzz!! The Movie" and 317,126 others - 1 revision each
|}
<center>[[Image:wiki_update_frequency.png|640px]]</center>
The following table shows the number of articles in each monthly snapshot. In each month, we separately counted the articles that were newly updated within the month, and the articles that were last updated in a previous month.
In the following table, February 2001 is short-written as month-001, March 2001 as month-002, ..., December 2007 as month-083.
{| class="wikitable" style="text-align:right; margin: 1em auto 1em auto " border="1"
|-align="center"
!width="100"|Snapshot || Number of Carried-Over Articles || Number of Newly-Updated Articles || Total Number of Articles
|-
| month-001 || 0 || 23 || 23
|-
| month-002 || 21 || 160 || 181
|-
| month-003 || 179 || 212 || 391
|-
| month-004 || 385 || 670 || 1,055
|-
| month-005 || 1,046 || 186 || 1,232
|-
| month-006 || 1,207 || 349 || 1,556
|-
| month-007 || 1,534 || 695 || 2,229
|-
| month-008 || 2,163 || 1,190 || 3,353
|-
| month-009 || 3,266 || 1,917 || 5,183
|-
| month-010 || 4,972 || 1,939 || 6,911
|-
| month-011 || 6,364 || 2,491 || 8,855
|-
| month-012 || 8,129 || 2,277 || 10,406
|-
| month-013 || 8,626 || 3,408 || 12,034
|-
| month-014 || 10,145 || 3,669 || 13,814
|-
| month-015 || 12,149 || 2,890 || 15,039
|-
| month-016 || 13,197 || 3,797 || 16,994
|-
| month-017 || 13,967 || 5,192 || 19,159
|-
| month-018 || 15,825 || 6,291 || 22,116
|-
| month-019 || 17,560 || 10,200 || 27,760
|-
| month-020 || 21,135 || 16,112 || 37,247
|-
| month-021 || 29,871 || 28,525 || 58,396
|-
| month-022 || 52,325 || 10,311 || 62,636
|-
| month-023 || 51,434 || 27,957 || 79,391
|-
| month-024 || 71,448 || 13,466 || 84,914
|-
| month-025 || 76,908 || 12,617 || 89,525
|-
| month-026 || 81,189 || 13,327 || 94,516
|-
| month-027 || 85,235 || 14,343 || 99,578
|-
| month-028 || 87,799 || 17,513 || 105,312
|-
| month-029 || 87,679 || 23,705 || 111,384
|-
| month-030 || 92,631 || 26,438 || 119,069
|-
| month-031 || 102,220 || 23,983 || 126,203
|-
| month-032 || 109,987 || 24,068 || 134,055
|-
| month-033 || 116,297 || 24,339 || 140,636
|-
| month-034 || 119,494 || 29,287 || 148,781
|-
| month-035 || 125,761 || 33,126 || 158,887
|-
| month-036 || 133,969 || 34,961 || 168,930
|-
| month-037 || 137,032 || 46,191 || 183,223
|-
| month-038 || 139,282 || 63,119 || 202,401
|-
| month-039 || 153,382 || 66,120 || 219,502
|-
| month-040 || 164,852 || 70,693 || 235,545
|-
| month-041 || 150,747 || 101,445 || 252,192
|-
| month-042 || 186,426 || 84,940 || 271,366
|-
| month-043 || 201,801 || 88,208 || 290,009
|-
| month-044 || 213,105 || 95,792 || 308,897
|-
| month-045 || 230,877 || 99,329 || 330,206
|-
| month-046 || 208,679 || 146,893 || 355,572
|-
| month-047 || 239,545 || 140,840 || 380,385
|-
| month-048 || 289,942 || 111,292 || 401,234
|-
| month-049 || 310,721 || 109,583 || 420,304
|-
| month-050 || 309,097 || 136,095 || 445,192
|-
| month-051 || 311,723 || 162,419 || 474,142
|-
| month-052 || 332,785 || 171,091 || 503,876
|-
| month-053 || 346,613 || 189,980 || 536,593
|-
| month-054 || 362,863 || 215,235 || 578,098
|-
| month-055 || 387,670 || 233,548 || 621,218
|-
| month-056 || 430,610 || 227,345 || 657,955
|-
| month-057 || 438,169 || 263,848 || 702,017
|-
| month-058 || 477,553 || 266,604 || 744,157
|-
| month-059 || 462,758 || 326,800 || 789,558
|-
| month-060 || 484,083 || 356,435 || 840,518
|-
| month-061 || 536,424 || 349,439 || 885,863
|-
| month-062 || 535,708 || 400,751 || 936,459
|-
| month-063 || 574,904 || 409,781 || 984,685
|-
| month-064 || 605,089 || 430,124 || 1,035,213
|-
| month-065 || 646,905 || 439,811 || 1,086,716
|-
| month-066 || 674,061 || 472,054 || 1,146,115
|-
| month-067 || 699,421 || 510,847 || 1,210,268
|-
| month-068 || 776,674 || 485,047 || 1,261,721
|-
| month-069 || 806,557 || 506,063 || 1,312,620
|-
| month-070 || 833,026 || 530,075 || 1,363,101
|-
| month-071 || 882,059 || 531,460 || 1,413,519
|-
| month-072 || 895,075 || 571,286 || 1,466,361
|-
| month-073 || 956,064 || 561,065 || 1,517,129
|-
| month-074 || 982,413 || 587,120 || 1,569,533
|-
| month-075 || 1,024,155 || 597,422 || 1,621,577
|-
| month-076 || 1,068,145 || 604,626 || 1,672,771
|-
| month-077 || 1,133,363 || 605,840 || 1,739,203
|-
| month-078 || 1,188,351 || 634,385 || 1,822,736
|-
| month-079 || 1,233,461 || 654,324 || 1,887,785
|-
| month-080 || 1,306,141 || 629,149 || 1,935,290
|-
| month-081 || 1,329,029 || 654,937 || 1,983,966
|-
| month-082 || 1,405,930 || 621,105 || 2,027,035
|-
| month-083 || 1,441,438 || 636,307 || 2,077,745
|-
| total || 30,070,825 || 16,618,497 || 46,689,322
|}
|}

Latest revision as of 22:20, 20 November 2009

From the English Wikipedia XML dump crated on April 25th 2007, we extracted 83 monthly snapshots. All the experiments have been performed on these monthly snapshots.

Original Data English Wikipedia XML Dump created on April 25th 2007
Extracted Data 83 monthly snapshots between February 2001 ~ December 2007
Included in Each Snapshot Most recent revision of each article as of the end of the month.
Number of Articles 2,077,745
Number of Revisions 16,618,497
Average Number of Revisions per Article 8
Average Lifespan per Revision 27.4 months
The Most Frequently-Updated Article "Cannabis", "Chess", and "Sport" - 73 revisions each
The Least Frequently-Updated Article "Buzz!! The Movie" and 317,126 others - 1 revision each
Wiki update frequency.png

The following table shows the number of articles in each monthly snapshot. In each month, we separately counted the articles that were newly updated within the month, and the articles that were last updated in a previous month.

In the following table, February 2001 is short-written as month-001, March 2001 as month-002, ..., December 2007 as month-083.

Snapshot Number of Carried-Over Articles Number of Newly-Updated Articles Total Number of Articles
month-001 0 23 23
month-002 21 160 181
month-003 179 212 391
month-004 385 670 1,055
month-005 1,046 186 1,232
month-006 1,207 349 1,556
month-007 1,534 695 2,229
month-008 2,163 1,190 3,353
month-009 3,266 1,917 5,183
month-010 4,972 1,939 6,911
month-011 6,364 2,491 8,855
month-012 8,129 2,277 10,406
month-013 8,626 3,408 12,034
month-014 10,145 3,669 13,814
month-015 12,149 2,890 15,039
month-016 13,197 3,797 16,994
month-017 13,967 5,192 19,159
month-018 15,825 6,291 22,116
month-019 17,560 10,200 27,760
month-020 21,135 16,112 37,247
month-021 29,871 28,525 58,396
month-022 52,325 10,311 62,636
month-023 51,434 27,957 79,391
month-024 71,448 13,466 84,914
month-025 76,908 12,617 89,525
month-026 81,189 13,327 94,516
month-027 85,235 14,343 99,578
month-028 87,799 17,513 105,312
month-029 87,679 23,705 111,384
month-030 92,631 26,438 119,069
month-031 102,220 23,983 126,203
month-032 109,987 24,068 134,055
month-033 116,297 24,339 140,636
month-034 119,494 29,287 148,781
month-035 125,761 33,126 158,887
month-036 133,969 34,961 168,930
month-037 137,032 46,191 183,223
month-038 139,282 63,119 202,401
month-039 153,382 66,120 219,502
month-040 164,852 70,693 235,545
month-041 150,747 101,445 252,192
month-042 186,426 84,940 271,366
month-043 201,801 88,208 290,009
month-044 213,105 95,792 308,897
month-045 230,877 99,329 330,206
month-046 208,679 146,893 355,572
month-047 239,545 140,840 380,385
month-048 289,942 111,292 401,234
month-049 310,721 109,583 420,304
month-050 309,097 136,095 445,192
month-051 311,723 162,419 474,142
month-052 332,785 171,091 503,876
month-053 346,613 189,980 536,593
month-054 362,863 215,235 578,098
month-055 387,670 233,548 621,218
month-056 430,610 227,345 657,955
month-057 438,169 263,848 702,017
month-058 477,553 266,604 744,157
month-059 462,758 326,800 789,558
month-060 484,083 356,435 840,518
month-061 536,424 349,439 885,863
month-062 535,708 400,751 936,459
month-063 574,904 409,781 984,685
month-064 605,089 430,124 1,035,213
month-065 646,905 439,811 1,086,716
month-066 674,061 472,054 1,146,115
month-067 699,421 510,847 1,210,268
month-068 776,674 485,047 1,261,721
month-069 806,557 506,063 1,312,620
month-070 833,026 530,075 1,363,101
month-071 882,059 531,460 1,413,519
month-072 895,075 571,286 1,466,361
month-073 956,064 561,065 1,517,129
month-074 982,413 587,120 1,569,533
month-075 1,024,155 597,422 1,621,577
month-076 1,068,145 604,626 1,672,771
month-077 1,133,363 605,840 1,739,203
month-078 1,188,351 634,385 1,822,736
month-079 1,233,461 654,324 1,887,785
month-080 1,306,141 629,149 1,935,290
month-081 1,329,029 654,937 1,983,966
month-082 1,405,930 621,105 2,027,035
month-083 1,441,438 636,307 2,077,745
total 30,070,825 16,618,497 46,689,322