Webarc:Search and Access Strategies - Revision history

Scsong: Webarc:Search and Access Stratergies moved to Webarc:Search and Access Strategies

2009-05-12T19:38:17Z

Webarc:Search and Access Stratergies moved to Webarc:Search and Access Strategies

← Older revision	Revision as of 19:38, 12 May 2009
(No difference)

Scsong: Webarc:Temporal Text-Search Index moved to Webarc:Search and Access Stratergies

2009-05-12T19:37:21Z

Webarc:Temporal Text-Search Index moved to Webarc:Search and Access Stratergies

← Older revision	Revision as of 19:37, 12 May 2009
(No difference)

Scsong at 19:36, 12 May 2009

2009-05-12T19:36:21Z

← Older revision		Revision as of 19:36, 12 May 2009
Line 44:		Line 44:
	== Scoring within a Temporal Context ==		== Scoring within a Temporal Context ==

	[[Image:temporal_scoring.gif\|~~480px~~]]		[[Image:temporal_scoring.gif\|320px]]

	== Search User Interface ==		== Search User Interface ==
	[[Image:search_maryland_5_7.jpg\|320px]][[Image:search_airpollution.jpg\|320px]]		[[Image:search_maryland_5_7.jpg\|320px]] [[Image:search_airpollution.jpg\|320px]]

	== Grouping Search Results ==		== Grouping Search Results ==

Scsong at 19:33, 12 May 2009

2009-05-12T19:33:08Z

← Older revision		Revision as of 19:33, 12 May 2009
Line 12:		Line 12:
	== Existing Access Methods ==		== Existing Access Methods ==

	[[Image:existing_methods.~~jpg~~\|480px]]		[[Image:existing_methods.gif\|480px]]

	== Problems With Existing Methods ==		== Problems With Existing Methods ==
	* Inefficient handling of time-constrained search.		* Inefficient handling of time-constrained search.

	[[Image:inefficient_temporal_handling.~~jpg~~\|480px]]		[[Image:inefficient_temporal_handling.gif\|480px]]

	* Ineffective delivery of search results		* Ineffective delivery of search results
Line 40:		Line 40:
	* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.		* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.

	[[Image:temporal_index.~~jpg~~\|480px]]		[[Image:temporal_index.gif\|480px]]

	== Scoring within a Temporal Context ==		== Scoring within a Temporal Context ==

	[[Image:temporal_scoring.~~jpg~~\|480px]]		[[Image:temporal_scoring.gif\|480px]]

	== Search User Interface ==		== Search User Interface ==
Line 50:		Line 50:

	== Grouping Search Results ==		== Grouping Search Results ==
	[[Image:grouping_search_results.~~jpg~~\|480px]]		[[Image:grouping_search_results.gif\|480px]]

	== Group-wide Scoring ==		== Group-wide Scoring ==

Scsong at 19:28, 12 May 2009

2009-05-12T19:28:34Z

← Older revision		Revision as of 19:28, 12 May 2009
Line 11:		Line 11:

	== Existing Access Methods ==		== Existing Access Methods ==
	[[Image:existing_methods.~~png~~\|~~640px~~]]
			[[Image:existing_methods.jpg\|480px]]

	== Problems With Existing Methods ==		== Problems With Existing Methods ==
	* Inefficient handling of time-constrained search.		* Inefficient handling of time-constrained search.
	[[Image:inefficient_temporal_handling.~~png~~\|~~640px~~]]
			[[Image:inefficient_temporal_handling.jpg\|480px]]

	* Ineffective delivery of search results		* Ineffective delivery of search results
	** Inadequate relevancy scoring.		** Inadequate relevancy scoring.
Line 36:		Line 39:
	SCk = { All web objects valid within a time interval [tk~tk+1) }		SCk = { All web objects valid within a time interval [tk~tk+1) }
	* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.		* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.
	[[Image:temporal_index.~~png~~\|~~640px~~]]
			[[Image:temporal_index.jpg\|480px]]

	== Scoring within a Temporal Context ==		== Scoring within a Temporal Context ==
	[[Image:temporal_scoring.~~png~~\|~~640px~~]]
			[[Image:temporal_scoring.jpg\|480px]]

	== Search User Interface ==		== Search User Interface ==
Line 45:		Line 50:

	== Grouping Search Results ==		== Grouping Search Results ==
	[[Image:grouping_search_results.~~png~~\| ~~640px~~]]		[[Image:grouping_search_results.jpg\|480px]]

	== Group-wide Scoring ==		== Group-wide Scoring ==

Scsong at 19:24, 12 May 2009

2009-05-12T19:24:15Z

← Older revision		Revision as of 19:24, 12 May 2009
Line 11:		Line 11:

	== Existing Access Methods ==		== Existing Access Methods ==
	* Chronological Listing		[[Image:existing_methods.png\|640px]]
	[[Image:~~chronological_listing~~.~~jpg~~\|~~200px]]~~
	* Directory
	~~[[Image:directory.jpg\|200px]]~~
	* Text-Search
	~~[[Image:text-search.jpg\|200px]]~~
	* Hybrid
	~~[[Image:hybrid.jpg\|200px~~]]

	== Problems With Existing Methods ==		== Problems With Existing Methods ==

Scsong at 19:22, 12 May 2009

2009-05-12T19:22:44Z

← Older revision		Revision as of 19:22, 12 May 2009
Line 12:		Line 12:
	== Existing Access Methods ==		== Existing Access Methods ==
	* Chronological Listing		* Chronological Listing
	[[Image:chronological_listing.jpg\|~~320px~~]]		[[Image:chronological_listing.jpg\|200px]]
	* Directory		* Directory
	[[Image:directory.jpg\|~~320px~~]]		[[Image:directory.jpg\|200px]]
	* Text-Search		* Text-Search
	[[Image:text-search.jpg\|~~320px~~]]		[[Image:text-search.jpg\|200px]]
	* Hybrid		* Hybrid
	[[Image:hybrid.jpg\|~~320px~~]]		[[Image:hybrid.jpg\|200px]]

	== Problems With Existing Methods ==		== Problems With Existing Methods ==
	* Inefficient handling of time-constrained search.		* Inefficient handling of time-constrained search.
	[[Image:inefficient_temporal_handling.png\|~~320px~~]]		[[Image:inefficient_temporal_handling.png\|640px]]
	* Ineffective delivery of search results		* Ineffective delivery of search results
	** Inadequate relevancy scoring.		** Inadequate relevancy scoring.
	*** Scoring is performed over the entire history.		*** Scoring is performed over the entire history.
	** ~~Lack of~~ search ~~result grouping~~.		** Ungrouped search results.
	*** URL is not unique in web archives – time dependent.		*** URL is not unique in web archives – time dependent.
	*** Considering different versions of the same URL tend to have similar contents, It is highly likely to have the first result page “polluted’ by multiple versions of the same URL.		*** Considering different versions of the same URL tend to have similar contents, It is highly likely to have the first result page “polluted’ by multiple versions of the same URL.
	*** Users can want to focus more on a specific time-period within the results.		*** Users can want to focus more on a specific time-period within the results.
	Lack of a group-scoring methodology.		** Lack of a group-scoring methodology.
	*** What group to show on the top is not clear without a group-scoring methodology.		*** What group to show on the top is not clear without a group-scoring methodology.

Line 40:		Line 40:

	== Basic Techniques ==		== Basic Techniques ==
	Determine a snapshot of web contents covering a time ~~window�SCk~~ = { All web objects valid within a time interval [tk~tk+1) }		* Determine a snapshot of web contents covering a time window
	Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.		SCk = { All web objects valid within a time interval [tk~tk+1) }
			* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.
			[[Image:temporal_index.png\|640px]]

	== Scoring within a Temporal Context ==		== Scoring within a Temporal Context ==
	* Determine a snapshot of web contents covering a time window		[[Image:temporal_scoring.png\|640px]]
	~~�SCk = { All web objects valid within a time interval [tk~tk+1) }~~
	* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.
	[[Image:~~temporal_index~~.png\|~~320px~~]]

	== Search User Interface ==		== Search User Interface ==
Line 53:		Line 52:

	== Grouping Search Results ==		== Grouping Search Results ==
	[[Image:grouping_search_results.png\|~~320px~~]]		[[Image:grouping_search_results.png\| 640px]]

	== Group-wide Scoring ==		== Group-wide Scoring ==

Scsong at 19:17, 12 May 2009

2009-05-12T19:17:01Z

← Older revision		Revision as of 19:17, 12 May 2009
Line 12:		Line 12:
	== Existing Access Methods ==		== Existing Access Methods ==
	* Chronological Listing		* Chronological Listing
	[[Image:~~dup_nw_pages~~.~~png\|320px]][[Image:dup_gw_pages.png~~\|320px]]		[[Image:chronological_listing.jpg\|320px]]
	* Directory		* Directory
	[[Image:~~dup_nw_pages~~.~~png\|320px]][[Image:dup_gw_pages.png~~\|320px]]		[[Image:directory.jpg\|320px]]
	* Text-Search		* Text-Search
	[[Image:~~dup_nw_pages~~.~~png\|320px]][[Image:dup_gw_pages.png~~\|320px]]		[[Image:text-search.jpg\|320px]]
	* Hybrid		* Hybrid
	[[Image:~~dup_nw_pages~~.~~png\|320px]][[Image:dup_gw_pages.png~~\|320px]]		[[Image:hybrid.jpg\|320px]]

	== Problems With Existing Methods ==		== Problems With Existing Methods ==
	* Inefficient handling of time-constrained search.		* Inefficient handling of time-constrained search.
	[[Image:~~dup_nw_pages.png\|320px]][[Image:dup_gw_pages~~.png\|320px]]		[[Image:inefficient_temporal_handling.png\|320px]]
	* Ineffective delivery of search results		* Ineffective delivery of search results
	Inadequate relevancy scoring.		** Inadequate relevancy scoring.
	Scoring is performed over the entire history.		*** Scoring is performed over the entire history.
	~~Ungrouped~~ search ~~results~~.		** Lack of search result grouping.
	URL is not unique in web archives – time dependent.		*** URL is not unique in web archives – time dependent.
	Considering different versions of the same URL tend to have similar contents, It is highly likely to have the first result page “polluted’ by multiple versions of the same URL.		*** Considering different versions of the same URL tend to have similar contents, It is highly likely to have the first result page “polluted’ by multiple versions of the same URL.
	Users can want to focus more on a specific time-period within the results.		*** Users can want to focus more on a specific time-period within the results.
	Lack of a group-scoring methodology.		Lack of a group-scoring methodology.
	What group to show on the top is not clear without a group-scoring methodology.		*** What group to show on the top is not clear without a group-scoring methodology.

	== Overview of Our Approach ==		== Overview of Our Approach ==
Line 40:		Line 40:

	== Basic Techniques ==		== Basic Techniques ==
			Determine a snapshot of web contents covering a time window�SCk = { All web objects valid within a time interval [tk~tk+1) }
			Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.

	== Scoring within a Temporal Context ==		== Scoring within a Temporal Context ==
			* Determine a snapshot of web contents covering a time window
			�SCk = { All web objects valid within a time interval [tk~tk+1) }
			* Given SCs, we maintain a set of inverted lists for each SC, and build a time hierarchy or a combined multi-version tree.
			[[Image:temporal_index.png\|320px]]

	== Search User Interface ==		== Search User Interface ==
			[[Image:search_maryland_5_7.jpg\|320px]][[Image:search_airpollution.jpg\|320px]]

	== Grouping Search Results ==		== Grouping Search Results ==
			[[Image:grouping_search_results.png\|320px]]

	== Group-wide Scoring ==		== Group-wide Scoring ==
			Grouping is good, but now which group to place first on the result page?

			* Simple method : use average or highest score among members
			* More effective method: compute a relevancy score as a group.
			** Instead of tf(t), we use df(t), document frequency of t in group.
			** Instead of idf(t), we use igf(t), inverse group frequency .

			We extend some of the best known IR technologies for group ranking.


	== Publication ==		== Publication ==
	Song, S. and JaJa, J., Archiving ~~Temporal Web Information~~: ~~Organization of Web Contents for Fast Access and Compact Storage:UMIACS-TR-2008-08. 2008, University of Maryland Institute for Advanced Computer Studies~~. [[media:~~temporal-web-archiving-final-umiacs-tr-2008-08~~.pdf\|pdf]]		Song, S. and JaJa, J. Search and Access Strategies for Web Archives. in Archiving 2009. 2009: IS&T. [[media:Archiving2009_submitted.pdf\|pdf]]

Scsong at 19:04, 12 May 2009

2009-05-12T19:04:13Z

← Older revision		Revision as of 19:04, 12 May 2009
Line 1:		Line 1:
	~~TBD~~		== Background ==
			* The Web has become the main publication medium world-wide, covering almost every facet of human activity. However, the Web is an ephemeral medium.
			* Web archives offer unique opportunities for knowledge discovery due to the richness of their contents extending over significant periods of time.
			* We need effective and scalable access strategies for web archives covering significant temporal spans.

			== Goals ==
			* An effective technology to explore and search for information in a web archive. The technology must enable effective information exploration and discovery.
			* A framework that produces ranking and evaluation of archived web contents within a temporal context as required by the user.
			* Methods to determine the relevance of a group of web objects within the temporal context. A group can consist of a series of temporally-contiguous versions of a single URL, or of web objects archived within some time span.
			* A framework that allows effective search using keywords and time spans for large scale web archives.

			== Existing Access Methods ==
			* Chronological Listing
			[[Image:dup_nw_pages.png\|320px]][[Image:dup_gw_pages.png\|320px]]
			* Directory
			[[Image:dup_nw_pages.png\|320px]][[Image:dup_gw_pages.png\|320px]]
			* Text-Search
			[[Image:dup_nw_pages.png\|320px]][[Image:dup_gw_pages.png\|320px]]
			* Hybrid
			[[Image:dup_nw_pages.png\|320px]][[Image:dup_gw_pages.png\|320px]]

			== Problems With Existing Methods ==
			* Inefficient handling of time-constrained search.
			[[Image:dup_nw_pages.png\|320px]][[Image:dup_gw_pages.png\|320px]]
			* Ineffective delivery of search results
			Inadequate relevancy scoring.
			Scoring is performed over the entire history.
			Ungrouped search results.
			URL is not unique in web archives – time dependent.
			Considering different versions of the same URL tend to have similar contents, It is highly likely to have the first result page “polluted’ by multiple versions of the same URL.
			Users can want to focus more on a specific time-period within the results.
			Lack of a group-scoring methodology.
			What group to show on the top is not clear without a group-scoring methodology.

			== Overview of Our Approach ==
			* Efficient time-constrained search by maintaining separate inverted lists for a given time window. Click here for details.
			* Scoring within a temporal context by computing term weights as a function of time. Click here for details.
			* Grouping similar search results, while scoring search results as a group. Click here and here for details.


			== Basic Techniques ==

			== Scoring within a Temporal Context ==

			== Search User Interface ==

			== Grouping Search Results ==

			== Group-wide Scoring ==


			== Publication ==
			Song, S. and JaJa, J., Archiving Temporal Web Information: Organization of Web Contents for Fast Access and Compact Storage:UMIACS-TR-2008-08. 2008, University of Maryland Institute for Advanced Computer Studies. [[media:temporal-web-archiving-final-umiacs-tr-2008-08.pdf\|pdf]]

Scsong at 22:14, 24 September 2008

2008-09-24T22:14:54Z

New page

TBD