The website "romip.narod.ru." is not registered with uCoz.
If you are absolutely sure your website must be here,
please contact our Support Team.
If you were searching for something on the Internet and ended up here, try again:

About uCoz web-service

Community

Contacts

Legal information

 Web site Classification Track
RIRES: Russian Information Retrieval Evaluation Seminar
 News 
 About 
 Manifesto 
 Call for participation 
 General principles 
 Participation 
 Tracks 
 Participants 
 Test collections 
 Publications 
 Relevance tables 
 History 
 2004 
 2005 
 Forum 

По-русскиПо-русски
 

Web site Classification Track

Overview

The purpose of this track is to evaluate methods of Web site topic classification.

For this track the standard procedure is used.

Test Collection

The source dataset consists of BY.web collection and DMOZ collection. The latter is used as a training set.

Task Description for Participating Systems

Each participant is granted access to the training set, DMOZ collection, a set of web sites (not single web pages!) from BY.web collection. The task is to assign topics from training set to each web to each web site. Valid number of topics per site is from 0 to 5. Topics should be returned as an ordered list for each web site.

The training set is based on a subset of the Russian-language categories from the DMOZ catalog.

Evaluation Methodology

  • instructions for assessors: evaluate web-site relevance to categories basing on the extended category description
  • relevance scale:
    • yes / probably yes / perhaps yes / no / impossible to evaluate
    • yes / no / impossible to evaluate
  • official metrics:
    • precision
    • recall

Data Formats