| Home | << 1 >> |
|
| Record | |||||
|---|---|---|---|---|---|
Author  |
Francesco Brughi; Debora Gil; Llorenç Badiella; Eva Jove Casabella; Oriol Ramos Terrades | ||||
| Title | Exploring the impact of inter-query variability on the performance of retrieval systems | Type | Conference Article | ||
| Year | 2014 | Publication | 11th International Conference on Image Analysis and Recognition | Abbreviated Journal | |
| Volume | 8814 | Issue | Pages | 413–420 | |
| Keywords | |||||
| Abstract | This paper introduces a framework for evaluating the performance of information retrieval systems. Current evaluation metrics provide an average score that does not consider performance variability across the query set. In this manner, conclusions lack of any statistical significance, yielding poor inference to cases outside the query set and possibly unfair comparisons. We propose to apply statistical methods in order to obtain a more informative measure for problems in which different query classes can be identified. In this context, we assess the performance variability on two levels: overall variability across the whole query set and specific query class-related variability. To this end, we estimate confidence bands for precision-recall curves, and we apply ANOVA in order to assess the significance of the performance across different query classes. | ||||
| Address | Algarve; Portugal; October 2014 | ||||
| Corporate Author | Thesis | ||||
| Publisher | Springer International Publishing | Place of Publication | Editor | ||
| Language | Summary Language | Original Title | |||
| Series Editor | Series Title | Abbreviated Series Title | LNCS | ||
| Series Volume | Series Issue | Edition | |||
| ISSN | 0302-9743 | ISBN | 978-3-319-11757-7 | Medium | |
| Area | Expedition | Conference | ICIAR | ||
| Notes | IAM; DAG; 600.060; 600.061; 600.077; 600.075 | Approved | no | ||
| Call Number | Admin @ si @ BGB2014 | Serial | 2559 | ||
| Permanent link to this record | |||||