Evaluating the concept specialization distance from an end-user perspective: The case of AGROVOC

David Martín-Moncunill, Miguel Angel Sicilia-Urban, Elena García-Barriocanal, Christian M. Stracke

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Purpose – The common understanding of generalization/specialization relations assumes the relation to be equally strong between a classifier and any of its related classifiers and also at every level of the hierarchy. Assigning a grade of relative distance to represent the level of similarity between the related pairs of classifiers could correct this situation, which has been considered as an oversimplification of the psychological account of the real-world relations. The paper aims to discuss these issues. Design/methodology/approach – The evaluation followed an end-user perspective. In order to obtain a consistent data set of specialization distances, a group of 21 persons was asked to assign values to a set of relations from a selection of terms from the AGROVOC thesaurus. Then two sets of representations of the relations between the terms were built, one according to the calculated concept of specialization weights and the other one following the original order of the thesaurus. In total, 40 persons were asked to choose between the two sets following an A/B test-like experiment. Finally, short interviews were carried out after the test to inquiry about their decisions. Findings – The results show that the use of this information could be a valuable tool for search and information retrieval purposes and for the visual representation of knowledge organization systems (KOS). Furthermore, the methodology followed in the study turned out to be useful for detecting inconsistencies in the thesaurus and could thus be used for quality control and optimization of the hierarchical relations. Originality/value – The use of this relative distance information, namely, “concept specialization distance,” has been proposed mainly at a theoretical level. In the current experiment, the authors evaluate the potential use of this information from an end-user perspective, not only for text-based interfaces but also its application for the visual representation of KOS. Finally, the methodology followed for the elaboration of the concept specialization distance data set showed potential for detecting possible inconsistencies in KOS.
Original languageEnglish
Pages (from-to)860-876
Number of pages17
JournalOnline Information Review
Volume41
Issue number6
DOIs
Publication statusPublished - 9 Oct 2017

Fingerprint

Thesauri
specialization
Classifiers
thesaurus
organization
Information retrieval
methodology
Quality control
Experiments
human being
experiment
quality control
information retrieval
Values
interview
evaluation
knowledge
Group

Keywords

  • Concept
  • Specialization Distance
  • End-User
  • AGROVOC
  • Online Learning
  • Repositories
  • Agriculture
  • Vocabulary

Cite this

Martín-Moncunill, David ; Sicilia-Urban, Miguel Angel ; García-Barriocanal, Elena ; Stracke, Christian M. / Evaluating the concept specialization distance from an end-user perspective : The case of AGROVOC. In: Online Information Review. 2017 ; Vol. 41, No. 6. pp. 860-876.
@article{b9f97ef93ece4784b3db4198c9d971f7,
title = "Evaluating the concept specialization distance from an end-user perspective: The case of AGROVOC",
abstract = "Purpose – The common understanding of generalization/specialization relations assumes the relation to be equally strong between a classifier and any of its related classifiers and also at every level of the hierarchy. Assigning a grade of relative distance to represent the level of similarity between the related pairs of classifiers could correct this situation, which has been considered as an oversimplification of the psychological account of the real-world relations. The paper aims to discuss these issues. Design/methodology/approach – The evaluation followed an end-user perspective. In order to obtain a consistent data set of specialization distances, a group of 21 persons was asked to assign values to a set of relations from a selection of terms from the AGROVOC thesaurus. Then two sets of representations of the relations between the terms were built, one according to the calculated concept of specialization weights and the other one following the original order of the thesaurus. In total, 40 persons were asked to choose between the two sets following an A/B test-like experiment. Finally, short interviews were carried out after the test to inquiry about their decisions. Findings – The results show that the use of this information could be a valuable tool for search and information retrieval purposes and for the visual representation of knowledge organization systems (KOS). Furthermore, the methodology followed in the study turned out to be useful for detecting inconsistencies in the thesaurus and could thus be used for quality control and optimization of the hierarchical relations. Originality/value – The use of this relative distance information, namely, “concept specialization distance,” has been proposed mainly at a theoretical level. In the current experiment, the authors evaluate the potential use of this information from an end-user perspective, not only for text-based interfaces but also its application for the visual representation of KOS. Finally, the methodology followed for the elaboration of the concept specialization distance data set showed potential for detecting possible inconsistencies in KOS.",
keywords = "Concept, Specialization Distance, End-User, AGROVOC, Online Learning, Repositories, Agriculture, Vocabulary",
author = "David Mart{\'i}n-Moncunill and Sicilia-Urban, {Miguel Angel} and Elena Garc{\'i}a-Barriocanal and Stracke, {Christian M.}",
note = "DS_Citation:Mart{\'i}n-Moncunill, D., Sicilia-Urban, M. A., Garc{\'i}a-Barriocanal, E., & Stracke, C. M. (2017). Evaluating the concept specialization distance from an end-user perspective: The case of AGROVOC. Online Information Review, 41(6), 860-876. https://doi.org/10.1108/OIR-03-2016-0094",
year = "2017",
month = "10",
day = "9",
doi = "10.1108/OIR-03-2016-0094",
language = "English",
volume = "41",
pages = "860--876",
journal = "Online Information Review",
issn = "1468-4527",
publisher = "Emerald Group Publishing Ltd.",
number = "6",

}

Evaluating the concept specialization distance from an end-user perspective : The case of AGROVOC. / Martín-Moncunill, David; Sicilia-Urban, Miguel Angel; García-Barriocanal, Elena; Stracke, Christian M.

In: Online Information Review, Vol. 41, No. 6, 09.10.2017, p. 860-876.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Evaluating the concept specialization distance from an end-user perspective

T2 - The case of AGROVOC

AU - Martín-Moncunill, David

AU - Sicilia-Urban, Miguel Angel

AU - García-Barriocanal, Elena

AU - Stracke, Christian M.

N1 - DS_Citation:Martín-Moncunill, D., Sicilia-Urban, M. A., García-Barriocanal, E., & Stracke, C. M. (2017). Evaluating the concept specialization distance from an end-user perspective: The case of AGROVOC. Online Information Review, 41(6), 860-876. https://doi.org/10.1108/OIR-03-2016-0094

PY - 2017/10/9

Y1 - 2017/10/9

N2 - Purpose – The common understanding of generalization/specialization relations assumes the relation to be equally strong between a classifier and any of its related classifiers and also at every level of the hierarchy. Assigning a grade of relative distance to represent the level of similarity between the related pairs of classifiers could correct this situation, which has been considered as an oversimplification of the psychological account of the real-world relations. The paper aims to discuss these issues. Design/methodology/approach – The evaluation followed an end-user perspective. In order to obtain a consistent data set of specialization distances, a group of 21 persons was asked to assign values to a set of relations from a selection of terms from the AGROVOC thesaurus. Then two sets of representations of the relations between the terms were built, one according to the calculated concept of specialization weights and the other one following the original order of the thesaurus. In total, 40 persons were asked to choose between the two sets following an A/B test-like experiment. Finally, short interviews were carried out after the test to inquiry about their decisions. Findings – The results show that the use of this information could be a valuable tool for search and information retrieval purposes and for the visual representation of knowledge organization systems (KOS). Furthermore, the methodology followed in the study turned out to be useful for detecting inconsistencies in the thesaurus and could thus be used for quality control and optimization of the hierarchical relations. Originality/value – The use of this relative distance information, namely, “concept specialization distance,” has been proposed mainly at a theoretical level. In the current experiment, the authors evaluate the potential use of this information from an end-user perspective, not only for text-based interfaces but also its application for the visual representation of KOS. Finally, the methodology followed for the elaboration of the concept specialization distance data set showed potential for detecting possible inconsistencies in KOS.

AB - Purpose – The common understanding of generalization/specialization relations assumes the relation to be equally strong between a classifier and any of its related classifiers and also at every level of the hierarchy. Assigning a grade of relative distance to represent the level of similarity between the related pairs of classifiers could correct this situation, which has been considered as an oversimplification of the psychological account of the real-world relations. The paper aims to discuss these issues. Design/methodology/approach – The evaluation followed an end-user perspective. In order to obtain a consistent data set of specialization distances, a group of 21 persons was asked to assign values to a set of relations from a selection of terms from the AGROVOC thesaurus. Then two sets of representations of the relations between the terms were built, one according to the calculated concept of specialization weights and the other one following the original order of the thesaurus. In total, 40 persons were asked to choose between the two sets following an A/B test-like experiment. Finally, short interviews were carried out after the test to inquiry about their decisions. Findings – The results show that the use of this information could be a valuable tool for search and information retrieval purposes and for the visual representation of knowledge organization systems (KOS). Furthermore, the methodology followed in the study turned out to be useful for detecting inconsistencies in the thesaurus and could thus be used for quality control and optimization of the hierarchical relations. Originality/value – The use of this relative distance information, namely, “concept specialization distance,” has been proposed mainly at a theoretical level. In the current experiment, the authors evaluate the potential use of this information from an end-user perspective, not only for text-based interfaces but also its application for the visual representation of KOS. Finally, the methodology followed for the elaboration of the concept specialization distance data set showed potential for detecting possible inconsistencies in KOS.

KW - Concept

KW - Specialization Distance

KW - End-User

KW - AGROVOC

KW - Online Learning

KW - Repositories

KW - Agriculture

KW - Vocabulary

U2 - 10.1108/OIR-03-2016-0094

DO - 10.1108/OIR-03-2016-0094

M3 - Article

VL - 41

SP - 860

EP - 876

JO - Online Information Review

JF - Online Information Review

SN - 1468-4527

IS - 6

ER -