We compare four common data collection techniques to elicit preferences: the rating of items, the ranking of items, the partitioning of a given amount of points among items, and a reduced form of the technique for comparing items in pairs. University students were randomly assigned a questionnaire employing one of the four techniques. All questionnaires incorporated the same collection of items. The data collected with the four techniques were converted into analogous preference matrices, and analyzed with the Bradley–Terry model. The techniques were evaluated with respect to the fit to the model, the precision and reliability of the item estimates, and the consistency among the produced item sequences. The rating, ranking and budget partitioning techniques performed similarly, whereas the reduced pair comparisons technique performed a little worse. The item sequence produced by the rating technique was very close to the sequence obtained averaging over the three other techniques.

Comparison of four common data collection techniques to elicit preferences / Anselmi, Pasquale; Fabbris, Luigi; Martini, Maria Cristiana; Robusto, Egidio. - In: QUALITY & QUANTITY. - ISSN 0033-5177. - 52:3(2018), pp. 1227-1239. [10.1007/s11135-017-0514-7]

Comparison of four common data collection techniques to elicit preferences

MARTINI, Maria Cristiana;
2018

Abstract

We compare four common data collection techniques to elicit preferences: the rating of items, the ranking of items, the partitioning of a given amount of points among items, and a reduced form of the technique for comparing items in pairs. University students were randomly assigned a questionnaire employing one of the four techniques. All questionnaires incorporated the same collection of items. The data collected with the four techniques were converted into analogous preference matrices, and analyzed with the Bradley–Terry model. The techniques were evaluated with respect to the fit to the model, the precision and reliability of the item estimates, and the consistency among the produced item sequences. The rating, ranking and budget partitioning techniques performed similarly, whereas the reduced pair comparisons technique performed a little worse. The item sequence produced by the rating technique was very close to the sequence obtained averaging over the three other techniques.
2018
11-mag-2017
52
3
1227
1239
Comparison of four common data collection techniques to elicit preferences / Anselmi, Pasquale; Fabbris, Luigi; Martini, Maria Cristiana; Robusto, Egidio. - In: QUALITY & QUANTITY. - ISSN 0033-5177. - 52:3(2018), pp. 1227-1239. [10.1007/s11135-017-0514-7]
Anselmi, Pasquale; Fabbris, Luigi; Martini, Maria Cristiana; Robusto, Egidio
File in questo prodotto:
File Dimensione Formato  
Anselmi2018_Article_ComparisonOfFourCommonDataColl(1).pdf

Open access

Tipologia: Versione pubblicata dall'editore
Dimensione 442.03 kB
Formato Adobe PDF
442.03 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

Licenza Creative Commons
I metadati presenti in IRIS UNIMORE sono rilasciati con licenza Creative Commons CC0 1.0 Universal, mentre i file delle pubblicazioni sono rilasciati con licenza Attribuzione 4.0 Internazionale (CC BY 4.0), salvo diversa indicazione.
In caso di violazione di copyright, contattare Supporto Iris

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11380/1142595
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact