Send article as PDF   

I agree with the post that validity and reliability are the most critical considerations in selecting an existing data collection device. The importance arises from the fact that the tool should express consistency in exploring the study variables when properly administered (Streiner, Norman, & Cairney, 2014). The importance of this consideration in building the confidence on results calls for comprehensive evaluation of existing tool, where the first element should be content analysis. The assessment focuses on the degree to which the data collection device has adequately covered the areas being investigated. Similarly, the instrument must express professional appearance as a well-designed tool increases the response rates and chances of cooperation from the respondents. The tool being adopted or adapted must have been appraised against an external gold standard, a stage that satisfies the acceptability of the device as well as the degree of truism in exploring the research problem or testing the hypothesis. Besides the structural elements, the selection of an existing tool should consider reproducibility, where the focus is examining the consistency in its performance (Streiner, Norman, & Cairney, 2014). The appraisal stage considers test-retest reliability, inter-observer reproducibility, as well as consistency in collecting responses from participants.


I also support the post’s view that systematic review provides one of the most practical approaches of searching instruments that measure a particular concept. Besides being a robust way of literature-wide examination, systematic reviews are a gold standard in synthesizing evidence on the applicability of the devices (Nair, De La Vara, Sabetzadeh, & Briand, 2014). The use of secondary data does not only provide the research with a sufficient stock to mines but also a platform for critically evaluating the soundness. Selecting a tool thus become a preliminary aspect of the research process, allowing the scholar not only to meet the obligation of filling gaps in the study but also building on the legacy to ensure sensibility in future utilization of the devices.

Scroll to Top