Work Description

Title: The Perceived Value of Acquiring Data Seals of Approval Study Dataset and Associated Files Open Access Deposited
Attribute Value
  • This study investigates the value of acquiring DSAs from the perspectives of those who have them. To avoid data collector characteristics and bias that could potentially affect what data were collected and how they were analysed, only those without prior experience in the development of the DSA were selected to be a part of the research team that handled data collection and analysis. Specifically, this study included a data collector who is knowledgeable about repository standards but yet did not play an active role in the development of any of them. The data collector also does not serve as a formal third-party auditor, a contrast from existing research on this topic. Approval for conducting this research was received from the Indiana University Human Subjects Office. Our findings are drawn from data collected during interviews conducted between August 2015 and February 2016. All participants were at organizations whose repositories successfully acquired DSAs. We selected these individuals because only digital repository staff members at institutions which successfully acquired DSAs would be able to speak from experience about the actual benefits of having them. The list of 64 acquired seals on the DSA website constituted the sampling frame. The first author recruited participants by emailing representatives from each of the repositories that acquired the DSA and inviting their participation. The first author sent follow-up emails on two separate occasions to try to increase participation. As a result of these efforts, we successfully recruited 15 representatives from these repositories to participate in this study, with a response rate of 23%. The primary purpose of conducting the semi-structured, 30-minute interviews was to understand the value of the audit process and certification from the perspective of actual digital repository staff members. The first author asked respondents to discuss: how they learned about the DSA certification, how they decided to undergo audit, how they prepared for it, what the process was like, any lessons learned, the perceived value of the audit process, and the perceived value of certification since attaining it. No incentives for participation were provided. All interviews took place by telephone or via Skype and were audio recorded. Afterwards, all interviews were transcribed. Transcripts were then coded using NVivo – a qualitative data analysis software tool. Prior to analyzing the transcripts, the first author developed a codebook based primarily on the list of benefits on the DSA website. The first author also remained open to identifying additional themes as a result of analyzing the transcripts. The first author and a hired graduate student coded the transcripts. We calculated inter-rater reliability using Cohen’s Kappa. We achieved a score of 0.87; thus, on average, we agreed on codes 87% of the time. Some participants played an active role in the development of the DSA, either as past or present DSA board members. This was seen as a potential threat to the validity of the data. In particular, DSA board members could subconsciously or consciously over-report the benefits of acquiring DSAs based on their knowledge of and experience with the standard. For this reason, additional data analyses were performed. Specifically, a series of Mann-Whitney U tests were performed to detect whether any statistically significant differences existed between DSA board members and non-DSA board members regarding the frequency with which they reported benefits of acquiring DSAs. All statistical analyses were performed using IBM SPSS Statistics 24.
  • To access the coded interview transcripts and description of codes (i.e., codebook), you need NVivo for Mac Version 11.3.2 (1888). To access the raw dataset that lists the frequency with which each benefit was mentioned by DSA board members and non-DSA board members, you need IBM SPSS Statistics 24. To access the processed/analysed data from the Mann-Whitney U tests, you need IBM SPSS Statistics 24 to access the .spv file and Microsoft Word to access the .doc file.
Contact information
Funding agency
  • Other Funding Agency
Other Funding agency
  • This project was funded by a Research Data Alliance United States Data Share Fellowship from the Alfred P. Sloan Foundation.
Date coverage
  • 2015-08 to 2016-02
Citations to related material
Resource type
Last modified
  • 09/21/2020
To Cite this Work:
Donaldson, D. The Perceived Value of Acquiring Data Seals of Approval Study Dataset and Associated Files [Data set]. Indiana University - DataCORE.


Files (Count: 4; Size: 7.91 MB)

Download All Files (To download individual files, select them in the “Files” panel above)

Best for data sets < 3 GB. Downloads all files plus metadata into a zip file.