Corresponding author: Cameron Neylon (
Academic editor:
Given that there is a close link between research data and research publications, and that data constitutes a primary form of research output, it is appropriate that research funders’ open access policies address the issue of open research data (
Transitioning to an open research data policy raises a number of issues (
Most existing funder data sharing requirements have been developed by western funders of natural sciences and biomedical research. The most recent surveys (see references in Hodson and Molloy) of funder policies in this area are somewhat out of date as the policy environment is in flux.
An account of general drivers and principles
A discussion of the requirements for effective data sharing
A statement of necessary limits to openness
A definition of research data
An overview of data within the scope of the policy
An indication of the general criteria for the selection of research data
A summary of responsibilities
An indication of the availability of infrastructure and responsibility of costs
An overview of data management planning requirements
Recommendations on enabling discovery and re-use
Stipulations to encourage recognition and reward for data providers
A summary of reporting requirements, compliance monitoring and possible sanctions
This checklist provides a useful frame within which to both consider and critique the proposed IDRC policy as well as testing the capacity of individual projects to share data and the limitations they face. In particular a focus on points 3, 4, 5, and 7 will be helpful.
Very little work has been done examining open data policies in the context of development research specifically. Using Hodson and Molloy as a framing device derived largely from considerations of those funders in Europe and North America will allow us to test and extend this to include aspects specific to development research. This project will serve to inform open access to research data policies of development research funders through pilot testing open data management plan guidelines with a set of IDRC grantees.
The general objective of this project is to develop a model open research data policy and implementation guidelines for development research funders to enable greater access to development data.
The specific objectives are to:
Test and refine implementation guidelines for development research funders’ open research data policies;
Examine the specific ethical and implementation issues in data sharing in the context of development research including issues of knowledge developed in development and indigenous contexts;
Initiate the development of a community of practice around open data management planning amongst IDRC grantees;
Build the capacity of grantees on open data management; and Communicate the lessons learned on effective open research data management practices within IDRC and beyond
The overarching research question is: What are the essential components of an effective open access to research data policy for development research funders?
We will attempt to answer this question by generating, testing and refining a set of open data implementation guidelines through a series of pilot studies. We will use the framework of Hodson and Molloy to guide our analysis. We will also test the completeness of framework with respect to the specific issues of development research funders.
The project includes three components
A state-of-the art review on open access data management plans.
Eight open data pilot studies with volunteer IDRC grantees
Report and recommendations for IDRC and development funders on data sharing policies and guidelines to support project data sharing.
This will include an updated review of extant policies, scoping out the existing online resources that support data storage, interviews with research funders with open access to research data policies and with researchers who have implemented open access data management plans. The framework of Hodson and Molloy will be used to interrogate the policies. A particular focus will be the practical experience of funders on how policy decisions have an impact on the volume and quality of data sharing in practice.
Eight (8) open data pilot studies will be conducted with volunteer IDRC grantees with new and ongoing projects. This principally involves support (both financial and technical) for the development and implementation of an open data management plan. These eight cases will include a cross-section of IDRC supported research, as well as levels of capacity with respect to the management of open data.
The case studies will focus: on the following research questions:
What types of support, both financial and technical, are required by IDRC partners to implement an open access data management plan effectively?
What challenges do IDRC partners face with regard to carrying out data audits?
What challenges do IDRC partners face with regard to the storage and maintenance of research data?
A maximum of eight projects will be included in the pilot. The projects should span the program areas supported by IDRC. The selection of projects will include:
Early stage projects, where data management plan is still being developed
Mid-stage projects, ones already have some kind of data management plan or have plans to provide open data, where some data has already been gathered but can use the collected data to test the guidelines
At least one (1) project will be conducting research engaging with indigenous or locally developed knowledge
The projects will be of various sizes
The projects will represent a diversity of research methodologies
The projects will be geographically distributed
Each participating project will be engaged in a process of auditing the data that they have, or expect to, produce as a precursor to developing a Data Management Plan. Where possible existing tools, such as the Digital Curation Centre DMP Online tool, will be used to develop DMPs. We will test the applicability and usability of these tools in a development research context. DMPs will include assessment of the following issues:
What types of data will the project generate/collect?
What standards will be used and why?
How will this data be exploited and/or shared/made accessible for verification and reuse?
If data cannot be made available, explain why.
How will this data be curated and preserved?
Identification of suitable research data repositories
How to enable third parties to access, mine, exploit, reproduce and disseminate data, including consideration of licensing issues
Providing information on the tools (or provide the tools) and instruments needed to validate the results
The pilot will also include online training via video conference to build the capacity of grantees and IDRC staff around open data management. Project staff resources will be provided to participating grantees to support data sharing activities and training will be provided. Expert monitoring throughout the project will support these activities.
Through the development of the Data Management and Sharing Plan, the data audit and provision of online training the project team will agree to goals with each participating pilot project. After four months each project will be interviewed to determine progress against those agreed goals. Goals will then be refined for the second half of the project. These reports and interviews will be used to support a case study report for each project.
After eight months the reporting process will be repeated in preparation for the final wrap up meeting (below). A report template and structured interviews will be used to identify issues and challenges throughout the project. The availability and discoverability of data products from the project alongside the agreed goals will be used as the prompts for reporting and interviews.
As discussed above we will use the framework of Hodson and Molloy to organise and interrogate the challenges that projects face in sharing data. In particular there will be a focus on specific challenges associated with the limits to openness, scope of data to be included, and technical capacities that arise in a development research context.
Case studies and feedback from the eight pilot project participants will be used to inform IDRC of specific issues that arise from data sharing in the context of these projects. The project will provide advice on refining the open research data policy guidelines in collaboration with the IDRC grantees. It will propose guidelines on Data Management and Storage based on the experience in the development research context.
The project will also collaborate with the grantees to determine if there is an interest and willingness within the group to share their knowledge and experience in a community of practice. If there is, it will determine if support is required by the group to establish goals, roles and responsibilities, and to identify a mode of communication.
The project will be supported by an expert advisory group (EAG) that will meet twice during the project and provide advice for specific pilot project participants. The EAG will meet at the beginning of the project to identify initial issues on implementation and policy with the IDRC policy. This meeting will then include project participants and discussion of challenges and issues that may arise, as well as approaches to overcoming them. The EAG will also participate in an assessment meeting at the end of the project both to critique the progress made by the pilot projects and to test the recommendations arising from the project.
Goals of the initial meeting:
Review the IDRC ORD policy and critique the implementation guidelines
Orient the volunteer grantees to participate in the pilot case studies
Develop guidelines for the pilot projects
Refine the monitoring and evaluation framework
At the final wrap up meeting the research lead of each participating project will be expected to participate at a roundup workshop at the conclusion of the pilot to share experience and lessons learned. The reporting (above) will be used as the basis for discussion with reflection based on draft case studies for response from the participants and experts.
See Table
While there have been a range of data policy implementation projects across a range of research funders this IDRC project treads new ground in investigating research data sharing in the specific context of development research. This raises both issues of data ownership and ethics that are specific to development research as well as raising more prominently issues that are common to research data sharing generally.
Two core audiences are therefore research funders engaged in development issues, particularly those with a strong position on data sharing more generally (Wellcome Trust, Gates Foundation, and DFID) and research funders concerned more broadly with developing strong practice in collaboration and data sharing (with a focus on Canadian funders of the Tri-Council Group). Our focus will be on directly engaging the first group (through involvement in the workshop and wrap up meeting) and engaging the broader research funder community more generally through published reports, best practice documents, at meetings such as the Research Data Alliance, FORCE2016 etc. and potentially through a new community of practice around open data management and sharing planning.
September 2015 - Submit the RSP PAD and budget
September 2015 - send an internal call to IDRC Program Officers to identify grantees to participate in the pilot case studies
September 28, 2015 - complete a draft of the monitoring and evaluation framework and metrics for success
October 31, 2015 - finalize the eight (8) volunteer grantees to participate in the pilot case studies
December 11, 2015 - complete the literature review and survey of funders/data infrastructure providers.
January 11-13, 2016 - Convene a three day workshop at IDRC - The Expert Advisory Group to meet on the first day and the eight (8) volunteer grantees and IDRC Program Officers to join the meeting for the last two days
The pilot case studies will commence in January 2016 and finish in September 2016 for a duration of eight months
Reporting: Project will be interviewed for a preliminary report after 4 months and at 8 months for the final report.
Wrap up meeting: The research lead of each participating project will be expected to participate at a roundup workshop at the conclusion of the pilot to share experience and lessons learned. The reporting (above) will be used as the basis for discussion with reflection based on draft case studies for response from the participants and experts. This will take place in October 2016.
Reporting: Final outputs to be delivered by November 2016 (see below)
Costs relating to the implementation of the pilot, including labour and infrastructure, will be covered by IDRC.
Specific technical and professional support services will also be provided
Each project will also be assigned a mentor from the Expert Advisory Group.
Other incentive or recognition for providing open data will be considered as a key part of the pilot project.
8 case studies
One journal article that synthesises lessons learned from 8 case studies
Summary report and recommendations to IDRC on identifying best practice and refining data sharing policy
An index of available data products from the participating projects with critical analysis of their usability, discoverability and evidence of use and wider interest
Eight (8) grantees to have an active and effective data sharing program in place. All eight to have released some data or have immediate plans to do so over the course of the pilot.
Improved knowledge and capacity to support the implement of the Centre’s ORD policy within IDRC
Improvements to guidelines and best practice on Data Management and Storage for development research funders and their grantees
The ‘seeds’ of a community of practise around open data management and sharing planning
Attend the 3 day workshop in November, 2015
Review the preliminary and final reports
Assist in evaluating the performance of the participating projects and the pilot project as a whole through attendance at the Wrap up Meeting
Attend the 3 day workshop in November, 2015
Critique and refine the draft policy implementation guidelines
Critique and refine the monitoring and evaluation plans for the pilot
Provide expert advice and perspective to the pilot projects
Review the preliminary and final reports
Assist in evaluating the performance of the participating projects and the pilot project as a whole through attendance at the Wrap up Meeting
Attend the latter 2 days of the 3 day workshop in November, 2015
Working (with support) to audit the data they expect to produce (or have produced)
Producing (with support) a data management and sharing plan
Implement the agreed data management and sharing plan
Engaging with the mentors on monitoring the implementation of the data management and sharing plan
Responding to analysis of the usage and discoverability of data generated by the project
Reflecting on the experience of preparing and implementing the data management and sharing plan
Attending the wrap up meeting to discuss the experiences and guide the further development of open research data policy implementation guidelines for development research funders
Risk Assessment and Recommendations
Risk Category | Risk Description | Risk Likelihood |
Prevention Plan |
Risks to achievements of objectives | An insufficient number of volunteer projects to participate in the pilot case studies are identified. | M | The call to Program Officers will be made through a variety of channels – PA Directors, Lyris lists and Friday coffee and the significance of the RSP will be clearly articulated. |
An insufficient number of volunteer projects are working with knowledge within indigenous contexts. | M | Program Officers responsible for projects working with indigenous knowledge will be identified and targeted. | |
Program Officers do not have sufficient time to participate in the project. | H | The time commitment required from Program Officers will be described in the call and their ability to participate effectively in the project will be confirmed before their participation is finalized. | |
Risks to timing | The pilot case studies are not completed within eight (8) months. | M | The mentors and their grantees will collaborate on work plans with deliverables and completion dates. The work plans will be monitored by the principal investigators and the responsible officer. |
Ethics considerations | Knowledge from indigenous sources cannot be made open due to IP rights concerns. | M | Examine this ethics consideration at the outset and determine how the needs/rights of all parties (grantees and indigenous participants) can be met. |
Grantees capacity risk | Grantees do not have sufficient time to participate in the project. | M | The time commitment required from grantees will be accurately described in the call to Program Officers and confirmed before the volunteer grantees are selected. |
Grantees do not have the knowledge and experience required to manage and share research data. | L | The project workshop and project mentors will provide knowledge and support. |
Explorer les occasions et les défis que présente la mise en oeuvre de stratégies de recherche ouverte au sein des institutions de développement
Data type: Grant Proposal
Brief description: A translation of the proposal into French. IDRC operates in both English and French as a Canadian Crown Corporation.
© Centre de recherches pour le développement international 2015
File: oo_85278.pdf