- Open Access
Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization
© The Author(s). 2018
- Received: 3 August 2018
- Accepted: 10 August 2018
- Published: 24 September 2018
Qualitative approaches are one of several methodologies utilised within the social sciences. New developments within qualitative methods are widening the opportunities for using qualitative evidence to inform health policy and systems decisions. In this commentary, we discuss how, in our work with the World Health Organization (WHO), we have explored ways of broadening the types of evidence used to develop evidence-informed guidance for health systems.
Health systems decisions are commonly informed by evidence on the effectiveness of health system interventions. However, decision makers and other stakeholders also typically have additional questions, including how different stakeholders value different outcomes, the acceptability and feasibility of different interventions and the impacts of these interventions on equity and human rights. Evidence from qualitative research can help address these questions, and a number of WHO guidelines are now using qualitative evidence in this way. This growing use of qualitative evidence to inform decision making has been facilitated by recent methodological developments, including robust methods for qualitative evidence syntheses and approaches for assessing how much confidence to place in findings from such syntheses. For research evidence to contribute optimally to improving and sustaining the performance of health systems, it needs to be transferred easily between different elements of what has been termed the ‘evidence ecosystem’. This ecosystem includes primary and secondary evidence producers, guidance developers and those implementing and evaluating interventions to strengthen health systems. We argue that most of the elements of an ecosystem for qualitative evidence are now in place – an important milestone that suggests that we are entering a new era for qualitative research. However, a number of challenges and constraints remain. These include how to build stronger links between the communities involved in the different parts of the qualitative evidence ecosystem and the need to strengthen capacity, particularly in low and middle income countries, to produce and utilise qualitative evidence and decision products informed by such evidence. We invite others who want to support the wider use of qualitative evidence in decision processes to look for opportunities in their settings to put this into practice.
- Qualitative research
- Qualitative evidence synthesis
- Social science approach
- Evidence ecosystem
- Health systems
- Systematic review
- Capacity strengthening
- Decision making
- Policy making
The growing use of qualitative evidence to support decisions, and the availability of methods that can help us use this type of evidence in knowledge-to-action cycles [1, 2], suggest that we are entering a new era for qualitative research. Qualitative approaches are one of many methodologies utilised within the social sciences. Here we focus here on how new developments in the field of qualitative research are creating important opportunities for using qualitative evidence, including findings from syntheses of qualitative evidence, to inform health policy and systems decisions.
Health systems are complex, creating challenges for decision makers aiming to strengthen these systems and achieve the Sustainable Development Goals . Most stakeholders agree, however, that decisions about which interventions or policy options to implement should be informed by the best available global and local evidence [4, 5]. Within clinical care there is a long history of using evidence-based guidelines to inform decisions. However, evidence-based health systems guidance is a more recent development. Health systems guidance has been defined as “systematically developed statements produced at global or national levels to assist decisions about appropriate options for addressing a health systems challenge in a range of settings and to assist with the implementation of these options and their monitoring and evaluation” . Health systems guidance can address issues such as options for funding national lay health worker programmes; which digital interventions might effectively support health care delivery; and ways of retaining health care providers in rural areas.
In our work with the World Health Organization (WHO) we have explored ways of broadening the types of evidence that are used to develop health systems guidance [7, 8]. While questions of effectiveness are central to health systems decisions, decision makers also want to know more about how different stakeholders value different outcomes, the acceptability and feasibility of different interventions and the impacts of these interventions on equity and human rights [6, 7, 9]. Evidence from qualitative research can play a key role in addressing these considerations . This is because well-designed qualitative research allows us to explore how people experience and conceptualise the world around them, including health systems and services; and can help us understand how and why these systems succeed or fail. For instance, a recent qualitative study of introducing and implementing humanised childbirth care in a referral hospital in Benin highlighted some of the challenges experienced by midwives and other health care providers in delivering such care, and developed a conceptual model of humanised care in this setting . This primary study was, in turn, incorporated into a qualitative evidence synthesis (or systematic review of qualitative studies) of factors that influence the provision of childbirth care by skilled birth attendants in low and middle income countries . This synthesis subsequently informed a WHO statement on skilled health personnel providing care during childbirth . In addition to the WHO, a range of other organisations involved in producing guidance and health technology assessments are also increasingly using qualitative evidence to answer questions related to, for instance, the acceptability and feasibility of interventions. These organisations include the National Institute of Health and Clinical Excellence (NICE) in the United Kingdom [13, 14], the Swedish Public Health Institute and the South African Fetal Alcohol Spectrum Disorders Task Team .
One example of the use of qualitative evidence to inform WHO guidance is the recent set of WHO recommendations on ‘Antenatal care for a positive pregnancy experience’ . These include recommendations on health systems interventions to improve the quality of antenatal care and women’s use of this care. To ensure that women’s perspectives shaped the development of this guidance, the WHO first commissioned a qualitative evidence synthesis that gathered studies from across the world exploring what women want, need and value in pregnancy . The WHO used this synthesis when determining the broader aims of the guidance and the key outcomes to be considered when gathering evidence and making recommendations. For instance, the concept of a “positive pregnancy experience” became the core focus of the guidance as a means of ensuring that person-centred health and well-being was prioritized. Also, the outcome “positive pregnancy experience” was included for most guidance questions, ensuring that each intervention was evaluated against this key issue for women. Following the scoping stage of the guidance, the WHO commissioned a second qualitative evidence synthesis to explore factors influencing women’s use of antenatal services . These findings fed into the guidance process by answering questions about the acceptability and feasibility of the interventions to women and other stakeholders. A number of other recent WHO guidelines have used similar approaches [19–21].
The growing use of qualitative evidence to inform decision making has been facilitated by a number of key developments in the field, including better standards for reporting primary qualitative studies [22, 23]; robust methods for undertaking qualitative evidence syntheses ; databases for rapidly identifying such syntheses within the health field [25, 26]; the emergence of GRADE-CERQual - an approach for assessing how much confidence to place in findings from qualitative evidence syntheses [27, 28]; and frameworks that facilitate the packaging of different types of evidence to facilitate transparent and systematic assessment by decision makers [29, 30]. The challenge now is to mainstream these efforts so that qualitative evidence, ideally from syntheses of primary qualitative studies, is used more widely to develop health systems guidance and clinical guidelines within WHO and within other guideline development organisations. In our experience, one important constraint includes identifying teams to conduct policy-relevant qualitative evidence syntheses, particularly in low and middle income countries. We also need to explore further how to help members of guideline panels and other decision makers engage with different types of evidence and make judgements about these when formulating recommendations. In addition, we need to expand efforts to strengthen capacity in low and middle income countries to undertake health policy and systems relevant primary qualitative research.
For research evidence to contribute optimally to improving and sustaining the performance of health systems, it needs to be transferred easily between different elements of what has been termed the ‘evidence ecosystem’ [31–33]. This ecosystem includes those producing primary evidence and those synthesising the evidence; people producing evidence-informed decision products such as health systems guidance and clinical practice guidelines; those responsible for implementing evidence-informed options within health systems, including programme managers and decision makers; and those involved in delivering and using health services, including service providers, service users and citizens . Recent developments within the field of qualitative research, including those described above, mean that we now have most of the elements of an ecosystem for qualitative evidence in place. Evidence from primary qualitative studies is now being gathered in evidence syntheses; the findings of these syntheses are being used in decision products such as guidance and policy briefs [34, 35]; and decision products informed by qualitative evidence are being used to guide choices on health system options and, in turn, are informing choices by service providers and users. Finally, these health system strengthening initiatives are being evaluated through new primary qualitative research [36, 37]. In addition, we now have a better understanding of how primary qualitative research should be designed to meet the needs of those synthesising research and decision makers.
Having the elements of a qualitative evidence ecosystem in place is an important milestone and suggests that we are entering a new and exciting era within the field of qualitative research. Of course, a number of challenges and constraints remain, as we have noted earlier. Other challenges include how to build stronger links between the communities involved in the different parts of the qualitative evidence ecosystem, including across all sectors relevant to the Sustainable Development Goals , and the need to strengthen capacity across settings and institutions, particularly in low and middle income countries, to produce and utilise qualitative evidence and decision products informed by such evidence. Our experience of working with the WHO has helped us to collaboratively develop methods for using qualitative evidence in guideline and guidance development. We realise, however, that we are also not yet making full use of the potential of qualitative evidence synthesis findings to shape the development of implementation considerations for guidance or to inform guidance contextualisation, adaptation and implementation processes at national and sub-national levels. This is in part because we need to explore both ways of integrating these findings with local evidence , including the knowledge and experience of local stakeholders, and approaches for working with local stakeholders to develop implementation options. Efforts are also needed to strengthen the capacity of local stakeholders to understand and use qualitative evidence. These are areas in which we and others are now doing methodological research.
As we take this work forward, we should also not forget what is perhaps the most important role that qualitative evidence can play in decision-making: representing the views and experiences of stakeholders, including vulnerable and marginalised groups who are often not represented directly. By drawing on the global body of qualitative evidence, qualitative evidence syntheses have the potential, when used together with direct stakeholder engagement, to help ensure that decisions are guided by stakeholders’ views and that these decisions do not widen inequities. As we have noted elsewhere, using qualitative evidence in this way may also contribute to increased transparency and accountability in public decision-making .
Our experiences of working with the WHO have taught us that the best way of learning is doing. We support Health Systems Global’s efforts to promote both primary and secondary social science research on health policies and systems, and to strengthen capacity and collaborations in this area . However, we need to go further than producing more social science research that is policy relevant and is conducted in ways that address the tensions and complexities involved in commissioning and undertaking research across different settings and groups [39, 40]. As a social science research community, we also need to work more closely with policy users and other stakeholders to build capacity for evidence use. We therefore invite others who believe that we need greater recognition of the value of qualitative research, and who want to support the wider use of qualitative evidence in decision processes, to look for opportunities in their settings to put these beliefs into practice.
We would like to thank Karen Daniels, Ana Lorena Ruano, Kerry Scott and Stephanie Topp for their helpful and insightful comments on earlier versions of this commentary.
No funding was received for writing this commentary. Both authors have received funding from the Alliance for Health Policy and Systems Research, the Brocher Foundation, Cochrane, the Norwegian Agency for Development Cooperation (Norad), the Research Council of Norway and the WHO in relation to the ideas and work described in this commentary. SL receives additional funding from the South African Medical Research Council.
Availability of data and materials
Not applicable as the manuscript does not contain any data.
SL and CG jointly wrote this commentary. Both authors read and approved the final manuscript.
SL works as a health systems researcher and has a background in medicine and in sociology as applied to health. CG works as a health systems researcher and has a background in anthropology and the social sciences as applied to health and health care.
Ethics approval and consent to participate
Not applicable as this is a commentary and not an empirical study.
Consent for publication
Not applicable as the manuscript does not contain data from any individual person.
Simon Lewin is the Joint Coordinating Editor for the Cochrane Effective Practice and Organization of Care (EPOC) Group and a Coordinator of the GRADE-CERQual Project Group. Claire Glenton is the Director of Cochrane Norway, an Editor for the Cochrane Effective Practice and Organization of Care (EPOC) Group and a Coordinator of the GRADE-CERQual Project Group. Both Simon and Claire have worked closely with the WHO on developing WHO guidelines and guidance.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26(1):13–24.View ArticleGoogle Scholar
- Straus SE, Kitson A, Harrison MB, Graham ID, Fervers B, Légaré F, Davies B, Edwards N, Majumdar SR. The knowledge-to-action cycle. In: Straus SE, Tetroe J, Graham ID, editors. Knowledge Translation in Health Care. London: Blackwell; 2009.View ArticleGoogle Scholar
- United Nations. Transforming our world: the 2030 agenda for sustainable development, vol. 2015. New York, NY: UN; 2015. Available at: https://sustainabledevelopment.un.org/content/documents/21252030%20Agenda%20for%20Sustainable%20Development%20web.pdf Google Scholar
- Lewin S, Oxman AD, Lavis JN, Fretheim A, Garcia Marti S, Munabi-Babigumira S. SUPPORT tools for evidence-informed policymaking in health 11: Finding and using evidence about local conditions. Health Res Policy Syst. 2009;7(Suppl 1):S11.View ArticlePubMedPubMed CentralGoogle Scholar
- Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking? Health Res Policy Syst. 2009;7(Suppl 1):S1.View ArticlePubMedPubMed CentralGoogle Scholar
- Bosch-Capblanch X, Lavis JN, Lewin S, Atun R, Rottingen JA, Droschel D, Beck L, Abalos E, El-Jardali F, Gilson L, et al. Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development. PLoS Med. 2012;9(3):e1001185.View ArticlePubMedPubMed CentralGoogle Scholar
- Glenton C, Lewin S, Gulmezoglu AM. Expanding the evidence base for global recommendations on health systems: strengths and challenges of the OptimizeMNH guidance process. Implement Sci. 2016;11:98.View ArticlePubMedPubMed CentralGoogle Scholar
- Glenton C, Lewin S, Norris SL. Using evidence from qualitative research to develop WHO guidelines (Chapter 15). In: World Health Organization. Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2016.Google Scholar
- WHO. Handbook for Guideline Development. 2nd ed. Geneva: World Health Organization; 2016.Google Scholar
- Fujita N, Perrin XR, Vodounon JA, Gozo MK, Matsumoto Y, Uchida S, Sugiura Y. Humanised care and a change in practice in a hospital in Benin. Midwifery. 2012;28(4):481–8.View ArticlePubMedGoogle Scholar
- Munabi-Babigumira S, Glenton C, Lewin S, Fretheim A, Nabudere H. Factors that influence the provision of intrapartum and postnatal care by skilled birth attendants in low- and middle-income countries: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2017;11:CD011558.PubMedGoogle Scholar
- WHO. Defining competent maternal and newborn health professionals. Geneva: World Health Organization; 2018. Available at: http://apps.who.int/iris/handle/10665/272817.
- Carroll C. Qualitative evidence synthesis to improve implementation of clinical guidelines. Bmj. 2017;356:j80.View ArticlePubMedGoogle Scholar
- Tan TP, Stokes T, Shaw EJ. Use of qualitative research as evidence in the clinical guideline program of the National Institute for health and clinical excellence. Int J Evid Based Healthc. 2009;7(3):169–72.View ArticlePubMedGoogle Scholar
- Adebiyi BO, Mukumbang FC, Okop KJ, Beytell AM. A modified Delphi study towards developing a guideline to inform policy on fetal alcohol spectrum disorders in South Africa: a study protocol. BMJ Open. 2018;8(4):e019907.View ArticlePubMedPubMed CentralGoogle Scholar
- WHO. WHO recommendations on antenatal care for a positive pregnancy experience. Geneva: World Health Organization; 2016.Google Scholar
- Downe S, Finlayson K, Tuncalp Ӧ, Metin Gulmezoglu A. What matters to women: a systematic scoping review to identify the processes and outcomes of antenatal care provision that are important to healthy pregnant women. BJOG. 2016;123(4):529–39.View ArticlePubMedGoogle Scholar
- Downe S, Finlayson K, Tunçalp Ö, Gülmezoglu AM. Factors that influence the uptake of routine antenatal services by pregnant women: a qualitative evidence synthesis (Protocol). Cochrane Database Syst Rev. 2016;10:CD012392.Google Scholar
- WHO. Health worker roles in providing safe abortion care and post-abortion contraception. Geneva: World Health Organization; 2015.Google Scholar
- WHO. WHO recommendations: intrapartum care for a positive childbirth experience. Geneva: World Health Organization; 2018.Google Scholar
- WHO. Communicating risk in public health emergencies. A WHO guideline for emergency risk communication (ERC) policy and practice. Geneva: World Health Organization; 2018.Google Scholar
- O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245–51.View ArticlePubMedGoogle Scholar
- Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.View ArticleGoogle Scholar
- Noyes J, Booth A, Cargo M, Flemming K, Garside R, Hannes K, Harden A, Harris J, Lewin S, Pantoja T, et al. Cochrane qualitative and implementation methods group guidance series-paper 1: introduction. J Clin Epidemiol. 2018;97:35–8.View ArticlePubMedGoogle Scholar
- Lavis JN, Wilson MG, Moat KA, Hammill AC, Boyko JA, Grimshaw JM, Flottorp S. Developing and refining the methods for a ‘one-stop shop’ for research evidence about health systems. Health Res Policy Syst. 2015;13:10.View ArticlePubMedPubMed CentralGoogle Scholar
- Rada G, Perez D, Capurro D. Epistemonikos: a free, relational, collaborative, multilingual database of health evidence. Stud Health Technol Inform. 2013;192:486–90.PubMedGoogle Scholar
- Lewin S, Booth A, Glenton C, Munthe-Kaas HM, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. 2018;13(Suppl 1):2.View ArticlePubMedPubMed CentralGoogle Scholar
- Lewin S, Glenton C, Munthe-Kaas H, Carlsen B, Colvin CJ, Gulmezoglu M, Noyes J, Booth A, Garside R, Rashidian A. Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual). PLoS Med. 2015;12(10):e1001895.View ArticlePubMedPubMed CentralGoogle Scholar
- Alonso-Coello P, Schünemann HJ, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, Treweek S, Mustafa RA, Rada G, Rosenbaum S, Morelli A, Guyatt GH, Oxman AD; GRADE Working Group. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction. BMJ. 2016;353:i2016.Google Scholar
- Moberg J, Oxman AD, Rosenbaum S, Schunemann HJ, Guyatt G, Flottorp S, Glenton C, Lewin S, Morelli A, Rada G, et al. The GRADE evidence to decision (EtD) framework for health system and public health decisions. Health Res Policy Syst. 2018;16(1):45.View ArticlePubMedPubMed CentralGoogle Scholar
- Brandt L, Agoritsas T, Guyatt GH, van de Velde S, Kiuijpers T, Elliot J, Mavergames C, Leng G, MacDonald H, Kunnamo I, et al. A trustworthy, efficient and integrated evidence ecosystem. Forthcoming. 2018;Google Scholar
- Elliott JH, Turner T, Clavisi O, Thomas J, Higgins JP, Mavergames C, Gruen RL. Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med. 2014;11(2):e1001603.View ArticlePubMedPubMed CentralGoogle Scholar
- Shepherd JP. How to achieve more effective services: the evidence ecosystem. Cardiff, UK: What Works Network/Cardiff University; 2014. Available at: http://www.scie-socialcareonline.org.uk/how-to-achieve-more-effective-services-the-evidence-ecosystem/r/a11G0000006z7vXIAQ Google Scholar
- Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009;7(Suppl 1):S13.View ArticlePubMedPubMed CentralGoogle Scholar
- Moat KA, Lavis JN, Clancy SJ, El-Jardali F, Pantoja T, Knowledge Translation Platform Evaluation study team. Evidence briefs and deliberative dialogues: perceptions and intentions to act on what was learnt. Bull World Health Organ. 2014;92(1):20–8.Google Scholar
- Pitchforth E, van Teijlingen E, Graham W, Dixon-Woods M, Chowdhury M. Getting women to hospital is not enough: a qualitative study of access to emergency obstetric care in Bangladesh. Qual Saf Health Care. 2006;15(3):214–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Zembe-Mkabile WZ, Jackson D, Sanders D, Besada D, Daniels K, Zamasiya T, Doherty T. The ‘community’ in community case management of childhood illnesses in Malawi. Glob Health Action. 2016;9:29177.View ArticlePubMedGoogle Scholar
- Social science approaches for research and engagement in health policy & systems (SHaPeS) thematic working group of Health Systems Global, Regional Network for Equity in Health in East and Southern Africa, Emerging Voices for Global Health, Daniels K, Loewenson R, George A, Howard N, Koleva G, Lewin S, Marchal B, et al. Fair publication of qualitative research in health systems: a call by health policy and systems researchers. Int J Equity Health. 2016;15:98.View ArticleGoogle Scholar
- Doherty T, Lewin S, Kinney M, Sanders D, Mathews C, Daviaud E, Goga A, Bhana A, Besada D, Vanleeuw L, et al. Addressing the tensions and complexities involved in commissioning and undertaking implementation research in low- and middle-income countries. BMJ Glob Health. 2018;3:e000741.View ArticlePubMedPubMed CentralGoogle Scholar
- de Gruchy J, Lewin S. Ethics that exclude: the role of ethics committees in lesbian and gay health research in South Africa. Am J Public Health. 2001;91(6):865–8.View ArticlePubMedPubMed CentralGoogle Scholar