Extending the PRISMA statement to equity-focused systematic reviews (PRISMA-E 2012): explanation and elaboration
© Welch et al. 2015
Received: 20 July 2015
Accepted: 21 September 2015
Published: 8 October 2015
The promotion of health equity, the absence of avoidable and unfair differences in health outcomes, is a global imperative. Systematic reviews are an important source of evidence for health decision-makers, but have been found to lack assessments of the intervention effects on health equity. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) is a 27 item checklist intended to improve transparency and reporting of systematic reviews. We developed an equity extension for PRISMA (PRISMA-E 2012) to help systematic reviewers identify, extract, and synthesise evidence on equity in systematic reviews.
Methods and findings
In this explanation and elaboration paper we provide the rationale for each extension item. These items are additions or modifications to the existing PRISMA Statement items, in order to incorporate a focus on equity. An example of good reporting is provided for each item as well as the original PRISMA item.
This explanation and elaboration document is intended to accompany the PRISMA-E 2012 Statement and the PRISMA Statement to improve understanding of the reporting guideline for users. The PRISMA-E 2012 reporting guideline is intended to improve transparency and completeness of reporting of equity-focused systematic reviews. Improved reporting can lead to better judgement of applicability by policy makers which may result in more appropriate policies and programs and may contribute to reductions in health inequities.
To encourage wide dissemination of this article it is accessible on the International Journal for Equity in Health, Journal of Clinical Epidemiology, and Journal of Development Effectiveness web sites.
Promoting health equity and reducing avoidable health inequalities is a global imperative, endorsed by the Rio Summit in Brazil in 2011, the Pan American Health Organization, and the World Health Organization [1–3]. Health inequalities are differences in health outcomes across individuals in a population or between different population groups whereas health inequities are inequalities which are avoidable and unfair [4, 5]. Inequities are not only due to poverty, but may also be due to unfair differences in health across other characteristics such as sex/gender, geography, and ethnicity . The concept of health equity also suggests that groups of people should not be prevented from achieving health due to factors such as discrimination or inadequate access. In this reporting guideline, we focus on unfair inequalities in health outcomes and therefore use the term ‘equity’.
Systematic reviews are recognized as an important source of rigorously and transparently synthesized information by health decision-makers [2, 7–9]. Health decision makers have described lack of evidence on equity as a barrier to using systematic reviews and guidelines [5, 10], and arguably, primary studies themselves. However, a 2010 systematic review found that there is a lack of detail in reporting of certain aspects important to health equity including population characteristics, assessment of credibility of subgroup analyses, and judgement about the applicability of the findings to other settings with fewer than half of the included reviews reporting on socio-demographic characteristics (such as age, sex, place of residence, ethnicity) of the study populations . These are important factors to consider for health equity and the lack of reporting of these elements demonstrates the need to improve reporting of equity in systematic reviews, and to increase the overall investment in systematic reviews that can provide a clear emphasis on considerations of equity.
Terminology related to disadvantaged populations
To describe the populations who are experiencing inequitable differences we use the term ‘disadvantaged’ although we recognize that this term may not be acceptable to all. In a methodology review of equity assessment, disadvantage was defined in terms of the avoidability or preventability of health inequalities (12 of 34 studies)  by focusing on populations that have experienced health inequities (e.g., Aboriginal populations).
We have chosen to use the term “disadvantaged” for PRISMA-E 2012 because we felt that despite its limitations (e.g., that it may be considered a condescending or paternalistic term), the term “disadvantaged” more clearly defines a population that is experiencing or has experienced health inequities. Whereas vulnerability encompasses a combination of risk, exposure and resilience that do not always lead to health inequities, and other terms such as “marginalized” are too narrowly focused and do not encompass the breadth of settings, contexts and health inequities of interest.
To further facilitate and promote the use of the guideline of equity issues in systematic review (PRISMA-E 2012), we developed this explanation and elaboration to describe each of the items and provide examples from existing reviews to demonstrate good reporting.
Scope of PRISMA-E 2012
Assess effects of interventions targeted at disadvantaged or at-risk populations (e.g., school feeding for disadvantaged children ). These may not include equity outcomes but by targeting disadvantaged populations will reduce inequities.
Assess effects of interventions aimed at reducing social gradients across populations or among subgroups of the population (e.g., interventions to reduce the social gradient in smoking, obesity prevention in children, interventions delivered by lay health workers [15, 18–20]).
In the PRISMA-E 2012 Statement we had a third type of systematic review focused on health equity, those that are not aimed at reducing inequities but where it may be important to understand the equity effects. For example, we had previously categorized the review examining lay health workers in this category. We have now grouped this review into the second type of review described above.
In 2010, approximately 20 % of systematic reviews indexed in Medline met at least one of the above criteria [21, 22]. These reviews may not include equity as an outcome, but may target disadvantaged populations, or assess differences of the effect of the intervention among disadvantaged populations.
The PRISMA-E 2012 items are focused on health equity but may also apply to systematic reviews in non-health areas which address questions about inequity such as education, transport, justice, or social welfare. Additionally, some items in the checklist may be relevant to all systematic reviews, but have been included in this extension because of their specific importance to health equity. These items are additions or modifications to the existing PRISMA Statement items, in order to incorporate a focus on equity. For each item, the original PRISMA item is listed and the PRISMA-E 2012 extension item is noted below.
Methods PRISMA-E 2012 reporting guideline
Checklist of items for reporting equity-focused systematic reviews
Standard PRISMA Item
Extension for Equity-Focused Reviews
Identify the report as a systematic review, meta-analysis, or both.
Identify equity as a focus of the review, if relevant, using the term equity.
2. Provide a structured summary including, as applicable: background; objectives; data sources; study eligibility criteria, participants, and interventions; study appraisal and synthesis methods; results; limitations; conclusions and implications of key findings; systematic review registration number.
State research question(s) related to health equity.
Present results of health equity analyses (e.g., subgroup analyses or meta-regression).
Describe extent and limits of applicability to disadvantaged populations of interest.
Describe the rationale for the review in the context of what is already known.
Describe assumptions about mechanism(s) by which the intervention is assumed to have an impact on health equity.
Provide the logic model/analytical framework, if done, to show the pathways through which the intervention is assumed to affect health equity and how it was developed.
Provide an explicit statement of questions being addressed with reference to PICOS.
Describe how disadvantage was defined if used as criterion in the review (e.g., for selecting studies, conducting analyses, or judging applicability).
State the research questions being addressed with reference to health equity
Protocol and registration
Indicate if a review protocol exists, if and where it can be accessed (e.g., web address), and, if available, provide registration information including registration number.
6. Specify study characteristics (e.g., PICOS, length of follow-up) and report characteristics (e.g., years considered, language, publication status) used as criteria for eligibility, giving rationale.
Describe the rationale for including particular study designs related to equity research questions.
Describe the rationale for including the outcomes (e.g., how these are relevant to reducing inequity).
Describe all information sources (e.g., databases with dates of coverage, contact with study authors to identify additional studies) in the search and date last searched.
Describe information sources (e.g., health, non-health, and grey literature sources) that were searched that are of specific relevance to address the equity questions of the review.
Present full electronic search strategy for at least one database, including any limits used, such that it could be repeated.
Describe the broad search strategy and terms used to address equity questions of the review.
State the process for selecting studies (i.e., screening, eligibility, included in systematic review, and, if applicable, included in the meta-analysis).
Data collection process
Describe method of data extraction from reports (e.g., piloted forms, independently, in duplicate) and any processes for obtaining and confirming data from investigators.
List and define all variables for which data were sought (e.g., PICOS, funding sources) and any assumptions and simplifications made.
List and define data items related to equity, where such data were sought (e.g., using PROGRESS-Plus or other criteria, context).
Risk of bias in individual studies
Describe methods used for assessing risk of bias of individual studies (including specification of whether this was done at the study or outcome level), and how this information is to be used in any data synthesis.
State the principal summary measures (e.g., risk ratio, difference in means).
Synthesis of results
Describe the methods of handling data and combining results of studies, if done, including measures of consistency (e.g., I 2) for each meta-analysis.
Describe methods of synthesizing findings on health inequities (e.g., presenting both relative and absolute differences between groups).
Risk of bias across studies
15. Specify any assessment of risk of bias that may affect the cumulative evidence (e.g., publication bias, selective reporting within studies).
Describe methods of additional analyses (e.g., sensitivity or subgroup analyses, meta-regression), if done, indicating which were pre-specified.
Describe methods of additional synthesis approaches related to equity questions, if done, indicating which were pre-specified
Give numbers of studies screened, assessed for eligibility, and included in the review, with reasons for exclusions at each stage, ideally with a flow diagram.
For each study, present characteristics for which data were extracted (e.g., study size, PICOS, follow-up period) and provide the citations.
Present the population characteristics that relate to the equity questions across the relevant PROGRESS-Plus or other factors of interest.
Risk of bias within studies
Present data on risk of bias of each study and, if available, any outcome level assessment (see item 12).
Results of individual studies
For all outcomes considered (benefits or harms), present, for each study: (a) simple summary data for each intervention group; (b) effect estimates and confidence intervals, ideally with a forest plot.
Synthesis of results
Present results of each meta-analysis done, including confidence intervals and measures of consistency.
Present the results of synthesizing findings on inequities (see 14).
Risk of bias across studies
Present results of any assessment of risk of bias across studies (see item 15).
Give results of additional analyses, if done (e.g., sensitivity or subgroup analyses, meta-regression [see item 16]).
Give the results of additional synthesis approaches related to equity objectives, if done, (see 16).
Summary of evidence
Summarize the main findings including the strength of evidence for each main outcome; consider their relevance to key groups (e.g., health care providers, users, and policy makers).
Discuss limitations at study and outcome level (e.g., risk of bias), and at review-level (e.g., incomplete retrieval of identified research, reporting bias).
Provide a general interpretation of the results in the context of other evidence, and implications for future research.
Present extent and limits of applicability to disadvantaged populations of interest and describe the evidence and logic underlying those judgments.
Provide implications for research, practice, or policy related to equity where relevant (e.g., types of research needed to address unanswered questions).
Describe sources of funding for the systematic review and other support (e.g., supply of data); role of funders for the systematic review.
How to use this paper
The format of this document is similar to the format used in other explanation and elaboration documents [25–29]. We feel this explanation and elaboration paper is an important contribution to the literature because it provides the detailed rationale, evidence, whenever available, and an exemplar, for recommending each item as well as examples of good practice. We recommend authors use this document in conjunction with the PRISMA-E 2012 statement and with the original PRISMA statement and explanation and elaboration papers. We use the term “we” to refer to the consensus panel that met to finalize the PRISMA-Equity 2012 reporting guidelines in February 2012, as well as those who were unable to attend but contributed to the final reporting guidelines.
Item 1: title
Standard PRISMA item: Identify the report as a systematic review, meta-analysis or both.
In addition, for equity-focused systematic reviews: Identify equity as a focus of the review, if relevant, using the term equity
Explanation - Equity-focused systematic reviews need a concise title that includes the term ‘equity’ or ‘inequity’. At the consensus meeting, the panel felt strongly that a consistent term was needed in the title to help identify equity-focused reviews and we chose the term ‘equity’ because of our focus on unfair inequalities in health. Indexing of electronic databases is poor for terms relating to health equity or disadvantaged or vulnerable populations therefore we suggest including ‘equity’ in the title will facilitate searching for equity-focused reviews. Not all systematic reviews will include equity in the title so to improve searchability, ‘equity’ should be included in the abstract and/or keywords. This will also help policy makers find equity-focused systematic reviews. In a search of systematic reviews published in the last year in MEDLINE, we only found 11 with ‘equity’ in the title and 73 with equity in the title and/or abstract (Additional file 1: Table S1).
Item 2: abstract
Standard PRISMA item: Provide a structured summary including, as applicable: background; objectives; data sources; study eligibility criteria, participants, and interventions; study appraisal and synthesis methods; results; limitations; conclusions and implications of key findings; systematic review registration number.
In addition, for equity-focused systematic reviews: State research question(s) related to health equity.
○ “We aimed to systematically assess current evidence for the association between socioeconomic position (SEP) and caries. We included studies investigating the association between social position (determined by own or parental educational or occupational background, or income) and caries prevalence, experience, or incidence” .
“Our primary outcome is the utilization of [post-natal care] PNC services, and determinants of concern are: 1) socioeconomic status (for example, income, education); 2) geographic determinants (for example, distance to a health center, rural versus urban residence); and 3) demographic determinants (for example, ethnicity, immigration status)” 
Explanation - The abstract of the review needs to indicate whether the research questions and objectives are of relevance to equity or specific populations since some readers, including those making decisions about health programs and policies, may only have access to the abstract (or only read the abstract). Thus, we recommend research questions related to health equity should be reported in the abstract to facilitate their retrieval for decision-making. We also recommend describing the type of inequities addressed by the review (e.g., health outcomes, health service coverage or access, financial risk).
Item 2A: in addition, for equity-focused systematic reviews: Present results of health equity analyses (e.g., subgroup analyses or meta-regression).
○ “No strong evidence of differential effects was found for smoking restrictions in workplaces and public places, although those in higher occupational groups may be more likely to change their attitudes or behaviour. Smoking restrictions in schools may be more effective in girls. Restrictions on sales to minors may be more effective in girls and younger children. Increasing the price of tobacco products may be more effective in reducing smoking among lower income adults and those in manual occupations, although there was also some evidence to suggest that adults with higher levels of education maybe more price sensitive. Young people aged under 25 are also affected by price increases, with some evidence that boys and non-white young people may be more sensitive to price” .
Explanation - Findings related to equity questions should be presented in the abstract along with the main results. In addition, the abstract needs to differentiate between the main analyses and other analyses as well as any null findings. Of 182 abstracts, 42 % do not describe the direction of the main effect in words, and 25 % do not provide numerical results . For equity-focused reviews, we have found that equity findings (e.g., subgroup analyses by socioeconomic status or other indicators) are not well reported in the abstract. Including the equity findings in the abstract may facilitate finding equity-focused reviews. As mentioned above, some readers only read or have access to the abstract. We felt that including equity-findings in the abstract will be helpful for users to determine whether the review is of interest. Therefore, the abstract should describe all relevant effects on health equity, both beneficial and harmful, as well as the methods used to assess health equity .
As recommended by PRISMA for abstracts , authors should report the main results in both numbers and words to meet the needs of different users.
Item 2B: in addition, for equity-focused systematic reviews: Describe extent and limits of applicability to disadvantaged populations of interest.
○ “Conditional cash transfer programmes have been the subject of some well-designed evaluations, which strongly suggest that they could be an effective approach to improving access to preventive services. Their replicability under different conditions - particularly in more deprived settings - is still unclear because they depend on effective primary health care, and mechanisms to disburse payments. Further rigorous evaluative research is needed, particularly where [conditional cash transfers] CCTs are being introduced in low income countries, for example in Sub-Saharan Africa or South Asia.” 
Explanation - Since the abstract may be all that a reader accesses, it is important that the abstract reports the extent and limits of applicability of the findings of the review in relation to equity concepts. We felt this information is important to all consumers and users of the review, including patients, practitioners, policy makers, press, and the public.
The reporting of applicability is not intended to be a recommendation for practice or policy. It is instead intended to provide the reader with information regarding the primary studies and the results of the review and how the results of equity considerations apply. While there is insufficient space to report applicability considerations for all populations, we felt that applicability to the target population of the review should be reported.
Item 3: rationale
Standard PRISMA item: Describe the rationale for the review in the context of what is already known.
In addition, for equity-focused systematic reviews: Describe assumptions about mechanism(s) by which the intervention is assumed to have an impact on health equity.
○ “CCT programs are justified on the grounds that demand-side subsidies are needed to address constraints and bottlenecks of service delivery. CCT programs usually aim to increase demand for preventive health services and education because these services have positive spillover effects that justify the expense. CCT help overcome barriers to access of services. These programs address social equity concerns because CCT can help to “level the playing field” thus creating equal opportunities” .
○ “Many lay health worker programs aim to address inequity by providing services to underserved communities” .
Explanation - If available, systematic reviews with a focus on health equity should explicitly describe the assumptions about the effects of the intervention on health equity, or drivers of health inequity. Assumptions about outcomes along the causal chain and these hypotheses about health equity may be articulated using different methods such as a program theory and can then be tested empirically with pre-planned analyses in the review [39, 40]. The review should describe a priori how and why interventions are expected to work and the influence of factors such as setting and participant and program characteristics. This explicit reporting of assumptions and underlying hypotheses will help the reader understand the choice of methods to assess effects on health equity and the interpretation of results within the framework of these hypotheses.
Item 3A: in addition, for equity-focused systematic reviews: Provide the logic model/analytical framework, if done, to show the pathways through which the intervention is assumed to affect health equity and how it was developed.
Explanation - Health equity is influenced by multiple interacting factors such as context, setting, population characteristics, environment, public policy setting, health facility factors, health provider factors [4, 44, 45]. A visual framework, or logic model, can show the links between these factors, the program or intervention of interest, and the hypothesized effects on health equity. It can be used to show hypothesized pathways of influence on health equity, to focus the review, define the inclusion criteria, identify intermediate outcomes and harms, define the search strategy, and plan subgroup and effect modifier analyses . For example, the logic model for a systematic review of preschool feeding shows that low socioeconomic status and household size may increase the risk of substitution (less food at home), thus decreasing the observed effects of preschool feeding) . A visual framework can be useful for policy-makers and decision-makers who seek to answer questions about the effects of both targeted and universal interventions and how these programs will work in their policy/decision-making settings and system. For complex interventions, a visual framework can help the reader unpack the ‘black box’, thus showing how the intervention might affect different subgroups of the population and can be used as a tool for articulating subgroup analyses a priori.
Many different methods exist for developing a logic model, and different logic models have been developed for the same question. Guidance for how to construct a logic model is available from the Cochrane Public Health Group and the Kellogg Foundation [48–51].
Item 4: objectives
Standard PRISMA item: Provide an explicit statement of questions being addressed with reference to participants, interventions, comparisons, outcomes, and study design (PICOS).
In addition, for equity-focused systematic reviews: Describe how disadvantage was defined if used as criterion in the review (e.g., for selecting studies, conducting analyses, or judging applicability).
○ “For the purposes of this review, the term’disadvantaged’ is taken to denote women whom the primary investigators considered to be of low socio-economic status or educationally disadvantaged, or who are under the age of 20[children born to teenage mothers in the UK have been estimated to have a 63 % increased likelihood of being born into poverty], or who are caring for children in single-parent households” .
○ “Parents with children up to the age of school entry and who were socially disadvantaged in respect of poverty, lone parenthood or ethnic minority status.” 
○ “We will retrieve studies implemented in LMICs, as defined by The World Bank Group’s classification… which study access to or utilization of PNC services by birthing women living in resource strained settings.” 
Explanation - Description of the specific population in the PICOS (Population, Intervention, Comparator, Outcome, Study Design) framework does not encompass explicit definition of how disadvantage or risk of inequity will be assessed, for example in reference to which group, disadvantaged by what mechanisms, and for which outcomes. Populations are at risk of health disadvantage for many different reasons which may interact with each other. There are many examples of factors that may contribute to disadvantage and these may interact with each other, such as geographical isolation, lack of access to health facilities, biologic vulnerability, historical oppression, social exclusion, health or language literacy, low resource settings, inadequate health systems, inadequate health insurance, health provider attitudes, stigmatization, and discrimination . Systematic review authors can group such factors using the PROGRESS-Plus acronym; Place of residence, Race/ethnicity/culture/religion, Occupation, Gender/sex, Religion, Social Capital, Socioeconomic status [6, 52]. However, grouping populations that share one characteristic across PROGRESS-Plus may lead to overgeneralization since people within one category are heterogeneous (e.g., women range from poor to wealthy, with very different personal histories and exposures to health risks).
An explicit definition of how disadvantage will be assessed in the systematic review, either for targeted interventions or for subgroup analyses of universal interventions, is necessary to increase the likelihood that similar groups of people are compared, to make explicit the proposed reasons those people are considered disadvantaged, to explain why and how the program is expected to work for people at different risk of health disadvantage, and to facilitate judgments about applicability in different settings and populations. If disadvantage is used as a criterion, it needs to be defined, as well as the proposed reasons for disadvantage (e.g., biologic, societal), and the comparator or reference group against which disadvantage is assessed. Disadvantage and vulnerability may be poorly reported in primary studies. However, systematic review authors should describe how they have operationalized their definition of disadvantage or inequity in their inclusion criteria, analyses, and judgements of applicability. For example, if economically disadvantaged populations are the focus of the review, then a description of this population should be provided.
Item 4A: in addition, for equity-focused systematic reviews: State the research questions being addressed with reference to health equity.
○ 2 objectives “To determine the effectiveness of school feeding programs in improving physical and psychosocial health outcomes for low income school children.” And “To compare the effectiveness of school feeding programmes for socio-economically disadvantaged children and advantaged children” .
○ “To assess the impact on maternal and infant health and on infant development of programmes offering home support in addition to the standard service for teenaged mothers (ages less than 20 years) who had recently given birth and who were socially or economically disadvantaged, for example because they were poor, lived inner city or were single parents” .
Explanation - If assessing the impact on inequities is an objective of the review, the research questions related to this objective should be stated. Potentially important subgroup effects are differences in the relative effect that are large enough that users might make different decisions based on the subgroup effect than they would be based on the overall effect. Review authors should give consideration to all potentially disadvantaged groups for which the intervention might have a different effect based on the intervention’s mechanism of action; including economic status, employment or occupation, education, place of residence, gender, and ethnicity.
Consideration of differences in relative effects for disadvantaged populations should be addressed similarly to any other subgroup analysis. As such, authors should distinguish between protocol and review items. The protocol should indicate plans for any subgroup analyses, including specifying which subgroups will be investigated, the predicted direction of the subgroup effect, and the indirect evidence supporting the prediction (e.g., biological or sociological rationale; studies of other relevant populations, interventions or outcomes) [55, 56]. Only a small number of subgroups (i.e., only those for which there is a plausible reason such as indirect evidence for anticipating a subgroup effect) should be investigated.
Item 6: eligibility criteria
Standard PRISMA item: Specify study characteristics (e.g., PICOS, length of follow up) and report characteristics (e.g., years considered, language, publication, status) used as criteria for eligibility, giving rationale.
In addition, for equity-focused systematic reviews: Describe the rationale for including particular study designs related to equity research questions.
○ “Cross-sectional quantitative study designs, qualitative study designs, or a combination of the two (mixed-methods studies). Specifically, we included, first, any type of cross-sectional study design reporting quantitative data. Second, qualitatively-based studies had to have used either individual interviews or focus group interviews to collect data about [female genital mutilation/cutting] FGM/C and used qualitative data analysis methods, such as thematic analysis, to be eligible for inclusion. Third, mixed-methods studies that incorporated both quantitative and qualitative components where the research design matched the nominated study designs were included. Both the quantitative and the qualitative components of the study were subjected to the same inclusion criteria as the mono-methods studies and the study was only included when the inclusion criteria were met” .
○ “We included qualitative studies and studies using descriptive statistics which met the following criteria:
reported on interventions as identified as “farmer field schools”, although not necessarily the same interventions as those included in the review of effects (review question 1);
assessed determinants of service delivery quality, knowledge acquisition, adoption of technological improvements, diffusion, or sustainability (either directly or indirectly – for example, studies that were relevant to addressing barriers to and enablers of [farmer field schools] FFS effectiveness)…” 
Explanation - Evidence on equity impacts may come from a range of study designs, depending on the question, and the study designs included in a systematic review should be chosen based on the question according to their ‘fitness for purpose’ . The evidence of effects may have been assessed using RCTs or other intervention study designs such as interrupted time series or controlled before-after study. However, for many equity-focused reviews examining social or public health interventions, the context in which the intervention operates is important and may be reported in qualitative studies . Evaluations of policy-level and other interventions that have implications for reducing inequity and may provide important insight into the effects on equity may have been evaluated using non-randomised designs (e.g., natural experiments).
Authors should be able to capture different types of evidence through the inclusion of different study designs, but should justify inclusion of these designs and provide the rationale. For example, barrier and facilitator data collection and analysis often requires quantitative and qualitative data. New authors may not be aware of the rationale for preferred study designs. While most systematic reviews just list study design without rationale, the need to explain the rationale is not just an issue for equity, it should always be reported.
Item 6A: in addition, for equity-focused systematic reviews: Describe the rationale for including the outcomes (e.g., how these are relevant to reducing inequity).
○ “Other smoking-related outcomes included compliance with age-of-sale legislation, density of advertising and vending machines, brand appeal, and awareness and receptivity to antismoking campaigns. This broad range of smoking-related outcomes was included in order to encompass the diverse ways in which tobacco control policies can influence youth smoking-related outcomes” .
○ “Changes in equity of access - increased access for disadvantaged groups or a reduction in gaps in coverage – could also be an important outcome measure. This required a preliminary analysis and categorisation of the population of interest along a socio-economic scale. We accepted any relevant methodology (e.g., wealth/asset index) provided it was rigorous and described in detail” .
Explanation - As with all systematic reviews, outcomes need to be selected based on their relevance to the relevant stakeholder and/or user group (e.g., subjects/patients, practitioner (and the patient-practitioner dyad), the public, policy-makers and politicians). Equity-focused systematic reviews must, in addition, consider the relevance and importance of outcomes across categories of disadvantage that are deemed relevant for the review, including both health and non-health outcomes. Non-health related outcomes can have direct impacts on health and equity. For example, the Whitehall study found that employment grade levels are related to health differences in which people with lower grade jobs have higher rates of mortality and diseases, such as ischaemic heart disease, and lower self-perceived health status .
In addition, measures may need to be developed and/or adapted to ensure that the methodology does not disadvantage participation of bias results across populations. Other situations are often found when a measure may be used across a population, and where the intervention effectiveness is analysed according to cultural diversity within the population. For example, a systematic review of culturally appropriate health education assessed the influence of culturally adapted measurement tools on knowledge outcomes using sensitivity analysis . The importance of outcomes for different settings and populations needs to be rated when selecting major outcomes, for example, in Summary of Findings (SOF) Tables for Cochrane reviews. A SOF table presents the main findings of the review for up to seven patient-important outcomes and rates the quality of the evidence . SOFs are intended for those using the review, such as decision-makers .
Context, inconvenience and burden (e.g., financial burden) for populations need to be considered as potentially important outcomes in equity-focused reviews even if they are not commonly reported in primary studies. Financial burden may be relatively greater for those who are poor and other burdens, such as stigma or travel time, may be different for different populations.
Equity of access to care and coverage of health services are important outcomes for some interventions which seek to improve access. Horizontal equity implies equal health care for equal need, whereas vertical equity implies greater health care for greater need. Authors should take a pragmatic approach to assessing equity of access.
Item 7: information sources
Standard PRISMA item: Describe all information sources (e.g., databases with dates of coverage, contact with study authors to identify additional studies) in the search and date last searched.
In addition, for equity-focused systematic reviews: Describe information sources (e.g., health, non-health, and grey literature sources) that were searched that are of specific relevance to address the equity questions of the review.
○ “We chose to restrict our search of electronic databases to the 20 databases that had produced the highest yield in the search for a previous systematic review on a related topic, the health effects of new roads. We developed our search syntax iteratively. We first conducted a scoping search with a provisional set of terms, retrieved the 100 most relevant abstracts, and then added additional indexing or text word terms used in those references to our search strategy. We then adapted the search syntax for each database or interface used. We did not limit the search using terms for study design. We decided not to attempt a “systematic” internet search. Instead, we used three quality assured gateway sites...and our own knowledge to generate lists of potentially relevant web sites, from which we selected a purposive sample of 16 sites that contained bibliographies or searchable databases of documents. These represented a range of types of organisation (academic, government, and voluntary), countries of origin (Canada, all the countries of the European Union, Norway, and the United States of America), and language of publication (Danish, English, French, Norwegian, and Swedish)” .
○ “We searched the following electronic databases for primary studies:
The Cochrane Central Register of Controlled Trials (CENTRAL) 2009, Issue 1, part of the The Cochrane Library (www.thecochranelibrary.com) including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 3 March 2009)
MEDLINE, Ovid In-Process & Other Non-Indexed Citations and MEDLINE, Ovid (1948 to present) (searched 24 June 2011)
EMBASE, Ovid (1980 to 2009 Week 09) (searched 2 March 2009)
PsycINFO, Ovid (1806 to February Week 4 2009) (searched 4 March 2009)
EconLit, Ovid (1969 to February 2009) (searched 5 March 2009)
Sociological Abstracts, CSA (1952 to current) (searched 8 March 2009)
Social Services Abstracts, CSA (1979 to current) (searched 8 March 2009)
LILACS (searched 6 May 2009)
WHOLIS (searched 7 May 2009)
Science Citation Index Expanded (SCI-EXPANDED) (1975 to present) (searched 8 September 2010)
Social Sciences Citation Index (SSCI) (1975 to present) (searched 8 September 2010). In addition we selected relevant databases from the LMIC database list at: http://epocoslo.cochrane.org. We did not search CINAHL or International Pharmaceutical Abstracts, so it is possible that studies relating to nursing or pharmaceuticals were missed. However, the general searches, including in websites focused on this topic, did not suggest that we had missed any relevant studies. We will add these databases when the review is updated” .
Explanation - Equity-focused reviews often go beyond issues of health and bridge other disciplines and thus information sources. For equity-focused systematic reviews, sources of information beyond the well-known health databases may be required. The search strategy may require inclusion of sources of information from different disciplines and different databases (e.g., sociological abstracts, IDEAhealth, non-health transportation or environmental content databases, and discipline-specific grey literature). Authors should describe all sources of information used for the search and provide a brief description of each, and justify why these information sources were considered necesary and appropriate.
Some relevant information may be available only to members of a certain association or working group. It would therefore be helpful for authors to report the accessibility of the sources of information in addition to website links or other information that may help the reader identify where the information has originated.
Item 8: search
Standard PRISMA item: Present full electronic search strategy for at least one database, including any limits used, such that it could be repeated.
In addition, for equity-focused systematic reviews: Describe the broad search strategy and terms used to address equity questions of the review.
○ See Additional file 1: Table S2
A note about searching
Caution should be used when developing the search strategy. Limiting the search using equity-related search terms is not recommended as many studies are not indexed using equity-related terms and potentially relevant studies could be missed. For equity-focused reviews, the search strategy may need to be broadened to reduce the risk of missing potentially included studies. Review authors should plan more time for screening.
Item 11: data items
Standard PRISMA item: List and define all variables for which data were sought (e.g., PICOS, funding sources) and any assumptions and simplifications made.
In addition, for equity-focused systematic reviews: List and define data items related to equity, where such data were sought (e.g., using PROGRESS-Plus or other criteria, context).
○ “…extracted data on study design, description of the intervention (including process), details on participants (including age, sex, number in each group), length of intervention, definition of poor/low income, other socio-demographic variables, including place of residence, race/ethnicity, age, and nutritional status, critical appraisal (see below), physical, cognitive, and behavioural outcomes. We had planned to extract data on cost-effectiveness, but found none. Where possible, we recorded effects by socio-economic position.” 
Explanation - It is important for equity-focused systematic reviews to report all items for which data were sought even if the information was not available from the primary studies. Authors should explain the reasons for seeking data on these characteristics. If possible, authors should consider making their data extraction forms available online (e.g., as web-only appendices) or by request so that others may use or amend the forms in their own reviews.
Other data items that relate to the context of the population or intervention should also be reported as well as any interactions between context and PROGRESS-Plus factors. Each characteristic requires careful consideration regarding their definition and classification as well as their interaction with other contextual elements and how they influence health inequities. For example, there is no agreed system for classifying race, ethnicity, and culture, particularly across different countries .
PROGRESS-Plus is one acronym that can be used to describe disadvantage [6, 52, 69]. However, other frameworks for describing disadvantage and inequity exist and may also be used to capture equity-relevant data items. We support PROGRESS-Plus because it is easy to remember and is inclusive of all factors that may indicate disadvantage. About 68 % of systematic reviews describe the included population using one or more of the PROGRESS-Plus criteria and 13 % assess the effects of interventions disaggregated across one or more of these characteristics .
Item 14: synthesis of results
Standard PRISMA item: Describe the methods of handling data and combining results of studies, if done, including measures of consistency (e.g., I 2 ) for each meta-analysis.
In addition, for equity-focused systematic reviews: Describe methods of synthesizing findings on health inequities (e.g., presenting both relative and absolute differences between groups).
○” Studies demonstrating an overall effect on anthropometric outcomes were initially categorized according to whether they were effective or not effective among lower SEP groups. Within these categories, we then analysed studies to identify common characteristics between interventions, including the degree to which they addressed structural barriers to behavioural change; as noted earlier, particular structural barriers may be more or less prevalent among different SEP groups in a population” .
Explanation - There is a need for clear and explicit reporting of choices regarding analyses about health inequity and their rationale a priori. This includes reporting what will be compared and how these comparisons will be made. There are over 20 different approaches available to measure health inequalities between two groups (e.g., rate ratio, rate difference, low to high ratio), or between more than two groups (e.g., slope index of inequality, concentration index, index of dissimilarity) . Despite vigorous debate about the attributes, measurement properties and implications of different measures and choice such as the referent group, there is no single accepted measure of health inequalities, and all are subject to limitations . Furthermore, the selection of how to measure health inequalities may bias the interpretation of results . For example, the interpretation of any measure of changes in health inequalities over time depends on whether the outcome is an adverse effect or beneficial outcome, and on the baseline prevalence . Authors should report the methods used to synthesize findings to ensure sufficient information.
Measures of health inequalities may be useful as an input for population or economic models for projecting population impact on health inequalities. Considerations for choosing a measure of health inequalities are: 1) interpretability; 2) ease of calculation; and 3) information available from primary studies. While there is no agreement on the best approach, selection of measures of health inequalities needs to consider the advantages, data requirements and limitations of these approaches. The choice of reference point (comparator), method of assessing differences (relative or absolute), measurement of differences or end of study outcomes affects the difference observed between two or more groups . Some measures (e.g., Gini, concentration index) may be less well understood by the users.
The measurement of health inequity depends on characteristics of the outcome measure and choices about comparisons, such as, whether the outcome is desirable or undesirable, baseline prevalence, and absolute or relative differences [74, 75]. This was demonstrated with a before-after study of a coronary artery bypass graft (CABG) report card program that compared the rates of CABG surgery between white, black, and Hispanic patients. The relative difference decreased between white and black patients for receipt of a CABG but the absolute difference increased therefore increasing the disparities between ethnicities [75, 76].
The absolute effect provides the difference in effectiveness between while the relative effect describes the difference in effectiveness relative to a reference group, such as the whole population . Absolute differences can describe the proportion of the disadvantaged population affected, or not affected, by the intervention since disadvantaged populations may have worse health status and higher risk of adverse outcomes . Another example (Fig. 2) demonstrates that while the rate of stomach cancer mortality for men and women declined between the years 1930 and 2000, the absolute difference between these rates decreased over that last 50 years while the relative difference has increased steadily . This demonstrates that although mortality rates have declined in both groups, the ratio of male-to-female stomach cancer mortality has increased (more men than women are dying from stomach cancer). It would be misleading to present one of these indicators without the others therefore we suggest that systematic review authors present the absolute and relative differences.
If the aim of the intervention being studied in the systematic review is to reduce inequities, authors should report how they plan to measure the effect on health inequities. If the review will compare effects in two groups, how will the difference be measured, synthesised, and interpreted at the systematic review level?
Item 16: additional analyses
Standard PRISMA item: Describe methods of additional analyses (e.g., sensitivity or subgroup analyses, meta-regression), if done, indicating which were pre-specified.
In addition, for equity-focused systematic reviews: Describe methods of additional synthesis approaches related to equity questions, if done, indicating which were pre-specified.
○ “Effect modifiers, such as high/low energy, compliance, substitution, and duration of the intervention were examined. In addition, study quality was considered since studies of lower quality often show higher effect sizes than those of higher quality. For example, biased outcome assessment is possible if the outcome assessors are not blinded to study group. This review tabulated the effects for each study by sorting them according to these effect modifiers (type of study, blinding versus unclear blinding, date of study, and high versus low energy) (Kristjansson et al. 2007). The effect of school feeding on learning outcomes may also be affected by contextual factors as teacher absenteeism and availability of learning materials, both of which may be worse in more disadvantaged communities.” 
○ “This study examined the influence of program implementation, program activities, program environment, and individual characteristics on welfare-to-work programs. The authors also considered the unemployment rate for each to determine whether the programs were affected by the availability of jobs in the area in which the program was implemented” .
Explanation - Understanding how to reduce health inequities may require additional quantitative or qualitative analyses, such as causal pathway analyses or process evaluations and a greater use of subgroup analyses to explore the differential effects of public health or population level interventions. Implementation of an intervention and its effectiveness may depend on participant characteristics such as age, education, gender, social status, context including the presence of complementary services, setting characteristics, and intervention characteristics (e.g., fidelity of intervention, delivery). Differences in participant characteristics, context and intervention design or delivery may limit the ability to conduct a meta-analysis. These characteristics of interventions, setting and participants may not be well-reported in primary studies, or have insufficient statistical power to find significant effects at the sub-group level [80, 81]. Systematic review authors may need to contact the primary study authors for information regarding subgroup analyses across different characteristics such as ethnicity and socioeconomic status. This information may have been analysed but not reported in the published papers [82, 83]. The move towards open access of trial data may make this more feasible in the future .
Subgroup analyses need to be conducted with caution and follow guidelines for reducing the likelihood of false results. Sun and colleagues have developed criteria for judging the credibility of subgroup analyses such as prespecifying the hypothesized direction of effects, using a test for interaction, and keeping the number of subgroup analyses few, and justified based on prior empiric evidence .
Systematic reviews with an equity focus should document and describe relevant and important characteristics of the participants and settings, as well as implications for the ability to conduct pre-planned analyses.
Numerous additional methods may be employed to assess the influence of contextual factors, participant characteristics and implementation such as qualitative review methods to understand the process of implementation and its relationship to effectiveness (e.g., using meta-ethnography, realist review or thematic analysis) . When reporting the use of these methods, authors should use the relevant, method-specific reporting guidance to transparently report their methods (e.g., RAMESES reporting guidelines for realist review or the Cochrane Handbook extension on qualitative reviews) [86, 87].
Item 18: study characteristics
Standard PRISMA item: For each study, present characteristics for which data were extracted (e.g., study size, PICOS, follow-up period) and provide the citations.
In addition, for equity-focused systematic reviews: Present the population characteristics that relate to the equity questions across the relevant PROGRESS-Plus or other factors of interest.
○ “Of the 82 studies included in this review, 55 studies (67 %) were conducted in six high income countries: Australia, Canada, Ireland, New Zealand, the UK, and the USA. Forty-one of the 82 studies were conducted in the USA. Twelve studies (14.6 %) were conducted in eight middle income countries (Brazil, China, India, Mexico, Philippines, Thailand, Turkey, and South Africa). Fifteen trials (18.3 %) were from 10 low income countries Bangladesh, Burkina Faso, Ethiopia, Ghana, Iraq, Jamaica, Nepal, Pakistan, Tanzania, and Vietnam). In 59 studies the intervention was delivered to patients based in their homes. Five interventions were based solely in a primary care facility…A further eight studies involved a combination of home, primary care, and community based interventions. Four studies delivered the intervention mainly by telephone…while one implemented the intervention through community meetings. For five studies, other sites were used such as the workplace, churches, or homeless shelters” .
○ “Study participants had a mean age of 12.6 years and were described as of American Indian descent and representing the Pueblo, Navajo, Hopi, and Jicarilla Apache Indian Nations. The study setting was described as a boarding school exclusively for American Indian youth and promoting academic excellence” .
Explanation - Approximately 50 % of systematic reviews report the effect of sex/gender on outcomes, and less than 15 % report other PROGRESS-Plus characteristics which may be important [21, 24, 89]. PROGRESS-Plus information is reported in primary studies more often than in systematic reviews [21, 89]. Reporting the characteristics of populations associated with disadvantage, if relevant to the SR question, helps the user/reader compare their own setting and population to those included in the studies and can influence decision-making.
It may be useful to include criteria relating to judgements about which PROGRESS-Plus factors are relevant for the review question. A number of frameworks are available to help identify characteristics that are relevant in describing the socioeconomic and demographic characteristics of populations in addition to PROGRESS-Plus, such as SCRAP (Sex, Comorbidities, Race, Age and Physiopathology) ; and SUPPORT Collaboration framework . There is little empirical evidence about the most efficient use of these frameworks. It is unlikely to be feasible to report all characteristics of interest, and not all characteristics may be relevant for each review. It is not necessary to report on all PROGRESS-Plus characteristics, as this might encourage data dredging. However, authors should consider which factors are relevant to their question a priori.
Authors should report characteristics of the setting, and whether these characteristics are entangled with the classification of disadvantage. For example, in the systematic review of school feeding for disadvantaged children, disadvantage was identified by attributes of the setting such as the location (poor, rural villages), the main occupation (e.g., subsistence farmers”) and the presence of school breakfast programs, which were only funded and provided in very poor areas with high malnutrition .
Item 21: synthesis of results
Standard PRISMA item: Present results of each meta-analysis done, including confidence intervals and measures of consistency.
In addition, for equity-focused systematic reviews: Present the results of synthesizing findings on inequities (see 14).
○ “This review sought to identify studies which had reported on sociodemographic characteristics known to be important from an equity perspective. For this process, the PROGRESS (Place, Race, Occupation, Gender, Religion, Education, Socio-economic status (SES), Social status) framework was utilised. All studies reported the gender of participants at baseline. Four studies reported the race of participants and the level of education of parents…and two studies included information about the employment status of parents at baseline… included information on SES of participants at baseline based on parental income… reported some indicators related to place (the proportion of participating schools in a rural or urban region) and SES (the proportion of participating schools in an urban region which were also in an area considered to be underprivileged). When analysing data on outcomes, only three studies analysed results by any of the PROGRESS items. …analysed outcomes by gender…analysed outcomes by the same indicators of place and SES that were collected at baseline (these data are discussed above)” .
Explanation - Authors should report the results of all analyses related to health inequities and specify which analyses were determined a priori and which were conducted post hoc. Raw values, as well as absolute and relative effects on health inequities should be presented for the reasons discussed above. All analyses conducted at the review level should be reported, even if they were lacking in data or were not statistically significant.
When examining the data across a population to identify population subgroups experiencing disadvantage, interventions may have a greater absolute effect even if the relative effect is the same. For example, a cohort of women smokers found that the relative risk of coronary heart disease for cigarette smokers was slightly lower among women with hypertension, hypercholesterolemia, or diabetes than among those without them . However, the absolute (or attributable) risk was two or more times higher for women with those conditions. Although the relative risk was lower, the absolute risk was much higher because the baseline risk of coronary heart disease was so much higher for non-smoking women with those conditions .
Example of a summary of findings table that includes an outcome related to health inequity
The impact of user fees on access to health services in low- and middle-income countries
Population: Anyone using any type of health service in low- and middle-income countries.
Settings: Burkina Faso, Kenya, Lesotho, Papua New Guinea.
Intervention: Introducing or increasing user fees
Comparison: No fees
Relative change in utilisation1
Number of studies
Quality of the evidence (GRADE)a
Equity outcome - health utilisation by quartile
⊕ ⊖ ⊖ ⊖ Very low3
This study where quality improvements were introduced at the same time as user fees found an increase in utilisation for poor groups. The authors did not report the results in a way that the relative change in utilisation could be calculated.
Example of a summary of findings table that includes a separate row to show the absolute events for disadvantaged groups
Vitamin A supplementation for preventing morbidity and mortality in children from six months to five years of age
Patient or population: Children aged between 6 months and five years
Intervention: Vitamin A supplementation
Comparison: Placebo or usual care
Illustrative comparative risksa (95 % CI)
Relative effect (95 % CI)
No. of Participants (studies)
Quality of the evidence (GRADE)
Low risk population
RR 0.72; 95 % CI 0.57 to 0.91
90,951 (7 studies)
Total number of participants reflects number randomised to studies. The analysis combined cumulative risk and risk per/1000 years follow-up.
3 per 10001
2 per 1000 (2 to 3)
Follow-up: 48–104 weeks
Medium risk population
4 per 10001
3 per 1000 (2 to 4)
High risk population
9 per 10001
6 per 1000 (5 to 8)
Example of a separate summary of findings table because of expected differences for disadvantaged population
Increases in price/tax of tobacco products
Smokefree-voluntary, regional, partial
Smokefree-compulsory, national, comprehensive
Mass media campaigns
Mass media campaigns-quitlines and NRT
Controls on advertising, promotion and marketing of tobacco
Population-level cessation support interventions
Setting based interventions(community, workplace, hospital)
Item 23: additional analyses
Standard PRISMA item: Give results of additional analyses, if done (e.g., sensitivity or subgroup analyses, meta-regression [see Item 16]).
In addition, for equity-focused systematic reviews: Give the results of additional synthesis approaches related to equity objectives, if done, (see 16).
○ “Effect modifiers were age and socioeconomic status. Younger students had larger effects than older students and students with lower socioeconomic status (SES) had larger effects than those with higher SES.” 
○ “This review used weighted regression analyses to investigate which elements of the programs were independently related to bullying and victimization effect sizes. These analyses showed that the most important elements of the program that were related to a decrease in bullying were parent training/meetings and disciplinary methods. Of all the intensity and duration factors, the most important program elements were intensity for children and parent training/meetings.” 
Explanation - The results of any additional syntheses related to the equity objectives should be reported as well as whether they were planned a priori and specified in the review protocol. This is consistent with published best practice in subgroup analysis . Subgroup analyses can be inappropriate, poorly-specified, and prone to Type I and Type II error, therefore, aall subgroup analyses need to be interpreted cautiously. Subgroup analyses in systematic reviews are generally reported with insufficient detail to judge their credibility .
Subgroups that were not identified at the protocol stage may be identified post hoc, however, the rationale for these analyses should be reported. Authors should report all subgroup analyses and any analyses to assess effect modifiers such as meta-regression- both statistically significant and non-significant to avoid outcome reporting bias of reporting only statistically significant results . This may be difficult, as effect modifiers may not be clearly reported in the primary studies. In some cases, there may be too few studies in particular settings of interest to draw conclusions. Intervention effects can be influenced by their design and implementation as well as the context within which it was implemented. For example, in the school feeding review, learning outcomes such as mathematics achievement were found to be higher with school meals programs but context was important for this outcome; if there were no teachers then there was no change in educational achievement with feeding.
Analyses related to contextual factors should be fully reported including a description of whether data was lacking from primary studies.
Item 26: conclusions
Standard PRISMA item: Provide a general interpretation of the results in the context of other evidence, and implications for future research.
In addition, for equity-focused systematic reviews: Present extent and limits of applicability to disadvantaged populations of interest and describe the evidence and logic underlying those judgements.
○ “This review included studies from high income countries as well as lower-middle- and upper-middle-income countries, with five studies conducted in countries within the latter two groupings (Thailand, Brazil, Chile and Mexico). This means that, while predominantly conducted within high-income settings, the findings from this review may be generalisable to a number of settings. A total of nineteen studies specifically reported incorporating strategies to target socio-economic and/or cultural diversity or disadvantage. One such study was conducted outside of the high-income country setting, in Chile, an upper-middle-income country. Of the remaining eighteen studies, seven studies conducted in the USA were of interventions targeting African American children and their communities and another two studies targeted Native American communities. Other studies targeted participants of low socio-economic status, or were implemented in areas of social disadvantage. By far the most common setting for interventions included in this review were schools (43 studies). Other interventions were (or included) home-based (14 studies), community based (six studies), or were set in a health service (two studies) or care setting (two studies). Eleven studies incorporated interventions across multiple settings.” 
Explanation - The conclusion should provide a transparent assessment of the applicability, the transferability, and the generalizability of the findings to the specific disadvantaged populations of interest (recognizing it is impossible to make these judgments for all possible populations). Authors should clearly report any disadvantaged population that was specified in the protocol and the reasons that consideration was given to the applicability of the results to the specified population. The applicability of the findings of a review to disadvantaged populations should be addressed similarly to considerations of applicability to any other population [8, 64, 90, 99, 100].
Authors should specify disadvantaged populations or settings for which the intervention is likely to be relevant. In the discussion review authors should consider the potential impact of: economic status, employment or occupation, education, place of residence, gender, and ethnicity as potential influences on the applicability of the results to disadvantaged populations, as well as resource or capacity constraints, health system arrangements or baseline conditions as potential reasons for there being a difference in the potential applicability of the results to low-income countries or disadvantaged populations. Authors should justify any judgments about applicability using transparent methods. There is no agreed checklist for judging applicability, though many are available [81, 101]. However, authors should provide rationale, and any data used to make judgements about applicability.
Applicability of results is often overlooked in systematic reviews. For example, an assessment of systematic reviews related to public health found that only 13 % discussed applicability . The panel felt that the conclusion of an equity-focused systematic review should provide a transparent assessment of the applicability, the transferability, and the generalizability of the findings to at least one specific disadvantaged population of interest. This population should be pre-specified in the protocol with rationale. Authors should also specify additional disadvantaged populations or settings for which the intervention is likely to be relevant.
The applicability of the findings of a review to disadvantaged populations should be addressed similarly to considerations of applicability to any other population, using explicit methods [8, 64, 90, 99, 100]. There is no agreed checklist for judging applicability, though many checklists are available . Authors should provide a rationale for the method they choose, and any data used to make judgements about applicability, such as other evidence about the possible impact of economic status, employment or occupation, education, place of residence, gender, and ethnicity, as well as resource or capacity constraints, health system arrangements or baseline conditions.
Item 26A: in addition, for equity-focused systematic reviews: Provide implications for research, practice, or policy related to equity where relevant (e.g., types of research needed to address unanswered questions).
○ “The body of evidence in this review provides some support for the hypothesis that obesity prevention interventions in children can be effective, and where examined, have not caused adverse outcomes or increased health inequalities. To this end, the direction of research and evaluation must move into how to implement effectively to scale, sustain the impacts over time and ensure equitable outcomes. In addition, interventions need to be developed that can be embedded into ongoing practice and operating systems, rather than implementing interventions that are resource intensive and cannot be maintained long-term.” 
○ “Future research should promote the development of effective interventions to enhance the online health literacy of consumers. Thus there is a need for well-designed and rigorously conducted randomised controlled trials (RCTs). These RCTs should involve diverse participants (regarding disease status, age, socio-economic group and gender) to analyse to what extent online health literacy reduces a barrier to using the internet for health information, or if socio-economic group, gender and age are more important in influencing internet use (Livingstone 2006). Trials should be conducted in different settings (including low, middle and high income countries) and should examine interventions to enhance consumers online health literacy (search, appraisal and use of online health information) like internet training courses.” 
Explanation - Implications for research, practice, and policy should highlight the effects on equity. This sections of the review should state the research that needs to be done to address existing knowledge gaps and should also suggest what the unanswered research questions are – that is, by specifying the questions that still need answering instead of stating that we “need more research”.
We developed the PRISMA-E 2012 checklist following guidance suggested by Moher and colleagues . This reporting guideline is intended to improve transparency and completeness of reporting of equity-focused systematic reviews. Improved reporting can lead to better judgement of applicability by policy makers which may result in more appropriate policies and programs and may lead to reductions in health inequities.
This explanation and elaboration document is intended to accompany the PRISMA-E 2012 Statement to improve understanding of the reporting guideline for users . The original PRISMA Statement has been endorsed by almost 200 journals; therefore, we recommend that authors of equity-focused systematic reviews use both the PRISMA checklist and the PRISMA-E 2012 checklist.
Potential limitations of the PRISMA-E 2012 checklist are that certain terminology used in the reporting guideline may not be well defined or widely used and may be defined differently by different users. To mitigate these concerns, we pilot tested the checklist with different groups of systematic reviews authors including those in high-income as well as low- and middle-income countries. The results of these pilot tests have been reported elsewhere . While some of the PRISMA-E 2012 extension items may apply to non-equity-focused reviews, we felt that their importance for equity-focused reviews was great enough to warrant development of a specific reporting guideline for these reviews. In addition, there is no planned update of the PRISMA Statement so we have included them in this reporting guideline.
We are committed to a broad based dissemination strategy of PRISMA-E 2012 and hope to have endorsement by all journals endorsing the PRISMA Statement. Our dissemination strategy includes contact with journal editors, systematic review authors and trainers, and dissemination at meetings and conferences. We will continue to monitor endorsement of the checklist by journal editors. We plan to evaluate this reporting guideline at a future date to determine its impact on reporting of equity-focused systematic reviews. We will measure the ‘footprint’ of PRISMA-E 2012 by tracking the number of requests for support (e.g., emails, phone calls), and indicators of sharing of PRISMA-E 2012 through various networks, such as LinkedIn, Twitter, and Facebook. We will also measure web metrics, such as downloads of the Word file of the reporting guideline checklist from our website.
We hope that journal endorsement and implementation, and use by systematic reviewers will improve the reporting of equity-focused systematic reviews. Widespread use of the PRISMA-E 2012 checklist may increase the requests for more data from primary researchers which may in turn improve the reporting of equity considerations in primary research.
The members of the PRISMA-Equity Bellagio group are: Rifat Atun, Harvard School of Public Health, USA; Shally Awasthi, King George's Medical College, India; Virginia Barbour, PLOS Medicine, UK; Zulfiqar A. Bhutta, Robert Harding Chair in Global Child Health & Policy, Centre for Global Child Health, The Hospital for Sick Children, Toronto, Canada & Founding Director, Center of Excellence in Women and Child Health, The Aga Khan University, Karachi, Pakistan; Luis Gabriel Cuervo, Research Promotion & Development, Pan American Health Organization, USA; Trish Groves, Deputy Editor, BMJ, UK; Tracey Koehlmoos-Perez, Headquarters U.S. Marine Corps, United States; Elizabeth Kristjansson, School of Psychology, Faculty of Social Sciences, University of Ottawa, Canada; David Moher, Ottawa Hospital Research Institute, Canada; Andy Oxman, Global Health Unit, Norwegian Knowledge Centre for Health Services, Cochrane EPOC Review Group, Norway; Tomas Pantoja, Universidad Católica de Chile, Santiago, Systematic Review Methods Centre Cochrane EPOC editor, Alliance for Health Systems and Policy Research, Chile; Mark Petticrew, London School of Hygiene and Tropical Medicine, Campbell and Cochrane Equity Methods Group, UK; Jennifer Petkovic, Campbell and Cochrane Equity Methods Group, University of Ottawa, Canada; Terri Pigott, Campbell Methods Coordinating Group; Campbell Statistics Group, Loyola University Chicago, USA; Kent Ranson, Alliance for Health Systems and Policy Research, WHO, Switzerland; Tessa TanTorres, World Health Organization, Choosing Interventions that are Cost-Effective (WHO-CHOICE), Switzerland; Prathap Tharyan, Cochrane Evidence Aid, Department of Psychiatry; Cochrane Schizophrenia Group; Coordinator, South Asian Cochrane Network - India, India; David Tovey, The Cochrane Library, UK; Peter Tugwell, University of Ottawa, Department of Medicine, Faculty of Medicine, University of Ottawa, Canada; Jimmy Volmink, Cochrane HIV/AIDS Review Group; South Africa Cochrane Centre, Medical Research Council of South Africa; Stellenbosch University, South Africa; Elizabeth Wager, Sideview, UK; Elizabeth Waters, Melbourne School of Population Health, The University of Melbourne, Australia; Vivian Welch, Ottawa Hospital Research Institute, Campbell and Cochrane Equity Methods Group, Bruyère Research Institute, University of Ottawa, Canada; George Wells, Cardiovascular Research Methods Centre, University of Ottawa Heart Institute, Cochrane Non-Randomized Studies Methods Group; Howard White, International Initiative for Impact Evaluation (3ie); Campbell International Development Coordinating Group, India.
In memoriam: We are greatly saddened by the loss of our esteemed friend and colleague, Elizabeth Waters, whose contributions were invaluable to this work.
The development of the PRISMA-E 2012 reporting guideline was funded by the Canadian Institutes of Health Research (grant number KPE 114370) and the Rockefeller Foundation. VW holds an Ontario Early Researcher Award. PT holds a Canada Research Chair in Health Equity. DM is funded by a University Research Chair. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Rio Political Declaration on Social Determinants of Health. Rio de Janeiro, Brazil.: World Conference on Social Determinants of Health, World Health Organization, 2011.Google Scholar
- PAHO. 49th Directing Council. 61st Session of the Regional Committee. Policy on Research for Health (CD49/10). Washington, DC: PAHO; 2009.Google Scholar
- WHO. The WHO strategy on research for health. Geneva, Switzerland: World Health Organization; 2012.Google Scholar
- Whitehead M. The concepts and principles of equity and health. Int J Health Serv. 1992;22(3):429–45.View ArticlePubMedGoogle Scholar
- Petticrew M, Whitehead M, Macintyre SJ, Graham H, Egan M. Evidence for public health policy on inequalities: 1: the reality according to policymakers. J Epidemiol Community Health. 2004;58(10):811–6.PubMed CentralView ArticlePubMedGoogle Scholar
- O’Neill J, Tabish H, Welch V, Petticrew M, Pottie K, Clarke M, et al. Applying an equity lens to interventions: using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J Clin Epidemiol. 2014;67(1):56–64.View ArticlePubMedGoogle Scholar
- Kelly MP, Morgan A, Bonnefoy J, Butt J, Bergman V, Mackenbach JP, et al. The social determinants of health: developing an evidence base for political action. Geneva: World Health Organisation; 2007. p. 1–165.Google Scholar
- Lavis JN. How can we support the use of systematic reviews in policymaking? Plos Med. 2009;6(11):e1000141.PubMed CentralView ArticlePubMedGoogle Scholar
- PAHO. Health Agenda for the Americas. Text of document distributed at the launching ceremony in Panama City. Panama: PAHO; 2007.Google Scholar
- Vogel JP, Oxman AD, Glenton C, Rosenbaum S, Lewin S, Gulmezoglu AM, et al. Policymakers‘and other stakeholders’ perceptions of key considerations for health system decisions and the presentation of evidence to inform those considerations: an international survey. Health Res Policy Syst. 2013;11:19.PubMed CentralView ArticlePubMedGoogle Scholar
- Welch V, Tugwell P, Petticrew M, de Montigny J, Ueffing E, Kristjansson B, et al. How effects on health equity are assessed in systematic reviews of interventions. Cochrane Database Syst Rev. 2010;12:MR000028.PubMedGoogle Scholar
- Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, et al. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;11:MR000030.PubMedGoogle Scholar
- Panic N, Leoncini E, de Belvis G, Ricciardi W, Boccia S. Evaluation of the endorsement of the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement on the quality of published systematic review and meta-analyses. PLoS One. 2013;8(12):e83138.PubMed CentralView ArticlePubMedGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.PubMed CentralView ArticlePubMedGoogle Scholar
- Welch V, Petticrew M, Tugwell P, Moher D, O’Neill J, Waters E, et al. PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. Plos Med. 2012;9(10):e1001333.PubMed CentralView ArticlePubMedGoogle Scholar
- Welch V, Petticrew M, Tugwell P, Moher D, O’Neill J, Waters E, et al. Extensión PRISMA-Equidad 2012: guías para la escritura y la publicación de revisiones sistemáticas enfocadas en la equidad en salud. Rev Panam Salud Publica. 2013;34(1):60–7.Google Scholar
- Miller S, Maguire LK, Macdonald G. Home-based child development interventions for preschool children from socially disadvantaged families. Cochrane Database Syst Rev. 2011;12:CD008131.PubMedGoogle Scholar
- Thomas S, Fayter D, Misso K, Ogilvie D, Petticrew M, Sowden A, et al. Population tobacco control interventions and their effects on social inequalities in smoking: systematic review. Tob Control. 2008;17(4):230.PubMed CentralView ArticlePubMedGoogle Scholar
- Thomson G, Hudson S, Wilson N, Edwards R. A qualitative case study of policy maker views about the protection of children from smoking in cars. Nicotine & Tobacco Research: official journal of the Society for Research on Nicotine and Tobacco. 2010;12(9):970–7.View ArticleGoogle Scholar
- Waters E, de Silva-Sanigorski A, Hall BJ, Brown T, Campbell KJ, Gao Y, et al. Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2011;12:CD001871.PubMedGoogle Scholar
- Tsikata S, Robinson V, Petticrew V, Kristjansson E, Moher D, McGowan J, et al. Is health equity considered in systematic reviews of the Cochrane Collaboration? 11th Cochrane Colloquium; 2003 2003/01/10/; Barcelona, SpainGoogle Scholar
- Welch V, Smylie JK, Kristjansson E, Brand K, Tugwell P, Wells GA. What is the role of systematic reviews in tackling health inequity? Doctoral thesis. Ottawa: University of Ottawa; 2010. Available from: https://www.ruor.uottawa.ca/handle/10393/30036.Google Scholar
- Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. Plos Med. 2010;7(2):e1000217.PubMed CentralView ArticlePubMedGoogle Scholar
- Welch V, Petticrew M, Ueffing E, Benkhalti Jandu M, Brand K, Dhaliwal B, et al. Does consideration and assessment of effects on health equity affect the conclusions of systematic reviews? A methodology study. PLoS One. 2012;7(3):e31360.PubMed CentralView ArticlePubMedGoogle Scholar
- Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne D, et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Annals Internal Medicine. 2001;134(8):663–94.View ArticleGoogle Scholar
- Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clinical chemistry and laboratory medicine: CCLM / FESCC. 2003;41(1):68–73.View ArticleGoogle Scholar
- Vandenbroucke JP, von Elm E, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Plos Med. 2007;4(10):e297.PubMed CentralView ArticlePubMedGoogle Scholar
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Plos Med. 2009;6(7):e1000100.PubMed CentralView ArticlePubMedGoogle Scholar
- Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309.View ArticlePubMedGoogle Scholar
- Mathew JL. Inequity in childhood immunization in India: a systematic review. Indian Pediatr. 2012;49(3):203–23.View ArticlePubMedGoogle Scholar
- Johri M, Norheim OF. Can cost-effectiveness analysis integrate concerns for equity? Systematic review. Int J Technol Assess Health Care. 2012;28(2):125–32.View ArticlePubMedGoogle Scholar
- Schwendicke F, Dörfer CE, Schlattmann P, Page LF, Thomson WM, Paris S. Socioeconomic inequality and caries: a systematic review and meta-analysis. J Dent Res. 2015;94:10.View ArticlePubMedGoogle Scholar
- Langlois EV, Miszkurka M, Ziegler D, Karp I, Zunzunegui MV. Protocol for a systematic review on inequalities in postnatal care services utilization in low- and middle-income countries. Systematic reviews. 2013;2:55.PubMed CentralView ArticlePubMedGoogle Scholar
- Beller EM, Glasziou PP, Hopewell S, Altman DG. Reporting of effect direction and size in abstracts of systematic reviews. JAMA. 2011;306(18):1981–2.View ArticlePubMedGoogle Scholar
- White M, Adams J, Heywood P. How and why do interventions that increase health overall widen inequalities within populations? In: Babones S, editor. Social Inequality and Public Health. Bristol: Policy Press; 2009.Google Scholar
- Beller EM, Glasziou PP, Altman DG, Hopewell S, Bastian H, Chalmers I, et al. PRISMA for Abstracts: reporting systematic reviews in journal and conference abstracts. Plos Med. 2013;10(4):e1001419.PubMed CentralView ArticlePubMedGoogle Scholar
- Lagarde M, Haines A, Palmer N. The impact of conditional cash transfers on health outcomes and use of health services in low and middle income countries. Cochrane Database Syst Rev. 2009;4:CD008137.PubMedGoogle Scholar
- Lewin S, Munabi-Babigumira S, Glenton C, Daniels K, Bosch-Capblanch X, van Wyk BE, et al. Lay health workers in primary and community health care for maternal and child health and the management of infectious diseases. Cochrane Database Syst Rev. 2010;3:CD004015.PubMedGoogle Scholar
- Waddington H, White H, Snilstveit B, Hombrados J, Vojtkova M, Davies P, et al. How to do a good systematic review of effects in international development: a tool kit. J Dev Effect. 2013;4(3):359–87.View ArticleGoogle Scholar
- Snilstveit B. Systematic reviews: from ‘bare bones’ reviews to policy relevance. J Dev Effect. 2012;4(3):388–408.View ArticleGoogle Scholar
- Waddington H, White H. Farmer field schools: From agricultural extension to adult education, 3ie Systematic Review Summary 1. London: International Initiative for Impact Evaluation (3ie); 2014.Google Scholar
- White H. Current challenges in impact evaluation. The European Journal of Development Research. 2014;26:18–30.View ArticleGoogle Scholar
- Niederdeppe J, Kuang X, Crock B, Skelton A. Media campaigns to promote smoking cessation among socioeconomically disadvantaged populations: what do we know, what do we need to learn, and what should we do now? Soc Sci Med. 2008;67(9):1343–55.View ArticlePubMedGoogle Scholar
- Braveman P, Gruskin S. Defining equity in health. J Epidemiol Commun Health. 2003;57(4):254–8.View ArticleGoogle Scholar
- Tugwell P, de Savigny D, Hawker G, Robinson V. Applying clinical epidemiological methods to health equity: the equity effectiveness loop. BMJ. 2006;332(7537):358–61.PubMed CentralView ArticlePubMedGoogle Scholar
- Anderson LM, Petticrew M, Rehfuess E, Armstrong R, Ueffing E, Baker P, et al. Using logic models to capture complexity in systematic reviews. Res Synth Method. 2011;2:33–42.View ArticleGoogle Scholar
- Kristjansson E, Francis D, Liberato S, Benkhalti Jandu M, Welch V, Batal M, et al. Feeding interventions for improving the physical and psychosocial health of disadvantaged children aged three months to five years (Protocol). Cochrane Database Syst Rev. 2012;6:CD009924.Google Scholar
- Armstrong R, Waters E, Doyle J. Chapter 21: Reviews in public health and health promotion In Cochrane Handbook for Systematic Reviews of Interventions. In: Higgins JPT, Green S, editors. The Cochrane Collaboration. 2011.Google Scholar
- W.K. Kellogg Foundation. Logic Model Development Guide. Battle Creek, MI: W.K. Kellog Foundation; 2004.Google Scholar
- Rogers P. Theory of Change. Methodological Briefs: Impact Evaluation No. 2: UNICEF Office of Research, Florence, 2014.Google Scholar
- Vogel I. Review of the use of ‘Theory of Change’ in International Development. DFID Research Paper: Department of International Development, 2012Google Scholar
- Evans T, Brown H. Road traffic crashes: operationalizing equity in the context of health sector reform. Injury Control & Safety Promotion. 2003;10(1–2):11–2.View ArticleGoogle Scholar
- Kristjansson B, Petticrew M, MacDonald B, Krasevec J, Janzen L, Greenhalgh T, et al. School feeding for improving the physical and psychosocial health of disadvantaged students. Cochrane Database Syst Rev. 2007;1:CD004676.PubMedGoogle Scholar
- Macdonald G, Bennett C, Higgins J, Dennis J. Home visiting for socially disadvantaged mothers (Protocol). Cochrane Database Syst Rev. 2010;10:CD008784.Google Scholar
- Sun X, Briel M, Walter SD, Guyatt GH. Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. BMJ. 2010;340:c117.View ArticlePubMedGoogle Scholar
- Sun X, Briel M, Busse JW, You JJ, Akl EA, Mejza F, et al. Credibility of claims of subgroup effects in randomised controlled trials: systematic review. BMJ. 2012;344:e1553.View ArticlePubMedGoogle Scholar
- Berg R, Denison E. Interventions to reduce the prevalence of female genital mutilation/cutting in African countries. Campbell Systematic Reviews. 2012(9)Google Scholar
- Waddington H, Snilstveit B, Hombrados J, Vojtkova M, Phillips D, Davies P, et al. Farmer field schools for improving farming practices and farmer outcomes: A systematic review. Campbell Syst Rev. 2014;6. doi: 10.4073/csr.2014.6
- Petticrew M, Roberts H. Evidence, hierarchies, and typologies: horses for courses. J Epidemiol Commun Health. 2003;57(7):527–9.View ArticleGoogle Scholar
- Brown T, Platt S, Amos A. Equity impact of interventions and policies to reduce smoking in youth: systematic review. Tob Control. 2014;23(e2):e98–105.View ArticlePubMedGoogle Scholar
- Marmot MG, Smith GD, Stansfeld S, Patel C, North F, Head J, et al. Health inequalities among British civil servants: the Whitehall II study. Lancet. 1991;337(8754):1387–93.View ArticlePubMedGoogle Scholar
- Attridge M, Creamer J, Ramsden M, Cannings-John R, Hawthorne K. Culturally appropriate health education for people in ethnic minority groups with type 2 diabetes mellitus. Cochrane Database Syst Rev. 2014;9:CD006424.PubMedGoogle Scholar
- Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions, The Cochrane Collaboration. 2011.Google Scholar
- Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.View ArticlePubMedGoogle Scholar
- Ogilvie D, Hamilton V, Egan M, Petticrew M. Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go? J Epidemiol Commun Health. 2005;59(9):804–8.View ArticleGoogle Scholar
- Witter S, Fretheim A, Kessy F, Lindahl A. Paying for performance to improve the delivery of health interventions in low- and middle-income countries. Cochrane Database Syst Rev. 2012;2:CD007899.PubMedGoogle Scholar
- Leclercq E, Leeflang M, van-Dalen E-C. Validation of a PubMed search filter for identifying studies including children. Cochrane Colloq Abstr J. 2010:P121.Google Scholar
- Moerman CJ, Deurenberg R, Haafkens JA. Locating sex-specific evidence on clinical questions in MEDLINE: a search filter for use on OvidSP. BMC Med Res Methodol. 2009;9:25.PubMed CentralView ArticlePubMedGoogle Scholar
- Oliver S, Kavanagh J, Caird J, Lorenc T, Oliver K, Harden A. Health promotion, inequalities and young people’s health. A systematic review of research. 2008: EPPI-Centre, 2008Google Scholar
- Beauchamp A, Backholer K, Magliano D, Peeters A. The effect of obesity prevention interventions according to socioeconomic position: a systematic review. Obesity reviews: an official journal of the International Association for the Study of Obesity. 2014;15(7):541–54.View ArticleGoogle Scholar
- Harper S, King NB, Young ME. Impact of selective evidence presentation on judgments of health inequality trends: an experimental study. PLoS One. 2013;8(5):e63362.PubMed CentralView ArticlePubMedGoogle Scholar
- Harper S, King NB, Meersman SC, Reichman ME, Breen N, Lynch J. Implicit value judgments in the measurement of health inequalities. The Milbank quarterly. 2010;88(1):4–29.PubMed CentralView ArticlePubMedGoogle Scholar
- Scanlan JP. Can we actually measure health disparities? Chance. 2006;19(2):47–51.View ArticleGoogle Scholar
- Keppel K, Pamuk E, Lynch J, Carter-Pokras O, Kim I, Mays V, et al. Methodological issues in measuring health disparities. Vital Health Stat. 2005;141:1.Google Scholar
- Scanlan JP. Race and Mortality Revisited. Society. 2014;51:328.PubMed CentralView ArticlePubMedGoogle Scholar
- Werner RM, Asch DA, Polsky D. Racial profiling: the unintended consequences of coronary artery bypass graft report cards. Circulation. 2005;111(10):1257–63.View ArticlePubMedGoogle Scholar
- Mackenbach JP, Kunst AE. Measuring the magnitude of socio-economic inequalities in health: an overview of available measures illustrated with two examples from Europe. Soc Sci Med. 1997;44(6):757–71.View ArticlePubMedGoogle Scholar
- Harper S, Lynch J. Methods for Measuring Cancer Disparities: Using Data Relevant to Healthy People 2010 Cancer-Related Objectives, NCI Cancer Surveillance Monograph Series. Bethesda, MD: National Cancer Institute; 2005.Google Scholar
- Bloom H. Learning More from Social Experiments. New York: Russell Sage Foundation Publications; 2005.Google Scholar
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.View ArticlePubMedGoogle Scholar
- Burford B, Lewin S, Welch V, Rehfuess E, Waters E. Assessing the applicability of findings in systematic reviews of complex interventions can enhance the utility of reviews for decision making. J Clin Epidemiol. 2013;66(11):1251–61.View ArticlePubMedGoogle Scholar
- Bhutta ZA, Soofi S, Cousens S, Mohammad S, Memon ZA, Ali I, et al. Improvement of perinatal and newborn care in rural Pakistan through community-based strategies: a cluster-randomised effectiveness trial. Lancet. 2011;377(9763):403–12.View ArticlePubMedGoogle Scholar
- Yousafzai AK, Rasheed MA, Rizvi A, Armstrong R, Bhutta ZA. Effect of integrated responsive stimulation and nutrition interventions in the Lady Health Worker programme in Pakistan on child development, growth, and health outcomes: a cluster-randomised factorial effectiveness trial. Lancet. 2014;384(9950):1282–93.View ArticlePubMedGoogle Scholar
- Godlee F. Clinical trial data for all drugs in current use. BMJ. 2012;345:e7304.View ArticlePubMedGoogle Scholar
- Kastner M, Tricco AC, Soobiah C, Lillie E, Perrier L, Horsley T, et al. What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Med Res Methodol. 2012;12:114.PubMed CentralView ArticlePubMedGoogle Scholar
- Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: realist syntheses. BMC medicine. 2013;11:21.PubMed CentralView ArticlePubMedGoogle Scholar
- Noyes J, Popay J, Pearson A, Hannes K, Booth A. Chapter 20: Qualitative research and Cochrane reviews. In: JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. West Sussex, England: Wiley & Sons LTD; 2008.Google Scholar
- Jull J, Crispo J, Welch V, MacDonald H, Brascoupe S, Boyer Y, et al. Interventions for Indigenous Peopls making health decisions: A systematic review. Pimatisiwin. 2013;11(3):539–44.Google Scholar
- Tugwell P, Maxwell L, Welch V, Kristjansson E, Petticrew M, Wells G, et al. Is health equity considered in systematic reviews of the Cochrane Musculoskeletal Group? Arthritis Rheum. 2008;59(11):1603–10.View ArticlePubMedGoogle Scholar
- Dans AL, Dans LF, Guyatt GH. Applying results to individual patients. In: Guyatt GH, Rennie D, Meade MO, Coon JT, editors. Part B Therapy. New York: McGraw-Hill Companies; 2008. p. 273–89.Google Scholar
- Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 10: Taking equity into consideration when assessing the findings of a systematic review. Health Res Policy Syst. 2009;7 Suppl 1:S10.PubMed CentralView ArticlePubMedGoogle Scholar
- Willett WC, Green A, Stampfer MJ, Speizer FE, Colditz GA, Rosner B, et al. Relative and absolute excess risks of coronary heart disease among women who smoke cigarettes. N Engl J Med. 1987;317(21):1303–9.View ArticlePubMedGoogle Scholar
- Lagarde M, Palmer N. The impact of user fees on access to health services in low- and middle-income countries. Cochrane Database Syst Rev. 2011;4:CD009094.PubMedGoogle Scholar
- Imdad A, Herzer K, Mayo-Wilson E, Yakoob MY, Bhutta ZA. Vitamin A supplementation for preventing morbidity and mortality in children from 6 months to 5 years of age. Cochrane Database Syst Rev. 2010;12:CD008524.PubMedGoogle Scholar
- Brown T, Platt S, Amos A. Equity impact of population-level interventions and policies to reduce smoking in adults: A systematic review. Drug Alcohol Depend. 2014;138C:7–16.View ArticleGoogle Scholar
- Wilson S, Lipsey M. School-based interventions for aggressive and disruptive behavior. update of a meta-analysis. Am J Prev Med. 2007;33(2S):S130–43.PubMed CentralView ArticlePubMedGoogle Scholar
- Farrington D, Ttofi M. School-Based Programs to Reduce Bullying and Victimization. Campbell Syst Rev 2009;6. www.campbellcollaboration.org
- Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.View ArticlePubMedGoogle Scholar
- Dans AM, Dans L, Oxman AD, Robinson V, Acuin J, Tugwell P, et al. Assessing equity in clinical practice guidelines. J Clin Epidemiol. 2007;60(6):540–6.View ArticlePubMedGoogle Scholar
- Schünemann H, Oxman A, Vist G, Higgins J, Deeks J, Glasziou P, et al. 12.3 Interpreting results and drawing conclusions: Issues in applicability. In: Higgins JPT, Green S editor. Cochrane Handbook for Systematic Reviews of Interventions The Cochrane Collaboration, 2011Google Scholar
- Welch V, Brand K, Kristjansson E, Smylie J, Wells G, Tugwell P. Systematic reviews need to consider applicability to disadvantaged populations: inter-rater agreement for a health equity plausibility algorithm, BMC Med Res Methodol 2012;12:187.PubMed CentralView ArticlePubMedGoogle Scholar
- Ahmad N, Boutron I, Dechartres A, Durieux P, Ravaud P. Applicability and generalisability of the results of systematic reviews to public health practice and policy: a systematic review. Trials. 2010;11:20.PubMed CentralView ArticlePubMedGoogle Scholar
- Car J, Lang B, Colledge A, Ung C, Majeed A. Interventions for enhancing consumers’ online health literacy. Cochrane Database Syst Rev. 2011;6:CD007092.PubMedGoogle Scholar
- Burford BJ, Welch V, Waters E, Tugwell P, Moher D, O’Neill J, et al. Testing the PRISMA-Equity 2012 reporting guideline: the perspectives of systematic review authors. PLoS One. 2013;8(10):e75122.PubMed CentralView ArticlePubMedGoogle Scholar