Skip to main content

Critical considerations for the practical utility of health equity tools: a concept mapping study



Promoting health equity within health systems is a priority and challenge worldwide. Health equity tools have been identified as one strategy for integrating health equity considerations into health systems. Although there has been a proliferation of health equity tools, there has been limited attention to evaluating these tools for their practicality and thus their likelihood for uptake.


Within the context of a large program of research, the Equity Lens in Public Health (ELPH), we conducted a concept mapping study to identify key elements and themes related to public health leaders and practitioners’ views about what makes a health equity tool practical and useful. Concept mapping is a participatory mixed-method approach to generating ideas and concepts to address a common concern. Participants brainstormed responses to the prompt “To be useful, a health equity tool should…” After participants sorted responses into groups based on similarity and rated them for importance and feasibility, the statements were analyzed using multidimensional scaling, then grouped using cluster analysis. Pattern matching graphs were constructed to illustrate the relationship between the importance and feasibility of statements, and go-zone maps were created to guide subsequent action.


The process resulted in 67 unique statements that were grouped into six clusters: 1) Evaluation for Improvement; 2) User Friendliness; 3) Explicit Theoretical Background; 4) Templates and Tools 5) Equity Competencies; and 6) Nothing about Me without Me- Client Engaged. The result was a set of concepts and themes describing participants’ views of the practicality and usefulness of health equity tools.


These thematic clusters highlight the importance of user friendliness and having user guides, templates and resources to enhance use of equity tools. Furthermore, participants’ indicated that practicality was not enough for a tool to be useful. In addition to practical characteristics of the tool, a useful tool is one that encourages and supports the development of practitioner competencies to engage in equity work including critical reflections on power and institutional culture as well as strategies for the involvement of community members impacted by health inequities in program planning and delivery. The results of this study will be used to inform the development of practical criteria to assess health equity tools for application in public health.


The Ottawa Charter for Health Promotion explicitly identified equity and social justice as essential prerequisites for health, and equity in health as an important outcome of health promotion [1]. Since the Ottawa Charter, promoting health equity has been a priority for public health systems worldwide [2,3,4]. Starfield [5] described inequities in health as “systematic differences in one or more aspects of health status across socially, demographically, or geographically defined populations or subgroups” (p.546). Health inequities are unfair, avoidable, and potentially remediable; removing barriers to resources for health is essential for achieving health potential [6]. Health inequities are understood to be a consequence of unjust social structures that disadvantage some groups more than others [7].

There is support for, and agreement on, the need to improve health equity and strengthen the implementation and integration of health equity considerations in health care systems internationally [8,9,10]. Public health leaders have identified the use of health equity tools and resources as one promising strategy for doing this [11, 12]. Health equity tools have a range of purposes; they can help public health professionals assess the degree to which health equity considerations are included in policies or programs, or to measure health equity. Tools can also aid in choosing actions to address specific health inequities [13,14,15]. They can be used to: a) guide the conduct and interpretation of systematic reviews [16,17,18], b) incorporate cultural and gender considerations [19, 20], and c) conduct equity audits [21] or equity focused health impact assessments [22,23,24,25,26].

While health equity tools are meant to strengthen and integrate health equity considerations into public health policies, programs, and practices, there are challenges related to identifying, selecting, appraising and applying health equity tools [27]. Public health practitioners and decision makers struggle to apply a health equity lens in their work [28]. They identify that a lack of shared understanding of health equity and lack of guidance for applying health equity tools makes the use of tools challenging [29, 30]. Tyler et al. [28] found that when implementing an equity focused health impact assessment tool, factors at the system, organizational and operational level made using the tool a challenge. The main barriers to use of this tool include competing priorities; lack of organizational commitment, readiness and resources; and lack of shared understanding about health equity. In Canada, the National Collaborating Centre on Determinants of Health identified that the two most common challenges to health equity action were “getting support to take action on social justice issues in a health system based on biomedical principles” and “not being sure of what to do or what tools are available to help address health equity” [31].

So, despite the growing number of equity-focused resources, lenses, gauges, frameworks, and tools that span a range of purposes [27], there is little guidance in the literature to help practitioners and decision makers choose the appropriate tools, and we know little about the resources and supports that are needed to apply and use these tools. For example, conducting an equity-focused health impact assessment requires significant time and resources compared to using other tools that consist of brief checklists. To our knowledge no specific criteria have been developed for assessing health equity tools in relation to their practical utility. We sought to address this knowledge gap in this study.

As part of the ELPH program of research, we sought to identify available health equity tools and to develop theoretical and practical criteria for assessing them [32]. To date, we have developed an inventory of the health equity tools (see, and identified a range of equity theories underlying approaches to health equity action through a review of the literature [33]. The identification of equity theories will guide us in developing the theoretical criteria which will be the focus of a subsequent paper.

We define a health equity tool as a document or resource that clearly identifies improving health equity as a goal and provides a set of steps, questions, or a framework that people can follow to achieve this goal [27]. In this paper, we identify key elements and themes that public health practitioners and leaders deem important in making health equity tools both practical and useful. These findings will inform the development of a set of criteria for judging practical utility of health equity tools. Developing both the practical and theoretical criteria, constitute the next stage of our project. In the study reported in this paper, we used concept mapping [34] to explore the ideas of public health practitioners about what makes a health equity tool both practical and useful, and to determine the feasibility and importance of the ideas generated.


Concept mapping

Concept mapping is a participatory mixed method approach to research [23, 24] that enables a group to describe ideas in response to a focused question, sort the ideas, rate them on specific criteria, and subject the data to multivariate analysis. The results are transformed into maps for visual representation and interpretation [35] which can then be used to guide planning, implementation and evaluation of action. Overall, there are six phases to the method: (1) preparing (2) generating ideas through brainstorming, (3) sorting and rating the ideas, (4) processing the data to produce maps, (5) interpreting the data and maps, and (6) using the maps. We obtained ethical approval for this study from the University of Victoria, the University of British Columbia, and from each of the five health authorities in British Columbia that were partners in the ELPH project and participated in the concept mapping study.

Phase 1: Preparing

Phase 1 consists of establishing a ‘focus prompt’ and choosing participants [36]. The focus prompt is a statement or question that participants respond to in Phase 2, and these responses become the concepts for mapping. For this preparatory phase, we convened a small working group of public health practitioners and decision-makers to generate some initial ideas. We then discussed the focus prompt with the entire team at an ELPH whole team meeting. The team comprises researchers, project staff, public health decision makers and practitioners. After much deliberation with team members, to generate concepts we chose the prompt: “To be useful, a health equity tool should...”

We invited ELPH team members to participate in the concept mapping exercise and posted invitations on the websites of organizations affiliated with team members. Because concept mapping is a mixed method approach, drawing initially on qualitative data through brainstorming and sorting, the logic of qualitative sampling guided the selection of a purposive sample. The main criterion in a purposive sample is that the participant has experience with the phenomenon under study and will be a good informant [37]. Participants included public health practitioners and decision makers from the BC Ministry of Health, and five of the six health authorities: Fraser Health, Interior Health, Island Health, Provincial Health Services, and Vancouver Coastal Health, as well as other associated organizations. Within their organizations, participants were responsible for implementing an equity lens in the public health system, specifically in relation to two core public health programs: mental health promotion and preventing substance use harm. Since the aim in qualitative research is not statistical generalizability, sampling is driven by a concern with the conceptual requirements of the study.

We asked e-mail recipients to forward the invitation to anyone they thought might be interested in participating. Although it was not possible to track the number of people that received the invitation, there was no need to do so because concept mapping does not limit the number of participants. Concept mapping was initially developed for 40 people or fewer when conducted face-to-face [34] and although a larger sample size potentially adds greater clarity to the results, there is a diminishing return as the number grows [38]. Therefore, response rate is not of great concern and not all participants need to be involved in every phase of the process. We used online Concept Systems software thereby allowing greater reach in terms of participation [39] because participants are spread across the vast geographic area of British Columbia. We incorporated the consent form into the online program with participants completing the consent before responding to questions.

Phase 2: Generating ideas through brainstorming

In Phase 2, we asked participants to generate as many ideas as possible to answer the focus prompt [36]. Forty-eight anonymous respondents contributed to this brainstorming phase, which occurred online using a secure site. Throughout the phase, all ideas generated were visible to all participants to allow one person’s ideas to spark another’s. A benefit of anonymous online participation is that everyone is free to make their statement without fear of criticism or controversy [36]. Participants generated 76 statements. The fact that all ideas were visible to everyone may have contributed to participants perceiving that their ideas had already been identified by others and so limited the number of statements each person contributed.

Phase 3: Sorting and rating ideas

In Phase 3, two team members (WM & KP) clarified the statements (e.g., correcting grammar, synthesizing ideas, deleting duplicates while staying as close as possible to the participant’s original wording) resulting in a final set of 67 unique statements. Additional team members then reviewed the statements and confirmed them. Using the online concept mapping software, participants were then asked to sort the 67 statements into themes or categories based on the similarity of ideas [36]. They also rated the statements from 1 to 5 on the dimensions of importance and feasibility, with 1 representing lower importance or feasibility and 5 representing greater importance or feasibility. In total, 26 people participated in the sorting process (19 completed) and 37 participated in the rating of importance and feasibility (30 and 27 respectively completed). Participant demographics are described in Table 1 for the 30 participants who completed either the sorting or rating process.

Table 1 Demographic characteristics of participants involved in sorting and rating

Phase 4: Processing the data to produce maps

In Phase 4, we analyzed the data and produced the concept map, point-rating map, ladder graph, and Go-Zone maps. We used Concept Systems™ software [39] to generate all statistics and maps. Starting with information from the statement sorting, the program identifies two statements clustered together in the same category. On a matrix of N x N statements, the program assigns a 1 if the statements are placed together and 0 if not placed together, allowing for the total across all participants for each statement pair to have a number between one and the total number of participants [36]. The total similarity matrix is analyzed using non-metric multidimensional scaling (MDS) on two dimensions, allowing for representation on an XY axis called a point map [36]. Statements grouped together most often are closer together on the map. The program then uses the point map output in hierarchical cluster analysis that partitions the configuration into non-overlapping clusters in two-dimensional space (called a cluster map) [36]. The researchers decide on the number of initial clusters. At this stage in the analysis, the researchers must carefully consider the statements in each cluster to decide whether they are better grouped together or divided.

Starting with the 12 clusters identified in the Concept Systems output, we examined each group of statements to make sense of the grouping mindful of our participants’ original decisions to sort particular statements together. We merged clusters that contained similar sets of statements until we arrived at a final set of six clusters, and additional merging no longer made conceptual sense. For example, to reduce the clusters further from our current 6 to 5, cluster 6 statements that we have called ‘Nothing about Me without Me – Client Engaged’ would have been mixed with cluster 5 statements, called ‘Equity Competencies’. These sets of statements are very different conceptually and thus are best kept as two separate clusters. Discussions with participants in the whole team meeting confirmed their agreement that the clusters were distinct and the statements within them fit well with the overall meaning of the cluster as a whole, and thus made conceptual sense.

The software program showed the top ten cluster names assigned by the participants. In this same meeting, researchers and participants then reviewed the statements in each cluster, and selected the name for each that most closely described our shared understanding of why participants placed the responses together.

Additionally, the importance and feasibility ratings are averaged across participants for each item and for each cluster. This produces a point-rating map, which we generated for the entire set of statements and for each cluster. A ladder graph is used to compare the ratings for the importance of statements in a cluster to the ratings for the feasibility of statements in that cluster, giving a Pearson’s correlation coefficient (r) to describe the extent of the correlation [36]. A Go-Zone map uses the importance and feasibility ratings to produce a 2 × 2 table with the most important and most feasible statements or clusters in the top right hand quadrant.

Phase 5: Interpreting the data and maps

In Phase 5, researchers and participants interpret the maps. The closer that statements are located on the map, the closer they are conceptually. In other words, clusters of statements are used to structure ideas, producing what could be called a conceptual framework for the issue or problem. The Go-Zone map and ladder graph allow the relative importance and feasibility of statements and clusters to be assessed to indicate the most actionable areas on which to focus, and the areas of importance that may be more difficult to implement or of less importance.

Phase 6: Using the maps

Phase 6 is the final phase in which the maps are used for evaluation and planning; they are the result of collective thinking on a specific question. This paper represents a Phase 6 strategy for evaluation and planning.


Cluster map

Participants generated 67 unique statements in response to the focus prompt “To be useful, a health equity tool should...”, and sorted them into clusters. After the MDS and cluster analysis, we identified a final set of six clusters. The specific statements in each cluster are listed in Table 2 and the final six clusters are presented in Fig. 1. The statement numbers in Fig. 1 correspond to the statement numbers in Table 2.

Table 2 Statements by Cluster to the focus prompt “To be useful, a health equity tool should…”
Fig. 1
figure 1

Cluster Map. Map displays which statements (by number) are contained in each cluster. Statement numbers correspond to statements given in Table 2

The stress index is the statistic that is reported in MDS analysis to indicate goodness-of-fit of the two-dimensional configuration to the original similarity matrix [34]. A low stress value suggests a better fit. Trochim [35] reported an average stress value of 0.285 across 33 studies, and approximately 95% of concept mapping projects have a stress value between 0.205 and 0.365. The stress value for this study, 0.294, is well within the expected range.

Cluster 1: Evaluation for improvement

Cluster 1 consists of 12 statements with a focus on evaluation and quality improvement to ensure that the use of a tool results in action and improvement in policies and programs. There should be clear benefits of applying a health equity tool such as identifying program improvements, health equity priorities, or engaging clients in thinking about social factors that may impact health. Use of the tool should improve implementation of health equity action through clear intended outcomes such as identifying inequities or improving equity in an existing program, identification of next steps or strategies linking to action research, or providing a feedback loop to allow refinement and ongoing improvements. Health equity tools should contribute to program evaluation and evaluation should be integral to the use of the tools to facilitate improvements in implementation.

Cluster 2: User friendliness

This 16-statement cluster reflects a very practical set of responses that describe how important ease of use is for practitioners. Practitioners stressed the need for simplicity: a tool should be concise, use plain language, be easy to understand, and be quick for practitioners to use. Furthermore, a tool should be applicable to a diverse range of situations. It should apply to various levels of the organization while having a clear purpose and objective. A useful tool needs to guide the thinking process, help the user determine relevant strategies, and offer practical ways for providers to engage with people. These findings suggest that practitioners want a tool that is not only easy to understand, but also one that is applicable throughout an organization in order for it to be practical. Obviously, using one tool versus several is simpler yet it is important to remember that tools have a range of applications and purposes so practicality may have to be weighed in relation to fit and purpose.

Cluster 3: Explicit theoretical background

This seven statement cluster is smaller, reflecting a distinct view that, to be practical, a tool should make explicit fundamental principles and theoretical foundations, including definitions and explanations of health equity. Overall, the statements in this cluster reflect the importance of clear and explicit explanations of the meaning, definition, and theoretical constructs that underpin the tool.

Cluster 4: Templates and tools

The Templates and Tools cluster has 14 statements describing practical resources to help a practitioner use the tool. Participants highlighted the importance of having access to descriptions of appropriate and inappropriate applications of the tool, examples of how to use it, and resources or links for additional information and/or implementation strategies. Participants emphasized the importance of having the necessary templates and guidance documents that outline, in a stepwise fashion, how to use the tool. This could be in the form of manuals but, more importantly, participants are looking for examples and illustrations of how the tool should be or has been used. Of note, participants explicitly highlighted the importance of directions for synthesizing across the steps in a tool, outlining processes that lead to conclusions about actions to take. These cluster statements reflect that, to be useful, a tool needs to include practical “how to” information about selection and use.

Cluster 5: Equity competencies

Thirteen statements in the Equity Competencies cluster reflect the view of participants that health equity tools, to be useful, require a practitioner to have health equity competencies and that these competencies should be encouraged by and through the use of a health equity tool. These competencies include the need for practitioners to be aware of and reflexive in their practice as to: a) broader structural conditions that produce inequities and move beyond thinking from individual to social factors that impact health; b) institutional culture and take account of histories of trauma; c) the persistent stigma that exists within health systems that can impact the delivery of health care; and d) potential health literacy issues for some clients. Other important competencies include having compassion, and using harm reduction strategies to improve health. A health equity tool needs to support the development of competencies in applying a health equity lens to all public health programs, and facilitate connection to a community of practice. Overall, for health equity tools to be useful, they should incorporate and encourage the enactment of equity competencies.

Cluster 6: Nothing about me without me – Client engaged

As the smallest cluster with only five statements, this set of statements focuses on the need for health equity tools to promote inclusion of those populations impacted by health inequities such as people who use substances or those who are neglected relative to others. Tools should encourage practitioners to engage all such groups in a meaningful way so that the care delivered will be culturally appropriate and trauma-informed, as necessary.

Statements ratings and go zone map

Subsequent to generating and clustering statements, participants rated each statement on importance and feasibility. We then averaged the ratings across participants for each statement. The Go Zone map in Fig. 2 compares the mean importance and feasibility for each statement, with the numbers on the map corresponding to the statement numbers in Table 2. Statements rated high in both importance and feasibility would represent potential priority areas of action. The top four statements that are both highly important and most feasible illustrate the need for a tool to be clear, easy to understand, and well defined, with a clear intended outcome, purpose and objectives. Statements that were rated highly important but less feasible include engaging both the provider and client to think beyond the individual to the social factors that impact health, and to include the participation of those affected by health inequities.

Fig. 2
figure 2

Go Zone Map of Mean Importance and Feasibility Ratings for All Statements. Ratings range from 1 to 5, with 1 indicating a low importance or feasibility, and 5 indicating high importance or feasibility. Statement numbers correspond to statements in Table 2

Cluster ratings and ladder graph

In Table 3, we present the mean importance and feasibility for the statements in each cluster, and compare these in the ladder graph in Fig. 3. The greater the angle between the two clusters, the greater the difference on the scale. The most important and feasible clusters were User Friendliness and Templates and Tools. The strong correlation between importance and feasibility ratings (r = 0.78) indicates that there would be a good benefit in targeting the most feasible clusters as they were also rated highly important. Notably, all of the clusters were rated above 3 in both importance and feasibility indicating that there were no clusters that participants considered to be of low importance, or too difficult to address.

Table 3 Cluster mean ratings for importance and feasibility
Fig. 3
figure 3

Ladder Graph of Mean Importance and Feasibility by Cluster. Ratings range from 1 to 5 with 1 indicating low importance or feasibility and 5 indicating high importance or feasibility. Placement of cluster name on each axis indicates order of importance and feasibility. Colour of cluster name corresponds to colour of the line on graph which gives the value for importance and feasibility. Pearson’s r reports the overall correlation between importance and feasibility ratings


Health equity tools have been identified as one strategy to increase health equity considerations in public health programs and the health sector more broadly. Despite a proliferation of health equity tools, there has been limited critical analysis of these tools, or assessment of their practical utility. Here we used concept mapping to understand what public health practitioners see as important characteristics of a useful health equity tool. This resulted in the construction of six clusters for consideration when developing, selecting and using health equity tools. Ratings of the importance and feasibility of the characteristics in these clusters showed that participants considered all clusters to be important and comparatively feasible to implement, and that targeting the most feasible of the clusters would be strategic because they were also rated as highly important.

A key aspect of these findings is the importance of having tools that have clear and actionable objectives and cycles for evaluation, explicit theoretical foundations, are user friendly, and have supporting guidance documents available (Clusters 1–4). Although some of the statements in these clusters are specific to health equity, these higher level themes demonstrate understanding of what is needed for successful development and delivery of programs in general. Some of these findings are similar to those of Guichard, et al. [40], who used concept mapping to prioritize and identify important conditions for implementing a specific health equity tool (GAALISS tool) in public health practice. These conditions included specifying necessary characteristics of the tool being implemented such as: the tool should be short, have simple terminology, be accompanied by examples, and have a user guide. Their work, and that of Tyler et al. [28], highlighted the importance of leadership, organizational priorities and readiness, and intersectoral partnerships as important conditions for implementing both the GAALISS and Health Equity Impact Assessment (HEIA) health equity tools. That these conditions did not emerge in our work is likely a result of our focus prompt. Participants may have assumed that conditions were already in place, with our participants focusing on the process of implementing a tool as part of their practice and within their sphere of influence. As well, in our work, we identified the importance of having tools that have explicit and coherent theoretical foundations.

Our findings do speak to the value of community engagement and empowerment, as well as the importance of reflexivity and specific knowledge of the root determinants of health inequities in the process of implementing health equity tools (Cluster 5). Others, examining the use of knowledge to action frameworks as important strategies for improving action on health equity [41, 42], have highlighted similar findings. Masuda et al. [43] specifically stress the importance of critical inquiry and reflexive practice as part of the third wave of knowledge translation in terms of moving from ‘what we know’ to ‘how we know’, and recognizing the underlying power relations that shape knowledge in order to promote a more fair and just world within our spheres of influence. McCalman et al. [44] reviewed Indigenous health promotion tools, and these authors also emphasize the importance of cultural competency, community engagement and empowerment, and capacity development as well as partnerships, holism, best practice, and sustainability as key elements.

Our participants identified that to be useful equity tools should encourage the development and use of equity competencies as important to practicality. Some might argue that these elements go beyond the characteristics of the tool itself. It is important to remember, however, that our focus prompt did not ask specifically for characteristics of tools. Rather, it asked “To be useful, a health equity tool should……”. This prompt essentially asked participants about what a health equity tool should be or do in order to be useful. In the view of our participants, a useful tool is not just one that is easy to use, or has a clear purpose or objectives. It is one that encourages practitioners to think in a particular way, and to have a way of being that reflects the values and principles of health equity.

In relation to Cluster 5 (equity competencies), participants specifically highlighted the importance of being aware of stigma and the importance of harm reduction as key elements that make a health equity tool useful. This is not surprising given that 2/3 of participants reported working in public health programs related to mental health promotion and preventing the harms of substance use. Harm reduction is an evidence based non-judgmental approach that focuses on preventing harms of substance use while emphasizing respect, dignity, compassion and meaningful inclusion without expecting cessation of use [45]. Such an approach is clearly consistent with principles of health equity in relation to substance use programs [46].

Cluster 6, which focuses on client engagement in the use and application of health equity tools, highlights key social justice perspectives [47] that call for meaningful involvement and participation of those affected by health inequities in the application and use of health equity tools. Community participation is a central plank in health promotion [1]. In fact, the very naming of that cluster, Nothing about Me without Me- Client Engaged, reflects a popular and well known saying, both in Canada and elsewhere, that builds on original work in disability studies involving people with lived experience in issues that impact their lives [48].

As such, Clusters 5 and 6 specifically highlight public health commitments to social justice, and speak to the importance of developing critical consciousness in relation to structural and systemic injustices that have produced health inequities for those facing structural disadvantages due to gender, ethnicity, sexual orientation, class, ability and how they are positioned within current systems of care [49, 50]. It seems reasonable to us that our participants identified these aspects of public health and social justice as key elements in determining the usefulness and practicality of health equity tools. These are the very foundations of public health [51, 52]. If a tool does not support practitioners to work in practical and meaningful ways with people impacted by health inequities, then practitioners did not view it as useful to their practice. Although these clusters reflect a unique perspective of practitioners focused on health equity work in the area of mental health promotion and preventing harms of substance use, we would argue that these clusters may be applicable to judgements about the usefulness of health equity tools in other areas of public health practice. Specifically, we highlight important practitioner insights about the need for tools that encourage individual reflexivity on power and position and recognition of how stigma embedded in institutional cultures can obscure the structural and social conditions that impact health. We note that the overall sample contained participants in a wide range of roles from each health authority, all with varying levels of responsibility and education. Thus these viewpoints are from people with experience at different levels of authority and from program areas of the organization.

Strategic direction and action planning can occur with the use of Go-Zone maps and ladder graphs [34]. The clusters entitled ‘User Friendliness’ and ‘Templates and Tools’ indicate that having a clear and well defined tool is both highly important and feasible. For designers of tools, ensuring that a tool is clear and concise, with sufficient examples and information to aid in the selection and use of the tool are comparatively simple areas to target that are highly important in ensuring a tool’s utility. We would add that making a tool clear and concise does not necessarily mean that it reflects a sound theoretical understanding of health equity. Given previous research on the lack of shared understanding of health equity among public health leaders and practitioners, and the difficulties in applying a health equity lens to take action on promoting health equity [28,29,30], it seems insufficient and restrictive to focus only on the form of the tool, such as making it simple, concise and easy to use.

Statements and clusters ranked as important but less feasible offer areas for reflection and deliberation on ways that guidance in these clusters could be achieved. Participants noted that to be useful, application of health equity tools should be complemented by the development of practitioner competencies related to health equity. These competencies include taking a reflexive position and possessing a compassionate understanding of the broader structural injustices that produce health inequities, and being able to raise practitioner consciousness about the roots of health inequities. Participants also noted the importance of tools that promote inclusion and meaningful involvement of clients to address health inequities. Although these areas may be more difficult to address, these clusters draw attention to important elements of a health equity tool that need to be considered beyond the form of the tool itself in order to make it truly useful and avoid unintentionally perpetuating health inequities and/or harms. A strength of this study is that it directly involved public health leaders and practitioners in considering an issue that is relevant in their work. The fact that all of the clusters had comparatively high importance and feasibility indicates the careful consideration that went into the generation of all the responses as to what makes a useful health equity tool, and that all clusters need to be considered in the development of practical criteria.


Our public health partners identified challenges in identifying and applying a health equity lens and tools, and were lacking guidance on how to work effectively toward reducing health equities. Thus participants were well situated to provide insight into what would make a useful health equity tool from their experience with searching for, selecting, and using such tools. Overall, few studies have addressed the theoretical or practical aspects of selecting and implementing health equity tools as an intervention to promote action on health equity. In this paper, we have identified and described clusters of thematic elements that can inform the development of practical criteria for constructing, selecting and using health equity tools. The findings of this study provide the basis for these yet-to-be developed criteria. In addition to the obvious characteristics of health equity tools that reflect practicality such as being useful in evaluating and informing improvements, being user friendly and including tools and templates to support use, our participants also identified unique aspects of usefulness. That is, to be useful, health equity tools need to have explicit theoretical foundations, promote health equity competencies that are rooted in critical conceptions of social justice and ensure that practitioners engage and participate directly with community members who are experiencing health inequities. These aspects of usefulness have important implications for public health systems in supporting health equity action in organization.



Equity Lens in Public Health


Health equity assessment tool


Health Equity Impact Assessment


Multidimensional scaling


  1. World Health Organization. The Ottawa charter for health promotion. Ottawa: Canadian Public Health Association and World Health Organization; 1986.

    Google Scholar 

  2. Baum F, Sanders D. Ottawa 25 years on: a more radical agenda for health equity is still required. Health Promot Int. 2011;26(suppl 2):ii253–7.

    Article  PubMed  Google Scholar 

  3. Commission on the Social Determinants of Health. Closing the gap in a generation: achieving health equity through action on the social determinants of health. Geneva: World Health Organization; 2008.

    Google Scholar 

  4. Williams JS, Walker RJ, Egede LE. Achieving equity in an evolving healthcare system: opportunities and challenges. Am J Med Sci. 2016;351(1):33–43.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Starfield B. Improving equity in health: a research agenda. Int J Health Serv. 2001;31(3):545.

    Article  CAS  PubMed  Google Scholar 

  6. Whitehead MM, Dahlgren G. Levelling up (part 1): a discussion paper on concepts and principles for tackling social inequities in health, in studies on social and economic determinants of population health. Copenhagen: World Health Organization; 2006.

    Google Scholar 

  7. Braveman P, Gruskin S. Defining equity in health. J Epidemology Community Health. 2003;57:254–8.

    Article  CAS  Google Scholar 

  8. Marmot M, et al. Closing the gap in a generation: health equity through action on the social determinants of health. Lancet. 2008;372(9650):1661–9.

    Article  PubMed  Google Scholar 

  9. Baum FE, et al. Changes not for the fainthearted: reorienting health care systems toward health equity through action on the social determinants of health. Am J Public Health. 2009;99(11):1967-74.

  10. Health Canada. Chief Public Health Officer’s Report: The state of public health in Canada. Ottawa: Health Canada; 2008. Available from:

  11. Haber, R. Community planning with a health equity lens: Promising directions and strategies. 2011 August 2011; 1–13]. Available from:

  12. Sudbury & District Health Unit, 10 promising practices to reduce social inequalities in health: what does the evidence tell us? Sudbury: Sudbury & District Health Unit; 2012.

  13. Global Equity Gauge Alliance, The equity gauge: concepts, principles and guidelines. 2003: Duran, South Africa.

  14. Scott V, et al. Research to action to address inequities: the experience of the cape town equity gauge. Int J Health Equity. 2008;7(1):6.

    Article  Google Scholar 

  15. Vega J, et al. Disentangling the Pathways to Health Inequities: The Chilean Health Equity Gauge. Santiago: Pontificia Universidad Católica de Chile; 2002. Available from:

  16. Main C, et al. Population tobacco control interventions and their effects on social inequalities in smoking: placing an equity lens on existing systematic reviews. BMC Public Health. 2008;8(17):230–327.

    Google Scholar 

  17. Oxman A, et al. SUPPORT tools for evidence-informed health policymaking (STP) 10: taking equity into consideration when assessing the findings of a systematic review. Health Res Policy Syst. 2009;7(Supp 1):S10.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Tugwell P, et al. Reduction of inequalities in health: assessing evidence-based tools. Int J Equity Health. 2006;5(1):11.

  19. Signal, L., et al., The health equity assessment tool: a user’s guide. 2008: Wellington, New Zealand.

  20. Wolski E. Culturally Relevant Gender Based Analysis: A tool to promote equity. Native Women’s Association of Canada. Fall/Winter 2008/2009. Network. p. 26–27. 2009, Canadian Women’s Health Network. Available from:

  21. Aspray T, et al. Rapid assessment methods used for health-equity audit: diabetes mellitus among frail British care-home residents. Public Health. 2006;120(11):1042–51.

    Article  PubMed  Google Scholar 

  22. Haber, R., Health Equity Impact Assessment, A Primer. 2010, Wellesley Institute.

  23. Harris-Roxas B, et al. A rapid equity focused health impact assessment of a policy implementation plan: an Australian case study and impact evaluation. Int J Equity Health. 2011;10(1):6.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Harris-Roxas B, Simpson S, Harris E. Equity-focused health impact assessment: a literature review. Sydney: CHETRE on behalf of the Australasian Collaboration for Health Equity Impact Assessment (ACHEIA); 2004. Available from:

  25. Mahoney M, et al. Equity-focused health impact assessment framework. Burwood: the Australasian Collaboration for Health Equity Impact Assessment (ACHEIA); 2004. Available from:

  26. Simpson S, et al. Equity-focused health impact assessment: a tool to assist policy makers in addressing health inequalities. Environ Impact Assess Rev. 2005;25(7–8):772–82.

    Article  Google Scholar 

  27. Pauly B, et. Health Equity Tools 2.0. 2016. Victoria, BC, Canada: University of Victoria; 2016. Available from:

  28. Tyler I, et al. Health equity assessment: facilitators and barriers to application of health equity tools. Toronto, ON: Ontario Agency for Health Protection and Promotion (Public Health Ontario); 2014.

    Google Scholar 

  29. Pauly BM, et al. Health equity talk: understandings of health equity among health leaders. AIMS Public Health. 2017;4(5):490–512.

    Article  Google Scholar 

  30. MacDonald, M., et al., Evolving understandings of health equity and health equity action in British Columbia, Canada, in 22nd IUHPE World Conference on Health Promotion. 2016: Curitiba Brazil.

  31. Oickle, D. Do tools catalyze action on health equity? 2017; Available from:

    Google Scholar 

  32. Pauly BM, et al. Reducing health inequities: the contribution of core public health services in BC. BMC Public Health. 2013;13(1):550.

    Article  PubMed  Google Scholar 

  33. MacDonald M, et al. Toward a Health Equity Lens: From the Theoretical to the Practical, in CPHA 2017: Annual Conference of the Canadian Public Health Association. Halifax: Canadian Public Health Association; 2017.

  34. Kane M, Trochim WM. Concept mapping for planning and evaluation. Thousand Oaks: Sage Publications; 2007.

    Book  Google Scholar 

  35. Trochim WM, et al. Practical challenges of systems thinking and modeling in public health. Am J Public Health. 2006;96:538–46.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Trochim WM. An introduction to concept mapping for planning and evaluation. Eval Program Plann. 1989;12:1–16.

    Article  Google Scholar 

  37. Polit D, Beck C. Nursing research: generating and assessing evidence for nursing practice. 10th ed. Philadelphia: Wolters Kluwer Health; 2017.

    Google Scholar 

  38. Trochim WM. The Reliability of Concept Mapping, in the Conference of the American Evaluation Association. Dallas: American Evaluation Association; 1993.

  39. Concept Systems Inc. Software. Available from:

  40. Guichard A, et al. Use of concurrent mixed methods combining concept mapping and focus groups to adapt a health equity tool in Canada. Eval Program Plann. 2017;61:169–77.

    Article  PubMed  Google Scholar 

  41. Davison CM, Ndumbe-Eyoh S, Clement C. Critical examination of knowledge to action models and implications for promoting health equity. Int J Equity Health. 2015;14(1):49.

    Article  PubMed  PubMed Central  Google Scholar 

  42. vMasuda JR, et al. Equity-focused knowledge translation: a framework for "reasonable action" on health inequities. Int J Public Health. 2014;59(3):457–64.

  43. Masuda JR, et al. Environmental health and vulnerable populations in Canada: mapping an integrated equity-focused research agenda. Can Geographer/Le Géographe canadien. 2008;52(4):427–50.

    Article  Google Scholar 

  44. McCalman J, et al. The characteristics, implementation and effects of Aboriginal and Torres Strait Islander health promotion tools: a systematic literature search. BMC Public Health. 2014;14(1):712-23.

  45. International Harm Reduction Association. What is harm reduction? 2015; Available from:

    Google Scholar 

  46. Pauly BM. Harm reduction through a social justice lens. Int J Drug Policy. 2008;19(1):4–10.

    Article  PubMed  Google Scholar 

  47. Young IM. Justice and the politics of difference. Princeton, N.J: Princeton University Press; 1990.

    Google Scholar 

  48. Canadian HIV/AIDS Legal Network, et al. Nothing about us without us- A manifesto by people who use illegal drugs. Toronto: AIDSLAW; 2008. Available from:

  49. Graham H. Social determinants and their unequal distribution: clarifying policy understandings. Milbank Q. 2004;82(1):101–24.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Sadana R, Blas E. What can public health programs do to improve health equity? Public Health Rep. 2013;128(Supp 3):12–20.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Beauchamp DE. Public health as social justice. Inquiry. 1976;XIII:3–12.

    Google Scholar 

  52. Powers M, Faden R. Social justice: the moral foundations of public health and health policy. USA: Oxford University Press; 2006.

    Google Scholar 

Download references


As a participatory research project, participants contributed to the analysis and interpretation of the data. Heather Strosher and Diane Bomans contributed to preparing the final manuscript by formatting and providing edits and feedback. During the time this research was conducted, Marjorie MacDonald was supported by a Canadian Institutes of Health Research Applied Public Health Chair award (FRN# 92365).


The ELPH project is funded by the Canadian Institutes of Health Research (CIHR) Operating Grant: Programmatic Grants to Tackle Health and Health Equity, through the CIHR Institutes of Aboriginal Health and Institutes of Population and Public Health (FRN 116688) and the Public Health Agency of Canada. The departments responsible for funding were not involved in the design of the study or collection, analysis, or interpretation of data, or in writing the manuscript. AK is employed with the Public Health Agency of Canada within the Centre for Chronic Disease Prevention and Health Equity and contributed to the collection, analysis and interpretation of the data but was not involved in the funding process.

Availability of data and materials

Ethical approval and consent for this study were obtained as part of a larger program of research (Equity Lens in Public Health) for which there are restrictions for accessing data to protect confidentiality. The data used for this analysis are included here.

Author information

Authors and Affiliations



BP, WM, AK, TP, ST, TH, and MM designed the study. All authors were involved in the collection, analysis or interpretation of data. BP, WM, TvR, and MM drafted the manuscript and all authors provided feedback on the manuscript and approved the final manuscript.

Corresponding author

Correspondence to Bernadette Pauly.

Ethics declarations

Ethics approval and consent to participate

We obtained ethical approval for this study from the University of Victoria, the University of British Columbia, and from each of the five regional health authorities in British Columbia that were partners in the ELPH project: UVic/Vancouver Health Authority file J2011–102, UB/Vancouver Coastal Health Authority file H11–03359, Fraser Health Authority file FHREB2012–003, Interior Health Authority file 2011–12-044-E, and Northern Health Authority file RRC-2012-0006. We obtained consent from all participants prior to participating in the study.

Competing interests

AK is employed with the Public Health Agency of Canada within the Centre for Chronic Disease Prevention and Health Equity. The Public Health Agency of Canada was one funder of this study, however, AK is not involved in funding decisions which are conducted in a different branch of this agency. All other authors declare no competing interest.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pauly, B., Martin, W., Perkin, K. et al. Critical considerations for the practical utility of health equity tools: a concept mapping study. Int J Equity Health 17, 48 (2018).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: