Using relative and absolute measures for monitoring health inequalities: experiences from cross-national analyses on maternal and child health
© Houweling et al; licensee BioMed Central Ltd. 2007
Received: 03 August 2006
Accepted: 29 October 2007
Published: 29 October 2007
As reducing socio-economic inequalities in health is an important public health objective, monitoring of these inequalities is an important public health task. The specific inequality measure used can influence the conclusions drawn, and there is no consensus on which measure is most meaningful. The key issue raising most debate is whether to use relative or absolute inequality measures. Our paper aims to inform this debate and develop recommendations for monitoring health inequalities on the basis of empirical analyses for a broad range of developing countries.
Wealth-group specific data on under-5 mortality, immunisation coverage, antenatal and delivery care for 43 countries were obtained from the Demographic and Health Surveys. These data were used to describe the association between the overall level of these outcomes on the one hand, and relative and absolute poor-rich inequalities in these outcomes on the other.
We demonstrate that the values that the absolute and relative inequality measures can take are bound by mathematical ceilings. Yet, even where these ceilings do not play a role, the magnitude of inequality is correlated with the overall level of the outcome. The observed tendencies are, however, not necessities. There are countries with low mortality levels and low relative inequalities. Also absolute inequalities showed variation at most overall levels.
Our study shows that both absolute and relative inequality measures can be meaningful for monitoring inequalities, provided that the overall level of the outcome is taken into account. Suggestions are given on how to do this. In addition, our paper presents data that can be used for benchmarking of inequalities in the field of maternal and child health in low and middle-income countries.
Reducing health inequalities between social groups within countries is an important public health objective. Monitoring of such health inequalities, therefore, is an important public health task. Comparisons are an integral part of monitoring. The aims of such comparisons are to assess whether health inequalities are smaller or larger compared to other countries , whether inequalities have increased over time , or whether inequalities develop in the direction of predefined goals . Such monitoring is important, both for high-income countries, and for low and middle-income countries.
There is much debate about the inequality measure to be used for monitoring. There is consensus on the importance of the choice of the measure, since this may influence the conclusions drawn [4–7]. However, there is less consensus on which measure is most meaningful. The key issue that has raised most recent debate is whether to use relative or absolute measures of inequality [5–7]. According to some authors, extreme caution is needed when using relative measures to monitor inequalities. Increasing relative inequalities, it is suggested, are 'nearly inevitable' when the overall level of the outcome (e.g. mortality) falls. Similarly, ratios in the reverse outcome (e.g. survival), would almost necessarily decrease. This would lead to "diametrically opposed interpretations" of patterns of inequality . This latter problem is obviously avoided when using absolute measures of inequality, such as the rate difference . Others, however, warn that using absolute inequality measures "almost inevitably" leads to smaller inequalities when overall levels fall, and that therefore ratio-based measures are more meaningful for monitoring purposes .
Our paper aims to inform this debate and develop recommendations for monitoring health inequalities on the basis of empirical analyses of health-related inequalities in a broad range of developing countries. We examine to what extent relative and absolute inequalities on the one hand, and overall levels on the other, are indeed empirically related as suggested by the above mentioned authors. We also assess to what extent any observed associations can be explained by mathematically-defined ceilings to relative and absolute inequality measures.
We examine the above issues by means of a cross-national analysis of 43 low and middle-income countries for one health outcome (under-5 mortality) and three indicators of health care use (full childhood immunization, skilled antenatal care, skilled delivery assistance), using the Demographic and Health Surveys (DHS) dataset. The DHS is the largest survey program in low and middle-income countries with standardized questionnaires containing information on socio-economic characteristics, mortality, and health care use. A cross-sectional analysis of low and middle-income countries is particularly suitable for answering the above questions because of the wide range of overall levels of health-related outcomes across these countries.
Data on poor-rich differences in under-5 mortality, full childhood immunization coverage, skilled delivery attendance and antenatal care for 43 low and middle-income countries were obtained from World Bank Country Reports . The Country Reports are based on DHS data . These are nationally representative surveys, for which usually between 5000–10000 women aged 15 – 49 years were interviewed. The data and indicators used have been described elsewhere in more detail . We included those countries for which Country Reports were available at time of analysis.
Household wealth was the socio-economic characteristic used in this study. Wealth has been shown to be an important determinant of mortality and health care use. It is extensively used in the field of health inequalities research, especially in studies on low and middle-income countries. Wealth was measured using an index based on household ownership of assets. The assets were combined into a wealth index using Principal Components derived weights [9, 11]. Despite its limitations , this index is fairly widely used as measure of economic status in developing countries [11, 13]. The total population in each of the countries was categorized accordingly into five, equally large, wealth layers.
First, scatter plots were used to assess the relationship between the overall level of the health-related outcomes and the magnitude of absolute and relative inequalities in these outcomes. The simplest inequality measures were used, i.e. the rate difference (RD) and the rate ratio (RR) between the poorest 40% and richest 40% population group. We calculated the R-square of the best fitting curve through the scatter plots.
Then, we examined to what extent the empirical patterns of the RR and RD could be clarified by mathematically-defined ceilings to the RR and RD. We calculated these ceilings using a hypothetical population of which 50% is poor and 50% is rich. For example, if overall immunisation coverage is 100%, the RR cannot exceed 1, and the RD cannot exceed 0. If overall immunisation coverage is 90%, the maximum value of the RR is 1.25 (i.e. 100% coverage among the rich and 80% among the poor) and is 20 for the RD. For outcomes that never reach 100%, like under-5 mortality, we made an adjustment to calculate realistic ceilings. We assumed a minimum under-5 mortality of 5 per 1000 live births and a maximum of 400/1000.
The ranking of countries was for some outcomes, i.e. skilled delivery attendance and under-5 mortality, highly sensitive to whether the RR or the RD was used (rank-correlation coefficient r = 0.32 and r = 0.39 respectively). For other outcomes, however, the ranking was more robust (immunization coverage: r = 0.85, and antenatal care: r = 0.97).
The empirically observed low RRs at high overall levels are therefore not surprising. Low RRs at high (>60–70%) overall rates are a necessity, not an accomplishment. Therefore, one cannot conclude, for example, that Niger, with a RR of 1.3 is doing comparatively well in terms of relative mortality inequalities, even though in many other countries, RRs are higher. The reason is that, with an average under-5 mortality level of 303/1,000, the RR in Niger cannot be very high. The same is true for low RDs at very high and very low overall rates. Bangladesh, with an overall professional delivery attendance level of only 8%, for example, exhibits a necessarily low RD in such care.
The observed general patterns in which the RR and RD are associated with the overall level of the outcome cannot be fully clarified by the mathematical ceilings. These ceilings only play a role at high overall rates (for RR) or very high and low overall rates (RD).
Our paper shows that the magnitude of both relative and absolute socio-economic inequalities in health-related outcomes is empirically related to the overall level of these outcomes. Relative inequalities, using the Rate Ratio as measure, tend to be larger at lower overall levels (e.g. of mortality). Absolute inequalities, using the Rate Difference as measure, tend to be low at both very low and very high overall levels. Our paper demonstrates that the magnitude of the RR and the RD is bound by mathematical ceilings. These ceilings partly explain the empirical patterns described above. Low RRs at very high overall levels, for instance, are a necessity, not an accomplishment. They reflect the fact that rates in all wealth layers need to be very high in order to uphold a very high overall level. Yet, even where mathematically-defined ceilings do not play a role, the magnitude of absolute and relative inequalities is correlated with the overall level.
Rising RRs with declining overall levels are, however, not a necessity. There are countries with low mortality rates and low RRs. In Uzbekistan and Kazakhstan, for example, the RR in under-5 mortality is low (RR = 1.15 and 1.01 respectively), despite the comparatively low overall under-5 mortality levels in these countries (55/1,000 and 48/1,000 respectively). Similarly, the RD showed variation around the trend-line at most overall levels. Moreover, the exact empirical patterns varied between the specific health-related outcomes, showing that the relationship between relative and absolute inequalities on the one hand, and overall levels on the other, is not as rigid as sometimes suggested.
Evaluation of methodology
Our results are based on DHS data, which uses standardized core questionnaires that generally allow for comparisons across countries. Although there is some uncertainty around the precise estimates for individual countries, it seems unlikely that this explains the systematic patterns observed. As DHS comprises a broad set of countries (representing various regions, and political, economic and cultural contexts), we expect that the patterns described are not dependent on the selection of countries for which DHS data are available. Also, we examined a broad set of outcomes. We expect an approximately similar range of patterns for other outcomes that are associated with socio-economic status.
A wealth index, based on household ownership of assets, was the socio-economic characteristic used in this study. When using maternal education, we found similar patterns (results available upon request).
Our empirical findings are based on a cross-sectional cross-national analysis, and are therefore directly relevant for international comparative studies. Patterns across countries in one period of time can, however, not necessarily be interpreted as also reflecting changes over time within countries. There are, however, indications that the observed tendencies of the RR and RD are also seen over time. In Western Europe, declines in total mortality among adults between the 1980s and 1990s were accompanied by increasing relative inequalities in mortality between socio-economic groups [2, 14, 15]. In developing countries, there is evidence that the decline in childhood mortality between the 1970s and the 1990s was accompanied by declining absolute socio-economic mortality inequalities, and stable or widening relative inequalities [16, 17].
Our findings are important, not only for international comparisons of low and middle-income countries, but for all studies in which (health-related) inequalities are compared between populations. When comparing mortality inequalities between European countries , for example, or when monitoring time-trends in inequality , differences in overall mortality levels need to be taken into account. Also when comparing health inequalities between age groups it is important to take into account the fact that overall mortality rises with age. Indeed, relative inequalities tend to decline with age, while absolute differences increase dramatically [19–21].
We used the most simple measures of relative and absolute inequality (the Rate Ratio and the Rate Difference) to illustrate the general tendencies and mathematical ceilings. Our findings can most likely be generalised to more sophisticated measures of relative and absolute inequality, such as the Relative Index of Inequality , the Slope Index of Inequality (SII) , and the Generalized Concentration Index . The mathematical ceilings to the Concentration Index have been described elsewhere . In a previous study we have reported a similar relationship between the SII and the overall level to the one reported here for the RD .
Explaining the patterns
As mentioned above, the observed general patterns in which the RR and RD are associated with the overall level of the outcome cannot be fully clarified by the mathematical ceilings. Further interpretation and appraisal of the observed patterns can be enhanced by placing them in an explanatory framework. An example of such a framework is the diffusion of innovations theory . According to this theory, innovations tend to reach the better-off first before trickling down to the lower classes. This would lead to high relative inequalities at the early phase of the diffusion process, and to a decline later onwards . Differential diffusion of innovations has been observed for a number of phenomena, such as the smoking epidemic in developed countries and the obesity epidemic [25, 26]. Indeed, the observed pattern of high relative inequalities at low levels of health care use and the low inequalities at high levels of health care use is conform expectations based on the diffusion of innovations theory.
Implications for monitoring health inequalities
Our study shows that not only the RR , and not only the RD , but both are associated with the overall level of the outcome. Preference for either measure can therefore not be based on (supposed lack of) these general tendencies.
At the same time these tendencies are not necessities. Scanlan argues that increasing RRs are nearly inevitable as mortality rates decline . Positive examples, however, demonstrate that keeping relative inequalities low when mortality levels decline, is attainable. This is important, both for policy makers and researchers, especially those who assume that rising inequalities with declining mortality levels are inevitable. Also the RD varies around the trend-line at most overall levels. This implies that both the RR and the RD are not entirely determined by overall levels and that both can be meaningful measures for monitoring inequality.
Conversely, small RRs at high overall levels are almost inevitable, as are low RDs at very low and very high overall rates. Ultimately, very low mortality levels are only attainable when absolute mortality inequalities are low. This should be taken into account when monitoring inequalities. The RR and the RD are therefore only useful for monitoring when the relationship of these measures with the overall level of the outcome is taken into account. Also when setting targets for reducing health inequalities, e.g. a 25% reduction in health inequalities in Europe , it is important to take into account the context in terms of overall rates, and to carefully consider the measure used for monitoring progress.
Whereas there are no standard recipes, we will give some suggestions on how the overall level of the outcome can be taken into account when monitoring inequalities.
When populations with similar overall levels of the outcome are compared, the RR and RD are both meaningful measures for monitoring. Malawi and Peru, for example, exhibit a similar overall level of professional delivery attendance (ca. 55%). Yet, Malawi is doing substantially better in terms of equity in the provision of such care (RD = 23) than Peru (RD = 60). When using the RR, one should, however, be aware that its magnitude can be highly sensitive to whether the outcome is defined positively or negatively, as we demonstrated for skilled delivery attendance. For certain outcomes (e.g. mortality), a negative definition is conventionally used, whereas for others (e.g. immunisation) a positive definition is more common. We warn against uncritical use of common but arbitrary definitions of health-related outcomes in either positive or negative terms. Each definition describes another aspect of the empirical reality, and it can be meaningful to describe inequalities according to both.
When populations with different overall levels are compared, one can assess whether the population with smallest inequalities theoretically could, given its corresponding mathematically-defined ceiling, have reached the higher inequality observed in the population with which it is compared. If the magnitude of inequality of one of the populations seems to be restricted by the mathematically-defined ceilings, such direct comparisons may not be very meaningful. For example, whereas the RD in professional delivery care in Bangladesh (RD = 17) is lower than in India (RD = 48), a direct comparison between the two on basis of the RD may not be very meaningful as absolute inequalities in Bangladesh are necessarily low given its overall level of delivery care (8% vs. 34% in India).
A solution to both of the above issues would be to use Odds Ratio-based measures of inequality. These measures are not bound by mathematically-defined ceilings, and they are insensitive to whether the outcome is defined positively or negatively. While these are obvious advantages of the Odds Ratio, it has the disadvantage that it is hard to interpret by non-researchers , who may tend to misinterpret this measure as a RR . Moreover, while the insensitivity of the OR to positive or negative health outcomes makes it immune to arbitrary decisions on outcome measures, it does not stimulate the researcher to be explicit in choosing for either a positive or a negative outcome indicator. An explicit choice is valuable in cases where positive and negative indicators, such the immunisation rate versus the non-immunisation rate have different policy implications.
International patterns, as presented in this paper, can also be used for monitoring. A country's performance in terms of health inequality can be assessed with reference to other countries with similar overall levels of the outcome. The trend-line, representing the average performance of countries at a given overall level, can be used as benchmark. For example, Malawi, with an overall level of professional delivery attendance of 55% and an RD of 23, is doing well compared to the trend-line presented in Figure 2c. Alternatively, the best possible attainment at a given overall level, or a predefined target may be used as reference. Finally, expectations based on the diffusion of innovations theory, can be used as framework for evaluating observed inequalities.
It can be useful to assess group-specific rates in addition to summary measures of inequality, for example when monitoring differential diffusion of innovations through a population. Again, it is important to take the overall level of the outcome into account. If not, group specific rates may become an indicator of the overall performance of a country, rather than being an indicator of its distribution. Group-specific rates can be benchmarked similarly as described above, using international comparisons.
Summarizing, both absolute and relative inequality measures can be meaningful for monitoring socio-economic health inequalities, provided that differences or changes in the overall level of the outcome are carefully taken into account. Our paper gives advice on how to take this overall level into account when monitoring these inequalities and presents data that can be used for benchmarking of low- and middle-income countries in the field of maternal and child health.
We thank Ewout Steyerberg for his comments on an earlier draft of this paper, and Caspar Looman for his statistical advice.
- Mackenbach JP, Kunst AE, Cavelaars AE, Groenhof F, Geurts JJ: Socioeconomic inequalities in morbidity and mortality in western Europe. The EU Working Group on Socioeconomic Inequalities in Health. Lancet. 1997, 349 (9066): 1655-9. 10.1016/S0140-6736(96)07226-1.View ArticlePubMedGoogle Scholar
- Mackenbach JP, Bos V, Andersen O, Cardano M, Costa G, Harding S, Reid A, Hemstrom O, Valkonen T, Kunst AE: Widening socioeconomic inequalities in mortality in six Western European countries. Int J Epidemiol. 2003, 32 (5): 830-837. 10.1093/ije/dyg209.View ArticlePubMedGoogle Scholar
- World Health Organization: Health21: The health for all policy framework for the WHO European Region. European Health for All Series; No 6. 1999, Copenhagen: WHO Regional Office for EuropeGoogle Scholar
- Mackenbach JP, Kunst AE: Measuring the magnitude of socio-economic inequalities in health: an overview of available measures illustrated with two examples from Europe. Soc Sci Med. 1997, 44 (6): 757-71. 10.1016/S0277-9536(96)00073-1.View ArticlePubMedGoogle Scholar
- Clarke PM, Gerdtham UG, Johannesson M, Bingefors K, Smith L: On the measurement of relative and absolute income-related health inequality. Soc Sci Med. 2002, 55 (11): 1923-8. 10.1016/S0277-9536(01)00321-5.View ArticlePubMedGoogle Scholar
- Boström G, Rosén M: Measuring social inequalities in health – politics or science?. Scand J Public Health. 2003, 31 (3): 211-5. 10.1080/14034940210164911.View ArticlePubMedGoogle Scholar
- Scanlan JP: Race and Mortality. Society. 2000, January/February:Google Scholar
- Victora CG, Vaughan JP, Barros FC, Silva AC, Tomasi E: Explaining trends in inequities: evidence from Brazilian child health studies. Lancet. 2000, 356 (9235): 1093-8. 10.1016/S0140-6736(00)02741-0.View ArticlePubMedGoogle Scholar
- Gwatkin DR, Rutstein S, Johnson K, Pande RP, Wagstaff A: Socio-economic Differences in Health, Nutrition, and Population. 2000, Washington: The World BankGoogle Scholar
- Filmer D, Pritchett LH: Estimating wealth effects without expenditure data – or tears: an application to educational enrollments in states of India. Demography. 2001, 38 (1): 115-132.PubMedGoogle Scholar
- Houweling TA, Kunst AE, Mackenbach JP: Measuring health inequality among children in developing countries: does the choice of the indicator of economic status matter?. Int J Equity Health. 2003, 2 (1): 8-10.1186/1475-9276-2-8.View ArticlePubMedPubMed CentralGoogle Scholar
- Bollen KA, Glanville JL, Stecklov G: Economic status proxies in studies of fertility in developing countries: Does the measure matter?. Population Studies – A Journal of Demography. 2002, 56 (1): 81-96.View ArticleGoogle Scholar
- Martikainen P, Valkonen T, Martelin T: Change in male and female life expectancy by social class: decomposition by age and cause of death in Finland 1971–95. J Epidemiol Community Health. 2001, 55: 494-499. 10.1136/jech.55.7.494.View ArticlePubMedPubMed CentralGoogle Scholar
- Marang-van de Mheen P, Davey Smith G, Hart C, Gunning-Schepers L: Socioeconomic differentials in mortality among men within Great Britain: time trends and contributory causes. J Epidemiol Community Health. 1998, 52: 214-218.View ArticlePubMedGoogle Scholar
- Cleland J, Bicego G, Fegan G: Socioeconomic inequalities in childhood mortality: the 1970s to the 1980s. Health Transit Rev. 1992, 2 (1): 1-18.PubMedGoogle Scholar
- Minujin A, Delamonica E: Mind the gap! Widening Child Mortality Disparities. J Human Development. 2003, 4 (3): 397-418. 10.1080/1464988032000125764.View ArticleGoogle Scholar
- Vågerö D, Erikson R: Socioeconomic inequalities in morbidity and mortality in western Europe. Lancet. 1997, 350 (9076): 516-10.1016/S0140-6736(97)26033-2.View ArticlePubMedGoogle Scholar
- Huisman M, Kunst AE, Andersen O, Bopp M, Borgan JK, Borrell C, Costa G, Deboosere P, Desplanques G, Donkin A, Gadeyne S, Minder C, Regidor E, Spadea T, Valkonen T, Mackenbach JP: Socioeconomic inequalities in mortality among elderly people in 11 European populations. J Epidemiol Community Health. 2004, 58 (6): 468-75. 10.1136/jech.2003.010496.View ArticlePubMedPubMed CentralGoogle Scholar
- Lopez AD, Collishaw NE, Piha T: A descriptive model of the cigarette epidemic in developed countries. Tob Control. 1994, 3: 242-247.View ArticlePubMed CentralGoogle Scholar
- Marmot MG, Shipley MJ: Do socioeconomic differences in mortality persist after retirement? 25 year follow up of civil servants from the first Whitehall study. BMJ. 1996, 313 (7066): 1177-80.View ArticlePubMedPubMed CentralGoogle Scholar
- Wagstaff A: The bounds of the concentration index when the variable of interest is binary, with an application to immunization inequality. Health Econ. 2005, 14 (4): 429-32. 10.1002/hec.953.View ArticlePubMedGoogle Scholar
- Kunst AE, Houweling TAJ: International overview of poor-rich disparities in child mortality and the use of maternal and child health services. 2001, Report on a short-term consultancy to the World BankGoogle Scholar
- Rogers EM: Diffusion of Innovations. 2003, London: Free Press, Google Scholar
- Huisman M, Kunst AE, Mackenbach JP: Educational inequalities in smoking among men and women aged 16 years and older in 11 European countries. Tob Control. 2005, 14 (2): 106-13. 10.1136/tc.2004.008573.View ArticlePubMedPubMed CentralGoogle Scholar
- Monteiro CA, Conde WL, Lu B, Popkin BM: Obesity and inequities in health in the developing world. Int J Obes Relat Metab Disord. 2004, 28 (9): 1181-6. 10.1038/sj.ijo.0802716.View ArticlePubMedGoogle Scholar
- Walter SD: Choice of effect measure for epidemiological data. J Clinical Epidemiology. 2000, 53 (9): 931-939. 10.1016/S0895-4356(00)00210-9.View ArticleGoogle Scholar
- Koolman X, Kunst AE: Estimating relative risks for categorical outcomes; An application to health inequality measurement.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.