Households, the omitted level in contextual analysis: disentangling the relative influence of households and districts on the variation of BMI about two decades in Indonesia
© The Author(s). 2016
Received: 31 March 2016
Accepted: 27 June 2016
Published: 7 July 2016
Most of the research investigating the effect of social context on individual health outcomes has interpreted context in terms of the residential environment. In these studies, individuals are nested within their neighbourhoods or communities, disregarding the intermediate household level that lies between individuals and their residential environment. Households are an important determinant of health yet they are rarely included at the contextual level in research examining association between body mass index (BMI) and the social determinants of health. In this study, our main aim was to provide a methodological demonstration of multilevel analysis, which disentangles the simultaneous effects of households and districts as well as their associated predictors on BMI over time.
Using both two- and three-level multilevel analysis, we utilized data from all four cross-sections of the Indonesian Family life Survey (IFLS) 1993 to 2007-8.
We found that: (i) the variation in BMI attributable to districts decreased from 4.3 % in 1993 to 1.5 % in 1997-98, and remained constant until 2007–08, while there was an alarming increase in the variation of BMI attributable to households, from 10 % in 2000 to 15 % in 2007–08; (ii) ignoring the household level did not change the relative variance contribution of districts on BMI, but ignoring the district level resulted in overestimation of household effects, and (iii) households’ characteristics (socioeconomic status, size, and place of residence) did not attenuate the variation of BMI at the household-level.
Estimating the relative importance of multiple social settings allows us to better understand and unpack the variation in clustered or hieratical data in order to make valid and robust inferences. Our findings will help direct investment of limited public health resources to the appropriate context in order to reduce health risk (variation in BMI) and promote population health.
During recent decades, a vast number of studies from epidemiology, sociology, human development and other disciplines have implied the important role played by context in a variety of health and developmental outcomes [1–8]. However, most research investigating the effect of context on individual health outcomes has mainly operationalized context within the area of residential environment, which generally refers to areas, neighbourhoods or communities. Consequently, individuals happen to be nested within their neighbourhoods or communities, ignoring the intermediate context that lies between individuals and their residential environment. Households or families as a major determinant of health [9, 10] can be considered in terms of an omitted contextual level, which has by and large been ignored in many empirical researches on social determinants of health. To a great extent, this is because of either simplicity or the absence of data at this level, which would allow the existence, and strength of such effects to be evaluated.
Few studies have examined the empirical implications or discussed the substantive eminence of this omitted level in empirical research [11–14]. The focus of these studies was mainly on methodological applications by using simulated data for analysis. We, however, examine the application of omitted level on health related outcomes – i.e. BMI – to better guide the limited public health resources to the right setting which has a greater impact on reducing variations in health among individual.
The reality recognized by social or behavioural scientists to understand social determinants of health and social disparity is largely multi-layered [15–18]. Assuming that individuals are nested in one and only one context may be an over-simplification of reality, as individuals simultaneously belong to multiple settings or levels that can each independently affect their health. Therefore, such a multilevel structure of reality means that empirical data sampled from individuals embedded in multiple social contexts are not mutually independent. Hence, in order to turn the complex models of social epidemiology into a useful analytical model of disease processes in persons and in populations, more comprehensive and better data are needed to test these models by using advanced statistical techniques and relevant epidemiological theories .
The empirical implications of an omitted level (in our example, households) can potentially alter the inferences drawn about the effect of the individual level or community level on a given outcome. It is possible that the clustering of the health of individuals within areas is due, in part, to the clustering of the health of individuals within households. Hence, studies that suggest the residential environment effects on individual health exist independently of individual characteristics need to be aware of the problem of ignoring households as a level in the multilevel analyses. Omission of this intermediate level can lead to biased parameter estimates and tests of cross-level effects and interactions, with potentially misleading substantive conclusions . Consequently, the policy implication of such studies is that targeted interventions and policies are misguided to the wrong setting, whether it be the household, the neighbourhood, or both.
So far, there has been great effort to observe the trend—assessing the associated factors and explaining the variations—of ever-increasing mean body mass index (BMI) or the prevalence of overweight and obesity or the dual burden of malnutrition (the co-existence of under- and overweight individuals in the same household) in Indonesia [21–27]. Previous studies, however, analysed data either only at the individual level, using ordinary least regressions, or predominantly focused on neighbourhoods and districts by applying hierarchical two-level multilevel analyses of only one time point. Therefore, identification of a context capable of having the greatest effect on reducing disease risks and promoting population health has been missed. In this study, our main aim was to provide a methodical demonstration of three-level multilevel analysis to disentangle the simultaneous effect of households and districts and their associated predictors on BMI over time (from 1993 to 2007–8) in Indonesia.
The specific objectives of our study are: (i) to assess the extent to which variation in BMI is attributed to the individual level, household level and district level, and how it is changing over time; (ii) whether ignoring the household level results in over- or under-estimation of the relative variance contribution of the district; and (iii) to examine how much of the variation in BMI is explained by the characteristics of each level and how it is changing over time.
We utilized a nationally representative data from an on-going longitudinal socioeconomic and health survey, called the Indonesian Family Life Survey (IFLS) (http://www.rand.org/labor/FLS/IFLS.html). So far, IFLS consists of four Waves from data collected in 1993, 1997–8, 2000, 2007–2008. The IFLS employed a multi-stage stratified systematic sampling design based on the stratification of provinces and urban/rural location. From 27 provinces, 13 of them were selected representing 83 % of the population. IFLS has a multilevel structure with individuals nested within households and districts . It provides a rich set of information on individuals and households, the communities they live in, and the facilities available to them.
We calculated BMI (weight in kilograms divided by the square of height in meters) based on the World Health Organization (WHO) definition .
The covariates were: (i) sex (male and female); (ii) age (2–100 years); (iii) education (no schooling, elementary, secondary and university); (iv) occupation (never worked, worked, in school and retired); (v) marital status (never married, married, separated, divorced and widowed); (vi) household living standard presented as quartiles of per capita expenditure: the first quartile was considered the “lowest per capita expenditure”; (vii) household size; and (viii) place of residence (urban and rural). Household per capita expenditure calculated by IFLS was used as a proxy for a household’s living standard and contained information about the household’s food expenditure and non-food consumption during one month measured in Indonesian Rupiah . Since our preliminary analysis showed only a very small percentage of variation in BMI was attributable to the district, district level variables were not included in the analysis.
In Eq. (1), the fixed effect parameter ß 0 refers to the overall mean outcome y across all households and ß n x nij refers to a vector of individual level covariates. The random effect parameter u 0j refers to the random effect for the household (assumed to be normally distributed with a mean of 0 and variance σ 2 u 0 ), and e 0ij refers to the random effect for the individual.
The fixed and random effect parameters in Eq. (2) have an identical interpretation to those in Eq. (1), except the y now refers to district instead of household. The ordinary least regression models, in which context is ignored, are not sufficiently adjustable to accommodate multiple nested contexts simultaneously, though the two-level multilevel modelling marks a significant advancement for considering context.
In Eq. (3), which presents a null or intercept-only model (i.e. a model without covariates), the fixed effect parameter ß 0 refers to the overall mean outcome (y) across all households and districts; v 0k is the random effect at district level, and allowed to vary from the grand mean (variance between districts is assumed to be normally distributed with a mean of 0 and variance σ 2 v 0 ); u 0jk is the random effect at the household level, a departure from the household effect within the district level (variance between households is assumed to be normally distributed with a mean of 0 and variance σ 2 u 0 ); e 0ijk is the random effect at the individual level, a departure from the household effect within a district (variance between individuals is assumed to be normally distributed with a mean of 0 and variance σ 2 e 0 ).
We continued the analyses in three steps on all four IFLS waves. First, to partition the variance in BMI into within and between components and estimate an intra-class correlation coefficient (ICC)—i.e. the proportion of variation in the outcome that was due to differences across households and districts, rather than differences across individuals—we estimated Model 1 controlling for only age and sex. The ICCs in the household-only and district-only multilevel model were generated by dividing the between-level random effect by the total variance. In the three-level multilevel analysis, we calculated ICCs for district-level and household-level, which are referred to as the intra-district (i.e. correlation in outcome between two individuals who live in the same district but live in different households; this was calculated by dividing the district-level random effect by the total variance, or the sum of the three variance components) and intra-household correlation coefficient (i.e. correlation in outcome between two individuals who live in the same household; this was calculated by dividing the household-level random effect by the total variance). Subsequently, we estimated a model that contained other individual-level predictors and covariates (Model 2). By including these individual-level variables, we were able to evaluate the extent to which the between-level variance estimates (i.e. random effect parameters) could be explained by the observed individual characteristics across households and districts. We then fitted a model containing individual-level variables and household-level variables (Model 3).
For each wave of IFLS, we examined residual plots at each level of analysis to evaluate model diagnostics on the variance parameter; this enabled us to test model assumptions, and detect outliers and influence points on model fit. Analyses were conducted using unweighted data; however, a non-weighted analysis is also appropriate as our emphasis was on tests of association and random effects, rather than deriving nationally representative estimates, and we adjusted our analyses for sample characteristics and thus reduced the heterogeneity in the sample . All analyses were conducted by STATA version 14.1 (College Station, Texas 77845, USA).
Descriptive and demographic characteristics of the study population
Individuals’ and households’ basic demographic composition characteristics. Indonesian Family Life Survey (IFLS) 1993–2007
Percentage of Men
Average BMI distribution across households and districts
Multilevel modelling and model comparison
Random effect estimates at the household- and district-level for the household-only two-level multilevel model, district-only two-level multilevel model, and household/district three level multilevel model. Indonesian Family life survey (IFLS) 1993–2007
ONLY HOUSEHOLD MODEL (TWO-LEVEL)
ONLY DISTRICT MODEL (TWO-LEVEL)
HOUSEHOLD AND DISTRICT MODEL (THREE-LEVEL)
Changing attributable variance of households and districts over time
Ignoring intermediate (household) level—a comparison between district only model (two-level) and household/district model (three-level)
In all three models (Model 1, Model 2 and Model 3), the random effects for district (σ 2 u0j ) and district level ICC did not change from the district only model (two-level) to the household/district model (three-level). For instance, comparing the district only model (two-level) to the household/district model (three-level) for Model 3, the district level ICC remained almost the same from 4.5 to 4.3 % for IFLS1; 1.7 to 1.5 % for IFLS2; 1.6 to 1.4 % for IFLS3; and 1.9 to 1.6 % for IFLS4. This result suggests that if we ignore intermediate (household) level, we will neither overestimate nor underestimate the effect of higher (district) level.
Ignoring higher (district) level—a comparison between household only model (two-level) and household and district model (three-level)
In all three models (Model 1, Model 2 and Model 3), the random effects for household (σ 2 u0j ) and household level ICC decreased from the household only model (two-level) to the household/district model (three-level) for each study wave. For instance, comparing the household only model (two-level) to the household/district model (three-level) for Model 3, the household level ICC decreased from 14.5 to 10.8 % for IFLS1; from 12.2 to 10.9 % for IFLS2; from 11.0 to 9.9 % for IFLS3; and from 16.4 to 15 % for IFLS4. This result suggests that if we ignore the higher (district) level, we will overestimate the effect of intermediate (household) level.
Explained variance by individuals and household characteristics—a comparison of Model 1, Model 2 and Model 3
We also found that inclusion of individual characteristics (education, marital status and occupation) in Model 2 largely attenuated the individual residual variance and between-level variance for districts in all four IFLS waves and in all three (household only, district only and household/district) models. This decline suggests that the between-level variation in BMI was due to compositional effect (i.e. characteristics of individuals in these contexts). However, compared to Model 2, inclusion of households’ characteristics (households’ per capita expenditure, households’ size and place of residency) in Model 3 did not reduce the residual variance at household level. For example, in the household/district model (three-level), the household residual variance in Model 2 was 1.04 (IFLS1), 1.01 (IFLS2), 1.02 (IFLS3) and 2.07 (IFLS4), which remained very similar in Model 3: 0.99 (IFLS1), 1.03 (IFLS2), 1.00 (IFLS3) and 1.93 (IFLS4). This comparison suggests that households’ per capita expenditure, size and place of residency could not explain or reduce the variation at household level.
The main findings in our study were: (i) a greater increase in the variation of BMI attributable to the households, compared with the districts; (ii) ignoring the household-level did not change the relative variance contribution of the districts on BMI, but ignoring the district-level resulted in overestimation of the household effect; (iii) households’ socio-economic characteristics did not attenuate BMI variation at the household-level.
Our study has uncovered one evidently very relevant context—households, whose study has remained almost quiescent in multilevel studies endeavouring to explain the fast growing body mass index in Indonesia. We focused on the significance of district and household factors in explaining variation in BMI over time and the results showed the salient relative importance of household over district. The variation in BMI attributable to districts decreased from 4.3 % in 1993 to 1.5 % in 1997–98 and remained constant until 2007–08, while there was a sharp increase in the variation of BMI attributable to households from 10 % in 2000 to 15 % in 2007–08. However, one must be cautious in stating that household level factors in general are more important for explaining health variation or inequality compared to factors at the local area/district level. It might well be that the influence of various contexts differs due to the particular health outcome in focus. One of the strongest predictors for BMI is food consumption , an event that takes place mainly within households. It is now evident that food consumption patterns are undergoing substantial changes in LMICs as well as in Indonesia, moving away from traditional cereals toward higher value and higher protein foods [35, 36]. Meals are planned, prepared and shared within the household and therefore there are strong reasons to believe that household factors are more important in influencing food intake compared to more distal factors such as the physical and social environment in the district. Several studies have shown how inhibited overeating is related to adult overweight , while children in general remain the highest proportion of underweight individuals  causing even more variation within the households. Our finding is in line with a study from Roemling and Qaim , who revealed increasing intra-household nutritional inequality in Indonesia. Indonesia has been through different economic stages: before economic crisis (prior to 1993), during economic crisis (1997–98), during economic recovery and decentralization (2000–2005) and in the phase of economic improvement (2006 onwards). The increased inequality in BMI within the households could be due to different impacts of the nutrition transition on different age groups, which affects the nutritional status of children and adults inversely. In contrast, lifestyle and dietary changes combined with limited nutrition and health knowledge on the one hand, coupled with rapid social, economic and technological changes on the other hand, seem be similarly shared within the districts among individuals after decentralization and during the phase of economic improvement. Therefore, this secular trend might be explained by sharing the same obesogenic environment at the district level.
However, beyond BMI, there are probably other health related outcomes where distal factors in the living environment might be more influential, such as self-rated health, for example. Within the research field of social capital and health, there is now quite strong evidence, based on multilevel studies, for a positive association between self-rated health and residential environment (community/neighbourhood/state/nation) characterized as high in social capital (i.e. socially cohesive, supportive and trusting) [38–40]. One may argue that household composition could contribute to the observed larger variation in BMI in 2007 as compared to 2000, since the number of households interviewed in 2007 increased by 30 % compared to those in 2000: it is likely that these new split-off households are possibly younger adults with children, and this can therefore contribute to a larger variation in the distribution of BMI at the household level. We examined the proportion of all individuals in each age category at ten year intervals. Even though the number of individuals and new split-off households increased over time, there was no substantial difference in proportion between under 20 year olds and those aged over 80 (data not shown). It should also be noted that there is still district level inequality in BMI (ICC = 1.6 % in 2007–08). These geographical variations in overweight and underweight individuals were also observed in a study by Hanandita and Tampubolon (2015) in Indonesia using data from Riskesdas, which covers more islands of the archipelago such as Sulawesi, Maluku, Halmahera, Nusa Tenggara and Papua. Nevertheless, the variation in districts did not increase over time as it did in households.
Apart from the substantive importance of households, the empirical applications of households as an omitted level are also important in contextual analysis. The notion of an omitted intermediate level and the importance of simultaneous analysis of the effect of multiple settings are more prominent where individuals are concurrently nested within multiple non-hierarchical settings—i.e. schools and neighbourhoods. Applying cross-classified multilevel models, these studies repeatedly reported a substantial decline in the role of neighbourhoods in children’s health outcomes after inclusion of the intermediate level such as schools [41–44]. In other words, ignoring an intermediate level (i.e. school) will result in overestimating the higher level (i.e. neighbourhood) where the structure of the data is not hierarchical. In our analysis, we examined the BMI of individuals who are nested within multiple hierarchical settings—household and districts—by applying three-level multilevel analysis. After accounting for the simultaneous effect of households and districts compared with district only models, there was no evidence as to whether the influence of the higher level (districts) is under- or overestimated. Nevertheless, had we estimated only a district level multilevel model and not estimated a three-level multilevel model that accounted for the random effect of both households and districts, we would have missed the contribution of households (ICC = 15 %) in the variation of BMI which would have remained otherwise unexplained. Furthermore, we now know the salient relative importance of households over districts, yet the answer to the question of why households became so different over time remains understudied.
A few methodological studies have investigated the effect of ignoring a level in the hierarchical nesting multilevel structure on test statistics using mainly simulated data [12, 13, 45–47]. These studies reported that when the higher level nesting structure is ignored, the variance of the ignored higher level relocates to the adjacent level and the variance component at the lowest level remains unchanged [12, 13, 45–47]. This is in line with our analysis when we compared the two-level (household only) model to the three-level (both household and district) model. In other words, the effect of household level is overestimated if the district level is ignored. The various authors also reported that if the intermediate level is ignored, the variance estimate of the discarded level is divided between the flanking levels and will be largely relocated to the lower level [12, 13, 45–47]. Especially when the data are perfectly balanced, the higher level variance will remain the same, but the lower level variance will now be subdivided between the intermediate and lower levels; however, the more unbalanced the data, the more approximate the estimates will become. This is also in accordance with our findings when we compared the two-level (district only) model with three-level (both household and district) model. Therefore, it can be concluded that the district level effect is neither over- nor underestimated when household level is ignored, while it is the variation at the individual level, which is overestimated.
Although fixed effect estimates (mean-centric measures) are informative for determining the extent to which the predictor of interest is associated with the outcome and also the degree to which it reduces between-level variation, in this analysis we purposely focused on only the random effect (measures of variance) of the multilevel contextual modelling. One reason for doing this was that we ran 36 multilevel models on all four cross-sections of IFLS data; therefore, reporting associations for a large number of predictors would have encumbered the current study. Furthermore, as George A. Kaplan put it in a paper called ‘What is wrong with social epidemiology, and how can we make it better’, many studies stop at reporting a statistically significant association between the risk factor and outcomes in question after adjusting for a set of known predictors . This counteracts the detection of new risk factors, which could possibly motivate the search for new disease mechanisms and ascertain new social risk factors as something more informative. Juan Merlo et.al. (2009) proposed the variance approach (random effect) as a new approach to contextual analysis allowing perspectives to be explained which could not be interpreted in mean-centric (fixed effect) terms . In our analysis, we compared the variance contributions (i.e. the random effect) across models to evaluate the extent to which inclusion of household predictors helped to explain the observed between-household variation in BMI. The associations between almost all of these fixed effect variables and BMI were statistically significant (data not shown). However, as reported earlier, it has not resulted in reducing the between-level variance. We may consider these factors to be significantly associated with BMI, but identifying the mechanism under which these associations are explained is awkward. Geoffrey Rose (1992) claims that “the primary determinants of disease are mainly economic and social, and therefore its remedies must also be economic and social” . If these socioeconomic factors cannot or do not explain within-household variation in BMI within the 1993–2007 period in Indonesia, our findings beg the question of what other unknown household characteristics—such as family psychosocial conditions, family social capital, social network, gendered power relations, household decision making or women’s education—could have a larger effect on reducing the variation of BMI at the household level. Therefore, the need to unpack further the nature of within-household behaviour to explain the variation in BMI is a necessity.
Our study has some limitations that should be mentioned. First, the last wave of the IFLS was conducted in 2007–08, which might not be very up to date. However, IFLS is the largest longitudinal nationally representative survey, providing comprehensive socioeconomic and health information at the individual, household, district and province levels in Indonesia. Secondly, individuals who moved out and started a new split-off household in the subsequent waves were followed over time. Therefore, in IFLS2, IFLS3 and IFLS4, we had a smaller number of individuals in some districts. In practice, however, the assumption of a completely balanced design is almost never met . In addition, referring to the concept of exchangeability in hierarchical models , each parameter borrows strength from the other parameters at its level in the hierarchy: therefore estimates are shrunk towards the population mean. The consequence of exchangeability is beneficial when the number of individuals observed in some of the units in the hierarchy is very small. Finally, we did not include the dietary pattern of households or the physical activity level of individuals, which might better explain the variation in BMI.
Estimating the effect of the omitted level would help better to understand and unpack the variation in clustered or hierarchical data in order to make a valid and robust inference. The questions raised in our analysis provide a compelling agenda for further investigation where little is known about the consequence of ignoring a level in nesting multilevel models on different health-related outcomes. Recognition of increased variation in BMI at household level is important for laying out strategies that respond to the differential needs of individuals within the same household. Hence, to help guide the investment of limited public health resources, much more work is needed in this area to demonstrate and to evaluate the role of social context on health. Otherwise, implementation of misguided policies and interventions in contexts that may not be capable of having a significant effect on reducing health risk and promoting population health outcomes will always be a risk.
BMI, body mass index; ICC, intraclass correlation; IFLS, Indonesian Family Life Survey; LMICs, Low- and middle-income countries; SD, standard deviation; SES, socioeconomic status.
This study is supported by Umeå Center for Global Health Research (UCGHR) and Umeå Centre for Gender Studies (UCGS) that jointly sponsor Masoud Vaezghasemi’s PhD studies. We are grateful to acknowledge the Kempe Foundation and the Wallenberg scholarship at Umeå University that facilitated Masoud Vaezghasemi’s visit to Harvard University during Spring 2015. None of these sources had any involvement in the study design, analysis, interpretation of the data, and in the decision to submit the paper for publication. We acknowledge IFLS support, Senior Research Associate Christine Peterson for patiently guiding us with data management. We also appreciate STATA support team for their technical advice.
The authors’ contributions were as follows: MV and NN contributed reagents and materials; MV and SVS conceived and designed the experiment; MV and SVS analysed and performed the experiment; MV wrote the first draft of the manuscript; MV, NN, ME and SVS actively contributed to the finalizing of the manuscript and MV had primary responsibility for the final content of the manuscript. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Kaplan GA, Lynch JW. Whither studies on the socioeconomic foundations of population health? Am J Public Health. 1997;87(9):1409–11.View ArticlePubMedPubMed CentralGoogle Scholar
- Macintyre S, Ellaway A, Cummins S. Place effects on health: how can we conceptualise, operationalise and measure them? Soc Sci Med. 2002;55(1):125–39. PubMed PMID: WOS:000176232400010.View ArticlePubMedGoogle Scholar
- Merlo J, Chaix B, Yang M, Lynch J, Rastam L. A brief conceptual tutorial on multilevel analysis in social epidemiology: interpreting neighbourhood differences and the effect of neighbourhood characteristics on individual health. J Epidemiol Community Health. 2005;59(12):1022–8. doi:10.1136/jech.2004.028035.View ArticlePubMedPubMed CentralGoogle Scholar
- Truong KD, Ma S. A systematic review of relations between neighborhoods and mental health. J Ment Health Policy Econ. 2006;9(3):137–54.PubMedGoogle Scholar
- Yen IH, Michael YL, Perdue L. Neighborhood environment in studies of health of older adults: a systematic review. Am J Prev Med. 2009;37(5):455–63. doi:10.1016/j.amepre.2009.06.022.View ArticlePubMedPubMed CentralGoogle Scholar
- Diez Roux AV, Mair C. Neighborhoods and health. Ann NY Acad Sci. 2010;1186:125–45. doi:10.1111/j.1749-6632.2009.05333.x.View ArticlePubMedGoogle Scholar
- McDonald KN, Oakes JM, Forsyth A. Effect of street connectivity and density on adult BMI: results from the Twin Cities Walking Study. J Epidemiol Community Health. 2012;66(7):636–40. doi:10.1136/jech.2010.122556.View ArticlePubMedGoogle Scholar
- Arcaya MC, Arcaya AL, Subramanian SV. Inequalities in health: definitions, concepts, and theories. Glob Health Action. 2015;8:27106. doi:10.3402/gha.v8.27106.PubMedGoogle Scholar
- McNeill T. Family as a social determinant of health: implications for governments and institutions to promote the health and well-being of families. Healthc Q. 2010;14(Spec No 1):60–7.View ArticlePubMedGoogle Scholar
- Ross CE, Mirowsky J, Goldsteen K. The Impact of the Family on Health - the Decade in Review. J Marriage Fam. 1990;52(4):1059–78. doi:10.2307/353319. PubMed PMID: WOS:A1990EK09000017.View ArticleGoogle Scholar
- Raykov T, Patelis T, George A. Examining Intermediate Omitted Levels in Hierarchical Designs via Latent Variable Modeling. Structural Equation Modeling: A Multidisciplinary Journal. 2015. p. 1–5. doi:10.1080/10705511.2014.938186.Google Scholar
- Van den Noortgate W, Opdenakker MC, Onghena P. The effects of ignoring a level in multilevel analysis. Sc Eff Sch Improv. 2005;16(3):281–303. doi:10.1080/09243450500114850. PubMed PMID: WOS:000231803100003.View ArticleGoogle Scholar
- Van Landeghem G, De Fraine B, Van Damme J. The consequence of ignoring a level of nesting in multilevel analysis: A comment. Multivariate Behav Research. 2005;40(4):423–34. doi:10.1207/S15327906mbr4004_2. PubMed PMID: WOS:000237342900002.View ArticleGoogle Scholar
- Chen Q. The Impact of Ignoring a Level of Nesting Structure in Multilevel Mixture Model: A Monte Carlo Study. SAGE Open. 2012;2(1). doi: 10.1177/2158244012442518Google Scholar
- Kaplan GA, Everson SA, Lynch JW. The contribution of social and behavioral research to an understanding of the distribution of disease: a multilevel approach. In: Smedley BD, Syme SL, editors. Promoting health: intervention strategies from social and behavioral research. Washington, DC: National Academy Press; 2000. p. 31–55.Google Scholar
- House JS. Understanding social factors and inequalities in health: 20th century progress and 21st century prospects. J Health Soc Behav. 2002;43(2):125–42.View ArticlePubMedGoogle Scholar
- Lynch JW. Social epidemiology: some observations on the past, present and future. Australas epidemiol. 2000;7(3).Google Scholar
- Marmot M. Multilevel approaches to understanding social determinants. In: Berkman LF, Kawachi I, editors. Social epidemiology. New York, NY: Oxford University Press; 2000. p. 349–67.Google Scholar
- Kaplan GA. What’s wrong with social epidemiology, and how can we make it better? Epidemiol Rev. 2004;26:124–35. doi:10.1093/epirev/mxh010.View ArticlePubMedGoogle Scholar
- Raudenbush SW, Bryk AS. Hierarchical Linear Models: Applications and Data Analysis Methods. University of Chicago: SAGE Publications; 2002. p.485Google Scholar
- Winkvist A, Nurdiati DS, Stenlund H, Hakimi M. Predicting under- and overnutrition among women of reproductive age: a population-based study in central Java, Indonesia. Public Health Nutr. 2000;3(2):193–200. Epub 2000/08/19.View ArticlePubMedGoogle Scholar
- Julia M, van Weissenbruch MM, Prawirohartono EP, Surjono A. Delemarre-van de Waal HA. Tracking for underweight, overweight and obesity from childhood to adolescence: a 5-year follow-up study in urban Indonesian children. Horm Res. 2008;69(5):301–6. doi:10.1159/000114862. Epub 2008/02/09.View ArticlePubMedGoogle Scholar
- Oddo VM, Rah JH, Semba RD, Sun K, Akhter N, Sari M, et al. Predictors of maternal and child double burden of malnutrition in rural Indonesia and Bangladesh. Am J Clin Nutr. 2012;95(4):951–8. doi:10.3945/ajcn.111.026070.View ArticlePubMedGoogle Scholar
- Roemling C, Qaim M. Obesity trends and determinants in Indonesia. Appetite. 2012;58(3):1005–13. doi:10.1016/j.appet.2012.02.053.View ArticlePubMedGoogle Scholar
- Roemling C, Qaim M. Dual burden households and intra-household nutritional inequality in Indonesia. Econ Hum Biol. 2013;11(4):563–73. doi:10.1016/j.ehb.2013.07.001.View ArticlePubMedGoogle Scholar
- Vaezghasemi M, Ohman A, Eriksson M, Hakimi M, Weinehall L, Kusnanto H, et al. The effect of gender and social capital on the dual burden of malnutrition: a multilevel study in Indonesia. PLoS One. 2014;9(8):e103849. doi:10.1371/journal.pone.0103849.View ArticlePubMedPubMed CentralGoogle Scholar
- Hanandita W, Tampubolon G. The double burden of malnutrition in Indonesia: Social determinants and geographical variations. SSM - PopulationHealth. 2015;1:16–25.View ArticleGoogle Scholar
- Frankenberg E, Thomas D. The Indonesian Family Life Survey: study design and results from wave 1 and 2. Santa Monica: RAND; 2000.Google Scholar
- Strauss J, Witoelar F, Sikoki B, Wattie AM. The Fourth Wave of the Indonesia Family Life Survey: Overview and Field Report. RAND. 2009. WR-675/1-NIA/NICHD. http://www.rand.org/labor/FLS/IFLS/download.html.
- Cole TJ, Bellizzi MC, Flegal KM, Dietz WH. Establishing a standard definition for child overweight and obesity worldwide: international survey. BMJ. 2000;320(7244):1240–3.View ArticlePubMedPubMed CentralGoogle Scholar
- Strauss J, Witoelar F, Sikoki B, Wattie AM. User’s Guide for the Indonesia Family Life Survey, Wave 4. 2009. WR-675/2-NIA/NICHD.Google Scholar
- Subramanian SV, Jones K, Duncan C. Multilevel methods for public health research. In: Kawachi I, Berkman LF, editors. Neighborhoods and Health. NewYork, NY: Oxford University Press; 2003. p. 65–111.View ArticleGoogle Scholar
- Lee ES, Forthofer RN. Analyzing Complex Survey Data. Thousand Oaks: Sage; 2006.View ArticleGoogle Scholar
- Periwal V, Chow CC. Patterns in food intake correlate with body mass index. Am J Physiol Endocrinol Metab. 2006;291(5):E929–36. doi:10.1152/ajpendo.00122.2006.View ArticlePubMedGoogle Scholar
- Lipoeto NI, Geok Lin K, Angeles-Agdeppa I. Food consumption patterns and nutrition transition in South-East Asia. Public Health Nutr. 2013;16(9):1637–43. doi:10.1017/S1368980012004569.View ArticlePubMedGoogle Scholar
- Rae AN. Food consumption patterns and nutrition in urban Java households: the discriminatory power of some socioconomic variables. Aust J Agric Resour Econ. 1999;43(3):359–83.View ArticleGoogle Scholar
- Francis LA, Ventura AK, Marini M, Birch LL. Parent overweight predicts daughters’ increase in BMI and disinhibited overeating from 5 to 13 years. Obesity. 2007;15(6):1544–53. doi:10.1038/oby.2007.183.View ArticlePubMedPubMed CentralGoogle Scholar
- Eriksson M. Social Capital, health and community action: Implications for health promotion. Umeå: Umeå University; 2010 [Thesis PhD dissertation].Google Scholar
- Murayama H, Fujiwara Y, Kawachi I. Social capital and health: a review of prospective multilevel studies. J Epidemiol. 2012;22(3):179–87.View ArticlePubMedPubMed CentralGoogle Scholar
- Gilbert KL, Quinn SC, Goodman RM, Butler J, Wallace J. A meta-analysis of social capital and health: a case for needed research. J Health Psychol. 2013;18(11):1385–99. doi:10.1177/1359105311435983.View ArticlePubMedPubMed CentralGoogle Scholar
- Aminzadeh K, Denny S, Utter J, Milfont TL, Ameratunga S, Teevale T, et al. Neighbourhood social capital and adolescent self-reported wellbeing in New Zealand: a multilevel analysis. Soc Sci Med. 2013;84:13–21. doi:10.1016/j.socscimed.2013.02.012.View ArticlePubMedGoogle Scholar
- De Clercq B, Pfoertner TK, Elgar FJ, Hublet A, Maes L. Social capital and adolescent smoking in schools and communities: a cross-classified multilevel analysis. Soc Sci Med. 2014;119:81–7. doi:10.1016/j.socscimed.2014.08.018.View ArticlePubMedGoogle Scholar
- Dunn EC, Milliren CE, Evans CR, Subramanian SV, Richmond TK. Disentangling the relative influence of schools and neighborhoods on adolescents’ risk for depressive symptoms. Am J Public Health. 2015;105(4):732–40. doi:10.2105/AJPH.2014.302374.View ArticlePubMedPubMed CentralGoogle Scholar
- Dunn EC, Richmond TK, Milliren CE, Subramanian SV. Using cross-classified multilevel models to disentangle school and neighborhood effects: an example focusing on smoking behaviors among adolescents in the United States. Health Place. 2015;31:224–32. doi:10.1016/j.healthplace.2014.12.001.View ArticlePubMedPubMed CentralGoogle Scholar
- Moerbeek M. The Consequence of Ignoring a Level of Nesting in Multilevel Analysis. Multivariate Behav Res. 2004;39(1):129–49. doi:10.1207/s15327906mbr3901_5.View ArticlePubMedGoogle Scholar
- Tranmer M, Steel DG. Ignoring a level in a multilevel model: evidence from UK census data. Environ Plann A. 2001;33(5):941–8. doi:10.1068/A3317. PubMed PMID: WOS:000169191400011.View ArticleGoogle Scholar
- Park J, Yu HT. The Impact of Ignoring the Level of Nesting Structure in Nonparametric Multilevel Latent Class Models. Educational and psychological measurement. 2015. p. 1–24. doi:10.1177/0013164415618240.Google Scholar
- Merlo J, Ohlsson H, Lynch KF, Chaix B, Subramanian SV. Individual and collective bodies: using measures of variance and association in contextual epidemiology. J Epidemiol Community Health. 2009;63(12):1043–8. doi:10.1136/jech.2009.088310.View ArticlePubMedGoogle Scholar
- Rose G. The strategy of preventive medicine. Oxford: Oxford University Press; 1992.Google Scholar
- Gelman A, Carlin J, Stern H, Rubin D. Bayesian data analysis. New York: Chapman & Hall; 2003.Google Scholar