Protocol to evaluate the effectiveness and cost

BMC Public Health volume 23, Article number: 1475 (2023) Cite this article

46 Accesses

18 Altmetric

Metrics details

One in seven UK children have obesity when starting school, with higher prevalence associated with deprivation. Most pre-school children do not meet UK recommendations for physical activity and nutrition. Formal childcare settings provide opportunities to deliver interventions to improve nutritional quality and physical activity to the majority of 3–4-year-olds. The nutrition and physical activity self-assessment for childcare (NAP SACC) intervention has demonstrated effectiveness in the USA with high acceptability in the UK. The study aims to evaluate the effectiveness and cost-effectiveness of the NAP SACC UK intervention to increase physical activity, reduce sedentary time and improve nutritional intake.

Multi-centre cluster RCT with process and economic evaluation. Participants are children aged 2 years or over, attending UK early years settings (nurseries) for ≥ 12 h/week or ≥ 15 h/week during term time and their parents, and staff at participating nurseries. The 12-month intervention involves nursery managers working with a Partner (public health practitioner) to self-assess policies and practices relating to physical activity and nutrition; nursery staff attending one physical activity and one nutrition training workshop and setting goals to be achieved within 6 months. The Partner provides support and reviews progress. Nursery staff receive a further workshop and new goals are set, with Partner support for a further 6 months. The comparator is usual practice. Up to 56 nurseries will be stratified by area and randomly allocated to intervention or comparator arm with minimisation of differences in level of deprivation. Primary outcomes: accelerometer-assessed mean total activity time on nursery days and average total energy (kcal) intake per eating occasion of lunch and morning/afternoon snacks consumed within nurseries. Secondary outcomes: accelerometer-assessed mean daily minutes of moderate-to-vigorous physical activity and sedentary time per nursery day, total physical activity on nursery days compared to non-nursery days, average serving size of lunch and morning/afternoon snacks in nursery per day, average percentage of core and non-core food in lunch and morning/afternoon snacks, zBMI, proportion of children who are overweight/obese and child quality-of-life. A process evaluation will examine fidelity, acceptability, sustainability and context. An economic evaluation will compare costs and consequences from the perspective of the local government, nursery and parents.

ISRCTN33134697, 31/10/2019.

Childhood obesity is one of the major public health challenges of the 21st century and has been exacerbated by the COVID-19 pandemic. In England and Scotland around 14% of children [1, 2] are living with obesity when they start primary school (age 4–5 years), with the highest rates of obesity in the most deprived areas. This is an increase of nearly 5% from pre-pandemic levels [1]. Consequently, there is a need for effective obesity prevention approaches to target the pre-school age group, that can be delivered at scale.

Diet and physical activity (PA) are key behavioural targets for obesity prevention interventions. PA in childhood is associated with lower levels of cardio-metabolic risk factors and improved psychological well-being [3], and PA intervention studies in young children have consistently reported improved motor and cognitive development, and psychosocial and cardiometabolic health [4]. PA behaviours track from childhood into adulthood, thus positive patterns should be established in the early years of life [5]. The UK Chief Medical Officer recommends that children aged 1–5 years should be physically active for at least 3 h per day, with 1 h of this being moderate-to-vigorous PA (MVPA) [6]. In 2015, fewer than 9% of 2–4 year olds in England were meeting the PA guidelines and 83% of children had ‘low’ activity levels [7]. This signals a need for improvement in children’s PA levels.

The amount of PA in which a young child engages is influenced by the activity undertaken at pre-school and particularly the time spent outside [8]. A UK study reported that children aged 3 to 4 years, spend more time in MVPA and are less sedentary in pre-school and nursery settings compared with time spent at home [9]. However, the time spent in MVPA is still low, with one UK study reporting only 9% of children’s time at preschool being spent in MVPA [10]. The lack of MVPA in pre-school settings may be influenced by space and equipment, policies (including scheduled times for free/outdoor play), and staff training in PA promotion [11].

Dietary patterns established during childhood influence those in later life [12, 13]. Obesogenic dietary patterns, characterized by low intake of fruits, vegetables, high-fibre breakfast cereals (core foods) [14] and high intake of chocolate, confectionery, low-fibre bread, biscuits and cakes (non-core foods), have been observed in young children and are associated with a higher risk of adiposity in later childhood [15, 16]. Food provided in early years settings potentially contributes to these obesogenic dietary patterns, with non-core foods contributing to around 40% of energy intake in younger children (aged 1–3 years) when in attendance at these settings [17]. In terms of nutrient intake, only 15% of younger children meet the UK recommendation of free sugars contributing to no more than 5% of total energy intake, and this falls to 2% in the 4–10-year age-group. For fibre intake, only 12% of the younger children and 14% of the older children meet the recommended intake [18]. In addition to diet quality, meal size is a critical driver of weight gain. In children aged 2–5 years, every extra 10 kcal consumed per meal are associated with a 7% faster rate of weight gain [19]. A survey 10 years ago of early years settings in the UK found those in the most deprived areas reported serving more healthy food (whole grains, legumes, pulses, and lentils), however many were not meeting national guidelines [20]. There are no data on portion size of servings to children in early years settings in the UK.

Early-years settings provide scalable opportunities to deliver diet and PA interventions at the population level [21] and are considered important environments for early intervention to establish positive health behaviours and prevent childhood obesity [22]. In England and Scotland, 94% and 97% of 3–4 year-old children respectively, access the Government-funded early-years education [23, 24] and a large proportion of children under 5-years also attend private- or voluntary-funded childcare organisations (nurseries) beyond this funded provision [25], presenting an opportunity to positively influence eating and PA. However, currently there is limited guidance for PA and nutrition in early-years settings. UK voluntary guidelines exist for food in these settings [21, 26], but in contrast to school settings, where national school food standards legislation [27] applies, there are no statutory standards for food provision. Similarly, schools have a statutory requirement to provide physical education [28], but there are no PA-related requirements in early years settings.

Several syntheses of obesity prevention, PA, and nutrition intervention studies in children under 5 years of age provide some evidence of the effectiveness of these interventions, including those delivered in early years settings [29,30,31,32,33]. These evidence syntheses have identified a clear need for more robust research in this area, including evaluation of interventions with explicit theoretical underpinning and the inclusion of economic evaluation. A systematic review by Larson et al. [30] explored policies, practices and interventions for promoting healthy eating and PA in childcare settings and concluded that there was little focus on promoting these behaviours. They emphasised the opportunity for interventions and policies to support healthy eating and PA in these settings.

The 2019 Cochrane review of interventions for preventing obesity in children [34], which included 22 studies of interventions in childcare settings, highlighted the need for a better understanding of intervention implementation and collection of data to allow exploration of the impact of intervention on health inequalities. The latter is particularly important as obesity prevalence in UK children is more than double in deprived areas compared with the most affluent areas [1]. This also signals the need for early-years settings interventions to be designed to particularly benefit low-income families and other groups with poorer nutrition, lower physical activity and higher obesity prevalence.

In the UK, there have been few randomised-controlled trials (RCT) of early-years setting interventions targeting diet, physical activity and obesity [35,36,37], with mixed findings. One cluster-RCT of an early-years educational intervention showed a small reduction in BMI standard deviation score (zBMI) in the intervention, compared with the control group [35]. Another cluster-RCT evaluating a PA intervention in early-years settings reported no difference in physical activity or BMI between intervention and control groups; the authors suggested the intervention was probably of inadequate dose [37].

The NAP SACC programme [38] was developed in the USA and is an early-years setting intervention which aims to improve policies, practices, and the nutrition and PA environment, through a process of self-assessment and targeted assistance. NAP SACC is informed by social cognitive theory (SCT), which identifies the interrelationship between the environment, people, and behaviour [39], within a socio-ecological framework, which identifies multiple, interdependent influences at policy, community, organisational, interpersonal, and intrapersonal levels [40, 41]. The goals of the NAP SACC programme are to improve the nutritional quality of food served, the amount and quality of PA, staff-child interactions, and nutrition and PA policies [38].

Several RCTs of the NAP SACC programme in the USA have demonstrated its feasibility, acceptability and effectiveness, reporting: improvements in environmental audit nutrition scores [42]; increases in staff knowledge of childhood obesity, healthy eating, personal health, and working with families; decreases in children’s zBMI (-0.14; 95% CI -0.26,-0.02) [43]; and increased accelerometer-measured PA by 17% [44], following delivery of the NAP SACC programme. No studies included an economic evaluation or assessed dietary intake as an outcome.

In partnership with stakeholders, the NAP SACC programme was adapted for use in the UK (NAP SACC UK, details of which are published elsewhere [45]) and a feasibility cluster-RCT conducted with 168 children aged 2–4 years in 12 nurseries in North Somerset and Gloucestershire, England in 2015 to 2016 [45,46,47]. Overall, the NAP SACC UK intervention was delivered as planned, except for the home component (designed to support parents with their child’s PA and nutrition which was found not to be feasible), and the trial methods and design were found to be acceptable and feasible.

Post intervention (8–10 months after baseline), total activity in nursery settings was higher in the intervention nurseries compared with the control nurseries by 18.7 min/day (95% CI 3.8, 41.3) using the (underpowered) complete-case multi-level linear regression model adjusted for baseline outcome, age, gender and average hours of attendance. Evidence was less clear for improvements in anthropometry and dietary practices in the nurseries; however, the nursery managers reported improvements in several areas of feeding practice.

Given these promising outcomes of the NAP SACC UK feasibility study, together with the limited UK-based evidence for early-years settings interventions targeting diet and physical activity (particularly those targeting the early-years settings environment), there is a need to conduct a more definitive evaluation of the NAP SACC UK intervention. In response to the feasibility study findings, the intervention has been further refined by adapting the timings of intervention processes, extending the intervention period to 1 year (to include two Review and Reflect and goal setting cycles and a top-up day workshop), including lunchboxes in the Review and Reflect and workshop content and allowing for flexibility around the types of Local Authority staff who can deliver the intervention. Additionally, to improve dietary assessment, detailed data on food served and consumed using food photography will be captured to improve the assessment of diet. This will provide evidence for effectiveness and cost-effectiveness of an intervention that targets the eating and PA environments of early-years settings, which could potentially be rolled out at scale in the UK.

The aim of the trial is to evaluate the effectiveness and cost-effectiveness of the NAP SACC UK intervention to increase physical activity and diet quality, while reducing sedentary time and portion size to nationally recommended levels, using a cluster RCT design with embedded process and economic evaluations. The trial will take place in early years settings (referred to throughout as “nurseries”). The co-primary objectives are to determine whether the NAP SACC UK intervention at 12 months:

increases mean accelerometer-measured total physical activity on nursery days compared with usual practice

reduces the energy (kcal) per eating occasion averaged across snack and lunch eating occasions that occur within nurseries compared with usual practice, within Nationally recommended levels.

The secondary objectives are to determine whether the NAP SACC UK intervention, compared with usual practice at 12 months:

increases the mean moderate to vigorous physical activity time per nursery day

reduces the mean sedentary time per nursery day

increases the difference in mean accelerometer-measured total physical activity on nursery days compared to non-nursery days

reduces the mean serving size of lunch and morning/afternoon snacks in nursery per day

increases the balance of grams of core food to grams of non-core food consumed for lunch and morning/afternoon snacks in nursery per day

reduces child zBMI

reduces the proportion of children with overweight/obesity

improves child quality of life

is cost-effective

is delivered with fidelity and in a way which is acceptable and sustainable.

The NAP SACC UK study is a multicentre, parallel-group, two-arm, cluster RCT with a repeat cross-sectional design. Clusters (nurseries) will be randomised to receive either the 1-year NAP SACC UK intervention or continue with usual practice. The effectiveness and cost-effectiveness of NAP SACC UK will be assessed immediately after the 1-year intervention. Figure 1 provides a study overview and Fig. 2 provides a SPIRIT flow diagram outlining the stages of the study.

NAPSACC UK overview flow chart

SPIRIT flow diagram for NAPSACC UK study

Separate cross-sectional samples of children attending the participating nurseries will be taken at two time points. The first will be prior to randomisation (T0) and the second, immediately after the intervention (T1). NAP SACC UK is designed to be an environmental intervention influencing the whole nursery which will impact all children and not just those present at T0. Due to the movement of children during the intervention period, the children at T0 may not be representative of the cluster, thus the repeat cross-sectional design may minimise bias and has been used in previous studies [48].

The trial will include up to 56 nurseries from four areas across England and Scotland: Ayrshire and Arran (Scotland), Sandwell, Somerset and Swindon (England). These areas were selected to ensure a broad range of deprivation status and ethnicity (non-white population varying from 2% in Somerset to 30% in Sandwell [UK 2011 census]) to enable exploration of generalisability. The research will be managed from three University ‘Hubs’ local to the study areas (University of Bristol, University of Glasgow and University of Birmingham).

Nurseries within the four study areas are eligible to participate if they are: day nurseries, private nursery schools, maintained nurseries (including nurseries within Children’s Centres), nursery classes attached to primary schools and pre-schools where children consume lunch (provided by the nursery or family). Nurseries will be excluded from participating if they are: childminders, crèches, playgroups, primary school reception classes, solely outdoor nursery settings, solely Special Educational Needs and Disabilities (SEND) nursery settings, au pairs, or settings taking part in a research study or other initiative that would interfere with the NAP SACC UK study.

Participants within each nursery setting include nursery staff (managers and childcare staff), parent/carers and children. Child (and associated parent/carer participants) inclusion criteria are: aged 2 years or over at the time of assessment, not yet attending Reception (England) or Primary One (Scotland), attending the participating nurseries for a minimum of 12 h/week across the year or 15 h/week during term time, and consuming at least lunch within the setting.

The study aims to recruit nurseries across the Index of Multiple Deprivation (IMD) or Scottish Index of Multiple Deprivation (SIMD). Within each of the four sites (S)IMD scores will be assigned to all nurseries and invitations sent across the range. An email will be sent to potentially eligible settings which will include a short informative film about the study, study summary and participant information sheet. The email will be followed up by a telephone call from the research staff to the nursery manager to undertake a screening check for eligibility and offer a meeting to discuss further study details. If eligible nursery managers decide to participate in the study, they will be provided with a consent form and letter of agreement to sign. Up to 56 nurseries will be recruited with the aim of a balance across the four sites. All nursery staff from recruited settings who work directly with children aged 2 years and over will be invited to participate.

In selected and consented nurseries, all parent/carers of children aged 2-years or over will be informed about the study and invited to participate if their child attends for the minimum eligible hours. Parents will have the opportunity to review study documents as hard copies or online and view a short informative online film. Opt-in consent will be obtained for parents as participants, as well as on behalf of their associated child. The research team will be available by email or telephone to answer questions and, if appropriate, in person at a convenient time for the nursery.

Each nursery will be randomly allocated to the NAP SACC UK intervention or usual practice comparator group once all T0 data have been collected from the children, parents and staff at the nursery. Allocation will be conducted by a statistician, blind to the identity of nurseries and otherwise uninvolved in the ongoing study.

Within each hub separately, the allocation of nurseries will be conducted to minimise differences on an average IMD score (created for each nursery using the postcodes of the children recruited) at each site. Each random allocation will attempt to balance the IMD score between the two groups per site. This minimisation procedure will be written in Stata and code included in the Statistical Analysis Plan.

Two statisticians and two health economists will support this trial. The senior statistician and health economist will be blinded throughout the trial and will not have access to any identifying data. A study statistician and a health economist will perform all disaggregated analyses according to a pre-specified statistical analysis plan and health economic analysis plan, respectively. In addition, the study statistician will attend Trial Steering Committee meetings as required and prepare all interim reports, e.g., on recruitment and data completeness. The remaining members of the study team will remain blinded to aggregate data only.

Our aim is to recruit up to 56 nurseries (784 children), allowing for two nurseries withdrawing from the study and an average of 14 children per nursery, allowing for up to 35% failing to provide valid accelerometer data on nursery days. Assuming nine children will provide valid primary outcome data at each nursery, 27 nurseries in each of the intervention and control arms will provide 90% power at the 5% significance level to detect a 17-min difference (0.4 standard deviations) in total daily physical activity on nursery days. In the absence of a good estimate of the variation in mean total activity per day between nurseries, we allowed for variation up to a magnitude corresponding to an intra-cluster correlation of 0.087. The coefficient of variation of cluster size is 0.3 to account for slightly variable cluster size, i.e., different numbers of children in nurseries. As our measure of nutrition is on a continuous scale, a trial of 56 nurseries will be able to detect a 0.4 standard deviation difference in kcal, under the same assumptions. From our feasibility data, this is about 45 kcal which equates to approximately half a banana or half a cup of milk.

All consenting nurseries, nursery staff, children and parents/carers will participate in the baseline (T0) and follow-up (T1) data collection. However, the control nurseries and participants within them, will not receive the NAP SACC UK intervention and will continue practice as usual. Data will not be collected from control nurseries for the economic analysis.

Table 1 outlines the data collection time points at the nursery, child and parent level. Details of data collection methods for PA, diet and anthropometric data are also listed here.

Accelerometers will be worn for five week days.

Morning/afternoon snack and lunch diet data will be collected in nursery from consented children using the Remote Food Photography Method (RFPM) to give direct estimation of portion sizes of foods and drinks through visual comparison of photographs to standard portion size photographs [49, 50]. A researcher will take one photograph of a child’s eating occasion before consumption and one photo after. Photos are taken at a 45-degree angle and approximately at arm’s-length distance from the plate, including all the food on the plate. If a child receives additional portions of food, a photograph will be taken of the plate before the serving is added and again after to capture a photograph of the new portion. A final photo is then taken when the child finishes eating to capture any leftovers or confirm the entire serving was consumed. The photographs will be annotated to assist with food identification or portion size estimation where relevant and submitted for analysis to Pennington Biomedical Research Centre (PBRC) [51]. The photos will be processed to estimate nutrient composition of foods consumed. In the absence of the meal being weighed or specific recipe being provided from the nursery, standard recipes or volumetric portion sizes will be used based on the National Diet and Nutrition Survey (NDNS) nutrient databank [52].

All anthropometric measurements will be completed with children in a private area with a member of nursery staff. Weight will be measured without shoes in light clothing to the nearest 0.1 kg using a calibrated medical grade digital scale. Height will be measured to the nearest 0.1 cm, without shoes, using a portable stadiometer. Fieldworkers will be trained to ensure correct position for height assessment.

Two elements have been identified as critical to successful implementation: 1) the valued relationship formed between the nursery manager and NAP SACC UK Partner and 2) the motivation and “buy in” created among nursery staff at the workshops [47]. Local Authorities (or the NHS Board in Scotland) have identified relevant health or health improvement staff to take on the roles of Partners to replicate what is likely to happen in any future implementation. However, each group of staff will be trained to the same specifications. The process evaluation will explore this variation to understand its impact on how the intervention was implemented and received. The process evaluation will explore the following components:

Fidelity: the degree to which the intervention happened as planned in each area?

Acceptability: acceptance of the intervention to nursery managers, Partners and Local Authority/NHS Board commissioners.

Sustainability: exploration of the appropriateness of differing models of Partner provisions; if [and how] NAP SACC UK becomes embedded into nursery and Partner processes.

Context: the way in which context affected the fidelity, acceptability and sustainability of the intervention and how it interacted with the hypothesized mechanisms of the intervention.

The process evaluation will use a combination of methods to collect detailed information to contextualise the results of the trial and inform any potential roll-out plans should the intervention prove effective:

Semi-structured observations of Partner training and staff workshops, to explore fidelity and quality of implementation

Questionnaires to capture i) staff views on the quality and utility of the training workshops and ii) usual practice in control nurseries.

Semi-structured interviews with NAP SACC Partners and intervention nursery managers to explore implementation, acceptability, sustainability and control. Local commissioners in each area will also be interviewed to explore sustainability and fit with local priorities.

Document analysis of self-assessment and goal-setting forms to assess changes made because of the intervention.

Data will be collected to capture the costs and consequences from the perspective of the local government, nurseries and parents. The primary economic outcome will be child health-related quality of life, measured at baseline and 12 month follow-up using the parent-reported PedsQL for 2–4 year olds. The developer of the PedsQL measurement tool advised that this measure would be suitable for parents in our study who are completing the measure for a 5 year old child. Versions of the PedsQL for older children include questions about school which would not be relevant to our participants. We will capture costs related to each perspective using various methods, including:

Intervention training costs (local government perspective): Study records will document all costs incurred during the 2-day Partner training to deliver the NAP SACC UK intervention.

Intervention delivery costs (local government perspective): NAP SACC UK Partners will complete an electronic log where they will record the contact time they had with each nursery provider. The Partners will also be asked to record details on the type of nursery staff whom they have been in contact with and the mode of delivery.

Implementation costs (nursery perspective): At the 6-month point in the delivery of the intervention - all nursery managers for the intervention arm will be asked to complete a short health economic questionnaire. To prepare the nursery managers, they will be sent the questionnaire in advance to report on whether any of the actions they undertook as part of the NAP SACC UK intervention, have had an impact on staff time and/or resulted in a financial cost to the nursery during the previous 6-month period. Nursery managers will also be asked whether the workshops took place out-of-hours and if this incurred a financial cost to the nursery. At 12 months, a subsample (~ 50%) of nursery managers from the intervention group will be asked to complete the same health economic questionnaire. In addition, the subsample of nursery managers who are taking part in the process evaluation will also be invited to repeat the health economic questionnaire at the 12-month time point.

Participation costs (parent perspective): At 12 months, time and out-of-pocket costs incurred by the parents during the 12-month intervention period will be captured through parental self-report questionnaires.

Our feasibility study indicated insufficient value in collecting information from parents on their children’s use of healthcare during the intervention to justify the burden. Healthcare use in this generally healthy population was infrequent and believed to be very unlikely to be causally related to the intervention.

To thank all participating nursery schools, in both the intervention and control arms, we will provide £300 on completion of the study, along with a summary of results at nursery level. Following data collection, participating children will receive a small token of thanks in the form of a sticker and a children’s book; parents will receive a £10 voucher on return of their child’s accelerometer.

Table 2 outlines the detail of the intervention using the TIDieR reporting guidance as a framework. Local Authorities have chosen the most appropriate locally employed staff to deliver the intervention (public health practitioners with expertise in public health, nutrition or physical activity who are referred to as NAP SACC UK Partners), to enable us to test the effectiveness of the intervention as it might be delivered outside a trial.

Valid accelerometer data will be at least 2 days of data worn for at least 6 h per 24 h, informed by the methodology used by Pate et al. [53]. Given the variability of opening times and child attendance between nurseries, the minimum number of hours in order to be categorised as a ‘nursery day’ will be explored and a suitable cut-off used. Periods of 60-min with zero values will be interpreted as time that the monitor is not worn. A day will be considered valid if ≥ 6 h of data are recorded on a day when the child attended nursery. Children with ≥ 2 nursery days of accelerometer data will be included in the analyses. Mean minutes of sedentary time (using two thresholds of 0–25 and 0–199 counts per 15 s using the criteria proposed by Evenson and Puyau [54, 55]) will be used and mean minutes of light, moderate to vigorous intensity physical activity will be processed (thresholds of 200–799; and > = 800 counts per 15 s) [56]. Mean accelerometer counts per minute, which provides an indication of the overall volume of physical activity in which the children engage will also be calculated as this approach facilitates comparison with studies that may have applied a different cut-point. The accelerometer data will be checked for outliers. Informed by previous studies with children we will exclude implausibly high values, such as might occur when a participant uses a trampoline, using a cap of 11,714 counts per minute (cpm) [57].

Total eating occasion size (kcal per occasion) will be computed from the sum of energy in each portion food or drink consumed for each snack (morning or afternoon) or lunch consumed in nursery. The average total size of eating occasions consumed within nursery for each child will then be derived (primary outcome). Specific foods will also be classified as core or non-core and the total intake (kcal) of core and non-core foods will be separately summed in each eating occasion consumed at nursery and expressed as a percentage of total energy consumed in an eating occasion for each child [14]. To represent the balance of healthy to less-healthy food intake consumed, the average percentage of core and non-core food in lunch and morning/afternoon snacks consumed by each child will be calculated.

The primary and secondary analyses will be pre-specified in a statistical analysis plan which will be written whilst blinded to the accumulating outcome data and will be made publicly available before the conclusion of the follow-up period. The evidence for an overall intervention effect on the primary outcomes (physical activity and nutrition) will be estimated using a multilevel linear regression model, which will include the following nursery level covariates: intervention group, IMD as used to stratify the allocation, local authority, and a random effect to accommodate variation between nurseries (clustering). The intervention effects will be presented as differences in average total activity and total energy consumed per eating occasion with their 95% confidence intervals. The exact specification of the primary analysis will be informed by an inspection of the baseline measurements of the primary outcomes.

The primary analysis approach will be adapted to estimate the intervention effect on each of the secondary outcomes, utilizing univariate multilevel linear regression (continuous outcome measures) or univariate multilevel logistic regression (binary outcome measures).

We will examine whether the intervention effect on the two primary outcome measures varies by sub-groups of participants. These sub-groups will be pre-specified in the statistical analysis plan and may include parental employment status, geographical area, child’s gender and time spent in nursery.

Sensitivity analyses will repeat the primary analysis with variations to the method that include the following (i) additional covariates where one or more measures was found to be unbalanced at baseline; (ii) missing data imputed under different assumptions about the mechanisms leading to those data being missing; and (iii) excluding outliers if inspection reveals that outliers are genuine.

Information collected from document analysis, questionnaires and structured elements of the training sessions/workshops observations will be entered into the REDCap data management system or an Excel file. Interview transcripts, qualitative observations and fieldnotes will be uploaded into NVivo 12 to aid data management and analysis and analysed to identify key themes. An initial coding framework will be developed by two staff including both deductive codes derived from research questions and inductive codes identified from initial readings of early transcripts. This framework will be independently applied to two to four further transcripts depending on the consistency of coding; any discrepancies in coding will be discussed and appropriate revisions made. The final framework will be applied to all subsequent transcripts with any additions or revisions recorded. We will triangulate between different process evaluation data sources (observations, questionnaires, documentary data and interviews) to identify confirmatory or contradictory results. For example, we will compare data from the observations of training workshops with the staff evaluation forms and comments from nursery manager and/or Partner interviews to understand how the workshops were received and their importance within the intervention as a whole.

The primary economic analysis will consist of a within-trial cost consequences analysis (CCA) from the perspective of the local government, nursery and parents. Results from the within-trial CCA will allow the costs and consequences to be presented clearly in a disaggregated format rather than summarised into a single index. If there is an important difference in physical activity and/or diet at T1, a secondary analysis considering the potential longer-term costs and outcomes of the intervention will be considered. This would include a review of the economic evidence on the medium- and long-term costs and consequences of changes in physical activity and diet in young children.

The trial aims to evaluate the effectiveness and cost-effectiveness of the NAP SACC UK intervention to increase physical activity, reduce sedentary time and improve the quality and quantity of nutritional intake. The trial builds on the success of the feasibility study, the evaluations of the intervention and subsequent adoption across the US. The trial initially started in July 2019 and was paused from March 2020 to January 2022 because of the disruption to research in childcare settings arising from COVID-19. Following discussion with nurseries, collaborators and the funder, we restarted the study in February 2022. Some of the initial outcome measures and processes were refined and this protocol represents the study upon restarting in 2022.

If the NAP SACC UK intervention is found to be effective, this will have important policy and practice implications for the commissioning of programmes to prevent obesity, improve physical activity and nutrition in early years settings in the UK. We also have the scope to apply for additional funding to explore longer term impacts on z-BMI, height and weight beyond the early years’ settings. The trial is deliberately pragmatic in the use of public health staff or staff from commissioned services who work on physical activity and nutrition beyond health visitors as used in the feasibility trial.

The Chief Investigator will manage access rights to the data set. Prospective new users must demonstrate compliance with legal, data protection and ethical guidelines before any data are released. We anticipate that anonymised trial data will be shared with other researchers to enable meta-analyses.

Body Max Index

Cost consequence analysis

Confidence Interval

Coronavirus disease

Counts per Minute

Clinical Trials Unit

Index of Multiple Deprivation

Moderate to Vigorous Physical Activity

National Diet and Nutrition Survey

National Health Service

National Institute for Health Research

NIHR Public Health Research programme

Physical Activity

Pennington Biomedical Research Centre

Pediatric Quality of Live Inventory

Randomised Control Trial

Research Ethics Committee

Research Electronic Data Capture

Remote Food Photography Method

Social Cognitive Theory

Standard Deviation

Special Educational Needs and Disabilities

Template for Intervention Description and Replication

Trial Steering Committee

United Kingdom

United States of America/United States

University of Bristol

BMI Z-score

Population Health Team ND. National Child Measurement Programme, England 2020/21 School Year. NHS Digital, Government Statistical Service; 2021.

Government S. Scottish Health Survey 2019 - volume 1: main report 2020. Available from: http://www.gov.scot/publications/scottish-health-survey-2019-volume-1-main-report/. Accessed 10 Jan 2022.

Strong WB, Malina RM, Blimkie CJ, Daniels SR, Dishman RK, Gutin B, et al. Evidence based physical activity for school-age youth. J Pediatr. 2005;146(6):732–7.

Article PubMed Google Scholar

Carson V, Lee EY, Hewitt L, Jennings C, Hunter S, Kuzik N, et al. Systematic review of the relationships between physical activity and health indicators in the early years (0–4 years). BMC Public Health. 2017;17:854.

Article PubMed PubMed Central Google Scholar

Hayes G, Dowd KP, MacDonncha C, Donnelly AE. Tracking of physical activity and sedentary behavior from adolescence to young adulthood: a systematic literature review. J Adolesc Health. 2019;65(4):446–54.

Article PubMed Google Scholar

Officers UCM. UK Chief Medical Officers’ physical activity guidelines. In: Care DoHaS, editor. 2019.

Digital N. Health survey for England. England; 2016. Available from: https://digital.nhs.uk/data-and-information/publications/statistical/health-survey-for-england/health-survey-for-england-2015#:~:text=Children's%20physical%20activity,least%2060%20minutes%20every%20day.

Pate RR, McIver K, Dowda M, Brown WH, Addy C. Directly observed physical activity levels in preschool children. J Sch Health. 2008;78(8):438–44.

Article PubMed Google Scholar

Hesketh KR, Griffin SJ, van Sluijs EMF. UK Preschool-aged children’s physical activity levels in childcare and at home: a cross-sectional exploration. Int J Behav Nutr Phys Act. 2015;12(1):1–9.

Article Google Scholar

Dobell AP, Eyre ELJ, Tallis J, Chinapaw MJM, Altenburg TM, Duncan MJ. Examining accelerometer validity for estimating physical activity in pre-schoolers during free-living activity. Scand J Med Sci Sports. 2019;29(10):1618–28.

Article PubMed Google Scholar

Copeland KA, Khoury JC, Kalkwarf HJ. Child care center characteristics associated with preschoolers’ physical activity. Am J Prev Med. 2016;50(4):470–9.

Article PubMed Google Scholar

Luque V, Escribano J, Closa-Monasterolo R, Zaragoza-Jordana M, Ferre N, Grote V, et al. Unhealthy dietary patterns established in infancy track to mid-childhood: the EU childhood obesity project. J Nutr. 2018;148(5):752–9.

Article PubMed Google Scholar

Ventura AK, Worobey J. Early influences on the development of food preferences. Curr Biol. 2013;23(9):R401–8.

Article CAS PubMed Google Scholar

Toumpakari Z, Haase AM, Johnson L. Adolescents’ non-core food intake: a description of what, where and with whom adolescents consume non-core foods. Public Health Nutr. 2016;19(9):1645–53.

Article PubMed PubMed Central Google Scholar

Johnson L, Mander AP, Jones LR, Emmett PM, Jebb SA. Energy-dense, low-fiber, high-fat dietary pattern is associated with increased fatness in childhood. Am J Clin Nutr. 2008;87(4):846–54.

Article CAS PubMed Google Scholar

Sirkka O, Fleischmann M, Abrahamse-Berkeveld M, Halberstadt J, Olthof MR, Seidell JC, et al. Dietary patterns in early childhood and the risk of childhood overweight: the GECKO Drenthe birth cohort. Nutrients. 2021;13(6):2046.

Article CAS PubMed PubMed Central Google Scholar

Ziauddeen N, Page P, Penney TL, Nicholson S, Kirk SFL, Almiron-Roig E. Eating at food outlets and leisure places and “on the go” is associated with less-healthy food choices than eating at home and in school in children: cross-sectional data from the UK National Diet and Nutrition Survey Rolling Program (2008–2014). Am J Clin Nutr. 2018;107(6):992–1003.

Article PubMed PubMed Central Google Scholar

England PH. National Diet and Nutrition Survey Rolling programme Years 9 to 11 (2016/2017 to 2018/2019). 2020.

Syrad H, Llewellyn CH, Johnson L, Boniface D, Jebb SA, van Jaarsveld CHM, et al. Meal size is a critical driver of weight gain in early childhood. Sci Rep-Uk. 2016;6:28368.

Article CAS Google Scholar

Neelon SE, Burgoine T, Hesketh KR, Monsivais P. Nutrition practices of nurseries in England. Comparison with national guidelines. Appetite. 2015;85:22–9.

Article PubMed PubMed Central Google Scholar

Children Af. Eat better start better: voluntary food and drink guidelines for early years settings in England - a practical guide. London: Action for children; 2017.

Maher EJ, Li GH, Carter L, Johnson DB. Preschool child care participation and obesity at the start of kindergarten. Pediatrics. 2008;122(2):322–30.

Article PubMed Google Scholar

Albakri M, Basi T, Forsyth E, Patel R, Skipp A, Tanner E. Take-up of free early education entitlements. In: Education Df, editor. 2018. p. 97.

Government S. Chapter 5: early learning and childcare. 2021. Available from: https://www.gov.scot/publications/summary-statistics-schools-scotland/pages/6/.

Education Df. Survey of childcare and early years providers 2021. 2021.

Scotland NH. Setting the table. 2018. p. 143.

Education TSoSf. The requirements for school food regulations 2014 (legislation.gov.uk). London: Uk Government; 2014.

Google Scholar

Education Df. National curriculum in England: physical education programmes of study. In: Education Do, editor. London: Department of Education; 2013.

Hesketh KD, Campbell KJ. Interventions to prevent obesity in 0–5 year olds: an updated systematic review of the literature. Obesity (Silver Spring). 2010;18(Suppl 1):S27-35.

Article PubMed Google Scholar

Larson N, Ward DS, Neelon SB, Story M. What role can child-care settings play in obesity prevention? A review of the evidence and call for research efforts. J Am Diet Assoc. 2011;111(9):1343–62.

Article PubMed Google Scholar

Narzisi K, Simons J. Interventions that prevent or reduce obesity in children from birth to five years of age: a systematic review. J Child Health Care. 2021;25(2):320–34.

Article PubMed Google Scholar

Ward DS, Vaughn A, McWilliams C, Hales D. Interventions for increasing physical activity at child care. Med Sci Sports Exerc. 2010;42(3):526–34.

Article PubMed Google Scholar

Summerbell CD, Waters E, Edmunds LD, Kelly S, Brown T, Campbell KJ. Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2005;(3):CD001871. https://doi.org/10.1002/14651858.CD001871.pub2.

Brown T, Moore TH, Hooper L, Gao Y, Zayegh A, Ijaz S, et al. Interventions for preventing obesity in children. Cochrane Database Syst Rev. 2019;7:CD001871.

PubMed Google Scholar

Hodgkinson A, Abbott J, Hurley MA, Lowe N, Qualter P. An educational intervention to prevent overweight in pre-school years: a cluster randomised trial with a focus on disadvantaged families. BMC Public Health. 2019;19(1):1430.

Article PubMed PubMed Central Google Scholar

Malden S, Reilly JJ, Gibson AM, Bardid F, Summerbell C, De Craemer M, et al. A feasibility cluster randomised controlled trial of a preschool obesity prevention intervention: ToyBox-Scotland. Pilot Feasibility Stud. 2019;5:128.

Article PubMed PubMed Central Google Scholar

Reilly JJ, Kelly L, Montgomery C, Williamson A, Fisher A, McColl JH, et al. Physical activity to prevent obesity in young children: cluster randomised controlled trial. BMJ. 2006;333(7577):1041.

Article PubMed PubMed Central Google Scholar

Benjamin SE, Ammerman A, Sommers J, Dodds J, Neelon B, Ward DS. Nutrition and physical activity self-assessment for child care (NAP SACC): results from a pilot intervention. J Nutr Educ Behav. 2007;39(3):142–9.

Article PubMed Google Scholar

Bandura A. Social foundations of thought and action: a social cognitive theory. 2nd edn. New Jersey: Prentice-Hall; 1986.

Bronfenbrenner U. The ecology of human development: experiments by nature and design. Cambridge: Harvard Univesity Press; 1979.

McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q. 1988;15(4):351–77.

Article CAS PubMed Google Scholar

Ward D, Hales D, Haverly K, Marks J, Benjamin S, Ball S, et al. An instrument to assess the obesogenic environment of child care centers. Am J Health Behav. 2008;32(4):380–6.

Article PubMed Google Scholar

Alkon A, Crowley AA, Neelon SE, Hill S, Pan Y, Nguyen V, et al. Nutrition and physical activity randomized control trial in child care centers improves knowledge, policies, and children’s body mass index. BMC Public Health. 2014;14:215.

Article PubMed PubMed Central Google Scholar

Bonis M, Loftin M, Ward D, Tseng TS, Clesi A, Sothern M. Improving physical activity in daycare interventions. Child Obes. 2014;10(4):334–41.

Article PubMed Google Scholar

Kipping R, Langford R, Brockman R, Wells S, Metcalfe C, Papadaki A, et al. Child-care self-assessment to improve physical activity, oral health and nutrition for 2- to 4-year-olds: a feasibility cluster RCT. Public Health Res. 2019;7(13):1–64.

Article Google Scholar

Kipping R, Jago R, Metcalfe C, White J, Papadaki A, Campbell R, et al. NAP SACC UK: protocol for a feasibility cluster randomised controlled trial in nurseries and at home to increase physical activity and healthy eating in children aged 2–4 years. BMJ Open. 2016;6(4):e010622.

Article CAS PubMed PubMed Central Google Scholar

Langford R, Jago R, White J, Moore L, Papadaki A, Hollingworth W, et al. A physical activity, nutrition and oral health intervention in nursery settings: process evaluation of the NAP SACC UK feasibility cluster RCT. BMC Public Health. 2019;19(1):865.

Article PubMed PubMed Central Google Scholar

Bonell C, Allen E, Warren E, McGowan J, Bevilacqua L, Jamal F, et al. Effects of the Learning Together intervention on bullying and aggression in English secondary schools (INCLUSIVE): a cluster randomised controlled trial. Lancet. 2018;392(10163):2452–64. https://doi.org/10.1016/S0140-6736(18)31782-3.

Nicklas T, Islam NG, Saab R, Schulin R, Liu Y, Butte NF, et al. Validity of a digital diet estimation method for use with preschool children. J Acad Nutr Diet. 2018;118(2):252–60.

Article PubMed Google Scholar

Nicklas T, Saab R, Islam NG, Wong W, Butte N, Schulin R, et al. Validity of the remote food photography method against doubly labeled water among minority preschoolers. Obesity (Silver Spring). 2017;25(9):1633–8.

Article PubMed Google Scholar

Fitt E, Cole D, Ziauddeen N, Pell D, Stickley E, Harvey A, et al. DINO (Diet In Nutrients Out) - an integrated dietary assessment system. Public Health Nutr. 2015;18(2):234–41.

Article PubMed Google Scholar

University of Cambridge NSR. National diet and nutrition survey years 1–11, 2008–2019 [data collection]. 2021.

Pate RR, Brown WH, Pfeiffer KA, Howie EK, Saunders RP, Addy CL, et al. An intervention to increase physical activity in children: a randomized controlled trial with 4-year-olds in preschools. Am J Prev Med. 2016;51(1):12–22.

Article PubMed PubMed Central Google Scholar

Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG. Calibration of two objective measures of physical activity for children. J Sports Sci. 2008;26(14):1557–65.

Article PubMed Google Scholar

Puyau MR, Adolph AL, Vohra FA, Butte NF. Validation and calibration of physical activity monitors in children. Obes Res. 2002;10(3):150–7.

Article PubMed Google Scholar

van Cauwenberghe E, Labarque V, Trost SG, de Bourdeaudhuij I, Cardon G. Calibration and comparison of accelerometer cut points in preschool children. Int J Pediatr Obes. 2011;6(2–2):e582–9.

Article PubMed Google Scholar

Rich C, Geraci M, Griffiths L, Sera F, Dezateux C, Cortina-Borja M. Quality control methods in accelerometer data processing: identifying extreme counts. PLoS One. 2014;9(1):e85134.

Article PubMed PubMed Central Google Scholar

Download references

The sponsor of this study is the University of Bristol, Research and Enterprise Development, 2nd Floor, Augustine’s Courtyard, Orchard Lane, Bristol, BS1 5DS www.bristol.ac.uk/red/. The authors thank all the children, parents and childcare provider staff who took part in NAP SACC UK. We thank NAP SACC UK partners and trainers. We thank collaborators for their support of the study. We also thank the Chair and members of the Trial Steering Committee for their advice and support. The views expressed in this paper are those of the authors and not necessarily anyone in this acknowledgement list.

The NAP SACC UK study is funded by the UK National Institute for Health and Care Research (NIHR) Public Health Research Programme (12/75/51). This study was designed and delivered in collaboration with the Bristol Trials Centre (BTC), a UKCRC Registered Clinical Trials Unit which is in receipt of NIHR CTU Support Funding. Pennington Biomedical’s Remote Food Photography Method© was utilised during the study, and Pennington Biomedical is supported by NORC Center Grant P30 DK072476 entitled “Nutrition and Metabolic Health Through the Lifespan” sponsored by the National Institute of Diabetes and Digestive and Kidney Disease and by grant U54 GM104940 from the National Institute of General Medical Sciences, which funds the Louisiana Clinical and Translational Science Center. None of the funders nor the study sponsor had involvement in the Trial Steering Committee, the collection, analysis, or interpretation of data or writing of the paper. Intervention costs have been funded by the Office for Health Improvement and Disparities (OHID), Sandwell Metropolitan Borough Council, Swindon Borough Council and Ayrshire and Arran Council. The views and opinions expressed in this publication are those of the authors and do not necessarily reflect those of the funding bodies listed here.

For the purpose of Open Access, the author has applied [a Creative Commons Attribution (CC BY) licence] [an ‘Open Government Licence’] (or where permitted by the NIHR) [a Creative Commons Attribution No-derivatives (CC BY-ND) licence] to any Author Accepted Manuscript version arising.

University of Bristol, Bristol, UK

Ruth Kipping, Kim Hannam, Kate Willis, Chris Metcalfe, Russell Jago, Rebecca Langford, William Hollingworth, Madeleine Cochrane, Pete Blair, Zoi Toumpakari, Tom Reid, Megan Pardoe & Liping Wen

University of Birmingham, Birmingham, UK

Miranda Pallan, Alex Dobell & Marie Murphy

NatCen Social Research, London, UK

Laura Johnson

Pennington Biomedical Research Center, Baton Rouge, USA

Corby K. Martin

Cardiff University, Cardiff, Wales

James White

Bristol Trials Centre, University of Bristol, Bristol, UK

Jodi Taylor

University of North Carolina, Chapel Hill, USA

Dianne Ward

MRC / CSO Social & Public Health Sciences Unit, University of Glasgow, Glasgow, UK

Laurence Moore, Anne Martin & Sharon Anne Simpson

School of Social and Political Sciences and MRC/CSO Social and Public Health Sciences Unit, University of Glasgow, Glasgow, UK

Stephanie Chambers

You can also search for this author in PubMed Google Scholar

The study was conceived by RK, MP, CM, RJ, LJ, RL, CM, WH, JW, DW, LM and SS. KH and KW are the Trial Managers, AD is a Research Fellow working on the trial, MC is the health economics analyst, LW is the statistical analyst. JT is the trials centre lead and PB is the trial statistician, ZT and LJ are the nutrition co-leads. The first draft of this manuscript was written by RK, KH, AD and MP with input from all other authors. All authors have edited and critically reviewed the paper and approved the final version of the paper.

University of Bristol, University of Birmingham, NatCen Social Research, Pennington Biomedical Research Center, Cardiff University, University of North Carolina University of Glasgow.

Correspondence to Ruth Kipping.

This study was approved by the Faculty of Health Sciences Research Ethics Committee at the University of Bristol (REF: 6373) on 09/10/2019. Parents of children eligible to participate in the study must provide written informed consent for themselves as participants as well as on behalf of the associated child to participate. This can either be provided as a handwritten hard copy of the consent form or as e-consent via our study database. The protocol of this study has regard for the HRA guidance. The reporting of findings will be in accordance with the CONSORT guidelines.

This trial will run in accordance with GCP. Compliance with this standard provides public assurance that the rights, safety and well-being of trial subjects are protected, in accordance to the Declaration of Helsinki guidelines.

Not applicable.

The authors declare that they have no competing interests with the exception of CM: The intellectual property surrounding the Remote Food Photography Method© (RFPM) is owned by Pennington Biomedical Research Center / Louisiana State University and Corby Martin is an inventor of the technology.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

Kipping, R., Pallan, M., Hannam, K. et al. Protocol to evaluate the effectiveness and cost-effectiveness of an environmental nutrition and physical activity intervention in nurseries (Nutrition and Physical Activity Self Assessment for Child Care - NAP SACC UK): a multicentre cluster randomised controlled trial. BMC Public Health 23, 1475 (2023). https://doi.org/10.1186/s12889-023-16229-y

Download citation

Received: 26 June 2023

Accepted: 01 July 2023

Published: 02 August 2023

DOI: https://doi.org/10.1186/s12889-023-16229-y

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative