NutriSTEP® is Reliable for Internet and Onscreen Use
Publication: Canadian Journal of Dietetic Practice and Research
17 February 2015
Abstract
Purpose: NutriSTEP® screens for nutritional risk in preschoolers (3–5 years of age). Availability has been limited to paper versions. The objective is to test reliability for Internet and Onscreen use.
Methods: Two studies were conducted with parents in several Ontario Early Years Centres (Internet (n = 63)) and in the community and schools in Timmons, Guelph, and Ottawa, Ontario (Onscreen (n = 64)). Parents completed NutriSTEP® either on paper or using Internet or Onscreen versions. Two weeks later, the alternate mode was completed. Reliability was assessed using Intraclass Correlations (ICC) and Pearson Correlations (PC) on total and attribute scores, Kappa coefficients (κ) for risk, and Wilcoxon Signed Rank Test for responses on individual questions.
Results: For total scores, Internet and Onscreen ICCs were 0.94 and 0.91, respectively, with PCs of 0.89 and 0.84, respectively. Attribute scores were 0.69–0.91 (ICC) and 0.70–0.84 (PC) for Internet, and 0.81–0.92 (ICC) and 0.68–0.85 (PC) for Onscreen. κ amongst risk categories was 0.58 (P = 0.000) for Internet and 0.50 (P = 0.000) for Onscreen. For individual dichotomized questions, 5 of 17 (Onscreen and Internet) were excellent (κ > 0.75); 11 of 17 (Internet) and 9 of 17 (Onscreen) were adequate (0.40 < κ > 0.75); 0 of 17 (Internet) and 2 of 17 (Onscreen) questions were poor (κ < 0.4) in agreement between modes.
Conclusions: Internet and Onscreen versions of NutriSTEP® are reliable.
Résumé
Objectif. NutriSTEPMD permet de dépister le risque nutritionnel chez les enfants d’âge préscolaire (de 3 à 5 ans). Jusqu’à présent, seules des versions papier de cet outil étaient disponibles. L'objectif de cette étude est d’évaluer la fiabilité d'une version en ligne et à l’écran.
Méthodes. Deux études ont été menées auprès de parents dans plusieurs centres de la petite enfance de l'Ontario (Internet [n = 63]) et dans la communauté et les écoles ontariennes de Timmons, Guelph et Ottawa (à l’écran [n = 64]). Les parents ont rempli le questionnaire NutriSTEPMD sur papier ou à l'aide de la version en ligne ou à l’écran. Deux semaines plus tard, les participants devaient remplir le questionnaire en ayant recours à l'autre méthode. La fiabilité a été évaluée au moyen de coefficients de corrélation intraclasse (CIC) et de coefficients de corrélation de Pearson (CCP) pour les scores totaux et les scores d'attribut, de coefficients kappa (κ) pour le risque, et du test de Wilcoxon pour observations appariées pour les réponses aux questions individuelles.
Résultats. En ce qui a trait aux scores totaux, les CIC pour les options en ligne et à l’écran étaient de 0,94 et 0,91, respectivement, et les CCP, de 0,89 et 0,84, respectivement. Les scores d'attribut oscillaient entre 0,69 et 0,91 (CIC) et 0,70 et 0,84 (CCP) pour la version en ligne, et entre 0,81 et 0,92 (CIC) et 0,68 et 0,85 (CCP) pour la version à l’écran. Dans les catégories de risques, κ représentait 0,58 (p = 0,000) pour la version en ligne et 0,50 (p = 0,000) pour la version à l’écran. Pour ce qui est des questions dichotomiques individuelles, 5 sur 17 (à l’écran et en ligne) étaient excellentes (κ > 0,75); 11 sur 17 (en ligne) et 9 sur 17 (à l’écran) étaient adéquates (0,40 < κ > 0,75); 0 sur 17 (en ligne) et 2 sur 17 (à l’écran) ont été jugées faibles (κ < 0,4) conformément aux deux méthodes.
Conclusions. Les versions en ligne et à l’écran de NutriSTEPMD sont fiables.
Get full access to this article
View all available purchase options and get full access to this article.
References
1
Baker JL, Olsen LW, and Sorensen TIA Childhood body mass index and the risk of coronary heart disease in adulthood N Engl J Med. 2007 357 23 2329 -37
2
Weichselbaum E and Buttriss J Nutrition, health and schoolchildren Nutr Bull. 2011 36 295 -355
3
American Dietetic Association. ADA's definitions for nutrition screening and nutrition assessment ADA's definitions for nutrition screening and nutrition assessment J Am Diet Assoc 1994 94 838 -9
4
Rush D Nutrition screening in old people: its place in the coherent practice of preventative health care Ann Rev Nutr. 1997 17 101 -25
5
Keller HH, Goy HRK, and Kane SI Validity and reliability of SCREEN II (Seniors in the community: risk evaluation for eating and nutrition, version II) Eur J Clin Nutr. 2005 59 10 1149 -57
6
Rysdale L, Witchell E, Keller H, Randall Simpson J, Turfryer M, McGibbon K, et al. Parent perceptions of NutriSTEP and nutrition risk screening in a sample of Ontario preschool children Infant Child Adolesc Nutr. 2011 3 197 -204
7
Shields M. Nutrition: findings from the Canadian Community Health Survey. Measured obesity: overweight Canadian Children and Adolescents; 2005 [cited 2013 Aug 26]. Available from: http://www.statcan.gc.ca/pub/82-620-m/2005001/pdf/4193660-eng.pdf.
8
Southgate KM, Keller HH, and Reimer HD Determining knowledge and behaviour change after nutrition screening Can J Diet Pract Res. 2010 71 3 128 -33
9
Keller HH, Haresign H, and Brockest B Process evaluation of bringing nutrition screening to seniors in Canada (BNSS) Can J Diet Pract Res. 2007 68 2 86 -91
10
Tremblay MS and Willms JD Is the Canadian childhood obesity epidemic related to physical inactivity? Int J Obes Relat Metab Disord. 2003 27 9 1100 -5
11
Tremblay MS, Shields M, Laviolette M, Craig CL, Janssen I, and Connor Gorber S Fitness of Canadian children and youth: results from the 2007–2009 Canadian Health Measures Survey Health Reports (Statistics Canada catalogue 82–003) 2010 21 1 7 -20
12
Boulos R, Vikre EK, Oppenheimer S, Chang H, and Kanarek RB ObesiTV: how television is influencing the obesity epidemic Physiol Behav. 2012 107 146 -53
13
Kirkpatrick SI and Tarasuk V Food insecurity is associated with nutrient inadequacies among Canadian adults and adolescents J Nutr. 2008 138 604 -12
14
Chief Medical Officer of Health. Healthy Weights, Healthy Lives; 2004 Chief Medical Officer of Health Report. 2004. [cited 2015 Jan 6]. Available from: http://www.health.gov.on.ca/en/common/ministry/publications/reports/
cmoh04_report/cmoh_04.aspx.
cmoh04_report/cmoh_04.aspx.
15
Randall Simpson JA, Keller HH, Rysdale LA, and Beyers BE Nutrition screening tool for every preschooler (NutriSTEP™): validation and test–retest reliability of a parent-administered questionnaire assessing nutrition risk of preschoolers Eur J Clin Nutr. 2008 62 770 -80
16
Whyte K, Rysdale L, Keller H, Beyers J, and Randall Simpson J Test-retest reliability and construct validity of Toddler NutriSTEP® Appl Phys Nutr Met. 2012 37 3 595
17
Randall Simpson J, Whyte K, Lac J, Rysdale L, Keller H, and Beyers J Validation of Toddler NutriSTEP FASEB J. 2013 27 617
18
Gumbley J, Holland N, Song J, Rysdale L, Turfryer M, Beyers H, et al. Content validation of Toddler NutriSTEP® Appl Phys Nutr Met. 2011 36 427
19
Watson-Jarvis K, McNeil D, Fenton TR, and Campbell K Implementing the nutrition screening tool for every preschooler (NutriSTEP®) in community health centres Can J Diet Pract Res. 2011 72 2 96 -8
20
Watson-Jarvis K, Fenton TR, McNeil D, and Campbell K Preschool nutrition risk in Calgary Can J Diet Pract Res. 2011 72 1 e101 -6
21
Persaud N, Maguire JL, Lebovic G, Carsley S, Khovratovich M, Randall Simpson JA, et al. Association between serum cholesterol and eating behaviours during early childhood: a cross-sectional study Can Med Assoc J. 2013 185 11 e531 -6
22
Jones JM Reliability of nutritional screening and assessment tools Nutrition. 2004 20 307 -11
23
The International Test Commission International guidelines on computer-based and internet-delivered testing Int J Test. 2006 6 2 143 -71
24
Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. 4th ed. Oxford University Press; 2008.
25
Statistics Canada.Canadian community health survey (CCHS). Questionnaire for Cycle 1.1 (September 2000–November 2001). Statistics Canada: Ottawa, ON, Canada; 2001.
26
Donker DK, Hasman A, and Van Geign HP Interpretation of low kappa values Int J Biomed Comput. 1993 33 55 -64
27
Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, and McGhee EM The effectiveness of web-based vs. non-web-based interventions: a meta-analysis of behavioral change outcomes J Med Internet Res. 2004 6 4 e40
28
Mackert M, Kahlor L, Tyler D, and Gustafson J Designing e-health interventions for low-health-literate culturally diverse parents: addressing the obesity epidemic Telemed J E Health. 2009 15 7 672 -7
29
Khoo K, Bolt P, Babl FE, Jury S, and Goldman RD Health information seeking by parents in the internet age J Paediatr Child Health. 2008 44 7-8 419 -23
30
McMullan M Patients using the internet to obtain health information: how this affects the patient-health professional relationship Patient Educ Couns. 2006 63 1–2 24 -8
31
Beath H and Keller H Nutrition screen showed good agreement when self- and interviewer administered J Clin Epidemiol. 2007 60 1085 -9
32
Huhmann MB, Perez V, Alexander DD, and Thomas DR Self-completed nutrition screening tool for community dwelling older adults with high reliability; a comparison study J Nutr Health Aging. 2013 17 4 339 -44
33
Magunkusumo RT, Duisterhout JS, deGraaff N, Maarsingh EJ, de Koning HJ, and Raat H Internet versus paper mode of health and health behavior questionnaires in elementary schools: asthma and fruit as examples J Sch Health. 2006 76 2 80 -6
34
Vallejo MA, Jordán CM, Díaz MI, Comeche MI, and Ortega J Psychological Assessment via the Internet: A Reliability and Validity Study of Online (vs Paper and-Pencil) Versions of the General Health Questionnaire-28 (GHQ-28) and the Symptoms Check-List-90-Revised (SCL-90-R) J Med Internet Res. 2007 9 1 e2
35
Holländare F, Andersson G, and Engström I A comparison of psychometric properties between internet and paper versions of two depression instruments (BDI-II and MADRS-S) administered to clinic patients J Med Internet Res. 2010 12 5 e49
36
Basnov M, Kongsved SM, Bech P, and Hjollund NH Reliability of short form-36 in an Internet- and a pen-and-paper version Inform Health Soc Care. 2009 34 1 53 -8
37
Statistics Canada. Immigration and Ethnocultural Diversity in Canada; 2011 [cited 2014 Mar 24]. Available from http://www12.statcan.gc.ca/nhs-enm/2011/as-sa/99-010-x/99-010-x2011001-eng.cfm#a4.
Information & Authors
Information
Published In
Canadian Journal of Dietetic Practice and Research
Volume 76 • Number 1 • March 2015
Pages: 9 - 14
History
Version of record online: 17 February 2015
Authors
Metrics & Citations
Metrics
Other Metrics
Citations
Cite As
Bianca Carducci MSc, Maria Reesor BASc, Helen Haresign MSc, RD, Lee Rysdale MEd, RD, Heather Keller PhD, RD, Joanne Beyers MA, RD, Stéphanie Paquette-Duhaime BASc, RD, O'Connor Amy MSc, RD, and Simpson Janis Randall PhD, RD. 2015. NutriSTEP® is Reliable for Internet and Onscreen Use. Canadian Journal of Dietetic Practice and Research.
76(1): 9-14. https://doi.org/10.3148/cjdpr-2014-029
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
There are no citations for this item
View Options
Get Access
Login options
Check if you access through your login credentials or your institution to get full access on this article.
Subscribe
Click on the button below to subscribe to Canadian Journal of Dietetic Practice and Research
