Inter-rater reliability in classification of canonical babbling status based on canonical babbling ratio in infants with isolated cleft palate randomised to Timing of Primary Surgery for Cleft Palate (TOPS)
Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Standard
Inter-rater reliability in classification of canonical babbling status based on canonical babbling ratio in infants with isolated cleft palate randomised to Timing of Primary Surgery for Cleft Palate (TOPS). / Willadsen, Elisabeth; Cooper, Rachael; Conroy, Eliza Beth; Gamble, Carrol; Albery, Liz; Andersen, Helene; Appelqvist, Malin; Bodling, Pia; Bowden, Melanie; Brunnegard, Karin; Enfalt, Josefin; van Eeden, Stephanie; Goncalves, Cristina; Fukushiro, Ana; Jørgensen, Line; Lemvik, Jorunn; Leturgie, Louise; Liljerehn, Eva; Lodge, Natalie; McMahon, Siobhan; Miguel, Haline; Patrick, Kathryn; Phippen, Ginette; Piazentin-Penna, Silvia; Southby, Lucy; Taleman, Ann Sofie; Tangstad, Jorid; Yamashita, Renata; Shaw, William; Munro, Kevin; Walsh, Tanya; Persson, Christina.
I: Clinical Linguistics and Phonetics, Bind 37, Nr. 1, 2023, s. 77-98.Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Inter-rater reliability in classification of canonical babbling status based on canonical babbling ratio in infants with isolated cleft palate randomised to Timing of Primary Surgery for Cleft Palate (TOPS)
AU - Willadsen, Elisabeth
AU - Cooper, Rachael
AU - Conroy, Eliza Beth
AU - Gamble, Carrol
AU - Albery, Liz
AU - Andersen, Helene
AU - Appelqvist, Malin
AU - Bodling, Pia
AU - Bowden, Melanie
AU - Brunnegard, Karin
AU - Enfalt, Josefin
AU - van Eeden, Stephanie
AU - Goncalves, Cristina
AU - Fukushiro, Ana
AU - Jørgensen, Line
AU - Lemvik, Jorunn
AU - Leturgie, Louise
AU - Liljerehn, Eva
AU - Lodge, Natalie
AU - McMahon, Siobhan
AU - Miguel, Haline
AU - Patrick, Kathryn
AU - Phippen, Ginette
AU - Piazentin-Penna, Silvia
AU - Southby, Lucy
AU - Taleman, Ann Sofie
AU - Tangstad, Jorid
AU - Yamashita, Renata
AU - Shaw, William
AU - Munro, Kevin
AU - Walsh, Tanya
AU - Persson, Christina
N1 - Publisher Copyright: © 2022 Taylor & Francis Group, LLC.
PY - 2023
Y1 - 2023
N2 - Canonical babbling (CB) is commonly defined as present when at least 15% of all syllables produced are canonical, in other words a canonical babbling ratio (CBR) ≥0.15. However, there is limited knowledge about inter-rater reliability in classification of CB status based on CBR and inter-rater differences in assessment of CBR. We investigated inter-rater reliability of experienced Speech Language Therapists (SLTs) on: classification of CB status based on CBR ≥ 0.15, CBRs and the total number of syllables per infant used to calculate CBR. Each infant (n = 484) was video-recorded at a clinical site in play interaction with their parent as part of the randomised controlled trial Timing of Primary Surgery for Cleft Palate. Each recording was subsequently assessed by three independent SLTs, from a pool of 29 SLTs. They assessed the recordings in real time. The three assessing SLTs agreed in classification of CB status in 423 (87.4%) infants, with higher complete agreement for canonical (91%; 326/358) than non-canonical (77%; 97/126). The average difference in CBR and total number of syllables identified between the SLT assessments of each infant was 0.12 and 95, respectively. This study provided new evidence that one trained SLT can reliably classify CB status (CBR ≥ 0.15) in real time when there is clear distinction between the observed CBR and the boundary (0.15); however, when the observed CBR approaches the boundary multiple SLT assessments are beneficial. Thus, we recommend to include assessment of inter-rater reliability, if the purpose is to compare CBR and total syllable count across infants or studies. Trial registration number here: www.clinicaltrials.gov, identifier NCT00993551.
AB - Canonical babbling (CB) is commonly defined as present when at least 15% of all syllables produced are canonical, in other words a canonical babbling ratio (CBR) ≥0.15. However, there is limited knowledge about inter-rater reliability in classification of CB status based on CBR and inter-rater differences in assessment of CBR. We investigated inter-rater reliability of experienced Speech Language Therapists (SLTs) on: classification of CB status based on CBR ≥ 0.15, CBRs and the total number of syllables per infant used to calculate CBR. Each infant (n = 484) was video-recorded at a clinical site in play interaction with their parent as part of the randomised controlled trial Timing of Primary Surgery for Cleft Palate. Each recording was subsequently assessed by three independent SLTs, from a pool of 29 SLTs. They assessed the recordings in real time. The three assessing SLTs agreed in classification of CB status in 423 (87.4%) infants, with higher complete agreement for canonical (91%; 326/358) than non-canonical (77%; 97/126). The average difference in CBR and total number of syllables identified between the SLT assessments of each infant was 0.12 and 95, respectively. This study provided new evidence that one trained SLT can reliably classify CB status (CBR ≥ 0.15) in real time when there is clear distinction between the observed CBR and the boundary (0.15); however, when the observed CBR approaches the boundary multiple SLT assessments are beneficial. Thus, we recommend to include assessment of inter-rater reliability, if the purpose is to compare CBR and total syllable count across infants or studies. Trial registration number here: www.clinicaltrials.gov, identifier NCT00993551.
KW - agreement
KW - assessment variation
KW - canonical babbling ratio
KW - Canonical babbling status
KW - isolated cleft palate
U2 - 10.1080/02699206.2021.2012259
DO - 10.1080/02699206.2021.2012259
M3 - Journal article
C2 - 35100923
AN - SCOPUS:85124288791
VL - 37
SP - 77
EP - 98
JO - Clinical Linguistics & Phonetics
JF - Clinical Linguistics & Phonetics
SN - 0269-9206
IS - 1
ER -
ID: 371561123