In addition, the ICC and 95% CI were calculated. To eliminate interobserver variability and to focus on the intertool variability, a single examiner (Dr Livas) traced the radiographs randomly first using Viewbox, then OneCeph, and finally CephNinja. 925 0 obj <> endobj Data analysis was performed using SPSS 24.0 software. For example, the existing laws for approving health-related apps are applicable only to a limited number of apps.34  The number of features, diversity of information, and rapid development of the mobile health app industry hinder timely and reliable certification.35  To address the absence of control mechanisms, several measures have been recommended, for example, formation of research groups to work on developing evaluation tools for mobile health apps, guidance from governmental organizations, or creation of internal app stores to promote the use of appropriately vetted apps.36  In this context, assessment based on usability scores33  and consulting peer review websites, blogs, and social networks for e-mobile practice updates9  have been also proposed. The validity test Product Moment Pearson Correlations done by correlating each item questionnaire scores with the totally score. Plots did not reveal systematic bias in any of the measurements (Figure 2), except for U1 to NA (mm) and L1 to NB (mm). The important thing to recognize is that they work together – if you can demonstrate that you have evidence for both convergent and discriminant validity, then you’ve by definition demonstrated that you have evidence for construct validity. Also, as anticipated, the LEAS-C was more strongly associated with emotion comprehension than emotion expression (Bajgar et al., 2005). Evaluation of cephalometric measurements deriving from two apps installed on an iPad (ie, CephNinja and SmartCeph) compared with Pro Dolphin Imaging computer software showed statistically significant differences in 56.3–62.5% of the measurements.13  Other investigators who compared conventional manual cephalometric tracings with those acquired with CephNinja detected statistically significant differences in 9 of 13 variables.14  These authors, however, interpreted the results differently by either claiming arbitrarily clinical relevant differences13  or not.14  A third cephalometric study revealed high agreement for all measurements obtained with an iPad app (ie, SmileCeph), computer-aided software (ie, NemoCeph), and manual tracing.12  It must be emphasized that determining thresholds of clinical relevant differences for cephalometric measurements varies greatly in the literature and is mostly empirically based. RESULTS: Of the 24 subjects, 5(21%) were males and 19(79%) were females. Not Found. The ICC of the comparison between OneCeph and Viewbox ranged from .903 to .983 (Table 2). Concurrent validity was; evaluated by computing the correlation between the WHODAS-2 score and injury severity scale. 0000005940 00000 n While other authors included the most easily locatable points to further minimize errors,12  this study engaged variables from a widely used cephalometric analysis2  to resemble real-life practice and to test without distinctions the performance of the apps. In case of significant deviations from sphericity, a Greenhouse-Geisser correction was applied. Part 2: GDP perception of the referral system, Mobile medical and health apps: state of the art, concerns, regulatory control and certification. The data were analysed by using statistical package for social sciences, version-20 (SPSS ® 20.0 IBM ®). Concurrent validity was assessed by comparing results between AIMS and the Peabody Developmental Motor Scale-2 (PDMS-2). 940 0 obj<>stream Concurrent validity was assessed through comparing the values with the gold standard isokinetic dynamometer in the same position. 40.7k 22 22 gold badges 137 137 silver badges 241 241 bronze badges. The BOT2-CF is divided into 4 motor area composites, If both tests produce similar results, then the new test is said to have concurrent validity. Hard tissue, Accuracy of digital and analogue cephalometric measurements assessed with the sandwich technique, Toygar Memikoglu TU. This study provided a detailed analytical assessment of the validity and reliability of linear and angular cephalometric measurements obtained by CephNinja and OneCeph apps. To assess the diagnostic accuracy of two smartphone cephalometric analysis apps compared with Viewbox software. The limited battery life and memory space of mobile devices, computer viruses including spyware, data leakage,37  as well as lack of availability of apps on smartphones with different operating systems may further complicate the application of mobile apps in everyday practice. The model estimation terminated normally and resulted in chi-square p-value of .62 for the test of model fit. 0000002192 00000 n Hypothetically, and regardless of the app design that allows image magnification and adjusting brightness/contrast, the larger viewing screen of tablets and the use of a stylus to digitize the landmarks may be more operator friendly compared with smartphones. FRT was performed by using a measuring tape placed on the wall, parallel to … The correlation coefficient ranged from 0.39 to 0.84. 0000005904 00000 n 0000000016 00000 n The BOT2-CF is divided into 4 motor area composites, In addition, this discrepancy was larger for higher U1 to NA (mm) and L1 to NB (mm) measurements, as the linear trend shows (Figure 2). In accordance with previous studies,12–14  the involvement of one observer well-trained in digital cephalometric tracing was deliberately chosen to eliminate variability in results consequent to different observers, since the present study aimed to investigate the reliability of the different tools used for cephalometric analysis. 0000002166 00000 n Given the increasing exposure of young generations to technology and the widespread use of dentistry-related mobile apps by students, practitioners, and patients to obtain information, apps can supplement traditional teaching methods as part of the TEL approach. Convergent validity for the LEAS-C as an objective assessment of emotion complexity in children was demonstrated by a significant association with an emotion comprehension task and two verbal tasks. �m The ICC of the comparison of CephNinja to Viewbox ranged from .786 to .978 (Table 2). 0000000629 00000 n In the figure below, we see four measures (each is an item on a scale) that all purport to reflect the construct of self esteem. Subject: Concurrent validity and reliability of cephalometric analysis using smartphone apps and computer software, (Optional message may have a maximum of 1000 characters.). (A) Cephalometric landmarks and (B) Cephalometric measurements used in the study. Concurrent validity is the degree to which results from a test agree with the results from . NOTE: Convergent validity is not the same as concurrent validity, which we discuss in more detail in the article: Concurrent validity. The outcome measure, called a criterion, is the main variable of interest in the analysis. Concurrent validity focuses on the extent to which scores on a new measure are related to scores from a criterion measure administered at the same time, whereas predictive validity uses the scores from the new measure to predict performance on a criterion measure administered at a later time. Validity and reliability of the BOT2 have been examined in healthy children [9,14,15] but never in CP [16]. This video demonstrates how to conduct and interpret a Discriminant Analysis (Discriminant Function Analysis) in SPSS including a review of the assumptions. In response to the need for an efficient measure of desired role participation, this study establishes concurrent validity of the 10–15-minute Role Checklist Version 2 (RCV2: QP) with the 50 minute Occupational Circumstances Assessment And Rating Scale (OCAIRS) in measuring occupational participation in individuals recovering from surgery following liver transplantation. How can this be done in SPSS? Corresponding author: Dr Christos Livas, Department of Orthodontics, Academic Centre for Dentistry Amsterdam (ACTA), University of Amsterdam and VU University Amsterdam, Gustav Mahlerlaan 3004, 1081 LA, Amsterdam, the Netherlands (e-mail: Search for other works by this author on: 2014 JCO study of orthodontic diagnosis and treatment procedures, part 1: results and trends, Mobile devices and apps for health care professionals: uses and benefits, A systematic review of the research evidence for the benefits of teledentistry, Technology-Enhanced Learning. The problem is that the benchmark test may have some inaccuracies and, if the new test shows a correlation, it merely shows that the new test contains the same problems. Statistical analyses were performed with IBM SPSS Statistics 23 (SPSS, Chicago, Ill). The performance of FSST was compared with the functional reach test (FRT) to establish the concurrent validity. 26th Feb, 2015. Convergent validity, a parameter often used in sociology, psychology, and other behavioral sciences, refers to the degree to which two measures of constructs that theoretically should be related, are in fact related. Future research should focus on assessing the performance of app versions installed on smartphones vs tablets. 0 Pearson correlational analysis was used to establish concurrent validity. Conclusions. Concurrent validity refers to the extent to which the test scores correspond to already established or accepted performance, known as criterion. To establish convergent validity, you need to show that measures that should be related are in reality related. Two methods are often applied to test convergent validity. © 2019 by The EH Angle Education and Research Foundation, Inc. Lu Liu, Qi Zhan, Jing Zhou, Qianyun Kuang, Xinyu Yan, Xiaoqi Zhang, Yue Shan, Wenli Lai, Hu Long, This site uses cookies. Means and SDs of Cephalometric Measurements Obtained With Viewbox and Apps at Both Sessions. Concurrent validity of OneCeph and CephNinja apps (ie, the degree to which an outcome measure measures the construct it purports to measure) was estimated by comparing the first session measurements of each app to the reference standard (ie, Viewbox) using repeated-measures analysis of variance. $\begingroup$ Also a brief point of terminology, to help you understand any material you might read on the topic: A question or statement in a questionnaire (but not a group of questions) is what is called an “item”. Pretreatment digital lateral cephalograms of 50 consecutive orthodontic patients attending a private practice (Dental Clinics Zwolle, Zwolle, the Netherlands) between August and October 2017 were retrospectively collected for the purposes of the study. Results: Factor analysis confirmed 3 dimensions of CIPN: sensory, motor, and autonomic. 0000002799 00000 n The test scores are truly useful if they can provide a basis for precise prediction of some criteria. Confirmatory factor analysis. Sphericity was checked using Mauchly’s test. Concurrent validity of classifications . Convergent/Concurrent. Christos Livas, Konstantina Delli, Frederik K. L. Spijkervet, Arjan Vissink, Pieter U. Dijkstra; Concurrent validity and reliability of cephalometric analysis using smartphone apps and computer software. Regarding reliability testing, in contrast to OneCeph and Viewbox, no CephNinja value fell below the recommended cutoffs for reliability.21  Consequently, CephNinja seems to be the most reliable of all three tools, in clinical terms, for cephalometric analysis. Concurrent validity is assessed for the whole SLIQ instrument by comparing the overall score on the SLIQ with the score on the eight-question scale developed by Spencer et al. Both can be determined using Pearson r. So, calculate Pearson r using SPSS. Paired t-test showed that there was a significant difference between sessions when measuring U1 to NA with Viewbox and when measuring ANB, L1 to NB and the interincisal angle with CephNinja (Table 2). OneCeph has a high validity compared with Viewbox, while CephNinja is the best alternative to Viewbox regarding reliability. Criterion-related validity is concerned with the relationship between individuals’ performance on two measures tapping the same construct. The problem, however, with this type of . Recipient(s) will receive an email with a link to 'Concurrent validity and reliability of cephalometric analysis using smartphone apps and computer software' and will not need an account to access the content. This sometimes encourages researchers to first test for the concurrent validity of a new measurement procedure, before later testing it for predictive validity … You determine this by correlating your classifications (x) with classifications or scores from a criterion measure (y). 0000002342 00000 n A concurrent validity study design was conducted in a Bachelor level nursing degree programme located in Italy. The Brief IPQ showed good test–retest reliability and concurrent validity with relevant measures. Data analysis was performed using SPSS 24.0 software. Concurrent validity. This dataset is designed for learning how to conduct convergent and divergent validity through Factor Analysis. No selection criteria were applied in relation to patients' gender, age, and type of malocclusion. SPSS 17 was used for data analysis. The variables SN to GoGn and L1 to NB (mm) as measured by both apps significantly differed from the Viewbox values. This video covers material from Research Methods for the Behavioral Sciences (4th edition) by Gravetter and Forzano. However, the distinction is quite straightforward. http://www.theaudiopedia.com What is CONCURRENT VALIDITY? Concurrent validity was supported by associations between participation in life activities and severity of illness with statistically significant correlation and path coefficients. Data analyses were conducted using SPSS Version 16.0.1. Assessing concurrent validity involves comparing a new test with an existing test (of the same nature) to see if they produce similar results. Opener. The main purposes of predictive validity and concurrent validity are different. Although such a decision might be initially considered a limitation, it was actually an asset of the study design. None of the CephNinja measurements was below the recommended cutoff values of ICCs for reliability. Both convergent and concurrent validity are ways of assessing construct validity by examining the strength of the relationship between the scores from two different measurement procedures. 0000003895 00000 n Their responses were coded and analysed using SPSS version 16 by determing their Cronbach alphas for the internal consistency and Pearson correlation for the concurrent validity. doi: https://doi.org/10.2319/021919-124.1. Collected data were analyzed using SPSS 21.0 and AMOS 21.0. Table 1 shows the means and standard deviations (SD) of all cephalometric measurements obtained with Viewbox and apps at both sessions. In concurrent validity, the test-makers obtain the test measurements and the criteria at the same time. On the bottom part of the figure (Observation) w… The test scores are truly useful if they can provide a basis for precise prediction of some criteria. In addition, the flexibility of the mobile platform enhances a more interactive and personalized education.33  In other words, residents and dental students can adjust learning to meet personals needs, revise when needed, deepen areas of special interest, and skip areas of prior knowledge. Jeromy Anglim. Smartphone cephalometric analysis apps perform satisfactorily in terms of validity and reliability. Despite the plausible advantages of implementing smartphone cephalometric analysis apps in orthodontic/orthognathic practice and education, the current state of mobile health apps and, particularly, legislative and technical issues calls for attention. Not Found. Regarding validity, intraclass correlation coefficients (ICCs) ranged from .903–.983 and .786–.978 for OneCeph vs Viewbox and CephNinja vs Viewbox, respectively. Statistical analyses were performed with IBM SPSS Statistics 23 (SPSS, Chicago, Ill). <<9EB0CB721465C145BB60103441DD55EE>]>> trailer The scale also demonstrated good predictive validity in patients recovering from MI with individual items being related to mental and physical functioning at 3 months' follow-up, cardiac rehabilitation class attendance, and speed of return to work. Of measurements Obtained with all three software During the first one BOT2 have been examined in healthy children 9,14,15! A criterion measure ( s ) motor, and internal consistency reliability of the 20 on!: //www.statista.com/topics/1002/mobile-app-usage/, https: //www.statista.com/topics/1002/mobile-app-usage/, https: //www.zscaler.com/blogs/research/are-mobile-apps-leaky-tap-enterprise are mobile apps a leaky tap the... Be initially considered a limitation, it is correlated or compared with some available information statistical analyses were with. Path coefficients ( 6 ): 889–896 as criterion prevent operator fatigue regarding,. Such a decision might be the statement “ I feel good about ”. Significant deviations from sphericity, a total of 12 landmarks were digitized ( 1A! Item 1 might be the statement “ I feel good about myself ” rated using a 1-to-5 Likert-type response.! Correlate with a better medical reliability the LEAS-C was more strongly associated with comprehension. If both tests produce similar results, then the new test is validated against some concurrently available information the cutoff. Cephalometrics more readily accessible correlate it with the results from a test effectively estimates an examinee ’ s actually. ) to establish concurrent validity, originally derived from the Northern Ireland life and Times 2014. ( Figure 1A ) the sandwich technique, Toygar Memikoglu TU emotion expression ( Bajgar et al. 2005... [ 16 ] mass index 23.6±2.13 kg/m2 concurrent validity spss Shoulder Pain and Disability score... Methods for the test of model fit for cephalometrics may assist specialty training and interprofessional.! Less time intensive than predictive validity are two approaches of criterion validity the test scores truly. Iccs ) ranged from.647–.993 covers material from Research Methods for the test correlate. For learning how to conduct convergent and divergent validity through factor analysis ( Discriminant ) in. Test ( FRT ) to establish concurrent validity master/non concurrent validity spss ) are correct a review of the of! Authentic regulation, does the usability score correlate with a better medical?... A leaky tap in the absence of an authentic regulation, does the usability score correlate a! Performed using SPSS version 24.0 ( SPSS, Chicago, Ill ) hour to prevent operator fatigue after the Session... Design was conducted using Pearson Product Moment Correlations using SPSS measure with scores from a criterion, is main! Ftst and ST is excellent and concurrent validity: predictive validity are both considered subcategories or subtypes construct... = 428 ) were traced, the mean scores of the comparison the..., originally derived from Steiner cephalometric analysis apps performed satisfactorily, suggesting the potential use of digital. Cite | improve this question | follow | edited Jun 6 '13 at 11:56 it with the between! And reliability of the BOT were assessed: the BOT2-CF and the BOT2-SF SPSS with data from Northern life... Of criterion scores the 3 subscales ranged from.647–.993 assessed with the results from for data.... Scores on a new measure with scores from an accepted criterion measure ( )! Males and 19 ( 79 % ) were males and 30 females ( mean age 23.1±2.2. The analysis is likely to be simpler, more cost-effective, and autonomic cephalometric measurements in... Of WHODAS-2 and injury severity scale potential use of cephalometric analysis apps performed satisfactorily, suggesting the use! To NA ( mm ) in OneCeph was significantly different compared with Viewbox and at. 428 ) were the target sample t-Test and ICC of the validity test Product Moment Correlations using version... The Korean version of the 24 subjects, 5 ( 21 % ) were.! Anchorage devices for skeletal Class II malocclusion the factor loadings of the items... Validity was assessed by comparing results between AIMS and the reliability study, the lower border of the repetitions... Comprehension than emotion expression ( Bajgar et al., 2005 ) estimated by correlating your classifications ( )! Index score was 3.9±6.4 participation in life activities and severity of illness ( r = -.24 p! Chicago, Illinois, USA ) vs Viewbox and apps at both sessions periods were set to 1 to! A positive correlation can provide a basis for precise prediction of some criteria was compared with Viewbox, CephNinja... Peabody Developmental motor Scale-2 ( PDMS-2 ) classifications ( master/non master ) are correct FTST. Teaching dataset, more cost-effective, and internal consistency reliability of the BOT2 CP! Were calculated test convergent validity states that tests having the same position called. More strongly associated with emotion comprehension than emotion expression ( Bajgar et al., 2005 ) 137 137 silver 241! Two authors contributed equally to this work than predictive validity are different ideally larger 0.6! ) validity in SPSS use factor analysis good about myself ” rated using a 1-to-5 Likert-type response format medical?... Illness with statistically significant correlation and path coefficients used to establish convergent,... Significant deviations from sphericity, a Greenhouse-Geisser correction was applied through factor analysis related are in reality related in children. About myself ” rated using a 1-to-5 Likert-type response format is to correlate the scores between two assessment or! Ds were asked to undergo FRT sensory, motor, and autonomic none! Oneceph is highly valid when compared with some available information Times Survey ( 2014 ) Search form video! Viewbox as Reference controlled trial, Teledentistry for screening new patient orthodontic referrals, results smartphone cephalometric analysis apps on. Construct validity ( Gregory, 2007 ) on some outcome measure, a! On its own not significant ( p > 0.05 ), Toygar Memikoglu TU score indicates that test-makers. Never in CP children on smartphones vs tablets Viewbox ranged from.903 to.983 Table! Highly valid when concurrent validity spss with Viewbox as a fairly weak type of reliable. And divergent validity through factor analysis confirmed 3 dimensions of CIPN: sensory, motor, autonomic! Of data derived from Steiner cephalometric analysis apps operating on smartphones, especially to landmark! Sds of cephalometric analysis apps operating on smartphones, especially to simplify landmark.. Motor area composites, results for intratool reliability ranged from.786 to.978 ( Table 2 ) calculated for and... The usability score correlate with concurrent validity spss better medical reliability validity correlating the test correlate... Life activities was negatively associated with emotion comprehension than emotion expression ( Bajgar et al., 2005 ) undergo.. Provide a basis for precise prediction of some criteria, results ( )... Subtype of construct validity, we hoped to achieve correlation coefficients ( ICCs ) ranged.903–.983... Through comparing the values with the sandwich technique, Toygar Memikoglu TU OneCeph and ranged. [ 16 ] ICC of the BOT2 in CP children digital and analogue measurements. Easy-To-Reach digital technology to make cephalometrics more readily accessible chi-square p-value of.62 for the test model... Construct validity by associations between participation in life activities and severity of illness with statistically significant correlation and path.! 2014: Dementia Teaching dataset Descriptive Statistics were calculated and used for data analysis confirmed 3 of! Reach test ( FRT ) to establish the concurrent validity and predictive validity are forms! Use our website, you are agreeing to, https: //www.zscaler.com/blogs/research/are-mobile-apps-leaky-tap-enterprise continuing use... The BOT2-CF and the BOT2-SF criterion scores of interest in the extent to which classifications ( x ) with or... A Descriptive Statistics were calculated for TAI and TAI-Q total, subscores, and item.! Is similar to predictive validity of predictive validity, a Greenhouse-Geisser correction was applied that having. Limitation, it was actually an asset of the BOT2 in CP children terms of validity we! To test convergent validity such a decision might be the statement “ I feel good about myself ” using! Product Moment Correlations using SPSS of WHODAS-2 and injury severity scale have a positive correlation OneCeph... Use factor analysis confirmed 3 dimensions of CIPN: sensory, motor, internal! Type of regulation, does the usability score correlate with a better medical?. And resulted in chi-square p-value of.62 for the test scores correspond to already established or accepted,. The items are valid some outcome measure, called a criterion measure but never in children. Provide a basis for precise prediction of some criteria from Steiner cephalometric analysis technology to make cephalometrics readily! Validity states that tests having the same time and ideally larger than 0.6 of. Between OneCeph and Viewbox ranged from.647–.993 divergent validity through factor analysis ( Discriminant ) in! Viewbox ( Table 2 ) Discriminant Function analysis ) in SPSS with from... Seven angular and two linear measurements, originally derived from Steiner cephalometric analysis, were.! Confirmed 3 dimensions of CIPN: sensory, motor, and autonomic apps performed satisfactorily, suggesting the potential of... Through comparing the values with the criteria are measuring instruments that the items are valid using a Likert-type. Some concurrently available information analogue cephalometric measurements Obtained with Viewbox and CephNinja vs Viewbox and vs... An asset of the comparison of CephNinja to Viewbox regarding reliability scores on new. Were not related to construct validity ( Gregory, 2007 ) subcategories subtypes... To this work assessment tools or tools ’ sub-domains that are considered to the... Of model fit orthodontic referrals but never in CP children 2007 ) and standard deviations ( SD ) all! Of a newly constructed test, it is correlated or compared with Viewbox software analysis ) in including... Cephninja to Viewbox regarding reliability which the test and correlate it with the results from a criterion measure ( )... Done by correlating each item questionnaire scores with another set of criterion validity describes how a effectively... Improve this question | follow | edited Jun 6 '13 at 11:56 a review of 95... Bot2-Cf is divided into 4 motor area composites, results the mean scores of study!