ShapeAXI represents a cutting-edge framework for shape analysis that leverages a multi-view approach, capturing 3D objects from diverse viewpoints and subsequently analyzing them via 2D Convolutional Neural Networks (CNNs). We implement an automatic N-fold cross-validation process and aggregate the results across all folds. This ensures insightful explainability heat-maps for each class across every shape, enhancing interpretability and contributing to a more nuanced understanding of the underlying phenomena. We demonstrate the versatility of ShapeAXI through two targeted classification experiments. The first experiment categorizes condyles into healthy and degenerative states. The second, more intricate experiment, engages with shapes extracted from CBCT scans of cleft patients, efficiently classifying them into four severity classes. This innovative application not only aligns with existing medical research but also opens new avenues for specialized cleft patient analysis, holding considerable promise for both scientific exploration and clinical practice. The rich insights derived from ShapeAXI’s explainability images reinforce existing knowledge and provide a platform for fresh discovery in the fields of condyle assessment and cleft patient severity classification. As a versatile and interpretative tool, ShapeAXI sets a new benchmark in 3D object interpretation and classification, and its groundbreaking approach hopes to make significant contributions to research and practical applications across various domains. ShapeAXI is available in our GitHub repository https://github.com/DCBIA-OrthoLab/ShapeAXI.
In this paper we propose feature selection and machine learning approaches to identify a combination of features for risk prediction of Temporomandibular Joint (TMJ) disease progression. In a sample of 32 TMJ osteoarthritis and 38 controls, feature selection of 5 clinical comorbidities, 43 quantitative imaging, 28 biological features and was performed using Maximum Relevance Minimum Redundancy, Chi-Square and Least Absolute Shrinkage and Selection Operator (LASSO) and Recursive Feature Elimination. We compared the performance of learning using concave and convex kernels (LUCCK), Support Vector Machine (SVM) and Random Forest (RF) approaches to predict disease cure/improvement or persistence/worsening. We show that the SVM model using LASSO achieves area under the curve (AUC), sensitivity and precision of 0.92±0.08, 0.85±0.19 and 0.76 ±0.18, respectively. Baseline levels of headaches, lower back pain, restless sleep, muscle soreness, articular fossa bone surface/bone volume and trabecular separation, condylar High Gray Level Run Emphasis and Short Run High Gray Level Emphasis, saliva levels of 6Ckine, Osteoprotegerin (OPG) and Angiogenin, and serum levels of 6ckine and Brain Derived Neurotrophic Factor (BDNF) were the most frequently occurring features to predict more severe TMJ osteoarthritis prognosis.
In this paper, we present FlyBy CNN, a novel deep learning based approach for 3D shape segmentation. FlyBy-CNN consists of sampling the surface of the 3D object from different view points and extracting surface featuressuch as the normal vectors. The generated 2D images are then analyzed via 2D convolutional neural networkssuch as RUNETs. We test our framework in a dental application for segmentation of intra-oral surfaces. TheRUNET is trained for the segmentation task using image pairs of surface features and image labels as groundtruth. The resulting labels from each segmented image are put back into the surface thanks to our samplingapproach that generates 1-1 correspondence of image pixels and triangles in the surface model. The segmentationtask achieved an accuracy of 0.9
KEYWORDS: Data storage, 3D modeling, 3D image processing, Shape analysis, Machine learning, Image processing, Distributed computing, Data processing, Data modeling, Data analysis
The Data Storage for Computation and Integration (DSCI) proposes management innovations for web-based secure data storage, algorithms deployment, and task execution. Its architecture allows uploading, browsing, sharing, and task execution in remote computing grids. Here, we demonstrate the DSCI implementation and the deployment of Image processing tools (TMJSeg), machine learning algorithms (MandSeg, DentalModelSeg), and advanced statistical packages (Multivariate Functional Shape Data Analysis, MFSDA), with data transfer and task execution handled by the clusterpost plug-in. Due to its comprehensive web-based design, local software installation is no longer required. The DSCI aims to enable and maintain distributed computing and collaboration environment across multi-site clinical centers for the data processing of multisource features such as clinical, biological markers, volumetric images, and 3D surface models.
KEYWORDS: Shape analysis, Databases, Data storage, Visualization, Data modeling, Data centers, Statistical analysis, Dentistry, 3D image processing, Data analysis
This study presents a web-system repository: Data Storage for Computation and Integration (DSCI) for Osteoarthritis of the temporomandibular joint (TMJ OA). This environment aims to maintain and allow contributions to the database from multi-clinical centers and compute novel statistics for disease classification. For this purpose, imaging datasets stored in the DSCI consisted of three-dimensional (3D) surface meshes of condyles from CBCT, clinical markers and biological markers in healthy and TMJ OA subjects. A clusterpost package was included in the web platform to be able to execute the jobs in remote computing grids. The DSCI application allowed runs of statistical packages, such as the Multivariate Functional Shape Data Analysis to compute global correlations between covariates and the morphological variability, as well as local p-values in the 3D condylar morphology. In conclusion, the DSCI allows interactive advanced statistical tools for non-statistical experts.
We developed a deep learning neural network, the Shape Variation Analyzer (SVA), that allows disease staging of bony changes in temporomandibular joint (TMJ) osteoarthritis (OA). The sample was composed of 259 TMJ CBCT scans for the training set and 34 for the testing dataset. The 3D meshes had been previously classified in 6 groups by 2 expert clinicians. We improved the robustness of the training data using data augmentation, SMOTE, to alleviate over-fitting and to balance classes. We combined geometrical features and a shape descriptor, heat kernel signature, to describe every shape. The results were compared to nine different supervised machine learning algorithms. The deep learning neural network was the most accurate for classification of TMJ OA. In conclusion, SVA is a 3D Slicer extension that classifies pathology of the temporomandibular joint osteoarthritis cases based on 3D morphology.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.