Skip to main content
Advertisement
  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Neurology: Neuroimmunology & Neuroinflammation COVID-19 Article Hub
    • Inclusion, Diversity, Equity, Anti-racism, & Social Justice (IDEAS)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center

Advanced Search

Main menu

  • Neurology.org
  • Journals
    • Neurology
    • Clinical Practice
    • Education
    • Genetics
    • Neuroimmunology & Neuroinflammation
  • Online Sections
    • Neurology Video Journal Club
    • Neurology: Neuroimmunology & Neuroinflammation COVID-19 Article Hub
    • Inclusion, Diversity, Equity, Anti-racism, & Social Justice (IDEAS)
    • Innovations in Care Delivery
    • Practice Buzz
    • Practice Current
    • Residents & Fellows
    • Without Borders
  • Collections
    • COVID-19
    • Disputes & Debates
    • Health Disparities
    • Infographics
    • Null Hypothesis
    • Patient Pages
    • Topics A-Z
    • Translations
  • Podcast
  • CME
  • About
    • About the Journals
    • Contact Us
    • Editorial Board
  • Authors
    • Submit a Manuscript
    • Author Center
  • Home
  • Articles
  • Issues
  • COVID-19 Article Hub
  • Infographics & Video Summaries

User menu

  • My Alerts
  • Log in
  • Log out

Search

  • Advanced search
Neurology Neuroimmunology & Neuroinflammation
Home
A peer-reviewed clinical and translational neurology open access journal
  • My Alerts
  • Log in
  • Log out
Site Logo
  • Home
  • Articles
  • Issues
  • COVID-19 Article Hub
  • Infographics & Video Summaries

Share

July 2021; 8 (4) ArticleOpen Access

Network Damage Predicts Clinical Worsening in Multiple Sclerosis

A 6.4-Year Study

View ORCID ProfileMaria A. Rocca, Paola Valsasina, Alessandro Meani, Elisabetta Pagani, Claudio Cordani, Chiara Cervellin, View ORCID ProfileMassimo Filippi
First published May 21, 2021, DOI: https://doi.org/10.1212/NXI.0000000000001006
Maria A. Rocca
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maria A. Rocca
  • For correspondence: rocca.mara@hsr.it
Paola Valsasina
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: valsasina.paola@hsr.it
Alessandro Meani
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: meani.alessandro@hsr.it
Elisabetta Pagani
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: pagani.elisabetta@hsr.it
Claudio Cordani
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: cordani.claudio@hsr.it
Chiara Cervellin
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: chiara.cervellin96@gmail.com
Massimo Filippi
From the Neuroimaging Research Unit (M.A.R.), Division of Neuroscience; and Neurology Unit, IRCCS San Raffaele Scientific Institute; Vita-Salute San Raffaele University (M.A.R., M.F.); Neuroimaging Research Unit (P.V., A.M., E.P., Claudio Cordani, Chiara Cervellin), Division of Neuroscience, IRCCS San Raffaele Scientific Institute; and Neuroimaging Research Unit (M.F.), Division of Neuroscience, Neurology Unit, Neurorehabilitation Unit, and Neurophysiology Service, IRCCS San Raffaele Scientific Institute, Milan, Italy.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Massimo Filippi
Full PDF
Citation
Network Damage Predicts Clinical Worsening in Multiple Sclerosis
A 6.4-Year Study
Maria A. Rocca, Paola Valsasina, Alessandro Meani, Elisabetta Pagani, Claudio Cordani, Chiara Cervellin, Massimo Filippi
Neurol Neuroimmunol Neuroinflamm Jul 2021, 8 (4) e1006; DOI: 10.1212/NXI.0000000000001006

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Permissions

Make Comment

See Comments

Downloads
675

Share

  • Article
  • Figures & Data
  • Info & Disclosures
Loading

Abstract

Objective In multiple sclerosis (MS), clinical impairment is likely due to both structural damage and abnormal brain function. We assessed the added value of integrating structural and functional network MRI measures to predict 6.4-year MS clinical disability deterioration.

Methods Baseline 3D T1-weighted and resting-state functional MRI scans were obtained from 233 patients with MS and 77 healthy controls. Patients underwent a neurologic evaluation at baseline and at 6.4-year median follow-up (interquartile range = 5.06–7.51 years). At follow-up, patients were classified as clinically stable/worsened according to disability changes. In relapsing-remitting (RR) MS, secondary progressive (SP) MS conversion was evaluated. Global brain volumetry was obtained. Furthermore, independent component analysis identified the main functional connectivity (FC) and gray matter (GM) network patterns.

Results At follow-up, 105/233 (45%) patients were clinically worsened; 26/157 (16%) patients with RRMS evolved to SPMS. The treatment-adjusted random forest model identified normalized GM and brain volumes, decreased FC between default-mode networks, increased FC of the left precentral gyrus in the sensorimotor network (SMN), and GM atrophy in the fronto-parietal network (false discovery rate [FDR]-corrected p = range 0.01–0.09) as predictors of clinical worsening (out-of-bag [OOB] accuracy = 0.74). An expected contribution of baseline disability was also present (FDR-p = 0.01). Baseline disability, normalized GM volume, and GM atrophy in the SMN (FDR-p = range 0.01–0.09) were independently associated with SPMS conversion (OOB accuracy = 0.84). At receiver operating characteristic analysis, including network MRI variables improved disability worsening (p = 0.05) and SPMS conversion (p = 0.02) prediction.

Conclusions Integration of MRI network measures helped determining the relative contributions of global/local GM damage and functional reorganization to clinical deterioration in MS.

Glossary

AUC=
area under the curve;
BGN=
basal ganglia network;
DMN=
default-mode network;
DMT=
disease-modifying treatment;
EDSS=
Expanded Disability Status Scale;
FC=
functional connectivity;
FDR=
false discovery rate;
fMRI=
functional MRI;
FPN=
fronto-parietal network;
GM=
gray matter;
HC=
healthy control;
IC=
independent component;
LV=
lesion volume;
MS=
multiple sclerosis;
OOB=
out of bag;
PPMS=
primary progressive MS;
RF=
random forest;
RR=
relapsing-remitting MS;
RS=
resting state;
SBM=
source-based morphometry;
SMA=
supplementary motor area;
SMN=
sensorimotor network;
SN=
salience network;
SPMS=
secondary progressive MS;
WM=
white matter

Multiple sclerosis (MS) is the most common inflammatory, demyelinating and neurodegenerative CNS disease characterized by a great interindividual variability.1 Now that several disease-modifying treatments (DMTs) are available,2 there is an increasing need to identify patients with MS having a more severe disease evolution, to optimize patients' management and increase the benefit/risk ratio.

Conventional MRI revolutionized MS evaluation and was formally included in MS diagnostic criteria.3 In treated patients with MS, MRI disease activity measures are combined with clinical evaluation to guide treatment decisions.4 However, the predictive value of conventional MRI on subsequent disease course is still debated, with only some studies detecting a significant influence of white matter (WM) lesion burden on disease evolution.5,-,7

A large effort has been spent to improve predictivity of MRI in MS by assessing clinically relevant compartments (i.e., gray matter [GM], strategic WM tracts, and spinal cord) and by applying quantitative techniques, sensitive toward different pathologic substrates.8 This helped demonstrate that in patients with established MS and in progressive MS (PMS), GM damage plays a major role in explaining long-term disability and cognitive decline.9,-,12

Brain function depends on not only local processing but also effective global communication and integration of information. Because impaired interaction among the main brain areas may cause disability accumulation in MS, mapping structural and functional brain networks might be clinically relevant. Studies of structural network abnormalities, which decomposed WM lesions and GM maps into distinct patterns covarying across subjects, revealed that a stronger network disruption in these 2 compartments was correlated with severe disability13 and was able to predict the subsequent disease course.14,15 Resting-state (RS) functional connectivity (FC) network studies showed complex abnormalities in patients with MS,16,17 characterized by an early RS FC increase and RS FC decrease in more advanced phases. Abnormal within- and between-network RS FC contributed to explain MS phenotypic variability and cognitive deficits16,18 and was able to predict clinical deterioration at medium term,19,20 whereas abnormal FC during a psychological stress functional (fMRI) paradigm contributed to explain future GM atrophy.21 However, the combined ability of functional and structural network techniques in predicting subsequent clinical worsening of MS was not investigated yet.

In this study, we hypothesized that integrating structural and functional network information may help to identify specific circuits being critical for clinical deterioration in heterogeneous diseases such as MS, and may improve prediction of the subsequent disease course, in terms of disability increase and evolution to a more severe clinical phenotype. To test this, we analyzed volumetric and RS fMRI data from a large MS cohort and mapped abnormalities of the main data-driven functional and structural GM networks. Then, we assessed the added value of integrated structural and functional network MRI measures to predict clinical disability deterioration and conversion to secondary progressive (SP) MS over a 6.4-year follow-up.

Methods

Standard Protocol Approvals, Registrations, and Patient Consents

Approval was received from the local ethical standards committee on human experimentation (protocol ID: FISM 2008/R/13); written informed consent was obtained from all subjects before study participation.

Subjects

Recruited subjects are part of a prospective cohort at Hospital San Raffaele. Patients are assessed clinically at the MS Center at least once per year and are offered the opportunity to undergo research brain MRI. Inclusion criteria are reported in the e-Methods (links.lww.com/NXI/A486). For the current analysis, we selected patients with a clinical follow-up ≥3 years from MRI acquisition. The final cohort included 233 patients with MS (90/143 males/females; mean age = 42.3 years, SD = 10.8 years): there were 157 relapsing-remitting (RR) MS, 59 SPMS, and 17 primary progressive (PP) MS.22 Cross-sectional MRI from 77 matched healthy controls (HCs) (35/42 males/females; mean age = 41.0 years, SD = 14.5 years) were also analyzed. Part of baseline MRI/clinical evaluations was previously published.16,23

Clinical Assessment

At baseline, a complete neurologic evaluation was performed in patients with MS, with rating of the Expanded Disability Status Scale (EDSS) score24 and DMT recording. The follow-up neurologic assessment was performed after a median of 6.4 years (interquartile range = 5.06–7.51 years) and included EDSS score rating, occurrence of clinical relapses, and DMT changes (binary coded). At follow-up, patients were clinically worsened if they had an EDSS score increase ≥1.0 when the baseline EDSS score was <6.0, ≥0.5 when the baseline EDSS score was ≥6.0,9 or ≥1.5 if the baseline score EDSS was 0.25 EDSS score changes were confirmed after a 3-month, relapse-free period. In RRMS, conversion to SPMS (defined, in agreement with previous studies,11,26,27 by development of irreversible EDSS score increase over at least a 1‐year duration, independent of relapses) was also assessed.

MRI Acquisition and Conventional MRI Analysis

At baseline, the following MRI scans were collected using a 3.0T scanner from patients and HC (e-Methods, links.lww.com/NXI/A486): (1) T2*-weighted single-shot echo planar imaging for RS fMRI; (2) 3D T1-weighted fast field echo for T1-hypointense lesion volume (LV) and global brain volumetry assessment; and (3) dual-echo turbo spin echo for T2-hyperintense LV assessment.

RS FC Within and Among Networks

The main purpose was to use independent component (IC) analysis to produce RS FC networks. This was achieved, after RS fMRI preprocessing (e-Methods, links.lww.com/NXI/A486), using the GIFT software (mialab.mrn.org/software/gift/) and Infomax algorithm. The number of group ICs was 40, according to the minimum description length criterion. Visual inspection and template matching28,-,31 allowed selection of sensory, motor, and high-order integrative networks. The temporal association among selected ICs was explored using the functional network connectivity (FNC) toolbox (mialab.mrn.org, e-Methods, links.lww.com/NXI/A486).

Structural GM Network Analysis: Source-Based Morphometry

The main aim was to use source-based morphometry (SBM) to produce GM networks, that is, groups of distinct GM regions showing common covariations among subjects. Preprocessed GM maps (e-Methods, links.lww.com/NXI/A486) underwent the GIFT SBM toolbox and the Infomax algorithm.32 The SBM model order (n = 40) matched functional analysis. After IC selection by visual inspection and spatial matching with functional components,33 GM loading coefficients, representing the degree to which a network is present in individual subjects, were extracted and used for statistics. If the main sign was negative, GM IC maps and loading coefficients were inverted.32 Only pairs of matching functional-structural networks were included.

Statistical Analysis

Between-Group Comparisons

Analyses were performed using SAS (r.9.4) and R software (v.3.4.4). Normal distribution was checked with the Kolmogorov-Smirnov test, Shapiro-Wilk test, and Q-Q plots. LVs were log transformed. Between-group comparisons of demographic and clinical variables were assessed using the Pearson χ2, 2-sample t, or Mann-Whitney U tests, as appropriate. Age- and sex-adjusted linear models were used to compare conventional MRI between groups. Patients with SPMS and those with PPMS were grouped together, leading to these comparisons: (1) patients with MS vs HCs; (2) patients with RRMS vs HCs; (3) patients with PMS vs HCs; and (4) patients with PMS vs RRMS.

Voxel-wise RS FC differences between patients with MS and HCs were investigated using SPM12 and age- and sex-adjusted linear models (p < 0.001, uncorrected, and p < 0.05, clusterwise family-wise error corrected). Models were masked with corrected effects of interest, retaining only significant RS FC within each network. Average RS FC Z-scores of regional significant difference were extracted using the MarsBaR toolbox.

Prediction Analysis

Follow-up duration-adjusted logistic regressions were run on all demographic, clinical, conventional, and network-based MRI variables assessed in this study (n = 62, listed in e-table 1, links.lww.com/NXI/A485) to determine candidate predictors (p < 0.1)9,10,34 of disability worsening and conversion to SPMS to be further considered for random forest (RF) analysis. The heterogeneity of between-phenotype effects was tested with interaction terms. Then, RF probability models were used to identify variables independently associated with clinical worsening and SPMS conversion. For each model, 10,000 trees were built on a random subset of covariates (including only demographic and clinical variables, adding conventional and finally network MRI variables), with a follow-up duration-weighted bootstrap resampling of observations. We assessed feature relevance with an outcome permutation test (1,000 permutations), providing an unbiased measure of variable importance and significance p values for each predictor.35 DMT change, but not DMT at baseline, was included as a covariate because it did not differ between stable/worsened MS, nor between SPMS converters/nonconverters. We reported the out-of-bag (OOB) Brier score (mean squared prediction error) of final models, based on selected features. A receiver operating characteristic analysis tested the significance of partial contributions of conventional and network MRI vs clinical variables to model discriminative ability (OOB area under the curve [AUC]).

Considering the exploratory nature of our analysis, significance in logistic regression and RF analyses was set at p < 0.1, false discovery rate (FDR) corrected for multiple comparisons (Benjamini-Hochberg procedure). Uncorrected results (p < 0.05) are also reported.

Data Availability

The data set used and analyzed during the current study is available from the corresponding author on reasonable request.

Results

Demographic, Clinical, and Conventional MRI

Compared with HCs, patients with MS (as a whole and according to phenotype) showed significantly lower brain and deep GM volumetry. Patients with PMS were older (p < 0.001), had higher EDSS score (p < 0.001), longer disease duration (p < 0.001), higher T2 (p < 0.001) and T1 LV (p < 0.001), and lower brain volumetry (p = range <0.001–0.002) than those with RRMS (table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1

Main Demographic, Clinical, and Conventional MRI Measures of HCs and Patients With MS (as a Whole and According to the Clinical Phenotype)

The median EDSS score at follow-up was = 4.0 (interquartile range = 1.5–6.5) (median EDSS score change between baseline and follow-up = 0.5, interquartile range = 0.0–1.5, p value vs baseline<0.0001). According to EDSS score changes, 105 patients with MS (45%) were clinically worsened at follow-up: 1 patient (of 2, 50%) had baseline EDSS score = 0, 71 patients (of 184, 38%) had baseline EDSS score between 0.5 and 5.5, and 33 patients (of 47, 70%) had baseline EDSS score ≥6. Moreover, 26 patients with RRMS (16%) converted to SPMS.

At baseline, compared with clinically stable, patients with clinically worsened MS were older, had longer disease duration, higher EDSS score, higher LV, and more severe whole-brain and GM atrophy (table 2). Compared with patients remaining RRMS, SPMS converters had a higher proportion of males, were older, and had higher baseline EDSS score and lower brain volumetry (table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2

Demographic, Clinical, and Conventional MRI Measures of Patients With MS, Divided According to Clinical Worsening at Follow-up, and of Patients With RRMS, Divided According to Conversion to SPMS at Follow-up

RS FC Networks

Eight functional networks (figure 1) were selected: 2 sensorimotor networks (SMN I and II),28 1 basal ganglia network (BGN),29 3 default-mode networks (DMNs I, II, and III),30 1 salience network (SN),31 and 1 fronto-parietal network (FPN) associated with working memory and dorsal attention28 (r with corresponding templates = range 0.40–0.65).

Figure 1
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1 Main Functional and Structural Networks of Interest Related to Sensory, Motor, and High-Order Integrative Functions in Patients With Multiple Sclerosis (MS) and Healthy Controls (HCs)

Spatial maps of relevant (A) resting-state (RS) functional connectivity (FC) and (B) gray matter (GM) networks. RS FC networks were thresholded at p < 0.05, with family-wise error corrected (positive effects of interest from the 2-sample t test). GM structural networks were selected by visual inspection and spatial matching with RS FC networks, and as in previous studies,23 they were displayed using a threshold z-score >2.

At the regional level, decreased and increased RS FC within specific regions in patients with MS vs HC were found (e-table 2, links.lww.com/NXI/A485; figure 2). Specifically, decreased RS FC was observed in patients with MS within the SMN I in the right paracentral lobule and supplementary motor area (SMA), within the BGN in the right cerebellum, within the SN in the right insula and left caudate nucleus, within the DMN I/III in the left posterior cingulate and right caudate nucleus, and within the FPN in the right anterior cingulate. Increased RS FC was detected in the bilateral precentral and postcentral gyrus within the SMN I/II, and frontal regions within the DMN II.

Figure 2
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2 Between-Group Comparison of Functional and Structural Networks Between HC and MS

(A) Voxel-wise between-group comparisons of RS FC: the blue–light blue color scale shows decreased RS FC in MS vs HC, whereas the red-yellow color scale shows increased RS FC in MS vs HC (age- and sex-adjusted 2-sample t test, p < 0.001 uncorrected for illustrative purposes). (B) Boxplots showing average loading coefficients (means and SDs) of relevant GM networks. MS = multiple sclerosis; FC = functional connectivity; GM = gray matter; HC = healthy controls.

Considering FNC analysis, connectivity strength was significantly decreased in patients with MS vs HCs between SMN I-BGN (p = 0.02) and SMN I-DMN II (p = 0.01), as well as between FPN-DMN I (p = 0.01) and FPN-SN (p = 0.002) (e-table 2, links.lww.com/NXI/A485).

GM Networks

Seven GM networks matched functional networks: 2 SMNs, one including precentral and postcentral, middle occipital gyri, and cerebellum (r with functional SMN I = 0.32, p < 0.001) and the other including precentral gyri, SMA, and cerebellum (r with functional SMN II = 0.44, p < 0.001); 1 BGN, including deep GM and cerebellum (r with functional BGN = 0.80, p < 0.001); 2 DMNs, one including posterior cingulate, precuneus, and angular gyri (r with functional DMN I = 0.55, p < 0.001) and the other including medial frontal, middle frontal, and angular gyri (r with functional DMN II = 0.73, p < 0.001); 1 SN (r with functional SN = 0.56, p < 0.001); and 1 FPN (r with functional FPN = 0.43, p < 0.001).33 Patients with MS showed significant GM atrophy (i.e., lower GM loadings) vs HCs in all networks, except for SMN II (figure 2).

Prediction Analysis

The univariate analysis identified, at corrected threshold, older baseline age, longer disease duration, higher EDSS score, higher LV, lower global brain volumetry, lower GM loading coefficients for all networks, and reduced FNC between DMN II-DMN III as candidate predictors of disability worsening (table 3). At an uncorrected threshold, the following candidate predictors of EDSS score worsening were also identified: decreased RS FC in the SMA and increased RS FC in the left precentral gyrus of SMNs, reduced FNC between DMN III-FPN, and increased FNC between DMN I-DMN III (table 3).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3

Candidate Predictors (p < 0.10) of Disability Worsening in All Patients With MS and Candidate Predictors of Conversion to SPMS in RRMS by Follow-up Adjusted Logistic Regression Models

RF analysis identified as FDR-corrected predictors of clinical worsening a higher baseline EDSS score, lower normalized brain and GM volumes, reduced FNC between DMN II-DMN III, increased RS FC of the left precentral gyrus (SMN II), and GM atrophy in FPN (table 4, figure 3). An FDR-uncorrected contribution of GM atrophy in SMN II and SN was also found. When considering all predictors, the receiver operating characteristic analysis (AUC = 0.76, table 4, figure 3) highlighted that the inclusion of network MRI variables significantly improved (p = 0.009) prediction performances. Results did not change substantially with FDR-corrected predictors only (AUC = 0.74, improvement of prediction performance: p = 0.05).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 4

Informative Predictors of Disability Worsening in All Patients With MS, as Well as Independent Predictors of Conversion to SPMS in RRMS, Selected by Random Forest Analyses

Figure 3
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3 Analysis of Prediction

Results of the ROC analysis showing the area under the curve (OOB AUC) of random forest models predicting clinical disability worsening (A) and conversion to SPMS (B). Models show the increments of AUC associated with the inclusion of conventional MRI variables (green lines) and network MRI variables (orange lines) in addition to confounding covariates and clinical variables (purple lines). AUC = area under the curve; OOB = out-of-bag; ROC = receiver operating characteristic; SPMS = secondary progressive multiple sclerosis.

The univariate analysis identified as FDR-corrected predictors for SPMS conversion male sex, older baseline age, higher EDSS score, lower normalized brain and GM volumes, and GM loadings of SMN and FPN (table 3). At an uncorrected threshold, the following candidate SPMS predictors were also detected: lower deep GM volumes, decreased RS FC in the SMA (SMN I), decreased FNC between DMN II-DMN III and DMN II-BGN, and lower GM loadings of BGN and DMN (table 3). As shown in table 4, the RF model selected baseline EDSS score, normalized GM volume, and GM atrophy in the SMN I as FDR-corrected predictors of SPMS conversion. The receiver operating characteristic analysis (table 4, figure 3) highlighted the significant contribution (p = 0.02) of network MRI variables to model performance.

Discussion

By analyzing a large cohort of patients with MS having a 6.4-year follow-up clinical evaluation, we found that integrating structural and functional network measures significantly improved clinical worsening prediction. Besides higher baseline EDSS score and lower whole-GM volumetry, abnormal baseline RS FC within and between sensorimotor and DMNs, as well as sensorimotor and cognitive GM network atrophy, contributed to explain overall disability progression. Moreover, GM atrophy in an SMN was among the determinants of SPMS conversion. Prediction models of both clinical worsening and SPMS conversion were produced using RF methodology, a machine-learning technique that is less sensitive to false discoveries than classic multivariate logistic models,36 being based on the use of different bootstrap samples of data and different subsets of predictors to construct thousands of decision trees, on which hypotheses are tested.36

As clinical outcomes, we selected the EDSS score, the most widely validated MS disability measure, which was used in all prognostic studies,6,7,9,-,12,14,15 and evolution to SPMS, that is associated with a poor prognosis, mostly because of the limited DMT effect in these patients. During the 6.4-year follow-up, 45% of patients had a worsening of disability and 16% of patients with RRMS evolved to SPMS. In line with previous studies, older age, longer disease duration, and higher baseline EDSS score were associated with poorer clinical outcomes.7,37 In particular, a higher baseline EDSS score was retained by multivariable analysis as a predictor of both worsening of disability and evolution to SPMS. This is in line with a recent meta-analysis, indicating baseline EDSS score as the most frequent predictor of future disease course.7 On the other hand, this result may be partially driven by autocorrelation issues.

In addition to baseline disability, different MRI measures contributed to the prediction of disease evolution. Concerning conventional MRI, whole-brain atrophy was predictive of disease worsening at RF analysis. Likewise, whole-GM atrophy was retained as a predictor of both clinical worsening and SPMS conversion. The notion that whole-GM atrophy is one of the most important MRI measures explaining disability deterioration is in line with previous medium- and long-term studies.9,11,12 Because we included both RRMS and PMS, our results support the importance of this measure independently from phenotype and reinforce the notion that the neurodegenerative MS-related damage is more critical than inflammation to explain a worse clinical course. In line with this, LV was not retained as a predictor by any RF model.

One of the main strengths of this study, compared with previous ones, was the assessment of network-specific MRI measures. This was a rewarding strategy to ameliorate prediction of MS disease evolution because both functional and structural network MRI abnormalities were found to be informative of subsequent clinical deterioration at medium-term, and inclusion of network MRI metrics in RF models significantly improved prediction performance.

Considering the prediction of EDSS score worsening, 2 fMRI outcomes were selected by RF analysis, namely, decreased FNC among DMNs and increased RS FC of the left precentral gyrus in the SMN II. The role of fMRI for prognosis has still to be fully investigated. Although there is some preliminary evidence of a significant influence of baseline FC during a psychological stress fMRI task on subsequent development of atrophy,21 and a significant influence of baseline RS FC abnormalities on subsequent clinical disability,19,20 studies in large patients' groups including all main disease phenotypes are still missing. Here, a prevalent decrease of RS FC among networks18 and a heterogeneous pattern of regionally increased and decreased RS FC were confirmed.18,23,38 However, only abnormalities of RS FC in the DMN and SMN were associated with EDSS score worsening. The DMN is one of the key networks of the brain, and abnormal DMN RS FC is present in several brain disorders, including MS.23,30 A good control of DMN activity is crucial for an efficient brain function.30 In line with this, we found that reduced RS FC between 2 DMN patterns (including the posterior and the anterior nodes of this network, respectively) was able to explain clinical worsening. This reinforces the notion of a close correlation between impaired functional communication and increasing disability in MS. On the other hand, we also found that a selective increase of RS FC within a specific region of the SMN (i.e., the left precentral gyrus) was predictive of clinical deterioration. A previous 2-year graph analysis study in 38 patients with early RRMS20 showed that at baseline, patients had an increased network RS FC, which tended to decrease during the study follow-up, concomitantly with disability progression. Previous findings suggest that increased RS FC may occur at early disease stages to compensate structural damage and may stop after reaching a maximum level.19,20,39 In later phases, RS FC depletion is thought to contribute to disability progression.20,23 Our results further support such hypothesis in a larger group of patients and with a longer follow-up. Remarkably, we found that this behavior distinguished the SMN, which is most likely clinically related to EDSS score deterioration.

Of interest, besides whole-GM atrophy, RF analysis also identified GM atrophy in the FPN to be predictive of a worse disease evolution. This is not the first study that highlights a significant contribution of network GM measures to MS prognosis.14,15 Taken together, these results suggest that the assessment of specific system involvement may convey more clinically relevant pieces of information than global MRI measures in these patients.

In patients with RRMS, RF analysis identified atrophy of SMN I as significantly contributing to explain evolution to SPMS, whereas none of the other advanced MRI measures significant at the univariate analysis was retained. A unique definition of SPMS is still lacking and is a matter of current research.40 To be consistent with available literature, we applied the definition used in integrated clinical-MRI prognostic studies.9,11,26 The relation that we found between SMN atrophy and evolution to SPMS is not unexpected, considering that disability worsening in these patients is mostly driven by a progressive impairment of ambulation. In line with this, previous cross-sectional studies found peculiar atrophy of brain motor areas in patients with SPMS.41

Our study has the unique value of a large, monocentric, well-characterized patients' cohort. However, this study has some limitations. First, clinical evaluation did not include a baseline and follow-up cognitive assessment, which can have detrimental consequences on patients' functioning. Moreover, because we did not have a cognitive evaluation, we could not assess worsening of other scores than EDSS (e.g., the Multiple Sclerosis Functional Composite). Second, because of the complexity of the MRI protocol, we did not include a spinal cord evaluation, which may be relevant for disability accumulation and SPMS evolution.11 Third, a follow-up MRI scan was not available, thus making it impossible to quantify changes of WM LV and/or other MRI disease severity parameters. Fourth, not all data-driven structural and functional networks had a significant spatial correspondence, leading to the exclusion of potentially interesting components (e.g., the visual network); moreover, they may be not fully replicable in different data sets. Fifth, given the exploratory nature of this study, we used a relatively liberal threshold for FDR correction; moreover, the small portion of results not surviving at this threshold should be interpreted with extreme caution. Sixth, the use of the whole data set for feature selection (with logistic regressions) and for the subsequent construction of RF models may increase the risk of model overfitting; as such, results may be biased by double-dipping issues. Finally, this study was not planned to assess the role of treatment on clinical outcomes. Therefore, detailed information on treatment exposure was not collected and analyzed.

To conclude, we found that integrating structural and functional MRI network measures improved prediction of clinical worsening. The added value of other MRI and serologic biomarkers, such as WM network damage assessed by diffusion-weighted MRI, demyelination/remyelination indices derived from magnetization transfer imaging, or neurofilament light chain, might be the topic of future investigations.

Study Funding

This study was partially supported by FISM (Fondazione Italiana Sclerosi Multipla) cod. 2018/R/5 and was financed or co-financed with the “5 per mille” public funding.

Disclosure

M.A. Rocca received speaker honoraria from Bayer, Biogen, Bristol-Myers Squibb, Celgene, Genzyme, Merck-Serono, Novartis, Roche, and Teva and receives research support from the Italian Ministry of Health, MS Society of Canada, and Fondazione Italiana Sclerosi Multipla. P Valsasina, A Meani, and E Pagani received speaker's honoraria from Biogen Idec. C. Cordani and C. Cervellin report no disclosures relevant to the manuscript. M Filippi is Editor-in-Chief of the Journal of Neurology and Associate Editor of Human Brain Mapping; received compensation for consulting services and/or speaking activities from Almirall, Alexion, Bayer, Biogen, Celgene, Eli Lilly, Genzyme, Merck-Serono, Novartis, Roche, Sanofi, Takeda, and Teva Pharmaceutical Industries; and receives research support from Biogen Idec, Merck-Serono, Novartis, Roche, Teva Pharmaceutical Industries, Italian Ministry of Health, Fondazione Italiana Sclerosi Multipla, and ARiSLA (Fondazione Italiana di Ricerca per la SLA). Go to Neurology.org/NN for full disclosures.

Appendix Authors

Table

Footnotes

  • Go to Neurology.org/NN for full disclosures. Funding information is provided at the end of the article.

  • The Article Processing Charge was funded by the authors.

  • Received August 26, 2020.
  • Accepted in final form March 5, 2021.
  • Copyright © 2021 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the American Academy of Neurology.

This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND), which permits downloading and sharing the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.

References

  1. 1.↵
    1. Filippi M,
    2. Bar-Or A,
    3. Piehl F, et al.
    Multiple sclerosis. Nat Rev Dis Primers 2018;4:43.
    OpenUrl
  2. 2.↵
    1. Montalban X,
    2. Gold R,
    3. Thompson AJ, et al.
    ECTRIMS/EAN Guideline on the pharmacological treatment of people with multiple sclerosis. Mult Scler 2018;24:96–120.
    OpenUrlPubMed
  3. 3.↵
    1. Thompson AJ,
    2. Banwell BL,
    3. Barkhof F, et al.
    Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. Lancet Neurol 2018;17:162–173.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Gasperini C,
    2. Prosperini L,
    3. Tintore M, et al.
    Unraveling treatment response in multiple sclerosis: a clinical and MRI challenge. Neurology 2019;92:180–192.
    OpenUrl
  5. 5.↵
    1. Fisniku LK,
    2. Brex PA,
    3. Altmann DR, et al.
    Disability and T2 MRI lesions: a 20-year follow-up of patients with relapse onset of multiple sclerosis. Brain 2008;131:808–817.
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Elliott C,
    2. Belachew S,
    3. Wolinsky JS, et al.
    Chronic white matter lesion activity predicts clinical progression in primary progressive multiple sclerosis. Brain 2019;142:2787–2799.
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Brown FS,
    2. Glasmacher SA,
    3. Kearns PKA, et al.
    Systematic review of prediction models in relapsing remitting multiple sclerosis. PLoS One 2020;15:e0233575.
    OpenUrlPubMed
  8. 8.↵
    1. Enzinger C,
    2. Barkhof F,
    3. Ciccarelli O, et al.
    Nonconventional MRI and microstructural cerebral changes in multiple sclerosis. Nat Rev Neurol 2015;11:676–686.
    OpenUrlCrossRefPubMed
  9. 9.↵
    1. Filippi M,
    2. Preziosa P,
    3. Copetti M, et al.
    Gray matter damage predicts the accumulation of disability 13 years later. Neurology 2013;81:1759–1767.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Rocca MA,
    2. Sormani MP,
    3. Rovaris M, et al.
    Long-term disability progression in primary progressive multiple sclerosis: a 15-year study. Brain 2017;140:2814–2819.
    OpenUrl
  11. 11.↵
    1. Brownlee WJ,
    2. Altmann DR,
    3. Prados F, et al.
    Early imaging predictors of long-term outcomes in relapse-onset multiple sclerosis. Brain 2019;142:2276–2287.
    OpenUrl
  12. 12.↵
    1. Dekker I,
    2. Eijlers AJC,
    3. Popescu V, et al.
    Predicting clinical progression in multiple sclerosis after 6 and 12 years. Eur J Neurol 2019;26:893–902.
    OpenUrlCrossRefPubMed
  13. 13.↵
    1. He Y,
    2. Dagher A,
    3. Chen Z, et al.
    Impaired small-world efficiency in structural cortical networks in multiple sclerosis associated with white matter lesion load. Brain 2009;132:3366–3379.
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Muthuraman M,
    2. Fleischer V,
    3. Kroth J, et al.
    Covarying patterns of white matter lesions and cortical atrophy predict progression in early MS. Neurol Neuroimmunol Neuroinflamm 2020;7:e681.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    1. Tur C,
    2. Kanber B,
    3. Eshaghi A, et al.
    Clinical relevance of cortical network dynamics in early primary progressive MS. Mult Scler 2020;26:442–456.
    OpenUrlPubMed
  16. 16.↵
    1. Rocca MA,
    2. Valsasina P,
    3. Meani A,
    4. Falini A,
    5. Comi G,
    6. Filippi M
    . Impaired functional integration in multiple sclerosis: a graph theory study. Brain Struct Funct 2016;221:115–131.
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Liu Y,
    2. Duan Y,
    3. Dong H,
    4. Barkhof F,
    5. Li K,
    6. Shu N
    . Disrupted module efficiency of structural and functional brain connectomes in clinically isolated syndrome and multiple sclerosis. Front Hum Neurosci 2018;12:138.
    OpenUrl
  18. 18.↵
    1. Rocca MA,
    2. Valsasina P,
    3. Martinelli V, et al.
    Large-scale neuronal network dysfunction in relapsing-remitting multiple sclerosis. Neurology 2012;79:1449–1457.
    OpenUrlCrossRefPubMed
  19. 19.↵
    1. Hidalgo de La Cruz M,
    2. Valsasina P,
    3. Mesaros S, et al.
    Clinical predictivity of thalamic sub-regional connectivity in clinically isolated syndrome: a 7-year study. Mol Psychiatry 2020.
  20. 20.↵
    1. Faivre A,
    2. Robinet E,
    3. Guye M, et al.
    Depletion of brain functional connectivity enhancement leads to disability progression in multiple sclerosis: a longitudinal resting-state fMRI study. Mult Scler 2016;22:1695–1708.
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Meyer-Arndt L,
    2. Hetzer S,
    3. Asseyer S, et al.
    Blunted neural and psychological stress processing predicts future grey matter atrophy in multiple sclerosis. Neurobiol Stress 2020;13:100244.
    OpenUrl
  22. 22.↵
    1. Lublin FD,
    2. Reingold SC,
    3. Cohen JA, et al.
    Defining the clinical course of multiple sclerosis: the 2013 revisions. Neurology 2014;83:278–286.
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Rocca MA,
    2. Valsasina P,
    3. Leavitt VM, et al.
    Functional network connectivity abnormalities in multiple sclerosis: correlations with disability and cognitive impairment. Mult Scler 2018;24:459–471.
    OpenUrl
  24. 24.↵
    1. Kurtzke JF
    . Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 1983;33:1444–1452.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Healy BC,
    2. Engler D,
    3. Glanz B,
    4. Musallam A,
    5. Chitnis T
    . Assessment of definitions of sustained disease progression in relapsing-remitting multiple sclerosis. Mult Scler Int 2013;2013:189624.
    OpenUrlPubMed
  26. 26.↵
    1. Cree BA,
    2. Gourraud PA,
    3. Oksenberg JR, et al.
    University of California SFMSET, Cree BA, Gourraud PA, Oksenberg JR, et al. Long-term evolution of multiple sclerosis disability in the treatment era. Ann Neurol 2016;80:499–510.
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Scalfari A,
    2. Neuhaus A,
    3. Daumer M,
    4. Deluca GC,
    5. Muraro PA,
    6. Ebers GC
    . Early relapses, onset of progression, and late outcome in multiple sclerosis. JAMA Neurol 2013;70:214–222.
    OpenUrl
  28. 28.↵
    1. Smith SM,
    2. Fox PT,
    3. Miller KL, et al.
    Correspondence of the brain's functional architecture during activation and rest. Proc Natl Acad Sci United States America 2009;106:13040–13045.
    OpenUrl
  29. 29.↵
    1. Patenaude B,
    2. Smith SM,
    3. Kennedy DN,
    4. Jenkinson M
    . A Bayesian model of shape and appearance for subcortical brain segmentation. NeuroImage 2011;56:907–922.
    OpenUrlCrossRefPubMed
  30. 30.↵
    1. Raichle ME,
    2. Snyder AZ
    . A default mode of brain function: a brief history of an evolving idea. NeuroImage 2007;37:1083–1090. discussion 1097-1089.
    OpenUrlCrossRefPubMed
  31. 31.↵
    1. Seeley WW,
    2. Menon V,
    3. Schatzberg AF, et al.
    Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci 2007;27:2349–2356.
    OpenUrlAbstract/FREE Full Text
  32. 32.↵
    1. Xu L,
    2. Groth KM,
    3. Pearlson G,
    4. Schretlen DJ,
    5. Calhoun VD
    . Source-based morphometry: the use of independent component analysis to identify gray matter differences with application to schizophrenia. Hum Brain Mapp 2009;30:711–724.
    OpenUrlCrossRefPubMed
  33. 33.↵
    1. Segall JM,
    2. Allen EA,
    3. Jung RE, et al.
    Correspondence between structure and function in the human brain at rest. Front neuroinformatics 2012;6:10.
    OpenUrlCrossRefPubMed
  34. 34.↵
    1. Rocca MA,
    2. Parisi L,
    3. Pagani E, et al.
    Regional but not global brain damage contributes to fatigue in multiple sclerosis. Radiology 2014;273:511–520.
    OpenUrlCrossRefPubMed
  35. 35.↵
    1. Altmann A,
    2. Tolosi L,
    3. Sander O,
    4. Lengauer T
    . Permutation importance: a corrected feature importance measure. Bioinformatics 2010;26:1340–1347.
    OpenUrlCrossRefPubMed
  36. 36.↵
    1. Kacar K,
    2. Rocca MA,
    3. Copetti M, et al.
    Overcoming the clinical-MR imaging paradox of multiple sclerosis: MR imaging data assessed with a random forest approach. AJNR Am J Neuroradiol 2011;32:2098–2102.
    OpenUrlAbstract/FREE Full Text
  37. 37.↵
    1. Fambiatos A,
    2. Jokubaitis V,
    3. Horakova D, et al.
    Risk of secondary progressive multiple sclerosis: a longitudinal study. Mult Scler 2020;26:79–90.
    OpenUrlCrossRefPubMed
  38. 38.↵
    1. Faivre A,
    2. Rico A,
    3. Zaaraoui W, et al.
    Assessing brain connectivity at rest is clinically relevant in early multiple sclerosis. Mult Scler 2012;18:1251–1258.
    OpenUrlCrossRefPubMed
  39. 39.↵
    1. Rocca MA,
    2. Hidalgo de La Cruz M,
    3. Valsasina P, et al.
    Two-year dynamic functional network connectivity in clinically isolated syndrome. Mult Scler 2019:1352458519837704.
  40. 40.↵
    1. Lorscheider J,
    2. Buzzard K,
    3. Jokubaitis V, et al.
    Defining secondary progressive multiple sclerosis. Brain 2016;139:2395–2405.
    OpenUrlCrossRefPubMed
  41. 41.↵
    1. Ceccarelli A,
    2. Rocca MA,
    3. Pagani E, et al.
    A voxel-based morphometry study of grey matter loss in MS patients with different clinical phenotypes. NeuroImage 2008;42:315–322.
    OpenUrlCrossRefPubMed

Letters: Rapid online correspondence

No comments have been published for this article.
Comment

REQUIREMENTS

If you are uploading a letter concerning an article:
You must have updated your disclosures within six months: http://submit.neurology.org

Your co-authors must send a completed Publishing Agreement Form to Neurology Staff (not necessary for the lead/corresponding author as the form below will suffice) before you upload your comment.

If you are responding to a comment that was written about an article you originally authored:
You (and co-authors) do not need to fill out forms or check disclosures as author forms are still valid
and apply to letter.

Submission specifications:

  • Submissions must be < 200 words with < 5 references. Reference 1 must be the article on which you are commenting.
  • Submissions should not have more than 5 authors. (Exception: original author replies can include all original authors of the article)
  • Submit only on articles published within 6 months of issue date.
  • Do not be redundant. Read any comments already posted on the article prior to submission.
  • Submitted comments are subject to editing and editor review prior to posting.

More guidelines and information on Disputes & Debates

Compose Comment

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
NOTE: The first author must also be the corresponding author of the comment.
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Publishing Agreement
NOTE: All authors, besides the first/corresponding author, must complete a separate Publishing Agreement Form and provide via email to the editorial office before comments can be posted.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Vertical Tabs

You May Also be Interested in

Back to top
  • Article
    • Abstract
    • Glossary
    • Methods
    • Results
    • Discussion
    • Study Funding
    • Disclosure
    • Appendix Authors
    • Footnotes
    • References
  • Figures & Data
  • Info & Disclosures
Advertisement

Preferences and User Experiences of Wearable Devices in Epilepsy A Systematic Review and Mixed-Methods Synthesis

Dr. Daniel Friedman and Dr. Sharon Chiang

► Watch

Related Articles

  • No related articles found.

Topics Discussed

  • Multiple sclerosis
  • Prognosis
  • fMRI
  • Volumetric MRI

Alert Me

  • Alert me when eletters are published
Neurology - Neuroimmunology Neuroinflammation: 10 (2)

Articles

  • Articles
  • Issues
  • Popular Articles

About

  • About the Journals
  • Ethics Policies
  • Editors & Editorial Board
  • Contact Us
  • Advertise

Submit

  • Author Center
  • Submit a Manuscript
  • Information for Reviewers
  • AAN Guidelines
  • Permissions

Subscribers

  • Subscribe
  • Sign up for eAlerts
  • RSS Feed
Site Logo
  • Visit neurology Template on Facebook
  • Follow neurology Template on Twitter
  • Visit Neurology on YouTube
  • Neurology
  • Neurology: Clinical Practice
  • Neurology: Education
  • Neurology: Genetics
  • Neurology: Neuroimmunology & Neuroinflammation
  • AAN.com
  • AANnews
  • Continuum
  • Brain & Life
  • Neurology Today

Wolters Kluwer Logo

Neurology: Neuroimmunology & Neuroinflammation
Online ISSN: 2332-7812

© 2023 American Academy of Neurology

  • Privacy Policy
  • Feedback
  • Advertise