Search

Existing learning-based cortical surface reconstruction approaches heavily rely on the supervision of pseudo ground truth (pGT) cortical surfaces for training. Such pGT surfaces are generated by traditional neuroimage processing pipelines, which are time consuming and difficult to generalize well to low-resolution brain MRI, e.g., from fetuses and neonates. In this work, we present CoSeg, a learning-based cortical surface reconstruction framework weakly supervised by brain segmentations without the need for pGT surfaces. CoSeg introduces temporal attention networks to learn time-varying velocity fields from brain MRI for diffeomorphic surface deformations, which fit an initial surface to target cortical surfaces within only 0.11 seconds for each brain hemisphere. A weakly supervised loss is designed to reconstruct pial surfaces by inflating the white surface along the normal direction towards the boundary of the cortical gray matter segmentation. This alleviates partial volume effects and encourages the pial surface to deform into deep and challenging cortical sulci. We evaluate CoSeg on 1,113 adult brain MRI at 1mm and 2mm resolution. CoSeg achieves superior geometric and morphological accuracy compared to existing learning-based approaches. We also verify that CoSeg can extract high-quality cortical surfaces from fetal brain MRI on which traditional pipelines fail to produce acceptable results., Comment: Accepted by the 27th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024)

Clinical adoption of deep learning models has been hindered, in part, because the black-box nature of neural networks leads to concerns regarding their trustworthiness and reliability. These concerns are particularly relevant in the field of neuroimaging due to the complex brain phenotypes and inter-subject heterogeneity often encountered. The challenge can be addressed by interpretable deep learning (iDL) methods that enable the visualisation and interpretation of the inner workings of deep learning models. This study systematically reviewed the literature on neuroimaging applications of iDL methods and critically analysed how iDL explanation properties were evaluated. Seventy-five studies were included, and ten categories of iDL methods were identified. We also reviewed five properties of iDL explanations that were analysed in the included studies: biological validity, robustness, continuity, selectivity, and downstream task performance. We found that the most popular iDL approaches used in the literature may be sub-optimal for neuroimaging data, and we discussed possible future directions for the field.

The Developing Human Connectome Project (dHCP) aims to explore developmental patterns of the human brain during the perinatal period. An automated processing pipeline has been developed to extract high-quality cortical surfaces from structural brain magnetic resonance (MR) images for the dHCP neonatal dataset. However, the current implementation of the pipeline requires more than 6.5 hours to process a single MRI scan, making it expensive for large-scale neuroimaging studies. In this paper, we propose a fast deep learning (DL) based pipeline for dHCP neonatal cortical surface reconstruction, incorporating DL-based brain extraction, cortical surface reconstruction and spherical projection, as well as GPU-accelerated cortical surface inflation and cortical feature estimation. We introduce a multiscale deformation network to learn diffeomorphic cortical surface reconstruction end-to-end from T2-weighted brain MRI. A fast unsupervised spherical mapping approach is integrated to minimize metric distortions between cortical surfaces and projected spheres. The entire workflow of our DL-based dHCP pipeline completes within only 24 seconds on a modern GPU, which is nearly 1000 times faster than the original dHCP pipeline. The qualitative assessment demonstrates that for 82.5% of the test samples, the cortical surfaces reconstructed by our DL-based pipeline achieve superior (54.2%) or equal (28.3%) surface quality compared to the original dHCP pipeline., Comment: Accepted by Medical Image Analysis

Cortical surface analysis has gained increased prominence, given its potential implications for neurological and developmental disorders. Traditional vision diffusion models, while effective in generating natural images, present limitations in capturing intricate development patterns in neuroimaging due to limited datasets. This is particularly true for generating cortical surfaces where individual variability in cortical morphology is high, leading to an urgent need for better methods to model brain development and diverse variability inherent across different individuals. In this work, we proposed a novel diffusion model for the generation of cortical surface metrics, using modified surface vision transformers as the principal architecture. We validate our method in the developing Human Connectome Project (dHCP), the results suggest our model demonstrates superior performance in capturing the intricate details of evolving cortical surfaces. Furthermore, our model can generate high-quality realistic samples of cortical surfaces conditioned on postmenstrual age(PMA) at scan., Comment: 4 pages

We generalise results by Lamberti and Lanza de Cristoforis (2005) concerning the continuity of projections onto eigenspaces of self-adjoint differential operators with compact inverses as the (spatial) domain of the functions is perturbed in $\mathbb{R}^2$. Our main case of interest is the Dirichlet Laplacian. We extend these results from bounds from $H_0^1$ to $H_0^1$ to bounds from $L^p$ to $L^p$, under the assumption that $(-\Delta^{-1}-z)^{-1}$ is $L^p$ bounded when $z$ lies outside of the spectrum of $-\Delta^{-1}$. We show that this assumption is met if the initial domain is a square or a rectangle., Comment: 27 pages, 2 figures

This paper introduces GeoMorph, a novel geometric deep-learning framework designed for image registration of cortical surfaces. The registration process consists of two main steps. First, independent feature extraction is performed on each input surface using graph convolutions, generating low-dimensional feature representations that capture important cortical surface characteristics. Subsequently, features are registered in a deep-discrete manner to optimize the overlap of common structures across surfaces by learning displacements of a set of control points. To ensure smooth and biologically plausible deformations, we implement regularization through a deep conditional random field implemented with a recurrent neural network. Experimental results demonstrate that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Furthermore, GeoMorph exhibits competitive performance compared to classical frameworks. Such versatility and robustness suggest strong potential for various neuroscience applications.

The development of robust and generalisable models for encoding the spatio-temporal dynamics of human brain activity is crucial for advancing neuroscientific discoveries. However, significant individual variation in the organisation of the human cerebral cortex makes it difficult to identify population-level trends in these signals. Recently, Surface Vision Transformers (SiTs) have emerged as a promising approach for modelling cortical signals, yet they face some limitations in low-data scenarios due to the lack of inductive biases in their architecture. To address these challenges, this paper proposes the surface Masked AutoEncoder (sMAE) and video surface Masked AutoEncoder (vsMAE) - for multivariate and spatio-temporal pre-training of cortical signals over regular icosahedral grids. These models are trained to reconstruct cortical feature maps from masked versions of the input by learning strong latent representations of cortical structure and function. Such representations translate into better modelling of individual phenotypes and enhanced performance in downstream tasks. The proposed approach was evaluated on cortical phenotype regression using data from the young adult Human Connectome Project (HCP) and developing HCP (dHCP). Results show that (v)sMAE pre-trained models improve phenotyping prediction performance on multiple tasks by $\ge 26\%$, and offer faster convergence relative to models trained from scratch. Finally, we show that pre-training vision transformers on large datasets, such as the UK Biobank (UKB), supports transfer learning to low-data regimes. Our code and pre-trained models are publicly available at https://github.com/metrics-lab/surface-masked-autoencoders ., Comment: Accepted for publications for MIDL 2024; 20 figures; 7 figures

Cortical surface reconstruction plays a fundamental role in modeling the rapid brain development during the perinatal period. In this work, we propose Conditional Temporal Attention Network (CoTAN), a fast end-to-end framework for diffeomorphic neonatal cortical surface reconstruction. CoTAN predicts multi-resolution stationary velocity fields (SVF) from neonatal brain magnetic resonance images (MRI). Instead of integrating multiple SVFs, CoTAN introduces attention mechanisms to learn a conditional time-varying velocity field (CTVF) by computing the weighted sum of all SVFs at each integration step. The importance of each SVF, which is estimated by learned attention maps, is conditioned on the age of the neonates and varies with the time step of integration. The proposed CTVF defines a diffeomorphic surface deformation, which reduces mesh self-intersection errors effectively. It only requires 0.21 seconds to deform an initial template mesh to cortical white matter and pial surfaces for each brain hemisphere. CoTAN is validated on the Developing Human Connectome Project (dHCP) dataset with 877 3D brain MR images acquired from preterm and term born neonates. Compared to state-of-the-art baselines, CoTAN achieves superior performance with only 0.12mm geometric error and 0.07% self-intersecting faces. The visualization of our attention maps illustrates that CoTAN indeed learns coarse-to-fine surface deformations automatically without intermediate supervision., Comment: Accepted by the 26th International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2023

Surface meshes are a favoured domain for representing structural and functional information on the human cortex, but their complex topology and geometry pose significant challenges for deep learning analysis. While Transformers have excelled as domain-agnostic architectures for sequence-to-sequence learning, the quadratic cost of the self-attention operation remains an obstacle for many dense prediction tasks. Inspired by some of the latest advances in hierarchical modelling with vision transformers, we introduce the Multiscale Surface Vision Transformer (MS-SiT) as a backbone architecture for surface deep learning. The self-attention mechanism is applied within local-mesh-windows to allow for high-resolution sampling of the underlying data, while a shifted-window strategy improves the sharing of information between windows. Neighbouring patches are successively merged, allowing the MS-SiT to learn hierarchical representations suitable for any prediction task. Results demonstrate that the MS-SiT outperforms existing surface deep learning methods for neonatal phenotyping prediction tasks using the Developing Human Connectome Project (dHCP) dataset. Furthermore, building the MS-SiT backbone into a U-shaped architecture for surface segmentation demonstrates competitive results on cortical parcellation using the UK Biobank (UKB) and manually-annotated MindBoggle datasets. Code and trained models are publicly available at https://github.com/metrics-lab/surface-vision-transformers., Comment: Accepted for publication at MIDL 2024, 17 pages, 6 figures

The extension of convolutional neural networks (CNNs) to non-Euclidean geometries has led to multiple frameworks for studying manifolds. Many of those methods have shown design limitations resulting in poor modelling of long-range associations, as the generalisation of convolutions to irregular surfaces is non-trivial. Recent state-of-the-art performance of Vision Transformers (ViTs) demonstrates that a general-purpose architecture, which implements self-attention, could replace the local feature learning operations of CNNs. Motivated by the success of attention-modelling in computer vision, we extend ViTs to surfaces by reformulating the task of surface learning as a sequence-to-sequence problem and propose a patching mechanism for surface meshes. We validate the performance of the proposed Surface Vision Transformer (SiT) on two brain age prediction tasks in the developing Human Connectome Project (dHCP) dataset and investigate the impact of pre-training on model performance. Experiments show that the SiT outperforms many surface CNNs, while indicating some evidence of general transformation invariance. Code available at https://github.com/metrics-lab/surface-vision-transformers, Comment: 7 pages, 1 figure, accepted to Transformers for Vision (T4V) workshop at CVPR 2022. arXiv admin note: substantial text overlap with arXiv:2204.03408, arXiv:2203.16414

Recent state-of-the-art performances of Vision Transformers (ViT) in computer vision tasks demonstrate that a general-purpose architecture, which implements long-range self-attention, could replace the local feature learning operations of convolutional neural networks. In this paper, we extend ViTs to surfaces by reformulating the task of surface learning as a sequence-to-sequence learning problem, by proposing patching mechanisms for general surface meshes. Sequences of patches are then processed by a transformer encoder and used for classification or regression. We validate our method on a range of different biomedical surface domains and tasks: brain age prediction in the developing Human Connectome Project (dHCP), fluid intelligence prediction in the Human Connectome Project (HCP), and coronary artery calcium score classification using surfaces from the Scottish Computed Tomography of the Heart (SCOT-HEART) dataset, and investigate the impact of pretraining and data augmentation on model performance. Results suggest that Surface Vision Transformers (SiT) demonstrate consistent improvement over geometric deep learning methods for brain age and fluid intelligence prediction and achieve comparable performance on calcium score classification to standard metrics used in clinical practice. Furthermore, analysis of transformer attention maps offers clear and individualised predictions of the features driving each task. Code is available on Github: https://github.com/metrics-lab/surface-vision-transformers, Comment: 10 pages, 3 figures, Submitted to IEEE Transactions on Medical Imaging

The extension of convolutional neural networks (CNNs) to non-Euclidean geometries has led to multiple frameworks for studying manifolds. Many of those methods have shown design limitations resulting in poor modelling of long-range associations, as the generalisation of convolutions to irregular surfaces is non-trivial. Motivated by the success of attention-modelling in computer vision, we translate convolution-free vision transformer approaches to surface data, to introduce a domain-agnostic architecture to study any surface data projected onto a spherical manifold. Here, surface patching is achieved by representing spherical data as a sequence of triangular patches, extracted from a subdivided icosphere. A transformer model encodes the sequence of patches via successive multi-head self-attention layers while preserving the sequence resolution. We validate the performance of the proposed Surface Vision Transformer (SiT) on the task of phenotype regression from cortical surface metrics derived from the Developing Human Connectome Project (dHCP). Experiments show that the SiT generally outperforms surface CNNs, while performing comparably on registered and unregistered data. Analysis of transformer attention maps offers strong potential to characterise subtle cognitive developmental patterns., Comment: 22 pages, 6 figures, Accepted to MIDL 2022, OpenReview link https://openreview.net/forum?id=mpp843Bsf-

Cortical surface registration is a fundamental tool for neuroimaging analysis that has been shown to improve the alignment of functional regions relative to volumetric approaches. Classically, image registration is performed by optimizing a complex objective similarity function, leading to long run times. This contributes to a convention for aligning all data to a global average reference frame that poorly reflects the underlying cortical heterogeneity. In this paper, we propose a novel unsupervised learning-based framework that converts registration to a multi-label classification problem, where each point in a low-resolution control grid deforms to one of fixed, finite number of endpoints. This is learned using a spherical geometric deep learning architecture, in an end-to-end unsupervised way, with regularization imposed using a deep Conditional Random Field (CRF). Experiments show that our proposed framework performs competitively, in terms of similarity and areal distortion, relative to the most popular classical surface registration algorithms and generates smoother deformations than other learning-based surface registration methods, even in subjects with atypical cortical morphology., Comment: 13 pages

We present CortexODE, a deep learning framework for cortical surface reconstruction. CortexODE leverages neural ordinary differential equations (ODEs) to deform an input surface into a target shape by learning a diffeomorphic flow. The trajectories of the points on the surface are modeled as ODEs, where the derivatives of their coordinates are parameterized via a learnable Lipschitz-continuous deformation network. This provides theoretical guarantees for the prevention of self-intersections. CortexODE can be integrated to an automatic learning-based pipeline, which reconstructs cortical surfaces efficiently in less than 5 seconds. The pipeline utilizes a 3D U-Net to predict a white matter segmentation from brain Magnetic Resonance Imaging (MRI) scans, and further generates a signed distance function that represents an initial surface. Fast topology correction is introduced to guarantee homeomorphism to a sphere. Following the isosurface extraction step, two CortexODE models are trained to deform the initial surface to white matter and pial surfaces respectively. The proposed pipeline is evaluated on large-scale neuroimage datasets in various age groups including neonates (25-45 weeks), young adults (22-36 years) and elderly subjects (55-90 years). Our experiments demonstrate that the CortexODE-based pipeline can achieve less than 0.2mm average geometric error while being orders of magnitude faster compared to conventional processing pipelines., Comment: Accepted by IEEE Transactions on Medical Imaging

Generalized differential forms are used in discussions of metric geometries and Einstein's vacuum field equations. Cartan's structure equations are generalized and applied. In particular flat generalized connections are associated with any metric. Einstein's vacuum field equations and their Lorentzian four-metric solutions are considered from a novel point of view. It is shown how particular flat generalized connections and geometries can encode such Ricci flat metrics., Comment: 21 pages, minor corrections in Section 2

The study of functional brain connectivity (FC) is important for understanding the underlying mechanisms of many psychiatric disorders. Many recent analyses adopt graph convolutional networks, to study non-linear interactions between functionally-correlated states. However, although patterns of brain activation are known to be hierarchically organised in both space and time, many methods have failed to extract powerful spatio-temporal features. To overcome those challenges, and improve understanding of long-range functional dynamics, we translate an approach, from the domain of skeleton-based action recognition, designed to model interactions across space and time. We evaluate this approach using the Human Connectome Project (HCP) dataset on sex classification and fluid intelligence prediction. To account for subject topographic variability of functional organisation, we modelled functional connectomes using multi-resolution dual-regressed (subject-specific) ICA nodes. Results show a prediction accuracy of 94.4% for sex classification (an increase of 6.2% compared to other methods), and an improvement of correlation with fluid intelligence of 0.325 vs 0.144, relative to a baseline model that encodes space and time separately. Results suggest that explicit encoding of spatio-temporal dynamics of brain functional activity may improve the precision with which behavioural and cognitive phenotypes may be predicted in the future., Comment: MLCN 2021

Traditional cortical surface reconstruction is time consuming and limited by the resolution of brain Magnetic Resonance Imaging (MRI). In this work, we introduce Pial Neural Network (PialNN), a 3D deep learning framework for pial surface reconstruction. PialNN is trained end-to-end to deform an initial white matter surface to a target pial surface by a sequence of learned deformation blocks. A local convolutional operation is incorporated in each block to capture the multi-scale MRI information of each vertex and its neighborhood. This is fast and memory-efficient, which allows reconstructing a pial surface mesh with 150k vertices in one second. The performance is evaluated on the Human Connectome Project (HCP) dataset including T1-weighted MRI scans of 300 subjects. The experimental results demonstrate that PialNN reduces the geometric error of the predicted pial surface by 30% compared to state-of-the-art deep learning approaches., Comment: Accepted in The 4th International Workshop on Machine Learning in Clinical Neuroimaging (MLCN2021)

Biomechanical modeling of tissue deformation can be used to simulate different scenarios of longitudinal brain evolution. In this work,we present a deep learning framework for hyper-elastic strain modelling of brain atrophy, during healthy ageing and in Alzheimer's Disease. The framework directly models the effects of age, disease status, and scan interval to regress regional patterns of atrophy, from which a strain-based model estimates deformations. This model is trained and validated using 3D structural magnetic resonance imaging data from the ADNI cohort. Results show that the framework can estimate realistic deformations, following the known course of Alzheimer's disease, that clearly differentiate between healthy and demented patterns of ageing. This suggests the framework has potential to be incorporated into explainable models of disease, for the exploration of interventions and counterfactual examples., Comment: MLCN 2021

We consider a problem relating to magnetic confinement devices known as stellarators. Plasma is confined by magnetic fields generated by current-carrying coils, and here we investigate how closely to the plasma they need to be positioned. Current-carrying coils are represented as singularities within the magnetic field and therefore this problem can be modelled mathematically as finding how far we can harmonically extend a vector field from the boundary of a domain. For this paper we consider two-dimensional domains with real analytic boundary, and prove that a harmonic extension exists if and only if the boundary data satisfies a combined compatibility and regularity condition. Our method of proof uses a generalisation of a result of Hadamard on the Cauchy problem for the Laplacian. We then provide a lower bound on how far we can harmonically extend the vector field from the boundary via the Cauchy--Kovalevskaya Theorem., Comment: 30 pages, 4 figures

We identify explicitly the fractional power spaces for the $L^2$ Dirichlet Laplacian and Dirichlet Stokes operators using the theory of real interpolation. The results are not new, but we hope that our arguments are relatively accessible., Comment: 10 pages. Most of this previously appeared as part of arXiv:1904.03337v1, which was subsequently split for publication

Fetal ultrasound screening during pregnancy plays a vital role in the early detection of fetal malformations which have potential long-term health impacts. The level of skill required to diagnose such malformations from live ultrasound during examination is high and resources for screening are often limited. We present an interpretable, atlas-learning segmentation method for automatic diagnosis of Hypo-plastic Left Heart Syndrome (HLHS) from a single `4 Chamber Heart' view image. We propose to extend the recently introduced Image-and-Spatial Transformer Networks (Atlas-ISTN) into a framework that enables sensitising atlas generation to disease. In this framework we can jointly learn image segmentation, registration, atlas construction and disease prediction while providing a maximum level of clinical interpretability compared to direct image classification methods. As a result our segmentation allows diagnoses competitive with expert-derived manual diagnosis and yields an AUC-ROC of 0.978 (1043 cases for training, 260 for validation and 325 for testing)., Comment: MICCAI'21 Main Conference

Lorentzian 4-metrics are expressed in spinorial coordinates. In these coordinates the metric components can be factorized into a product of complex conjugate quantities. The linearized theory and Einstein's vacuum field equations are studied using these coordinates. The relationship between Lorentzian and complex 4-metrics is discussed., Comment: Equations added. Final section re-written

An important goal of medical imaging is to be able to precisely detect patterns of disease specific to individual scans; however, this is challenged in brain imaging by the degree of heterogeneity of shape and appearance. Traditional methods, based on image registration to a global template, historically fail to detect variable features of disease, as they utilise population-based analyses, suited primarily to studying group-average effects. In this paper we therefore take advantage of recent developments in generative deep learning to develop a method for simultaneous classification, or regression, and feature attribution (FA). Specifically, we explore the use of a VAE-GAN translation network called ICAM, to explicitly disentangle class relevant features from background confounds for improved interpretability and regression of neurological phenotypes. We validate our method on the tasks of Mini-Mental State Examination (MMSE) cognitive test score prediction for the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort, as well as brain age prediction, for both neurodevelopment and neurodegeneration, using the developing Human Connectome Project (dHCP) and UK Biobank datasets. We show that the generated FA maps can be used to explain outlier predictions and demonstrate that the inclusion of a regression module improves the disentanglement of the latent space. Our code is freely available on Github https://github.com/CherBass/ICAM.

The cerebral cortex performs higher-order brain functions and is thus implicated in a range of cognitive disorders. Current analysis of cortical variation is typically performed by fitting surface mesh models to inner and outer cortical boundaries and investigating metrics such as surface area and cortical curvature or thickness. These, however, take a long time to run, and are sensitive to motion and image and surface resolution, which can prohibit their use in clinical settings. In this paper, we instead propose a machine learning solution, training a novel architecture to predict cortical thickness and curvature metrics from T2 MRI images, while additionally returning metrics of prediction uncertainty. Our proposed model is tested on a clinical cohort (Down Syndrome) for which surface-based modelling often fails. Results suggest that deep convolutional neural networks are a viable option to predict cortical metrics across a range of brain development stages and pathologies., Comment: Best Paper Honourable Mentions @ MLCN 2020 (MICCAI 2020)

This paper considers solutions $u_\alpha$ of the three-dimensional Navier--Stokes equations on the periodic domains $Q_\alpha:=(-\alpha,\alpha)^3$ as the domain size $\alpha\to\infty$, and compares them to solutions of the same equations on the whole space. For compactly-supported initial data $u_\alpha^0\in H^1(Q_\alpha)$, an appropriate extension of $u_\alpha$ converges to a solution $u$ of the equations on ${\mathbb R}^3$, strongly in $L^r(0,T;H^1({\mathbb R}^3))$, $r\in[1,\infty)$. The same also holds when $u_\alpha^0$ is the velocity corresponding to a fixed, compactly-supported vorticity. A consequence is that if an initial compactly-supported velocity $u_0\in H^1({\mathbb R}^3)$ or an initial compactly-supported vorticity $\omega_0\in H^1({\mathbb R}^3)$ gives rise to a smooth solution on $[0,T^*]$ for the equations posed on ${\mathbb R}^3$, a smooth solution will also exist on $[0,T^*]$ for the same initial data for the periodic problem posed on ${Q_\alpha}$ for $\alpha$ sufficiently large; this illustrates a `transfer of regularity' from the whole space to the periodic case.

Feature attribution (FA), or the assignment of class-relevance to different locations in an image, is important for many classification problems but is particularly crucial within the neuroscience domain, where accurate mechanistic models of behaviours, or disease, require knowledge of all features discriminative of a trait. At the same time, predicting class relevance from brain images is challenging as phenotypes are typically heterogeneous, and changes occur against a background of significant natural variation. Here, we present a novel framework for creating class specific FA maps through image-to-image translation. We propose the use of a VAE-GAN to explicitly disentangle class relevance from background features for improved interpretability properties, which results in meaningful FA maps. We validate our method on 2D and 3D brain image datasets of dementia (ADNI dataset), ageing (UK Biobank), and (simulated) lesion detection. We show that FA maps generated by our method outperform baseline FA methods when validated against ground truth. More significantly, our approach is the first to use latent space sampling to support exploration of phenotype variation. Our code will be available online at https://github.com/CherBass/ICAM., Comment: Submitted to NeurIPS 2020: Neural Information Processing Systems. Keywords: interpretable, classification, feature attribution, domain translation, variational autoencoder, generative adversarial network, neuroimaging

Fully automatic deep learning has become the state-of-the-art technique for many tasks including image acquisition, analysis and interpretation, and for the extraction of clinically useful information for computer-aided detection, diagnosis, treatment planning, intervention and therapy. However, the unique challenges posed by medical image analysis suggest that retaining a human end user in any deep learning enabled system will be beneficial. In this review we investigate the role that humans might play in the development and deployment of deep learning enabled diagnostic applications and focus on techniques that will retain a significant input from a human end user. Human-in-the-Loop computing is an area that we see as increasingly important in future research due to the safety-critical nature of working in the medical domain. We evaluate four key areas that we consider vital for deep learning in the clinical practice: (1) Active Learning to choose the best data to annotate for optimal model performance; (2) Interaction with model outputs - using iterative feedback to steer models to optima for a given prediction and offering meaningful ways to interpret and respond to predictions; (3) Practical considerations - developing full scale applications and the key considerations that need to be made before deployment; (4) Future Prospective and Unanswered Questions - knowledge gaps and related research fields that will benefit human-in-the-loop computing as they evolve. We offer our opinions on the most promising directions of research and how various aspects of each area might be unified towards common goals., Comment: Medical Image Analysis Volume 71 2021 https://doi.org/10.1016/j.media.2021.102062

If $X$ is a set with finite Assouad dimension, it is known that the Assouad dimension of $X-X$ does not necessarily obey any non-trivial bound in terms of the Assouad dimension of $X$. In this paper, we consider self-similar sets on the real line and we show that if a particular weak separation condition is satisfied, then the Assouad dimension of the set of differences is bounded above by twice the Assouad dimension of the set itself. We then apply this result to a particular class of asymmetric Cantor sets., Comment: 30 pages

We recall a variation of a construction due to Laakso \cite{LA}, also used by Lang and Plaut \cite{LA} of a doubling metric space $X$ that cannot be embedded into any Hilbert space. We give a more concrete version of this construction and motivated by the results of Olson \& Robinson \cite{OR}, we consider the Kuratowski embedding $\Phi(X)$ of $X$ into $L^{\infty}(X)$ and prove that $\Phi(X)-\Phi(X)$ is not doubling.

Machine learning methods may have the potential to significantly accelerate drug discovery. However, the increasing rate of new methodological approaches being published in the literature raises the fundamental question of how models should be benchmarked and validated. We reanalyze the data generated by a recently published large-scale comparison of machine learning models for bioactivity prediction and arrive at a somewhat different conclusion. We show that the performance of support vector machines is competitive with that of deep learning methods. Additionally, using a series of numerical experiments, we question the relevance of area under the receiver operating characteristic curve as a metric in virtual screening, and instead suggest that area under the precision-recall curve should be used in conjunction with the receiver operating characteristic. Our numerical experiments also highlight challenges in estimating the uncertainty in model performance via scaffold-split nested cross validation., Comment: Code available on GitHub: https://github.com/mc-robinson/validating_validation_supp_info

We approximate functions defined on smooth bounded domains by elements of the eigenspaces of the Laplacian or the Stokes operator in such a way that the approximations are bounded and converge in both Sobolev and Lebesgue spaces. We prove an abstract result referred to fractional power spaces of positive, self-adjoint, compact-inverse operators on Hilbert spaces, and then obtain our main result by using the explicit form of these fractional power spaces for the Dirichlet Laplacian and Stokes operators. As a simple application, we prove that all weak solutions of the incompressible convective Brinkman--Forchheimer equations posed on a bounded domain in ${\mathbb R}^3$ satisfy the energy equality., Comment: 17 pages

We prove a robustness of regularity result for the $3$D convective Brinkman-Forchheimer equations $$ \partial_tu -\mu\Delta u + (u \cdot \nabla)u + \nabla p + \alpha u + \beta\abs{u}^{r - 1}u = f, $$ for the range of the absorption exponent $r \in [1, 3]$ (for $r > 3$ there exist global-in-time regular solutions), i.e. we show that strong solutions of these equations remain strong under small enough changes of the initial condition and forcing function. We provide a smallness condition which is similar to the robustness conditions given for the $3$D incompressible Navier-Stokes equations by Chernyshenko et al. (2007) and Dashti & Robinson (2008)., Comment: 22 pages

This essay concerns the study of gravitation and general relativity at King's College London (KCL). It covers developments since the nineteenth century but its main focus is on the quarter of a century beginning in 1955. At King's research in the twenty-five years from 1955 was dominated initially by the study of gravitational waves and then by the investigation of the classical and quantum aspects of black holes. While general relativity has been studied extensively by both physicists and mathematicians, most of the work at King's described here was undertaken in the mathematics department., Comment: Journal version

In this paper we study the regularity of embeddings of finite--dimensional subsets of Banach spaces into Euclidean spaces. In 1999, Hunt and Kaloshin [Nonlinearity 12 1263-1275] introduced the thickness exponent and proved an embedding theorem for subsets of Hilbert spaces with finite box--counting dimension. In 2009, Robinson [Nonlinearity 22 711-728] defined the dual thickness and extended the result to subsets of Banach spaces. Here we prove a similar result for subsets of Banach spaces, using the thickness rather than the dual thickness. We also study the relation between the box-counting dimension and these two thickness exponents for some particular subsets of $\ell_{p}$., Comment: Submitted, Referres comments addressed

We analyse the behaviour of solutions of the linear heat equation in ${\mathbb R}^d$ for initial data in the classes $M_\varepsilon({\mathbb R}^d)$ of Radon measures with $\int_{{\mathbb R}^d}{\rm e}^{-\varepsilon|x|^2}\,{\rm d}|u_0|<\infty$. We show that these classes are in some sense optimal for local and global existence of non-negative solutions: in particular $M_0({\mathbb R}^d)=\cap_{\varepsilon>0}M_\varepsilon({\mathbb R}^d)$ consists precisely of those initial data for which the a solution of the heat equation can be given for all time using the heat kernel representation formula. After considering properties of existence, uniqueness, and regularity for such initial data, which can grow rapidly at infinity, we go on to show that they give rise to properties associated more often with nonlinear models. We demonstrate the finite-time blowup of solutions, showing that the set of blowup points is the complement of a convex set, and that given any closed convex set there is an initial condition whose solutions remain bounded precisely on this set at the `blowup time'. We also show that wild oscillations are possible from non-negative initial data as $t\to\infty$ (in fact we show that this behaviour is generic), and that one can prescribe the behaviour of $u(0,t)$ to be any real-analytic function $\gamma(t)$ on $[0,\infty)$.

We study weak solutions of the incompressible Euler equations on $\mathbb{T}^2\times \mathbb{R}_+$; we use test functions that are divergence free and have zero normal component, thereby obtaining a definition that does not involve the pressure. We prove energy conservation under the assumptions that $u\in L^3(0,T;L^3(\mathbb{T}^2\times \mathbb{R}_+))$, $$ \lim_{|y|\to 0}\frac{1}{|y|}\int^T_0\int_{\mathbb{T}^2}\int^\infty_{x_3>|y|} |u(x+y)-u(x)|^3\mathrm{d} x\, \mathrm{d} t=0, $$ and an additional continuity condition near the boundary: for some $\delta>0$ we require $u\in L^3(0,T;C^0(\mathbb{T}^2\times [0,\delta])))$. We note that all our conditions are satisfied whenever $u(x,t)\in C^\alpha$, for some $\alpha>1/3$, with H\"older constant $C(x,t)\in L^3(\mathbb{T}^2\times\mathbb{R}^+\times(0,T))$., Comment: 21 pages

We prove two partial regularity results for the scalar equation $u_t+u_{xxxx}+\partial_{xx}u_x^2=0$, a model of surface growth arising from the physical process of molecular epitaxy. We show that the set of space-time singularities has (upper) box-counting dimension no larger than $7/6$ and $1$-dimensional (parabolic) Hausdorff measure zero. These parallel the results available for the three-dimensional Navier--Stokes equations. In fact the mathematical theory of the surface growth model is known to share a number of striking similarities with the Navier--Stokes equations, and the partial regularity results are the next step towards understanding this remarkable similarity. As far as we know the surface growth model is the only lower-dimensional "mini-model" of the Navier--Stokes equations for which such an analogue of the partial regularity theory has been proved. In the course of our proof, which is inspired by the rescaling analysis of Lin (1998) and Ladyzhenskaya & Seregin (1999), we develop certain nonlinear parabolic Poincar\'e inequality, which is a concept of independent interest. We believe that similar inequalities could be applicable in other parabolic equations., Comment: 29 pages

In their 1968 paper Fujita and Watanabe considered the issue of uniqueness of the trivial solution of semilinear parabolic equations with respect to the class of bounded, non-negative solutions. In particular they showed that if the underlying ODE has non-unique solutions (as characterised via an Osgood-type condition) {\em and} the nonlinearity $f$ satisfies a concavity condition, then the parabolic PDE also inherits the non-uniqueness property. This concavity assumption has remained in place either implicitly or explicitly in all subsequent work in the literature relating to this and other, similar, non-uniqueness phenomena in parabolic equations. In this paper we provide an elementary proof of non-uniqueness for the PDE without any such concavity assumption on $f$. An important consequence of our result is that uniqueness of the trivial solution of the PDE is equivalent to uniqueness of the trivial solution of the corresponding ODE, which in turn is known to be equivalent to an Osgood-type integral condition on $f$.

In this paper we give a simple proof of the existence of global-in-time smooth solutions for the convective Brinkman-Forchheimer equations (also called in the literature the tamed Navier-Stokes equations) $$ \partial_tu -\mu\Delta u + (u \cdot \nabla)u + \nabla p + \alpha u + \beta|u|^{r - 1}u = 0 $$ on a $3$D periodic domain, for values of the absorption exponent $r$ larger than $3$. Furthermore, we prove that global, regular solutions exist also for the critical value of exponent $r = 3$, provided that the coefficients satisfy the relation $4\mu\beta \geq 1$. Additionally, we show that in the critical case every weak solution verifies the energy equality and hence is continuous into the phase space $L^2$. As an application of this result we prove the existence of a strong global attractor, using the theory of evolutionary systems developed by Cheskidov., Comment: 17 pages

The aim of this paper is to prove energy conservation for the incompressible Euler equations in a domain with boundary. We work in the domain $\mathbb{T}^2\times\mathbb{R}_+$, where the boundary is both flat and has finite measure. However, first we study the equations on domains without boundary (the whole space $\mathbb{R}^3$, the torus $\mathbb{T}^3$, and the hybrid space $\mathbb{T}^2\times\mathbb{R}$). We make use of some of the arguments of Duchon \& Robert ({\it Nonlinearity} {\bf 13} (2000) 249--255) to prove energy conservation under the assumption that $u\in L^3(0,T;L^3(\mathbb{R}^3))$ and one of the two integral conditions \begin{equation*} \lim_{|y|\to 0}\frac{1}{|y|}\int^T_0\int_{\mathbb{R}^3} |u(x+y)-u(x)|^3\,d x\,d t=0 \end{equation*} or \begin{equation*} \int_0^T\int_{\mathbb{R}^3}\int_{\mathbb{R}^3}\frac{|u(x)-u(y)|^3}{|x-y|^{4+\delta}}\,d x\,d y<\infty,\qquad\delta>0, \end{equation*} the second of which is equivalent to requiring $u\in L^3(0,T;W^{\alpha,3}(\mathbb{R}^3))$ for some $\alpha>1/3$. We then use the first of these two conditions to prove energy conservation for a weak solution $u$ on $D_+:=\mathbb{T}^2\times \mathbb{R}_+$: we extend $u$ a solution defined on the whole of $\mathbb{T}^2\times\mathbb{R}$ and then use the condition on this domain to prove energy conservation for a weak solution $u\in L^3(0,T;L^3(D_+))$ that satisfies \begin{equation*} \lim_{|y|\to 0} \frac{1}{|y|}\int^{T}_{0}\iint_{\mathbb{T}^2}\int^\infty_{|y|}|u(t,x+y)-u(t,x)|^3 \,d x_3 \,d x_1 \,d x_2 \,d t=0, \end{equation*} and certain continuity conditions near the boundary $\partial D_+=\{x_3=0\}$.

This paper establishes the local-in-time existence and uniqueness of solutions to the viscous, non-resistive magnetohydrodynamics (MHD) equations in $\mathbb{R}^d$, $d=2,3$, with initial data $B_0\in H^s(\mathbb{R}^d)$ and $u_0\in H^{s-1+\varepsilon}(\mathbb{R}^d)$ for $s>d/2$ and any $0<\varepsilon<1$. The proof relies on maximal regularity estimates for the Stokes equation. The obstruction to taking $\varepsilon=0$ is explained by the failure of solutions of the heat equation with initial data $u_0\in H^{s-1}$ to satisfy $u\in L^1(0,T;H^{s+1})$; we provide an explicit example of this phenomenon.

We study the continuity of pullback and uniform attractors for non-autonomous dynamical systems with respect to perturbations of a parameter. Consider a family of dynamical systems parameterised by a complete metric space $\Lambda$ such that for each $\lambda\in\Lambda$ there exists a unique pullback attractor $\mathcal A_\lambda(t)$. Using the theory of Baire category we show under natural conditions that there exists a residual set $\Lambda_*\subseteq\Lambda$ such that for every $t\in\mathbb R$ the function $\lambda\mapsto\mathcal A_\lambda(t)$ is continuous at each $\lambda\in\Lambda_*$ with respect to the Hausdorff metric. Similarly, given a family of uniform attractors $\mathbb A_\lambda$, there is a residual set at which the map $\lambda\mapsto\mathbb A_\lambda$ is continuous. We also introduce notions of equi-attraction suitable for pullback and uniform attractors and then show when $\Lambda$ is compact that the continuity of pullback attractors and uniform attractors with respect to $\lambda$ is equivalent to pullback equi-attraction and, respectively, uniform equi-attraction. These abstract results are then illustrated in the context of the Lorenz equations and the two-dimensional Navier-Stokes equations.

In this note we discuss the diffusive, vector-valued Burgers equations in a three-dimensional domain with periodic boundary conditions. We prove that given initial data in $H^{1/2}$ these equations admit a unique global solution that becomes classical immediately after the initial time. To prove local existence, we follow as closely as possible an argument giving local existence for the Navier--Stokes equations. The existence of global classical solutions is then a consequence of the maximum principle for the Burgers equations due to Kiselev and Ladyzhenskaya (1957). In several places we encounter difficulties that are not present in the corresponding analysis of the Navier--Stokes equations. These are essentially due to the absence of any of the cancellations afforded by incompressibility, and the lack of conservation of mass. Indeed, standard means of obtaining estimates in $L^2$ fail and we are forced to start with more regular data. Furthermore, we must control the total momentum and carefully check how it impacts on various standard estimates., Comment: 15 pages, to appear in "Recent Progress in the Theory of the Euler and Navier--Stokes Equations", eds. J.C. Robinson, J.L. Rodrigo, W. Sadowski and A. Vidal-L\'opez, Cambridge University Press, 2016

Generalized differential forms are employed to construct generalized connections. Lorentzian four-metrics determined by certain of these connections satisfy Einstein's vacuum field equations when the connections are flat. Generalized Chern-Simons action principles with Einstein's equations as Euler-Lagrange equations are constructed by using these connections., Comment: 14 pages

If $u$ is a smooth solution of the Navier--Stokes equations on ${\mathbb R}^3$ with first blowup time $T$, we prove lower bounds for $u$ in the Sobolev spaces $\dot H^{3/2}$, $\dot H^{5/2}$, and the Besov space $\dot B^{5/2}_{2,1}$, with optimal rates of blowup: we prove the strong lower bounds $\|u(t)\|_{\dot H^{3/2}}\ge c(T-t)^{-1/2}$ and $\|u(t)\|_{\dot B^{5/2}_{2,1}}\ge c(T-t)^{-1}$, but in $\dot H^{5/2}$ we only obtain the weaker result $\limsup_{t\to T^-}(T-t)\|u(t)\|_{\dot H^{5/2}}\ge c$. The proofs involve new inequalities for the nonlinear term in Sobolev and Besov spaces, both of which are obtained using a dyadic decomposition of $u$.

In this paper we prove the existence of solutions to the viscous, non-resistive magnetohydrodynamics (MHD) equations on the whole of $\mathbb{R}^{n}$, $n=2,3$, for divergence-free initial data in certain Besov spaces, namely $\boldsymbol{u}_{0} \in B^{n/2-1}_{2,1}$ and $\boldsymbol{B}_{0} \in B^{n/2}_{2,1}$. The a priori estimates include the term $\int_{0}^{t} \| \boldsymbol{u}(s) \|_{H^{n/2}}^{2} \, \mathrm{d} s$ on the right-hand side, which thus requires an auxiliary bound in $H^{n/2-1}$. In 2D, this is simply achieved using the standard energy inequality; but in 3D an auxiliary estimate in $H^{1/2}$ is required, which we prove using the splitting method of Calder\'on (Trans. Amer. Math. Soc. 318(1), 179--200, 1990). By contrast, we prove that such solutions are unique in 3D, but the proof of uniqueness in 2D is more difficult and remains open.

We show that self-similar sets arising from iterated function systems that satisfy the Moran open-set condition, a canonical class of fractal sets, are `equi-homogeneous'. This is a regularity property that, roughly speaking, means that at each fixed length-scale any two neighbourhoods of the set have covers of approximately equal cardinality. Self-similar sets are notable in that they are Ahlfors-David regular, which implies that their Assouad and box-counting dimensions coincide. More generally, attractors of non-autonomous iterated functions systems (where maps are allowed to vary between iterations) can have distinct Assouad and box-counting dimensions. Consequently the familiar notion of Ahlfors-David regularity is too strong to be useful in the analysis of this important class of sets, which include generalised Cantor sets and possess different dimensional behaviour at different length-scales. We further develop the theory of equi-homogeneity showing that it is a weaker property than Ahlfors-David regularity and distinct from any previously defined notion of dimensional equivalence. However, we show that if the upper and lower box-counting dimensions of an equi-homogeneous set are equal and `attained' in a sense we make precise then the lower Assouad, Hausdorff, packing, lower box-counting, upper box-counting and Assouad dimensions coincide. Our main results provide conditions under which the attractor of a non-autonomous iterated function system is equi-homogeneous and we use this to compute the Assouad dimension of a certain class of these highly non-trivial sets.

In this paper we treat three problems on a two-dimensional `punctured periodic domain': we take $\Omega_r=(-L,L)^2\setminus D_r$, where $D_r=B(0,r)$ is the disc of radius $r$ centred at the origin. We impose periodic boundary conditions on the boundary of the box $\Omega=(-L,L)^2$, and Dirichlet boundary conditions on the circumference of the disc. In this setting we consider the Poisson equation, the Stokes equations, and the time-dependent Navier-Stokes equations, all with a fixed forcing function $f$ (which must satisfy $\int_\Omega f=0$ for the stationary problems), and examine the behaviour of solutions as $r\to0$. In all three cases we show convergence of the solutions to those of the limiting problem, i.e.\ the problem posed on all of $\Omega$ with periodic boundary conditions.

A Besicovitch set is a subset of $\R^d$ that contains a unit line segment in every direction and the famous Kakeya conjecture states that Besicovitch sets should have full dimension. We provide a number of results in support of this conjecture in a variety of contexts. Our proofs are simple and aim to give an intuitive feel for the problem. For example, we give a very simple proof that the packing and lower box-counting dimension of any Besicovitch set is at least $(d+1)/2$ (better estimates are available in the literature). We also study the `generic validity' of the Kakeya conjecture in the setting of Baire Category and prove that typical Besicovitch sets have full upper box-counting dimension. We also study a weaker version of the Kakeya problem where unit line segments are replaced by half-infinite lines. We prove that such `half-extended Besicovitch sets' have full Assouad dimension. This can be viewed as full resolution of a (much weakened) version of the Kakeya problem., Comment: 17 pages. Incorporated referee suggestions, improved results in section 4, to appear in Real Analysis Exchange

Let $\Lambda$ be a complete metric space, and let $\{S_\lambda(\cdot):\ \lambda\in\Lambda\}$ be a parametrised family of semigroups with global attractors ${\mathscr A}_\lambda$. We assume that there exists a fixed bounded set $D$ such that ${\mathscr A}_\lambda\subset D$ for every $\lambda\in\Lambda$. By viewing the attractors as the limit as $t\to\infty$ of the sets $S_\lambda(t)D$, we give simple proofs of the equivalence of `equi-attraction' to continuity (when this convergence is uniform in $\lambda$) and show that the attractors ${\mathscr A}_\lambda$ are continuous in $\lambda$ at a residual set of parameters in the sense of Baire Category (when the convergence is only pointwise).