SCI Publications
2026
H. Csala, A. Arzani .
Decomposed sparse modal optimization: Interpretable reduced-order modeling of unsteady flows, In International Journal of Heat and Fluid Flow, Vol. 117, Elsevier, pp. 110124. 2026.
ISSN: 0142-727X
DOI: https://doi.org/10.1016/j.ijheatfluidflow.2025.110124
Modal analysis plays a crucial role in fluid dynamics, offering a powerful tool for reducing the complexity of high-dimensional fluid flow data while extracting meaningful insights into flow physics. This is particularly important in the study of cardiovascular flows, where modal techniques help characterize unsteady flow structures, improve reduced-order modeling, and inform disease diagnosis and rapid medical device design. The most commonly used method, proper orthogonal decomposition (POD), is highly interpretable but suffers from its linearity, which limits its ability to capture nonlinear interactions. In this work, we introduce decomposed sparse modal optimization (DESMO), a nonlinear, adaptive extension of POD that improves the accuracy of flow field reconstruction while requiring fewer modes. We use modern gradient descent-based optimization tools to optimize the spatial modes and temporal coefficients concurrently while using a sparsity-promoting loss term. We demonstrate these on a canonical fluid flow benchmark, flow over a cylinder, a real-world example, blood flow inside a brain aneurysm, and a turbulent channel flow. DESMO can identify spatial modes that resemble higher-order POD modes while uncovering entirely new spatial structures in some cases. Different versions of DESMO can leverage Fourier series for modeling temporal coefficients, an autoencoder for spatial mode optimization, and symbolic regression for discovering differential equations for temporal evolution. Our results demonstrate that DESMO not only provides a more accurate representation of fluid flows but also preserves the interpretability of classical POD by having an analytical modal decomposition equation, offering a promising approach for reduced-order modeling across engineering applications.
Z. Cutler, J. Wilburn, H. Shrestha, Y. Ding, B. Bollen, K. Abrar Nadib, T. He, A. McNutt, L. Harrison, A. Lex.
ReVISit 2: A Full Experiment Life Cycle User Study Framework, In IEEE Transactions on Visualization and Computer Graphics, Vol. 32, IEEE, 2026.
Online user studies of visualizations, visual encodings, and interaction techniques are ubiquitous in visualization research. Yet, designing, conducting, and analyzing studies effectively is still a major burden.Although various packages support such user studies, most solutions address only facets of the experiment life cycle, make reproducibility difficult, or do not cater to nuanced study designs or interactions. We introduce reVISit 2, a software framework that supports visualization researchers at all stages of designing and conducting browser-based user studies. ReVISit supports researchers in the design, debug & pilot, data collection, analysis, and dissemination experiment phases by providing both technical affordances (such as replay of participant interactions) and sociotechnical aids (such as a mindfully maintained community of support). It is a proven system that can be (and has been) used in publication-quality studies---which we demonstrate through a series of experimental replications. We reflect on the design of the system via interviews and an analysis of its technical dimensions. Through this work, we seek to elevate the ease with which studies are conducted, improve the reproducibility of studies within our community, and support the construction of advanced interactive studies.
Z. Cutler, J. Wilburn, H. Shrestha, Y. Ding, A.M. McNutt, .
Running Online User Studies with the reVISit Framework, In EUROVIS 2026, Eurographics, 2026.
There are currently two main approaches for running online user studies: experimenters can use commercial survey tools, which are easy to use but can be costly, hamper reproducibility, and have limitations for complex stimuli; or they can build custom software to run and instrument a study, which is a laborious and complex task. In this tutorial, we introduce participants to a new, open-source alternative: the reVISit study platform. Many studies quickly reach a burdensome level of complexity, necessitating design of stimuli and experimental tasks as well as the study UI, data hosting, participant recruiting, randomization, etc. ReVISit ameliorates these problems and allows study designers to focus more on the research questions and stimulus design. ReVISit removes the tedium of study design by providing built-in components that most studies will need. ReVISit provides a domain-specific language and a notebook-oriented library that enables study designers to quickly create studies and deploy them as publicly accessible websites. This tutorial will introduce reVISit to the visualization community and allow community members to get hands-on experience with it through a series of practical examples. Participants will improve on a study until they have developed and deployed a study of an interactive, fully instrumented data visualization.
Z. Cutler, L.W. Ge, M. Kay, L. Harrison, A. McNutt, A. Lex.
Read, Critique, or Sketch? Investigating Alternative Visualization Literacy Assessment Modalities, Subtitled arXiv:2608.00330, 2026.
Visualization literacy is a multifaceted construct encompassing skills and competencies, such as decoding data, constructing charts, and identifying design flaws. Yet, assessments of these competencies has been primarily constrained to multiple choice assessments that target lower-order skills, such as chart comprehension. As a result, they often exhibit ceiling effects (i.e., even modestly skilled individuals commonly score near the top of the scale), and do not provide enough information about an individual's higher-order skills (e.g., applying external knowledge, formulating critiques, and designing visualizations). To close these gaps, we develop and investigate two web-based qualitative assessments for testing the critique and design aspects of visualization literacy through online think-aloud critique and sketching of visualization designs based on data and a prompt. We compare performance on our assessments to two established visualization literacy assessments, CALVI and Mini-VLAT, by administering them to three groups that represent three experience levels: crowdworkers, students who have taken a relevant course, and researchers. We find that our critique and sketching assessments capture skills distinct from existing measures and that they differentiate between experienced individuals better than multiple choice-based alternatives. Although administering and grading qualitative assessments can be challenging, our findings suggest qualitative, multimodal assessments are a promising complement to existing visualization literacy assessments, in particular when high visualization skills need to be distinguished.
D. Dade, J.A. Bergquist, R.S. MacLeod, B.A. Steinberg, T. Tasdizen.
Self-Supervised Contrastive Learning Enables Robust ECG-Based Cardiac Classification, In Heart Rhythm O2, Elsevier, 2026.
Background
Objective
Methods
Results
Conclusions
D. De Novi, L. Carnevale, R. Marino, D. Balouek, M. Parashar, M. Villari.
Transfer learning for IT operations: A comparison of statistical and neural time-series models for CPU utilization forecasting, In Telematics and Informatics Reports, Vol. 23, Elsevier, 2026.
AI-driven IT operations (AIOps) require forecasting models that combine predictive accuracy with low computational overhead across heterogeneous cloud infrastructures. However, existing studies rarely compare statistical, recurrent, and Transformer-based forecasting models under transfer learning (TL) and deployment-oriented constraints. This paper presents a comparative evaluation of statistical and neural time-series forecasting models for CPU utilization prediction in virtual machine and containerized environments. We analyze ARIMA, RNN, LSTM, Bidirectional LSTM, Informer, Temporal Fusion Transformer (TFT), and a VM-Temporal Transformer using TL between the Microsoft Azure Trace and Alibaba Cloud Trace datasets. Models are pre-trained on Azure virtual machine workloads and fine-tuned on Alibaba container traces to assess portability across heterogeneous infrastructures. Results show that attention-based architectures achieve competitive forecasting accuracy, with Informer reaching a minimum MAE of 0.0267. However, these gains require higher inference latency and larger memory footprints. Conversely, LSTM-based architectures offer the best trade-off between accuracy, inference speed, and storage efficiency, achieving sub-millisecond inference latency (0.2361 ms) and a compact 201 KB model size while maintaining robust performance across multiple forecasting horizons. The study demonstrates that TL enables effective knowledge transfer between VM and container-based environments, improving the portability of workload forecasting models for cloud and edge infrastructures. Beyond accuracy, the paper provides a deployment-oriented analysis of latency, storage footprint, and adaptability, offering practical guidelines for selecting forecasting architectures in resource-constrained AIOps scenarios supporting resilient and sustainable digital infrastructures.
T. Duan, Z. Wang, L. Shen, S. Niu, G. Doretto, D.A. Adjeroh, C. Tao.
Data Distribution Evolution for Robust EEG Emotion Recognition with Limited Data Resource, In IEEE Transactions on Affective Computing, IEEE, pp. 1--14. 2026.
DOI: 10.1109/TAFFC.2026.3684827
Proper decoding of human emotions based on physiological electroencephalography (EEG) signals significantly contributes to the development of human-computer interface related applications. Current major challenges hindering the recognition performance include the following: 1) the high variance and unknown noise that exist in the EEG recordings; 2) the size of EEG datasets are relatively small given the acquisition effort and annotation cost. It is worthwhile to explore approaches to improve decoding robustness under low data resource scenarios. Previous works utilized data augmentation techniques to tackle this problem using manually designed augmentation operations, leading to sub-optimal performance. In this study, we propose a principled framework to perform dynamic evolution on signal data and improve robustness in the occurrence of unknown corruptions or variances. The framework is formed with bi-level distributionally robust optimization (DRO), and improves robustness by simultaneously optimizing on a family of evolved distributions instead of the single training data distribution. We transform the formed gradient flow system into different types of concrete evolution instantiations based on Langevin dynamics and Hamiltonian dynamics, with tailored divergence measures serving as distance constraint. We performed extensive evaluation of the proposed approach on datasets covering different types of affective states, with model robustness tested on different types of corruptions and adversarial examples. The model outperforms competitive baselines by a significant margin on these challenging emotion recognition benchmarks, especially for low data resource scenarios.
Z.J. Eatough, R.J. Lisonbee, A.C. Peterson, S.Y. Elhabian, M. K. Mills, N. Krähenbühl, A. L. Lenz.
Morphologic assessment of peritalar compensation in patients with advanced varus ankle osteoarthritis, In Skeletal Radiology, Springer Nature, 2026.
Objective Varus ankle malalignment is observed in most ankle osteoarthritis patients with approximately half of these patients presenting with peritalar compensation, where the subtalar joint is aligned valgus to compensate for a varus tibiotalar joint. This study developed a 3D weight-bearing computed tomography–based multi-bone statistical shape model to quantify morphologic and alignment differences between compensated and non-compensated presentations of advanced varus ankle osteoarthritis. Materials and methods Our assessment included 70 individuals, 44 diagnosed with advanced varus ankle osteoarthritis, and 26 asymptomatic controls. Each participant underwent weight-bearing computed tomography. Semi-automatic segmentations produced patient-specific 3D bone reconstructions of the distal tibia, distal fibula, talus, calcaneus, navicular, and cuboid. A multi-bone statistical shape model was created using each of the 3D bone reconstructions. Joint space distance, coverage area, and congruence index were measured at equivalent anatomic locations within articular coverage obtained from the statistical shape model. Results Eleven principal component analysis modes retained 85.8% variance. Significant differences existed in mode 1 (medial malleolus and talar dome morphology, fibular positioning; 26.6% variance, p
M. Elhadidy, R.M. D'Souza, A. Arzani.
SLE-FNO: Single-Layer Extensions for Task-Agnostic Continual Learning in Fourier Neural Operators, Subtitled arXiv:2603.20410, 2026.
Scientific machine learning is increasingly used to build surrogate models, yet most models are trained under a restrictive assumption in which future data follow the same distribution as the training set. In practice, new experimental conditions or simulation regimes may differ significantly, requiring extrapolation and model updates without re-access to prior data. This creates a need for continual learning (CL) frameworks that can adapt to distribution shifts while preventing catastrophic forgetting. Such challenges are pronounced in fluid dynamics, where changes in geometry, boundary conditions, or flow regimes induce non-trivial changes to the solution. Here, we introduce a new architecture-based approach (SLE-FNO) combining a Single-Layer Extension (SLE) with the Fourier Neural Operator (FNO) to support efficient CL. SLE-FNO was compared with a range of established CL methods, including Elastic Weight Consolidation (EWC), Learning without Forgetting (LwF), replay-based approaches, Orthogonal Gradient Descent (OGD), Gradient Episodic Memory (GEM), PiggyBack, and Low-Rank Approximation (LoRA), within an image-to-image regression setting. The models were trained to map transient concentration fields to time-averaged wall shear stress (TAWSS) in pulsatile aneurysmal blood flow. Tasks were derived from 230 computational fluid dynamics simulations grouped into four sequential and out-of-distribution configurations. Results show that replay-based methods and architecture-based approaches (PiggyBack, LoRA, and SLE-FNO) achieve the best retention, with SLE-FNO providing the strongest overall balance between plasticity and stability, achieving accuracy with zero forgetting and minimal additional parameters. Our findings highlight key differences between CL algorithms and introduce SLE-FNO as a promising strategy for adapting baseline models when extrapolation is required.
M. Elhadidy, S. Viknesh, R.M. D'Souza, A. Arzani.
Wall Shear Stress Reconstruction from Concentration: Differentiable Physics and Physics-Informed Neural Networks, Subtitled arXiv:2606.06313v1, 2026.
Wall shear stress (WSS) governs near-wall transport dynamics and is a key hemodynamic indicator in cardiovascular flows, yet remains difficult to infer accurately due to the need for precise computation of near-wall velocity gradients. Passive scalar fields, such as concentration or temperature, are advected by the same underlying velocity field and have the potential to uncover hidden flow physics metrics such as WSS. In this work, we demonstrate such reconstruction from spatially limited passive scalar observations using two fundamentally different inverse frameworks: a differentiable physics framework based on discrete adjoint, PDE-constrained optimization, which enforces the governing equations as hard constraints, and physics-informed neural networks (PINNs), which treat them as soft constraints. Benchmark problems include a 2D canonical backward-facing step (2D-BFS) and a 3D patient-specific stenotic coronary artery. For the 2D-BFS case, evaluated under three measurement scenarios (near-wall, far-field, and combined), PINN achieves high accuracy when near-wall data are available but fails when restricted to far-field measurements, whereas the differentiable physics approach recovers accurate WSS across all scenarios. In the 3D patient-specific case, the differentiable physics framework outperforms PINNs, yielding accurate WSS reconstruction. These results establish that measurement location and inverse formulation jointly determine reconstruction fidelity in scalar-based near-wall flow inference. The proposed framework opens a path toward estimation of near-wall hemodynamics from scalar transport data, with broader applicability to fluid flow problems where passive scalars can be observed.
I.J. Eliza, X. Huang, A. Panta, A. Sahistan, Z. Li, A.A. Gooch, V. Pascucci.
Animating Petascale Time-varying Data on Commodity Hardware with LLM-assisted Scripting, Subtitled arXiv:2603.07053v1, 2026.
Scientists face significant visualization challenges as time-varying datasets grow in speed and volume, often requiring specialized infrastructure and expertise to handle massive datasets. Petascale climate models generated in NASA laboratories require a dedicated group of graphics and media experts and access to high-performance computing resources. Scientists may need to share scientific results with the community iteratively and quickly. However, the time-consuming trial-and-error process incurs significant data transfer overhead and far exceeds the time and resources allocated for typical post-analysis visualization tasks, disrupting the production workflow. Our paper introduces a user-friendly framework for creating 3D animations of petascale, time-varying data on a commodity workstation. Our contributions: (i) Generalized Animation Descriptor (GAD) with a keyframe-based adaptable abstraction for animation, (ii) efficient data access from cloud-hosted repositories to reduce data management overhead, (iii) tailored rendering system, and (iv) an LLM-assisted conversational interface as a scripting module to allow domain scientists with no visualization expertise to create animations of their region of interest. We demonstrate the framework's effectiveness with two case studies: first, by generating animations in which sampling criteria are specified based on prior knowledge, and second, by generating AI-assisted animations in which sampling parameters are derived from natural-language user prompts. In all cases, we use large-scale NASA climate-oceanographic datasets that exceed 1PB in size yet achieve a fast turnaround time of 1 minute to 2 hours. Users can generate a rough draft of the animation within minutes, then seamlessly incorporate as much high-resolution data as needed for the final version.
Y. Epshteyn, A. Narayan, Y. Yu.
Structure-Preserving Discontinuous Galerkin Methods for Stochastic Shallow Water Equations, Subtitled arXiv:2606.07155v1, 2026.
Shallow water equations (SWE) are fundamental models in fluid dynamics that are essential for studying a wide range of geophysical and engineering phenomena. In many practical applications, uncertainties arising from initial conditions and bottom topography must be taken into account, motivating the development of stable and accurate numerical methods for stochastic SWE. Building on the hyperbolicity-preserving stochastic Galerkin formulation for SWE [Dai, Epshteyn, Narayan, 2021 SISC] and a stochastic extension of the entropy stable discontinuous Galerkin methods for skew-symmetric SWE [Fu, 2022 JSC], we develop a structure-preserving, entropy conservative, and entropy stable discontinuous Galerkin--stochastic Galerkin method for the stochastic shallow water system, with the well-balanced property. We demonstrate the accuracy, applicability, and robustness of the proposed structure-preserving algorithms through several numerical experiments.
S.A. Faroughi, F. Mostajeran, A. Arzani, S. Faroughi.
Symbolic--KAN: Kolmogorov-Arnold Networks with Discrete Symbolic Structure for Interpretable Learning, Subtitled arXiv:2603.23854, 2026.
Symbolic discovery of governing equations is a long-standing goal in scientific machine learning, yet a fundamental trade-off persists between interpretability and scalable learning. Classical symbolic regression methods yield explicit analytic expressions but rely on combinatorial search, whereas neural networks scale efficiently with data and dimensionality but produce opaque representations. In this work, we introduce Symbolic Kolmogorov-Arnold Networks (Symbolic-KANs), a neural architecture that bridges this gap by embedding discrete symbolic structure directly within a trainable deep network. Symbolic-KANs represent multivariate functions as compositions of learned univariate primitives applied to learned scalar projections, guided by a library of analytic primitives, hierarchical gating, and symbolic regularization that progressively sharpens continuous mixtures into one-hot selections. After gated training and discretization, each active unit selects a single primitive and projection direction, yielding compact closed-form expressions without post-hoc symbolic fitting. Symbolic-KANs further act as scalable primitive discovery mechanisms, identifying the most relevant analytic components that can subsequently inform candidate libraries for sparse equation-learning methods. We demonstrate that Symbolic-KAN reliably recovers correct primitive terms and governing structures in data-driven regression and inverse dynamical systems. Moreover, the framework extends to forward and inverse physics-informed learning of partial differential equations, producing accurate solutions directly from governing constraints while constructing compact symbolic representations whose selected primitives reflect the true analytical structure of the underlying equations. These results position Symbolic-KAN as a step toward scalable, interpretable, and mechanistically grounded learning of governing laws.
B. Frieden, R. Whitehead, M.K. Ballard, R.M. Kirby, V. Shankar.
The Frame Kernel Method for Multiscale Operator Learning, Subtitled arXiv:2608.25084, 2026.
We present a natively multiscale operator learning method for the surrogate modeling of (numerical solvers for) multiscale partial differential equations (PDEs). The primary novelty of our method lies in a novel multiscale kernel frame function approximation technique. Leveraging this new kernel frame technique, we cast the operator learning problem as one of learning frame coefficients of output functions as a function of frame coefficients of input functions. The generalization step then automatically allows for a multiscale decomposition of the output functions. Our method is applicable to both tensor-product grids and point clouds. We present interpolation proofs, error estimates, and numerical convergence rates for our frame approximation. We the demonstrate the applicability of our method for the surrogate modeling of inherently multiscale PDEs. The new multiscale frame kernel method is significantly more accurate than popular neural operators on challenging problems from the literature, while simultaneously admitting an a posteriori multiscale decomposition upon generalization.
E. Ghelichkhan, T. Tasdizen.
Beyond Standard Sampling: Metric-Guided Iterative Inference for Radiologists-Aligned Medical Counterfactual Generation, In Proceedings of Machine Learning Research, 2026.
Generative counterfactuals offer a promising avenue for explainable AI in medical imaging, yet ensuring these synthesized images are both anatomically faithful and clinically effective remains a significant challenge. This work presents a domain-specific diffusion framework for generating ”healthy” counterfactuals from chest X-rays with cardiomegaly, underpinned by a systematic metric-guided inference strategy. In contrast to methods relying on static sampling parameters, our approach iteratively explores the inference hyperparameter space to maximize our composite selection criterion, CF Score, that integrates our novel Faithfulness-Effectiveness Trade-off (F ET ) metric.
We extend the evaluation of counterfactual utility beyond simple classification shifts by conducting the simultaneous validation against radiologist annotations and eye-tracking data. Using the REFLACX dataset, we demonstrate that difference maps derived from our counterfactuals exhibit strong spatial alignment with expert visual attention and annotation. Quantified by Normalized Cross-Correlation, Hit Rate, pixel-wise ROC-AUC, and AUC-IoU, our results confirm that metric-guided counterfactuals provide dense and clinically relevant localizations of pathology that closely mirror human diagnostic reasoning.
M. Al Zadid Sultan Bin Habib, Y. Ahamed, P. Gyawali, G. Doretto, D. A. Adjeroh.
BSTABDIFF: BLOCK-SUBUNIT DIFFUSION PRIORS FOR HIGH-DIMENSIONAL TABULAR DATA GENERA, In e 2nd DeLTa Workshop, ICLR 2026, 2026.
High-Dimensional Low-Sample Size (HDLSS) tabular domains (e.g., omics) are characterized by n ≪ m, where n = number of samples, and m = number of features. Such domains often exhibit strong local correlation groups, sparse cross-group dependencies, heavy-tailed non-Gaussian marginals, heteroscedastic noise, and structured missingness, making direct density learning in Rm ill-conditioned since n ≪ m. We propose BSTabDiff, a block-subunit generative framework that partitions the m observed features into M latent blocks (M ≪ m) and generates each block via a shared low-dimensional subunit variable, concentrating global dependence learning in the compact block-latent space RM while decoding to the full feature space with copula-driven dependence, flexible per-feature marginals, and explicit missingness mechanisms. BSTabDiff supports modern deep priors on block latents, including diffusion and normalizing flows, enabling stable synthesis and controllable benchmark generation in the HDLSS regime. Empirically, BSTabDiff produces more realistic and stable high-dimensional synthetic data when compared with unstructured tabular generators on HDLSS data.
A.Z.S.B. Habib, G. Doretto, D.A. Adjeroh.
DynaTab: Dynamic Feature Ordering as Neural Rewiring for High-Dimensional Tabular Data, In Proceedings of the First Workshop on NeuroAI Multimodal Intelligence @ AAAI, 2026.
High-dimensional tabular data lacks a natural feature order, limiting the applicability of permutation-sensitive deep learning models. We propose DynaTab, a dynamic feature ordering-enabled architecture inspired by neural rewiring. We introduce a lightweight criterion that predicts when feature permutation will benefit a dataset by quantifying its intrinsic complexity. DynaTab dynamically reorders features via a neural rewiring algorithm and processes them through a compact, dynamic order-aware combination of separate learned positional embedding, importance-based gating, and masked attention layers, compatible with any sequence-sensitive backbone. Trained end-to-end with bespoke dynamic feature ordering (DFO) and dispersion losses, DynaTab achieves statistically significant gains, particularly on high-dimensional datasets, where it is benchmarked against 45 state-of-the-art baselines across 36 different real-world tabular datasets. Our results position DynaTab as a compelling new paradigm for high-dimensional tabular deep learning.
A.Z.S.B. Habib, M.Y. Ahamed, P.K. Gyawali, G. Doretto, D.A. Adjeroh.
GOTabPFN: From Feature Ordering to Compact Tokenization for Tabular Foundation Models on High-Dimensional Data, Subtitled arXiv:2606.05441v2, 2026.
We investigate how to make small tabular foundation models effective for High-Dimensional, Low-Sample Size (HDLSS) tabular prediction without retraining large backbones. We introduce Graph-guided Ordering with Local Refinement (GO-LR), show its equivalence to weighted Minimum Linear Arrangement, and interpret the practical solver as a TSP-path-style surrogate. We propose GOTabPFN,which builds on GO-LR, and a Neuro-Inspired Subunit Compression (NSC) unit to pool locally adjacent ordered features into meta-features, yielding a compact representation that makes TabPFN-style prediction practical in HDLSS regimes. Across tabular benchmarks, GOTabPFN improves stability and accuracy under tight token budgets.
A.Z.S.B. Habib, M.Y. Ahamed, P.K. Gyawali, G. Doretto, D.A. Adjeroh.
BSTabDiff: Block-Subunit Diffusion Priors for High-Dimensional Tabular Data Generation, Subtitled arXiv:2606.09257v1, 2026.
High-Dimensional Low-Sample Size (HDLSS) tabular domains (e.g., omics) are characterized by nrong local correlation groups, sparse cross-group dependencies, heavy-tailed non-Gaussian marginals, heteroscedastic noise, and structured missingness, making direct density learning in Rm ill-conditioned since nrating global dependence learning in the compact block-latent space Rm while decoding to the full feature space with copula-driven dependence, flexible per-feature marginals, and explicit missingness mechanisms. BSTabDiff supports modern deep priors on block latents, including diffusion and normalizing flows, enabling stable synthesis and controllable benchmark generation in the HDLSS regime. Empirically, BSTabDiff produces more realistic and stable high-dimensional synthetic data when compared with unstructured tabular generators on HDLSS data.
A.Z.S.B. Habib, M.Y. Ahamed, P.K. Gyawali, G. Doretto, D.A. Adjeroh.
iStructTab: Structured Feature Sequencing for Multimodal Learning of Image and Tabular Data, Subtitled arXiv:2608.04348, 2026.
Multimodal learning of images and tabular data is often impaired by ineffective representations, resulting in redundancy, dispersion, and generalization problems. To tackle this challenge, we introduce Graph-Enhanced Descriptor Sequencing (GEDS), a structured feature sequencing algorithm grounded in principles from the Column Permutation Problem (CPP). GEDS refines statistical descriptors of the features through similarity graph-based computations, systematically determining an effective feature sequencing. We incorporate GEDS within an order-aware efficient transformer framework, utilizing order-aware memory tokens that explicitly adhere to the derived feature sequencing via a dedicated loss function. Experimental results across multimodal benchmarks demonstrate that iStructTab effectively minimizes feature dispersion, improving predictive performance and robustness, and highlighting the significance of structured feature sequencing in multimodal learning.
Page 2 of 154
