Longitudinal multimodal data, including electronic health records (EHR) and sequential chest X-rays (CXRs), is critical for modeling disease progression, yet remains underutilized due to two key challenges: (1) redundancy in consecutive CXR sequences, where static anatomical regions dominate over clinically-meaningful dynamics, and (2) temporal misalignment between sparse, irregular imaging and continuous EHR data. We introduce DiPro, a novel framework that addresses these challenges through region-aware disentanglement and multi-timescale alignment. First, we disentangle static (anatomy) and dynamic (pathology progression) features in sequential CXRs, prioritizing disease-relevant changes. Second, we hierarchically align these static and dynamic CXR features with asynchronous EHR data via local (pairwise interval-level) and global (full-sequence) synchronization to model coherent progression pathways. Extensive experiments on the MIMIC dataset demonstrate that DiPro could effectively extract temporal clinical dynamics and achieve state-of-the-art performance on both disease progression identification and general ICU prediction tasks.
@inproceedings{liu2025dipro,author={Liu, Chen and Yao, Wenfang and Yin, Kejing and Cheung, William K. and Qin, Jing},booktitle={Advances in Neural Information Processing Systems (NeurIPS-25)},title={Multimodal Disease Progression Modeling via Spatiotemporal Disentanglement and Multiscale Alignment},year={2025},}
NeurIPS-25
CURV: Coherent Uncertainty-Aware Reasoning in Vision-Language Models for X-Ray Report Generation
Ziao
Wang,
Sixing
Yan,
Kejing
Yin,
Xiaofeng
Zhang,
and William K.
Cheung
In Advances in Neural Information Processing Systems (NeurIPS-25) , 2025
Vision-language models have been explored for radiology report generation with promising results. Yet, uncertainty elaborated in findings and the reasoning process for reaching clinical impressions are seldom explicitly modeled, reducing the clinical accuracy and trustworthiness of the generated reports. We present CURV, a novel framework that alleviates the limitations through integrated awareness of uncertainty and explicit reasoning capabilities. Our approach consists of three key components: (1) an uncertainty modeling mechanism that teaches the model to recognize and express appropriate levels of diagnostic confidence, (2) a structured reasoning framework that generates intermediate explanatory steps connecting visual findings to clinical impressions, and (3) a reasoning coherence reward that ensures logical consistency among findings, reasoning, and impressions. We implement CURV through a three-stage training pipeline that combines uncertainty-aware fine-tuning, reasoning initialization, and reinforcement learning. In particular, we adopt a comprehensive reward function addresses multiple aspects of report quality, incorporating medical term matching, uncertainty expression evaluation, and semantic coherence evaluation. Experimental results demonstrate that CURV generates clinically relevant reports with appropriate uncertainty expressions and transparent reasoning traces, significantly outperforming previous methods. CURV represents a substantial advancement toward interpretable and trustworthy AI-generated radiology reports, with broader implications for the deployment of vision-language models in high-stakes clinical environments where uncertainty awareness and reasoning transparency are essential.
@inproceedings{wang2025curv,author={Wang, Ziao and Yan, Sixing and Yin, Kejing and Zhang, Xiaofeng and Cheung, William K.},booktitle={Advances in Neural Information Processing Systems (NeurIPS-25)},title={CURV: Coherent Uncertainty-Aware Reasoning in Vision-Language Models for X-Ray Report Generation},year={2025},}
2024
NeurIPS-24
Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest X-ray Generation
Wenfang
Yao*,
Chen
Liu*,
Kejing
Yin,
William K.
Cheung,
and Jing
Qin
In Advances in Neural Information Processing Systems (NeurIPS-24) , 2024
Integrating multi-modal clinical data, such as electronic health records (EHR) and chest X-ray images (CXR), is particularly beneficial for clinical prediction tasks. However, in a temporal setting, multi-modal data are often inherently asynchronous. EHR can be continuously collected but CXR is generally taken with a much longer interval due to its high cost and radiation dose. When clinical prediction is needed, the last available CXR image might have been outdated, leading to suboptimal predictions. To address this challenge, we propose DDL-CXR, a method that dynamically generates an up-to-date latent representation of the individualized CXR images. Our approach leverages latent diffusion models for patient-specific generation strategically conditioned on a previous CXR image and EHR time series, providing information regarding anatomical structures and disease progressions, respectively. In this way, the interaction across modalities could be better captured by the latent CXR generation process, ultimately improving the prediction performance. Experiments using MIMIC datasets show that the proposed model could effectively address asynchronicity in multimodal fusion and consistently outperform existing methods.
@inproceedings{yao2024ddlcxr,author={Yao, Wenfang and Liu, Chen and Yin, Kejing and Cheung, William K. and Qin, Jing},booktitle={Advances in Neural Information Processing Systems (NeurIPS-24)},title={Addressing Asynchronicity in Clinical Multimodal Fusion via Individualized Chest {X-ray} Generation},year={2024},}
IEEE CAI
An End-to-end Learning Approach for Counterfactual Generation and Individual Treatment Effect Estimation
Feilong
Wu,
Kejing
Yin,
and William K.
Cheung
In 2024 IEEE Conference on Artificial Intelligence (CAI) , 2024
Estimating the causal effect due to an intervention is important for many applications, such as healthcare. Unobserved counterfactuals make unbiased treatment effect estimation non-trivial. Among existing approaches, counterfactual generation which augments observational data with generated pseudo counterfactuals has been found promising for reducing the bias. These methods typically take a two-stage approach for the counterfactual generation and treatment effect estimation. Therefore, the counterfactual generation could be sub-optimal. To this end, we propose to jointly optimize the auxiliary models for generating the counterfactuals and the outcome estimation models. In particular, we demonstrate the viability by first connecting a counterfactual outcome generator with a reparameterized VAE model, and then learning them in an end-to-end fashion using the EM algorithm. Our evaluation results based on synthetic and semi-synthetic datasets show that a simple causal effect VAE model learned together with the counterfactual outcome generator can outperform a number of SOTA models for treatment effect estimation.
AAAI-24
DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency
Wenfang
Yao*,
Kejing
Yin*,
William K.
Cheung,
Jia
Liu,
and Jing
Qin
In Proceedings of the AAAI Conference on Artificial Intelligence , 2024
The combination of electronic health records (EHR) and medical images is crucial for clinicians in making diagnoses and forecasting prognoses. Strategically fusing these two data modalities has great potential to improve the accuracy of machine learning models in clinical prediction tasks. However, the asynchronous and complementary nature of EHR and medical images presents unique challenges. Missing modalities due to clinical and administrative factors are inevitable in practice, and the significance of each data modality varies depending on the patient and the prediction target, resulting in inconsistent predictions and suboptimal model performance. To address these challenges, we propose DrFuse to achieve effective clinical multi-modal fusion. It tackles the missing modality issue by disentangling the features shared across modalities and those unique within each modality. Furthermore, we address the modal inconsistency issue via a disease-wise attention layer that produces the patient- and disease-wise weighting for each modality to make the final prediction. We validate the proposed method using real-world large-scale datasets, MIMIC-IV and MIMIC-CXR. Experimental results show that the proposed method significantly outperforms the state-of-the-art models.
@inproceedings{drfuse2024yao,doi={10.1609/aaai.v38i15.29578},title={{DrFuse}: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency},author={Yao, Wenfang and Yin, Kejing and Cheung, William K. and Liu, Jia and Qin, Jing},booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},volume={38},number={15},year={2024},pages={16416-16424},}
Nat. Comm.
Exploring high-quality microbial genomes by assembling short-reads with long-range connectivity
Zhenmiao
Zhang,
Jin
Xiao,
Hongbo
Wang,
Chao
Yang,
Yufen
Huang,
Zhen
Yue,
Yang
Chen,
Lijuan
Han,
Kejing
Yin,
Aiping
Lyu,
Xiaodong
Fang,
and Lu
Zhang
Although long-read sequencing enables the generation of complete genomes for unculturable microbes, its high cost limits the widespread adoption of long-read sequencing in large-scale metagenomic studies. An alternative method is to assemble short-reads with long-range connectivity, which can be a cost-effective way to generate high-quality microbial genomes. Here, we develop Pangaea, a bioinformatic approach designed to enhance metagenome assembly using short-reads with long-range connectivity. Pangaea leverages connectivity derived from physical barcodes of linked-reads or virtual barcodes by aligning short-reads to long-reads. Pangaea utilizes a deep learning-based read binning algorithm to assemble co-barcoded reads exhibiting similar sequence contexts and abundances, thereby improving the assembly of high- and medium-abundance microbial genomes. Pangaea also leverages a multi-thresholding algorithm strategy to refine assembly for low-abundance microbes. We benchmark Pangaea on linked-reads and a combination of short- and long-reads from simulation data, mock communities and human gut metagenomes. Pangaea achieves significantly higher contig continuity as well as more near-complete metagenome-assembled genomes (NCMAGs) than the existing assemblers. Pangaea also generates three complete and circular NCMAGs on the human gut microbiomes.
GigaScience
LRTK: a platform agnostic toolkit for linked-read analysis of both human genome and metagenome
Chao
Yang,
Zhenmiao
Zhang,
Yufen
Huang,
Xuefeng
Xie,
Herui
Liao,
Jin
Xiao,
Werner Pieter
Veldsman,
Kejing
Yin,
Xiaodong
Fang,
and Lu
Zhang
GigaScience, 2024
IEEE JBHI
DNA-T: Deformable Neighborhood Attention Transformer for Irregular Medical Time Series
Jianxuan
Huang,
Baoyao
Yang,
Kejing
Yin,
and Jingwen
Xu
IEEE Journal of Biomedical and Health Informatics, 2024
The real-world Electronic Health Records (EHRs) present irregularities due to changes in the patient’s health status, resulting in various time intervals between observations and different physiological variables examined at each observation point. There have been recent applications of Transformer-based models in the field of irregular time series. However, the full attention mechanism in Transformer overly focuses on distant information, ignoring the short-term correlations of the condition. Thereby, the model is not able to capture localized changes or short-term fluctuations in patients’ conditions. Therefore, we propose a novel end-to-end Deformable Neighborhood Attention Transformer (DNA-T) for irregular medical time series. The DNA-T captures local features by dynamically adjusting the receptive field of attention and aggregating relevant deformable neighborhoods in irregular time series. Specifically, we design a Deformable Neighborhood Attention (DNA) module that enables the network to attend to relevant neighborhoods by drifting the receiving field of neighborhood attention. The DNA enhances the model’s sensitivity to local information and representation of local features, thereby capturing the correlation of localized changes in patients’ conditions. We conduct extensive experiments to validate the effectiveness of DNA-T, outperforming existing state-of-the-art methods in predicting the mortality risk of patients. Moreover, we visualize an example to validate the effectiveness of the proposed DNA. Our code is available at https://github.com/Nekumiya-x/DNA-T.
@article{huang2024dna,title={{DNA-T}: Deformable Neighborhood Attention Transformer for Irregular Medical Time Series},author={Huang, Jianxuan and Yang, Baoyao and Yin, Kejing and Xu, Jingwen},journal={IEEE Journal of Biomedical and Health Informatics},year={2024},doi={10.1109/JBHI.2024.3395446},}
IEEE TKDE
PATNet: Propensity-Adjusted Temporal Network for Joint Imputation and Prediction Using Binary EHRs With Observation Bias
Kejing
Yin,
Dong
Qian,
and William K
Cheung
IEEE Transactions on Knowledge and Data Engineering, 2024
Predictive analysis of electronic health records (EHR) is a fundamental task that could provide actionable insights to help clinicians improve the efficiency and quality of care. EHR are commonly recorded in binary format and contain inevitable missing data. The nature of missingness may vary by patients, clinical features, and time, which incurs observation bias. It is essential to account for the binary missingness and observation bias or the predictive performance could be substantially compromised. In this paper, we develop a propensity-adjusted temporal network (PATNet) to conduct data imputation and predictive analysis simultaneously. PATNet contains three subnetworks: 1) an imputation subnetwork that generates the initial imputation based on historical observations, 2) a propensity subnetwork that infers the patient-, feature-, and time-dependent propensity scores, and 3) a prediction subnetwork that produces the missing-informative prediction using the propensity-adjusted imputations and the missing probabilities. To allow the propensity scores to be inferred from data, we use the expectation-maximization (EM) algorithm to learn the imputation and propensity subnetworks and incorporate a low-rank constraint via PARAFAC2 approximation. Extensive evaluation using the MIMIC-III and eICU datasets demonstrates that PATNet outperforms the state-of-the-art methods in terms of binary data imputation, disease progression modeling, and mortality prediction tasks.
@article{yin2024patnet,title={PATNet: Propensity-Adjusted Temporal Network for Joint Imputation and Prediction Using Binary EHRs With Observation Bias},author={Yin, Kejing and Qian, Dong and Cheung, William K},journal={IEEE Transactions on Knowledge and Data Engineering},year={2024},publisher={IEEE},}
2023
ACM TIST
Adaptive Integration of Categorical and Multi-relational Ontologies with EHR Data for Medical Concept Embedding
Chin Wang
Cheong,
Kejing
Yin,
William K
Cheung,
Benjamin CM
Fung,
and Jonathan
Poon
ACM Transactions on Intelligent Systems and Technology, 2023
Representation learning has been applied to Electronic Health Records (EHR) for medical concept embedding and the downstream predictive analytics tasks with promising results. Medical ontologies can also be integrated to guide the learning so the embedding space can better align with existing medical knowledge. Yet, properly carrying out the integration is non-trivial. Medical concepts that are similar according to a medical ontology may not be necessarily close in the embedding space learned from the EHR data, as medical ontologies organize medical concepts for their own specific objectives. Any integration methodology without considering the underlying inconsistency will result in sub-optimal medical concept embedding and, in turn, degrade the performance of the downstream tasks. In this article, we propose a novel representation learning framework called ADORE (ADaptive Ontological REpresentations) that allows the medical ontologies to adapt their structures for more robust integrating with the EHR data. ADORE first learns multiple embeddings for each category in the ontology via an attention mechanism. At the same time, it supports an adaptive integration of categorical and multi-relational ontologies in the embedding space using a category-aware graph attention network. We evaluate the performance of ADORE on a number of predictive analytics tasks using two EHR datasets. Our experimental results show that the medical concept embeddings obtained by ADORE can outperform the state-of-the-art methods for all the tasks. More importantly, it can result in clinically meaningful sub-categorization of the existing ontological categories and yield attention values that can further enhance the model interpretability.
@article{cheong2023adaptive,title={Adaptive Integration of Categorical and Multi-relational Ontologies with EHR Data for Medical Concept Embedding},author={Cheong, Chin Wang and Yin, Kejing and Cheung, William K and Fung, Benjamin CM and Poon, Jonathan},journal={ACM Transactions on Intelligent Systems and Technology},volume={14},number={6},pages={1--20},year={2023},publisher={ACM New York, NY},}
2022
IEEE TKDE
Learning Inter-Modal Correspondence and Phenotypes From Multi-Modal Electronic Health Records
Kejing
Yin,
William K
Cheung,
Benjamin CM
Fung,
and Jonathan
Poon
IEEE Transactions on Knowledge and Data Engineering, 2022
Non-negative tensor factorization has been shown a practical solution to automatically discover phenotypes from the electronic health records (EHR) with minimal human supervision. Such methods generally require an input tensor describing the inter-modal interactions to be pre-established; however, the correspondence between different modalities (e.g., correspondence between medications and diagnoses) can often be missing in practice. Although heuristic methods can be applied to estimate them, they inevitably introduce errors, and leads to sub-optimal phenotype quality. This is particularly important for patients with complex health conditions (e.g., in critical care) as multiple diagnoses and medications are simultaneously present in the records. To alleviate this problem and discover phenotypes from EHR with unobserved inter-modal correspondence, we propose the collective hidden interaction tensor factorization (cHITF) to infer the correspondence between multiple modalities jointly with the phenotype discovery. We assume that the observed matrix for each modality is marginalization of the unobserved inter-modal correspondence, which are reconstructed by maximizing the likelihood of the observed matrices. Extensive experiments conducted on the real-world MIMIC-III dataset demonstrate that cHITF effectively infers clinically meaningful inter-modal correspondence, discovers phenotypes that are more clinically relevant and diverse, and achieves better predictive performance compared with a number of state-of-the-art computational phenotyping models.
@article{yin2022learning,title={Learning Inter-Modal Correspondence and Phenotypes From Multi-Modal Electronic Health Records},author={Yin, Kejing and Cheung, William K and Fung, Benjamin CM and Poon, Jonathan},journal={IEEE Transactions on Knowledge and Data Engineering},volume={34},number={09},pages={4328--4341},year={2022},publisher={IEEE Computer Society},}
2021
AAAI-21
SWIFT: Scalable Wasserstein factorization for sparse nonnegative tensors
Ardavan
Afshar,
Kejing
Yin,
Sherry
Yan,
Cheng
Qian,
Joyce
Ho,
Haesun
Park,
and Jimeng
Sun
In Proceedings of the AAAI Conference on Artificial Intelligence , 2021
Existing tensor factorization methods assume that the input tensor follows some specific distribution (i.e. Poisson, Bernoulli, and Gaussian), and solve the factorization by minimizing some empirical loss functions defined based on the corresponding distribution. However, it suffers from several drawbacks: 1) In reality, the underlying distributions are complicated and unknown, making it infeasible to be approximated by a simple distribution. 2) The correlation across dimensions of the input tensor is not well utilized, leading to sub-optimal performance. Although heuristics were proposed to incorporate such correlation as side information under Gaussian distribution, they can not easily be generalized to other distributions. Thus, a more principled way of utilizing the correlation in tensor factorization models is still an open challenge. Without assuming any explicit distribution, we formulate the tensor factorization as an optimal transport problem with Wasserstein distance, which can handle non-negative inputs. We introduce SWIFT, which minimizes the Wasserstein distance that measures the distance between the input tensor and that of the reconstruction. In particular, we define the N-th order tensor Wasserstein loss for the widely used tensor CP factorization and derive the optimization algorithm that minimizes it. By leveraging sparsity structure and different equivalent formulations for optimizing computational efficiency, SWIFT is as scalable as other well-known CP algorithms. Using the factor matrices as features, SWIFT achieves up to 9.65% and 11.31% relative improvement over baselines for downstream prediction tasks. Under the noisy conditions, SWIFT achieves up to 15% and 17% relative improvements over the best competitors for the prediction tasks.
@inproceedings{afshar2021swift,title={{SWIFT}: Scalable {Wasserstein} factorization for sparse nonnegative tensors},author={Afshar, Ardavan and Yin, Kejing and Yan, Sherry and Qian, Cheng and Ho, Joyce and Park, Haesun and Sun, Jimeng},booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},volume={35},number={8},pages={6548--6556},year={2021},}
SDM-21
TedPar: Temporally dependent PARAFAC2 factorization for phenotype-based disease progression modeling
Kejing
Yin,
William K
Cheung,
Benjamin CM
Fung,
and Jonathan
Poon
In Proceedings of the 2021 SIAM International Conference on Data Mining (SDM) , 2021
PARAFAC2 factorization provides a practical solution to map the temporally irregular electronic health records (EHR) to clinically relevant and interpretable phenotypes. Existing methods ignore the effect of interdependency of diseases over clinical history. Consequently, the crucial temporal information contained in the EHR data cannot be fully utilized and the learned phenotypes can be sub-optimal to characterize patients with progressive conditions. To address this issue, we propose a novel temporally dependent PARAFAC2 (TedPar) factorization in which the temporal dependency among the phenotypes is explicitly modeled. TedPar learns a set of target phenotypes to capture the clinical features relevant to the diseases of interest and a set of background phenotypes to capture irrelevant but frequently co-occurring clinical features. By effectively modeling the temporal dependency and separating relevant and irrelevant features, the discovered target phenotypes can be used to model the progression of the diseases of interest. Empirical evaluations show that TedPar obtains up to 32.4% relative improvement in reconstruction accuracy over the test set, suggesting significantly better generalizability than the baselines for both noise-free and heavily noisy input data. Qualitative analysis also shows that TedPar is capable of discovering clinically meaningful phenotypes and capturing the temporal dependency between them.
@inproceedings{yin2021tedpar,title={{TedPar}: Temporally dependent {PARAFAC2} factorization for phenotype-based disease progression modeling},author={Yin, Kejing and Cheung, William K and Fung, Benjamin CM and Poon, Jonathan},booktitle={Proceedings of the 2021 SIAM International Conference on Data Mining (SDM)},pages={594--602},year={2021},organization={Society for Industrial and Applied Mathematics},}
2020
KDD-20
LogPar: Logistic PARAFAC2 factorization for temporal binary data with missing values
Kejing
Yin,
Ardavan
Afshar,
Joyce C
Ho,
William K
Cheung,
Chao
Zhang,
and Jimeng
Sun
In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining , 2020
Research Track; acceptance ratio: 216⁄1279 = 16.9%
Binary data with one-class missing values are ubiquitous in real-world applications. They can be represented by irregular tensors with varying sizes in one dimension, where value one means presence of a feature while zero means unknown (i.e., either presence or absence of a feature). Learning accurate low-rank approximations from such binary irregular tensors is a challenging task. However, none of the existing models developed for factorizing irregular tensors take the missing values into account, and they assume Gaussian distributions, resulting in a distribution mismatch when applied to binary data. In this paper, we propose Logistic PARAFAC2 (LogPar) by modeling the binary irregular tensor with Bernoulli distribution parameterized by an underlying real-valued tensor. Then we approximate the underlying tensor with a positive-unlabeled learning loss function to account for the missing values. We also incorporate uniqueness and temporal smoothness regularization to enhance the interpretability. Extensive experiments using large-scale real-world datasets show that LogPar outperforms all baselines in both irregular tensor completion and downstream predictive tasks. For the irregular tensor completion, LogPar achieves up to 26% relative improvement compared to the best baseline. Besides, LogPar obtains relative improvement of 13.2% for heart failure prediction and 14% for mortality prediction on average compared to the state-of-the-art PARAFAC2 models.
@inproceedings{yin2020logpar,title={LogPar: Logistic PARAFAC2 factorization for temporal binary data with missing values},author={Yin, Kejing and Afshar, Ardavan and Ho, Joyce C and Cheung, William K and Zhang, Chao and Sun, Jimeng},booktitle={Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery \& Data Mining},pages={1625--1635},year={2020},}
JHIR
Context-aware time series imputation for multi-analyte clinical data
Kejing
Yin,
Liaoliao
Feng,
and William K
Cheung
Journal of Healthcare Informatics Research, 2020
This is an extension of our previous two-page abstract appeared in ICHI-19.
Clinical time series imputation is recognized as an essential task in clinical data analytics. Most models rely either on strong assumptions regarding the underlying data-generation process or on preservation of only local properties without effective consideration of global dependencies. To advance the state of the art in clinical time series imputation, we participated in the 2019 ICHI Data Analytics Challenge on Missing Data Imputation (DACMI). In this paper, we present our proposed model: Context-Aware Time Series Imputation (CATSI), a novel framework based on a bidirectional LSTM in which patients’ health states are explicitly captured by learning a “global context vector” from the entire clinical time series. The imputations are then produced with reference to the global context vector. We also incorporate a cross-feature imputation component to explore the complex feature correlations. Empirical evaluations demonstrate that CATSI obtains a normalized root mean square deviation (nRMSD) of 0.1998, which is 10.6% better than that of state-of-the-art models. Further experiments on consecutive missing datasets also illustrate the effectiveness of incorporating the global context in the generation of accurate imputations.
@article{yin2020context,title={Context-aware time series imputation for multi-analyte clinical data},author={Yin, Kejing and Feng, Liaoliao and Cheung, William K},journal={Journal of Healthcare Informatics Research},volume={4},pages={411--426},year={2020},publisher={Springer International Publishing},}
2019
AAAI-19
Learning phenotypes and dynamic patient representations via RNN regularized collective non-negative tensor factorization
Kejing
Yin,
Dong
Qian,
William K
Cheung,
Benjamin CM
Fung,
and Jonathan
Poon
In Proceedings of the AAAI Conference on Artificial Intelligence , 2019
Non-negative Tensor Factorization (NTF) has been shown effective to discover clinically relevant and interpretable phenotypes from Electronic Health Records (EHR). Existing NTF based computational phenotyping models aggregate data over the observation window, resulting in the learned phenotypes being mixtures of disease states appearing at different times. We argue that by separating the clinical events happening at different times in the input tensor, the temporal dynamics and the disease progression within the observation window could be modeled and the learned phenotypes will correspond to more specific disease states. Yet how to construct the tensor for data samples with different temporal lengths and properly capture the temporal relationship specific to each individual data sample remains an open challenge. In this paper, we propose a novel Collective Non-negative Tensor Factorization (CNTF) model where each patient is represented by a temporal tensor, and all of the temporal tensors are factorized collectively with the phenotype definitions being shared across all patients. The proposed CNTF model is also flexible to incorporate non-temporal data modality and RNN-based temporal regularization. We validate the proposed model using MIMIC-III dataset, and the empirical results show that the learned phenotypes are clinically interpretable. Moreover, the proposed CNTF model outperforms the state-of-the-art computational phenotyping models for the mortality prediction task.
@inproceedings{yin2019learning,title={Learning phenotypes and dynamic patient representations via RNN regularized collective non-negative tensor factorization},author={Yin, Kejing and Qian, Dong and Cheung, William K and Fung, Benjamin CM and Poon, Jonathan},booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},volume={33},number={01},pages={1246--1253},year={2019},}
IJCAI-19
Medical Concept Embedding with Multiple Ontological Representations
Lihong
Song,
Chin Wang
Cheong,
Kejing
Yin,
William K
Cheung,
Benjamin C M
Fung,
and Jonathan
Poon
In Proceedings of the 28th International Joint Conference on Artificial Intelligence , 2019
Learning representations of medical concepts from the Electronic Health Records (EHR) has been shown effective for predictive analytics in healthcare. Incorporation of medical ontologies has also been explored to further enhance the accuracy and to ensure better alignment with the known medical knowledge. Most of the existing work assumes that medical concepts under the same ontological category should share similar representations, which however does not always hold. In particular, the categorizations in medical ontologies were established with various factors being considered. Medical concepts even under the same ontological category may not follow similar occurrence patterns in the EHR data, leading to contradicting objectives for the representation learning. In this paper, we propose a deep learning model called MMORE which alleviates this conflicting objective issue by allowing multiple representations to be inferred for each ontological category via an attention mechanism. We apply MMORE to diagnosis prediction and our experimental results show that the representations obtained by MMORE can achieve better predictive accuracy and result in clinically meaningful sub-categorization of the existing ontological categories.
@inproceedings{song2019medical,doi={10.24963/ijcai.2019/641},title={Medical Concept Embedding with Multiple Ontological Representations},author={Song, Lihong and Cheong, Chin Wang and Yin, Kejing and Cheung, William K and Fung, Benjamin C M and Poon, Jonathan},booktitle={Proceedings of the 28th International Joint Conference on Artificial Intelligence},volume={19},pages={4613--4619},year={2019},}
ICHI-19
Context-aware imputation for clinical time series
Kejing
Yin,
and William K
Cheung
In 2019 IEEE International Conference on Healthcare Informatics (ICHI) , 2019
@inproceedings{yin2019context,title={Context-aware imputation for clinical time series},author={Yin, Kejing and Cheung, William K},booktitle={2019 IEEE International Conference on Healthcare Informatics (ICHI)},pages={1--3},year={2019},organization={IEEE}}
2018
IJCAI-18
Joint Learning of Phenotypes and Diagnosis-Medication Correspondence via Hidden Interaction Tensor Factorization.
Kejing
Yin,
William K
Cheung,
Yang
Liu,
Benjamin C M
Fung,
and Jonathan
Poon
In Proceedings of the 27th International Joint Conference on Artificial Intelligence , 2018
Non-negative tensor factorization has been shown effective for discovering phenotypes from the EHR data with minimal human supervision. In most cases, an interaction tensor of the elements in the EHR (e.g., diagnoses and medications) has to be first established before the factorization can be applied. Such correspondence information however is often missing. While different heuristics can be used to estimate the missing correspondence, any errors introduced will in turn cause inaccuracy for the subsequent phenotype discovery task. This is especially true for patients with multiple diseases diagnosed (e.g., under critical care). To alleviate this limitation, we propose the hidden interaction tensor factorization (HITF) where the diagnosis-medication correspondence and the underlying phenotypes are inferred simultaneously. We formulate it under a Poisson non-negative tensor factorization framework and learn the HITF model via maximum likelihood estimation. For performance evaluation, we applied HITF to the MIMIC III dataset. Our empirical results show that both the phenotypes and the correspondence inferred are clinically meaningful. In addition, the inferred HITF model outperforms a number of state-of-the-art methods for mortality prediction.
@inproceedings{yin2018joint,doi={10.24963/ijcai.2018/504},title={Joint Learning of Phenotypes and Diagnosis-Medication Correspondence via Hidden Interaction Tensor Factorization.},author={Yin, Kejing and Cheung, William K and Liu, Yang and Fung, Benjamin C M and Poon, Jonathan},booktitle={Proceedings of the 27th International Joint Conference on Artificial Intelligence},pages={3627--3633},year={2018}}
JAAS
Identifying laser-induced plasma emission spectra of particles in a gas–solid flow based on the standard deviation of intensity across an emission line
Shunchun
Yao,
Lifeng
Zhang,
Kejing
Yin,
Kaijie
Bai,
Jialong
Xu,
Zhimin
Lu,
and Jidong
Lu
Journal of Analytical Atomic Spectrometry, 2018
This is an extension of my undergraduate final-semester project.
@article{yao2018identifying,doi={10.1039/C8JA00194D},title={Identifying laser-induced plasma emission spectra of particles in a gas--solid flow based on the standard deviation of intensity across an emission line},author={Yao, Shunchun and Zhang, Lifeng and Yin, Kejing and Bai, Kaijie and Xu, Jialong and Lu, Zhimin and Lu, Jidong},journal={Journal of Analytical Atomic Spectrometry},volume={33},number={10},pages={1676--1682},year={2018},publisher={Royal Society of Chemistry}}
2015
E&F
Rapidly measuring unburned carbon in fly ash using molecular CN by laser-induced breakdown spectroscopy
Shunchun
Yao,
Yueliang
Shen,
Kejing
Yin,
Gang
Pan,
and Jidong
Lu
@article{yao2015rapidly,doi={10.1021/ef502174q},title={Rapidly measuring unburned carbon in fly ash using molecular {CN} by laser-induced breakdown spectroscopy},author={Yao, Shunchun and Shen, Yueliang and Yin, Kejing and Pan, Gang and Lu, Jidong},journal={Energy \& Fuels},volume={29},number={2},pages={1257--1263},year={2015},publisher={ACS Publications}}
