---

Projects & Papers / Teaching & Service / Awards

---

About

Hi, I am a postdoctoral researcher at Stanford University, working on the intersection of AI for healthcare, vision-language, and large language models. Before that, I received my Ph.D. from The Chinese University of Hong Kong, Shenzhen, where I was supervised jointly by Xiang Wan, Tsung-Hui Chang, and Guanbin Li and also worked closely with Benyou Wang. I was also a visiting student researcher at Stanford from 07/2023 to 07/2024. I finished my B.Eng. degree from Sun Yat-sen University in 2019.

For undergraduate or graduate students at Stanford, feel free to contact me if you want to work together on projects/thesis related to vision-language or AI for healthcare.

News

• 09/2024: Two paper accepted to NeurIPS-2024: (i) one in main track (Topic: robustness in vision-language models) and (ii) one in D&B track (spotlight) (Topic: evaluating multimodal agents with board games).

Projects

• LLM Zoo: democratizing ChatGPT
  Project Leader
  [Website]

Publications

Survey

• Pre-trained Language Models in Biomedical Domain: A Systematic Survey
  Benyou Wang, Qianqian Xie, Jiahuan Pei, Zhihong Chen, Prayag Tiwari, Zhao Li, Jie Fu
  ACM Computing Surveys 2023.
  I am responsible for the content of multi-modality.

Large Language Models

• HuatuoGPT, Towards Taming Language Model to Be a Doctor
  Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Jianquan Li, Guiming Chen, Xiangbo Wu, Zhiyi Zhang, Qingying Xiao, Xiang Wan, Benyou Wang, Haizhou Li
  Findings of EMNLP 2023.

Vision-Language (Representation Learning / Foundation Models)

• Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts
  Zhihong Chen*, Shizhe Diao*, Benyou Wang, Guanbin Li and Xiang Wan
  ICCV 2023.


• Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge
  Zhihong Chen, Guanbin Li and Xiang Wan
  ACMMM 2022.


• Mapping medical image-text to a joint space via masked modeling
  Zhihong Chen, Yuhao Du, Jinpeng Hu, Yang Liu, Guanbin Li, Xiang Wan and Tsung-Hui Chang
  Medical Image Analysis 2023.


• Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Training
  Zhihong Chen, Yuhao Du, Jinpeng Hu, Yang Liu, Guanbin Li, Xiang Wan and Tsung-Hui Chang
  MICCAI 2022.

Vision-Language (Task-specific Modeling)

• Toward expanding the scope of radiology report summarization to multiple anatomies and modalities
  Zhihong Chen*, Maya Varma*, Xiang Wan, Curtis P. Langlotz and Jean-Benoit Delbrouck*
  ACL 2023.


• Improving Radiology Summarization with Radiograph and Anatomy Prompts
  Jinpeng Hu, Zhihong Chen, Yang Liu, Xiang Wan, and Tsung-Hui Chang
  Findings of ACL 2023.


• Cross-modal Memory Networks for Radiology Report Generation
  Zhihong Chen, Yaling Shen, Yan Song and Xiang Wan
  ACL 2021.


• Generating Radiology Reports via Memory-driven Transformer
  Zhihong Chen, Yan Song, Tsung-Hui Chang and Xiang Wan
  EMNLP 2020.


• Hierarchical Attention Network for Image Captioning
  Weixuan Wang, Zhihong Chen and Haifeng Hu
  AAAI 2019.

Vision-Language (Adaptation, Analysis, etc.)

• Bridging Vision and Language Encoders: Parameter-Efficient Tuning for Referring Image Segmentation
  Zunnan Xu*, Zhihong Chen*, Yong Zhang, Yibing Song, Xiang Wan and Guanbin Li
  ICCV 2023.


• On the Difference of BERT-style and CLIP-style Text Encoders
  Zhihong Chen*, Guiming Hardy Chen*, Shizhe Diao, Xiang Wan and Benyou Wang
  Findings of ACL 2023.


• Advancing Visual Grounding with Scene Knowledge: Benchmark and Method
  Zhihong Chen*, Ruifei Zhang*, Yibin Song, Xiang Wan and Guanbin Li
  CVPR 2023.

Other Papers

• EASAL: Entity-Aware Subsequence-based Active Learning for Named Entity Recognition
  Yang Liu, Jinpeng Hu, Zhihong Chen, Xiang Wan, and Tsung-Hui Chang
  AAAI 2023.


• A Simple yet Effective Subsequence-Enhanced Approach for Cross-Domain NER
  Jinpeng Hu, Dandan Guo, Yang Liu, Zhuo Li, Zhihong Chen, Xiang Wan, and Tsung-Hui Chang
  AAAI 2023.


• Graph Enhanced Contrastive Learning for Radiology Findings Summarization
  Jinpeng Hu, Zhuo Li, Zhihong Chen, Zhen Li, Xiang Wan and Tsung-Hui Chang
  ACL 2022.


• Word Graph Guided Summarization for Radiology Findings
  Jinpeng Hu, Jianling Li, Zhihong Chen, Yaling Shen, Yan Song, Xiang Wan and Tsung-Hui Chang
  Findings of ACL 2021.

Teaching

• Teaching Assistant, ERG2050 Introduction to Data Analytics, Spring 2021
• Teaching Assistant, MAT1001 Calculus, Fall 2020 (Outstanding TA Award)
• Teaching Assistant, STA2001 Probability and Statistics, Spring 2020
• Teaching Assistant, MAT1001 Calculus, Fall 2019

Service

• Reviewer: ACL (2021; 2022; 2023; 2024), EMNLP (2020; 2022; 2023), NAACL (2022; 2024), COLING (2020), ARR (2021; 2022; 2023), CVPR (2024), TMI (2023)

Awards

• Presidential Fellowship, 2019-2024
• MICCAI Student Travel Award, 2023
• Outstanding Teaching Assistant (TA) Award, 2021
• National Scholarship, 2018

---

Last update: 09/2024. Template credited to Tengyu Ma's and Danqi Chen's.