I am Tian Ye, a Research Assistant in ROAS at HKUST,GZ, supervised by Prof. Lei Zhu. I am also an incoming PhD student at HKUST@ROAS Thrust. I was honored to be supervised and collaborated with Prof. Erkang Chen and Prof. Yun Liu during my undergraduate studies.

📰 News!!!

May 02 — Check out our MovieChat+ paper, the upgraded version of CVPR’24 MovieChat!

Apr 22 — We organize a Long-Term Question Answering Challenge (LOVEU@CVPR’24 Track 1: Long-term Video Question Answering), focusing on video understanding task with tens of thousands of frames! The competition is ongoing, with a submission deadline of June 9th.

📝 Selected Papers

My current research focuses on three main areas: (I) Addressing the challenges of real-world image restoration and enhancement by identifying and overcoming the limitations of existing learning-based methods. (II) Exploring vision problems related to photography, with the goal of producing images of superior visual quality. (III) Providing support for the art creation industry and digital asset generation through advancements in AIGC (Artificial Intelligence Generated Content) technology.

Google Scholar Citation: 600+ (2024.05)

ViewControl:View-Consistent Image-to-Image Editing in Interior Design Scenes
Jinbin Bai, Zhen Dong, Aosong Feng, Xiao Zhang, Tian Ye, Kaicheng Zhou, Mike Zheng Shou
IJCAI 2024 Special Track on AI, the Arts and Creativity. Three reviews with "Accept" ratings!
PDF | code

[Emboided AI&LLM] Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation
Zhonghan Zhao, Kewei Chen, Dongxu Guo, Wenhao Chai, Tian Ye, Yanting Zhang, Gaoang Wang.
ICLR 2024@LLMAgents Workshop
Arxiv

[Generative Model For IR] Learning Diffusion Texture Priors for Image Restoration
Tian Ye, Sixiang Chen, Wenhao Chai, Zhaohu Xing, Jing Qin, Ge Lin, Lei Zhu.
CVPR Highlight 2024 Selected as a Highlight presentation paper (324 of 11,532 valid submissions).
PDF | code

[LLM&Multi-Modal] MovieChat: From Dense Token to Sparse Memory for Long Video Understanding
Enxin Song, Wenhao Chai, Guanhong Wang, Yucheng Zhang, Haoyang Zhou, Feiyang Wu, Xun Guo, Tian Ye, Yan Lu, Jenq-Neng Hwang, Gaoang Wang
CVPR 2024
PDF | Code | Project

[Generative Model For IR] VQCNIR: Clearer Night Image Restoration with Vector-Quantized Codebook
Wenbin Zou, Hongxia Gao, Tian Ye, Liang Chen, Weipeng Yang, Shasha Huang, Hongsheng Chen, Sixiang Chen
AAAI 2024
PDF | Code

[Image Restoration] Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks
Sixiang Chen*,Tian Ye*, Jinbin Bai, Jun Shi, Erkang Chen, Lei Zhu.
ICCV 2023
PDF | Code | Project

[Generative Model For IR] Adverse Weather Removal with Codebook Priors
Tian Ye*, Sixiang Chen*, Jinbin Bai*, Shi Jun, Chenghao Xue, Jingjia Jiang, Junjie Yin, Erkang Chen, Yun Liu.
ICCV 2023
PDF | Code

[Image Restoration] Uncertainty-Driven Dynamic Degradation Perceiving and Background Modeling for Efficient Single Image Desnowing
SiXiang Chen*, Tian Ye*, Chenghao Xue, Haoyu Chen, Yun Liu, Erkang Chen, Lei Zhu
ACM Multimedia (ACM MM), 2023
PDF | Code

[Image Restoration]NightHazeFormer: Single Nighttime Haze Removal Using Prior Query Transformer
Yun Liu, Zhongsheng Yan, Sixiang Chen*, Tian Ye*, Wenqi Ren, Erkang Chen
ACM Multimedia (ACM MM), 2023
PDF | Code

[Image Restoration] Perceiving and Modeling Density for Image Dehazing
Tian Ye*, Yunchen Zhang*, Mingchao Jiang*, Liang Chen, Yun Liu, Erkang Chen.
ECCV Oral, 2022. Selected as a Oral presentation paper (Top 2.7%, 158 of 5,803 valid submissions).
PDF | Code

🎖 Competitions & Awards

  • PG scholarship of HKUST(GZ), 2024.
  • 2022 CVPR NAS Competition Supernet Track: Third Place Solution of Track 1
  • 2022 JMU Student Star Award (20/19000)

💬 Academic Services

  • Conference Reviewer: ACCV 2022&2024, WACV 2023&2024, BMVC 2023&2024, AAAI 2022&2023&2024, ICCV 2023, CVPR 2024, ECCV 2024, ACM MM 2024.

  • Workshop Competition Organizer: LOVEU@CVPR 2024

  • Journal Reviewer:

    International Journal of Computer Vision

    IEEE Signal Processing Letter

    IEEE Journal of Oceanic Engineering

📖 Educations&Experience

  • Sep’2024-Jul’2028 (expected): PhD Student (Incoming), The Hong Kong University of Science and Technology, Guangzhou Campus.

  • Jun’2023-Now: Research Assistant, The Hong Kong University of Science and Technology, Guangzhou Campus.

  • Sep’2019-Jul’2023: B.Eng (Telecommunication Engineering), Jimei University, Xiamen.