avatar

Le Zhuo

B.S. Student
Beihang University
zhuole1025@gmail.com


About Me

I received my B.E. degree from Beihang Univerisity in 2024, majoring in Computer Science and Technology. I am currently working as a research intern at Shanghai AI Lab, supervised by Dr. Peng Gao and Prof. Hongsheng Li. Before this, I was a research intern at Mila - Québec AI Institute supervised by Prof. Jian Tang. During my undergraduate years at BUAA, I was supervised by Prof. Si Liu and I was fortunate to work with Prof. Shuicheng Yan and Dr. Jie Fu at Beijing Academy of Artificial Intelligence. I was also a research intern at Alibaba Inc., where I worked on music generation with Dr. Aixi Zhang.

Research Interests

News

Publications

  1. Preprint
    Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraining
    Dongyang Liu*, Shitian Zhao*, Le Zhuo*, Weifeng Lin*, Yu Qiao, Hongsheng Li, Peng Gao
    Technical Report.
    PDF Code

  2. Preprint
    Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT
    Le Zhuo*, Ruoyi Du*, Han Xiao*, Yangguang Li*, Dongyang Liu*, Rongjie Huang*, Wenze Liu*, Lirui Zhao, Fu-Yun Wang, Zhanyu Ma, Xu Luo, Zehan Wang, Kaipeng Zhang, Xiangyang Zhu, Si Liu, Xiangyu Yue, Dingning Liu, Wanli Ouyang, Ziwei Liu, Yu Qiao, Hongsheng Li, Peng Gao
    Technical Report.
    PDF Code

  3. Preprint
    Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers
    Peng Gao*, Le Zhuo*, Ziyi Lin*, Chris Liu*, Junsong Chen*, Ruoyi Du*, Enze Xie*, Xu Luo*, Longtian Qiu*, Yuhang Zhang, Chen Lin, Rongjie Huang, Shijie Geng, Renrui Zhang, Junlin Xi, Wenqi Shao, Zhengkai Jiang, Tianshuo Yang, Weicai Ye, He Tong, Jingwen He, Yu Qiao, Hongsheng Li
    Technical Report.
    PDF Code

  4. ACL
    ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training
    Le Zhuo*, Zewen Chi*, Minghao Xu*, Heyan Huang, Jianan Zhao, Heqi Zheng, Conghui He, Xian-Ling Mao, Wentao Zhang
    Association for Computational Linguistics, (ACL), 2024.
    PDF Code Project Page

  5. Preprint
    LLMs as Visual Explainers: Advancing Image Classification with Evolving Visual Descriptions
    Songhao Han*, Le Zhuo*, Yue Liao, Si Liu
    Under review.
    PDF Code

  6. Preprint
    GraphText: Graph Reasoning in Text Space
    Jianan Zhao, Le Zhuo, Yikang Shen, Meng Qu, Kai Liu, Michael Bronstein, Zhaocheng Zhu, Jian Tang
    Under review.
    PDF

  7. ACM MM
    DiffDance: Cascaded Human Motion Diffusion Model for Dance Generation
    Qiaosong Qi*, Le Zhuo*, Aixi Zhang, Yue Liao, Fei Fang, Si Liu, Shuicheng Yan
    ACM International Conference on Multimedia (ACM MM), 2023.
    PDF Oral Presentation

  8. ICCV
    Video Background Music Generation: Dataset, Method and Evaluation
    Le Zhuo*, Zhaokai Wang*, Baisen Wang*, Yue Liao, Chenxi Bao, Stanley Peng, Songhao Han, Aixi Zhang, Fei Fang, Si Liu
    IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
    PDF Code

  9. NeurIPS
    MARBLE: Music Audio Representation Benchmark for Universal Evaluation
    Ruibin Yuan*, Yinghao Ma*, Yizhi Li*, Ge Zhang*, Xingran Chen, Hanzhi Yin, Le Zhuo, Yiqi Liu, Jiawen Huang, Zeyue Tian, Binyue Deng, Ningzhi Wang, Chenghua Lin, Emmanouil Benetos, Anton Ragni, Norbert Gyenge, Roger Dannenbert, Wenhu Chen, Gus Xia, Wei Xue, Si Liu, Shi Wang, Ruibo Liu, Yike Guo, Jie Fu
    Neural Information Processing Systems (NeurIPS), 2023.
    PDF Code Project Page

  10. ISMIR
    LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPT
    Le Zhuo, Ruibin Yuan, Jiahao Pan, Yizhi Li, Ge Zhang, Jiawen Huang, Si Liu, Roger Dannenberg, Jie Fu, Chenghua Lin, Emmanouil Benetos, Wenhu Chen, Wei Xue, Yike Guo
    International Society for Music Information Retrieval (ISMIR), 2023.
    PDF Code

Services

Conference Reviewers