• Hongxia Xie (谢洪霞)

    Jilin University

    I am an associate professor (tenure-track) in the College of Computer Science and Technology at Jilin University, China, and serve as the principal investigator of the Affective Vision and Computing (AVC) Lab. My research interests include multimodal affective computing and generative AI. Our mission is to bridge the affective gap between machines and humans. I received my Ph.D. degree from the Institute of Electronics of National Yang Ming Chiao Tung University (NYCU) under the supervision of Prof. Wen-Huang Cheng (IEEE Fellow) and the co-supervision of Prof. Hong-Han Shuai. Over the past five years, I have published nearly 20 academic papers in top-tier venues such as CVPR, ICCV, ECCV, ACM Multimedia, AAAI, IEEE Transactions on Affective Computing, and IEEE Transactions on Cybernetics. One of my papers also received the Best Paper Award at IEEE ICME 2021.

    🔥News

    • 🔥[2026/07]: We have released our survey on Social World Models, which introduces a three-level analytical framework covering Individual Agency, Mental Inference, and Social Coordination. The survey provides a comprehensive review of representative methods, datasets, and benchmarks across embodied intelligence, Theory of Mind, affective computing, human–robot collaboration, and multi-agent social coordination. We warmly invite you to explore the full survey at the link: https://github.com/avclabjlu/Awesome-Social-World-Models. We hope it will serve as a useful resource for researchers interested in socially intelligent AI.
    • 🔥[2026/03]: We launch the AffectiveArt 2026: Fine-Grained Emotion Understanding & Generation in Artistic Images Grand Challenge at ACM MM 2026. For details, please visit affectiveart-challenge.github.io. We warmly welcome your participation.
    • 🔥[2026/02]: Four papers got accepted by CVPR 2026 🎉
    • 🔥[2025/12]: One paper got accepted by AAAI 2026 🎉
    • 🔥[2025/07]: Two papers got accepted by ACM Multimedia 2025 (Datasets Track) 🎉
    • 🔥[2025/07]: One paper got accepted by ACM Multimedia 2025 🎉
    • 🔥[2025/07]: One paper got accepted by ICCV 2025 🎉
    • 🔥[2025/01]: I am awarded the Leading Talent Title by Jilin Province Government, China 🎉
    • 🔥[2024/12]: One paper got accepted by AAAI 2025 🎉
    • 🔥[2024/11]: I will serve as the Grand Challenge Co-chairs of ACM Multimedia 2025 🎉
    • 🔥[2024/08]: I receive the Youth Project Funding from National Natural Science Foundation of China (funding rate of 15.54%) 🎉
    • 🔥[2024/07]: I won the Best Poster Award in China Affective Computing Conference 🎉
    • 🔥[2024/07]: One paper got accepted by ECCV 2024 🎉
    • 🔥[2024/04]: One paper got accepted by ACM Computing Survey 🎉
    • 🔥[2024/02]: One paper got accepted by CVPR 2024 🎉
    • 🔥[2023/10]: One paper got accepted by ICCE 2024 🎉
    • 🔥[2023/07]: One paper got accepted by ICCV 2023 🎉
    • 🔥[2023/06]: One paper got accepted by IEEE Transactions on Affective Computing 🎉

    🔥Enrollment Quota Notice:

    • My PhD positions for 2026 are already filled. There will be 1–2 positions available for the 2027 Fall. Interested students are welcome to contact me via email.
    • There are 3 master’s openings for the 2027 Fall.
    • Remote research assistants are welcome.
  • 添加一个应用工具

    或者你可以输入 HTML 代码(专业版以上功能)

    Affective Vision Computing Lab

    Intelligence that understands people and the physical world.

    We develop human-centered AI that connects emotion, social reasoning, and realistic visual generation. Led by Associate Professor Hongxia Xie at Jilin University, AVC Lab studies how intelligent systems can understand people, create expressive visual experiences, and act in the world.

    College of Computer Science and Technology
    Jilin University · Changchun, China

    Understanding people.
    Connecting perception, reasoning, and action.

    From the lab

    News.

    Research milestones, awards, and community activities.

    1. We have released our survey on Social World Models, which introduces a three-level analytical framework covering Individual Agency, Mental Inference, and Social Coordination. The survey provides a comprehensive review of representative methods, datasets, and benchmarks across embodied intelligence, Theory of Mind, affective computing, human–robot collaboration, and multi-agent social coordination. We warmly invite you to explore the full survey at the link: https://github.com/avclabjlu/Awesome-Social-World-Models. We hope it will serve as a useful resource for researchers interested in socially intelligent AI.

    2. Mind-CAD was accepted by Computer-Aided Design and is now available online. Read the paper ↗

    3. We launch the AffectiveArt 2026: Fine-Grained Emotion Understanding & Generation in Artistic Images Grand Challenge at ACM MM 2026. For details, please visit affectiveart-challenge.github.io. We warmly welcome your participation.

    4. Four papers got accepted by CVPR 2026 🎉

    5. One paper got accepted by AAAI 2026 🎉

    6. Two papers got accepted by ACM Multimedia 2025 (Datasets Track) 🎉

    7. One paper got accepted by ACM Multimedia 2025 🎉

    8. One paper got accepted by ICCV 2025 🎉

    9. I am awarded the Leading Talent Title by Jilin Province Government, China 🎉

    10. One paper got accepted by AAAI 2025 🎉

    11. I will serve as the Grand Challenge Co-chairs of ACM Multimedia 2025 🎉

    12. I receive the Youth Project Funding from National Natural Science Foundation of China (funding rate of 15.54%) 🎉

    13. I won the Best Poster Award in China Affective Computing Conference 🎉

    14. One paper got accepted by ECCV 2024 🎉

    15. One paper got accepted by ACM Computing Survey 🎉

    16. One paper got accepted by CVPR 2024 🎉

    17. One paper got accepted by ICCE 2024 🎉

    18. One paper got accepted by ICCV 2023 🎉

    19. One paper got accepted by IEEE Transactions on Affective Computing 🎉

    01 / Research

    Four connected directions.

    Our research connects four areas, from understanding human emotions and intentions to generating coherent visual content and improving embodied decision-making.

    01

    Physical AI

    We study social world models, theory of mind, and embodied agents that connect perception, reasoning, and action. Our work asks how machines can infer beliefs and intentions, reason about physical processes, and perform tasks with greater consistency and care.

    Explore MindPower →
    02

    Realistic Generation

    We develop controllable visual generation across artistic images, human relighting, and multimodal design. We focus on the relationship between visual detail, physical consistency, and human intent.

    Explore KPLM-STA →
    03

    Human-Centered AI

    We build models and benchmarks for emotion understanding, affective reasoning, and reliable multimodal interpretation. Our goal is to help intelligent systems understand the rich context behind human expression.

    Explore EmoVIT →
    04

    AI for Science

    We investigate multimodal generation for structured, real-world processes, with a current focus on food computing. Our research links written instructions to coherent visual sequences and step-aligned evaluation.

    Explore RecipeGen →
    Research vision

    From seeing to understanding to acting, we build emotionally intelligent multimodal AI.

    Our research enables machines to perceive affect, reason about mental states, and generate socially coherent decisions and behaviors.

    AVC Lab research vision

    Projects & open resources

    MindPower (CVPR 2026) — research overview

    MindPower (CVPR 2026)

    Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents

    Project Page ↗
    EmoArt (ACM MM 2025) — research overview

    EmoArt (ACM MM 2025)

    A Multidimensional Dataset for Emotion-Aware Artistic Generation

    Project Page ↗
    Additional project figure
    EmoArt (ACM MM 2025) — additional project figure
    CookAnything (ACM MM 2025) — research overview

    CookAnything (ACM MM 2025)

    A Framework for Flexible and Consistent Multi-Step Recipe Image Generation

    Project Page ↗
    Awesome Social World Models — research overview

    Awesome Social World Models

    A Comprehensive Survey of Theory of Mind and Social Coordination

    Paper List ↗
    02 / Selected publications

    Ideas, made concrete.

    Selected research from AVC Lab and collaborators.
    Explore the papers, methods, datasets, and open resources behind our work.
    Full publication list ↓

    1. CVPR 2026

      MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents

      Connecting perception, mental-state reasoning, and action in socially aware embodied agents.

      Authors & publication details

      Ruoxuan Zhang, Qiyun Zheng, Zhiyu Zhou, Ziqi Liao, Siyu Wu, Jian-Yu Jiang-Lin, Bin Wen, Hongxia Xie, Jianlong Fu, Wen-Huang Cheng.

      CVPR 2026, pp. 29631–29641.
      Hongxia Xie: corresponding author.

    2. AAAI 2026

      KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light Modeling

      Physically grounded shadows for human relighting through body keypoints and explicit light geometry.

      Authors & publication details

      Xinhui Yin, Qifei Li, Yilin Guo, Hongxia Xie, Xiaoli Zhang.

      AAAI 2026, 40(14), pp. 12036–12043.
      Hongxia Xie and Xiaoli Zhang: corresponding authors.

    3. ACM MM 2025Datasets Track

      EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generation

      A structured artwork dataset connecting visual attributes, emotion, and artistic generation.

      Authors & publication details

      Cheng Zhang, Hongxia Xie, Bin Wen, Songhan Zuo, Ruoxuan Zhang, Wen-Huang Cheng.

      ACM Multimedia 2025, Datasets Track, pp. 12644–12650.
      Hongxia Xie: corresponding author.

    4. ACM MM 2025Datasets Track

      RecipeGen: A Step-Aligned Multimodal Benchmark for Real-World Recipe Generation

      Step-aligned recipes, images, and videos for evaluating faithful multimodal recipe generation.

      Authors & publication details

      Ruoxuan Zhang, Jidong Gao, Bin Wen, Hongxia Xie, Chenming Zhang, Hong-Han Shuai, Wen-Huang Cheng.

      ACM Multimedia 2025, Datasets Track, pp. 12659–12665.
      Hongxia Xie: corresponding author.

    5. ACM MM 2025

      CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation

      Flexible recipe illustration that aligns each step with its image while maintaining consistency across the sequence.

      Authors & publication details

      Ruoxuan Zhang, Bin Wen, Hongxia Xie, Yi Yao, Songhan Zuo, Jian-Yu Jiang-Lin, Hong-Han Shuai, Wen-Huang Cheng.

      ACM Multimedia 2025, pp. 7854–7863.
      Hongxia Xie: corresponding author.

    6. CVPR 2024

      EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning

      Visual instruction tuning for emotion classification, affective reasoning, and humor understanding.

      Authors & publication details

      Hongxia Xie, Chu-Jun Peng, Yu-Wen Tseng, Hung-Jen Chen, Chan-Feng Hsu, Hong-Han Shuai, Wen-Huang Cheng.

      CVPR 2024, pp. 26596–26605.
      Hongxia Xie: first author.

    7. CVPR 2026Collaboration

      Beyond Success: Refining Elegant Robot Manipulation from Mixed-Quality Data via Just-in-Time Intervention

      Improving robot execution quality through selective interventions without retraining the base policy.

      Authors & publication details

      Yanbo Mao, Jianlong Fu, Ruoxuan Zhang, Hongxia Xie, Meibao Yao.

      CVPR 2026, pp. 13508–13518.
      Hongxia Xie: coauthor. Meibao Yao: corresponding author.

    8. CVPR 2026Collaboration

      CAD-Refiner: A Unified Framework for CAD Generation and Iterative Editing

      A unified approach to multimodal CAD generation and iterative refinement.

      Authors & publication details

      Meng Yuan, Dawei Lin, Hongxia Xie, Tieru Wu, Rui Ma.

      CVPR 2026, pp. 3244–3253.
      Hongxia Xie: coauthor. Tieru Wu and Rui Ma: corresponding authors.

    Recent preprints

    Early research, shared with the community.

    JULY 2026
    arXiv preprint

    RetroHolmes: When Semantic Plausibility Fails Retrospective Physical Process Reasoning

    A benchmark for reasoning backward from visual outcomes under physical constraints.

    Ruoxuan Zhang, Qiyun Zheng, Siyu Wu, Ling Zou, Hongxia Xie, Zhiyu Zhou, Jian-Yu Jiang-Lin, Zihan Li, Zhengguang Wang, Bin Wen, Ling Lo, Jianlong Fu, Meibao Yao, Juncheng Hu, Wen-Huang Cheng.

    Read preprint ↗
    APRIL 2026
    arXiv preprint

    Aligning Progress and Feasibility: A Neuro-Symbolic Dual Memory Framework for Long-Horizon LLM Agents

    A dual-memory framework separating semantic progress guidance from logical action validation.

    Bin Wen, Ruoxuan Zhang, Yang Chen, Hongxia Xie, Lan-Zhe Guo.

    Read preprint ↗
    Survey & curated resource

    Social World Models

    A survey and curated reading list connecting individual agency, mental-state inference, emotion, and social coordination.

    Explore the resource ↗
    ACM Multimedia 2026 Grand Challenge

    AffectiveArt 2026

    Fine-grained emotion understanding and generation in artistic images. Challenge results and resources are available.

    View results & resources ↗
    Publication archive

    Full publication list.

    Journal articles and conference papers, including the complete publication list from Hongxia Xie's homepage.

    Google Scholar ↗
    Journal articles6 publications
    1. J01

      Mind-CAD: An interpretable multimodal framework for image-guided CAD DSL generation and editing

      Meng Yuan, Dawei Lin, Hongxia Xie, Tieru Wu, Rui Ma.

      Computer-Aided Design, vol. 199, Article 104126, 2026. Published online June 15, 2026.

    2. J02

      Lightweight Deep Learning for Resource-Constrained Environments: A Survey

      Hou-I Liu, Marco Galindo, Hongxia Xie, Lai-Kuan Wong, Hong-Han Shuai, Yung-Hui Li, Wen-Huang Cheng.

      ACM Computing Surveys, 56(10), Article 267, 2024.

    3. J03

      An Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge

      Hongxia Xie, Ling Lo, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE Transactions on Affective Computing, 2022. DOI: 10.1109/TAFFC.2022.3143100.

    4. J04

      CA-FER: Mitigating Spurious Correlation With Counterfactual Attention in Facial Expression Recognition

      Pin-Jui Huang*, Hongxia Xie*, Hung-Cheng Huang, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE Transactions on Affective Computing, 15(3), pp. 977–989, 2024. DOI: 10.1109/TAFFC.2023.3312768. * Equal contribution.

    5. J05

      Facial Chirality: From Visual Self-Reflection to Robust Facial Feature Learning

      Ling Lo, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE Transactions on Multimedia, vol. 24, pp. 4275–4284, 2022. DOI: 10.1109/TMM.2022.3197365.

    6. J06

      Specific Expert Learning: Enriching Ensemble Diversity via Knowledge Distillation

      W.-C. Kao, H.-X. Xie, C.-Y. Lin, and W.-H. Cheng.

      IEEE Transactions on Cybernetics, pp. 1–12, 2021. DOI: 10.1109/TCYB.2021.3125320.

    Conference papers19 publications
    1. C01

      MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents

      Ruoxuan Zhang, Qiyun Zheng, Zhiyu Zhou, Ziqi Liao, Siyu Wu, Jian-Yu Jiang-Lin, Bin Wen, Hongxia Xie, Jianlong Fu, Wen-Huang Cheng.

      CVPR 2026, pp. 29631–29641.

    2. C02

      Beyond Success: Refining Elegant Robot Manipulation from Mixed-Quality Data via Just-in-Time Intervention

      Yanbo Mao, Jianlong Fu, Ruoxuan Zhang, Hongxia Xie, Meibao Yao.

      CVPR 2026, pp. 13508–13518.

    3. C03

      CAD-Refiner: A Unified Framework for CAD Generation and Iterative Editing

      Meng Yuan, Dawei Lin, Hongxia Xie, Tieru Wu, Rui Ma.

      CVPR 2026, pp. 3244–3253.

    4. C04

      TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection

      Jian-Yu Jiang-Lin, Kang-Yang Huang, Ling Zou, Ling Lo, Sheng-Ping Yang, Yu-Wen Tseng, Kun-Hsiang Lin, Chia-Ling Chen, Yu-Ting Ta, Yan-Tsung Wang, Po-Ching Chen, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026.

    5. C05

      KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light Modeling

      Xinhui Yin, Qifei Li, Yilin Guo, Hongxia Xie, Xiaoli Zhang.

      AAAI 2026, 40(14), pp. 12036–12043.

    6. C06

      EmoArt: A Multidimensional Dataset for Emotion-Aware Artistic Generation

      Cheng Zhang, Hongxia Xie, Bin Wen, Songhan Zuo, Ruoxuan Zhang, Wen-Huang Cheng.

      ACM Multimedia 2025, Datasets Track, pp. 12644–12650.

    7. C07

      RecipeGen: A Step-Aligned Multimodal Benchmark for Real-World Recipe Generation

      Ruoxuan Zhang, Jidong Gao, Bin Wen, Hongxia Xie, Chenming Zhang, Hong-Han Shuai, Wen-Huang Cheng.

      ACM Multimedia 2025, Datasets Track, pp. 12659–12665.

    8. C08

      CookAnything: A Framework for Flexible and Consistent Multi-Step Recipe Image Generation

      Ruoxuan Zhang, Bin Wen, Hongxia Xie, Yi Yao, Songhan Zuo, Jian-Yu Jiang-Lin, Hong-Han Shuai, Wen-Huang Cheng.

      ACM Multimedia 2025, pp. 7854–7863.

    9. C09

      Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation

      Jhe-Hao Lin, Yi Yao, Chan-Feng Hsu, Hong-Xia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE/CVF International Conference on Computer Vision (ICCV), pp. 4178–4187, 2025.

    10. C10

      Foreground Focus: Enhancing Coherence and Fidelity in Camouflaged Image Generation

      Pei-Chi Chen, Yi Yao, Chan-Feng Hsu, HongXia Xie, Hung-Jen Chen, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE International Conference on Multimedia and Expo (ICME), 2025. Oral presentation.

    11. C11

      Future Sight and Tough Fights: Revolutionizing Sequential Recommendation with FENRec

      Yu-Hsuan Huang, Ling Lo, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      AAAI Conference on Artificial Intelligence, 39(11), pp. 11826–11834, 2025.

    12. C12

      The Fabrication of Reality and Fantasy: Scene Generation with LLM-Assisted Prompt Interpretation

      Yi Yao, Chan-Feng Hsu, Jhe-Hao Lin, Hongxia Xie, Terence Lin, Yi-Ning Huang, Hong-Han Shuai, Wen-Huang Cheng.

      European Conference on Computer Vision (ECCV), 2024.

    13. C13

      EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning

      Hongxia Xie, Chu-Jun Peng, Yu-Wen Tseng, Hung-Jen Chen, Chan-Feng Hsu, Hong-Han Shuai, Wen-Huang Cheng.

      CVPR 2024, pp. 26596–26605.

    14. C14

      Most Important Person-Guided Dual-Branch Cross-Patch Attention for Group Affect Recognition

      Hongxia Xie, Ming-Xian Lee, Tzu-Jui Chen, Hung-Jen Chen, Hou-I Liu, Hong-Han Shuai, Wen-Huang Cheng.

      IEEE/CVF International Conference on Computer Vision (ICCV), 2023.

    15. C15

      AU-Assisted Graph Attention Convolutional Network for Micro-Expression Recognition

      Hongxia Xie, Ling Lo, Hong-Han Shuai, Wen-Huang Cheng.

      in Proceedings of the 28th ACM International Conference on Multimedia (MM), 2020, pp. 2871–2880.

    16. C16

      Learning to Prompt for Vision-Language Emotion Recognition

      H.-X. Xie, H. Zhong, H.-H. Shuai, and W.-H. Cheng.

      in Affective Computing and Intelligent Interaction (ACII), AHRI workshop, 2023.

    17. C17

      Refining Valence Arousal Estimation With Dual-Stream Label Density Smoothing

      H.-X. Xie, I.-H. Li, L. Ling, H.-H. Shuai, and W.-H. Cheng.

      in International Conference on Consumer Electronics (ICCE), 2024.

    18. C18

      Facial Chirality: Using Self-Face Reflection to Learn Discriminative Features for Facial Expression Recognition

      Ling Lo, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      in 2021 IEEE International Conference on Multimedia and Expo (ICME), IEEE,2021, pp. 1–6.

    19. C19

      MER-GCN: Micro-Expression Recognition Based on Relation Modeling With Graph Convolutional Networks

      Ling Lo, Hongxia Xie, Hong-Han Shuai, Wen-Huang Cheng.

      in 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), IEEE, 2020, pp. 79–84.

    03 / People
    Hongxia Xie / 谢洪霞

    Hongxia Xie谢洪霞

    Principal Investigator, AVC Lab
    Associate Professor · Jilin University

    hongxiaxie@jlu.edu.cn ↗

    Hongxia Xie is an Associate Professor in the College of Computer Science and Technology at Jilin University and the principal investigator of AVC Lab. Her research spans affective computing, multimodal learning, generative AI, and socially aware embodied intelligence.

    She received her Ph.D. from National Yang Ming Chiao Tung University, advised by Wen-Huang Cheng and co-advised by Hong-Han Shuai.

    Our group combines close mentorship, open discussion, and careful experimentation. We welcome curious researchers who want to connect human understanding with advances in visual and embodied intelligence.

    Ph.D. students

    Master's students

    • Zihan Li李子涵Fall 2025
    • Yusen Xie谢玉森Fall 2025
    • Mengyuan Wang王梦圆Fall 2026
    • Jiaqi Shen沈佳琪Fall 2026
    • Yiming Chen陈一鸣Fall 2026

    Undergraduate students

    • Qiyun Zheng郑淇匀2025–2026
    • Ziqi Liao廖梓琪2025–2026
    • Siyu Wu吴思雨2025–2026
    • Zeyu Liang梁泽宇2025–2026
    • Zhengguang Wang王争光Undergraduate student
    • Chenghao Yu俞诚浩Undergraduate student
    • Yifan Duan段逸凡Undergraduate student

    Alumni

    Teaching

    • Cutting-Edge Research Introduction in Computer ScienceSpring 2024–2026
    • Introduction to Artificial IntelligenceFall 2024 & 2025
    • Pattern RecognitionSpring 2026
    Academic service8 roles
    • Tutorial Co-chairChinese Conference on Affective Computing (CCAC) 2026
    • Digital Media Chair12th IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and 12th IEEE International Conference on Robotics, Automation and Mechatronics (RAM), 2026
    • Grand Challenge Co-chairACM Multimedia 2025
    • Technical Committee MemberIEEE Consumer Technology Society (CTSoc)
    • Executive Committee MemberMultimedia Technical Committee of the China Computer Federation (CCF-MM)
    • Web ChairIEEE ICME 2022
    • Web ChairACM ICMR 2021
    • ReviewerECCV 2026; CVPR 2024–2026; ACM Multimedia 2021–2026; ICME 2021–2024; IEEE Transactions on Image Processing (TIP); IEEE Transactions on Multimedia (TMM); ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM).
    04 / Tutorials

    Tutorials for beginners.

    Research training and learning resources from AVC Lab.

    Our lab’s official WeChat account is AVCLab_JLU. We regularly share accessible insights into our latest research progress. Feel free to follow us!

    We provide regular training sessions for beginners, covering topics such as basic deep learning concepts, diffusion models, and more.

    We provide research training for freshmen, and the related resources are available on our bilibili website.

    Tutorial videos

    Chinese-language recordings

    If you have any questions, please get in touch with us by email: hongxiaxie@jlu.edu.cn

    05 / Talks

    Invited talks.

    Research perspectives, practical AI education, and conversations with the wider community.

    1. 2026/05

      MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents

      invited talk at the China Society of Image and Graphics (CSIG) Paper Sharing Seminar, hosted by Harbin Institute of Technology, China.

    2. 2026/03

      Hands-On Experience with OpenClaw in Academic Research and Teaching Management

      invited talk at the College of Automotive Engineering, Jilin University, China.

    3. 2025/12

      Towards Building Mind-Reading Embodied Agents

      invited talk at CSIG Affective Intelligence Conference 2025, Shenzhen, China.

    4. 2025/11

      Emotion, Art, and Mind: A New Journey of Affective Computing in the Era of Large Models

      invited talk at CIPS-SMP 2025, Wuhan, China.

    5. 2025/10

      Seeing with Feeling: Visual Emotion Understanding in the LLM Era

      Keynote Speaker at MRAC’25: Affective Computing Meets Large Language Models Workshop, ACM Multimedia 2025, Dublin, Ireland.

    6. 2025/07

      CookAnything: Teaching Models to Cook Visually Step by Step

      invited by Prof. Tan Yap Peng, NTU, Singapore.

    7. 2025/03–07

      Innovative Applications of DeepSeek and Large Models for Enhancing Grassroots Work Efficiency

      (DeepSeek等大模型提升基层工作效率的创新应用), invited talk at the “On-Site Training” Special Program for Community Workers organized by the Central Social Work Department of China (中央社会工作部(中社部)“送课上门”社区工作者专项培训(呼和浩特、西安、兴安盟、延安)

    8. 2025/06

      AI Tools for Empowering Efficient Teaching

      invited by Liwang Primary School, China.

    9. 2025/05

      From DeepSeek to Deep Research: Paradigm Shifts in Scientific Inquiry Driven by Large Models

      invited talk at the School of Business and Management, Jilin University, China.

    10. 2025/03

      AI-Enabled Intelligent Office Transformation

      invited talk at the Talent Affairs Office of Jilin University, China.

    11. 2025/03

      LLMs Empowering Financial Intelligence: Innovative Applications for Enhancing Financial Office Efficiency

      invited talk at the Finance Department of The First Bethune Hospital of Jilin University.

    12. 2025/03

      A Tutorial to Core Technologies and Practical Applications of LLMs

      invited talk at Jiaxin Technology, China.

    13. 2025/02

      Visual Emotion Understanding: Opportunities and Challenges in the LLM Era

      invited by Prof.Sanghoon Lee, Yonsei University, Korea.

    14. 2025/02

      DeepSeek Technical Insights and Applying LLMs for Teaching Empowerment

      Computer Science Faculty Teaching and Educational Capacity Enhancement Series Talks, Jilin University, China.

    06 / Join us

    Help shape what comes next.

    Prospective students, research assistants, and collaborators are welcome. If our research resonates with your interests, we would be glad to hear from you.

    FALL 2027 OPPORTUNITIES

    1–2 Ph.D. openings · 3 master's openings

    Remote research assistants welcome.

    Contact Hongxia Xie → hongxiaxie@jlu.edu.cn
  • Publication

    For a full paper list, please refer to the Google Scholar page.

    Journal

    • H.-I. Liu, Galindo, M., H.-X. Xie, L.-K. Wong, H.-H. Shuai, and W.-H. Cheng, "Lightweight Deep Learning for Resource-Constrained Environments: A Survey", ACM Computing Surveys, 2024. [PDF]
    • H.-X. Xie, L. Lo, H.-H. Shuai, and W.-H. Cheng, “An overview of facial micro-expression analysis: Data, methodology and challenge,” IEEE Transactions on Affective Computing, pp. 1–1, 2022. DOI: 10.1109/TAFFC.2022.3143100. [PDF]
    • P.-J. Huang*, H.-X. Xie*, H.-C. Huang, H.-H. Shuai, and W.-H. Cheng, “CA-FER: Mitigating spurious correlation with counterfactual attention in facial expression recognition,” IEEE Transactions on Affective Computing, (* means equal contribution). DOI: 10.1109/TAFFC.2023.3312768. [PDF]
    • L. Lo, H.-X. Xie, H.-H. Shuai, and W.-H. Cheng, “Facial chirality: From visual self-reflection to robust facial featurelearning,” IEEE Transactions on Multimedia, vol. 24, pp. 4275–4284, 2022. DOI: 10.1109/TMM.2022.3197365. [PDF]
    • W.-C. Kao, H.-X. Xie, C.-Y. Lin, and W.-H. Cheng, “Specific expert learning: Enriching ensemble diversity via knowledge distillation,” IEEE Transactions on Cybernetics, pp. 1–12, 2021. DOI: 10.1109/TCYB.2021.3125320. [PDF]

    Conference

    • R.-X Zhang, Q.-Y. Zheng, Z.-Z Zhou, Z.-Q Liao, S.-Y Wu, J.-Y. Jiang-Lin, B. Wen, H.-X. Xie*, J.-L Fu, and W.-H. Cheng, “MindPower: Enabling Theory-of-Mind Reasoning in VLM-based Embodied Agents”, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026. [PDF] [论文中文解读]
    • Y.-B Mao, J.-L Fu, R.-X Zhang, H.-X. Xie, and M.-B Yao, “Beyond Success: Refining Elegant Robot Manipulation from Mixed-Quality Data via Just-in-Time Intervention”, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026. [PDF]
    • M. Yuan, D.-W Lin, H.-X. Xie, T.-R Wu, and R. Ma, “CAD-Refiner: A Unified Framework for CAD Generation and Iterative Editing”, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
    • J.-Y. Jiang-Lin, K.-Y. Huang, L. Zou, L. Lo, S.-P. Yang, Y.-W. Tseng, K.-H. Lin, C.-L. Chen, Y.-T. Ta, Y.-T. Wang, P.-C. Chen, H.-X. Xie, H.-H. Shuai, and W.-H. Cheng, “TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection”, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026.
    • X.-H. Yin, Q.-F. Li, Y.-L. Guo, H.-X. Xie*, X.-L. Zhang* ,“KPLM-STA: Physically-Accurate Shadow Synthesis for Human Relighting via Keypoint-Based Light Modeling”, AAAI Conference on Artificial Intelligence (AAAI), 2026.
    • C. Zhang, H.-X. Xie*, B. Wen, S.-H. Zuo, R.-X Zhang, and W.-H.Cheng, “EmoArt: AMultidimensional Dataset for Emotion-Aware Artistic Generation”, in Proceedings of the ACM International Conference on Multimedia , Dataset Track, 2025. [论文中文解读]
    • R.-X Zhang, J.-D. Gao, B. Wen, H.-X. Xie*, C.-M, Zhang, H.-H. Shuai, and W.-H. Cheng, “RecipeGen: A Step-Aligned Multimodal Benchmark for Real-World Recipe Generation”, in Proceedings of the ACM International Conference on Multimedia, Dataset Track, 2025.【论文中文解读】
    • R.-X Zhang, B. Wen, H.-X. Xie*, Y. Yao, S.-H. Zuo, J.-L.-J.-Y, H.-H. Shuai, and W.-H. Cheng, “CookAnything: A Framework forFlexible and Consistent Multi-Step Recipe Image Generation”, in Proceedings of the ACM International Conference on Multimedia, 2025.【论文中文解读】
    • J.-H Lin, Y. Yao, C.-F., Hsu, H.-X. Xie, H.-H.Shuai, and W.-H. Cheng, “Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation”, In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2025.
    • P.-C Chen, Y. Yao, H.-X. Xie, H.-J. Chen, H.-H. Shuai,and W.-H. Cheng, “Foreground Focus: Enhancing Coherence and Fidelity in Camouflaged ImageGeneration”, in Proceedings of the IEEE InternationalConference on Multimedia and Expo (ICME), 2025. (Oral)
    • Y.-H. Huang, L. Ling, H.-X. Xie, H.-H. Shuai, and W.-H. Cheng, "Future Sight and Tough Fights: Revolutionizing Sequential Recommendation with FENRec", in Annual AAAI Conference on Artificial Intelligence, 2025.
    • Y. Yao, C.-F. Hsu, J.-H. Lin, H.-X. Xie, et al., "The Fabrication of Reality and Fantasy: Scene Generation with LLM-Assisted Prompt Interpretation", in European Conference on Computer Vision (ECCV), 2024. [PDF]
    • H.-X. Xie, C.-J. Peng, Y.-W. Tseng, et al., “EmoVIT: Revolutionizing emotion insights with visual instruction tuning,” in Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR), 2024. [PDF]
    • H.-X. Xie, M.-X. Lee, T.-J. Chen, et al., “Most important person-guided dual-branch cross-patch attention for group affect recognition,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023. [PDF]
    • H.-X. Xie, L. Lo, H.-H. Shuai, and W.-H. Cheng, “AU-assisted graph attention convolutional network for micro-expression recognition,” in Proceedings of the 28th ACM International Conference on Multimedia (MM), 2020, pp. 2871–2880. [PDF]
    • H.-X. Xie, H. Zhong, H.-H. Shuai, and W.-H. Cheng, “Learning to prompt for vision-language emotion recognition,” in Affective Computing and Intelligent Interaction (ACII), AHRI workshop, 2023. [PDF]
    • H.-X. Xie, I.-H. Li, L. Ling, H.-H. Shuai, and W.-H. Cheng, “Refining valence arousal estimation with dual-stream label density smoothing,” in International Conference on Consumer Electronics (ICCE), 2024. [PDF]
    • L. Lo, H.-X. Xie, H.-H. Shuai, and W.-H. Cheng, “Facial chirality: Using self-face reflection to learn discriminative features for facial expression recognition,” in 2021 IEEE International Conference on Multimedia and Expo (ICME), IEEE,2021, pp. 1–6. [PDF]
    • L. Lo, H.-X. Xie, H.-H. Shuai, and W.-H. Cheng, “MER-GCN: Micro-expression recognition based on relation modeling with graph convolutional networks,” in 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), IEEE, 2020, pp. 79–84. [PDF]
  • Teaching

    • Cutting-Edge Research Introduction in Computer Science (Target student: Master’s and PhD students in the School of Computer Science), 2024 - 2026 Spring.
    • Introduction of Artificial Intelligence (Target student: Freshman), 2024 & 2025 Fall.
    • Pattern Recognition (Target student: Third-year students in the School of Software Engineering), 2026 Spring.

  • Academic Service

    • Tutorial Co-chairs of Chinese Conference on Affective Computing (CCAC) 2026
    • Digital Media Chair of 12th IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and the 12th IEEE International Conference on Robotics, Automation and Mechatronics (RAM), 2026
    • Grand Challenge Co-chairs of ACM Multimedia 2025
    • Technical Committee Member of the IEEE Consumer Technology Society (CTSoc)
    • Executive Committee Member of the Multimedia Technical Committee of the China Computer Federation (CCF-MM)
    • Web Chair of IEEE ICME 2022
    • Web Chair of ACM ICMR 2021
    • Reviewer of ECCV 2026, CVPR 2024-2026, ACM Multimedia 2021-2026, ICME 2021-2024, TIP, TMM, ACM TOMM

  • PI of the AVC Lab

    I lead the Affective and Vision Computing (AVC) Lab starting in 2024. Although it is a newly established team, it is full of energy. Currently, we have about 30 students, most of whom are undergraduates at Jilin University. We recruit research assistants year-round. If you are interested in joining our lab, please feel free to get in touch.