CV
Education
- Ph.D. in Computer Science - Emory University, Aug. 2024–Present
- Supervised by Dr. Liang Zhao.
- M.Sc. in Computer Science and Technology - Shandong University, Sep. 2021–June 2024
- Supervised by Prof. Xuemeng Song, co-supervised by Prof. Liqiang Nie.
- B.E. in Physics - Shandong University, Sep. 2016–June 2020
Work Experience
- Multimodal Sarcasm Detection - Team Leader, Feb. 2022–Present
- Proposed a joint model for multi-modal sarcasm detection from both local semantic-guided and global aspects by utilizing mutual enhancement.
- Developed a local semantic-guided incongruity learning module using IoU scores and the knowledge graph ConceptNet5.
- Designed a global incongruity learning module based on the attention mechanism.
- Explored techniques for assessing object relevance in images using FastRCNN to reduce noise for text modalities.
- E-commerce Script Generation for Virtual Streamers - Team Member, Sep. 2021–June 2022
- Researched semi-supervised models, multimodal pre-training models, and knowledge distillation methods.
- Conducted data augmentation and participated in code implementation.
Skills
- Deep Learning Frameworks: PyTorch, TensorFlow
- Research Expertise: Multimodal Learning, NLP, Computer Vision
- Key Techniques: Contrastive Learning, Semi-supervised Learning, Graph Neural Networks
- Programming: Python, C++
- Tools: Scikit-learn, Hugging Face, OpenCV
Publications
- Mutual-enhanced Incongruity Learning Network for Multi-modal Sarcasm Detection.
Yang Qiao, Liqiang Jing, Xuemeng Song, Xiaolin Chen, Lei Zhu, Liqiang Nie. AAAI 2023 (Oral).
Read more
Awards and Honors
- Second Class Scholarship - Shandong University, 2023
- Inspur Social Scholarship - 2023
- AAAI-2023 Student Scholarship - 2023
- Excellent Graduate - Shandong University, 2020
- Outstanding Student Cadre - 2018, 2019
- Third Prize in Shandong Mathematics Contest - 2017
Social and School Activities
- Invited Reviewer for journals: Information Sciences, IEEE TCSVT.
- Teaching Assistant for Circuitry and Electronics Technology Course, Feb. 2022–June 2022.
- Counselor Assistant, Shandong University, Sep. 2020–June 2021.
- Class Monitor, Physics Class, Shandong University, Oct. 2017–June 2020.
Languages
- Mandarin (Native)
- English (IELTS: 7.5)