xiaoheng-zhang99 Goto Github PK

kingformatty-privacy-preserving-depression-classification-based-on-speech

langchain-chinese-getting-started-guide

LangChain 的中文入门教程

lavis

LAVIS - A One-stop Library for Language-Vision Intelligence

learning_alignement

Chinese BERT classification with tf2.0 and audio classification with mfcc

low-rank-multimodal-fusion

This is the repository for "Efficient Low-rank Multimodal Fusion with Modality-Specific Factors", Liu and Shen, et. al. ACL 2018

mcse

NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings

meca

medclip

Medical image captioning using OpenAI's CLIP

medclip-1

A multi-modal CLIP model trained on the medical dataset ROCO

medclip-2

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts

meld

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

meld-sentiment-speech-emotion-recognition

Multimodal EmotionLines Dataset (MELD) has been created by enhancing and extending EmotionLines dataset. MELD contains the same dialogue instances available in EmotionLines, but it also encompasses audio and visual modality along with text. MELD has more than 1400 dialogues and 13000 utterances from Friends TV series.

mental-health

Repository containing code for my internship at Valencia Polytechnic University (summer 2021)

mhyeeg

Official PyTorch repository for Hypercomplex Multimodal Emotion Recognition from EEG and Peripheral Physiological Signals, ICASSPW 2023.

mimic-cxr

Code, documentation, and discussion around the MIMIC-CXR database

mkgformer

Code for the SIGIR 2022 paper "Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completion"

mlp

mm-dfn

Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in Conversations"

mmemotionrecognition

Repository with the code of the paper: A proposal for Multimodal Emotion Recognition using auraltransformers and Action Units on RAVDESS dataset

mmft-bert

mmgcn

mmtransformer

[CVPR 2021] "Multimodal Motion Prediction with Stacked Transformers": official code implementation and project page.

moco-cxr

MoCo-based unsupervised training for Chest X-Ray Interpretation

moel

MoEL: Mixture of Empathetic Listeners

mosei_umons

A Transformer-based joint-encoding for Emotion Recognition and Sentiment Analysis

mpuc-mer

msvd-tl

Multi-Speaker Video Dialog with Frame-Level Temporal Localization

mtl4depr

Source code for paper Multi-Task Learning for Depression Detection in Dialogs (SIGDial 2022)

multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

multimodal-emotion-recognition

A real time Multimodal Emotion Recognition web app for text, sound and video inputs