关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
TAL
/
CTAL
Not watched
9
0
Fork 0
Code
Releases 0 Wiki Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
2 Commits
1 Branch
440 KiB
19 Download
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
CTAL/code
tal bf58aefe54 add ctal 1 year ago
..
calculate_eer.py add ctal 1 year ago
m2p_dataloader.py add ctal 1 year ago
m2p_finetune.py add ctal 1 year ago
m2p_mask.py add ctal 1 year ago
m2p_model.py add ctal 1 year ago
m2p_optimization.py add ctal 1 year ago
m2p_runner.py add ctal 1 year ago
m2p_transfer.py add ctal 1 year ago
run_m2pretrain.py add ctal 1 year ago
run_s-iemocap.py add ctal 1 year ago
run_s-pretrain.py add ctal 1 year ago
run_s-reg-mosei.py add ctal 1 year ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

该算法提出一个新的基于音频和文本的跨模态预训练模型, CTAL。通过大量的音频和文本对的两个代理任务来学习音频和文本之间的模态内和模态间的联系：屏蔽的语言建模和屏蔽的跨模态声学建模。在对多个下游音频和文本任务进行微调后，CTAL 模型在不同任务上有明显的改进，包括情感分类、情绪分析和说话人验证。其中在 IEMOCAP(Emotion Classification) 数据集上WA 达到73.95%，在MOSEI(Sentiment Analysis)上 F1 达到 81.01%。

Text Python

Contributors (2)
All

Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit