Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
Marco Gaido cba35cdbca | 1 year ago | |
---|---|---|
.. | ||
configs | 2 years ago | |
criterions | 2 years ago | |
data | 2 years ago | |
docs | 1 year ago | |
models | 2 years ago | |
scripts | 2 years ago | |
tasks | 1 year ago | |
README.md | 2 years ago | |
__init__.py | 2 years ago |
An extension of Fairseq s2t project with the speech to text task enhanced by the co-trained text to text mapping task. More details about Fairseq s2t can be found here
Examples of speech text joint training in fairseq
Please cite as:
@inproceedings{Tang2022UnifiedSP,
title={Unified Speech-Text Pre-training for Speech Translation and Recognition},
author={Yun Tang and Hongyu Gong and Ning Dong and Changhan Wang and Wei-Ning Hsu and Jiatao Gu and Alexei Baevski and Xian Li and Abdelrahman Mohamed and Michael Auli and Juan Miguel Pino},
booktitle={ACL},
year={2022}
}
@inproceedings{Tang2021IST,
title = {Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task},
author = {Yun Tang and Juan Pino and Xian Li and Changhan Wang and Dmitriy Genzel},
booktitle = {ACL},
year = {2021},
}
@inproceedings{Tang2021FST,
title = {FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task},
author = {Yun Tang and Hongyu Gong and Xian Li and Changhan Wang and Juan Pino and Holger Schwenk and Naman Goyal},
booktitle = {IWSLT},
year = {2021},
}
@inproceedings{Tang2021AGM,
title={A General Multi-Task Learning Framework to Leverage Text Data for Speech to Text Tasks},
author={Yun Tang and J. Pino and Changhan Wang and Xutai Ma and Dmitriy Genzel},
booktitle={ICASSP},
year={2021}
}
@inproceedings{wang2020fairseqs2t,
title = {fairseq S2T: Fast Speech-to-Text Modeling with fairseq},
author = {Changhan Wang and Yun Tang and Xutai Ma and Anne Wu and Dmytro Okhonko and Juan Pino},
booktitle = {Proceedings of the 2020 Conference of the Asian Chapter of the Association for Computational Linguistics (AACL): System Demonstrations},
year = {2020},
}
@inproceedings{ott2019fairseq,
title = {fairseq: A Fast, Extensible Toolkit for Sequence Modeling},
author = {Myle Ott and Sergey Edunov and Alexei Baevski and Angela Fan and Sam Gross and Nathan Ng and David Grangier and Michael Auli},
booktitle = {Proceedings of NAACL-HLT 2019: Demonstrations},
year = {2019},
}
No Description
Python Cuda C++ Cython Markdown other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》