关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
shibing624
/
pycorrector
mirror of https://github.com/shibing624/pycorrector.git
Not watched
1
1
Fork 0
Code
Releases 21 Wiki Activity
Issues 0 Datasets Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
888 Commits
1 Branch
106 MiB
1460 Download
 
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
pycorrector/examples
shibing624 eacef5925d update confusion 2 months ago
..
data update correct result format. 5 months ago
deepcontext update lm max length. 5 months ago
ernie_csc update model predict demo. 5 months ago
evaluate_models update get errors. 5 months ago
gpt update model predict. 5 months ago
kenlm update confusion 2 months ago
macbert update confusion 2 months ago
seq2seq update model predict demo. 5 months ago
t5 update model predict demo. 5 months ago
README.md update readme. 5 months ago

README.md

examples

  • kenlm：Kenlm模型，本项目基于Kenlm统计语言模型工具训练了中文NGram语言模型，结合规则方法、混淆集可以纠正中文拼写错误，方法速度快，扩展性强，效果一般
  • deepcontext：DeepContext模型，本项目基于PyTorch实现了用于文本纠错的DeepContext模型，该模型结构参考Stanford University的NLC模型，2014英文纠错比赛得第一名，效果一般
  • seq2seq：Seq2Seq模型，本项目基于PyTorch实现了用于中文文本纠错的ConvSeq2Seq模型，该模型在NLPCC-2018的中文语法纠错比赛中，使用单模型并取得第三名，可以并行训练，模型收敛快，效果一般
  • t5：T5模型，本项目基于PyTorch实现了用于中文文本纠错的T5模型，使用Langboat/mengzi-t5-base的预训练模型finetune中文纠错数据集，模型改造的潜力较大，效果好
  • ernie_csc：ERNIE_CSC模型，本项目基于PaddlePaddle实现了用于中文文本纠错的ERNIE_CSC模型，模型在ERNIE-1.0上finetune，模型结构适配了中文拼写纠错任务，效果好
  • macbert：MacBERT模型，本项目基于PyTorch实现了用于中文文本纠错的MacBERT4CSC模型，模型加入了错误检测和纠正网络，适配中文拼写纠错任务，效果好
  • gpt：GPT模型，本项目基于PyTorch实现了用于中文文本纠错的ChatGLM/LLaMA模型，模型在中文CSC和语法纠错数据集上finetune，适配中文文本纠错任务，效果好
  • evaluate_models：模型评估，本项目基于SIGHAN2015_test数据集，对各个纠错模型进行评估
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

Text Python other

Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit