关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
FoundationModel
/
Chinese-LLaMA-Alpaca
mirror of https://github.com/ymcui/Chinese-LLaMA-Alpaca
Not watched
7
1
Fork 4
Code
Releases 12 Wiki Activity
Issues 0 Datasets Model Cloudbrain

Code
/
Wiki

Page: Online conversion with Colab
API Calls
API调用
C Eval performance and script
C Eval评测结果与脚本
FAQ
Home
Inference with Transformers
Integrated with LangChain
Manual Conversion
Model Inference and Deployment
Model Reconstruction
Online conversion with Colab
Pretraining Script
SFT script
System Performance
Training Details
Use privateGPT for multi document QA
Using LlamaChat Interface
llama.cpp Deployment
llama.cpp量化部署
text generation webui
与LangChain进行集成
使用LlamaChat图形界面（macOS）
使用Transformers推理
使用privateGPT进行多文档问答
使用text generation webui搭建界面
在线模型合并与转换
常见问题
我应该选什么模型？
手动模型合并与转换
指令精调脚本
模型合并与转换
模型推理与部署
系统效果
训练细节
预训练脚本
6 Online conversion with Colab
ymcui edited this page 11 months ago

[New] After memory optimization, Colab free users can now convert 7B and 13B models online!

If you are familiar with Google Colab (if you have Pro and higher subscriptions), you can use our written Notebook to combine and quantify models online.

  • Support online conversion of LLaMA/Alpaca model 7B and 13B versions
  • After the run is over, you can download the combined full volume and quantized weights on demand (you can also transfer to your own Google Drive)
  • For specific steps, please move to the Google Colab notebook to view and run it (also available in the notebooks directory, for reference): Open In Colab
Delete Page

Deleting the wiki page 'Online conversion with Colab' cannot be undone. Continue?

No
Yes
Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit