Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
Mashiro f4f2555324 | 9 months ago | |
---|---|---|
.. | ||
README.md | 9 months ago | |
fsdp_finetune.py | 9 months ago | |
generate.py | 9 months ago |
Note: This example requires PyTorch 2.0+ and MMEngine 0.8.0+.
Install MMEngine
git clone https://github.com/open-mmlab/mmengine.git
cd mmengine
pip install -e . -v
Install third-party dependencies
pip install -U transformers accelerate tokenizers
mkdir data
wget https://raw.githubusercontent.com/tatsu-lab/stanford_alpaca/main/alpaca_data.json -O data/alpaca_data.json
Download model weights from https://huggingface.co/meta-llama/Llama-2-7b-hf
torchrun --nproc-per-node 8 examples/llama2/fsdp_finetune.py data/alpaca_data.json ${model_weights}
python examples/llama2/generate.py ${checkpoints}
No Description
Python Markdown other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》