Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
|
|
1 year ago | |
|---|---|---|
| .ipynb_checkpoints | 1 year ago | |
| __pycache__ | 1 year ago | |
| .gitignore | 1 year ago | |
| Omniarch.py | 1 year ago | |
| README.md | 1 year ago | |
| check_func.py | 1 year ago | |
| dataset.py | 1 year ago | |
| dft.py | 1 year ago | |
| llama.py | 1 year ago | |
| run_dynamic_cluster.sh | 1 year ago | |
| train.py | 1 year ago | |
| train_single.py | 1 year ago | |
| utils.py | 1 year ago | |
This is the Repo of paper OmniArch: Building the Foundation Model for Scientific Computing.
Foundation models have revolutionized language modeling, while whether this success is replicated in scientific computing remains unexplored. We present OmniArch, the first prototype aiming at solving multi-scale and multi-physics scientific computing problems with physical alignment. We addressed all three challenges with one unified architecture. Its pre-training stage contains a Fourier Encoder-decoder fading out the disharmony across separated dimensions and a Transformer backbone integrating quantities through temporal dynamics, and the novel PDE-Aligner performs physics-informed fine-tuning under flexible conditions. As far as we know, we first conduct 1D-2D-3D united pre-training on the PDEBench, and it sets not only new performance benchmarks for 1D, 2D, and 3D PDEs but also demonstrates exceptional adaptability to new physics via in-context and zero-shot learning approaches, which supports realistic engineering applications and foresight physics discovery.
mindspore_2_2_cann7_cb2
git clone https://openi.pcl.ac.cn/cty315/mindformers.git
cd mindformers
pip uninstall mindformers
bash build.sh
Single Device Training:
python train_single.py
Distributed Training:
bash run_dynamic_cluster.sh
| Model | Params. | Size | Huawei-Cloud Link | Google Drive |
|---|---|---|---|---|
| OmniArch-PT-Torch | 672.85M | 7.9GB | ckpt | ckpt |
| OmniArch-PT-MindSpore | 672.85M | 7.9GB | ckpt | ckpt |
No Description
Python Markdown Shell
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》