merge master into delta_center_dev

This commit is contained in:
shengdinghu 2022-10-10 08:30:01 +00:00
parent e8b349f1e1
commit 3ce94729c6
9 changed files with 21 additions and 6 deletions

View File

@ -31,7 +31,8 @@ OpenDelta is a toolkit for parameter-efficient tuning methods (we dub it as *del
- **A demo of using Opendelta to modify the PLM (E.g., BART).**
![How PLM changes using Delta-tuning](docs/source/imgs/demo.gif)
## Updates
## News
- 2022.10.10 We merge new version into main. Key changes can be seen in [Update log]()
- 2022.03.24 We notice several bugs in Soft Prompt Tuning and Prefix Tuning, mainly due to their need to customize attention ids, token_type_ids, we are fixing it! Currently, please use the other methods since they are stabler and better in performance.
- 2022.03.20 Add a [colab example](https://colab.research.google.com/drive/1uAhgAdc8Qr42UKYDlgUv0f7W1-gAFwGo?usp=sharing) to illustrate efficient training and space-saving multitask-serving.
- 2022.03.20 A new pip version released.
@ -72,7 +73,10 @@ python setup.py install
python setup.py develop
```
If you encounter network error using setup.py, please firstly install the dependencies via
#### Tips
- If you want to use mirror for installing the packages, please change the `index_url` in [setup.cfg](set.cfg)
- If you encounter network error using setup.py, please firstly install the dependencies via
```shell
pip install -r requirements.txt && python setup.py develop
```
@ -111,4 +115,7 @@ used models that OpenDelta are sure to support.
| CTRL | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
## Update Log
### version 0.3.0

View File

@ -142,6 +142,7 @@ bert_mapping = {
}
}
debertav2_mapping = {
"deberta.embeddings.word_embeddings": {"__name__":"embeddings"},
"deberta.embeddings.LayerNorm": {"__name__":""},

View File

@ -3,11 +3,10 @@ transformers>=4.10.0
datasets==1.17.0
sentencepiece>=0.1.96
tqdm>=4.62.2
# loralib
decorator
rich
web.py
gitpython
scipy
sklearn
scipy # need?
sklearn # need?
delta_center_client==0.0.4

5
setup.cfg Normal file
View File

@ -0,0 +1,5 @@
[easy_install]
# index_url = https://pypi.org/simple
index_url = https://pypi.tuna.tsinghua.edu.cn/simple

View File

@ -9,11 +9,12 @@ transformers>=4.10.0
datasets==1.17.0
sentencepiece>=0.1.96
tqdm>=4.62.2
# loralib
decorator
rich
web.py
gitpython
scipy # need?
sklearn # need?
delta_center_client==0.0.4
"""

View File

0
unittest/test_bmtrain.py Normal file
View File

View File

2
unittest/test_main.py Normal file
View File

@ -0,0 +1,2 @@