merge master into delta_center_dev
This commit is contained in:
parent
e8b349f1e1
commit
3ce94729c6
11
README.md
11
README.md
|
@ -31,7 +31,8 @@ OpenDelta is a toolkit for parameter-efficient tuning methods (we dub it as *del
|
|||
- **A demo of using Opendelta to modify the PLM (E.g., BART).**
|
||||
![How PLM changes using Delta-tuning](docs/source/imgs/demo.gif)
|
||||
|
||||
## Updates
|
||||
## News
|
||||
- 2022.10.10 We merge new version into main. Key changes can be seen in [Update log]()
|
||||
- 2022.03.24 We notice several bugs in Soft Prompt Tuning and Prefix Tuning, mainly due to their need to customize attention ids, token_type_ids, we are fixing it! Currently, please use the other methods since they are stabler and better in performance.
|
||||
- 2022.03.20 Add a [colab example](https://colab.research.google.com/drive/1uAhgAdc8Qr42UKYDlgUv0f7W1-gAFwGo?usp=sharing) to illustrate efficient training and space-saving multitask-serving.
|
||||
- 2022.03.20 A new pip version released.
|
||||
|
@ -72,7 +73,10 @@ python setup.py install
|
|||
python setup.py develop
|
||||
```
|
||||
|
||||
If you encounter network error using setup.py, please firstly install the dependencies via
|
||||
#### Tips
|
||||
- If you want to use mirror for installing the packages, please change the `index_url` in [setup.cfg](set.cfg)
|
||||
|
||||
- If you encounter network error using setup.py, please firstly install the dependencies via
|
||||
```shell
|
||||
pip install -r requirements.txt && python setup.py develop
|
||||
```
|
||||
|
@ -111,4 +115,7 @@ used models that OpenDelta are sure to support.
|
|||
| CTRL | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | | |
|
||||
|
||||
|
||||
## Update Log
|
||||
|
||||
### version 0.3.0
|
||||
|
||||
|
|
|
@ -142,6 +142,7 @@ bert_mapping = {
|
|||
}
|
||||
}
|
||||
|
||||
|
||||
debertav2_mapping = {
|
||||
"deberta.embeddings.word_embeddings": {"__name__":"embeddings"},
|
||||
"deberta.embeddings.LayerNorm": {"__name__":""},
|
||||
|
|
|
@ -3,11 +3,10 @@ transformers>=4.10.0
|
|||
datasets==1.17.0
|
||||
sentencepiece>=0.1.96
|
||||
tqdm>=4.62.2
|
||||
# loralib
|
||||
decorator
|
||||
rich
|
||||
web.py
|
||||
gitpython
|
||||
scipy
|
||||
sklearn
|
||||
scipy # need?
|
||||
sklearn # need?
|
||||
delta_center_client==0.0.4
|
||||
|
|
|
@ -0,0 +1,5 @@
|
|||
[easy_install]
|
||||
|
||||
# index_url = https://pypi.org/simple
|
||||
|
||||
index_url = https://pypi.tuna.tsinghua.edu.cn/simple
|
3
setup.py
3
setup.py
|
@ -9,11 +9,12 @@ transformers>=4.10.0
|
|||
datasets==1.17.0
|
||||
sentencepiece>=0.1.96
|
||||
tqdm>=4.62.2
|
||||
# loralib
|
||||
decorator
|
||||
rich
|
||||
web.py
|
||||
gitpython
|
||||
scipy # need?
|
||||
sklearn # need?
|
||||
delta_center_client==0.0.4
|
||||
"""
|
||||
|
||||
|
|
|
@ -0,0 +1,2 @@
|
|||
|
||||
|
Loading…
Reference in New Issue