2022-02-14 21:19:03 +08:00
OpenDelta's documentation!
=====================================
2022-10-14 23:15:38 +08:00
[OpenDelta ](https://github.com/thunlp/OpenDelta/ ) is a **Plug-and-play** Library of the parameter-efficient fine-tuning ([delta-tuning](WhatisDelta)) technology for pre-trained models.
2022-02-14 21:19:03 +08:00
## Essential Advantages:
- < span style = "color:rgb(81, 217, 245);font-weight:bold" > Clean:</ span > No need to edit the backbone PTM’ s codes.
- < span style = "color:orange;font-weight:bold" > Simple:</ span > Migrating from full-model tuning to delta-tuning needs as little as 3 lines of codes.
- < span style = "color:green;font-weight:bold" > Sustainable:</ span > Most evolution in external library doesn’ t require a new OpenDelta.
- < span style = "color:red;font-weight:bold" > Extendable:</ span > Various PTMs can share the same delta-tuning codes.
- < span style = "color:purple;font-weight:bold" > Flexible:</ span > Able to apply delta-tuning to (almost) any position of the PTMs.
```{eval-rst}
.. toctree::
:maxdepth: 1
:caption: Getting Started
notes/overview.md
notes/installation.md
2022-10-24 01:02:51 +08:00
notes/quickstart.md
notes/custom.md
2022-02-14 21:19:03 +08:00
notes/saveload.md
.. toctree::
:maxdepth: 1
:caption: Advanced Usage
2022-10-24 01:02:51 +08:00
2022-02-14 21:19:03 +08:00
notes/autodelta.md
notes/composition.md
notes/pluginunplug.md
2022-10-24 01:02:51 +08:00
notes/withbmtrain.md
notes/withaccelerate.md
notes/examples.md
.. toctree::
:maxdepth: 1
:caption: Utilities
notes/inspect.md
.. toctree::
:maxdepth: 1
:caption: Mechanisms
notes/keyfeature.md
notes/namebasedaddr.md
notes/unifyname.md
2022-10-14 23:15:38 +08:00
.. toctree::
:maxdepth: 1
:caption: Information
2022-02-14 21:19:03 +08:00
notes/citation.md
2022-10-14 23:15:38 +08:00
notes/update.md
2022-10-12 01:36:38 +08:00
notes/faq.md
2022-02-14 21:19:03 +08:00
.. toctree::
:maxdepth: 2
2022-10-14 23:15:38 +08:00
:caption: Documentation
2022-02-14 21:19:03 +08:00
modules/base
modules/deltas
modules/auto_delta
modules/utils
Indices and tables
==================
* :ref:`genindex`
```