7410e28329
New requests weren't being issued to the current peer when being deleted. For webseeds, this would cause them to not bother issuing new requests indefinitely. (cherry picked from commit 146a16df4ea26d33b0ce0391c8220de14c9e18f4) |
||
---|---|---|
.circleci | ||
bencode | ||
cmd | ||
common | ||
fs | ||
internal | ||
iplist | ||
logonce | ||
metainfo | ||
mmap_span | ||
mse | ||
peer_protocol | ||
segments | ||
storage | ||
test | ||
testdata | ||
tracker | ||
util/dirwatch | ||
webseed | ||
webtorrent | ||
.gitignore | ||
LICENSE | ||
README.md | ||
TODO | ||
bad_storage.go | ||
bep40.go | ||
bep40_test.go | ||
callbacks.go | ||
client.go | ||
client_test.go | ||
closewrapper.go | ||
config.go | ||
conn_stats.go | ||
deferrwl.go | ||
dht.go | ||
dialer.go | ||
doc.go | ||
example_test.go | ||
file.go | ||
file_test.go | ||
global.go | ||
go.mod | ||
go.sum | ||
handshake.go | ||
handshake_test.go | ||
ipport.go | ||
issue97_test.go | ||
issue211_test.go | ||
listen.go | ||
main_test.go | ||
misc.go | ||
misc_test.go | ||
multiless.go | ||
network_test.go | ||
networks.go | ||
peer-impl.go | ||
peer_info.go | ||
peer_infos.go | ||
peerconn.go | ||
peerconn_test.go | ||
peerid.go | ||
peerid_test.go | ||
pex.go | ||
pex_test.go | ||
pexconn.go | ||
pexconn_test.go | ||
piece.go | ||
piecestate.go | ||
portfwd.go | ||
prioritized_peers.go | ||
prioritized_peers_test.go | ||
protocol.go | ||
ratelimitreader.go | ||
reader.go | ||
reader_test.go | ||
request_strategy.go | ||
request_strategy_defaults.go | ||
rlreader_test.go | ||
socket.go | ||
spec.go | ||
struct_test.go | ||
t.go | ||
testing.go | ||
torrent.go | ||
torrent_pending_pieces.go | ||
torrent_stats.go | ||
torrent_test.go | ||
tracker_scraper.go | ||
utp.go | ||
utp_go.go | ||
utp_libutp.go | ||
utp_test.go | ||
webrtc.go | ||
webseed-peer.go | ||
worst_conns.go | ||
wstracker.go |
README.md
torrent
This repository implements BitTorrent-related packages and command-line utilities in Go. The emphasis is on use as a library from other projects. It's been used 24/7 in production by downstream services since late 2014. The implementation was specifically created to explore Go's concurrency capabilities, and to include the ability to stream data directly from the BitTorrent network. To this end it supports seeking, readaheads and other features exposing torrents and their files with the various Go idiomatic io
package interfaces. This is also demonstrated through torrentfs.
There is support for protocol encryption, DHT, PEX, uTP, and various extensions. There are several data storage backends provided: blob, file, bolt, and mmap, to name a few. You can write your own to store data for example on S3, or in a database.
Some noteworthy package dependencies that can be used for other purposes include:
Installation
Install the library package with go get github.com/anacrolix/torrent
, or the provided cmds with go get github.com/anacrolix/torrent/cmd/...
.
Library examples
There are some small examples in the package documentation.
Downstream projects
There are several web-frontends and Android clients among the known public projects:
- Torrent.Express
- Confluence
- Trickl
- Elementum
- goTorrent
- Go Peerflix
- Cloud Torrent
- Android Torrent Client
- libtorrent
- Remote-Torrent
- ANT-Downloader
- Go-PeersToHTTP
- CortexFoundation/torrentfs: P2P file system of cortex full node
Help
Communication about the project is primarily through Gitter and the issue tracker.
Command packages
Here I'll describe what some of the packages in ./cmd
do.
Note that the godo
command which is invoked in the following examples builds and executes a Go import path, like go run
. It's easier to use this convention than to spell out the install/invoke cycle for every single example.
torrent
Downloads torrents from the command-line. This first example does not use godo
.
$ go get github.com/anacrolix/torrent/cmd/torrent
# Now 'torrent' should be in $GOPATH/bin, which should be in $PATH.
$ torrent download 'magnet:?xt=urn:btih:KRWPCX3SJUM4IMM4YF5RPHL6ANPYTQPU'
ubuntu-14.04.2-desktop-amd64.iso [===================================================================>] 99% downloading (1.0 GB/1.0 GB)
2015/04/01 02:08:20 main.go:137: downloaded ALL the torrents
$ md5sum ubuntu-14.04.2-desktop-amd64.iso
1b305d585b1918f297164add46784116 ubuntu-14.04.2-desktop-amd64.iso
$ echo such amaze
wow
torrentfs
torrentfs mounts a FUSE filesystem at -mountDir
. The contents are the torrents described by the torrent files and magnet links at -metainfoDir
. Data for read requests is fetched only as required from the torrent network, and stored at -downloadDir
.
$ mkdir mnt torrents
$ godo github.com/anacrolix/torrent/cmd/torrentfs -mountDir=mnt -metainfoDir=torrents &
$ cd torrents
$ wget http://releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.iso.torrent
$ cd ..
$ ls mnt
ubuntu-14.04.2-desktop-amd64.iso
$ pv mnt/ubuntu-14.04.2-desktop-amd64.iso | md5sum
996MB 0:04:40 [3.55MB/s] [========================================>] 100%
1b305d585b1918f297164add46784116 -
torrent-magnet
Creates a magnet link from a torrent file. Note the extracted trackers, display name, and info hash.
$ godo github.com/anacrolix/torrent/cmd/torrent-magnet < ubuntu-14.04.2-desktop-amd64.iso.torrent
magnet:?xt=urn:btih:546cf15f724d19c4319cc17b179d7e035f89c1f4&dn=ubuntu-14.04.2-desktop-amd64.iso&tr=http%3A%2F%2Ftorrent.ubuntu.com%3A6969%2Fannounce&tr=http%3A%2F%2Fipv6.torrent.ubuntu.com%3A6969%2Fannounce