Go to file
Matt Joiner 39ccb14036 Update TODO file 2018-04-14 21:44:50 +10:00
.circleci Fix benchmark job in CI 2018-01-25 17:20:07 +11:00
bencode Fix #247 2018-04-13 17:07:19 +10:00
cmd Support different hosts for each network 2018-04-12 15:06:53 +10:00
fs Another use of LoopbackListenhost 2018-04-12 16:10:46 +10:00
internal package assert->expect 2018-04-12 11:34:24 +10:00
iplist Support IPv6 blocklists 2018-02-11 15:11:26 +11:00
logonce logonce is a package that prints each distinct message only once 2014-11-16 13:04:44 -06:00
metainfo Fix #247 2018-04-13 17:07:19 +10:00
mmap_span mmap_span: Synchronize access to memory maps to avoid race when unmapping 2018-01-06 16:39:52 +11:00
mse Set the connection.cryptoMethod 2018-02-16 10:59:56 +11:00
peer_protocol Fix fast extension message type constants 2018-02-05 18:00:47 +11:00
storage package assert->expect 2018-04-12 11:34:24 +10:00
testdata Add the fs test torrent to the repo 2017-12-29 13:50:26 +11:00
tracker Expose public IPv4 and IPv6 config options and use them with trackers 2018-03-29 14:29:15 +11:00
util/dirwatch github.com/go-fsnotify/fsnotify -> github.com/fsnotify/fsnotify 2018-03-27 17:31:52 +11:00
LICENSE Update LICENSE 2018-01-27 11:21:33 +11:00
Peer.go Prioritize pending nodes with BEP 40 2018-04-04 17:59:28 +10:00
Peers.go IPv6 tracker support 2018-02-19 16:19:18 +11:00
README.md Update README.md 2018-01-28 18:43:16 +11:00
TODO Update TODO file 2018-04-14 21:44:50 +10:00
bad_storage.go Some test tidying and improvements 2018-01-29 18:22:21 +11:00
bep40.go Fix #244 2018-04-14 21:43:08 +10:00
bep40_test.go Fix #244 2018-04-14 21:43:08 +10:00
client.go A few adjustments to prioritized peers usage 2018-04-14 21:44:41 +10:00
client_test.go Try to make test more reliable 2018-04-14 11:23:26 +10:00
config.go Fix #246 2018-04-12 23:34:31 +10:00
conn_stats.go TODOs and comments 2018-02-04 19:14:07 +11:00
connection.go Add some peer source comments 2018-04-12 15:12:29 +10:00
connection_test.go Support sending HaveAll 2018-02-04 19:10:25 +11:00
doc.go List implemented BEPs 2016-07-11 13:53:00 +10:00
example_test.go Add File.NewReader 2018-01-06 16:37:13 +11:00
file.go Fix file piece index offset calculations 2018-01-25 17:01:29 +11:00
file_test.go Add File.Cancel 2016-02-05 01:18:54 +11:00
global.go Try to count IPv6 connections 2018-02-13 00:48:21 +11:00
handshake.go Set the connection.cryptoMethod 2018-02-16 10:59:56 +11:00
handshake_test.go Support AllowedFast and enable fast extension 2018-02-05 00:18:38 +11:00
issue97_test.go Add Torrent.setInfo 2018-01-25 17:10:37 +11:00
issue211_test.go Remove racy part of test 2017-12-01 23:08:53 +11:00
listen.go Add LoopbackListenHost 2018-04-12 15:21:31 +10:00
main_test.go Fix TestSetMaxEstablishedConn and allow it to be run with -count > 1 2018-02-11 15:14:31 +11:00
misc.go Rework conns to/and allow multiple DHT servers 2018-04-12 11:41:07 +10:00
misc_test.go Fixes for non-pointer Bitmap corrupting state 2018-02-08 15:08:33 +11:00
peerid.go Change a bunch of Stringer and status stuff 2018-02-05 17:47:47 +11:00
peerid_test.go Change a bunch of Stringer and status stuff 2018-02-05 17:47:47 +11:00
pex.go Support IPv6 peers over PEX 2018-02-13 00:50:32 +11:00
pex_test.go Redo the compact peer types 2015-08-17 19:52:47 +10:00
piece.go Aggressively wake Readers 2018-02-04 22:47:01 +11:00
piecestate.go Include completion known in PieceState 2018-01-28 15:58:55 +11:00
portfwd.go sortimports 2018-01-31 16:42:40 +11:00
prioritized_peers.go Add tests for prioritizedPeers 2018-04-14 21:44:03 +10:00
prioritized_peers_test.go Add tests for prioritizedPeers 2018-04-14 21:44:03 +10:00
protocol.go Abstract out making a cancel message 2017-09-18 13:42:42 +10:00
ratelimitreader.go Fix download rate limiter and add test 2018-01-28 15:28:45 +11:00
reader.go Aggressively wake Readers 2018-02-04 22:47:01 +11:00
reader_test.go Implement go vet recommendations 2018-02-02 19:28:09 +11:00
rlreader_test.go sortimports 2018-01-31 16:42:40 +11:00
socket.go Support different hosts for each network 2018-04-12 15:06:53 +10:00
spec.go Add error return value to metainfo.MetaInfo.UnmarshalInfo 2016-09-20 12:32:15 +10:00
t.go Avoid race in test 2018-01-27 14:31:46 +11:00
torrent.go A few adjustments to prioritized peers usage 2018-04-14 21:44:41 +10:00
torrent_stats.go Merge a bunch of stuff into ConnStats and refactor connection.upload 2018-02-02 19:04:56 +11:00
torrent_test.go Rework conns to/and allow multiple DHT servers 2018-04-12 11:41:07 +10:00
tracker_scraper.go Expose public IPv4 and IPv6 config options and use them with trackers 2018-03-29 14:29:15 +11:00
utp.go Add support for disabling IPv4 and IPv4 peers 2018-02-16 10:46:11 +11:00
utp_go.go added disable_libutp build flag usage (#215) 2017-12-06 11:56:26 +11:00
utp_libutp.go added disable_libutp build flag usage (#215) 2017-12-06 11:56:26 +11:00
utp_test.go Fix panic when error occurs binding uTP socket 2017-09-14 00:25:29 +10:00
worst_conns.go Ditch the use of generic slices.HeapInterface for finding the worst "bad" connection 2016-10-31 16:24:48 +11:00

README.md

torrent

Join the chat at https://gitter.im/anacrolix/torrent GoDoc CircleCI

This repository implements BitTorrent-related packages and command-line utilities in Go. The emphasis is on use as a library from other projects. It's been used 24/7 in production by downstream services since late 2014. The implementation was specifically created to explore Go's concurrency capabilities, and to include the ability to stream data directly from the BitTorrent network. To this end it supports seeking, readaheads and other features exposing torrents and their files with the various Go idiomatic io package interfaces. This is also demonstrated through torrentfs.

There is support for protocol encryption, DHT, PEX, uTP, and various extensions. There are several data storage backends provided: blob, file, bolt, and mmap, to name a few. You can write your own to store data for example on S3, or in a database.

Some noteworthy package dependencies that can be used for other purposes include:

Installation

Install the library package with go get github.com/anacrolix/torrent, or the provided cmds with go get github.com/anacrolix/torrent/cmd/....

Library examples

There are some small examples in the package documentation.

Downstream projects

There are several web-frontends and Android clients among the known public projects:

Help

Communication about the project is primarily through Gitter and the issue tracker.

Command packages

Here I'll describe what some of the packages in ./cmd do.

Note that the godo command which is invoked in the following examples builds and executes a Go import path, like go run. It's easier to use this convention than to spell out the install/invoke cycle for every single example.

torrent

Downloads torrents from the command-line. This first example does not use godo.

$ go get github.com/anacrolix/torrent/cmd/torrent
# Now 'torrent' should be in $GOPATH/bin, which should be in $PATH.
$ torrent 'magnet:?xt=urn:btih:KRWPCX3SJUM4IMM4YF5RPHL6ANPYTQPU'
ubuntu-14.04.2-desktop-amd64.iso [===================================================================>]  99% downloading (1.0 GB/1.0 GB)
2015/04/01 02:08:20 main.go:137: downloaded ALL the torrents
$ md5sum ubuntu-14.04.2-desktop-amd64.iso
1b305d585b1918f297164add46784116  ubuntu-14.04.2-desktop-amd64.iso
$ echo such amaze
wow

torrentfs

torrentfs mounts a FUSE filesystem at -mountDir. The contents are the torrents described by the torrent files and magnet links at -metainfoDir. Data for read requests is fetched only as required from the torrent network, and stored at -downloadDir.

$ mkdir mnt torrents
$ godo github.com/anacrolix/torrent/cmd/torrentfs -mountDir=mnt -metainfoDir=torrents &
$ cd torrents
$ wget http://releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.iso.torrent
$ cd ..
$ ls mnt
ubuntu-14.04.2-desktop-amd64.iso
$ pv mnt/ubuntu-14.04.2-desktop-amd64.iso | md5sum
996MB 0:04:40 [3.55MB/s] [========================================>] 100%
1b305d585b1918f297164add46784116  -

torrent-magnet

Creates a magnet link from a torrent file. Note the extracted trackers, display name, and info hash.

$ godo github.com/anacrolix/torrent/cmd/torrent-magnet < ubuntu-14.04.2-desktop-amd64.iso.torrent
magnet:?xt=urn:btih:546cf15f724d19c4319cc17b179d7e035f89c1f4&dn=ubuntu-14.04.2-desktop-amd64.iso&tr=http%3A%2F%2Ftorrent.ubuntu.com%3A6969%2Fannounce&tr=http%3A%2F%2Fipv6.torrent.ubuntu.com%3A6969%2Fannounce