-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
New gossip_net backend using libp2p (#3988)
This is the revival of the tmp/cmr/net2 branch rebased onto develop. Some important user-facing changes: - No separate discovery/communication/etc ports. One port for all public daemon communications. - Automatic port forwarding with UPnP. If your local network supports UPnP, there should be no configuration required. - Local peer discovery. If your local network supports mDNS broadcast, coda daemons will automatically discover each other. This includes several daemons on the same machine- no more building peer lists! - New libp2p keypairs. These are managed the same as our key pairs with secret_file. Without configuration, key pairs are ephemeral and will disappear when the daemon restarts. (TODO: should we instead persist the keypair? does it matter for non-infrastructure?) Some important internal changes: - All daemon-daemon connections are now authenticated and confidential. - Connections are no longer transient and per-request. Individual requests get multiplexed as their own stream over the one connection between the peers. This is analogous to HTTP/2. Outgoing connections will appear to originate from the libp2p listening port, vs some transient port. Outstanding details: - Trust system needs to get augmented to track Peer.t instead of just an IP. Until then we can't implement ban_notify (#4093, #4096). - Libp2p has little per-connection structured reporting, some things we currently penalize trust for are not detected (eg opening a libp2p connection without also opening a coda RPC stream) (#4098). - New pubsub allows banning senders by peer ID. We currently don't do this but we should ban peerIDs that originated bad info and not just the IP of the whoever relayed it to us (#4096). - ~~Current pubsub validation flow goes a bit against the libp2p grain, and it's not clear to me that the current behavior will survive [this libp2p PR](libp2p/go-libp2p-kad-dht#388). There's an inline comment near the should_forward_message impl (#4097).~~ done - Connection limit enforcement (#4095) Other changes: - Rips out the last vestiges of old membership, which aren't in use. - The connection info in envelopes is much more accurate now. We shouldn't start trusting it just yet due to some future vagaries around relaying. - bump nixpkgs version Future improvements: - IPv6. There's a hardcoded IPv4 assumption in the helper around IP filtering. - Investigate libp2p autorelay. This should help nodes in restrictive networks achieve better connectivity, but has a host of problems. - Intelligent request routing. I believe we can use the "provider" feature to, at the very least, only send eg sync/bootstrap requests to nodes who believe themselves to be in sync. There are other options.
- Loading branch information
Showing
10 changed files
with
1,539 additions
and
138 deletions.
There are no files selected for viewing
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,11 +1,11 @@ | ||
| ((import (builtins.fetchTarball { | ||
| name = "nixpkgs-unstable-2019-03-18"; | ||
| url = https://github.com/nixos/nixpkgs/archive/0125544e2a0552590c87dca1583768b49ba911c0.tar.gz; | ||
| sha256 = "04xvlqw3zbq91zkfa506b2k1ajmj7pqh3nvdh9maabw6m5jhm5rl"; | ||
| name = "nixpkgs-stable-2019-12-05"; | ||
| url = https://github.com/nixos/nixpkgs/archive/19.09.tar.gz; | ||
| sha256 = "0mhqhq21y5vrr1f30qd2bvydv4bbbslvyzclhw0kdxmkgg3z4c92"; | ||
| })) {}).buildGoModule rec { | ||
| name = "libp2p_helper-${version}"; | ||
| version = "0.1"; | ||
| src = ./src; | ||
| modSha256 = "1spndcx0z50cmpfxfd0971nj9n0v77fghxl36hr1pvs6kv0ra5c3"; | ||
| modSha256 = "0wrqxik9z713w50w49ivy5c2vapk07fdmd0zsvk6kfkchkq1nsdy"; | ||
| } | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,27 +1,34 @@ | ||
| package main | ||
|
|
||
| import ( | ||
| crypto "github.com/libp2p/go-libp2p-crypto" | ||
| b58 "github.com/mr-tron/base58/base58" | ||
| "os" | ||
| ) | ||
| crypto "github.com/libp2p/go-libp2p-crypto" | ||
| b58 "github.com/mr-tron/base58/base58" | ||
| "os" | ||
| ) | ||
|
|
||
| func main() { | ||
| if len(os.Args) != 2 { | ||
| println("usage: libp2p-priv-to-pub PRIVKEY_BASE58_STRING"); | ||
| } | ||
| privk_enc := os.Args[1] | ||
| privk_raw, err := b58.Decode(privk_enc) | ||
| if err != nil { panic(err); } | ||
| if len(os.Args) != 2 { | ||
| println("usage: libp2p-priv-to-pub PRIVKEY_BASE58_STRING") | ||
| } | ||
| privk_enc := os.Args[1] | ||
| privk_raw, err := b58.Decode(privk_enc) | ||
| if err != nil { | ||
| panic(err) | ||
| } | ||
|
|
||
| priv, err := crypto.UnmarshalPrivateKey(privk_raw) | ||
| if err != nil { panic(err); } | ||
| priv, err := crypto.UnmarshalPrivateKey(privk_raw) | ||
| if err != nil { | ||
| panic(err) | ||
| } | ||
|
|
||
| pub := priv.GetPublic() | ||
| pub := priv.GetPublic() | ||
|
|
||
| pubk_raw, err := crypto.MarshalPublicKey(pub) | ||
| if err != nil { panic(err); } | ||
| pubk_raw, err := crypto.MarshalPublicKey(pub) | ||
| if err != nil { | ||
| panic(err) | ||
| } | ||
|
|
||
| pubk_enc := b58.Encode(pubk_raw) | ||
| pubk_enc := b58.Encode(pubk_raw) | ||
|
|
||
| println(pubk_enc) | ||
| println(pubk_enc) | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.