Hivemind Versions Save

What's Changed

• [minor] allow overriding args/kwargs behavior in Runtime by @justheuristic in https://github.com/learning-at-home/hivemind/pull/587
• Use proper p2pd binary on macOS by @borzunov in https://github.com/learning-at-home/hivemind/pull/586
• Force DHT to be mp.context.ForkProcess by @borzunov in https://github.com/learning-at-home/hivemind/pull/589
• Use separate binaries for all supported OS and architectures by @borzunov in https://github.com/learning-at-home/hivemind/pull/588
• Consider multiple CPU arch aliases by @borzunov in https://github.com/learning-at-home/hivemind/pull/590

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.9...1.1.10

What's Changed

• Improve handling of KeyboardInterrupt in CLI applications by @mryab in https://github.com/learning-at-home/hivemind/pull/567
• Measure coverage of subprocesses, exclude protobuf compiled files by @mryab in https://github.com/learning-at-home/hivemind/pull/568
• Require pydantic<2.0 unless it's supported by @borzunov in https://github.com/learning-at-home/hivemind/pull/573
• Support Python 3.11 by @borzunov @justheuristic in https://github.com/learning-at-home/hivemind/pull/574
• Fix using .lstrip() in hivemind.compression by @borzunov in https://github.com/learning-at-home/hivemind/pull/578
• Fix TypeError in P2P._terminate() by @borzunov in https://github.com/learning-at-home/hivemind/pull/579

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.8...1.1.9

What's Changed

• Fix errors in hivemind.p2p and hivemind.compression by @borzunov in https://github.com/learning-at-home/hivemind/pull/565

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.7...1.1.8

What's Changed

• Remove direct coroutine call by @srogatch in https://github.com/learning-at-home/hivemind/pull/557
• Require torch<2.0 until 2.0 is supported, add Python 3.10 to CI by @borzunov in https://github.com/learning-at-home/hivemind/pull/558
• Support PyTorch 2.0.0 by @justheuristic in https://github.com/learning-at-home/hivemind/pull/559
• Fix bfloat16 serialization for tensors with zero elements by @borzunov in https://github.com/learning-at-home/hivemind/pull/560
• Allow RemoteExpertWorker run coroutines concurrently by @borzunov in https://github.com/learning-at-home/hivemind/pull/561
• Fix broken link, min torch version in readme by @borzunov in https://github.com/learning-at-home/hivemind/pull/562

New Contributors

• @srogatch made their first contribution in https://github.com/learning-at-home/hivemind/pull/557

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.6...1.1.7

What's Changed

• Add docstrings for use_relay/use_auto_relay, add them to hivemind-cli by @borzunov in https://github.com/learning-at-home/hivemind/pull/547
• Fix docstrings about relays by @borzunov in https://github.com/learning-at-home/hivemind/pull/548
• New bitsandbytes (with latest GPU support) by @justheuristic in https://github.com/learning-at-home/hivemind/pull/554
• Improve bfloat16 serialization (backward compatible) by @justheuristic in https://github.com/learning-at-home/hivemind/pull/553
• Fix exception in MPFuture.del() by @justheuristic in https://github.com/learning-at-home/hivemind/pull/555

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.5...1.1.6

What's Changed

• Make DecentralizedAverager resistant to KeyboardInterrupt by @ikmckenz in https://github.com/learning-at-home/hivemind/pull/530
• Switch to p2pd v0.3.14, libp2p v0.24.0 by @justheuristic in https://github.com/learning-at-home/hivemind/pull/531
• Fix typo in beam_search.py by @eltociear in https://github.com/learning-at-home/hivemind/pull/532
• Fix link to the papers in readme by @borzunov in https://github.com/learning-at-home/hivemind/pull/535
• Fix a broken URL in contributing.md by @Vahe1994 in https://github.com/learning-at-home/hivemind/pull/538
• Support circuit relay v2, add tests by @Vahe1994 in https://github.com/learning-at-home/hivemind/pull/537
• Fix new parameters in hivemind.P2PDaemon by @borzunov in https://github.com/learning-at-home/hivemind/pull/540
• Fix logging in Jupyter and Colab by @borzunov in https://github.com/learning-at-home/hivemind/pull/542
• Add comment warning for non_blocking + share_memory by @justheuristic in https://github.com/learning-at-home/hivemind/pull/541
• Import bitsandbytes only if it is used by @borzunov in https://github.com/learning-at-home/hivemind/pull/546
• Add Codespell to CI, fix typos by @mryab in https://github.com/learning-at-home/hivemind/pull/543

New Contributors

• @ikmckenz made their first contribution in https://github.com/learning-at-home/hivemind/pull/530
• @eltociear made their first contribution in https://github.com/learning-at-home/hivemind/pull/532
• @Vahe1994 made their first contribution in https://github.com/learning-at-home/hivemind/pull/538

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.4...1.1.5

What's Changed

• Update p2pd to v0.3.13 by @borzunov in https://github.com/learning-at-home/hivemind/pull/527

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.3...1.1.4

What's Changed

• Update moe.md by @cirquit in https://github.com/learning-at-home/hivemind/pull/516
• Fix "unable to open shared memory" while using MPFuture by @borzunov in https://github.com/learning-at-home/hivemind/pull/517
• Fix MPFuture failing outside inference mode by @borzunov in https://github.com/learning-at-home/hivemind/pull/521
• Bump torch to >=1.9.0 by @borzunov in https://github.com/learning-at-home/hivemind/pull/522
• Fix P2PDaemon's idle timeout by @borzunov in https://github.com/learning-at-home/hivemind/pull/523
• Support torch.bfloat16 in hivemind.compression by @borzunov in https://github.com/learning-at-home/hivemind/pull/524
• Remove stale PeerIDs in hivemind-dht's routing table by @borzunov in https://github.com/learning-at-home/hivemind/pull/525

New Contributors

• @cirquit made their first contribution in https://github.com/learning-at-home/hivemind/pull/516

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.2...1.1.3

What's Changed

• Forbid protobuf 4.x in requirements by @justheuristic in https://github.com/learning-at-home/hivemind/pull/508
• Check if identity is already taken by @borzunov in https://github.com/learning-at-home/hivemind/pull/511
• Add Petals to "Example Use Cases" by @borzunov in https://github.com/learning-at-home/hivemind/pull/512
• Follow up #501 and #511 with minor fixes by @borzunov in https://github.com/learning-at-home/hivemind/pull/513
• Update bitsandbytes, relax its version constraint by @mryab in https://github.com/learning-at-home/hivemind/pull/510

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.1...1.1.2

What's Changed

• Handle errors in Runtime by @justheuristic in https://github.com/learning-at-home/hivemind/pull/489
• metadata type changed to bytes by @GreenFatGuy in https://github.com/learning-at-home/hivemind/pull/491
• fix: Parameter Averaging quickstart clarification by @IAL32 in https://github.com/learning-at-home/hivemind/pull/492
• Make DHT ignore SIGINT by @dbaranchuk in https://github.com/learning-at-home/hivemind/pull/493
• Update README with latest projects and publications by @mryab in https://github.com/learning-at-home/hivemind/pull/494
• Add links to "Example Use Cases" by @borzunov in https://github.com/learning-at-home/hivemind/pull/497
• Support bfloat16 for autograd by @dbaranchuk in https://github.com/learning-at-home/hivemind/pull/499
• Remove libp2p handlers when ConnectionHandler, DHT, and DecentralizedAverager are shut down by @borzunov in https://github.com/learning-at-home/hivemind/pull/501
• Fix PyTorch warning suppression by @borzunov in https://github.com/learning-at-home/hivemind/pull/502
• Fix a potential deadlock in await_asynchronously with nested locks by @justheuristic in https://github.com/learning-at-home/hivemind/pull/503
• Require TaskPoolBase to implement load_batch_to_runtime by @justheuristic in https://github.com/learning-at-home/hivemind/pull/506
• Change runtime.py to choose tasks with lowest (instead of highest) priority by @justheuristic in https://github.com/learning-at-home/hivemind/pull/505
• Add support for quantization with bitsandbytes by @mryab in https://github.com/learning-at-home/hivemind/pull/490

New Contributors

• @IAL32 made their first contribution in https://github.com/learning-at-home/hivemind/pull/492
• @dbaranchuk made their first contribution in https://github.com/learning-at-home/hivemind/pull/493

Full Changelog: https://github.com/learning-at-home/hivemind/compare/1.1.0...1.1.1