aboutsummaryrefslogtreecommitdiff
path: root/weed/cluster
AgeCommit message (Collapse)AuthorFilesLines
2024-05-05init candidate servers when setting a starting snapshotchrislu1-0/+4
2024-05-05logchrislu1-0/+5
2024-04-25Merge branch 'master' into mq-subscribechrislu1-0/+2
2024-04-24Fixes race with unlocked setter. (#5532)M@1-0/+2
2024-03-26log server listchrislu1-1/+2
2024-03-16go fmtchrislu1-3/+3
2024-03-09renamechrislu1-9/+9
2024-02-05proxy to broker leaderChris Lu1-4/+0
2024-02-05fix on finding lock ownerChris Lu1-1/+1
2024-02-04less verboseChris Lu1-2/+2
2024-02-04avoid too large expiration timeChris Lu3-83/+117
2024-02-03avoid timestamp overflowChris Lu1-1/+1
2024-02-02lock returns host and ownerchrislu3-61/+53
2024-02-01use a short-lived lockchrislu1-31/+18
2024-01-29re-lock if the lock owner is not foundchrislu2-47/+38
2024-01-08add batch index for each memory bufferchrislu1-0/+1
2024-01-03subscriber can be notified of the assignment change when topic is just ↵chrislu1-1/+1
configured Next: Subscriber needs to read by the timestamp offset.
2024-01-01add logschrislu1-0/+2
2023-12-11Merge accumulated changes related to message queue (#5098)Chris Lu1-3/+2
* balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment
2023-10-01RetryForever => RetryUntilchrislu1-3/+3
2023-09-18Revert "Revert "Merge branch 'master' into sub""chrislu1-1/+1
This reverts commit 0bb97709d41b1be4c74f01dcc65aac6d5f88bd16.
2023-09-18Revert "Merge branch 'master' into sub"chrislu1-1/+1
This reverts commit 4d414f54a224142f3f4d934f4af3b5dceb6fec6b, reversing changes made to 482742514656e9b5a652acf7406740fbc55db13d.
2023-09-17avoid nilchrislu1-1/+1
2023-09-16Squashed commit of the following:chrislu3-32/+108
commit 482742514656e9b5a652acf7406740fbc55db13d Author: chrislu <chris.lu@gmail.com> Date: Sat Sep 16 15:05:38 2023 -0700 balancer works commit 3b50139f68d5f59961113cf8fd0b903a7294a6ca Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:22:32 2023 -0700 comments commit 7f685ce7ba8853775e7c02c5b5c242d7920d62d3 Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 15 22:20:05 2023 -0700 adjust APIs commit 436d99443b399082f75f4ceb7595e8b5ac0a8ba3 Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 14 23:49:05 2023 -0700 receive broker stats commit b771fefa374fe237ff1317bbd03a9297a52191e3 Merge: 0a851ec00 890881037 Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 13 00:03:47 2023 -0700 Merge branch 'master' into sub commit 0a851ec00b455c72b405503f6f1f41728b15962e Author: chrislu <chris.lu@gmail.com> Date: Sun Sep 10 22:01:25 2023 -0700 Create balancer.go commit 39941edc0bae3b9a4a2c3344caf494f7ab80a82a Author: chrislu <chris.lu@gmail.com> Date: Thu Sep 7 23:55:19 2023 -0700 add publisher shutdown commit 875f562779f239a140d1008732b5375c0e511e61 Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:16:41 2023 -0700 server side send response at least once per second commit 984b6c54cf6b0defaa6e727ab5e36809411fe92c Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 23:15:29 2023 -0700 ack interval 128 commit 2492a454997a59ffe00405e365290addc460078a Author: chrislu <chris.lu@gmail.com> Date: Wed Sep 6 22:39:46 2023 -0700 ack interval commit ba67e6ca2998e82eb23abf5c431bdf9a92e966ea Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:50 2023 -0700 api for sub commit 9e4f98569898985ed285d8bb8a39b4ea5f095a98 Author: chrislu <chris.lu@gmail.com> Date: Mon Sep 4 21:43:30 2023 -0700 publish, benchmark commit cb470d44df2fed94ad8fd370b1c281cb126d373b Author: chrislu <chris.lu@gmail.com> Date: Fri Sep 1 00:36:51 2023 -0700 can pub and sub commit 1eb2da46d5d5a52c1012aa19ef31c1c8ed568d9e Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:02:12 2023 -0700 connect and publish commit 504ae8383ac3a0838d31d04b31623872b5734b31 Author: chrislu <chris.lu@gmail.com> Date: Mon Aug 28 09:01:25 2023 -0700 protoc version commit dbcba75271a4617b5931c4779ca0f7c924369a8f Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:59:04 2023 -0700 rename to lookup commit c9caf3311995290c36ed369b48fbbab23d6bc7b5 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 18:33:46 2023 -0700 move functions commit 4d6c18d86f07ee35625f207c94539727944a8776 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 17:50:59 2023 -0700 pub sub initial tests commit 4eb8e8624d8280d8aa4a227afc06bcacbfe732a7 Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:14:39 2023 -0700 rename commit 19904566706e9dba502f1ffd1f6fdf0bf876e99c Author: chrislu <chris.lu@gmail.com> Date: Sun Aug 27 13:13:14 2023 -0700 sub commit 905911853dd5103496e8fc9b47934fa3a48da214 Author: chrislu <chris.lu@gmail.com> Date: Sat Aug 26 13:39:21 2023 -0700 adjust proto
2023-06-25adjust lock APIschrislu2-8/+25
2023-06-25lock until cancelledchrislu1-1/+11
2023-06-25add distributed lock clientchrislu1-0/+151
2023-06-25adjust errorschrislu2-6/+13
2023-06-25filer can proxy to peer filer holding the lockchrislu1-1/+5
2023-06-25refactorchrislu1-2/+18
2023-06-25refactorchrislu2-5/+5
2023-06-25add distributed lock managerchrislu2-20/+80
2023-06-25add distributed lock managerchrislu3-12/+150
2023-06-20refactorchrislu2-3/+7
2023-06-19refactorchrislu2-42/+47
2023-06-19add LockRingchrislu2-0/+197
2023-06-19remove deprecated testschrislu1-41/+0
2023-06-19refactorchrislu1-18/+2
2023-06-19remove unused cluster node leaderchrislu3-168/+22
2022-08-23remove old raft servers if they don't answer to pings for too long (#3398)askeipx1-1/+2
* remove old raft servers if they don't answer to pings for too long add ping durations as options rename ping fields fix some todos get masters through masterclient raft remove server from leader use raft servers to ping them CheckMastersAlive for hashicorp raft only * prepare blocking ping * pass waitForReady as param * pass waitForReady through all functions * waitForReady works * refactor * remove unneeded params * rollback unneeded changes * fix
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu3-6/+6
2022-07-28dynamically connect to a filerchrislu1-0/+34
2022-07-28allocate brokers to serve segmentschrislu1-4/+25
2022-07-28refactorchrislu2-170/+141
2022-07-28clean upchrislu1-11/+11
2022-07-28display data center and rack in cluster.pschrislu1-12/+20
2022-07-28add dc and rackchrislu2-33/+71
2022-06-28fix `error: concurrent map writes` when add or remove cluster node石昌林2-4/+40
2022-05-30collect cluster node start timechrislu1-4/+4
2022-05-01fix testchrislu1-4/+4