aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2024-06-20chore: hot fix panic fs.verify (#5696)Konstantin Lebedev1-3/+4
2024-06-19[fs.verify] skip failed files if entry not found on filerStore (#5693)Konstantin Lebedev1-21/+54
2024-06-18[fs.verify] getmeta data from filer log (#5678)Konstantin Lebedev1-65/+104
* initial * fix: print entry path
2024-06-14Added context for the MasterClient's methods to avoid endless loops (#5628)vadimartynov2-3/+4
* Added context for the MasterClient's methods to avoid endless loops * Returned WithClient function. Added WithClientCustomGetMaster function * Hid unused ctx arguments * Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions * Changed the context termination check in the tryConnectToMaster function * Added a child context to the tryConnectToMaster function * Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
2024-06-11fix issue: sometimes volume.fsck report 'volume not found' (#5537)Taehyung Lim1-5/+10
* fix issue: sometimes volume.fsck report 'volume not found' when a volume server has multiple disk types * rename variable * adjust counters --------- Co-authored-by: chrislu <chris.lu@gmail.com>
2024-06-02Support concurrent volume.fsck & support disabling -cutoffTimeAgo to improve ↵NyaMisty1-18/+33
speed (#5636)
2024-06-02Ignore remote volume when selecting volumes in operation ↵NyaMisty1-0/+4
(ec.encode/volume.tier.upload) (#5635)
2024-06-02Fix volume.tier.upload nil pointer panic (#5634)NyaMisty1-0/+6
2024-05-27Replaces volume.unmount in the help of the volumeServer.leave (#5619)Vlad1-1/+1
2024-05-21fix wrong prefix exampleChris Lu1-1/+1
2024-05-21chore: add missing concurrency help in fs.meta.load command (#5609)Vlad1-0/+1
2024-05-20go fmtchrislu1-1/+1
2024-04-23fix "volume.fix.replication" move many replications only to one volumeServer ↵skycope3-15/+23
(#5522)
2024-04-12add testchrislu1-2/+17
2024-04-08fix(volume.fix.replication): adjust volume count, not free volume count (#5479)steve.wei1-4/+4
2024-03-17simplifychrislu2-3/+3
2024-03-17Revert "remove github.com/golang/protobuf/proto"chrislu1-4/+3
This reverts commit 1516e0249f5c7259880c3b5365b42ee0469510dd.
2024-03-16remove github.com/golang/protobuf/protochrislu1-3/+4
2024-03-07Merge branch 'master' into mq-subscribechrislu2-19/+53
2024-03-07Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-0/+53
2024-03-07purge cluster idchrislu1-19/+0
2024-03-05[shell] fs log purge (#5344)Konstantin Lebedev1-0/+53
* fix: install cronie * chore: shell delete old logs * Revert "fix: install cronie" This reverts commit 920832b04b89a0a0c9e12b3d51fe710fc622dad6. * fix: dayAgo * fix: Nit: dayAgo => daysAgo
2024-02-25Merge branch 'master' into mq-subscribechrislu1-30/+41
2024-02-15fix: fs verify error counter (#5261)Konstantin Lebedev1-30/+41
2024-02-05fix on finding lock ownerChris Lu1-1/+1
2024-02-04Merge branch 'master' into mq-subscribeChris Lu3-28/+35
2024-01-29weed/shell: Cluster check other disk types (#5245)Benoît Knecht1-9/+20
* week/shell: Cluster check other disk types The `cluster.check` command only took the empty (`""`) and `hdd` disk types into consideration, but a cluster with only `ssd` or `nvme` disk types would be equally valid. This commit simply checks that _any_ disk type is defined, and that some volumes are available for it. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Replace loop that copies slice Use the following construct instead of a `for` loop: ```golang x = append(x, y...) ``` See https://staticcheck.dev/docs/checks#S1011. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Check disk types when filer is in use Filer stores its metadata logs in generic (i.e. `""`) or HDD disk type volumes, so make sure those disk types exist and have volumes associated with them when Filer is deployed in the cluster. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> --------- Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
2024-01-25weed/shell: Cleanup volume balance logic (#5241)Benoît Knecht2-13/+9
2024-01-25weed/shell: Fix volume.balance logic (#5238)Benoît Knecht1-6/+6
2024-01-16remove isForPublish from LookupTopicBrokerschrislu1-1/+0
also adds a return parameter: whether the topic exists or not
2023-12-28shell meta load add concurrency (#4529)Konstantin Lebedev1-9/+27
* fix: increase speed cmd fs meta load * fix: add wg
2023-12-23Add modifyTimeAgo to volume.fsck (#5133)Seyed Mahdi Sadegh Shobeiri1-6/+17
* Add modifyTimeAgo to volume.fsck * Fix AppendAtNs
2023-12-23Fix cutoffTimeAgo in findMissingChunksInFiler (#5132)Seyed Mahdi Sadegh Shobeiri1-3/+2
2023-12-11Merge accumulated changes related to message queue (#5098)Chris Lu3-10/+56
* balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment
2023-11-21fix TestMisplacedChecking() and add test-casezehweh1-3/+9
2023-11-13fs.mergeVolumes: change dir to a named parameterAmir H. Yeganemehr1-8/+8
2023-11-13Fix typo (dist => dest)Amir H. Yeganemehr1-7/+7
2023-11-13fs.mergeVolumes: Make a plan based on volumes sizeAmir H. Yeganemehr1-61/+152
2023-11-13make help command in shell case insensitiveAmir H. Yeganemehr1-1/+1
2023-11-10ec.decode: mount the collected ec shardsjsh1-0/+10
2023-11-07fix isMisplaced() in command_volume_fix_replication.go (#4988)zehweh1-3/+3
2023-10-22log full percentagechrislu1-1/+1
2023-10-12 fix: disallow file name too long when writing a file (#4881)Konstantin Lebedev1-0/+2
* fix: disallow file name too long when writing a file * bool LongerName to MaxFilenameLength --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-12fix has changes false if deleted result size eq zero (#4909)Konstantin Lebedev1-2/+2
* fix has changes false if deleted result size eq zero https://github.com/seaweedfs/seaweedfs/issues/4171 * fix change respos status 202 to 304 if the file has already been deleted https://github.com/seaweedfs/seaweedfs/issues/4171 * fix delete if set apply changes https://github.com/seaweedfs/seaweedfs/issues/4171 --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-10add fs.mergeVolumes command into shell (#4907)Amir H. Yeganemehr1-0/+270
* add fs.compact command into shell * rename fs.compact to fs.mergeVolumes
2023-10-09 fix: skipping checking active volumes with the same number of files at the ↵Konstantin Lebedev2-24/+154
moment (#4893) * fix: skipping checking active volumes with the same number of files at the moment https://github.com/seaweedfs/seaweedfs/issues/4140 * refactor with comments https://github.com/seaweedfs/seaweedfs/issues/4140 * add TestShouldSkipVolume --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-05default to skip if less than 4 nodeschrislu2-18/+23
2023-10-02 fix: logger place msg (#4880)Konstantin Lebedev1-1/+1
2023-09-27fix: avoid deleting one replica without sync (#4875)Konstantin Lebedev2-30/+63
* fix: avoid deleting one replica without sync https://github.com/seaweedfs/seaweedfs/issues/4647 * Update weed/shell/command_volume_fix_replication.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * fix: revert this existing do option to positive --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2023-09-26rename functionchrislu1-1/+1