aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2024-03-17simplifychrislu2-3/+3
2024-03-17Revert "remove github.com/golang/protobuf/proto"chrislu1-4/+3
This reverts commit 1516e0249f5c7259880c3b5365b42ee0469510dd.
2024-03-16remove github.com/golang/protobuf/protochrislu1-3/+4
2024-03-07Merge branch 'master' into mq-subscribechrislu2-19/+53
2024-03-07Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-0/+53
2024-03-07purge cluster idchrislu1-19/+0
2024-03-05[shell] fs log purge (#5344)Konstantin Lebedev1-0/+53
* fix: install cronie * chore: shell delete old logs * Revert "fix: install cronie" This reverts commit 920832b04b89a0a0c9e12b3d51fe710fc622dad6. * fix: dayAgo * fix: Nit: dayAgo => daysAgo
2024-02-25Merge branch 'master' into mq-subscribechrislu1-30/+41
2024-02-15fix: fs verify error counter (#5261)Konstantin Lebedev1-30/+41
2024-02-05fix on finding lock ownerChris Lu1-1/+1
2024-02-04Merge branch 'master' into mq-subscribeChris Lu3-28/+35
2024-01-29weed/shell: Cluster check other disk types (#5245)Benoît Knecht1-9/+20
* week/shell: Cluster check other disk types The `cluster.check` command only took the empty (`""`) and `hdd` disk types into consideration, but a cluster with only `ssd` or `nvme` disk types would be equally valid. This commit simply checks that _any_ disk type is defined, and that some volumes are available for it. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Replace loop that copies slice Use the following construct instead of a `for` loop: ```golang x = append(x, y...) ``` See https://staticcheck.dev/docs/checks#S1011. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Check disk types when filer is in use Filer stores its metadata logs in generic (i.e. `""`) or HDD disk type volumes, so make sure those disk types exist and have volumes associated with them when Filer is deployed in the cluster. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> --------- Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
2024-01-25weed/shell: Cleanup volume balance logic (#5241)Benoît Knecht2-13/+9
2024-01-25weed/shell: Fix volume.balance logic (#5238)Benoît Knecht1-6/+6
2024-01-16remove isForPublish from LookupTopicBrokerschrislu1-1/+0
also adds a return parameter: whether the topic exists or not
2023-12-28shell meta load add concurrency (#4529)Konstantin Lebedev1-9/+27
* fix: increase speed cmd fs meta load * fix: add wg
2023-12-23Add modifyTimeAgo to volume.fsck (#5133)Seyed Mahdi Sadegh Shobeiri1-6/+17
* Add modifyTimeAgo to volume.fsck * Fix AppendAtNs
2023-12-23Fix cutoffTimeAgo in findMissingChunksInFiler (#5132)Seyed Mahdi Sadegh Shobeiri1-3/+2
2023-12-11Merge accumulated changes related to message queue (#5098)Chris Lu3-10/+56
* balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment
2023-11-21fix TestMisplacedChecking() and add test-casezehweh1-3/+9
2023-11-13fs.mergeVolumes: change dir to a named parameterAmir H. Yeganemehr1-8/+8
2023-11-13Fix typo (dist => dest)Amir H. Yeganemehr1-7/+7
2023-11-13fs.mergeVolumes: Make a plan based on volumes sizeAmir H. Yeganemehr1-61/+152
2023-11-13make help command in shell case insensitiveAmir H. Yeganemehr1-1/+1
2023-11-10ec.decode: mount the collected ec shardsjsh1-0/+10
2023-11-07fix isMisplaced() in command_volume_fix_replication.go (#4988)zehweh1-3/+3
2023-10-22log full percentagechrislu1-1/+1
2023-10-12 fix: disallow file name too long when writing a file (#4881)Konstantin Lebedev1-0/+2
* fix: disallow file name too long when writing a file * bool LongerName to MaxFilenameLength --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-12fix has changes false if deleted result size eq zero (#4909)Konstantin Lebedev1-2/+2
* fix has changes false if deleted result size eq zero https://github.com/seaweedfs/seaweedfs/issues/4171 * fix change respos status 202 to 304 if the file has already been deleted https://github.com/seaweedfs/seaweedfs/issues/4171 * fix delete if set apply changes https://github.com/seaweedfs/seaweedfs/issues/4171 --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-10add fs.mergeVolumes command into shell (#4907)Amir H. Yeganemehr1-0/+270
* add fs.compact command into shell * rename fs.compact to fs.mergeVolumes
2023-10-09 fix: skipping checking active volumes with the same number of files at the ↵Konstantin Lebedev2-24/+154
moment (#4893) * fix: skipping checking active volumes with the same number of files at the moment https://github.com/seaweedfs/seaweedfs/issues/4140 * refactor with comments https://github.com/seaweedfs/seaweedfs/issues/4140 * add TestShouldSkipVolume --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-10-05default to skip if less than 4 nodeschrislu2-18/+23
2023-10-02 fix: logger place msg (#4880)Konstantin Lebedev1-1/+1
2023-09-27fix: avoid deleting one replica without sync (#4875)Konstantin Lebedev2-30/+63
* fix: avoid deleting one replica without sync https://github.com/seaweedfs/seaweedfs/issues/4647 * Update weed/shell/command_volume_fix_replication.go Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> * fix: revert this existing do option to positive --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2023-09-26rename functionchrislu1-1/+1
2023-09-26fix: avoid deleting more than one replica (#4873)Konstantin Lebedev1-5/+6
https://github.com/seaweedfs/seaweedfs/issues/4647 Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co>
2023-09-25describe a topicchrislu1-0/+59
2023-09-25fix(ec): volumes created by foreign collection due to bug in ec balance (#4864)Tobias Gurtzick1-6/+10
* fix(ec): ignore 0 byte data files refers to parts of #4861 Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> * fix(ec): ignore volumes not from the current collection during balance fixes #4861 Signed-off-by: Tobias Gurtzick <magic@wizardtales.com> --------- Signed-off-by: Tobias Gurtzick <magic@wizardtales.com>
2023-09-25Revert "Revert "Merge branch 'master' of ↵chrislu8-35/+36
https://github.com/seaweedfs/seaweedfs"" This reverts commit 8cb42c39
2023-09-24create topic and report topicorigin/subchrislu1-13/+16
2023-09-24do create topicchrislu1-1/+3
2023-09-24add CreateTopic APIchrislu2-2/+100
2023-09-18Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"chrislu8-36/+35
This reverts commit 2e5aa06026750c99ea283181974d2ccfe5eb0468, reversing changes made to 4d414f54a224142f3f4d934f4af3b5dceb6fec6b.
2023-09-18Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 (#4850)dependabot[bot]8-35/+36
* Bump github.com/rclone/rclone from 1.63.1 to 1.64.0 Bumps [github.com/rclone/rclone](https://github.com/rclone/rclone) from 1.63.1 to 1.64.0. - [Release notes](https://github.com/rclone/rclone/releases) - [Changelog](https://github.com/rclone/rclone/blob/master/RELEASE.md) - [Commits](https://github.com/rclone/rclone/compare/v1.63.1...v1.64.0) --- updated-dependencies: - dependency-name: github.com/rclone/rclone dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * API changes * go mod --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2023-08-24Implement SRV lookups for filer (#4767)Nico D'Cotta1-1/+1
2023-08-19Fix s3.clean.uploads (#4766)SmsS41-9/+6
2023-08-08added an error messagechrislu1-0/+2
2023-08-01minor (#4723)wusong1-2/+2
2023-07-06clone volume locations in case they are changedchrislu4-5/+5
fix https://github.com/seaweedfs/seaweedfs/issues/4642
2023-06-19minorchrislu1-1/+1