aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2024-07-31fsck: only check the appendNs of deleted needle (#5841)wyang1-45/+43
increase fsck speed Co-authored-by: Yang Wang <yangwang@weride.ai>
2024-07-26fix evacuate volume to different disk types (#5530)wyang1-3/+4
Co-authored-by: wyang <wyang@wyangs-Air.lan>
2024-07-20get, set and add path confchrislu1-1/+1
2024-07-16Added tls for http clients (#5766)vadimartynov3-14/+15
* Added global http client * Added Do func for global http client * Changed the code to use the global http client * Fix http client in volume uploader * Fixed pkg name * Fixed http util funcs * Fixed http client for bench_filer_upload * Fixed http client for stress_filer_upload * Fixed http client for filer_server_handlers_proxy * Fixed http client for command_fs_merge_volumes * Fixed http client for command_fs_merge_volumes and command_volume_fsck * Fixed http client for s3api_server * Added init global client for main funcs * Rename global_client to client * Changed: - fixed NewHttpClient; - added CheckIsHttpsClientEnabled func - updated security.toml in scaffold * Reduce the visibility of some functions in the util/http/client pkg * Added the loadSecurityConfig function * Use util.LoadSecurityConfiguration() in NewHttpClient func
2024-07-15Add warning with hints to why a EC shard cant be moved (#5790)Dan1-2/+6
2024-07-10always copy ecj fileschrislu1-1/+1
2024-07-03volume.tier.upload: Fix deleting replicated volumes (#5743)rhysm1-1/+4
Co-authored-by: Rhys M <rhysm@protonmail.com>
2024-07-01refactor all methods strings to const (#5726)Konstantin Lebedev1-1/+1
2024-06-20chore: hot fix panic fs.verify (#5696)Konstantin Lebedev1-3/+4
2024-06-19[fs.verify] skip failed files if entry not found on filerStore (#5693)Konstantin Lebedev1-21/+54
2024-06-18[fs.verify] getmeta data from filer log (#5678)Konstantin Lebedev1-65/+104
* initial * fix: print entry path
2024-06-14Added context for the MasterClient's methods to avoid endless loops (#5628)vadimartynov2-3/+4
* Added context for the MasterClient's methods to avoid endless loops * Returned WithClient function. Added WithClientCustomGetMaster function * Hid unused ctx arguments * Using a common context for the KeepConnectedToMaster and WaitUntilConnected functions * Changed the context termination check in the tryConnectToMaster function * Added a child context to the tryConnectToMaster function * Added a common context for KeepConnectedToMaster and WaitUntilConnected functions in benchmark
2024-06-11fix issue: sometimes volume.fsck report 'volume not found' (#5537)Taehyung Lim1-5/+10
* fix issue: sometimes volume.fsck report 'volume not found' when a volume server has multiple disk types * rename variable * adjust counters --------- Co-authored-by: chrislu <chris.lu@gmail.com>
2024-06-02Support concurrent volume.fsck & support disabling -cutoffTimeAgo to improve ↵NyaMisty1-18/+33
speed (#5636)
2024-06-02Ignore remote volume when selecting volumes in operation ↵NyaMisty1-0/+4
(ec.encode/volume.tier.upload) (#5635)
2024-06-02Fix volume.tier.upload nil pointer panic (#5634)NyaMisty1-0/+6
2024-05-27Replaces volume.unmount in the help of the volumeServer.leave (#5619)Vlad1-1/+1
2024-05-21fix wrong prefix exampleChris Lu1-1/+1
2024-05-21chore: add missing concurrency help in fs.meta.load command (#5609)Vlad1-0/+1
2024-05-20go fmtchrislu1-1/+1
2024-04-23fix "volume.fix.replication" move many replications only to one volumeServer ↵skycope3-15/+23
(#5522)
2024-04-12add testchrislu1-2/+17
2024-04-08fix(volume.fix.replication): adjust volume count, not free volume count (#5479)steve.wei1-4/+4
2024-03-17simplifychrislu2-3/+3
2024-03-17Revert "remove github.com/golang/protobuf/proto"chrislu1-4/+3
This reverts commit 1516e0249f5c7259880c3b5365b42ee0469510dd.
2024-03-16remove github.com/golang/protobuf/protochrislu1-3/+4
2024-03-07Merge branch 'master' into mq-subscribechrislu2-19/+53
2024-03-07Merge branch 'master' of https://github.com/seaweedfs/seaweedfschrislu1-0/+53
2024-03-07purge cluster idchrislu1-19/+0
2024-03-05[shell] fs log purge (#5344)Konstantin Lebedev1-0/+53
* fix: install cronie * chore: shell delete old logs * Revert "fix: install cronie" This reverts commit 920832b04b89a0a0c9e12b3d51fe710fc622dad6. * fix: dayAgo * fix: Nit: dayAgo => daysAgo
2024-02-25Merge branch 'master' into mq-subscribechrislu1-30/+41
2024-02-15fix: fs verify error counter (#5261)Konstantin Lebedev1-30/+41
2024-02-05fix on finding lock ownerChris Lu1-1/+1
2024-02-04Merge branch 'master' into mq-subscribeChris Lu3-28/+35
2024-01-29weed/shell: Cluster check other disk types (#5245)Benoît Knecht1-9/+20
* week/shell: Cluster check other disk types The `cluster.check` command only took the empty (`""`) and `hdd` disk types into consideration, but a cluster with only `ssd` or `nvme` disk types would be equally valid. This commit simply checks that _any_ disk type is defined, and that some volumes are available for it. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Replace loop that copies slice Use the following construct instead of a `for` loop: ```golang x = append(x, y...) ``` See https://staticcheck.dev/docs/checks#S1011. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> * weed/shell: Check disk types when filer is in use Filer stores its metadata logs in generic (i.e. `""`) or HDD disk type volumes, so make sure those disk types exist and have volumes associated with them when Filer is deployed in the cluster. Signed-off-by: Benoît Knecht <bknecht@protonmail.ch> --------- Signed-off-by: Benoît Knecht <bknecht@protonmail.ch>
2024-01-25weed/shell: Cleanup volume balance logic (#5241)Benoît Knecht2-13/+9
2024-01-25weed/shell: Fix volume.balance logic (#5238)Benoît Knecht1-6/+6
2024-01-16remove isForPublish from LookupTopicBrokerschrislu1-1/+0
also adds a return parameter: whether the topic exists or not
2023-12-28shell meta load add concurrency (#4529)Konstantin Lebedev1-9/+27
* fix: increase speed cmd fs meta load * fix: add wg
2023-12-23Add modifyTimeAgo to volume.fsck (#5133)Seyed Mahdi Sadegh Shobeiri1-6/+17
* Add modifyTimeAgo to volume.fsck * Fix AppendAtNs
2023-12-23Fix cutoffTimeAgo in findMissingChunksInFiler (#5132)Seyed Mahdi Sadegh Shobeiri1-3/+2
2023-12-11Merge accumulated changes related to message queue (#5098)Chris Lu3-10/+56
* balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment
2023-11-21fix TestMisplacedChecking() and add test-casezehweh1-3/+9
2023-11-13fs.mergeVolumes: change dir to a named parameterAmir H. Yeganemehr1-8/+8
2023-11-13Fix typo (dist => dest)Amir H. Yeganemehr1-7/+7
2023-11-13fs.mergeVolumes: Make a plan based on volumes sizeAmir H. Yeganemehr1-61/+152
2023-11-13make help command in shell case insensitiveAmir H. Yeganemehr1-1/+1
2023-11-10ec.decode: mount the collected ec shardsjsh1-0/+10
2023-11-07fix isMisplaced() in command_volume_fix_replication.go (#4988)zehweh1-3/+3
2023-10-22log full percentagechrislu1-1/+1
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-25 06:26:22 +0000