aboutsummaryrefslogtreecommitdiff
path: root/weed/shell
AgeCommit message (Collapse)AuthorFilesLines
2024-12-06Remove average constraints when selecting nodes/racks to balance EC shards ↵Lisandro Pin3-97/+12
into. (#6325)
2024-12-05Share common parameters for EC re-balancing functions under a single struct. ↵Lisandro Pin3-187/+189
(#6319) TODO cleanup for https://github.com/seaweedfs/seaweedfs/discussions/6179.
2024-12-04Account for replication placement settings when balancing EC shards within ↵Lisandro Pin3-35/+57
the same rack. (#6317) * Account for replication placement settings when balancing EC shards within racks. * Update help contents for `ec.balance`. * Add a few more representative test cases for `pickEcNodeToBalanceShardsInto()`.
2024-12-04Account for replication placement settings when balancing EC shards across ↵Lisandro Pin4-29/+36
racks. (#6316)
2024-12-02Resolve replica placement for EC volumes from master server defaults. (#6303)Lisandro Pin3-28/+103
2024-11-28Display details upon failures to re-balance EC shards racks. (#6299)Lisandro Pin2-12/+18
2024-11-27Improve EC shards rebalancing logic across nodes (#6297)Lisandro Pin2-33/+159
* Improve EC shards rebalancing logic across nodes. - Favor target nodes with less preexisting shards, to ensure a fair distribution. - Randomize selection when multiple possible target nodes are available. - Add logic to account for replication settings when selecting target nodes (currently disabled). * Fix minor test typo. * Clarify internal error messages for `pickEcNodeToBalanceShardsInto()`.
2024-11-25use readable bytes size string in shell output (#6288)Trim211-1/+3
2024-11-21use math rand v2chrislu1-2/+2
2024-11-21Improve EC shards rebalancing logic across racks (#6270)Lisandro Pin4-40/+269
Improve EC shards rebalancing logic across racks. - Favor target shards with less preexisting shards, to ensure a fair distribution. - Randomize selection when multiple possible target shards are available. - Add logic to account for replication settings when selecting target shards (currently disabled).
2024-11-21[shell] don't require lock when there are no changes for ↵Konstantin Lebedev1-3/+4
volume.fix.replication (#6266) * don't require lock when there are no changes * revert takeAction
2024-11-20[shell] add noLock param for volume.move (#6261)Konstantin Lebedev2-4/+12
2024-11-19typochrislu1-8/+8
2024-11-19renamechrislu1-11/+11
2024-11-19minorchrislu1-1/+1
2024-11-19Unify usage of shell.EcNode.dc as DataCenterId. (#6258)Lisandro Pin11-31/+35
2024-11-18adds more info on skipped volumeschrislu1-0/+14
2024-11-18Introduce logic to resolve volume replica placement within EC rebalancing. ↵Lisandro Pin4-58/+132
(#6254) * Rename `command_ec_encode_test.go` to `command_ec_common_test.go`. All tests defined in this file are now for `command_ec_common.go`. * Minor code cleanups. - Fix broken `ec.balance` test. - Rework integer ceiling division to not use floats, which can introduce precision errors. * Introduce logic to resolve volume replica placement within EC rebalancing. This will be used to make rebalancing logic topology-aware. * Give shell.EcNode.dc a dedicated DataCenterId type.
2024-11-09delete aborted ec shards from both source and target servers (#6221)Chris Lu1-1/+4
fix https://github.com/seaweedfs/seaweedfs/issues/6205#issuecomment-2465004586
2024-11-05[shell] add admin noLock for balance (#6209)Konstantin Lebedev2-2/+12
add admin noLock for balance
2024-11-04Refactor `ec.balance` logic into a `weeed/shell/command_ec_common.go`… (#6195)Lisandro Pin2-428/+428
* Refactor `ec.balance` logic into a `weeed/shell/command_ec_common.go` standalone function. This is a prerequisite to unify the balance logic for `ec.balance` and `ec.encode'. * s/Balance()/EcBalance()/g
2024-11-04merge current message queue code changes (#6201)Chris Lu1-0/+94
* listing files to convert to parquet * write parquet files * save logs into parquet files * pass by value * compact logs into parquet format * can skip existing files * refactor * refactor * fix compilation * when no partition found * refactor * add untested parquet file read * rename package * refactor * rename files * remove unused * add merged log read func * parquet wants to know the file size * rewind by time * pass in stop ts * add stop ts * adjust log * minor * adjust log * skip .parquet files when reading message logs * skip non message files * Update subscriber_record.go * send messages * skip message data with only ts * skip non log files * update parquet-go package * ensure a valid record type * add new field to a record type * Update read_parquet_to_log.go * fix parquet file name generation * separating reading parquet and logs * add key field * add skipped logs * use in memory cache * refactor * refactor * refactor * refactor, and change compact log * refactor * rename * refactor * fix format * prefix v to version directory
2024-11-03[shell] volume.balance collect volume servers by dc rack node (#6191)Konstantin Lebedev3-8/+16
* chore: balance by rack * fix: rm check lock * fix: selected racks * fix: selected nodes * fix: containts * fix: one collectVolumeServersByDcRackNode * fix: revert lock and add lock * fix: panic test * revert noLock
2024-10-31fix format (#6185)wyang1-1/+1
unitest weed/shell fail
2024-10-28fix formatchrislu1-2/+2
2024-10-24ensure 2 volume space since actual need 1.4x volume size empty spacechrislu1-2/+2
2024-10-24correcting free volume count, factor it during ec encoding to ensure enough ↵chrislu1-3/+19
disk space available fix https://github.com/seaweedfs/seaweedfs/issues/6163
2024-10-24adjust output formatchrislu1-3/+3
2024-10-24rename proto field from DestroyTime to expire_at_secchrislu1-1/+1
For TTL volume converted into EC volume, this change may leave the volumes staying.
2024-10-22adjust help messagechrislu1-1/+1
2024-09-29fix help messagechrislu1-1/+1
2024-09-29adjust resource heavy for volume.fix.replicationchrislu2-2/+2
2024-09-29skip resource heavy commands from running on master nodeschrislu3-6/+6
2024-09-29refactorchrislu73-75/+81
2024-09-29refactorchrislu2-12/+14
2024-09-28add IsResourceHeavy() to command interfacechrislu73-2/+295
2024-09-26Fix/copy before delete replication (#6064)Max Denushev2-1/+109
* fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor * fix(shell): simplify replication check * fix(shell): add test for satisfyReplicaCurrentLocation
2024-09-24fix(volume): don't persist RO state in specific cases (#6058)Max Denushev6-16/+22
* fix(volume): don't persist RO state in specific cases * fix(volume): writable always persist
2024-09-19Vol check disk bug (#6044)dsd1-19/+34
* fix volume.check.disk * ensure multiple replica sync * add comment --------- Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
2024-09-16improve worm support (#5983)Guang Jiong Lou1-0/+2
* improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>
2024-09-09[shell] fix volume grow in shell (#5992)Konstantin Lebedev1-14/+73
* fix volume grow in shell * revert add Async * check available volume space * create a VolumeGrowRequest and remove unnecessary fields
2024-09-01Show volume server which failed to verify a chunk (#5958)Eugeniy E. Mikhailov1-4/+4
2024-08-23filer.remote.gateway not filer.remote.sync for remote.mount.buckets help ↵Shaun Alexander1-1/+1
string. (#5934)
2024-08-16EC volume supports expiration and displays expiration message when executing ↵augustazz1-1/+8
volume.list (#5895) * ec volume expire * volume.list show DestroyTime * comments * code optimization --------- Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
2024-08-15minorchrislu1-1/+1
2024-08-12load ec volume id locationschrislu1-0/+7
fix https://github.com/seaweedfs/seaweedfs/issues/5713
2024-08-08fix opposite logicchrislu1-2/+2
fix https://github.com/seaweedfs/seaweedfs/issues/5871
2024-08-08[remote.cache, remote.uncache] fix min/max agechrislu1-2/+3
fix https://github.com/seaweedfs/seaweedfs/issues/5871
2024-08-05[shell] volume.grow (#5855)Konstantin Lebedev1-0/+64
2024-08-01renamechrislu2-2/+2
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-25 08:17:29 +0000