| Age | Commit message (Collapse) | Author | Files | Lines | |
|---|---|---|---|---|---|
| 2025-05-22 | WIPorigin/changing-to-zap | chrislu | 1 | -4/+4 | |
| 2025-05-13 | Nit: unify the default `--maxParallelization` value for `weed shell` ↵ | Lisandro Pin | 1 | -1/+1 | |
| commands supporting this option (#6788) | |||||
| 2025-05-09 | Improve safety for weed shell's `ec.encode`. (#6773) | Lisandro Pin | 1 | -35/+55 | |
| Improve safety for weed shells `ec.encode`. The current process for `ec.encode` is: 1. EC shards for a volume are generated and added to a single server 2. The original volume is deleted 3. EC shards get re-balanced across the entire topology It is then possible to lose data between #2 and #3, if the underlying volume storage/server/rack/DC happens to fail, for whatever reason. As a fix, this MR reworks `ec.encode` so: * Newly created EC shards are spread across all locations for the source volume. * Source volumes are deleted only after EC shards are converted and balanced. | |||||
| 2025-05-08 | Improve parallelization for `ec.encode` (#6769) | Lisandro Pin | 1 | -34/+61 | |
| Improve parallelization for `ec.encode`. Instead of processing one volume at at time, perform all EC conversion steps (mark readonly -> generate EC shards -> delete volume -> remount) in parallel for all of them. This should substantially improve performance when EC encoding entire collections. | |||||
| 2025-02-28 | `ec.encode`: Fix resolution of target collections. (#6585) | Lisandro Pin | 1 | -8/+4 | |
| * Don't ignore empty (`""`) collection names when computing collections for a given volume ID. * `ec.encode`: Fix resolution of target collections. When no `volumeId` parameter is provided, compute volumes based on the provided collection name, even if it's empty (`""`). This restores behavior to before recent EC rebalancing rework. See also https://github.com/seaweedfs/seaweedfs/blob/ec30a504bae6cad75f859964e14c60d39cc43709/weed/shell/command_ec_encode.go#L99 . | |||||
| 2025-02-10 | `ec.encode`: Explictly mount EC shards after volume conversion. (#6528) | Lisandro Pin | 1 | -2/+12 | |
| This guarantees EC shards are immediately available after encoding, even if not affected by subsequent re-balancing. | |||||
| 2025-01-17 | `ec.encode`: Fix bug causing source volumes not being deleted after EC ↵ | Lisandro Pin | 1 | -1/+18 | |
| conversion. (#6447) This logic was originally part of `spreadEcShards()`, which got removed during the unification effort with `ec.balance` (https://github.com/seaweedfs/seaweedfs/pull/6344), accidentally breaking functionality in the process. The commit restores the deletion code for EC'd volumes - with parallelization support. | |||||
| 2024-12-19 | Fix volume replica parallelization within `ec.encode`. (#6377) | Lisandro Pin | 1 | -5/+3 | |
| See 826edd5d. | |||||
| 2024-12-18 | Allow configuring the maximum number of concurrent tasks for EC ↵ | Lisandro Pin | 1 | -2/+2 | |
| parallelization. (#6376) Follow-up to b0210df0. | |||||
| 2024-12-18 | Parallelize volume replica operations within `ec.encode`. (#6374) | Lisandro Pin | 1 | -6/+15 | |
| 2024-12-12 | Begin implementing EC balancing parallelization support. (#6342) | Lisandro Pin | 1 | -3/+2 | |
| * Begin implementing EC balancing parallelization support. Impacts both `ec.encode` and `ec.balance`, * Nit: improve type naming. * Make the goroutine workgroup handler for `EcBalance()` a bit smarter/error-proof. * Nit: unify naming for `ecBalancer` wait group methods with the rest of the module. * Fix concurrency bug. * Fix whitespace after Gitlab automerge. * Delete stray TODO. | |||||
| 2024-12-12 | Limit EC re-balancing for `ec.encode` to relevant collections when a volume ↵ | Lisandro Pin | 1 | -5/+1 | |
| ID argument is provided. (#6347) Limit EC re-balancing for `ec.encode` to relevant collections when a volume ID is provided. | |||||
| 2024-12-12 | Delete legacy balancing code for `ec.encode`. (#6344) | Lisandro Pin | 1 | -133/+0 | |
| 2024-12-10 | Unify the re-balancing logic for `ec.encode` with `ec.balance`. (#6339) | Lisandro Pin | 1 | -29/+44 | |
| Among others, this enables recent changes related to topology aware re-balancing at EC encoding time. | |||||
| 2024-11-19 | Unify usage of shell.EcNode.dc as DataCenterId. (#6258) | Lisandro Pin | 1 | -2/+2 | |
| 2024-11-09 | delete aborted ec shards from both source and target servers (#6221) | Chris Lu | 1 | -1/+4 | |
| fix https://github.com/seaweedfs/seaweedfs/issues/6205#issuecomment-2465004586 | |||||
| 2024-10-31 | fix format (#6185) | wyang | 1 | -1/+1 | |
| unitest weed/shell fail | |||||
| 2024-10-28 | fix format | chrislu | 1 | -2/+2 | |
| 2024-10-24 | ensure 2 volume space since actual need 1.4x volume size empty space | chrislu | 1 | -2/+2 | |
| 2024-10-24 | correcting free volume count, factor it during ec encoding to ensure enough ↵ | chrislu | 1 | -3/+19 | |
| disk space available fix https://github.com/seaweedfs/seaweedfs/issues/6163 | |||||
| 2024-09-29 | refactor | chrislu | 1 | -1/+1 | |
| 2024-09-28 | add IsResourceHeavy() to command interface | chrislu | 1 | -0/+4 | |
| 2024-09-24 | fix(volume): don't persist RO state in specific cases (#6058) | Max Denushev | 1 | -3/+4 | |
| * fix(volume): don't persist RO state in specific cases * fix(volume): writable always persist | |||||
| 2024-06-02 | Ignore remote volume when selecting volumes in operation ↵ | NyaMisty | 1 | -0/+4 | |
| (ec.encode/volume.tier.upload) (#5635) | |||||
| 2023-10-22 | log full percentage | chrislu | 1 | -1/+1 | |
| 2023-10-05 | default to skip if less than 4 nodes | chrislu | 1 | -0/+19 | |
| 2023-07-06 | clone volume locations in case they are changed | chrislu | 1 | -1/+1 | |
| fix https://github.com/seaweedfs/seaweedfs/issues/4642 | |||||
| 2023-06-12 | Delete volume is empty (#4561) | Konstantin Lebedev | 1 | -1/+1 | |
| * use onlyEmpty for deleteVolume https://github.com/seaweedfs/seaweedfs/issues/4559 * fix IsEmpty * fix test --------- Co-authored-by: Konstantin Lebedev <9497591+kmlebedev@users.noreply.github.co> | |||||
| 2023-02-09 | fix bug when vid not found | chrislu | 1 | -1/+1 | |
| fix https://github.com/seaweedfs/seaweedfs/issues/4193 | |||||
| 2022-08-22 | shell: stop long running jobs if lock is lost | chrislu | 1 | -0/+4 | |
| 2022-07-29 | move to https://github.com/seaweedfs/seaweedfs | chrislu | 1 | -7/+7 | |
| 2022-04-05 | erasure coding: tracking encoded/decoded volumes | chrislu | 1 | -1/+1 | |
| If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here. | |||||
| 2022-02-08 | volume.balance: add delay during tight loop | chrislu | 1 | -1/+1 | |
| fix https://github.com/chrislusf/seaweedfs/issues/2637 | |||||
| 2021-12-26 | use streaming mode for long poll grpc calls | chrislu | 1 | -1/+1 | |
| streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed. | |||||
| 2021-12-10 | add lock messages | chrislu | 1 | -1/+1 | |
| 2021-11-04 | randomize a bit for ec shards distribution | Chris Lu | 1 | -1/+2 | |
| 2021-11-01 | adjust help message since both fullPercent and quietFor are needed. | Chris Lu | 1 | -1/+1 | |
| 2021-09-13 | shell: do not need to lock to see volume -h | Chris Lu | 1 | -4/+4 | |
| 2021-09-13 | erasure coding: add cleanup step if anything goes wrong | Chris Lu | 1 | -0/+14 | |
| 2021-09-12 | change server address from string to a type | Chris Lu | 1 | -6/+7 | |
| 2021-08-13 | shell: volume.tier.move makes up changes if volume move failed | Chris Lu | 1 | -23/+1 | |
| 2021-05-06 | optional parallel copy ec shards | Chris Lu | 1 | -20/+27 | |
| fix https://github.com/chrislusf/seaweedfs/issues/2048 | |||||
| 2021-02-28 | adjust text | Chris Lu | 1 | -1/+1 | |
| 2021-02-22 | refactoring | Chris Lu | 1 | -7/+4 | |
| 2021-02-16 | this can compile now!!! | Chris Lu | 1 | -4/+6 | |
| 2020-11-28 | minor | Chris Lu | 1 | -2/+2 | |
| 2020-06-18 | erasure coding: fix cases where there are no .ecj files | Chris Lu | 1 | -0/+6 | |
| 2020-05-17 | logging | Chris Lu | 1 | -0/+1 | |
| 2020-04-23 | master: add cluster wide lock/unlock operation in weed shell | Chris Lu | 1 | -0/+4 | |
| fix https://github.com/chrislusf/seaweedfs/issues/1286 | |||||
| 2020-02-25 | remove ctx if possible | Chris Lu | 1 | -2/+2 | |
 |
index : seaweedfs/.git | |
| Unnamed repository; edit this file 'description' to name the repository. | root |
| aboutsummaryrefslogtreecommitdiff |