aboutsummaryrefslogtreecommitdiff
path: root/weed/pb
AgeCommit message (Collapse)AuthorFilesLines
2025-07-16convert error fromating to %w everywhere (#6995)Chris Lu4-10/+10
2025-07-11Admin UI: Add message queue to admin UI (#6958)Chris Lu4-889/+1451
* add a menu item "Message Queue" * add a menu item "Message Queue" * move the "brokers" link under it. * add "topics", "subscribers". Add pages for them. * refactor * show topic details * admin display publisher and subscriber info * remove publisher and subscribers from the topic row pull down * collecting more stats from publishers and subscribers * fix layout * fix publisher name * add local listeners for mq broker and agent * render consumer group offsets * remove subscribers from left menu * topic with retention * support editing topic retention * show retention when listing topics * create bucket * Update s3_buckets_templ.go * embed the static assets into the binary fix https://github.com/seaweedfs/seaweedfs/issues/6964
2025-07-06Admin UI add maintenance menu (#6944)Chris Lu5-0/+1996
* add ui for maintenance * valid config loading. fix workers page. * refactor * grpc between admin and workers * add a long-running bidirectional grpc call between admin and worker * use the grpc call to heartbeat * use the grpc call to communicate * worker can remove the http client * admin uses http port + 10000 as its default grpc port * one task one package * handles connection failures gracefully with exponential backoff * grpc with insecure tls * grpc with optional tls * fix detecting tls * change time config from nano seconds to seconds * add tasks with 3 interfaces * compiles reducing hard coded * remove a couple of tasks * remove hard coded references * reduce hard coded values * remove hard coded values * remove hard coded from templ * refactor maintenance package * fix import cycle * simplify * simplify * auto register * auto register factory * auto register task types * self register types * refactor * simplify * remove one task * register ui * lazy init executor factories * use registered task types * DefaultWorkerConfig remove hard coded task types * remove more hard coded * implement get maintenance task * dynamic task configuration * "System Settings" should only have system level settings * adjust menu for tasks * ensure menu not collapsed * render job configuration well * use templ for ui of task configuration * fix ordering * fix bugs * saving duration in seconds * use value and unit for duration * Delete WORKER_REFACTORING_PLAN.md * Delete maintenance.json * Delete custom_worker_example.go * remove address from workers * remove old code from ec task * remove creating collection button * reconnect with exponential backoff * worker use security.toml * start admin server with tls info from security.toml * fix "weed admin" cli description
2025-06-24Changes logging function (#6919)Aleksey Kosov2-14/+14
* updated logging methods for stores * updated logging methods for stores * updated logging methods for filer * updated logging methods for uploader and http_util * updated logging methods for weed server --------- Co-authored-by: akosov <a.kosov@kryptonite.ru>
2025-06-20Context-based logging with request ID (#6899)Aleksey Kosov1-6/+9
2025-06-16tail-volume-uses-the-source-volume-versionchrislu2-2/+12
2025-06-16add version to volume protochrislu19-11095/+4732
2025-05-28Add context with request (#6824)Aleksey Kosov1-2/+7
2025-05-22added context to filer_client method calls (#6808)Aleksey Kosov3-35/+35
Co-authored-by: akosov <a.kosov@kryptonite.ru>
2025-05-21Added middleware for processing request_id grpc and http requests (#6805)Aleksey Kosov1-0/+26
2025-03-25sync pbchrislu1-22/+22
2025-03-09Accumulated changes for message queue (#6600)Chris Lu7-916/+625
* rename * set agent address * refactor * add agent sub * pub messages * grpc new client * can publish records via agent * send init message with session id * fmt * check cancelled request while waiting * use sessionId * handle possible nil stream * subscriber process messages * separate debug port * use atomic int64 * less logs * minor * skip io.EOF * rename * remove unused * use saved offsets * do not reuse session, since always session id is new after restart remove last active ts from SessionEntry * simplify printing * purge unused * just proxy the subscription, skipping the session step * adjust offset types * subscribe offset type and possible value * start after the known tsns * avoid wrongly set startPosition * move * remove * refactor * typo * fix * fix changed path
2025-01-20Add message queue agent (#6463)Chris Lu22-1452/+3002
* scaffold message queue agent * adjust proto, add mq_agent * add agent client implementation * remove unused function * agent publish server implementation * adding agent
2024-12-31worm grace period and retention time support (#6404)Guang Jiong Lou2-655/+692
Signed-off-by: lou <alex1988@outlook.com>
2024-12-19"golang.org/x/exp/slices" => "slices" and go fmtchrislu1-2/+2
2024-10-28backward compatible vif loadingchrislu2-720/+855
2024-10-24rename proto fieldchrislu2-510/+510
This should not have any impact.
2024-10-24rename proto field from DestroyTime to expire_at_secchrislu18-2545/+2022
For TTL volume converted into EC volume, this change may leave the volumes staying.
2024-09-24fix unclaimed spaces calculation when volumePreallocate is enabled (#6063)LHHDZ2-642/+653
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled. Signed-off-by: LHHDZ <shichanglin5@qq.com>
2024-09-24fix(volume): don't persist RO state in specific cases (#6058)Max Denushev2-830/+841
* fix(volume): don't persist RO state in specific cases * fix(volume): writable always persist
2024-09-16improve worm support (#5983)Guang Jiong Lou6-205/+216
* improve worm support Signed-off-by: lou <alex1988@outlook.com> * worm mode in filer Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * move to fs configure Signed-off-by: lou <alex1988@outlook.com> * remove flag Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * support worm hardlink Signed-off-by: lou <alex1988@outlook.com> * update after review Signed-off-by: lou <alex1988@outlook.com> * typo Signed-off-by: lou <alex1988@outlook.com> * sync filer conf Signed-off-by: lou <alex1988@outlook.com> --------- Signed-off-by: lou <alex1988@outlook.com>
2024-09-09[shell] fix volume grow in shell (#5992)Konstantin Lebedev3-733/+991
* fix volume grow in shell * revert add Async * check available volume space * create a VolumeGrowRequest and remove unnecessary fields
2024-09-05persist readonly state to volume info (#5977)Bruce2-494/+505
2024-08-29math/rand => math/rand/v2chrislu1-1/+1
2024-08-27renamechrislu1-1/+1
2024-08-16EC volume supports expiration and displays expiration message when executing ↵augustazz4-1045/+1067
volume.list (#5895) * ec volume expire * volume.list show DestroyTime * comments * code optimization --------- Co-authored-by: xuwenfeng <xuwenfeng1@zto.com>
2024-08-13renamechrislu2-491/+491
2024-08-13add dat file size into vif for ECchrislu2-496/+507
2024-08-10Merge branch 'master' into mqchrislu5-657/+957
2024-08-01conditional deletechrislu2-495/+507
2024-07-21add version to filerchrislu2-321/+344
2024-07-20Revert "add collection for buckets"chrislu2-14/+3
This reverts commit 96af5712195be37b309115795066f17c7cc6126d.
2024-07-17add collection for bucketschrislu2-3/+14
2024-06-28bootstrap filer from one peerchrislu4-453/+715
2024-06-19[fs.verify] skip failed files if entry not found on filerStore (#5693)Konstantin Lebedev1-0/+3
2024-06-15Merge branch 'master' into mqchrislu2-209/+221
2024-06-15optionally skip deleting file chunkschrislu2-209/+221
2024-05-29passing along publisher namechrislu2-284/+284
2024-05-27balance subscriberschrislu2-451/+545
need to ensure the offsets are persisted
2024-05-23coordinator receives unassignment ackchrislu2-475/+570
2024-05-21refactorchrislu2-438/+519
ToDo 1. handle unassignment on client side 2. get notified of completed unassignment 3. in consumer_group.go, balance and send unassignment
2024-05-20unusedchrislu2-500/+400
2024-05-20track offsetchrislu2-175/+196
2024-05-19start consuming ASAPchrislu2-298/+326
2024-05-19persist consumer group offsetchrislu2-422/+443
1. use one follower 2. read write consumer group offset
2024-05-17add subscribe followerchrislu3-244/+737
2024-05-13consumer instance passing MaxPartitionCount to coordinatorchrislu2-3/+15
2024-05-02renamechrislu2-27/+27
2024-05-02rename field typeschrislu2-32/+32
2024-04-27add field indexchrislu2-81/+82
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-24 20:09:38 +0000