aboutsummaryrefslogtreecommitdiff
path: root/weed/stats/metrics.go
AgeCommit message (Collapse)AuthorFilesLines
2025-11-26Metrics: Add Prometheus metrics for concurrent upload tracking (#7555)Chris Lu1-0/+36
* metrics: add Prometheus metrics for concurrent upload tracking Add Prometheus metrics to monitor concurrent upload activity for both filer and S3 servers. This provides visibility into the upload limiting feature added in the previous PR. New Metrics: - SeaweedFS_filer_in_flight_upload_bytes: Current bytes being uploaded to filer - SeaweedFS_filer_in_flight_upload_count: Current number of uploads to filer - SeaweedFS_s3_in_flight_upload_bytes: Current bytes being uploaded to S3 - SeaweedFS_s3_in_flight_upload_count: Current number of uploads to S3 The metrics are updated atomically whenever uploads start or complete, providing real-time visibility into upload concurrency levels. This helps operators: - Monitor upload concurrency in real-time - Set appropriate limits based on actual usage patterns - Detect potential bottlenecks or capacity issues - Track the effectiveness of upload limiting configuration * grafana: add dashboard panels for concurrent upload metrics Add 4 new panels to the Grafana dashboard to visualize the concurrent upload metrics added in this PR: Filer Section: - Filer Concurrent Uploads: Shows current number of concurrent uploads - Filer Concurrent Upload Bytes: Shows current bytes being uploaded S3 Gateway Section: - S3 Concurrent Uploads: Shows current number of concurrent uploads - S3 Concurrent Upload Bytes: Shows current bytes being uploaded These panels help operators monitor upload concurrency in real-time and tune the upload limiting configuration based on actual usage patterns. * more efficient
2025-11-21add build info metrics (#7525)Chris Lu1-2/+24
* add build info metrics * unused * metrics on build * size limit * once
2025-07-02[volume] refactor and add metrics for flight upload and download data limit ↵Konstantin Lebedev1-0/+36
condition (#6920) * refactor concurrentDownloadLimit * fix loop * fix cmdServer * fix: resolve conversation pr 6920 * Changes logging function (#6919) * updated logging methods for stores * updated logging methods for stores * updated logging methods for filer * updated logging methods for uploader and http_util * updated logging methods for weed server --------- Co-authored-by: akosov <a.kosov@kryptonite.ru> * Improve lock ring (#6921) * fix flaky lock ring test * add more tests * fix: build * fix: rm import util/version * fix: serverOptions * refactoring --------- Co-authored-by: Aleksey Kosov <rusyak777@list.ru> Co-authored-by: akosov <a.kosov@kryptonite.ru> Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com> Co-authored-by: chrislu <chris.lu@gmail.com>
2025-02-24added re-generating and writing the Volume UUID if it is empty (#6568)Aleksey Kosov1-2/+1
2025-02-07fix: record and delete bucket metrics after inactive (#6523)zouyixiong1-0/+4
Co-authored-by: XYZ <XYZ>
2025-01-25Add metrics for uploaded and deleted s3 objects (#6475)Hadi Zamani1-0/+18
2025-01-16Add bucket's traffic metrics (#6444)Hadi Zamani1-0/+18
* Add bucket's traffic metrics * Add bucket traffic to dashboards * Fix bucket metrics help messages * Fix variable names
2024-12-13fix: filer may crash by bucketLastActiveTsNs concurrency access. (#6350)zouyixiong1-0/+7
2024-12-12fix: record and delete bucket metrics after inactive (#6349)zouyixiong1-5/+41
2024-11-25fix missing register master metric MasterPickForWriteErrorCounter (#6277)Konstantin Lebedev1-0/+1
2024-11-03fix deadlock hang when broadcast to clients (#6184)wyang1-0/+9
fix deadlock when broadcast to clients when master thransfer leader, the old master will disconnect with all filers and volumeServers, if the cluster is a big , the broadcast messages may be more big than the max of the channel len 100, then if the KeepConnect was not listen on the channel in disconnect, it will deadlock. and the whole cluster will not serve!
2024-10-14feat: add in-flight metric for s3/file/volume-server (#6120)steve.wei1-0/+26
2024-09-04[master] refactor func ShouldGrowVolumes (#5884)Konstantin Lebedev1-5/+14
2024-07-30[master] do sync grow request only if absolutely necessary (#5821)Konstantin Lebedev1-0/+8
* do sync grow request only if absolutely necessary https://github.com/seaweedfs/seaweedfs/pull/5819 * remove check VolumeGrowStrategy Threshold on PickForWrite * fix fmt.Errorf
2024-07-12metrics stats of volume layout depends on the data center (#5775)Konstantin Lebedev1-1/+1
stats volume layout depends on the data center
2024-04-17rename VolumeServerVolumeGauge (#5504)steve.wei1-3/+3
2024-04-06[s3] fix s3 test_multipart_resend_first_finishes_last (#5471)Konstantin Lebedev1-1/+8
* try fix s3 test https://github.com/seaweedfs/seaweedfs/pull/5466 * add error handler metrics * refactor * refactor multipartExt * delete bad entry parts
2024-03-22[master] add test for PickForWrite add metrics for volume layout (#5413)Konstantin Lebedev1-0/+9
2024-01-10chore: add status code for request_total metrics (#5188)Konstantin Lebedev1-0/+18
2023-11-26go fmtchrislu1-1/+0
2023-10-03Revert "Revert "Revert "Add disk type to prometheus metrics" (#4777)""chrislu1-3/+4
This reverts commit 567d78892860f87c207beb56a3323b4b9e90dfc9.
2023-10-02Revert "Revert "Add disk type to prometheus metrics" (#4777)"chrislu1-4/+3
This reverts commit 9215ba24be0aec0c5804927cc73613560e57cbc0.
2023-08-24Implement SRV lookups for filer (#4767)Nico D'Cotta1-1/+0
2023-08-21Add time to first byte metric for s3 (#4768)SmsS41-0/+10
* Add time to first byte metric for s3 * Change second to millisecond
2023-03-08Fix binding metrics to ipv6 (#4286)Kevin Liu1-2/+10
* Fix binding metrics to ipv6 * Update weed/stats/metrics.go --------- Co-authored-by: Chris Lu <chrislusf@users.noreply.github.com>
2022-11-24[metrics] Add the ability to control bind ip (#4012)Jiffs Maverick1-2/+2
2022-10-13vacuum metrics and force sync dst files (#3832)Konstantin Lebedev1-0/+28
2022-10-07metric shows who is currently blocking the cluster or not (#3799)Konstantin Lebedev1-0/+9
* master_admin_lock Shows whether cluster is locked now or not https://github.com/seaweedfs/seaweedfs/issues/3452 * fix metric MasterAdminLock
2022-10-07configure raft metrics (#3798)Konstantin Lebedev1-20/+21
2022-07-29move to https://github.com/seaweedfs/seaweedfschrislu1-1/+1
2022-07-27leave notion to refactor after prometheus upgradeEvgeny Kuzhelev1-0/+1
2022-07-27remove all (currently existing) collection volume metricsEvgeny Kuzhelev1-0/+18
2022-06-16add bucket label to s3 prometheus metricszzq094941-2/+3
2022-06-15feat(filer.sync): add metricsServer in filer.sync.zhihao.qu1-0/+18
Metrics include: (1) the offset of the filer.sync (2) the last send timestamp of the filer subscription
2022-06-10stats master_replica_placement_mismatchKonstantin Lebedev1-0/+9
2022-01-25fix metrics master nameKonstantin Lebedev1-4/+4
2022-01-24metrics master is leaderKonstantin Lebedev1-0/+13
2022-01-24new master metricsKonstantin Lebedev1-0/+24
2021-09-07handle ipv6 addressesChris Lu1-1/+3
2021-06-22Add process metrics of weed itselfJonas Falck1-6/+4
2020-10-22add available resource statsChris Lu1-0/+9
fix https://github.com/chrislusf/seaweedfs/issues/1555
2020-10-15add number of read only volumes metricKonstantin Lebedev1-0/+9
2020-10-01s3 metrics adjust the label2.02Chris Lu1-1/+1
2020-10-01label name is statusCodeKonstantin Lebedev1-1/+1
2020-10-01add status code in S3RequestCounterKonstantin Lebedev1-2/+2
2020-09-24adjust for metrics portChris Lu1-19/+17
2020-09-24add start metrics serverKonstantin Lebedev1-0/+11
2020-09-20adjust loggingChris Lu1-0/+2
2020-09-19go fmtChris Lu1-1/+0
2020-09-18s3: collect metricsChris Lu1-0/+19
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-21 05:23:18 +0000