aboutsummaryrefslogtreecommitdiff
path: root/weed/mq/client/pub_client
AgeCommit message (Collapse)AuthorFilesLines
2025-07-16convert error fromating to %w everywhere (#6995)Chris Lu2-6/+6
2025-03-09Accumulated changes for message queue (#6600)Chris Lu2-7/+11
* rename * set agent address * refactor * add agent sub * pub messages * grpc new client * can publish records via agent * send init message with session id * fmt * check cancelled request while waiting * use sessionId * handle possible nil stream * subscriber process messages * separate debug port * use atomic int64 * less logs * minor * skip io.EOF * rename * remove unused * use saved offsets * do not reuse session, since always session id is new after restart remove last active ts from SessionEntry * simplify printing * purge unused * just proxy the subscription, skipping the session step * adjust offset types * subscribe offset type and possible value * start after the known tsns * avoid wrongly set startPosition * move * remove * refactor * typo * fix * fix changed path
2024-12-19"golang.org/x/exp/slices" => "slices" and go fmtchrislu1-1/+1
2024-05-29passing along publisher namechrislu1-0/+1
2024-05-20go fmtchrislu1-5/+5
2024-05-20Merge branch 'master' into mqchrislu1-1/+1
2024-05-20go fmtchrislu1-1/+1
2024-05-19persist consumer group offsetchrislu1-1/+1
1. use one follower 2. read write consumer group offset
2024-05-05reset last errorchrislu1-0/+1
2024-05-02add example to publish a recordchrislu1-1/+8
2024-04-12publisher send schemachrislu3-0/+15
2024-04-12rename parameterchrislu2-6/+5
2024-03-31add control message to data messagechrislu2-2/+4
2024-03-31send is_close message to brokerchrislu2-1/+17
2024-03-31add publisher name for debuggingchrislu2-2/+4
2024-03-21correctly wait for the publisher to finishchrislu1-7/+16
2024-03-20publisher is able to fully send data and receive ackschrislu2-6/+14
still needs to close the pipes cleanly
2024-03-07adjust errorchrislu1-1/+1
2024-02-29publish init add followerschrislu1-3/+4
2024-02-29go fmtchrislu2-2/+1
2024-02-05report EOF errorChris Lu1-2/+2
2024-02-05minorChris Lu1-2/+2
2024-02-05proxy requests to lock ownerChris Lu1-13/+14
2024-01-28wait 3 seconds before shutting down publish client, to wait for all messages ↵chrislu1-1/+20
to be received
2024-01-28unused codechrislu1-71/+0
2024-01-28wait for each publish clientschrislu1-2/+4
2024-01-28read will block if no itemschrislu1-1/+1
2024-01-28adjust visibilitychrislu2-2/+2
2024-01-28refactorchrislu2-10/+25
2024-01-28refactorchrislu3-29/+15
2024-01-28wait for publishing clientschrislu1-3/+11
2024-01-28clean upchrislu1-9/+0
2024-01-27publish to input bufferchrislu4-126/+91
currently, the input buffer may not exist when start to publish
2024-01-26schedule jobschrislu2-0/+182
2024-01-16remove isForPublish from LookupTopicBrokerschrislu1-2/+0
also adds a return parameter: whether the topic exists or not
2024-01-15fix publisherchrislu1-1/+1
2024-01-10passing partition generation timestampchrislu2-0/+5
2024-01-05rename functionschrislu2-3/+3
2024-01-05rename functionschrislu2-6/+6
2023-12-11Merge accumulated changes related to message queue (#5098)Chris Lu4-83/+136
* balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * balance partitions on brokers * prepare topic partition first and then publish, move partition * purge unused APIs * clean up * adjust logs * add BalanceTopics() grpc API * configure topic * configure topic command * refactor * repair missing partitions * sequence of operations to ensure ordering * proto to close publishers and consumers * rename file * topic partition versioned by unixTimeNs * create local topic partition * close publishers * randomize the client name * wait until no publishers * logs * close stop publisher channel * send last ack * comments * comment * comments * support list of brokers * add cli options * Update .gitignore * logs * return io.eof directly * refactor * optionally create topic * refactoring * detect consumer disconnection * sub client wait for more messages * subscribe by time stamp * rename * rename to sub_balancer * rename * adjust comments * rename * fix compilation * rename * rename * SubscriberToSubCoordinator * sticky rebalance * go fmt * add tests * tracking topic=>broker * merge * comment
2023-09-19fix compilationchrislu2-4/+4
2023-09-07add publisher shutdownchrislu2-0/+20
2023-09-06ack interval 128chrislu1-0/+1
2023-09-04publish, benchmarkchrislu3-48/+97
2023-09-01can pub and subchrislu2-6/+6
2023-08-28connect and publishchrislu3-48/+133
2023-08-27pub sub initial testschrislu1-0/+54
2023-08-27subchrislu1-0/+5
generated by cgit v1.2.3 (git 2.25.1) at 2025-12-25 11:37:07 +0000