Buffering an event until a second event is received

[Toveal]

Sometimes vector does not send an event until the next event arrives. The second event ‘Pushes’ the first event. How can I fix this?
My Sink config:

[sinks.http-out-SM-5-test]
type = "http"
inputs = ["route_by_kassa.SM-5"]
uri = "http://localhost:3001/test-event"
method = "post"
encoding.codec = "json"

request.headers.content_type = "application/json"
request.concurrency = 1
request.timeout_secs = 31536000

buffer.type = "disk"
buffer.max_size = 536_870_912
buffer.when_full = "block"

[satellite-no]

Vector "batches" events when its sending them out of a sink. The batch settings are max_bytes, max_events, & timeout_sec as soon as one of these parameters is met it will send the event out the sink. For HTTP you should be seeing an event leave the sink ever 10MB or every 1 second as those are the defaults with no default set far max event.

Depending on how often your receiving events it might appear that the next event is pushing it out but its hard to say exactly without knowing more of the setup but in general you wont see more data going out than once per second. Play with the below settings and see if a combination might satisfy what you looking far.

batch.max_bytes = 
batch.max_events = 
batch.timeout_sec = 

[Toveal]

Thank you for your reply. I tried setting batch.max_bytes = 1. Sent the data. But even with max_bytes 1 there was a situation when the packet was ‘stuck’. I'm not talking about a delay of 1 or a few seconds. I am satisfied with this result. But it does not come even after 5-10 minutes
I tried different parameters, but none of them lead me to the desired result. I have built a test bench that sends data to Mock Server on the same machine. The result is the same. Packets come immediately only when using buffer.type = "memory"
I also tried to deploy a similar configuration on the same machine, there everything comes correctly (but it's not exact. I didn't test enough).