Use encode_varint to encode vector length in DefaultAsyncBuffer and RecordSets.

[simlay]

Closes #706.

[sehz]

rebase

[simlay]

I deleted the truncation stuff because it seems that it's a bad use case to take the bytes and modify them directy. Thoughts @sehz?

[sehz]

LOL. That is to simulate where SPU truncates output bytes in order to comply with max bytes per response. This is critical test to demonstrate receivers can recover much of batches even thought some of the batches are incomplete.

[simlay]

Part of the reason I removed it was because I couldn't figure out how to change the truncation bytes. Given that the SPU truncates it, that'll also have to change (probably why the build is currently failing) so should we keep the encoder changes to RecordSet or not?

[sehz]

We should make it changes only to DefaultAsyncBuffer

[sehz]

LOL. That is to simulate where SPU truncates output bytes in order to comply with max bytes per response. This is critical test to demonstrate receivers can recover much of batches even thought some of the batches are incomplete.

[simlay]

LOL. That is to simulate where SPU truncates output bytes in order to comply with max bytes per response. This is critical test to demonstrate receivers can recover much of batches even thought some of the batches are incomplete.

Well then that clears up the importance of it.

[sehz]

crate version need to be updated as well min platform version

[simlay]

crate version need to be updated as well min platform version

I'm pretty sure I bumped all the right versions. It's kind of a breaking change to all things depending on the dataplane-protocol crate which means there's a breaking change to just about every crate in the project so that's nice.