fix(TextEncoderStream): emoji encoding polyfill and add tests

[octet-stream]

Overview

Fixes #6458

What is it?

• Feature / enhancement
• Bug
• Docs / tests / types / typos

Description

The polyfill for TextEncoderStream introduced and proposed by me in #6310 (comment) for use in Bun and Cloudflare runtimes breaks emoji encoding. This PR fixes the encoding issue.

The issue caused by how I iterated over the input string: for...of loop relies on iterator protocol, which treats an emoji as a single character and iterates through it just once, and then String.charCodeAt(0) call was picking up just half of the symbol. Meanwhile, the Node.js' implementation iterates over the string using for loop which treats emojis as two symbols and then encodes each part of that symbol.

Use cases and why

Expected: The encoder stream polyfill should handle emoji symbols correctly.

Actual: The encoder stream polyfill breaks emoji symbols.

Checklist:

• My code follows the developer guidelines of this project
• I have performed a self-review of my own code
• I have made corresponding changes to the documentation
• Added new tests to cover the fix / functionality

[netlify]

👷 Deploy request for qwik-insights pending review.

Visit the deploys page to approve it

Name	Link
🔨 Latest commit	619d810

[pkg-pr-new]

Run & review this pull request in StackBlitz Codeflow.

@builder.io/qwik (619d810)

npm i https://pkg.pr.new/@builder.io/qwik@6466

@builder.io/qwik-city (619d810)

npm i https://pkg.pr.new/@builder.io/qwik-city@6466

eslint-plugin-qwik (619d810)

npm i https://pkg.pr.new/eslint-plugin-qwik@6466

create-qwik (619d810)

npm i https://pkg.pr.new/create-qwik@6466

[PatrickJS]

@octet-stream thanks a ton for looking into this and getting the test for it

[thejackshelton]

PR Looks good to me!

Thanks for adding tests 🙌

Yeah let's wait for e2e tests to pass before we merge

[gioboa]

Thanks for your help 👏🚀