Skip to content

Releases: HanGuo97/flute

v0.0.7

26 Aug 21:21
Compare
Choose a tag to compare

Added bitsandbytes conversion support.

v0.0.6

03 Aug 00:31
Compare
Choose a tag to compare

Patch release.

Full Changelog: v0.0.5...v0.0.6

v0.0.5

02 Aug 13:42
Compare
Choose a tag to compare

Added support for RTX4090

v0.0.4

27 Jul 22:37
Compare
Choose a tag to compare
  1. Adding support for LLaMA-3.1 405B
  2. Lightly tuned BF16 performance, though still worse than FP16, especially in 3-bit settings.
  3. Uses newer vLLM version.

v0.0.3

20 Jul 22:58
Compare
Choose a tag to compare
included dependencies in setup

v0.0.2

20 Jul 00:01
Compare
Choose a tag to compare
v0.0.2 Pre-release
Pre-release

Renamed the distribution name to flute-kernel to avoid name conflicts.

v0.0.1

19 Jul 02:39
Compare
Choose a tag to compare
v0.0.1 Pre-release
Pre-release
updated requirements, integrations, and GitHub workflows