New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can I use fastBPE in Chinese? #14

Closed

JxuHenry opened this issue May 8, 2019 · 2 comments

JxuHenry commented May 8, 2019

No description provided.

Owner

glample commented May 8, 2019

This should be fine, although in Chinese it may be simpler to just work at character level.

glample closed this as completed

echan00 commented Nov 4, 2019

@glample would you mind elaborating what you mean by "work at character level"?

lldd1001 mentioned this issue

terminate called after throwing an instance of 'c10::Error' what(): [enforce fail at inline_container.cc:319] . unexpected pos 2302963008 vs 2302962896 frame #0: c10::ThrowEnforceNotMet(char const*, int, char const*, std::string const&, void const*) + 0x55 (0x15158b1320a5 in /usr/local/lib/python3.8/dist-packages/torch/lib/libc10.so) #63

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment