New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GH-3166: add comments and one-sided dropout #3168

Merged

alanakbik merged 2 commits into master from GH-3166-expand-context

Mar 28, 2023

Collaborator

alanakbik commented Mar 28, 2023

This PR makes slight modifications to the behavior of context dropout in context expansion in TransformerEmbeddings:

the [FLERT] token is now always added, even when context is dropped
context dropout is applied to left and right context independently
more comments in the code

alanakbik added 2 commits

March 28, 2023 11:56


          GH-3166: add comments and one-sided dropout

b432e3f


          Black formatting

c8525b4

alanakbik merged commit 45deb59 into master

alanakbik deleted the GH-3166-expand-context branch

March 28, 2023 22:00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet