Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More flexibility on main metric used during training and evaluation #2117

Closed
MLDLMFZ opened this issue Feb 26, 2021 · 2 comments
Closed

More flexibility on main metric used during training and evaluation #2117

MLDLMFZ opened this issue Feb 26, 2021 · 2 comments
Labels
wontfix This will not be worked on

Comments

@MLDLMFZ
Copy link
Contributor

MLDLMFZ commented Feb 26, 2021

Allow different metric than micro f1 as main score (calculated in the eval method of models), which is used for monitoring model performance on dev data during training, saving of best model and learning rate scheduling

@MLDLMFZ
Copy link
Contributor Author

MLDLMFZ commented Feb 26, 2021

We are currently preparing a pull request that solves this.

MLDLMFZ added a commit to MLDLMFZ/flair that referenced this issue Mar 16, 2021
…etric

# Conflicts:
#	flair/trainers/trainer.py
MLDLMFZ added a commit to MLDLMFZ/flair that referenced this issue Mar 16, 2021
…hanges_from_5_branches

# Conflicts:
#	flair/models/text_classification_model.py
alanakbik added a commit that referenced this issue Mar 22, 2021
…n-metric

Gh 2117 more flexibility on main metric
@stale
Copy link

stale bot commented Jun 26, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the wontfix This will not be worked on label Jun 26, 2021
@stale stale bot closed this as completed Jul 3, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

1 participant