Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

verify + improve mitigation detector #610

Open
7 tasks
leondz opened this issue Apr 18, 2024 · 1 comment
Open
7 tasks

verify + improve mitigation detector #610

leondz opened this issue Apr 18, 2024 · 1 comment
Assignees
@erickgalinkin
Labels
detectors work on code that inherits from or manages Detector quality-accuracy This affects result quality/reliability
Milestone
release 0.9.1

Comments

@leondz
Copy link
Owner

leondz commented Apr 18, 2024

  • check the licensing for the data

  • measure performance

    • run over chat logs
    • take 100 +ve and 100 -ve samples
    • see what we think

  • update code / consider model

  • iterate
@leondz leondz added detectors work on code that inherits from or manages Detector quality-accuracy This affects result quality/reliability labels Apr 18, 2024
@leondz leondz added this to the rel milestone Apr 18, 2024
@erickgalinkin erickgalinkin self-assigned this Apr 18, 2024
@leondz leondz modified the milestones: rel, release 0.9.1 Apr 23, 2024
@leondz leondz mentioned this issue May 8, 2024
Merged
@leondz leondz changed the title verify mitigation detector verify + improve mitigation detector May 8, 2024
@leondz
Copy link
Owner Author

leondz commented May 24, 2024

see also #681

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@erickgalinkin erickgalinkin

Labels
detectors work on code that inherits from or manages Detector quality-accuracy This affects result quality/reliability
Projects
None yet
Milestone
release 0.9.1
Development

No branches or pull requests
2 participants
@leondz @erickgalinkin