Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

remove ~20K already deleted spam .com authors from Solr #77

Closed
hornc opened this issue Apr 5, 2018 · 1 comment
Closed

remove ~20K already deleted spam .com authors from Solr #77

hornc opened this issue Apr 5, 2018 · 1 comment
Assignees
@hornc

Comments

@hornc
Copy link
Collaborator

hornc commented Apr 5, 2018

Searching Authors for '.com' gives 20K results, most are already deleted spam authors (starting at page 5):

https://openlibrary.org/search/authors?q=.com&mode=everything&page=5

I can manually get them removed from Solr using the admin interface and the script I was using to update the removed 'Cd' authors: https://gist.github.com/hornc/230682dece335b998cb1b30498517251

These were not being removed from Solr once deleted, unfortunately I am still seeing deleted authors remaining in Solr after deletion even after internetarchive/openlibrary#861

Merged authors converted into redirects are now being removed from the solr index though.
@hornc hornc self-assigned this Apr 5, 2018
@hornc
Copy link
Collaborator Author

hornc commented Apr 9, 2018 •
edited
Loading

Completed. Using this script https://gist.github.com/hornc/230682dece335b998cb1b30498517251/610ec564d99089155b4b8f5992eb40657d4ca5a6

@hornc hornc closed this as completed Apr 9, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hornc hornc

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@hornc