Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Extract Stop words #186

Merged
merged 2 commits into from
Mar 24, 2022
Merged

Extract Stop words #186

merged 2 commits into from
Mar 24, 2022

Conversation

navinrathore
Copy link
Contributor

  • Extracting stop words for each DONOT_USE field.
  • stopWords are saved into csv files and html docs. The html docs have been linked in base documentation model.html
  • Added new config param - stopWordsCutoff (default value = 0.1)

@navinrathore
Copy link
Contributor Author

#78

@@ -507,7 +508,7 @@ public String getZinggBaseModelDir() {

@JsonIgnore
public String getZinggDocDir() {
return getZinggBaseModelDir();
return zinggDir + "/" + modelId;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do we need this change?

Copy link
Contributor Author

@navinrathore navinrathore Mar 23, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

getZinggDocDir() was unused.
getZinggBaseModelDir() is models/<id>/model directory. it contains model detail.
The getZinggDocDir() seems corresponding to doc/documentation, therefore used after modification.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks. so cant we then keep returning the getzinggBaseModelDir which is anyways what you are returning?

@sonalgoyal sonalgoyal merged commit 2423c26 into zinggAI:main Mar 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants