Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce mode and compression param resolution #2034

Merged
merged 2 commits into from
Sep 5, 2024

Conversation

jmazanec15
Copy link
Member

@jmazanec15 jmazanec15 commented Sep 4, 2024

Description

Adds mode and compression based parameter resolution. With this, if a user specifies the mode and/or compression params, we will create a default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the parameters. This will be taken in a future commit.

Still working on tests, but figured it would be good to get the PR out. Heres what I still need to do:

  • Resolve test failures
  • Block mode/compression on non-float data types
  • Add test coverage

Related Issues

#1949

Check List

  • Commits are signed per the DCO using --signoff.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@navneet1v
Copy link
Collaborator

Code looks good to me. Waiting for CI to be successful

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>
Signed-off-by: John Mazanec <jmazane@amazon.com>
@@ -95,6 +96,7 @@ public void tearDown() throws Exception {
super.tearDown();
}

@Ignore
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ignoring - there is some broken functionality around the quantization state that is being fixed.

@navneet1v navneet1v merged commit ef4922a into opensearch-project:main Sep 5, 2024
29 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 5, 2024
* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
(cherry picked from commit ef4922a)
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 5, 2024
* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
(cherry picked from commit ef4922a)
akashsha1 pushed a commit to akashsha1/k-NN that referenced this pull request Sep 16, 2024
)

* Introduce mode and compression param resolution

Adds mode and compression based parameter resolution. With this, if a
user specifies the mode and/or compression params, we will create a
default configuration with the aim of meeting those hints.

Currently, it does not contain support for overriding any of the
parameters. This will be taken in a future commit.

Signed-off-by: John Mazanec <jmazane@amazon.com>

* Modify reader changes

Signed-off-by: John Mazanec <jmazane@amazon.com>

---------

Signed-off-by: John Mazanec <jmazane@amazon.com>
Signed-off-by: Akash Shankaran <akash.shankaran@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants