Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

issue #558 linker not working #562

Merged
merged 2 commits into from
May 17, 2023
Merged

issue #558 linker not working #562

merged 2 commits into from
May 17, 2023

Conversation

vikasgupta78
Copy link
Contributor

linker issue fixed

@@ -130,7 +130,12 @@ public ZFrame<Dataset<Row>, Row, Column> dropDuplicates(String c, String... d) {
public ZFrame<Dataset<Row>, Row, Column> drop(String c) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

invoke drop(Column) here instead of going to spark api directly. then code is in one place only

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i don't think that would helps as:

  1. To invoke drop(Column) we would still use functions.col or df.col to get column object from column name , so dependency on spark is not reduced.
  2. Currently spark frame works as a adapter over data set where we delegate most of the methods to the data set object. This is exactly what we are doing with both drop methods. Now introducing logic in one of the drop methods instead of simple delegation does not make much sense

@vikasgupta78 vikasgupta78 changed the title issue #558 issue #558 linker not working May 2, 2023
@vikasgupta78 vikasgupta78 added this to the 0.3.5 milestone May 2, 2023
@sonalgoyal sonalgoyal merged commit 8a67b0d into zinggAI:0.3.5 May 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants