Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enrich textual cells with visual hashes #37191

Closed
Tracked by #163011
antbell opened this issue May 27, 2019 · 7 comments
Closed
Tracked by #163011

Enrich textual cells with visual hashes #37191

antbell opened this issue May 27, 2019 · 7 comments
Labels
enhancement New value added to drive a business result Feature:Discover Discover Application Feature:FieldFormatters impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. loe:needs-research This issue requires some research before it can be worked on or estimated Team:DataDiscovery Discover App Team (Document Explorer, Saved Search, Surrounding documents, Graph)

Comments

@antbell
Copy link

antbell commented May 27, 2019

Describe the feature:

Visual hashes, such as identicon, associate images to values in a deterministic way. This allows to check for equality in the data by comparing the corresponding images.

In the "Discover" view, add the option to enrich columns with visual hashes. This will allow to notice at a glance:

  • values occurring frequently;
  • breaks in long runs of the same value;
  • outliers.

Describe a specific use case for the feature:

Visual hashes for the following mocks have been created with the TFlag visual hash from the visual-hash python library.

e-commerce example

image

The switch from Saturday to Friday is very easy to spot. It's also apparent that no continent is predominant and that in the visible data there is a long run of female buyers.

logs example

image

The response status is almost always 200 and the exceptions are very easy to spot.

Notes

There is a small probability that different values are hashed to the same images, so equality of images does not imply equality of the values, but different images always correspond to different values.

Different types of visual hashes could be used for different columns. For attributes with small cardinality, such as gender or day of the week in the above examples, even a single color would be enough. For country codes, the country flag could be used. For IPs, sub-hashes for the first and last octets could be used.

@bhavyarm bhavyarm added enhancement New value added to drive a business result Team:Visualizations Visualization editors, elastic-charts and infrastructure labels May 28, 2019
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-app

@bhavyarm bhavyarm added the Feature:Discover Discover Application label May 28, 2019
@timroes
Copy link
Contributor

timroes commented Aug 1, 2019

cc @kertal Something like that (I totally like the idea btw) would be a really good use-case for why we should be able to set field formatters per column in discover. We could easily write a field formatter for that, and then you can use it in discover on the columns you need, without the requirement of having that somehow popping up in charts or other visualizations.

@timroes timroes added Team:DataDiscovery Discover App Team (Document Explorer, Saved Search, Surrounding documents, Graph) and removed Team:Visualizations Visualization editors, elastic-charts and infrastructure labels Aug 31, 2021
@jughosta jughosta added the impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. label Nov 28, 2022
@jughosta
Copy link
Contributor

jughosta commented Nov 28, 2022

Quick update: Discover supports "Color" field formatters now.

Screenshot 2022-11-28 at 16 50 58

Screenshot 2022-11-28 at 16 51 10

@antbell
Copy link
Author

antbell commented Feb 13, 2023

A possible extension of this idea: provide the possibility to only display the visual hash for a column and only show the text value on hover. This would allow a very compact and effective representation of fields with low cardinality but large textual representation.

@dej611
Copy link
Contributor

dej611 commented Feb 13, 2023

A possible workaround for this would be, given a identicon image API, to create a runtime field and using a URL formatter of the type Image and a configuration like the following:

Screenshot 2023-02-13 at 14 49 13

Here's an example for the url.keyword field, where a runtime field url_visual_hash has been defined:
Screenshot 2023-02-13 at 14 51 22

@davismcphee davismcphee added the loe:needs-research This issue requires some research before it can be worked on or estimated label Feb 13, 2023
@kertal
Copy link
Member

kertal commented Feb 27, 2023

@dej611 this sounds like a field formatter extension, if we intend to implement it... you workaround is pretty cool!

@kertal
Copy link
Member

kertal commented Aug 9, 2023

We are closing this in order to provide better transparency of priorities. This issue won't be prioritized in the near future.
We track it in #163011 for longer term planning.

@kertal kertal closed this as completed Aug 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Feature:Discover Discover Application Feature:FieldFormatters impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. loe:needs-research This issue requires some research before it can be worked on or estimated Team:DataDiscovery Discover App Team (Document Explorer, Saved Search, Surrounding documents, Graph)
Projects
None yet
Development

No branches or pull requests

9 participants