Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Data Explorer] Merging main to feature branch #4691

Merged

Conversation

ashwin-pc
Copy link
Member

Description

Merges main into data explorer feature branch

Issues Resolved

Screenshot

Testing the changes

Check List

  • All tests pass
    • yarn test:jest
    • yarn test:jest_integration
    • yarn test:ftr
  • New functionality includes testing.
  • New functionality has been documented.
  • Update CHANGELOG.md
  • Commits are signed per the DCO using --signoff

bandinib-amzn and others added 30 commits June 5, 2023 15:39
…roject#4149)

* Adds Repository Factory Provider

Signed-off-by: Bandini Bhopi <bandinib@amazon.com>
* enhance grouping for context menu options

Signed-off-by: David Sinclair <david@sinclair.tech>

* change log

Signed-off-by: David Sinclair <david@sinclair.tech>

* remove type export

Signed-off-by: David Sinclair <david@sinclair.tech>

* revert border and prevent destroy options

Signed-off-by: David Sinclair <david@sinclair.tech>

* update comments for building panels

Signed-off-by: David Sinclair <dsincla@rei.com>

* build panels tests and more comments

Signed-off-by: David Sinclair <dsincla@rei.com>

* add category option for context menus

Signed-off-by: David Sinclair <dsincla@rei.com>

* changelog

Signed-off-by: David Sinclair <dsincla@rei.com>

* add order to groups

Signed-off-by: David Sinclair <dsincla@rei.com>

* documentation, shorter copyrighty, minor cleanup

Signed-off-by: David Sinclair <dsincla@rei.com>

* changelog

Signed-off-by: David Sinclair <dsincla@rei.com>

---------

Signed-off-by: David Sinclair <david@sinclair.tech>
Signed-off-by: David Sinclair <dsincla@rei.com>
Signed-off-by: Ashish Agrawal <ashish81394@gmail.com>
Co-authored-by: Ashish Agrawal <ashish81394@gmail.com>
…-project#4026)

* Add bluebird replaces for src/plugins/saved_objects
* Add changelog entry

---------

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>
* links

Signed-off-by: Aigerim Suleimenova <aigerim.suleimenova27@gmail.com>

* new section for doveloper guide

Signed-off-by: Aigerim Suleimenova <aigerim.suleimenova27@gmail.com>

* updates

Signed-off-by: Aigerim Suleimenova <aigerim.suleimenova27@gmail.com>

* Update DEVELOPER_GUIDE.md

Co-authored-by: Ashwin P Chandran <ashwinpc1993@gmail.com>
Signed-off-by: Aigerim Suleimenova <aigerim.suleimenova27@gmail.com>

* Update DEVELOPER_GUIDE.md

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Aigerim Suleimenova <aigerim.suleimenova27@gmail.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Ashwin P Chandran <ashwinpc1993@gmail.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
)

* Enable data client with sample data server side

* Add dataSourceId into savedObject

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* Functional list, install uninstall

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* add change log

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* address comments

Signed-off-by: Kristen Tian <tyarong@amazon.com>

* add ut

Signed-off-by: Kristen Tian <tyarong@amazon.com>

---------

Signed-off-by: Kristen Tian <tyarong@amazon.com>
* Copy over the labels from the original PR
* Label the backport PR with `autocut`
* Label a PR that fails to backport

Signed-off-by: Miki <miki@amazon.com>
…search-project#4237)

Signed-off-by: Miki <miki@amazon.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
…d()[0]` (opensearch-project#4363)

Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
…ind()` (opensearch-project#4366)

Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
* [Lint] add custom stylelint rules and config

Adding `@osd/stylelint-config` and `@osd/stylelint-plugin-stylelint` packages.

These packages are utilized by OSD core and can be ran with the following:
`yarn lint:style`

Can be used to fix known non-compliant styling with the following:
`yarn lint:style --fix`

Can be used to audit untracked styling (based on defined rules) with the following:
```
export OUI_AUDIT_ENABLED=true
yarn lint:style
```

---

`@osd/stylelint-config`

Defines rules approved by UX and OSD core in JSON files and is added to OSD core.
Within this commit is defined `colors.json` and `global_selectors.json`.

`colors.json` defines a property that can be matched with a regex of a selector.
If the selector is tracked it will have an `approved` value and a list of `rejected`
values that UX knows if a value should be something.

`global_selectors.json` defines a selector that if tracked, it will have an `approved`
list of relative paths to files that can modify the global selector.

---

`@osd/stylelint-plugin-stylelint`

Creates the functionality that utilizes the JSON files within the `@osd/stylelint-config`.
Within this commit is defined `no_custom_colors` and `no_modifying_global_selectors` rules.

`no_custom_colors` checks if a property is a color property. It then utilizes a compliance
engine helper to check the `colors.json` to see if the property being modified has a compliance
rule available for the property for the specific selector and if it is not compliant.
For example, if a selector matches `button` and we are trying to apply `background-color: red`
to it. Stylelint will catch this and flag this as a known non-compliance issue since it knows
that it should `$euiColorWarning`. If we pass `--fix` the property will be updated to be
`$euiColorWarning`. If `OUI_AUDIT_ENABLED` is true it will catch all `background-color` being
modified that is not being defined explicitly in `colors.json`

`no_modifying_global_selectors` checks if a selector being modified is defined in
`global_selectors.json` to see if a selector not defined in a specific list of approved files.
For example, if a selector matches `#opensearch-dashboards-body` and it is being modified in
`src/core/public/rendering/_base.scss`. Stylelint will catch this and flag this as a
non-compliance issue. Since no other file should be modifying this selector. If we pass `--fix`
the styling will be complete removed from the non-compliant file.

---

Next steps:

* Migrate these packages to OUI
* Consider adding `yarn lint:style --fix` to the build release script here:
https://github.com/opensearch-project/opensearch-build/blob/main/scripts/default/opensearch-dashboards/build.sh#L89

Issue:
opensearch-project#4246

Signed-off-by: Kawika Avilla <kavilla414@gmail.com>

* fix to use find

Signed-off-by: Kawika Avilla <kavilla414@gmail.com>

* Add regex matching and OUI modification lint

Signed-off-by: Matt Provost <provomat@amazon.com>

* add changelog

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* address issues

Signed-off-by: Kawika Avilla <kavilla414@gmail.com>

---------

Signed-off-by: Kawika Avilla <kavilla414@gmail.com>
Signed-off-by: Matt Provost <provomat@amazon.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Matt Provost <provomat@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
Signed-off-by: Miki <miki@amazon.com>
Also now:
* `theme:darkMode` and `theme:version` can be configured via `defaults`
* unauthenticated users are no longer forced to light mode

Signed-off-by: Miki <miki@amazon.com>
…ct#4294)

* Refactor color to use OUI
* Pull theme value from actual active theme
* Update changelog

---------

Signed-off-by: Matt Provost <provomat@amazon.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Anan Zhuang <ananzh@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
…t#4384)

* Remove broken documentation link for Ruby API

https://apidock.com/ruby/Time/to_i is currently down for maintenance

But we don't need this link anyway, because it's talking about standard methods.
And we plan to deprecate flot_charts altogether: opensearch-project#4267

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* remove leftover link brackets

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Josh Romero <rmerqg@amazon.com>
* Fix relationships header overflow (opensearch-project#3967)

Co-authored-by: Andrey Myssak <andreymyssak@gmail.com>
Signed-off-by: Sergey Myssak <sergey.myssak@gmail.com>

* Replace relationships css file with oui classname (opensearch-project#3967)

Co-authored-by: Andrey Myssak <andreymyssak@gmail.com>
Signed-off-by: Sergey Myssak <sergey.myssak@gmail.com>

* Make title overflow wrap instead of truncation (opensearch-project#3967)

Co-authored-by: Andrey Myssak <andreymyssak@gmail.com>
Signed-off-by: Sergey Myssak <sergey.myssak@gmail.com>

* Remove icon from flyout header and wrap title

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Sergey Myssak <sergey.myssak@gmail.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Andrey Myssak <andreymyssak@gmail.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
* Remove color_util

Signed-off-by: Matt Provost <provomat@amazon.com>

* Update changelog

Signed-off-by: Matt Provost <provomat@amazon.com>

* Revert "Remove color_util"

This reverts commit 9ca9c56.

Signed-off-by: Matt Provost <provomat@amazon.com>

* Refactor color maps to use Oui color palettes

Signed-off-by: Matt Provost <provomat@amazon.com>

* Update changelog pt 2: electric boogaloo

Signed-off-by: Matt Provost <provomat@amazon.com>

* Make gradients look better

Signed-off-by: Matt Provost <provomat@amazon.com>

* Fix typescript ignore

Signed-off-by: Matt Provost <provomat@amazon.com>

* Fix tests

Signed-off-by: Matt Provost <provomat@amazon.com>

* Add todo followup

Signed-off-by: Matt Provost <provomat@amazon.com>

---------

Signed-off-by: Matt Provost <provomat@amazon.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
…#3964)

* Remove unused tags in the navigation plugin (opensearch-project#3962)

Signed-off-by: Andrey Myssak <andreymyssak@gmail.com>

* Update CHANGELOG.md (opensearch-project#3962)

Signed-off-by: Andrey Myssak <andreymyssak@gmail.com>

---------

Signed-off-by: Andrey Myssak <andreymyssak@gmail.com>
Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
Co-authored-by: Manasvini B Suryanarayana <manasvis@amazon.com>
* Add invalid properties rule

Signed-off-by: Matt Provost <provomat@amazon.com>

* Update changelog

Signed-off-by: Matt Provost <provomat@amazon.com>

* Rename old variable

Signed-off-by: Matt Provost <provomat@amazon.com>

* Add types for configs

Signed-off-by: Matt Provost <provomat@amazon.com>

* Rename rule to no_restricted_properties

Signed-off-by: Matt Provost <provomat@amazon.com>

* Refactor duplicate functions into generic one

Signed-off-by: Matt Provost <provomat@amazon.com>

* Add type definitions

Signed-off-by: Matt Provost <provomat@amazon.com>

* Add some documentation about supported config types

Signed-off-by: Matt Provost <provomat@amazon.com>

* Update changelog

Signed-off-by: Matt Provost <provomat@amazon.com>

* Optchain instead of unwrapping source file

Signed-off-by: Matt Provost <provomat@amazon.com>

---------

Signed-off-by: Matt Provost <provomat@amazon.com>
…osd-opensearch-archiver` package (opensearch-project#4142)

Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
Signed-off-by: Josh Romero <rmerqg@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
…arch-project#4408)

* Chore (deps): Bump OUI to 1.1.1 to add anomoly detection icon

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* update changelog

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Josh Romero <rmerqg@amazon.com>
…4415)

* fix: Link checker exclude

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>

* just ignore the broken URL for now

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>

---------

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>
opensearch-project#4348)

Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
…t#4427)

* chore: Adds 1.3.11 release notes



* chore: Adds 1.3.11 release notes updated



---------


(cherry picked from commit 63908e8)

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…h-project#4430)

* chore: Adds 1.3.11 release notes



* chore: Adds 1.3.11 release notes updated



* chore: Adds 1.3.11 release notes adds skipped changelog PR



---------


(cherry picked from commit 7de483f)

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
* Add typing to Stylelint rules

Signed-off-by: Matt Provost <provomat@amazon.com>

* Extract get color property parent into function

Signed-off-by: Matt Provost <provomat@amazon.com>

* Optchain instead of unwrapping source file

Signed-off-by: Matt Provost <provomat@amazon.com>

---------

Signed-off-by: Matt Provost <provomat@amazon.com>
Co-authored-by: Josh Romero <rmerqg@amazon.com>
…aletteColorBlind() (opensearch-project#4398)

Signed-off-by: Manasvini B Suryanarayana <manasvis@amazon.com>
Co-authored-by: Ashwin P Chandran <ashwinpc@amazon.com>
…pensearch-project#4411)

In this PR, we resolve semver to 7.5.3 from 5.x, 6.x and 7.x.
There are breaking changes in API in 7.5.3 compared to 5.x/6.x.
However, these API changes do not impact any usages. 

Issue Resolve
opensearch-project#4370

Signed-off-by: ananzh <ananzh@amazon.com>
Co-authored-by: Ashwin P Chandran <ashwinpc@amazon.com>
joshuarrrr and others added 7 commits August 3, 2023 10:42
opensearch-project#4658)

* Fix (Legacy Maps): Add necessary specificity for dark mode style overrides

- wrap override styles in visualization selector
- remove temp SASS var
- update attribution background to be opaque for consistency with other controls
- add raster tile filter to map tiles in dark mode, since OpenSearch doesn't serve dark mode raster tilesets
- Fix tooltip behavior so that tooltip only appears when there's content to render

fixes opensearch-project/dashboards-maps#449, fixes opensearch-project/dashboards-maps#450

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* update changelog

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* Fix spacing linter issues

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* Update font-family overrides to use CSS var definitions

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Josh Romero <rmerqg@amazon.com>
…-project#4651)

Also:
* bump `sass-loader` to a version that supports this `node-sass`

Signed-off-by: Miki <miki@amazon.com>
Also:
* Bump browserslist
* Widen browser support matrix
* Update browser typescript target to ES2018
* Bump `autoprefixer` but remove its usage as it spams the logs about it being unnecessary

Signed-off-by: Miki <miki@amazon.com>
Signed-off-by: abbyhu2000 <abigailhu2000@gmail.com>
…ensearch-project#4674)

* Add missing quotes to --font-text CSS vars

Signed-off-by: Josh Romero <rmerqg@amazon.com>

* Fix usage of --font-text CSS var

Remove quotes
Add additional leaflet font family overrides
Move legacy map custom button styles to separate file

Signed-off-by: Josh Romero <rmerqg@amazon.com>

---------

Signed-off-by: Josh Romero <rmerqg@amazon.com>
@codecov
Copy link

codecov bot commented Aug 7, 2023

Codecov Report

Merging #4691 (6bb07b9) into feature/data-explorer (521f306) will decrease coverage by 0.20%.
Report is 1 commits behind head on feature/data-explorer.
The diff coverage is 57.58%.

@@                    Coverage Diff                    @@
##           feature/data-explorer    #4691      +/-   ##
=========================================================
- Coverage                  66.50%   66.31%   -0.20%     
=========================================================
  Files                       3289     3378      +89     
  Lines                      62821    64637    +1816     
  Branches                    9788    10300     +512     
=========================================================
+ Hits                       41782    42865    +1083     
- Misses                     18658    19239     +581     
- Partials                    2381     2533     +152     
Flag Coverage Δ
Linux_1 34.83% <8.96%> (?)
Linux_2 55.04% <84.33%> (?)
Linux_3 43.89% <43.13%> (?)
Linux_4 35.10% <14.56%> (?)
Windows ?
Windows_1 34.84% <8.96%> (?)
Windows_2 55.01% <84.33%> (?)
Windows_3 43.89% <43.13%> (?)
Windows_4 35.10% <14.56%> (?)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
packages/osd-babel-preset/node_preset.js 100.00% <ø> (ø)
...osd-opensearch-archiver/src/lib/docs/test_stubs.ts 68.75% <ø> (ø)
...ch-archiver/src/lib/indices/create_index_stream.ts 69.76% <ø> (ø)
...ch-archiver/src/lib/indices/delete_index_stream.ts 50.00% <ø> (ø)
...ver/src/lib/indices/opensearch_dashboards_index.ts 0.00% <0.00%> (ø)
packages/osd-ui-shared-deps/theme.ts 41.66% <0.00%> (ø)
src/core/server/legacy/legacy_service.ts 75.38% <ø> (ø)
src/core/server/plugins/plugin_context.ts 45.45% <ø> (ø)
src/core/server/rendering/views/template.tsx 100.00% <ø> (ø)
...server/saved_objects/saved_objects_service.mock.ts 100.00% <ø> (ø)
... and 70 more

... and 207 files with indirect coverage changes

@ashwin-pc
Copy link
Member Author

CI Group 1 fails because of legacy discover style rules.

Comment on lines 26 to 27
"src/plugins/discover/public/application/components/sidebar/discover_sidebar.scss",
"src/plugins/discover/public/application/angular/doc_table/components/table_row/_open.scss"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like these paths got renamed

{
"font-family": {
"approved": [
"src/plugins/discover/public/application/_discover.scss",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here too

Signed-off-by: Ashwin P Chandran <ashwinpc@amazon.com>
@ashwin-pc ashwin-pc merged commit 838745f into opensearch-project:feature/data-explorer Aug 8, 2023
35 of 49 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
data explorer Issues related to the Data Explorer project de-angular de-angularize work discover for discover reinvent distinguished-contributor
Projects
None yet
Development

Successfully merging this pull request may close these issues.