Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

steampipe 0.20.2 #131342

Closed
wants to merge 1 commit into from
Closed

Conversation

chenrui333
Copy link
Member

@chenrui333 chenrui333 commented May 18, 2023

Created by brew bump


Created with brew bump-formula-pr.

release notes
#### Connection Management 
- Optimise connection initialisation for high connection count ([#3394](https://github.com/turbot/steampipe/issues/3394),[#3267](https://github.com/turbot/steampipe/issues/3267),[#3236](https://github.com/turbot/steampipe/issues/3236),[#3229](https://github.com/turbot/steampipe/issues/3229),[#3413](https://github.com/turbot/steampipe/issues/3413))
  - Execute RefreshConnections asyncronously in service startup
  - Start executing queries without waiting for connections to load, add smart error handling to wait for required connection
  - Optimise autocomplete for high connection count
  - Autocomplete and inspect data available before all conections are refreshed
  - Add `steampipe_connection_state` table to indicate the loading state of connections
  - Add support for `import_schema` property in connection config, controlling whether to create a postgres schema for a steampipe connection. Closes #3407
  - Optimise schema creation by cloning connection schemas
  - Add locking to ensure only a single instance of RefreshConnections runs
  - Update refresh connections to write comments for exemplar schemas first, followed by remaining schemas.  
  • Update connection and plugin validation during refreshConnections. (#3432,#3402)
    • ensure failed connections are set to 'error' in connection state.
    • Schema names starting with steampipe_ are to be reserved for steampipe.

Mod Dependency Management

  • Support mods requiring different versions of the same depdency mod. (#3302)
  • Support transitive dependencies referencing variables from different versions of same mod.(#3337)
  • Resource references in dependency mods must be fully qualified. (#3335)
  • Locals in dependency mods cannot be referenced. (#3336)
  • Fix issue where 'mod install' on an existing mod would sometimes corrupt the 'mod.sp' file. (#3376)
  • Fix issue where mod installation would fail silently for unmet dependencies in top mod in force mode. (#3358)
  • Fix issue where mod list output is not printed in a specific order. (#3349)
  • Fix issue where a mod would install even if plugin dependencies are not met. (#3041)
  • Fix issue where running mods with unmet dependencies does not raise warnings. (#3324)
  • Fix mod commands failing when using a https prefix. (#3257)
  • Fix issue where mod install/update continues installation even with unsatisfied requirements. (#3291)
  • Fix nil reference exception when loading a mod using the legacy requires property. (#3347)

Caching

  • Updates in cache configuration to allow disabling of all caching on server. (#3258)
    • STEAMPIPE_CACHE environment variable controls both service cache-enabled and client cache-enabled
    • service cache enabled is used by the plugin manager to enable/disable caching on the plugins during startup.
    • client cache enabled is used to enable/disable the cache on the database session.
  • Introduce SQL functions to easily manipulate caching functionality - meta_cache() and meta_cache_ttl(). (#3442)

What's new?

  • Add support for time-series charts. (#1389)
  • Updates to workspace profile - add additional properties and command specific options blocks. (#3223)
  • Adds a --progress flag to plugin install to disable progress bars. (#2953)
  • Detect older versions of MacOS and warn that Steampipe does not support them. (#3256)
  • Updates the default content written to 'default.spc' and remove deprecated blocks. (#3391)
  • Show plugin name with stream (if not latest) in the progress bar during plugin update. (#3241,#3330)
  • Replace all '...' with ellipsis … in terminal output. (#3441)
  • Add check to the mod init function so users are aware if it's run in the home directory or if there are a large number of non-mod files in the path. (#2562)
  • Add query column in introspection tables to populate FullName if a QueryProvider references a named query. (#3161)
  • Improve error message when running steampipe check/dashboard outside a mod. (#3215)

Bug fixes

  • Fixes issue where not being able to open the browser results in a fatal error during login. (#3437)
  • Fixes issue where 'internal' would be added twice in the search_path if one is mentioned in the non default search path. (#3397)
  • Set mod name in resource metadata for pseudo-resources. (#3405)
  • Fix error message when connecting to steampipe cloud if login token has expired or become corrupted. (#3418)
  • Fix invalid output format error when running dashboard if output is set in terminal options. (#3293)
  • Fixes issue where execution continues even if there's an unexpected error in parsing config. (#3286)
  • Fix rendering issues when running .inspect. (#3268)
  • Fixes issue where spinner was not showing up in interactive prompt while a query was executing. (#3259)
  • Fix crash on shutdown if init not complete. (#3352)
  • Fixes issue where workspace introspection option was boolean instead of control/info/none. (#3389)
  • Fixes issue where network failures during plugin install was returning 0 exit code. (#3367)
  • Ensure successful shutdown after dashboard service start failure. (#3354)
  • Ensure plugin-manager command does not execute scheduled tasks - avoid deprecation warnings which make the plugin manager GRPC startup fail. (#3410

closes chenrui333#9

@github-actions github-actions bot added go Go use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels May 18, 2023
@chenrui333
Copy link
Member Author

Error: could not create installation directory: /Users/brew/.steampipe: mkdir /Users/brew/.steampipe: operation not permitted

@chenrui333 chenrui333 added the build failure CI fails while building the software label May 18, 2023
@binaek
Copy link

binaek commented May 19, 2023

Hi @chenrui333

We have published v0.20.1 of steampipe.

@chenrui333
Copy link
Member Author

Thanks @binaek! :)

@chenrui333 chenrui333 changed the title steampipe 0.20.0 steampipe 0.20.1 May 19, 2023
@chenrui333
Copy link
Member Author

@binaek looks like still the same issue with the path setup.

@chenrui333
Copy link
Member Author

chenrui333 commented May 19, 2023

NOTE, this did happen before in #112068

@github-actions github-actions bot added the autosquash Automatically squash pull request commits according to Homebrew style. label May 19, 2023
@chenrui333 chenrui333 changed the title steampipe 0.20.1 steampipe 0.20.2 May 20, 2023
@binaek
Copy link

binaek commented May 22, 2023

Hi @chenrui333 ,

Looks like the version bump is still facing issues.

We will be glad to help from our end!

@binaek
Copy link

binaek commented May 22, 2023

One of the efforts of the 0.20.x release is to provide more details around errors during installation / startup mostly to make them less cryptic.

We found this in the run output:
https://github.com/Homebrew/homebrew-core/actions/runs/5026449806/jobs/9014872057?pr=131342#step:3:432 which looks like an output from this line in the formula.

Could this be the issue why the test is failing?

@binaek
Copy link

binaek commented May 24, 2023

@chenrui333 I have raised a PR with the source branch of this PR at chenrui333#9

The changes I am suggesting removes the need for the Formula to be tied down to an Error output - and asserting on the output of steampipe --version

This has two advantages:

  1. Removes the need for the Formula to be dependent upon an error output - which are always evolving.
  2. Uses an output which is by-and-large frozen and less likely to change in the future.

Can you please take a look?

@chenrui333
Copy link
Member Author

@binaek the issue is not really with test, the issue is more on the completion generation side

@chenrui333
Copy link
Member Author

I see what you are doing, let me update my test, we should not remove test though (good to have them to do some sanity checking)

@github-actions github-actions bot removed the autosquash Automatically squash pull request commits according to Homebrew style. label May 24, 2023
@chenrui333 chenrui333 added ready to merge PR can be merged once CI is green and removed build failure CI fails while building the software labels May 24, 2023
@chenrui333 chenrui333 added CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. and removed ready to merge PR can be merged once CI is green labels May 25, 2023
@github-actions
Copy link
Contributor

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To keep this pull request open, add a help wanted or in progress label.

@github-actions github-actions bot added the stale No recent activity label May 27, 2023
@binaek
Copy link

binaek commented May 27, 2023

@chenrui333 this PR has been marked as stale

@github-actions github-actions bot removed the stale No recent activity label May 27, 2023
@alebcay
Copy link
Member

alebcay commented May 27, 2023

We are running steampipe completion during the build process to extract the completions out of the executable. In the build environment, writing to file locations outside of the build path, a temporary directory, is not permitted.

It seems that running steampipe completion is attempting to write into ~/.steampipe. I understand that this is a config directory, but presumably steampipe completion does not need to rely on any config. Is there some way to ensure that steampipe completion does not make write to anywhere in the filesystem but only outputs the completions to stdout, as expected?

@chenrui333
Copy link
Member Author

^^ @binaek

@binaek
Copy link

binaek commented May 28, 2023

@chenrui333 @alebcay that looks like a bug.

Thank you for bringing it to our notice.

I have opened an issue at turbot/steampipe#3485 to fix this.

@chenrui333
Copy link
Member Author

I am gonna disable the completion step and proceed with the upgrade. We can bring it back for the next release.

@chenrui333 chenrui333 added the CI-requeued PR has been re-added to the queue label May 29, 2023
Signed-off-by: Rui Chen <rui@chenrui.dev>

steampipe: update test

Signed-off-by: Rui Chen <rui@chenrui.dev>
@chenrui333
Copy link
Member Author

looks like the path issue got fixed, let's try it out in the new PR.

@chenrui333 chenrui333 closed this May 31, 2023
@chenrui333
Copy link
Member Author

Should be good now with #132379

@chenrui333 chenrui333 added the superseded PR was replaced by another PR label May 31, 2023
@chenrui333 chenrui333 deleted the bump-steampipe-0.20.0 branch January 22, 2024 13:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. CI-requeued PR has been re-added to the queue go Go use is a significant feature of the PR or issue superseded PR was replaced by another PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants