Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ADAP-911] Support Metadata Freshness #615

Closed
peterallenwebb opened this issue Sep 22, 2023 · 4 comments · Fixed by #694 or #721
Closed

[ADAP-911] Support Metadata Freshness #615

peterallenwebb opened this issue Sep 22, 2023 · 4 comments · Fixed by #694 or #721
Assignees
@mikealfare
Labels
backport 1.7.latest Tag for PR to be backported to the 1.7.latest branch enhancement New feature or request

Comments

@peterallenwebb
Copy link
Contributor

peterallenwebb commented Sep 22, 2023 •
edited
Loading

Describe the feature

Support metadata-based freshness by implementing the new macro and feature flag described in #7012.

Who will this benefit?

Everyone who wants faster freshness results from Redshift!
@peterallenwebb peterallenwebb added enhancement New feature or request triage labels Sep 22, 2023
@github-actions github-actions bot changed the title Support Metadata Freshness [ADAP-911] Support Metadata Freshness Sep 22, 2023
@peterallenwebb peterallenwebb mentioned this issue Sep 22, 2023
Closed
3 tasks
@dbeatty10 dbeatty10 removed the triage label Sep 24, 2023
@misteliy
Copy link

Any updates on this issue given dbt 1.7 is coming up?

@dbeatty10 dbeatty10 mentioned this issue Dec 8, 2023
Closed
1 task
@misteliy
Copy link

misteliy commented Dec 18, 2023 •
edited
Loading

Hi, currently we have over 15k sources and having the freshness through metadata instead of querying redshift and putting more pressure on the cluster would be extremely useful. Maybe the AWS redshift team could get involved here?

@mikealfare mikealfare added the backport 1.7.latest Tag for PR to be backported to the 1.7.latest branch label Dec 19, 2023
@mikealfare mikealfare mentioned this issue Dec 19, 2023
Merged
4 tasks
@mikealfare
Copy link
Contributor

I set this up, but after doing some research it seems that Redshift may not support this. I have a request out to our partner team at Redshift; hopefully I'm missing something. Either way, I'm putting this on hold until then.

@mikealfare mikealfare self-assigned this Feb 20, 2024
@mikealfare
Copy link
Contributor

Re-opening for the backport.

@mikealfare mikealfare reopened this Feb 26, 2024
@mikealfare mikealfare linked a pull request Feb 26, 2024 that will close this issue
[Backport 1.7.latest] Implementation of metadata-based freshness #721
Merged
@MichelleArk MichelleArk mentioned this issue Mar 11, 2024
Closed
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mikealfare mikealfare

Labels
backport 1.7.latest Tag for PR to be backported to the 1.7.latest branch enhancement New feature or request
Projects
None yet
Milestone
No milestone
4 participants
@peterallenwebb @misteliy @mikealfare @dbeatty10