Skip to content

Latest commit

 

History

History

profile

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

Redshift Data Profiling Connector

This connector extracts column-level data profiles from a Redshift database using asyncpg library.

Setup

You must run the connector using a user with SELECT privilege to all tables.

You can use the following command against all schemas:

GRANT SELECT ON ALL TABLES IN SCHEMA [Schema] TO [User]

Config File

The config file inherits all the required and optional fields from the general Redshift connector Config File.

Optional Configurations

Sampling

See Sampling Config for details.

Testing

Follow the Installation instructions to install metaphor-connectors in your environment (or virtualenv). Make sure to include either all or postgresql extra.

Run the following command to test the connector locally:

metaphor redshift.profile <config_file>

Manually verify the output after the run finishes.