Skip to content

nitor-infotech-oss/large-datafile-process-spark

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Handle Multiple Header File with Azure key vault Integration.

Overview The purpose of this script is to download a file from Azure Blob Storage using the secret key vault credentials and separate the file data into multiple CSV files based on their headers.

Prerequisites

  • Azure Blob Storage account
  • Secret key vault credentials

Instructions

  1. Set up the necessary environment configuration for the Azure Blob Storage account and secret key vault credentials.
  2. Install the Azure Blob Storage Python library.
  3. Use the Azure Blob Storage Python library to download the file with the secret key vault credentials.
  4. Open the file and read the data.
  5. Upload the separated CSVs back to Azure Blob Storage.

Usage

  1. Set up the environment configuration variables for Azure Blob Storage and the secret key vault credentials.
  2. Run the script to download the file and separate the data into multiple CSV files.
  3. upload the separated CSV files back to Azure Blob Storage.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages