Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

init. #1

Merged
merged 17 commits into from
Mar 6, 2024
Merged

init. #1

merged 17 commits into from
Mar 6, 2024

Commits on Mar 5, 2024

  1. init. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    f03e4a1 View commit details
    Browse the repository at this point in the history

  2. Lower Python version requirement to 3.8, 

    changed extra gcp to db-dtypes.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    6a4f2be View commit details
    Browse the repository at this point in the history

  3. Update CI workflow, with 2 stage tests with and without integrates. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    470ce34 View commit details
    Browse the repository at this point in the history

  4. Upgrade pip in CI workflow. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    1c0e6ce View commit details
    Browse the repository at this point in the history

  5. Update minimum Python and poetry-core versions 

    The minimum Python version has been updated from 3.8 to 3.9. The pip upgrade step has been removed from the continuous integration (CI) workflow.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    5546876 View commit details
    Browse the repository at this point in the history

  6. Refactor test strategy and update data type mappings 

    Data type test strategies were moved to a separate file, enhancing modularity. Mappings for datetime and timedelta were extensively updated to enhance dtype to PyArrow type conversion. New test files were added to validate date, time, and database type mappings.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    39ebe6b View commit details
    Browse the repository at this point in the history

  7. Refactor data type tests and update CI workflow 

    Split data type tests into two distinct files for general and date-specific types, enhancing test organization. The refactoring moved general database data types testing to a new file called `test_db_general_dtypes.py`. Related changes are done in the continuous integration pipeline to accommodate the divide strategy.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    0377311 View commit details
    Browse the repository at this point in the history

  8. Update poetry install commands in CI workflow. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    7aca6f2 View commit details
    Browse the repository at this point in the history

  9. In the CI workflow, the command to install the project dependencies h… 

    …as been changed from 'poetry install --only-root' to 'poetry install --sync'.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    dbc4391 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Add new datetime and numeric mappers, refactor mapper dictionary. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    6450f74 View commit details
    Browse the repository at this point in the history

  2. Add timezone and timedelta test cases. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    33661a9 View commit details
    Browse the repository at this point in the history

  3. Update pb_sts.py tests to include timedelta64[ms]. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    83b082d View commit details
    Browse the repository at this point in the history

  4. Add types-pytz as a dependency in pyproject.toml. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    a6d130a View commit details
    Browse the repository at this point in the history

  5. Update unit test command in CI workflow. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    13964c8 View commit details
    Browse the repository at this point in the history

  6. The --sync flag from the poetry install command has been removed. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    2623a49 View commit details
    Browse the repository at this point in the history

  7. Remove local virtual environment setup from GitHub workflow 

    The sections of the GitHub workflow related to setting up a local virtual environment have been removed. This change came about as these instructions were redundant in the system. The instructions to create and position the virtual environment within the project are now handled within the poetry.toml file configuration.

Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    bff6fee View commit details
    Browse the repository at this point in the history

  8. Update README with SchemArrow introduction and usage guide. 

    Signed-off-by: DanielAvdar <66269169+DanielAvdar@users.noreply.github.com>
    @DanielAvdar
    DanielAvdar committed Mar 6, 2024
    Configuration menu
    Copy the full SHA
    53478b9 View commit details
    Browse the repository at this point in the history