Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add_Jittor: Passing model tests, Parameter and Module Container test #79

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

hishambarakat16
Copy link
Contributor

@hishambarakat16 hishambarakat16 commented Sep 8, 2024

+++++++++
Ammendation:

  • Reverted the TLX examples and tutorials to keep Torch as default
    +++++++++

add_Jittor: Passing model tests, Parameter and Module Container test.

Additional Functionality:
1- TrainOneStep integration.
2- Updated core/train_jt to enable accuracy to be measured. 3- Updated Jittor Optimizer: replaced gradient and apply_gradient function with jittors default functions Zero_grad() and Step(). included a new function Set() to set the trainable_weights paramters for the optimizer. 4- Updated Jittor Metrics for Accuracy, Recall, Precision and AUC. 5- Creating Jittor model tutorial file jittor_module_tutorial.py 6- Module Container and Parameter Container: Updated core_jittor ModuleList and ParameterDict to enable OrderedDict intialization which was not available due to the parent class (Jittor Module) initializing Dict by default which caused integration issues. This issue was handled by updating the function and also excluding the parent Module for these functions.

Areas to optimize integration: Enabling Jittor integration to run large model training as currently it is limited in the complexity of NN layers.

Checklist

  • I've tested that my changes are compatible with the latest version of Tensorflow.
  • I've read the Contribution Guidelines
  • I've updated the documentation if necessary.

Motivation and Context

Description

add_Jittor: Passing model tests, Parameter and Module Container test.

Additional Functionality:
1- TrainOneStep integration.
2- Updated core/train_jt to enable accuracy to be measured.
3- Updated Jittor Optimizer: replaced gradient and apply_gradient function with jittors default functions Zero_grad() and Step(). included a new function Set() to set the trainable_weights paramters for the optimizer.
4- Updated Jittor Metrics for Accuracy, Recall, Precision and AUC.
5- Creating Jittor model tutorial file jittor_module_tutorial.py
6- Module Container and Parameter Container: Updated core_jittor ModuleList and ParameterDict to enable OrderedDict intialization which was not available due to the parent class (Jittor Module) initializing Dict by default which caused integration issues. This issue was handled by updating the function and also excluding the parent Module for these functions.

Areas to optimize integration: Enabling Jittor integration to run large model training as currently it is limited in the complexity of NN layers.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant