Skip to content

[MICCAI 2024 Acceptance] Official Pytorch Code for Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction

Notifications You must be signed in to change notification settings

MICV-yonsei/PETITE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Parameter Efficient Fine Tuning for
Multi-scanner PET to PET Reconstruction
MICCAI 2024

Yumin Kim*, Gayoon Choi*, Seong Jae Hwang
Yonsei University
(* Equal Contributor)

str

Requirements

conda env create -f cvt.yaml
conda activate cvt
conda env create -f unetr.yaml
conda activate unetr

Dataset Preparation

For datasets from ADNI(Alzheimer's Disease Neuroimaging Initiative) that include PET(Positron emission tomography) scans.

Data Collection/full_FDG/

Your dataset directory should be structured as follows:

  • training set: /root_dir/ADNI/Dynamic/Resolution/
  • validation set: /root_dir/ADNI/Averaged/Resolution/
Scanner Resolution Voxel spacing Manufacturer Institution
1 (192, 192, 136) (1.21875, 1.21875, 1.21875) Siemens Univ of California
2 (192, 192, 128) (1.21875, 1.21875, 1.21875) Siemens Univ of California
3 (224, 224, 81) (1.01821, 1.01821, 2.02699) Siemens Univ of California
4 (128, 128, 90) (2, 2, 2) Philips Healthcare OHSU
5 (128, 128, 63) (2.05941, 2.05941, 2.425) Siemens UCSD

To create an json file for efficient data split, run the following command:

python3 data/make_json.py

Downloading pre-trained weights

Click the links below to download the pre-trained weights for each of the five scanners. Each scanner has weights for three folds. Training details are described in our paper. Currently, available versions of pre-trained weights are as follows:

Pre-training

sh shell/train/pretraining.sh

PEFT

sh shell/train/tuning.sh

How to Apply LoRA in Conv3D

Using Low-Rank Adaptation (LoRA) with Conv3D involves modifying the Conv3D layers to integrate the LoRA technique.

  • Modified to place Lora instead of Convolutional Projection in Attention
  • nn.Conv3d -> lora.Conv3d
import loralib as lora

ADNI policy

ADNI data cannot be publicly shared by private users. It was not possible to directly upload data in this repository. However, feel free to contact me if you need more information about how to access data or about data used.

Remember to follow the ADNI data sharing and publication policy, if you are going to publish a work in which data from the ADNI database were used.

Citation

If you found this code useful, please cite the following paper:

@InProceedings{Kim_Parameter_MICCAI2024,
        author = { Kim, Yumin and Choi, Gayoon and Hwang, Seong Jae},
        title = { { Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction } },
        booktitle = {proceedings of Medical Image Computing and Computer Assisted Intervention -- MICCAI 2024},
        year = {2024},
        publisher = {Springer Nature Switzerland},
        volume = {LNCS 15007},
        month = {October},
        page = {pending}
}

About

[MICCAI 2024 Acceptance] Official Pytorch Code for Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published