Skip to content

jahanxb/flcode

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

*** Please do not share/publish this code ***

*** environment ***

  • ./envfl.yml: python environment (run "conda env create -f envfl.yml" to creat environment)

*** hyperparameter ***

  • ./options.py: hyperparameter settings
  • ./options_xxx_tuned.py: well-tuned hyperparameters for different datasets (copy to options.py)

*** Example ***

python main_fed.py

sudo apt install python3.7 19 16:44 sudo apt install python3.7-venv 20 16:44 sudo apt install python3.7-dev

python main_fed.py --gpu -1 --dataset cifar --round 50

python -m grpc_tools.protoc -I/home/jahanxb/PycharmProjects/FLcode/proto --python_out=. --grpc_python_out=. /home/jahanxb/PycharmProjects/FLcode/proto/pingpong.proto

delete all rabbitmq queues

rabbitmqadmin -u jahanxb -p phdunr -f tsv -q list queues name | while read queue; do rabbitmqadmin -u jahanxb -p phdunr -q delete queue name=${queue}; done

*** Mongodb Setup *** sudo docker pull mongo:4.0.4 sudo docker run -d -p 27017:27017 --name test-mongo mongo:latest sudo docker exec -it container_name /bin/bash mongosh db. createUser( { user: "jahanxb", pwd: "phdunr", roles: [ { role: "userAdminAnyDatabase", db: "admin" } ] } )

connect to mongoserver through Mongodb Compass


*** Mongodb Setup ***

scripts/cassandra_configs/

delete this folder first: it seems it create problems if we don't

$ sudo rm -rf /var/lib/cassandra/data/system/*

I configured node 1 (10.10.1.2) as the main seader for everyone I have node11 cassandra config file, follow the instruction and replace IP address for the nodes

/etc/cassandra/cassandra-env.sh

#JVM_OPTS there is a hostname , change it to its corresponding IP Addr e.g node10 , 10.10.1.11

once it's done also restart service on all nodes

sudo systemctl daemon-reload && sudo systemctl restart cassandra

check status via

sudo nodetool status

## running on master node for 10 clients

python main_fed_master_n10.py --dataset cifar --round 10 --gpu -1 --tau 10 --num_users 10 --frac 1

About

Data Decoupling in Federated learning

Resources

Stars

Watchers

Forks

Packages

No packages published