
############################## Experiment details ##############################

dataset: femnist
dataset_dir: ../data/femnist/
output_dir: output/fedavg_cnn-2022-07-21_23:11:28/
model: cnn
num_rounds: 10
eval_every: 1
ServerType: <class 'rayleaf.experiments.fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgServer'>
client_types: [(<class 'rayleaf.experiments.fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgClient'>, 10)]
clients_per_round: 5
client_lr: 0.06
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 10
gpus_per_client_cluster: 1
num_client_clusters: 2
save_model: False

############################## Simulation ##############################

Spawning 2 ClientClusters using cuda device (this may take a while)
10 total clients: 10 FedAvgClients

>>> Training Accuracy: Round 0 <<<
+------------+------------+-------------------+-------------------+
|    average |     median |   10th percentile |   90th percentile |
|------------+------------+-------------------+-------------------|
| 0.00232897 | 0.00277027 |                 0 |        0.00299917 |
+------------+------------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|         0 |        0 |                 0 |                 0 |
+-----------+----------+-------------------+-------------------+
--- Round 1 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 1 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0663755 | 0.0675432 |         0.0551075 |         0.0776297 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 1 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0542636 | 0.050641 |         0.0219512 |          0.097619 |
+-----------+----------+-------------------+-------------------+
--- Round 2 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 2 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0637555 | 0.0674539 |         0.0528529 |         0.0741964 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 2 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
| 0.0516796 | 0.050641 |         0.0219512 |          0.097619 |
+-----------+----------+-------------------+-------------------+
--- Round 3 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 3 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.113246 |  0.12741 |         0.0704954 |           0.14091 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 3 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.121447 | 0.118304 |         0.0230769 |          0.213864 |
+-----------+----------+-------------------+-------------------+
--- Round 4 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 4 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0759825 | 0.0760431 |         0.0587814 |          0.089244 |
+-----------+-----------+-------------------+-------------------+
>>> Test Accuracy: Round 4 <<<
+-----------+-----------+-------------------+-------------------+
|   average |    median |   10th percentile |   90th percentile |
|-----------+-----------+-------------------+-------------------|
| 0.0671835 | 0.0512821 |          0.028125 |          0.114286 |
+-----------+-----------+-------------------+-------------------+
--- Round 5 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 5 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.241048 | 0.256511 |          0.145093 |          0.330439 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 5 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.22739 | 0.223611 |          0.166802 |          0.296748 |
+-----------+----------+-------------------+-------------------+
--- Round 6 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 6 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.390102 | 0.374466 |          0.281997 |          0.472237 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 6 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.338501 | 0.324561 |          0.226113 |          0.410743 |
+-----------+----------+-------------------+-------------------+
--- Round 7 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 7 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.439592 | 0.394317 |          0.322074 |           0.55468 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 7 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.416021 | 0.392308 |          0.302303 |          0.595238 |
+-----------+----------+-------------------+-------------------+
--- Round 8 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 8 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.526055 | 0.510014 |          0.367283 |          0.726026 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 8 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.457364 | 0.423878 |          0.328947 |          0.600639 |
+-----------+----------+-------------------+-------------------+
--- Round 9 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 9 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.557787 |  0.52751 |          0.448852 |          0.674174 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 9 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.51938 | 0.530488 |          0.339931 |          0.659524 |
+-----------+----------+-------------------+-------------------+
--- Round 10 of 10: Training 5 clients: 5 FedAvgClients ---
>>> Training Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.620961 | 0.578507 |          0.467522 |          0.772646 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.596899 | 0.576923 |          0.414474 |          0.771429 |
+-----------+----------+-------------------+-------------------+

############################## Post-Simulation ##############################

Total Experiment time: 0:02:29.631649
