=== 训练开始时间: 2024-11-10 19:50:27.688348 ===

  0%|          | 0/11049 [00:00<?, ?it/s][W reducer.cpp:1346] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1346] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1346] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())
[W reducer.cpp:1346] Warning: find_unused_parameters=True was specified in DDP constructor, but did not find any unused parameters in the forward pass. This flag results in an extra traversal of the autograd graph every iteration,  which can adversely affect performance. If your model indeed never has any unused parameters in the forward pass, consider turning this flag off. Note that this warning may be a false positive if your model has flow control causing later iterations to have unused parameters. (function operator())

  0%|          | 1/11049 [00:01<4:30:18,  1.47s/it]
                                                   
{'loss': 0.8792, 'grad_norm': 2.7552928924560547, 'learning_rate': 9.04977375565611e-09, 'epoch': 0.0}

  0%|          | 1/11049 [00:01<4:30:18,  1.47s/it]
  0%|          | 2/11049 [00:02<2:50:39,  1.08it/s]
                                                   
{'loss': 1.0013, 'grad_norm': 2.666252374649048, 'learning_rate': 1.809954751131222e-08, 'epoch': 0.0}

  0%|          | 2/11049 [00:02<2:50:39,  1.08it/s]
  0%|          | 3/11049 [00:02<2:24:20,  1.28it/s]
                                                   
{'loss': 0.8866, 'grad_norm': 2.2508935928344727, 'learning_rate': 2.7149321266968328e-08, 'epoch': 0.0}

  0%|          | 3/11049 [00:02<2:24:20,  1.28it/s]
  0%|          | 4/11049 [00:03<2:11:57,  1.40it/s]
                                                   
{'loss': 0.8779, 'grad_norm': 2.258808135986328, 'learning_rate': 3.619909502262444e-08, 'epoch': 0.0}

  0%|          | 4/11049 [00:03<2:11:57,  1.40it/s]
  0%|          | 5/11049 [00:03<2:05:17,  1.47it/s]
                                                   
{'loss': 1.02, 'grad_norm': 2.8289098739624023, 'learning_rate': 4.524886877828055e-08, 'epoch': 0.0}

  0%|          | 5/11049 [00:03<2:05:17,  1.47it/s]
  0%|          | 6/11049 [00:04<2:01:05,  1.52it/s]
                                                   
{'loss': 0.9655, 'grad_norm': 2.318906307220459, 'learning_rate': 5.4298642533936655e-08, 'epoch': 0.0}

  0%|          | 6/11049 [00:04<2:01:05,  1.52it/s]
  0%|          | 7/11049 [00:05<1:58:31,  1.55it/s]
                                                   
{'loss': 1.0214, 'grad_norm': 2.708559036254883, 'learning_rate': 6.334841628959276e-08, 'epoch': 0.0}

  0%|          | 7/11049 [00:05<1:58:31,  1.55it/s]
  0%|          | 8/11049 [00:05<1:56:49,  1.58it/s]
                                                   
{'loss': 1.051, 'grad_norm': 2.811492681503296, 'learning_rate': 7.239819004524888e-08, 'epoch': 0.0}

  0%|          | 8/11049 [00:05<1:56:49,  1.58it/s]
  0%|          | 9/11049 [00:06<1:55:36,  1.59it/s]
                                                   
{'loss': 0.8735, 'grad_norm': 2.380664348602295, 'learning_rate': 8.144796380090499e-08, 'epoch': 0.0}

  0%|          | 9/11049 [00:06<1:55:36,  1.59it/s]
  0%|          | 10/11049 [00:06<1:55:25,  1.59it/s]
                                                    
{'loss': 1.0068, 'grad_norm': 2.522887945175171, 'learning_rate': 9.04977375565611e-08, 'epoch': 0.0}

  0%|          | 10/11049 [00:07<1:55:25,  1.59it/s]
  0%|          | 11/11049 [00:07<1:54:36,  1.61it/s]
                                                    
{'loss': 0.9911, 'grad_norm': 2.364562749862671, 'learning_rate': 9.954751131221719e-08, 'epoch': 0.0}

  0%|          | 11/11049 [00:07<1:54:36,  1.61it/s]
  0%|          | 12/11049 [00:08<1:54:03,  1.61it/s]
                                                    
{'loss': 0.9509, 'grad_norm': 3.323326349258423, 'learning_rate': 1.0859728506787331e-07, 'epoch': 0.0}

  0%|          | 12/11049 [00:08<1:54:03,  1.61it/s]
  0%|          | 13/11049 [00:08<1:53:40,  1.62it/s]
                                                    
{'loss': 0.9959, 'grad_norm': 2.8964548110961914, 'learning_rate': 1.1764705882352942e-07, 'epoch': 0.0}

  0%|          | 13/11049 [00:08<1:53:40,  1.62it/s]
  0%|          | 14/11049 [00:09<1:53:23,  1.62it/s]
                                                    
{'loss': 1.1628, 'grad_norm': 3.8879191875457764, 'learning_rate': 1.2669683257918552e-07, 'epoch': 0.0}

  0%|          | 14/11049 [00:09<1:53:23,  1.62it/s]
  0%|          | 15/11049 [00:10<1:53:28,  1.62it/s]
                                                    
{'loss': 0.9526, 'grad_norm': 3.0315842628479004, 'learning_rate': 1.3574660633484163e-07, 'epoch': 0.0}

  0%|          | 15/11049 [00:10<1:53:28,  1.62it/s]
  0%|          | 16/11049 [00:10<1:53:14,  1.62it/s]
                                                    
{'loss': 1.1426, 'grad_norm': 3.4638497829437256, 'learning_rate': 1.4479638009049776e-07, 'epoch': 0.0}

  0%|          | 16/11049 [00:10<1:53:14,  1.62it/s]
  0%|          | 17/11049 [00:11<1:53:08,  1.63it/s]
                                                    
{'loss': 1.034, 'grad_norm': 2.9400837421417236, 'learning_rate': 1.5384615384615387e-07, 'epoch': 0.0}

  0%|          | 17/11049 [00:11<1:53:08,  1.63it/s]
  0%|          | 18/11049 [00:11<1:53:00,  1.63it/s]
                                                    
{'loss': 0.9905, 'grad_norm': 2.728464126586914, 'learning_rate': 1.6289592760180998e-07, 'epoch': 0.0}

  0%|          | 18/11049 [00:11<1:53:00,  1.63it/s]
  0%|          | 19/11049 [00:12<1:52:56,  1.63it/s]
                                                    
{'loss': 0.9276, 'grad_norm': 2.375582218170166, 'learning_rate': 1.7194570135746609e-07, 'epoch': 0.01}

  0%|          | 19/11049 [00:12<1:52:56,  1.63it/s]
  0%|          | 20/11049 [00:13<1:52:58,  1.63it/s]
                                                    
{'loss': 1.054, 'grad_norm': 2.9570693969726562, 'learning_rate': 1.809954751131222e-07, 'epoch': 0.01}

  0%|          | 20/11049 [00:13<1:52:58,  1.63it/s]
  0%|          | 21/11049 [00:13<1:52:54,  1.63it/s]
                                                    
{'loss': 0.8401, 'grad_norm': 2.711366891860962, 'learning_rate': 1.9004524886877827e-07, 'epoch': 0.01}

  0%|          | 21/11049 [00:13<1:52:54,  1.63it/s]
  0%|          | 22/11049 [00:14<1:52:54,  1.63it/s]
                                                    
{'loss': 1.0163, 'grad_norm': 3.1166489124298096, 'learning_rate': 1.9909502262443438e-07, 'epoch': 0.01}

  0%|          | 22/11049 [00:14<1:52:54,  1.63it/s]
  0%|          | 23/11049 [00:14<1:52:54,  1.63it/s]
                                                    
{'loss': 0.9862, 'grad_norm': 2.8964684009552, 'learning_rate': 2.0814479638009051e-07, 'epoch': 0.01}

  0%|          | 23/11049 [00:15<1:52:54,  1.63it/s]
  0%|          | 24/11049 [00:15<1:52:51,  1.63it/s]
                                                    
{'loss': 0.9309, 'grad_norm': 3.0667545795440674, 'learning_rate': 2.1719457013574662e-07, 'epoch': 0.01}

  0%|          | 24/11049 [00:15<1:52:51,  1.63it/s]
  0%|          | 25/11049 [00:16<1:52:48,  1.63it/s]
                                                    
{'loss': 0.9636, 'grad_norm': 3.018319606781006, 'learning_rate': 2.2624434389140273e-07, 'epoch': 0.01}

  0%|          | 25/11049 [00:16<1:52:48,  1.63it/s]
  0%|          | 26/11049 [00:16<1:52:50,  1.63it/s]
                                                    
{'loss': 1.0491, 'grad_norm': 3.101659059524536, 'learning_rate': 2.3529411764705883e-07, 'epoch': 0.01}

  0%|          | 26/11049 [00:16<1:52:50,  1.63it/s]
  0%|          | 27/11049 [00:17<1:52:45,  1.63it/s]
                                                    
{'loss': 0.835, 'grad_norm': 2.036139965057373, 'learning_rate': 2.4434389140271494e-07, 'epoch': 0.01}

  0%|          | 27/11049 [00:17<1:52:45,  1.63it/s]
  0%|          | 28/11049 [00:17<1:52:43,  1.63it/s]
                                                    
{'loss': 0.8779, 'grad_norm': 2.80488920211792, 'learning_rate': 2.5339366515837105e-07, 'epoch': 0.01}

  0%|          | 28/11049 [00:18<1:52:43,  1.63it/s]
  0%|          | 29/11049 [00:18<1:52:42,  1.63it/s]
                                                    
{'loss': 1.1022, 'grad_norm': 3.784450054168701, 'learning_rate': 2.6244343891402716e-07, 'epoch': 0.01}

  0%|          | 29/11049 [00:18<1:52:42,  1.63it/s]
  0%|          | 30/11049 [00:19<1:52:38,  1.63it/s]
                                                    
{'loss': 0.8619, 'grad_norm': 2.19671630859375, 'learning_rate': 2.7149321266968326e-07, 'epoch': 0.01}

  0%|          | 30/11049 [00:19<1:52:38,  1.63it/s]
  0%|          | 31/11049 [00:19<1:52:36,  1.63it/s]
                                                    
{'loss': 0.9893, 'grad_norm': 2.5340588092803955, 'learning_rate': 2.805429864253394e-07, 'epoch': 0.01}

  0%|          | 31/11049 [00:19<1:52:36,  1.63it/s]
  0%|          | 32/11049 [00:20<1:52:40,  1.63it/s]
                                                    
{'loss': 0.9153, 'grad_norm': 2.626168966293335, 'learning_rate': 2.8959276018099553e-07, 'epoch': 0.01}

  0%|          | 32/11049 [00:20<1:52:40,  1.63it/s]
  0%|          | 33/11049 [00:21<1:52:37,  1.63it/s]
                                                    
{'loss': 1.0425, 'grad_norm': 4.406014919281006, 'learning_rate': 2.9864253393665164e-07, 'epoch': 0.01}

  0%|          | 33/11049 [00:21<1:52:37,  1.63it/s]
  0%|          | 34/11049 [00:21<1:52:37,  1.63it/s]
                                                    
{'loss': 1.1112, 'grad_norm': 2.714390516281128, 'learning_rate': 3.0769230769230774e-07, 'epoch': 0.01}

  0%|          | 34/11049 [00:21<1:52:37,  1.63it/s]
  0%|          | 35/11049 [00:22<1:52:38,  1.63it/s]
                                                    
{'loss': 1.0514, 'grad_norm': 2.7115683555603027, 'learning_rate': 3.167420814479638e-07, 'epoch': 0.01}

  0%|          | 35/11049 [00:22<1:52:38,  1.63it/s]
  0%|          | 36/11049 [00:22<1:52:34,  1.63it/s]
                                                    
{'loss': 0.9863, 'grad_norm': 2.6709821224212646, 'learning_rate': 3.2579185520361996e-07, 'epoch': 0.01}

  0%|          | 36/11049 [00:23<1:52:34,  1.63it/s]
  0%|          | 37/11049 [00:23<1:52:34,  1.63it/s]
                                                    
{'loss': 0.9294, 'grad_norm': 2.7138383388519287, 'learning_rate': 3.34841628959276e-07, 'epoch': 0.01}

  0%|          | 37/11049 [00:23<1:52:34,  1.63it/s]
  0%|          | 38/11049 [00:24<1:52:35,  1.63it/s]
                                                    
{'loss': 0.9712, 'grad_norm': 2.7283425331115723, 'learning_rate': 3.4389140271493217e-07, 'epoch': 0.01}

  0%|          | 38/11049 [00:24<1:52:35,  1.63it/s]
  0%|          | 39/11049 [00:24<1:52:32,  1.63it/s]
                                                    
{'loss': 0.9453, 'grad_norm': 2.54508113861084, 'learning_rate': 3.529411764705883e-07, 'epoch': 0.01}

  0%|          | 39/11049 [00:24<1:52:32,  1.63it/s]
  0%|          | 40/11049 [00:25<1:52:31,  1.63it/s]
                                                    
{'loss': 0.8452, 'grad_norm': 3.3601953983306885, 'learning_rate': 3.619909502262444e-07, 'epoch': 0.01}

  0%|          | 40/11049 [00:25<1:52:31,  1.63it/s]
  0%|          | 41/11049 [00:25<1:52:30,  1.63it/s]
                                                    
{'loss': 1.0811, 'grad_norm': 3.145836353302002, 'learning_rate': 3.710407239819005e-07, 'epoch': 0.01}

  0%|          | 41/11049 [00:26<1:52:30,  1.63it/s]
  0%|          | 42/11049 [00:26<1:52:32,  1.63it/s]
                                                    
{'loss': 0.9186, 'grad_norm': 2.5146219730377197, 'learning_rate': 3.8009049773755655e-07, 'epoch': 0.01}

  0%|          | 42/11049 [00:26<1:52:32,  1.63it/s]
  0%|          | 43/11049 [00:27<1:52:35,  1.63it/s]
                                                    
{'loss': 0.9893, 'grad_norm': 2.4658567905426025, 'learning_rate': 3.891402714932127e-07, 'epoch': 0.01}

  0%|          | 43/11049 [00:27<1:52:35,  1.63it/s]
  0%|          | 44/11049 [00:27<1:52:30,  1.63it/s]
                                                    
{'loss': 0.9709, 'grad_norm': 2.53745436668396, 'learning_rate': 3.9819004524886876e-07, 'epoch': 0.01}

  0%|          | 44/11049 [00:27<1:52:30,  1.63it/s]
  0%|          | 45/11049 [00:28<1:52:29,  1.63it/s]
                                                    
{'loss': 0.9741, 'grad_norm': 2.9626715183258057, 'learning_rate': 4.072398190045249e-07, 'epoch': 0.01}

  0%|          | 45/11049 [00:28<1:52:29,  1.63it/s]
  0%|          | 46/11049 [00:29<1:52:27,  1.63it/s]
                                                    
{'loss': 1.0991, 'grad_norm': 3.486103057861328, 'learning_rate': 4.1628959276018103e-07, 'epoch': 0.01}

  0%|          | 46/11049 [00:29<1:52:27,  1.63it/s]
  0%|          | 47/11049 [00:29<1:52:30,  1.63it/s]
                                                    
{'loss': 0.9328, 'grad_norm': 2.526853084564209, 'learning_rate': 4.2533936651583713e-07, 'epoch': 0.01}

  0%|          | 47/11049 [00:29<1:52:30,  1.63it/s]
  0%|          | 48/11049 [00:30<1:52:29,  1.63it/s]
                                                    
{'loss': 0.9305, 'grad_norm': 2.707380533218384, 'learning_rate': 4.3438914027149324e-07, 'epoch': 0.01}

  0%|          | 48/11049 [00:30<1:52:29,  1.63it/s]
  0%|          | 49/11049 [00:30<1:52:28,  1.63it/s]
                                                    
{'loss': 0.9594, 'grad_norm': 2.629138946533203, 'learning_rate': 4.434389140271494e-07, 'epoch': 0.01}

  0%|          | 49/11049 [00:31<1:52:28,  1.63it/s]
  0%|          | 50/11049 [00:31<1:52:29,  1.63it/s]
                                                    
{'loss': 0.997, 'grad_norm': 3.023271322250366, 'learning_rate': 4.5248868778280546e-07, 'epoch': 0.01}

  0%|          | 50/11049 [00:31<1:52:29,  1.63it/s]
  0%|          | 51/11049 [00:32<1:52:26,  1.63it/s]
                                                    
{'loss': 0.8448, 'grad_norm': 2.482598304748535, 'learning_rate': 4.615384615384616e-07, 'epoch': 0.01}

  0%|          | 51/11049 [00:32<1:52:26,  1.63it/s]
  0%|          | 52/11049 [00:32<1:52:25,  1.63it/s]
                                                    
{'loss': 1.0159, 'grad_norm': 2.7091526985168457, 'learning_rate': 4.7058823529411767e-07, 'epoch': 0.01}

  0%|          | 52/11049 [00:32<1:52:25,  1.63it/s]
  0%|          | 53/11049 [00:33<1:52:24,  1.63it/s]
                                                    
{'loss': 0.9601, 'grad_norm': 2.472470760345459, 'learning_rate': 4.796380090497738e-07, 'epoch': 0.01}

  0%|          | 53/11049 [00:33<1:52:24,  1.63it/s]
  0%|          | 54/11049 [00:33<1:52:32,  1.63it/s]
                                                    
{'loss': 0.8965, 'grad_norm': 2.6083855628967285, 'learning_rate': 4.886877828054299e-07, 'epoch': 0.01}

  0%|          | 54/11049 [00:34<1:52:32,  1.63it/s]
  0%|          | 55/11049 [00:34<1:52:25,  1.63it/s]
                                                    
{'loss': 1.0336, 'grad_norm': 2.456610918045044, 'learning_rate': 4.977375565610859e-07, 'epoch': 0.01}

  0%|          | 55/11049 [00:34<1:52:25,  1.63it/s]
  1%|          | 56/11049 [00:35<1:52:23,  1.63it/s]
                                                    
{'loss': 1.0187, 'grad_norm': 2.9753823280334473, 'learning_rate': 5.067873303167421e-07, 'epoch': 0.02}

  1%|          | 56/11049 [00:35<1:52:23,  1.63it/s]
  1%|          | 57/11049 [00:35<1:52:23,  1.63it/s]
                                                    
{'loss': 0.8721, 'grad_norm': 3.0132203102111816, 'learning_rate': 5.158371040723982e-07, 'epoch': 0.02}

  1%|          | 57/11049 [00:35<1:52:23,  1.63it/s]
  1%|          | 58/11049 [00:36<1:52:25,  1.63it/s]
                                                    
{'loss': 0.9152, 'grad_norm': 2.525344133377075, 'learning_rate': 5.248868778280543e-07, 'epoch': 0.02}

  1%|          | 58/11049 [00:36<1:52:25,  1.63it/s]
  1%|          | 59/11049 [00:37<1:52:23,  1.63it/s]
                                                    
{'loss': 0.9945, 'grad_norm': 2.257838249206543, 'learning_rate': 5.339366515837105e-07, 'epoch': 0.02}

  1%|          | 59/11049 [00:37<1:52:23,  1.63it/s]
  1%|          | 60/11049 [00:37<1:52:23,  1.63it/s]
                                                    
{'loss': 0.8702, 'grad_norm': 2.4312615394592285, 'learning_rate': 5.429864253393665e-07, 'epoch': 0.02}

  1%|          | 60/11049 [00:37<1:52:23,  1.63it/s]
  1%|          | 61/11049 [00:38<1:52:22,  1.63it/s]
                                                    
{'loss': 0.9839, 'grad_norm': 3.1867692470550537, 'learning_rate': 5.520361990950227e-07, 'epoch': 0.02}

  1%|          | 61/11049 [00:38<1:52:22,  1.63it/s]
  1%|          | 62/11049 [00:38<1:52:27,  1.63it/s]
                                                    
{'loss': 0.9991, 'grad_norm': 2.793937921524048, 'learning_rate': 5.610859728506788e-07, 'epoch': 0.02}

  1%|          | 62/11049 [00:38<1:52:27,  1.63it/s]
  1%|          | 63/11049 [00:39<1:52:21,  1.63it/s]
                                                    
{'loss': 0.7877, 'grad_norm': 2.185526132583618, 'learning_rate': 5.701357466063349e-07, 'epoch': 0.02}

  1%|          | 63/11049 [00:39<1:52:21,  1.63it/s]
  1%|          | 64/11049 [00:40<1:52:21,  1.63it/s]
                                                    
{'loss': 0.722, 'grad_norm': 1.711723804473877, 'learning_rate': 5.791855203619911e-07, 'epoch': 0.02}

  1%|          | 64/11049 [00:40<1:52:21,  1.63it/s]
  1%|          | 65/11049 [00:40<1:52:24,  1.63it/s]
                                                    
{'loss': 0.9764, 'grad_norm': 2.637816905975342, 'learning_rate': 5.882352941176471e-07, 'epoch': 0.02}

  1%|          | 65/11049 [00:40<1:52:24,  1.63it/s]
  1%|          | 66/11049 [00:41<1:52:23,  1.63it/s]
                                                    
{'loss': 1.0197, 'grad_norm': 4.763244152069092, 'learning_rate': 5.972850678733033e-07, 'epoch': 0.02}

  1%|          | 66/11049 [00:41<1:52:23,  1.63it/s]
  1%|          | 67/11049 [00:41<1:52:19,  1.63it/s]
                                                    
{'loss': 0.9563, 'grad_norm': 2.5750977993011475, 'learning_rate': 6.063348416289593e-07, 'epoch': 0.02}

  1%|          | 67/11049 [00:42<1:52:19,  1.63it/s]
  1%|          | 68/11049 [00:42<1:52:21,  1.63it/s]
                                                    
{'loss': 0.8727, 'grad_norm': 2.1659560203552246, 'learning_rate': 6.153846153846155e-07, 'epoch': 0.02}

  1%|          | 68/11049 [00:42<1:52:21,  1.63it/s]
  1%|          | 69/11049 [00:43<1:52:16,  1.63it/s]
                                                    
{'loss': 0.8032, 'grad_norm': 2.6942403316497803, 'learning_rate': 6.244343891402715e-07, 'epoch': 0.02}

  1%|          | 69/11049 [00:43<1:52:16,  1.63it/s]
  1%|          | 70/11049 [00:43<1:52:11,  1.63it/s]
                                                    
{'loss': 0.8213, 'grad_norm': 2.7697644233703613, 'learning_rate': 6.334841628959276e-07, 'epoch': 0.02}

  1%|          | 70/11049 [00:43<1:52:11,  1.63it/s]
  1%|          | 71/11049 [00:44<1:52:11,  1.63it/s]
                                                    
{'loss': 0.903, 'grad_norm': 2.9661083221435547, 'learning_rate': 6.425339366515836e-07, 'epoch': 0.02}

  1%|          | 71/11049 [00:44<1:52:11,  1.63it/s]
  1%|          | 72/11049 [00:44<1:52:13,  1.63it/s]
                                                    
{'loss': 0.8299, 'grad_norm': 2.6656410694122314, 'learning_rate': 6.515837104072399e-07, 'epoch': 0.02}

  1%|          | 72/11049 [00:45<1:52:13,  1.63it/s]
  1%|          | 73/11049 [00:45<1:52:13,  1.63it/s]
                                                    
{'loss': 0.9863, 'grad_norm': 2.9586334228515625, 'learning_rate': 6.60633484162896e-07, 'epoch': 0.02}

  1%|          | 73/11049 [00:45<1:52:13,  1.63it/s]
  1%|          | 74/11049 [00:46<1:52:14,  1.63it/s]
                                                    
{'loss': 0.7998, 'grad_norm': 2.1303133964538574, 'learning_rate': 6.69683257918552e-07, 'epoch': 0.02}

  1%|          | 74/11049 [00:46<1:52:14,  1.63it/s]
  1%|          | 75/11049 [00:46<1:52:14,  1.63it/s]
                                                    
{'loss': 0.9164, 'grad_norm': 2.512791633605957, 'learning_rate': 6.787330316742082e-07, 'epoch': 0.02}

  1%|          | 75/11049 [00:46<1:52:14,  1.63it/s]
  1%|          | 76/11049 [00:47<1:52:12,  1.63it/s]
                                                    
{'loss': 0.8763, 'grad_norm': 2.060007095336914, 'learning_rate': 6.877828054298643e-07, 'epoch': 0.02}

  1%|          | 76/11049 [00:47<1:52:12,  1.63it/s]
  1%|          | 77/11049 [00:48<1:52:11,  1.63it/s]
                                                    
{'loss': 0.8998, 'grad_norm': 2.2118325233459473, 'learning_rate': 6.968325791855204e-07, 'epoch': 0.02}

  1%|          | 77/11049 [00:48<1:52:11,  1.63it/s]
  1%|          | 78/11049 [00:48<1:52:11,  1.63it/s]
                                                    
{'loss': 0.8729, 'grad_norm': 2.1497185230255127, 'learning_rate': 7.058823529411766e-07, 'epoch': 0.02}

  1%|          | 78/11049 [00:48<1:52:11,  1.63it/s]
  1%|          | 79/11049 [00:49<1:52:12,  1.63it/s]
                                                    
{'loss': 0.8993, 'grad_norm': 2.618656873703003, 'learning_rate': 7.149321266968326e-07, 'epoch': 0.02}

  1%|          | 79/11049 [00:49<1:52:12,  1.63it/s]
  1%|          | 80/11049 [00:49<1:52:14,  1.63it/s]
                                                    
{'loss': 0.8143, 'grad_norm': 2.1577298641204834, 'learning_rate': 7.239819004524888e-07, 'epoch': 0.02}

  1%|          | 80/11049 [00:50<1:52:14,  1.63it/s]
  1%|          | 81/11049 [00:50<1:52:13,  1.63it/s]
                                                    
{'loss': 1.0049, 'grad_norm': 2.617392063140869, 'learning_rate': 7.330316742081449e-07, 'epoch': 0.02}

  1%|          | 81/11049 [00:50<1:52:13,  1.63it/s]
  1%|          | 82/11049 [00:51<1:52:08,  1.63it/s]
                                                    
{'loss': 0.907, 'grad_norm': 2.4121289253234863, 'learning_rate': 7.42081447963801e-07, 'epoch': 0.02}

  1%|          | 82/11049 [00:51<1:52:08,  1.63it/s]
  1%|          | 83/11049 [00:51<1:52:13,  1.63it/s]
                                                    
{'loss': 0.9839, 'grad_norm': 2.60573148727417, 'learning_rate': 7.51131221719457e-07, 'epoch': 0.02}

  1%|          | 83/11049 [00:51<1:52:13,  1.63it/s]
  1%|          | 84/11049 [00:52<1:52:10,  1.63it/s]
                                                    
{'loss': 0.8218, 'grad_norm': 2.6154966354370117, 'learning_rate': 7.601809954751131e-07, 'epoch': 0.02}

  1%|          | 84/11049 [00:52<1:52:10,  1.63it/s]
  1%|          | 85/11049 [00:52<1:52:09,  1.63it/s]
                                                    
{'loss': 0.8345, 'grad_norm': 2.454322576522827, 'learning_rate': 7.692307692307694e-07, 'epoch': 0.02}

  1%|          | 85/11049 [00:53<1:52:09,  1.63it/s]
  1%|          | 86/11049 [00:53<1:52:19,  1.63it/s]
                                                    
{'loss': 0.828, 'grad_norm': 2.3060643672943115, 'learning_rate': 7.782805429864254e-07, 'epoch': 0.02}

  1%|          | 86/11049 [00:53<1:52:19,  1.63it/s]
  1%|          | 87/11049 [00:54<1:52:17,  1.63it/s]
                                                    
{'loss': 0.9275, 'grad_norm': 2.0890042781829834, 'learning_rate': 7.873303167420815e-07, 'epoch': 0.02}

  1%|          | 87/11049 [00:54<1:52:17,  1.63it/s]
  1%|          | 88/11049 [00:54<1:52:17,  1.63it/s]
                                                    
{'loss': 0.9082, 'grad_norm': 2.289246082305908, 'learning_rate': 7.963800904977375e-07, 'epoch': 0.02}

  1%|          | 88/11049 [00:54<1:52:17,  1.63it/s]
  1%|          | 89/11049 [00:55<1:52:15,  1.63it/s]
                                                    
{'loss': 0.8844, 'grad_norm': 2.565133810043335, 'learning_rate': 8.054298642533938e-07, 'epoch': 0.02}

  1%|          | 89/11049 [00:55<1:52:15,  1.63it/s]
  1%|          | 90/11049 [00:56<1:52:10,  1.63it/s]
                                                    
{'loss': 0.8005, 'grad_norm': 1.8540935516357422, 'learning_rate': 8.144796380090498e-07, 'epoch': 0.02}

  1%|          | 90/11049 [00:56<1:52:10,  1.63it/s]
  1%|          | 91/11049 [00:56<1:52:07,  1.63it/s]
                                                    
{'loss': 0.7381, 'grad_norm': 1.9099034070968628, 'learning_rate': 8.235294117647059e-07, 'epoch': 0.02}

  1%|          | 91/11049 [00:56<1:52:07,  1.63it/s]
  1%|          | 92/11049 [00:57<1:52:08,  1.63it/s]
                                                    
{'loss': 0.8073, 'grad_norm': 1.9523980617523193, 'learning_rate': 8.325791855203621e-07, 'epoch': 0.02}

  1%|          | 92/11049 [00:57<1:52:08,  1.63it/s]
  1%|          | 93/11049 [00:57<1:52:05,  1.63it/s]
                                                    
{'loss': 1.0492, 'grad_norm': 2.522533416748047, 'learning_rate': 8.416289592760182e-07, 'epoch': 0.03}

  1%|          | 93/11049 [00:58<1:52:05,  1.63it/s]
  1%|          | 94/11049 [00:58<1:52:08,  1.63it/s]
                                                    
{'loss': 1.0048, 'grad_norm': 2.186619281768799, 'learning_rate': 8.506787330316743e-07, 'epoch': 0.03}

  1%|          | 94/11049 [00:58<1:52:08,  1.63it/s]
  1%|          | 95/11049 [00:59<1:52:04,  1.63it/s]
                                                    
{'loss': 0.8243, 'grad_norm': 2.788179874420166, 'learning_rate': 8.597285067873304e-07, 'epoch': 0.03}

  1%|          | 95/11049 [00:59<1:52:04,  1.63it/s]
  1%|          | 96/11049 [00:59<1:52:01,  1.63it/s]
                                                    
{'loss': 0.7769, 'grad_norm': 2.053231716156006, 'learning_rate': 8.687782805429865e-07, 'epoch': 0.03}

  1%|          | 96/11049 [00:59<1:52:01,  1.63it/s]
  1%|          | 97/11049 [01:00<1:52:00,  1.63it/s]
                                                    
{'loss': 0.8395, 'grad_norm': 2.003537654876709, 'learning_rate': 8.778280542986425e-07, 'epoch': 0.03}

  1%|          | 97/11049 [01:00<1:52:00,  1.63it/s]
  1%|          | 98/11049 [01:00<1:51:58,  1.63it/s]
                                                    
{'loss': 0.8518, 'grad_norm': 2.342658758163452, 'learning_rate': 8.868778280542988e-07, 'epoch': 0.03}

  1%|          | 98/11049 [01:01<1:51:58,  1.63it/s]
  1%|          | 99/11049 [01:01<1:52:01,  1.63it/s]
                                                    
{'loss': 0.7238, 'grad_norm': 1.6521934270858765, 'learning_rate': 8.959276018099549e-07, 'epoch': 0.03}

  1%|          | 99/11049 [01:01<1:52:01,  1.63it/s]
  1%|          | 100/11049 [01:02<1:51:58,  1.63it/s]
                                                     
{'loss': 0.7695, 'grad_norm': 1.6388832330703735, 'learning_rate': 9.049773755656109e-07, 'epoch': 0.03}

  1%|          | 100/11049 [01:02<1:51:58,  1.63it/s]
  1%|          | 101/11049 [01:02<1:51:57,  1.63it/s]
                                                     
{'loss': 0.8299, 'grad_norm': 1.817150354385376, 'learning_rate': 9.14027149321267e-07, 'epoch': 0.03}

  1%|          | 101/11049 [01:02<1:51:57,  1.63it/s]
  1%|          | 102/11049 [01:03<1:51:55,  1.63it/s]
                                                     
{'loss': 0.7785, 'grad_norm': 1.5918525457382202, 'learning_rate': 9.230769230769232e-07, 'epoch': 0.03}

  1%|          | 102/11049 [01:03<1:51:55,  1.63it/s]
  1%|          | 103/11049 [01:04<1:51:52,  1.63it/s]
                                                     
{'loss': 0.6064, 'grad_norm': 1.5308961868286133, 'learning_rate': 9.321266968325793e-07, 'epoch': 0.03}

  1%|          | 103/11049 [01:04<1:51:52,  1.63it/s]
  1%|          | 104/11049 [01:04<1:52:09,  1.63it/s]
                                                     
{'loss': 0.7505, 'grad_norm': 1.4733240604400635, 'learning_rate': 9.411764705882353e-07, 'epoch': 0.03}

  1%|          | 104/11049 [01:04<1:52:09,  1.63it/s]
  1%|          | 105/11049 [01:05<1:52:01,  1.63it/s]
                                                     
{'loss': 0.81, 'grad_norm': 1.8185012340545654, 'learning_rate': 9.502262443438914e-07, 'epoch': 0.03}

  1%|          | 105/11049 [01:05<1:52:01,  1.63it/s]
  1%|          | 106/11049 [01:05<1:51:58,  1.63it/s]
                                                     
{'loss': 0.8161, 'grad_norm': 1.8583601713180542, 'learning_rate': 9.592760180995477e-07, 'epoch': 0.03}

  1%|          | 106/11049 [01:05<1:51:58,  1.63it/s]
  1%|          | 107/11049 [01:06<1:51:57,  1.63it/s]
                                                     
{'loss': 0.9192, 'grad_norm': 1.8320999145507812, 'learning_rate': 9.683257918552038e-07, 'epoch': 0.03}

  1%|          | 107/11049 [01:06<1:51:57,  1.63it/s]
  1%|          | 108/11049 [01:07<1:51:58,  1.63it/s]
                                                     
{'loss': 0.8026, 'grad_norm': 1.7297660112380981, 'learning_rate': 9.773755656108598e-07, 'epoch': 0.03}

  1%|          | 108/11049 [01:07<1:51:58,  1.63it/s]
  1%|          | 109/11049 [01:07<1:52:07,  1.63it/s]
                                                     
{'loss': 0.6352, 'grad_norm': 1.315548300743103, 'learning_rate': 9.86425339366516e-07, 'epoch': 0.03}

  1%|          | 109/11049 [01:07<1:52:07,  1.63it/s]
  1%|          | 110/11049 [01:08<1:52:03,  1.63it/s]
                                                     
{'loss': 0.9172, 'grad_norm': 3.6814427375793457, 'learning_rate': 9.954751131221719e-07, 'epoch': 0.03}

  1%|          | 110/11049 [01:08<1:52:03,  1.63it/s]
  1%|          | 111/11049 [01:08<1:52:00,  1.63it/s]
                                                     
{'loss': 0.7304, 'grad_norm': 1.8819327354431152, 'learning_rate': 1.0045248868778282e-06, 'epoch': 0.03}

  1%|          | 111/11049 [01:09<1:52:00,  1.63it/s]
  1%|          | 112/11049 [01:09<1:51:55,  1.63it/s]
                                                     
{'loss': 0.7885, 'grad_norm': 1.532655119895935, 'learning_rate': 1.0135746606334842e-06, 'epoch': 0.03}

  1%|          | 112/11049 [01:09<1:51:55,  1.63it/s]
  1%|          | 113/11049 [01:10<1:51:53,  1.63it/s]
                                                     
{'loss': 0.7606, 'grad_norm': 1.9340934753417969, 'learning_rate': 1.0226244343891404e-06, 'epoch': 0.03}

  1%|          | 113/11049 [01:10<1:51:53,  1.63it/s]
  1%|          | 114/11049 [01:10<1:52:03,  1.63it/s]
                                                     
{'loss': 0.673, 'grad_norm': 1.6010140180587769, 'learning_rate': 1.0316742081447963e-06, 'epoch': 0.03}

  1%|          | 114/11049 [01:10<1:52:03,  1.63it/s]
  1%|          | 115/11049 [01:11<1:51:57,  1.63it/s]
                                                     
{'loss': 0.751, 'grad_norm': 1.6189866065979004, 'learning_rate': 1.0407239819004527e-06, 'epoch': 0.03}

  1%|          | 115/11049 [01:11<1:51:57,  1.63it/s]
  1%|          | 116/11049 [01:12<1:51:52,  1.63it/s]
                                                     
{'loss': 0.8459, 'grad_norm': 1.793450951576233, 'learning_rate': 1.0497737556561086e-06, 'epoch': 0.03}

  1%|          | 116/11049 [01:12<1:51:52,  1.63it/s]
  1%|          | 117/11049 [01:12<1:51:49,  1.63it/s]
                                                     
{'loss': 0.7587, 'grad_norm': 1.819889783859253, 'learning_rate': 1.0588235294117648e-06, 'epoch': 0.03}

  1%|          | 117/11049 [01:12<1:51:49,  1.63it/s]
  1%|          | 118/11049 [01:13<1:51:49,  1.63it/s]
                                                     
{'loss': 0.6499, 'grad_norm': 1.4448354244232178, 'learning_rate': 1.067873303167421e-06, 'epoch': 0.03}

  1%|          | 118/11049 [01:13<1:51:49,  1.63it/s]
  1%|          | 119/11049 [01:13<1:51:46,  1.63it/s]
                                                     
{'loss': 0.6957, 'grad_norm': 1.562792420387268, 'learning_rate': 1.076923076923077e-06, 'epoch': 0.03}

  1%|          | 119/11049 [01:13<1:51:46,  1.63it/s]
  1%|          | 120/11049 [01:14<1:51:47,  1.63it/s]
                                                     
{'loss': 0.6911, 'grad_norm': 1.6045713424682617, 'learning_rate': 1.085972850678733e-06, 'epoch': 0.03}

  1%|          | 120/11049 [01:14<1:51:47,  1.63it/s]
  1%|          | 121/11049 [01:15<1:51:54,  1.63it/s]
                                                     
{'loss': 0.7241, 'grad_norm': 1.6939219236373901, 'learning_rate': 1.0950226244343892e-06, 'epoch': 0.03}

  1%|          | 121/11049 [01:15<1:51:54,  1.63it/s]
  1%|          | 122/11049 [01:15<1:51:52,  1.63it/s]
                                                     
{'loss': 0.6565, 'grad_norm': 1.271032452583313, 'learning_rate': 1.1040723981900454e-06, 'epoch': 0.03}

  1%|          | 122/11049 [01:15<1:51:52,  1.63it/s]
  1%|          | 123/11049 [01:16<1:51:48,  1.63it/s]
                                                     
{'loss': 0.7452, 'grad_norm': 1.5899896621704102, 'learning_rate': 1.1131221719457013e-06, 'epoch': 0.03}

  1%|          | 123/11049 [01:16<1:51:48,  1.63it/s]
  1%|          | 124/11049 [01:16<1:51:49,  1.63it/s]
                                                     
{'loss': 0.7187, 'grad_norm': 1.670239806175232, 'learning_rate': 1.1221719457013577e-06, 'epoch': 0.03}

  1%|          | 124/11049 [01:17<1:51:49,  1.63it/s]
  1%|          | 125/11049 [01:17<1:51:51,  1.63it/s]
                                                     
{'loss': 0.7492, 'grad_norm': 1.590686321258545, 'learning_rate': 1.1312217194570136e-06, 'epoch': 0.03}

  1%|          | 125/11049 [01:17<1:51:51,  1.63it/s]
  1%|          | 126/11049 [01:18<1:51:48,  1.63it/s]
                                                     
{'loss': 0.6838, 'grad_norm': 1.4510455131530762, 'learning_rate': 1.1402714932126698e-06, 'epoch': 0.03}

  1%|          | 126/11049 [01:18<1:51:48,  1.63it/s]
  1%|          | 127/11049 [01:18<1:51:45,  1.63it/s]
                                                     
{'loss': 0.7739, 'grad_norm': 1.6908929347991943, 'learning_rate': 1.1493212669683257e-06, 'epoch': 0.03}

  1%|          | 127/11049 [01:18<1:51:45,  1.63it/s]
  1%|          | 128/11049 [01:19<1:51:39,  1.63it/s]
                                                     
{'loss': 0.7042, 'grad_norm': 1.6098096370697021, 'learning_rate': 1.1583710407239821e-06, 'epoch': 0.03}

  1%|          | 128/11049 [01:19<1:51:39,  1.63it/s]
  1%|          | 129/11049 [01:19<1:51:37,  1.63it/s]
                                                     
{'loss': 0.6602, 'grad_norm': 1.4482228755950928, 'learning_rate': 1.167420814479638e-06, 'epoch': 0.04}

  1%|          | 129/11049 [01:20<1:51:37,  1.63it/s]
  1%|          | 130/11049 [01:20<1:51:37,  1.63it/s]
                                                     
{'loss': 0.6962, 'grad_norm': 1.315229058265686, 'learning_rate': 1.1764705882352942e-06, 'epoch': 0.04}

  1%|          | 130/11049 [01:20<1:51:37,  1.63it/s]
  1%|          | 131/11049 [01:21<1:51:39,  1.63it/s]
                                                     
{'loss': 0.5263, 'grad_norm': 1.4332305192947388, 'learning_rate': 1.1855203619909502e-06, 'epoch': 0.04}

  1%|          | 131/11049 [01:21<1:51:39,  1.63it/s]
  1%|          | 132/11049 [01:21<1:51:40,  1.63it/s]
                                                     
{'loss': 0.5867, 'grad_norm': 1.1491023302078247, 'learning_rate': 1.1945701357466065e-06, 'epoch': 0.04}

  1%|          | 132/11049 [01:21<1:51:40,  1.63it/s]
  1%|          | 133/11049 [01:22<1:51:37,  1.63it/s]
                                                     
{'loss': 0.7745, 'grad_norm': 1.348260760307312, 'learning_rate': 1.2036199095022625e-06, 'epoch': 0.04}

  1%|          | 133/11049 [01:22<1:51:37,  1.63it/s]
  1%|          | 134/11049 [01:23<1:51:37,  1.63it/s]
                                                     
{'loss': 0.5536, 'grad_norm': 1.599936842918396, 'learning_rate': 1.2126696832579187e-06, 'epoch': 0.04}

  1%|          | 134/11049 [01:23<1:51:37,  1.63it/s]
  1%|          | 135/11049 [01:23<1:51:36,  1.63it/s]
                                                     
{'loss': 0.6551, 'grad_norm': 1.2443188428878784, 'learning_rate': 1.2217194570135748e-06, 'epoch': 0.04}

  1%|          | 135/11049 [01:23<1:51:36,  1.63it/s]
  1%|          | 136/11049 [01:24<1:51:34,  1.63it/s]
                                                     
{'loss': 0.6105, 'grad_norm': 1.6067818403244019, 'learning_rate': 1.230769230769231e-06, 'epoch': 0.04}

  1%|          | 136/11049 [01:24<1:51:34,  1.63it/s]
  1%|          | 137/11049 [01:24<1:51:37,  1.63it/s]
                                                     
{'loss': 0.5922, 'grad_norm': 1.1876095533370972, 'learning_rate': 1.239819004524887e-06, 'epoch': 0.04}

  1%|          | 137/11049 [01:25<1:51:37,  1.63it/s]
  1%|          | 138/11049 [01:25<1:51:34,  1.63it/s]
                                                     
{'loss': 0.7083, 'grad_norm': 1.3626735210418701, 'learning_rate': 1.248868778280543e-06, 'epoch': 0.04}

  1%|          | 138/11049 [01:25<1:51:34,  1.63it/s]
  1%|▏         | 139/11049 [01:26<1:51:31,  1.63it/s]
                                                     
{'loss': 0.6323, 'grad_norm': 1.1320236921310425, 'learning_rate': 1.2579185520361992e-06, 'epoch': 0.04}

  1%|▏         | 139/11049 [01:26<1:51:31,  1.63it/s]
  1%|▏         | 140/11049 [01:26<1:51:30,  1.63it/s]
                                                     
{'loss': 0.6191, 'grad_norm': 1.2411679029464722, 'learning_rate': 1.2669683257918552e-06, 'epoch': 0.04}

  1%|▏         | 140/11049 [01:26<1:51:30,  1.63it/s]
  1%|▏         | 141/11049 [01:27<1:51:32,  1.63it/s]
                                                     
{'loss': 0.5301, 'grad_norm': 1.2007780075073242, 'learning_rate': 1.2760180995475114e-06, 'epoch': 0.04}

  1%|▏         | 141/11049 [01:27<1:51:32,  1.63it/s]
  1%|▏         | 142/11049 [01:27<1:51:30,  1.63it/s]
                                                     
{'loss': 0.6962, 'grad_norm': 1.1417632102966309, 'learning_rate': 1.2850678733031673e-06, 'epoch': 0.04}

  1%|▏         | 142/11049 [01:28<1:51:30,  1.63it/s]
  1%|▏         | 143/11049 [01:28<1:51:29,  1.63it/s]
                                                     
{'loss': 0.6914, 'grad_norm': 1.2470189332962036, 'learning_rate': 1.2941176470588237e-06, 'epoch': 0.04}

  1%|▏         | 143/11049 [01:28<1:51:29,  1.63it/s]
  1%|▏         | 144/11049 [01:29<1:51:28,  1.63it/s]
                                                     
{'loss': 0.5558, 'grad_norm': 1.0418277978897095, 'learning_rate': 1.3031674208144798e-06, 'epoch': 0.04}

  1%|▏         | 144/11049 [01:29<1:51:28,  1.63it/s]
  1%|▏         | 145/11049 [01:29<1:51:28,  1.63it/s]
                                                     
{'loss': 0.5234, 'grad_norm': 1.068745732307434, 'learning_rate': 1.312217194570136e-06, 'epoch': 0.04}

  1%|▏         | 145/11049 [01:29<1:51:28,  1.63it/s]
  1%|▏         | 146/11049 [01:30<1:51:27,  1.63it/s]
                                                     
{'loss': 0.8453, 'grad_norm': 1.2432385683059692, 'learning_rate': 1.321266968325792e-06, 'epoch': 0.04}

  1%|▏         | 146/11049 [01:30<1:51:27,  1.63it/s]
  1%|▏         | 147/11049 [01:31<1:51:27,  1.63it/s]
                                                     
{'loss': 0.5251, 'grad_norm': 1.1270943880081177, 'learning_rate': 1.330316742081448e-06, 'epoch': 0.04}

  1%|▏         | 147/11049 [01:31<1:51:27,  1.63it/s]
  1%|▏         | 148/11049 [01:31<1:51:24,  1.63it/s]
                                                     
{'loss': 0.5624, 'grad_norm': 1.0102243423461914, 'learning_rate': 1.339366515837104e-06, 'epoch': 0.04}

  1%|▏         | 148/11049 [01:31<1:51:24,  1.63it/s]
  1%|▏         | 149/11049 [01:32<1:51:25,  1.63it/s]
                                                     
{'loss': 0.4717, 'grad_norm': 0.9660270810127258, 'learning_rate': 1.3484162895927602e-06, 'epoch': 0.04}

  1%|▏         | 149/11049 [01:32<1:51:25,  1.63it/s]
  1%|▏         | 150/11049 [01:32<1:51:24,  1.63it/s]
                                                     
{'loss': 0.6102, 'grad_norm': 1.3201121091842651, 'learning_rate': 1.3574660633484164e-06, 'epoch': 0.04}

  1%|▏         | 150/11049 [01:33<1:51:24,  1.63it/s]
  1%|▏         | 151/11049 [01:33<1:51:23,  1.63it/s]
                                                     
{'loss': 0.5542, 'grad_norm': 1.0810657739639282, 'learning_rate': 1.3665158371040723e-06, 'epoch': 0.04}

  1%|▏         | 151/11049 [01:33<1:51:23,  1.63it/s]
  1%|▏         | 152/11049 [01:34<1:51:21,  1.63it/s]
                                                     
{'loss': 0.6169, 'grad_norm': 1.0677051544189453, 'learning_rate': 1.3755656108597287e-06, 'epoch': 0.04}

  1%|▏         | 152/11049 [01:34<1:51:21,  1.63it/s]
  1%|▏         | 153/11049 [01:34<1:51:24,  1.63it/s]
                                                     
{'loss': 0.5281, 'grad_norm': 1.000578761100769, 'learning_rate': 1.3846153846153848e-06, 'epoch': 0.04}

  1%|▏         | 153/11049 [01:34<1:51:24,  1.63it/s]
  1%|▏         | 154/11049 [01:35<1:51:22,  1.63it/s]
                                                     
{'loss': 0.5659, 'grad_norm': 1.0451797246932983, 'learning_rate': 1.3936651583710408e-06, 'epoch': 0.04}

  1%|▏         | 154/11049 [01:35<1:51:22,  1.63it/s]
  1%|▏         | 155/11049 [01:35<1:51:22,  1.63it/s]
                                                     
{'loss': 0.5433, 'grad_norm': 1.005329966545105, 'learning_rate': 1.402714932126697e-06, 'epoch': 0.04}

  1%|▏         | 155/11049 [01:36<1:51:22,  1.63it/s]
  1%|▏         | 156/11049 [01:36<1:51:30,  1.63it/s]
                                                     
{'loss': 0.6998, 'grad_norm': 1.4474403858184814, 'learning_rate': 1.4117647058823531e-06, 'epoch': 0.04}

  1%|▏         | 156/11049 [01:36<1:51:30,  1.63it/s]
  1%|▏         | 157/11049 [01:37<1:51:26,  1.63it/s]
                                                     
{'loss': 0.5486, 'grad_norm': 1.049790859222412, 'learning_rate': 1.420814479638009e-06, 'epoch': 0.04}

  1%|▏         | 157/11049 [01:37<1:51:26,  1.63it/s]
  1%|▏         | 158/11049 [01:37<1:51:23,  1.63it/s]
                                                     
{'loss': 0.6452, 'grad_norm': 1.6043403148651123, 'learning_rate': 1.4298642533936652e-06, 'epoch': 0.04}

  1%|▏         | 158/11049 [01:37<1:51:23,  1.63it/s]
  1%|▏         | 159/11049 [01:38<1:51:18,  1.63it/s]
                                                     
{'loss': 0.5741, 'grad_norm': 1.0434391498565674, 'learning_rate': 1.4389140271493212e-06, 'epoch': 0.04}

  1%|▏         | 159/11049 [01:38<1:51:18,  1.63it/s]
  1%|▏         | 160/11049 [01:39<1:51:17,  1.63it/s]
                                                     
{'loss': 0.5526, 'grad_norm': 1.0094118118286133, 'learning_rate': 1.4479638009049775e-06, 'epoch': 0.04}

  1%|▏         | 160/11049 [01:39<1:51:17,  1.63it/s]
  1%|▏         | 161/11049 [01:39<1:51:16,  1.63it/s]
                                                     
{'loss': 0.5234, 'grad_norm': 1.030827522277832, 'learning_rate': 1.4570135746606337e-06, 'epoch': 0.04}

  1%|▏         | 161/11049 [01:39<1:51:16,  1.63it/s]
  1%|▏         | 162/11049 [01:40<1:51:19,  1.63it/s]
                                                     
{'loss': 0.5525, 'grad_norm': 0.9694176912307739, 'learning_rate': 1.4660633484162899e-06, 'epoch': 0.04}

  1%|▏         | 162/11049 [01:40<1:51:19,  1.63it/s]
  1%|▏         | 163/11049 [01:40<1:51:15,  1.63it/s]
                                                     
{'loss': 0.5239, 'grad_norm': 0.9898731112480164, 'learning_rate': 1.4751131221719458e-06, 'epoch': 0.04}

  1%|▏         | 163/11049 [01:40<1:51:15,  1.63it/s]
  1%|▏         | 164/11049 [01:41<1:51:25,  1.63it/s]
                                                     
{'loss': 0.6374, 'grad_norm': 0.9829636812210083, 'learning_rate': 1.484162895927602e-06, 'epoch': 0.04}

  1%|▏         | 164/11049 [01:41<1:51:25,  1.63it/s]
  1%|▏         | 165/11049 [01:42<1:51:21,  1.63it/s]
                                                     
{'loss': 0.5915, 'grad_norm': 1.248705506324768, 'learning_rate': 1.493212669683258e-06, 'epoch': 0.04}

  1%|▏         | 165/11049 [01:42<1:51:21,  1.63it/s]
  2%|▏         | 166/11049 [01:42<1:51:21,  1.63it/s]
                                                     
{'loss': 0.5973, 'grad_norm': 1.0693286657333374, 'learning_rate': 1.502262443438914e-06, 'epoch': 0.05}

  2%|▏         | 166/11049 [01:42<1:51:21,  1.63it/s]
  2%|▏         | 167/11049 [01:43<1:51:18,  1.63it/s]
                                                     
{'loss': 0.6424, 'grad_norm': 1.060474157333374, 'learning_rate': 1.5113122171945702e-06, 'epoch': 0.05}

  2%|▏         | 167/11049 [01:43<1:51:18,  1.63it/s]
  2%|▏         | 168/11049 [01:43<1:51:22,  1.63it/s]
                                                     
{'loss': 0.6244, 'grad_norm': 1.0247217416763306, 'learning_rate': 1.5203619909502262e-06, 'epoch': 0.05}

  2%|▏         | 168/11049 [01:44<1:51:22,  1.63it/s]
  2%|▏         | 169/11049 [01:44<1:51:13,  1.63it/s]
                                                     
{'loss': 0.5765, 'grad_norm': 1.0111525058746338, 'learning_rate': 1.5294117647058826e-06, 'epoch': 0.05}

  2%|▏         | 169/11049 [01:44<1:51:13,  1.63it/s]
  2%|▏         | 170/11049 [01:45<1:51:14,  1.63it/s]
                                                     
{'loss': 0.5683, 'grad_norm': 1.0327577590942383, 'learning_rate': 1.5384615384615387e-06, 'epoch': 0.05}

  2%|▏         | 170/11049 [01:45<1:51:14,  1.63it/s]
  2%|▏         | 171/11049 [01:45<1:51:12,  1.63it/s]
                                                     
{'loss': 0.4809, 'grad_norm': 0.9949357509613037, 'learning_rate': 1.5475113122171947e-06, 'epoch': 0.05}

  2%|▏         | 171/11049 [01:45<1:51:12,  1.63it/s]
  2%|▏         | 172/11049 [01:46<1:51:13,  1.63it/s]
                                                     
{'loss': 0.4936, 'grad_norm': 1.0046433210372925, 'learning_rate': 1.5565610859728508e-06, 'epoch': 0.05}

  2%|▏         | 172/11049 [01:46<1:51:13,  1.63it/s]
  2%|▏         | 173/11049 [01:46<1:51:10,  1.63it/s]
                                                     
{'loss': 0.6244, 'grad_norm': 0.8914050459861755, 'learning_rate': 1.565610859728507e-06, 'epoch': 0.05}

  2%|▏         | 173/11049 [01:47<1:51:10,  1.63it/s]
  2%|▏         | 174/11049 [01:47<1:51:18,  1.63it/s]
                                                     
{'loss': 0.6159, 'grad_norm': 1.1861317157745361, 'learning_rate': 1.574660633484163e-06, 'epoch': 0.05}

  2%|▏         | 174/11049 [01:47<1:51:18,  1.63it/s]
  2%|▏         | 175/11049 [01:48<1:51:13,  1.63it/s]
                                                     
{'loss': 0.5024, 'grad_norm': 0.9088194966316223, 'learning_rate': 1.583710407239819e-06, 'epoch': 0.05}

  2%|▏         | 175/11049 [01:48<1:51:13,  1.63it/s]
  2%|▏         | 176/11049 [01:48<1:51:12,  1.63it/s]
                                                     
{'loss': 0.4024, 'grad_norm': 0.8234982490539551, 'learning_rate': 1.592760180995475e-06, 'epoch': 0.05}

  2%|▏         | 176/11049 [01:48<1:51:12,  1.63it/s]
  2%|▏         | 177/11049 [01:49<1:51:12,  1.63it/s]
                                                     
{'loss': 0.5971, 'grad_norm': 0.9416819214820862, 'learning_rate': 1.6018099547511314e-06, 'epoch': 0.05}

  2%|▏         | 177/11049 [01:49<1:51:12,  1.63it/s]
  2%|▏         | 178/11049 [01:50<1:51:09,  1.63it/s]
                                                     
{'loss': 0.5317, 'grad_norm': 1.0326036214828491, 'learning_rate': 1.6108597285067876e-06, 'epoch': 0.05}

  2%|▏         | 178/11049 [01:50<1:51:09,  1.63it/s]
  2%|▏         | 179/11049 [01:50<1:51:09,  1.63it/s]
                                                     
{'loss': 0.5718, 'grad_norm': 0.9169276356697083, 'learning_rate': 1.6199095022624437e-06, 'epoch': 0.05}

  2%|▏         | 179/11049 [01:50<1:51:09,  1.63it/s]
  2%|▏         | 180/11049 [01:51<1:51:06,  1.63it/s]
                                                     
{'loss': 0.4395, 'grad_norm': 0.8268606662750244, 'learning_rate': 1.6289592760180997e-06, 'epoch': 0.05}

  2%|▏         | 180/11049 [01:51<1:51:06,  1.63it/s]
  2%|▏         | 181/11049 [01:51<1:51:07,  1.63it/s]
                                                     
{'loss': 0.5995, 'grad_norm': 0.948775053024292, 'learning_rate': 1.6380090497737558e-06, 'epoch': 0.05}

  2%|▏         | 181/11049 [01:52<1:51:07,  1.63it/s]
  2%|▏         | 182/11049 [01:52<1:51:14,  1.63it/s]
                                                     
{'loss': 0.4369, 'grad_norm': 0.8055103421211243, 'learning_rate': 1.6470588235294118e-06, 'epoch': 0.05}

  2%|▏         | 182/11049 [01:52<1:51:14,  1.63it/s]
  2%|▏         | 183/11049 [01:53<1:51:07,  1.63it/s]
                                                     
{'loss': 0.5419, 'grad_norm': 0.9702402353286743, 'learning_rate': 1.656108597285068e-06, 'epoch': 0.05}

  2%|▏         | 183/11049 [01:53<1:51:07,  1.63it/s]
  2%|▏         | 184/11049 [01:53<1:51:06,  1.63it/s]
                                                     
{'loss': 0.535, 'grad_norm': 1.0835179090499878, 'learning_rate': 1.6651583710407241e-06, 'epoch': 0.05}

  2%|▏         | 184/11049 [01:53<1:51:06,  1.63it/s]
  2%|▏         | 185/11049 [01:54<1:51:05,  1.63it/s]
                                                     
{'loss': 0.5565, 'grad_norm': 0.9067075252532959, 'learning_rate': 1.67420814479638e-06, 'epoch': 0.05}

  2%|▏         | 185/11049 [01:54<1:51:05,  1.63it/s]
  2%|▏         | 186/11049 [01:54<1:51:02,  1.63it/s]
                                                     
{'loss': 0.4484, 'grad_norm': 0.8431698083877563, 'learning_rate': 1.6832579185520364e-06, 'epoch': 0.05}

  2%|▏         | 186/11049 [01:55<1:51:02,  1.63it/s]
  2%|▏         | 187/11049 [01:55<1:51:01,  1.63it/s]
                                                     
{'loss': 0.5003, 'grad_norm': 0.9734979867935181, 'learning_rate': 1.6923076923076926e-06, 'epoch': 0.05}

  2%|▏         | 187/11049 [01:55<1:51:01,  1.63it/s]
  2%|▏         | 188/11049 [01:56<1:50:59,  1.63it/s]
                                                     
{'loss': 0.5763, 'grad_norm': 1.138024926185608, 'learning_rate': 1.7013574660633485e-06, 'epoch': 0.05}

  2%|▏         | 188/11049 [01:56<1:50:59,  1.63it/s]
  2%|▏         | 189/11049 [01:56<1:50:58,  1.63it/s]
                                                     
{'loss': 0.5121, 'grad_norm': 0.9604508876800537, 'learning_rate': 1.7104072398190047e-06, 'epoch': 0.05}

  2%|▏         | 189/11049 [01:56<1:50:58,  1.63it/s]
  2%|▏         | 190/11049 [01:57<1:50:57,  1.63it/s]
                                                     
{'loss': 0.5689, 'grad_norm': 1.1575638055801392, 'learning_rate': 1.7194570135746609e-06, 'epoch': 0.05}

  2%|▏         | 190/11049 [01:57<1:50:57,  1.63it/s]
  2%|▏         | 191/11049 [01:58<1:50:56,  1.63it/s]
                                                     
{'loss': 0.6371, 'grad_norm': 1.0395474433898926, 'learning_rate': 1.7285067873303168e-06, 'epoch': 0.05}

  2%|▏         | 191/11049 [01:58<1:50:56,  1.63it/s]
  2%|▏         | 192/11049 [01:58<1:51:05,  1.63it/s]
                                                     
{'loss': 0.487, 'grad_norm': 0.8629506826400757, 'learning_rate': 1.737556561085973e-06, 'epoch': 0.05}

  2%|▏         | 192/11049 [01:58<1:51:05,  1.63it/s]
  2%|▏         | 193/11049 [01:59<1:51:05,  1.63it/s]
                                                     
{'loss': 0.6033, 'grad_norm': 1.270110011100769, 'learning_rate': 1.746606334841629e-06, 'epoch': 0.05}

  2%|▏         | 193/11049 [01:59<1:51:05,  1.63it/s]
  2%|▏         | 194/11049 [01:59<1:51:01,  1.63it/s]
                                                     
{'loss': 0.5622, 'grad_norm': 0.8837730884552002, 'learning_rate': 1.755656108597285e-06, 'epoch': 0.05}

  2%|▏         | 194/11049 [01:59<1:51:01,  1.63it/s]
  2%|▏         | 195/11049 [02:00<1:50:59,  1.63it/s]
                                                     
{'loss': 0.5679, 'grad_norm': 1.0193161964416504, 'learning_rate': 1.7647058823529414e-06, 'epoch': 0.05}

  2%|▏         | 195/11049 [02:00<1:50:59,  1.63it/s]
  2%|▏         | 196/11049 [02:01<1:50:57,  1.63it/s]
                                                     
{'loss': 0.5235, 'grad_norm': 0.9153251647949219, 'learning_rate': 1.7737556561085976e-06, 'epoch': 0.05}

  2%|▏         | 196/11049 [02:01<1:50:57,  1.63it/s]
  2%|▏         | 197/11049 [02:01<1:50:54,  1.63it/s]
                                                     
{'loss': 0.5182, 'grad_norm': 1.0919055938720703, 'learning_rate': 1.7828054298642536e-06, 'epoch': 0.05}

  2%|▏         | 197/11049 [02:01<1:50:54,  1.63it/s]
  2%|▏         | 198/11049 [02:02<1:50:59,  1.63it/s]
                                                     
{'loss': 0.5417, 'grad_norm': 1.0499012470245361, 'learning_rate': 1.7918552036199097e-06, 'epoch': 0.05}

  2%|▏         | 198/11049 [02:02<1:50:59,  1.63it/s]
  2%|▏         | 199/11049 [02:02<1:50:59,  1.63it/s]
                                                     
{'loss': 0.6621, 'grad_norm': 1.0426450967788696, 'learning_rate': 1.8009049773755657e-06, 'epoch': 0.05}

  2%|▏         | 199/11049 [02:03<1:50:59,  1.63it/s]
  2%|▏         | 200/11049 [02:03<1:50:57,  1.63it/s]
                                                     
{'loss': 0.5549, 'grad_norm': 0.93563312292099, 'learning_rate': 1.8099547511312218e-06, 'epoch': 0.05}

  2%|▏         | 200/11049 [02:03<1:50:57,  1.63it/s]
  2%|▏         | 201/11049 [02:04<1:50:55,  1.63it/s]
                                                     
{'loss': 0.5522, 'grad_norm': 0.989883542060852, 'learning_rate': 1.819004524886878e-06, 'epoch': 0.05}

  2%|▏         | 201/11049 [02:04<1:50:55,  1.63it/s]
  2%|▏         | 202/11049 [02:04<1:50:54,  1.63it/s]
                                                     
{'loss': 0.5026, 'grad_norm': 0.8519905209541321, 'learning_rate': 1.828054298642534e-06, 'epoch': 0.05}

  2%|▏         | 202/11049 [02:04<1:50:54,  1.63it/s]
  2%|▏         | 203/11049 [02:05<1:50:51,  1.63it/s]
                                                     
{'loss': 0.5099, 'grad_norm': 0.9540056586265564, 'learning_rate': 1.8371040723981903e-06, 'epoch': 0.06}

  2%|▏         | 203/11049 [02:05<1:50:51,  1.63it/s]
  2%|▏         | 204/11049 [02:06<1:50:51,  1.63it/s]
                                                     
{'loss': 0.4287, 'grad_norm': 0.7314087152481079, 'learning_rate': 1.8461538461538465e-06, 'epoch': 0.06}

  2%|▏         | 204/11049 [02:06<1:50:51,  1.63it/s]
  2%|▏         | 205/11049 [02:06<1:50:47,  1.63it/s]
                                                     
{'loss': 0.4938, 'grad_norm': 0.8447374701499939, 'learning_rate': 1.8552036199095024e-06, 'epoch': 0.06}

  2%|▏         | 205/11049 [02:06<1:50:47,  1.63it/s]
  2%|▏         | 206/11049 [02:07<1:50:49,  1.63it/s]
                                                     
{'loss': 0.5268, 'grad_norm': 0.8869221210479736, 'learning_rate': 1.8642533936651586e-06, 'epoch': 0.06}

  2%|▏         | 206/11049 [02:07<1:50:49,  1.63it/s]
  2%|▏         | 207/11049 [02:07<1:50:51,  1.63it/s]
                                                     
{'loss': 0.4957, 'grad_norm': 0.8463852405548096, 'learning_rate': 1.8733031674208147e-06, 'epoch': 0.06}

  2%|▏         | 207/11049 [02:07<1:50:51,  1.63it/s]
  2%|▏         | 208/11049 [02:08<1:50:54,  1.63it/s]
                                                     
{'loss': 0.5549, 'grad_norm': 0.8529922962188721, 'learning_rate': 1.8823529411764707e-06, 'epoch': 0.06}

  2%|▏         | 208/11049 [02:08<1:50:54,  1.63it/s]
  2%|▏         | 209/11049 [02:09<1:50:52,  1.63it/s]
                                                     
{'loss': 0.5147, 'grad_norm': 0.8880453109741211, 'learning_rate': 1.8914027149321268e-06, 'epoch': 0.06}

  2%|▏         | 209/11049 [02:09<1:50:52,  1.63it/s]
  2%|▏         | 210/11049 [02:09<1:50:55,  1.63it/s]
                                                     
{'loss': 0.5639, 'grad_norm': 0.9156631231307983, 'learning_rate': 1.9004524886877828e-06, 'epoch': 0.06}

  2%|▏         | 210/11049 [02:09<1:50:55,  1.63it/s]
  2%|▏         | 211/11049 [02:10<1:50:53,  1.63it/s]
                                                     
{'loss': 0.4672, 'grad_norm': 0.7307483553886414, 'learning_rate': 1.909502262443439e-06, 'epoch': 0.06}

  2%|▏         | 211/11049 [02:10<1:50:53,  1.63it/s]
  2%|▏         | 212/11049 [02:10<1:50:50,  1.63it/s]
                                                     
{'loss': 0.4776, 'grad_norm': 0.8290805816650391, 'learning_rate': 1.9185520361990953e-06, 'epoch': 0.06}

  2%|▏         | 212/11049 [02:11<1:50:50,  1.63it/s]
  2%|▏         | 213/11049 [02:11<1:50:49,  1.63it/s]
                                                     
{'loss': 0.4925, 'grad_norm': 0.911220908164978, 'learning_rate': 1.9276018099547515e-06, 'epoch': 0.06}

  2%|▏         | 213/11049 [02:11<1:50:49,  1.63it/s]
  2%|▏         | 214/11049 [02:12<1:50:48,  1.63it/s]
                                                     
{'loss': 0.4733, 'grad_norm': 0.7392673492431641, 'learning_rate': 1.9366515837104076e-06, 'epoch': 0.06}

  2%|▏         | 214/11049 [02:12<1:50:48,  1.63it/s]
  2%|▏         | 215/11049 [02:12<1:50:45,  1.63it/s]
                                                     
{'loss': 0.5407, 'grad_norm': 0.8414676189422607, 'learning_rate': 1.9457013574660634e-06, 'epoch': 0.06}

  2%|▏         | 215/11049 [02:12<1:50:45,  1.63it/s]
  2%|▏         | 216/11049 [02:13<1:50:44,  1.63it/s]
                                                     
{'loss': 0.4928, 'grad_norm': 0.764665961265564, 'learning_rate': 1.9547511312217195e-06, 'epoch': 0.06}

  2%|▏         | 216/11049 [02:13<1:50:44,  1.63it/s]
  2%|▏         | 217/11049 [02:13<1:50:42,  1.63it/s]
                                                     
{'loss': 0.6636, 'grad_norm': 1.0478754043579102, 'learning_rate': 1.9638009049773757e-06, 'epoch': 0.06}

  2%|▏         | 217/11049 [02:14<1:50:42,  1.63it/s]
  2%|▏         | 218/11049 [02:14<1:50:39,  1.63it/s]
                                                     
{'loss': 0.4003, 'grad_norm': 0.7403923273086548, 'learning_rate': 1.972850678733032e-06, 'epoch': 0.06}

  2%|▏         | 218/11049 [02:14<1:50:39,  1.63it/s]
  2%|▏         | 219/11049 [02:15<1:50:38,  1.63it/s]
                                                     
{'loss': 0.4748, 'grad_norm': 0.8515095114707947, 'learning_rate': 1.981900452488688e-06, 'epoch': 0.06}

  2%|▏         | 219/11049 [02:15<1:50:38,  1.63it/s]
  2%|▏         | 220/11049 [02:15<1:50:42,  1.63it/s]
                                                     
{'loss': 0.5396, 'grad_norm': 0.8288384079933167, 'learning_rate': 1.9909502262443437e-06, 'epoch': 0.06}

  2%|▏         | 220/11049 [02:15<1:50:42,  1.63it/s]
  2%|▏         | 221/11049 [02:16<1:50:42,  1.63it/s]
                                                     
{'loss': 0.4948, 'grad_norm': 0.6911404132843018, 'learning_rate': 2.0000000000000003e-06, 'epoch': 0.06}

  2%|▏         | 221/11049 [02:16<1:50:42,  1.63it/s]
  2%|▏         | 222/11049 [02:17<1:50:40,  1.63it/s]
                                                     
{'loss': 0.4727, 'grad_norm': 0.7590057849884033, 'learning_rate': 2.0090497737556565e-06, 'epoch': 0.06}

  2%|▏         | 222/11049 [02:17<1:50:40,  1.63it/s]
  2%|▏         | 223/11049 [02:17<1:50:42,  1.63it/s]
                                                     
{'loss': 0.5048, 'grad_norm': 0.9441220164299011, 'learning_rate': 2.0180995475113122e-06, 'epoch': 0.06}

  2%|▏         | 223/11049 [02:17<1:50:42,  1.63it/s]
  2%|▏         | 224/11049 [02:18<1:50:40,  1.63it/s]
                                                     
{'loss': 0.4336, 'grad_norm': 0.8388345241546631, 'learning_rate': 2.0271493212669684e-06, 'epoch': 0.06}

  2%|▏         | 224/11049 [02:18<1:50:40,  1.63it/s]
  2%|▏         | 225/11049 [02:18<1:50:39,  1.63it/s]
                                                     
{'loss': 0.5597, 'grad_norm': 0.8990150094032288, 'learning_rate': 2.0361990950226245e-06, 'epoch': 0.06}

  2%|▏         | 225/11049 [02:19<1:50:39,  1.63it/s]
  2%|▏         | 226/11049 [02:19<1:50:39,  1.63it/s]
                                                     
{'loss': 0.4505, 'grad_norm': 0.7822028398513794, 'learning_rate': 2.0452488687782807e-06, 'epoch': 0.06}

  2%|▏         | 226/11049 [02:19<1:50:39,  1.63it/s]
  2%|▏         | 227/11049 [02:20<1:50:40,  1.63it/s]
                                                     
{'loss': 0.4129, 'grad_norm': 0.7261788845062256, 'learning_rate': 2.054298642533937e-06, 'epoch': 0.06}

  2%|▏         | 227/11049 [02:20<1:50:40,  1.63it/s]
  2%|▏         | 228/11049 [02:20<1:50:35,  1.63it/s]
                                                     
{'loss': 0.4286, 'grad_norm': 0.6650387644767761, 'learning_rate': 2.0633484162895926e-06, 'epoch': 0.06}

  2%|▏         | 228/11049 [02:20<1:50:35,  1.63it/s]
  2%|▏         | 229/11049 [02:21<1:50:35,  1.63it/s]
                                                     
{'loss': 0.5529, 'grad_norm': 1.0867527723312378, 'learning_rate': 2.072398190045249e-06, 'epoch': 0.06}

  2%|▏         | 229/11049 [02:21<1:50:35,  1.63it/s]
  2%|▏         | 230/11049 [02:21<1:50:38,  1.63it/s]
                                                     
{'loss': 0.5133, 'grad_norm': 0.8463840484619141, 'learning_rate': 2.0814479638009053e-06, 'epoch': 0.06}

  2%|▏         | 230/11049 [02:22<1:50:38,  1.63it/s]
  2%|▏         | 231/11049 [02:22<1:50:33,  1.63it/s]
                                                     
{'loss': 0.502, 'grad_norm': 0.9357390999794006, 'learning_rate': 2.0904977375565615e-06, 'epoch': 0.06}

  2%|▏         | 231/11049 [02:22<1:50:33,  1.63it/s]
  2%|▏         | 232/11049 [02:23<1:50:35,  1.63it/s]
                                                     
{'loss': 0.406, 'grad_norm': 0.7193650007247925, 'learning_rate': 2.0995475113122172e-06, 'epoch': 0.06}

  2%|▏         | 232/11049 [02:23<1:50:35,  1.63it/s]
  2%|▏         | 233/11049 [02:23<1:50:31,  1.63it/s]
                                                     
{'loss': 0.5596, 'grad_norm': 0.9259937405586243, 'learning_rate': 2.1085972850678734e-06, 'epoch': 0.06}

  2%|▏         | 233/11049 [02:23<1:50:31,  1.63it/s]
  2%|▏         | 234/11049 [02:24<1:50:29,  1.63it/s]
                                                     
{'loss': 0.5766, 'grad_norm': 1.0150024890899658, 'learning_rate': 2.1176470588235296e-06, 'epoch': 0.06}

  2%|▏         | 234/11049 [02:24<1:50:29,  1.63it/s]
  2%|▏         | 235/11049 [02:25<1:50:34,  1.63it/s]
                                                     
{'loss': 0.5168, 'grad_norm': 0.9166010618209839, 'learning_rate': 2.1266968325791857e-06, 'epoch': 0.06}

  2%|▏         | 235/11049 [02:25<1:50:34,  1.63it/s]
  2%|▏         | 236/11049 [02:25<1:50:36,  1.63it/s]
                                                     
{'loss': 0.567, 'grad_norm': 1.010375738143921, 'learning_rate': 2.135746606334842e-06, 'epoch': 0.06}

  2%|▏         | 236/11049 [02:25<1:50:36,  1.63it/s]
  2%|▏         | 237/11049 [02:26<1:50:36,  1.63it/s]
                                                     
{'loss': 0.4623, 'grad_norm': 0.7712345719337463, 'learning_rate': 2.1447963800904976e-06, 'epoch': 0.06}

  2%|▏         | 237/11049 [02:26<1:50:36,  1.63it/s]
  2%|▏         | 238/11049 [02:26<1:50:33,  1.63it/s]
                                                     
{'loss': 0.4957, 'grad_norm': 0.7732856869697571, 'learning_rate': 2.153846153846154e-06, 'epoch': 0.06}

  2%|▏         | 238/11049 [02:26<1:50:33,  1.63it/s]
  2%|▏         | 239/11049 [02:27<1:50:28,  1.63it/s]
                                                     
{'loss': 0.5903, 'grad_norm': 0.9058641195297241, 'learning_rate': 2.1628959276018104e-06, 'epoch': 0.06}

  2%|▏         | 239/11049 [02:27<1:50:28,  1.63it/s]
  2%|▏         | 240/11049 [02:28<1:50:29,  1.63it/s]
                                                     
{'loss': 0.4312, 'grad_norm': 0.7741720676422119, 'learning_rate': 2.171945701357466e-06, 'epoch': 0.07}

  2%|▏         | 240/11049 [02:28<1:50:29,  1.63it/s]
  2%|▏         | 241/11049 [02:28<1:50:28,  1.63it/s]
                                                     
{'loss': 0.5242, 'grad_norm': 0.8425605297088623, 'learning_rate': 2.1809954751131223e-06, 'epoch': 0.07}

  2%|▏         | 241/11049 [02:28<1:50:28,  1.63it/s]
  2%|▏         | 242/11049 [02:29<1:50:26,  1.63it/s]
                                                     
{'loss': 0.4581, 'grad_norm': 0.7176691889762878, 'learning_rate': 2.1900452488687784e-06, 'epoch': 0.07}

  2%|▏         | 242/11049 [02:29<1:50:26,  1.63it/s]
  2%|▏         | 243/11049 [02:29<1:50:23,  1.63it/s]
                                                     
{'loss': 0.3773, 'grad_norm': 0.6660673022270203, 'learning_rate': 2.1990950226244346e-06, 'epoch': 0.07}

  2%|▏         | 243/11049 [02:30<1:50:23,  1.63it/s]
  2%|▏         | 244/11049 [02:30<1:50:22,  1.63it/s]
                                                     
{'loss': 0.5536, 'grad_norm': 0.934643566608429, 'learning_rate': 2.2081447963800907e-06, 'epoch': 0.07}

  2%|▏         | 244/11049 [02:30<1:50:22,  1.63it/s]
  2%|▏         | 245/11049 [02:31<1:50:21,  1.63it/s]
                                                     
{'loss': 0.6195, 'grad_norm': 0.9715659618377686, 'learning_rate': 2.2171945701357465e-06, 'epoch': 0.07}

  2%|▏         | 245/11049 [02:31<1:50:21,  1.63it/s]
  2%|▏         | 246/11049 [02:31<1:50:22,  1.63it/s]
                                                     
{'loss': 0.4223, 'grad_norm': 0.8392453789710999, 'learning_rate': 2.2262443438914026e-06, 'epoch': 0.07}

  2%|▏         | 246/11049 [02:31<1:50:22,  1.63it/s]
  2%|▏         | 247/11049 [02:32<1:50:21,  1.63it/s]
                                                     
{'loss': 0.5349, 'grad_norm': 0.9515589475631714, 'learning_rate': 2.2352941176470592e-06, 'epoch': 0.07}

  2%|▏         | 247/11049 [02:32<1:50:21,  1.63it/s]
  2%|▏         | 248/11049 [02:32<1:50:25,  1.63it/s]
                                                     
{'loss': 0.5902, 'grad_norm': 1.0247477293014526, 'learning_rate': 2.2443438914027154e-06, 'epoch': 0.07}

  2%|▏         | 248/11049 [02:33<1:50:25,  1.63it/s]
  2%|▏         | 249/11049 [02:33<1:50:25,  1.63it/s]
                                                     
{'loss': 0.456, 'grad_norm': 0.80146723985672, 'learning_rate': 2.253393665158371e-06, 'epoch': 0.07}

  2%|▏         | 249/11049 [02:33<1:50:25,  1.63it/s]
  2%|▏         | 250/11049 [02:34<1:50:25,  1.63it/s]
                                                     
{'loss': 0.5036, 'grad_norm': 0.8451463580131531, 'learning_rate': 2.2624434389140273e-06, 'epoch': 0.07}

  2%|▏         | 250/11049 [02:34<1:50:25,  1.63it/s]
  2%|▏         | 251/11049 [02:34<1:50:23,  1.63it/s]
                                                     
{'loss': 0.456, 'grad_norm': 0.7525219321250916, 'learning_rate': 2.2714932126696834e-06, 'epoch': 0.07}

  2%|▏         | 251/11049 [02:34<1:50:23,  1.63it/s]
  2%|▏         | 252/11049 [02:35<1:50:22,  1.63it/s]
                                                     
{'loss': 0.5879, 'grad_norm': 1.0280054807662964, 'learning_rate': 2.2805429864253396e-06, 'epoch': 0.07}

  2%|▏         | 252/11049 [02:35<1:50:22,  1.63it/s]
  2%|▏         | 253/11049 [02:36<1:50:21,  1.63it/s]
                                                     
{'loss': 0.5062, 'grad_norm': 0.8264834880828857, 'learning_rate': 2.2895927601809958e-06, 'epoch': 0.07}

  2%|▏         | 253/11049 [02:36<1:50:21,  1.63it/s]
  2%|▏         | 254/11049 [02:36<1:50:19,  1.63it/s]
                                                     
{'loss': 0.4754, 'grad_norm': 0.7731763124465942, 'learning_rate': 2.2986425339366515e-06, 'epoch': 0.07}

  2%|▏         | 254/11049 [02:36<1:50:19,  1.63it/s]
  2%|▏         | 255/11049 [02:37<1:50:47,  1.62it/s]
                                                     
{'loss': 0.4177, 'grad_norm': 0.6934793591499329, 'learning_rate': 2.307692307692308e-06, 'epoch': 0.07}

  2%|▏         | 255/11049 [02:37<1:50:47,  1.62it/s]
  2%|▏         | 256/11049 [02:37<1:50:39,  1.63it/s]
                                                     
{'loss': 0.5184, 'grad_norm': 0.8271273970603943, 'learning_rate': 2.3167420814479642e-06, 'epoch': 0.07}

  2%|▏         | 256/11049 [02:38<1:50:39,  1.63it/s]
  2%|▏         | 257/11049 [02:38<1:50:31,  1.63it/s]
                                                     
{'loss': 0.4666, 'grad_norm': 0.708518385887146, 'learning_rate': 2.32579185520362e-06, 'epoch': 0.07}

  2%|▏         | 257/11049 [02:38<1:50:31,  1.63it/s]
  2%|▏         | 258/11049 [02:39<1:50:26,  1.63it/s]
                                                     
{'loss': 0.4979, 'grad_norm': 1.07858145236969, 'learning_rate': 2.334841628959276e-06, 'epoch': 0.07}

  2%|▏         | 258/11049 [02:39<1:50:26,  1.63it/s]
  2%|▏         | 259/11049 [02:39<1:50:21,  1.63it/s]
                                                     
{'loss': 0.6033, 'grad_norm': 1.0064620971679688, 'learning_rate': 2.3438914027149323e-06, 'epoch': 0.07}

  2%|▏         | 259/11049 [02:39<1:50:21,  1.63it/s]
  2%|▏         | 260/11049 [02:40<1:50:24,  1.63it/s]
                                                     
{'loss': 0.5471, 'grad_norm': 0.9779285192489624, 'learning_rate': 2.3529411764705885e-06, 'epoch': 0.07}

  2%|▏         | 260/11049 [02:40<1:50:24,  1.63it/s]
  2%|▏         | 261/11049 [02:40<1:50:22,  1.63it/s]
                                                     
{'loss': 0.5055, 'grad_norm': 0.7815381288528442, 'learning_rate': 2.3619909502262446e-06, 'epoch': 0.07}

  2%|▏         | 261/11049 [02:41<1:50:22,  1.63it/s]
  2%|▏         | 262/11049 [02:41<1:50:18,  1.63it/s]
                                                     
{'loss': 0.3587, 'grad_norm': 0.7808516025543213, 'learning_rate': 2.3710407239819003e-06, 'epoch': 0.07}

  2%|▏         | 262/11049 [02:41<1:50:18,  1.63it/s]
  2%|▏         | 263/11049 [02:42<1:50:17,  1.63it/s]
                                                     
{'loss': 0.5145, 'grad_norm': 0.8784258365631104, 'learning_rate': 2.3800904977375565e-06, 'epoch': 0.07}

  2%|▏         | 263/11049 [02:42<1:50:17,  1.63it/s]
  2%|▏         | 264/11049 [02:42<1:50:25,  1.63it/s]
                                                     
{'loss': 0.371, 'grad_norm': 0.6885406374931335, 'learning_rate': 2.389140271493213e-06, 'epoch': 0.07}

  2%|▏         | 264/11049 [02:42<1:50:25,  1.63it/s]
  2%|▏         | 265/11049 [02:43<1:50:30,  1.63it/s]
                                                     
{'loss': 0.4651, 'grad_norm': 0.8001613020896912, 'learning_rate': 2.3981900452488693e-06, 'epoch': 0.07}

  2%|▏         | 265/11049 [02:43<1:50:30,  1.63it/s]
  2%|▏         | 266/11049 [02:44<1:50:22,  1.63it/s]
                                                     
{'loss': 0.4226, 'grad_norm': 0.9107164740562439, 'learning_rate': 2.407239819004525e-06, 'epoch': 0.07}

  2%|▏         | 266/11049 [02:44<1:50:22,  1.63it/s]
  2%|▏         | 267/11049 [02:44<1:50:25,  1.63it/s]
                                                     
{'loss': 0.5378, 'grad_norm': 0.8508616089820862, 'learning_rate': 2.416289592760181e-06, 'epoch': 0.07}

  2%|▏         | 267/11049 [02:44<1:50:25,  1.63it/s]
  2%|▏         | 268/11049 [02:45<1:50:14,  1.63it/s]
                                                     
{'loss': 0.5418, 'grad_norm': 0.8343275785446167, 'learning_rate': 2.4253393665158373e-06, 'epoch': 0.07}

  2%|▏         | 268/11049 [02:45<1:50:14,  1.63it/s]
  2%|▏         | 269/11049 [02:45<1:50:43,  1.62it/s]
                                                     
{'loss': 0.4582, 'grad_norm': 0.7873907685279846, 'learning_rate': 2.4343891402714935e-06, 'epoch': 0.07}

  2%|▏         | 269/11049 [02:46<1:50:43,  1.62it/s]
  2%|▏         | 270/11049 [02:46<1:50:42,  1.62it/s]
                                                     
{'loss': 0.3709, 'grad_norm': 0.6338286995887756, 'learning_rate': 2.4434389140271496e-06, 'epoch': 0.07}

  2%|▏         | 270/11049 [02:46<1:50:42,  1.62it/s]
  2%|▏         | 271/11049 [02:47<1:50:31,  1.63it/s]
                                                     
{'loss': 0.4456, 'grad_norm': 0.7048667073249817, 'learning_rate': 2.4524886877828054e-06, 'epoch': 0.07}

  2%|▏         | 271/11049 [02:47<1:50:31,  1.63it/s]
  2%|▏         | 272/11049 [02:47<1:50:27,  1.63it/s]
                                                     
{'loss': 0.5627, 'grad_norm': 0.8396154046058655, 'learning_rate': 2.461538461538462e-06, 'epoch': 0.07}

  2%|▏         | 272/11049 [02:47<1:50:27,  1.63it/s]
  2%|▏         | 273/11049 [02:48<1:50:20,  1.63it/s]
                                                     
{'loss': 0.5596, 'grad_norm': 0.815459132194519, 'learning_rate': 2.470588235294118e-06, 'epoch': 0.07}

  2%|▏         | 273/11049 [02:48<1:50:20,  1.63it/s]
  2%|▏         | 274/11049 [02:48<1:50:24,  1.63it/s]
                                                     
{'loss': 0.5173, 'grad_norm': 0.7940088510513306, 'learning_rate': 2.479638009049774e-06, 'epoch': 0.07}

  2%|▏         | 274/11049 [02:49<1:50:24,  1.63it/s]
  2%|▏         | 275/11049 [02:49<1:50:28,  1.63it/s]
                                                     
{'loss': 0.5655, 'grad_norm': 0.8301750421524048, 'learning_rate': 2.48868778280543e-06, 'epoch': 0.07}

  2%|▏         | 275/11049 [02:49<1:50:28,  1.63it/s]
  2%|▏         | 276/11049 [02:50<1:50:20,  1.63it/s]
                                                     
{'loss': 0.4076, 'grad_norm': 0.7261257767677307, 'learning_rate': 2.497737556561086e-06, 'epoch': 0.07}

  2%|▏         | 276/11049 [02:50<1:50:20,  1.63it/s]
  3%|▎         | 277/11049 [02:50<1:50:14,  1.63it/s]
                                                     
{'loss': 0.6125, 'grad_norm': 1.0054364204406738, 'learning_rate': 2.5067873303167423e-06, 'epoch': 0.08}

  3%|▎         | 277/11049 [02:50<1:50:14,  1.63it/s]
  3%|▎         | 278/11049 [02:51<1:50:13,  1.63it/s]
                                                     
{'loss': 0.5384, 'grad_norm': 0.8694398999214172, 'learning_rate': 2.5158371040723985e-06, 'epoch': 0.08}

  3%|▎         | 278/11049 [02:51<1:50:13,  1.63it/s]
  3%|▎         | 279/11049 [02:52<1:50:19,  1.63it/s]
                                                     
{'loss': 0.4887, 'grad_norm': 0.6808547973632812, 'learning_rate': 2.5248868778280542e-06, 'epoch': 0.08}

  3%|▎         | 279/11049 [02:52<1:50:19,  1.63it/s]
  3%|▎         | 280/11049 [02:52<1:50:17,  1.63it/s]
                                                     
{'loss': 0.5703, 'grad_norm': 0.916886031627655, 'learning_rate': 2.5339366515837104e-06, 'epoch': 0.08}

  3%|▎         | 280/11049 [02:52<1:50:17,  1.63it/s]
  3%|▎         | 281/11049 [02:53<1:50:15,  1.63it/s]
                                                     
{'loss': 0.5251, 'grad_norm': 0.7168359756469727, 'learning_rate': 2.5429864253393665e-06, 'epoch': 0.08}

  3%|▎         | 281/11049 [02:53<1:50:15,  1.63it/s]
  3%|▎         | 282/11049 [02:53<1:50:12,  1.63it/s]
                                                     
{'loss': 0.4901, 'grad_norm': 0.7186455726623535, 'learning_rate': 2.5520361990950227e-06, 'epoch': 0.08}

  3%|▎         | 282/11049 [02:54<1:50:12,  1.63it/s]
  3%|▎         | 283/11049 [02:54<1:50:06,  1.63it/s]
                                                     
{'loss': 0.501, 'grad_norm': 0.7816529273986816, 'learning_rate': 2.561085972850679e-06, 'epoch': 0.08}

  3%|▎         | 283/11049 [02:54<1:50:06,  1.63it/s]
  3%|▎         | 284/11049 [02:55<1:50:17,  1.63it/s]
                                                     
{'loss': 0.4728, 'grad_norm': 0.7319274544715881, 'learning_rate': 2.5701357466063346e-06, 'epoch': 0.08}

  3%|▎         | 284/11049 [02:55<1:50:17,  1.63it/s]
  3%|▎         | 285/11049 [02:55<1:50:10,  1.63it/s]
                                                     
{'loss': 0.5464, 'grad_norm': 0.9460570216178894, 'learning_rate': 2.5791855203619916e-06, 'epoch': 0.08}

  3%|▎         | 285/11049 [02:55<1:50:10,  1.63it/s]
  3%|▎         | 286/11049 [02:56<1:50:07,  1.63it/s]
                                                     
{'loss': 0.4243, 'grad_norm': 0.7337058186531067, 'learning_rate': 2.5882352941176473e-06, 'epoch': 0.08}

  3%|▎         | 286/11049 [02:56<1:50:07,  1.63it/s]
  3%|▎         | 287/11049 [02:56<1:50:04,  1.63it/s]
                                                     
{'loss': 0.5083, 'grad_norm': 0.8464063405990601, 'learning_rate': 2.5972850678733035e-06, 'epoch': 0.08}

  3%|▎         | 287/11049 [02:57<1:50:04,  1.63it/s]
  3%|▎         | 288/11049 [02:57<1:50:03,  1.63it/s]
                                                     
{'loss': 0.5123, 'grad_norm': 0.8880050182342529, 'learning_rate': 2.6063348416289597e-06, 'epoch': 0.08}

  3%|▎         | 288/11049 [02:57<1:50:03,  1.63it/s]
  3%|▎         | 289/11049 [02:58<1:50:11,  1.63it/s]
                                                     
{'loss': 0.4363, 'grad_norm': 0.7347669005393982, 'learning_rate': 2.615384615384616e-06, 'epoch': 0.08}

  3%|▎         | 289/11049 [02:58<1:50:11,  1.63it/s]
  3%|▎         | 290/11049 [02:58<1:50:08,  1.63it/s]
                                                     
{'loss': 0.5536, 'grad_norm': 1.0106827020645142, 'learning_rate': 2.624434389140272e-06, 'epoch': 0.08}

  3%|▎         | 290/11049 [02:58<1:50:08,  1.63it/s]
  3%|▎         | 291/11049 [02:59<1:50:03,  1.63it/s]
                                                     
{'loss': 0.3936, 'grad_norm': 0.6049941778182983, 'learning_rate': 2.6334841628959277e-06, 'epoch': 0.08}

  3%|▎         | 291/11049 [02:59<1:50:03,  1.63it/s]
  3%|▎         | 292/11049 [03:00<1:50:02,  1.63it/s]
                                                     
{'loss': 0.5002, 'grad_norm': 0.7934043407440186, 'learning_rate': 2.642533936651584e-06, 'epoch': 0.08}

  3%|▎         | 292/11049 [03:00<1:50:02,  1.63it/s]
  3%|▎         | 293/11049 [03:00<1:50:02,  1.63it/s]
                                                     
{'loss': 0.4424, 'grad_norm': 0.8096259832382202, 'learning_rate': 2.65158371040724e-06, 'epoch': 0.08}

  3%|▎         | 293/11049 [03:00<1:50:02,  1.63it/s]
  3%|▎         | 294/11049 [03:01<1:50:11,  1.63it/s]
                                                     
{'loss': 0.5302, 'grad_norm': 0.7276831865310669, 'learning_rate': 2.660633484162896e-06, 'epoch': 0.08}

  3%|▎         | 294/11049 [03:01<1:50:11,  1.63it/s]
  3%|▎         | 295/11049 [03:01<1:50:07,  1.63it/s]
                                                     
{'loss': 0.4395, 'grad_norm': 0.773181140422821, 'learning_rate': 2.6696832579185524e-06, 'epoch': 0.08}

  3%|▎         | 295/11049 [03:01<1:50:07,  1.63it/s]
  3%|▎         | 296/11049 [03:02<1:50:11,  1.63it/s]
                                                     
{'loss': 0.5124, 'grad_norm': 0.6948378086090088, 'learning_rate': 2.678733031674208e-06, 'epoch': 0.08}

  3%|▎         | 296/11049 [03:02<1:50:11,  1.63it/s]
  3%|▎         | 297/11049 [03:03<1:50:05,  1.63it/s]
                                                     
{'loss': 0.3618, 'grad_norm': 0.664715588092804, 'learning_rate': 2.6877828054298643e-06, 'epoch': 0.08}

  3%|▎         | 297/11049 [03:03<1:50:05,  1.63it/s]
  3%|▎         | 298/11049 [03:03<1:50:00,  1.63it/s]
                                                     
{'loss': 0.439, 'grad_norm': 0.7736392617225647, 'learning_rate': 2.6968325791855204e-06, 'epoch': 0.08}

  3%|▎         | 298/11049 [03:03<1:50:00,  1.63it/s]
  3%|▎         | 299/11049 [03:04<1:50:10,  1.63it/s]
                                                     
{'loss': 0.6096, 'grad_norm': 0.8705521821975708, 'learning_rate': 2.7058823529411766e-06, 'epoch': 0.08}

  3%|▎         | 299/11049 [03:04<1:50:10,  1.63it/s]
  3%|▎         | 300/11049 [03:04<1:50:11,  1.63it/s]
                                                     
{'loss': 0.4953, 'grad_norm': 0.767540454864502, 'learning_rate': 2.7149321266968327e-06, 'epoch': 0.08}

  3%|▎         | 300/11049 [03:05<1:50:11,  1.63it/s]
  3%|▎         | 301/11049 [03:05<1:50:06,  1.63it/s]
                                                     
{'loss': 0.5107, 'grad_norm': 0.7793522477149963, 'learning_rate': 2.7239819004524885e-06, 'epoch': 0.08}

  3%|▎         | 301/11049 [03:05<1:50:06,  1.63it/s]
  3%|▎         | 302/11049 [03:06<1:50:01,  1.63it/s]
                                                     
{'loss': 0.4093, 'grad_norm': 0.7471365928649902, 'learning_rate': 2.7330316742081446e-06, 'epoch': 0.08}

  3%|▎         | 302/11049 [03:06<1:50:01,  1.63it/s]
  3%|▎         | 303/11049 [03:06<1:49:55,  1.63it/s]
                                                     
{'loss': 0.5033, 'grad_norm': 0.8697065114974976, 'learning_rate': 2.7420814479638012e-06, 'epoch': 0.08}

  3%|▎         | 303/11049 [03:06<1:49:55,  1.63it/s]
  3%|▎         | 304/11049 [03:07<1:49:52,  1.63it/s]
                                                     
{'loss': 0.4953, 'grad_norm': 0.8758756518363953, 'learning_rate': 2.7511312217194574e-06, 'epoch': 0.08}

  3%|▎         | 304/11049 [03:07<1:49:52,  1.63it/s]
  3%|▎         | 305/11049 [03:08<1:50:20,  1.62it/s]
                                                     
{'loss': 0.4467, 'grad_norm': 0.7154930233955383, 'learning_rate': 2.7601809954751135e-06, 'epoch': 0.08}

  3%|▎         | 305/11049 [03:08<1:50:20,  1.62it/s]
  3%|▎         | 306/11049 [03:08<1:50:10,  1.63it/s]
                                                     
{'loss': 0.4697, 'grad_norm': 0.74005526304245, 'learning_rate': 2.7692307692307697e-06, 'epoch': 0.08}

  3%|▎         | 306/11049 [03:08<1:50:10,  1.63it/s]
  3%|▎         | 307/11049 [03:09<1:50:02,  1.63it/s]
                                                     
{'loss': 0.5089, 'grad_norm': 0.8767299652099609, 'learning_rate': 2.778280542986426e-06, 'epoch': 0.08}

  3%|▎         | 307/11049 [03:09<1:50:02,  1.63it/s]
  3%|▎         | 308/11049 [03:09<1:49:57,  1.63it/s]
                                                     
{'loss': 0.5711, 'grad_norm': 0.801542341709137, 'learning_rate': 2.7873303167420816e-06, 'epoch': 0.08}

  3%|▎         | 308/11049 [03:09<1:49:57,  1.63it/s]
  3%|▎         | 309/11049 [03:10<1:50:05,  1.63it/s]
                                                     
{'loss': 0.4344, 'grad_norm': 0.7704291343688965, 'learning_rate': 2.7963800904977377e-06, 'epoch': 0.08}

  3%|▎         | 309/11049 [03:10<1:50:05,  1.63it/s]
  3%|▎         | 310/11049 [03:11<1:50:06,  1.63it/s]
                                                     
{'loss': 0.5568, 'grad_norm': 0.8051407933235168, 'learning_rate': 2.805429864253394e-06, 'epoch': 0.08}

  3%|▎         | 310/11049 [03:11<1:50:06,  1.63it/s]
  3%|▎         | 311/11049 [03:11<1:49:57,  1.63it/s]
                                                     
{'loss': 0.4618, 'grad_norm': 0.8753640651702881, 'learning_rate': 2.81447963800905e-06, 'epoch': 0.08}

  3%|▎         | 311/11049 [03:11<1:49:57,  1.63it/s]
  3%|▎         | 312/11049 [03:12<1:49:53,  1.63it/s]
                                                     
{'loss': 0.409, 'grad_norm': 0.6240674257278442, 'learning_rate': 2.8235294117647062e-06, 'epoch': 0.08}

  3%|▎         | 312/11049 [03:12<1:49:53,  1.63it/s]
  3%|▎         | 313/11049 [03:12<1:49:46,  1.63it/s]
                                                     
{'loss': 0.4716, 'grad_norm': 0.732570230960846, 'learning_rate': 2.832579185520362e-06, 'epoch': 0.08}

  3%|▎         | 313/11049 [03:13<1:49:46,  1.63it/s]
  3%|▎         | 314/11049 [03:13<1:49:48,  1.63it/s]
                                                     
{'loss': 0.4771, 'grad_norm': 0.6815443634986877, 'learning_rate': 2.841628959276018e-06, 'epoch': 0.09}

  3%|▎         | 314/11049 [03:13<1:49:48,  1.63it/s]
  3%|▎         | 315/11049 [03:14<1:49:47,  1.63it/s]
                                                     
{'loss': 0.4608, 'grad_norm': 0.7011317014694214, 'learning_rate': 2.8506787330316743e-06, 'epoch': 0.09}

  3%|▎         | 315/11049 [03:14<1:49:47,  1.63it/s]
  3%|▎         | 316/11049 [03:14<1:49:46,  1.63it/s]
                                                     
{'loss': 0.5203, 'grad_norm': 0.789019763469696, 'learning_rate': 2.8597285067873304e-06, 'epoch': 0.09}

  3%|▎         | 316/11049 [03:14<1:49:46,  1.63it/s]
  3%|▎         | 317/11049 [03:15<1:49:45,  1.63it/s]
                                                     
{'loss': 0.4247, 'grad_norm': 0.688337504863739, 'learning_rate': 2.8687782805429866e-06, 'epoch': 0.09}

  3%|▎         | 317/11049 [03:15<1:49:45,  1.63it/s]
  3%|▎         | 318/11049 [03:15<1:49:41,  1.63it/s]
                                                     
{'loss': 0.5967, 'grad_norm': 0.8830932378768921, 'learning_rate': 2.8778280542986423e-06, 'epoch': 0.09}

  3%|▎         | 318/11049 [03:16<1:49:41,  1.63it/s]
  3%|▎         | 319/11049 [03:16<1:49:40,  1.63it/s]
                                                     
{'loss': 0.4694, 'grad_norm': 0.6561873555183411, 'learning_rate': 2.8868778280542985e-06, 'epoch': 0.09}

  3%|▎         | 319/11049 [03:16<1:49:40,  1.63it/s]
  3%|▎         | 320/11049 [03:17<1:49:39,  1.63it/s]
                                                     
{'loss': 0.53, 'grad_norm': 0.7861942052841187, 'learning_rate': 2.895927601809955e-06, 'epoch': 0.09}

  3%|▎         | 320/11049 [03:17<1:49:39,  1.63it/s]
  3%|▎         | 321/11049 [03:17<1:49:35,  1.63it/s]
                                                     
{'loss': 0.4227, 'grad_norm': 0.6813059449195862, 'learning_rate': 2.9049773755656112e-06, 'epoch': 0.09}

  3%|▎         | 321/11049 [03:17<1:49:35,  1.63it/s]
  3%|▎         | 322/11049 [03:18<1:49:40,  1.63it/s]
                                                     
{'loss': 0.5551, 'grad_norm': 0.7597669363021851, 'learning_rate': 2.9140271493212674e-06, 'epoch': 0.09}

  3%|▎         | 322/11049 [03:18<1:49:40,  1.63it/s]
  3%|▎         | 323/11049 [03:19<1:49:40,  1.63it/s]
                                                     
{'loss': 0.4856, 'grad_norm': 0.7826799750328064, 'learning_rate': 2.9230769230769236e-06, 'epoch': 0.09}

  3%|▎         | 323/11049 [03:19<1:49:40,  1.63it/s]
  3%|▎         | 324/11049 [03:19<1:49:39,  1.63it/s]
                                                     
{'loss': 0.4612, 'grad_norm': 0.7235337495803833, 'learning_rate': 2.9321266968325797e-06, 'epoch': 0.09}

  3%|▎         | 324/11049 [03:19<1:49:39,  1.63it/s]
  3%|▎         | 325/11049 [03:20<1:49:39,  1.63it/s]
                                                     
{'loss': 0.4526, 'grad_norm': 0.8313300609588623, 'learning_rate': 2.9411764705882355e-06, 'epoch': 0.09}

  3%|▎         | 325/11049 [03:20<1:49:39,  1.63it/s]
  3%|▎         | 326/11049 [03:20<1:49:37,  1.63it/s]
                                                     
{'loss': 0.4044, 'grad_norm': 0.6765660643577576, 'learning_rate': 2.9502262443438916e-06, 'epoch': 0.09}

  3%|▎         | 326/11049 [03:21<1:49:37,  1.63it/s]
  3%|▎         | 327/11049 [03:21<1:49:36,  1.63it/s]
                                                     
{'loss': 0.4472, 'grad_norm': 0.6749937534332275, 'learning_rate': 2.9592760180995478e-06, 'epoch': 0.09}

  3%|▎         | 327/11049 [03:21<1:49:36,  1.63it/s]
  3%|▎         | 328/11049 [03:22<1:49:33,  1.63it/s]
                                                     
{'loss': 0.4055, 'grad_norm': 0.7455217838287354, 'learning_rate': 2.968325791855204e-06, 'epoch': 0.09}

  3%|▎         | 328/11049 [03:22<1:49:33,  1.63it/s]
  3%|▎         | 329/11049 [03:22<1:49:32,  1.63it/s]
                                                     
{'loss': 0.5759, 'grad_norm': 0.9078990817070007, 'learning_rate': 2.97737556561086e-06, 'epoch': 0.09}

  3%|▎         | 329/11049 [03:22<1:49:32,  1.63it/s]
  3%|▎         | 330/11049 [03:23<1:49:33,  1.63it/s]
                                                     
{'loss': 0.606, 'grad_norm': 0.8489664196968079, 'learning_rate': 2.986425339366516e-06, 'epoch': 0.09}

  3%|▎         | 330/11049 [03:23<1:49:33,  1.63it/s]
  3%|▎         | 331/11049 [03:23<1:49:34,  1.63it/s]
                                                     
{'loss': 0.5472, 'grad_norm': 0.8670616149902344, 'learning_rate': 2.995475113122172e-06, 'epoch': 0.09}

  3%|▎         | 331/11049 [03:24<1:49:34,  1.63it/s]
  3%|▎         | 332/11049 [03:24<1:57:59,  1.51it/s]
                                                     
{'loss': 0.4755, 'grad_norm': 0.6872854828834534, 'learning_rate': 3.004524886877828e-06, 'epoch': 0.09}

  3%|▎         | 332/11049 [03:24<1:57:59,  1.51it/s]
  3%|▎         | 333/11049 [03:25<1:55:26,  1.55it/s]
                                                     
{'loss': 0.3649, 'grad_norm': 0.6183779239654541, 'learning_rate': 3.0135746606334843e-06, 'epoch': 0.09}

  3%|▎         | 333/11049 [03:25<1:55:26,  1.55it/s]
  3%|▎         | 334/11049 [03:25<1:53:35,  1.57it/s]
                                                     
{'loss': 0.448, 'grad_norm': 0.709682047367096, 'learning_rate': 3.0226244343891405e-06, 'epoch': 0.09}

  3%|▎         | 334/11049 [03:26<1:53:35,  1.57it/s]
  3%|▎         | 335/11049 [03:26<1:52:21,  1.59it/s]
                                                     
{'loss': 0.3904, 'grad_norm': 0.6740153431892395, 'learning_rate': 3.0316742081447962e-06, 'epoch': 0.09}

  3%|▎         | 335/11049 [03:26<1:52:21,  1.59it/s]
  3%|▎         | 336/11049 [03:27<1:51:32,  1.60it/s]
                                                     
{'loss': 0.3969, 'grad_norm': 0.6416434645652771, 'learning_rate': 3.0407239819004524e-06, 'epoch': 0.09}

  3%|▎         | 336/11049 [03:27<1:51:32,  1.60it/s]
  3%|▎         | 337/11049 [03:27<1:50:57,  1.61it/s]
                                                     
{'loss': 0.4381, 'grad_norm': 0.6952148675918579, 'learning_rate': 3.049773755656109e-06, 'epoch': 0.09}

  3%|▎         | 337/11049 [03:27<1:50:57,  1.61it/s]
  3%|▎         | 338/11049 [03:28<1:50:34,  1.61it/s]
                                                     
{'loss': 0.4414, 'grad_norm': 0.6522449851036072, 'learning_rate': 3.058823529411765e-06, 'epoch': 0.09}

  3%|▎         | 338/11049 [03:28<1:50:34,  1.61it/s]
  3%|▎         | 339/11049 [03:29<1:50:14,  1.62it/s]
                                                     
{'loss': 0.4231, 'grad_norm': 0.7320650815963745, 'learning_rate': 3.0678733031674213e-06, 'epoch': 0.09}

  3%|▎         | 339/11049 [03:29<1:50:14,  1.62it/s]
  3%|▎         | 340/11049 [03:29<1:50:00,  1.62it/s]
                                                     
{'loss': 0.5079, 'grad_norm': 0.9414060115814209, 'learning_rate': 3.0769230769230774e-06, 'epoch': 0.09}

  3%|▎         | 340/11049 [03:29<1:50:00,  1.62it/s]
  3%|▎         | 341/11049 [03:30<1:49:48,  1.63it/s]
                                                     
{'loss': 0.5194, 'grad_norm': 0.8281380534172058, 'learning_rate': 3.0859728506787336e-06, 'epoch': 0.09}

  3%|▎         | 341/11049 [03:30<1:49:48,  1.63it/s]
  3%|▎         | 342/11049 [03:30<1:49:49,  1.62it/s]
                                                     
{'loss': 0.4591, 'grad_norm': 0.7830485701560974, 'learning_rate': 3.0950226244343893e-06, 'epoch': 0.09}

  3%|▎         | 342/11049 [03:31<1:49:49,  1.62it/s]
  3%|▎         | 343/11049 [03:31<1:49:42,  1.63it/s]
                                                     
{'loss': 0.4939, 'grad_norm': 0.8050327301025391, 'learning_rate': 3.1040723981900455e-06, 'epoch': 0.09}

  3%|▎         | 343/11049 [03:31<1:49:42,  1.63it/s]
  3%|▎         | 344/11049 [03:32<1:49:37,  1.63it/s]
                                                     
{'loss': 0.548, 'grad_norm': 0.7857447266578674, 'learning_rate': 3.1131221719457017e-06, 'epoch': 0.09}

  3%|▎         | 344/11049 [03:32<1:49:37,  1.63it/s]
  3%|▎         | 345/11049 [03:32<1:49:29,  1.63it/s]
                                                     
{'loss': 0.5123, 'grad_norm': 0.9169197082519531, 'learning_rate': 3.122171945701358e-06, 'epoch': 0.09}

  3%|▎         | 345/11049 [03:32<1:49:29,  1.63it/s]
  3%|▎         | 346/11049 [03:33<1:49:26,  1.63it/s]
                                                     
{'loss': 0.5431, 'grad_norm': 0.7212586998939514, 'learning_rate': 3.131221719457014e-06, 'epoch': 0.09}

  3%|▎         | 346/11049 [03:33<1:49:26,  1.63it/s]
  3%|▎         | 347/11049 [03:33<1:49:22,  1.63it/s]
                                                     
{'loss': 0.4181, 'grad_norm': 0.7648208737373352, 'learning_rate': 3.1402714932126697e-06, 'epoch': 0.09}

  3%|▎         | 347/11049 [03:34<1:49:22,  1.63it/s]
  3%|▎         | 348/11049 [03:34<1:49:24,  1.63it/s]
                                                     
{'loss': 0.5712, 'grad_norm': 0.7835803031921387, 'learning_rate': 3.149321266968326e-06, 'epoch': 0.09}

  3%|▎         | 348/11049 [03:34<1:49:24,  1.63it/s]
  3%|▎         | 349/11049 [03:35<1:49:22,  1.63it/s]
                                                     
{'loss': 0.3728, 'grad_norm': 0.6878161430358887, 'learning_rate': 3.158371040723982e-06, 'epoch': 0.09}

  3%|▎         | 349/11049 [03:35<1:49:22,  1.63it/s]
  3%|▎         | 350/11049 [03:35<1:49:29,  1.63it/s]
                                                     
{'loss': 0.4348, 'grad_norm': 0.7553408145904541, 'learning_rate': 3.167420814479638e-06, 'epoch': 0.1}

  3%|▎         | 350/11049 [03:35<1:49:29,  1.63it/s]
  3%|▎         | 351/11049 [03:36<1:49:23,  1.63it/s]
                                                     
{'loss': 0.4999, 'grad_norm': 0.8288297653198242, 'learning_rate': 3.1764705882352943e-06, 'epoch': 0.1}

  3%|▎         | 351/11049 [03:36<1:49:23,  1.63it/s]
  3%|▎         | 352/11049 [03:37<1:49:19,  1.63it/s]
                                                     
{'loss': 0.4626, 'grad_norm': 0.7363475561141968, 'learning_rate': 3.18552036199095e-06, 'epoch': 0.1}

  3%|▎         | 352/11049 [03:37<1:49:19,  1.63it/s]
  3%|▎         | 353/11049 [03:37<1:49:19,  1.63it/s]
                                                     
{'loss': 0.3933, 'grad_norm': 0.67083340883255, 'learning_rate': 3.1945701357466062e-06, 'epoch': 0.1}

  3%|▎         | 353/11049 [03:37<1:49:19,  1.63it/s]
  3%|▎         | 354/11049 [03:38<1:49:16,  1.63it/s]
                                                     
{'loss': 0.4099, 'grad_norm': 0.7910089492797852, 'learning_rate': 3.203619909502263e-06, 'epoch': 0.1}

  3%|▎         | 354/11049 [03:38<1:49:16,  1.63it/s]
  3%|▎         | 355/11049 [03:38<1:49:14,  1.63it/s]
                                                     
{'loss': 0.591, 'grad_norm': 0.8312300443649292, 'learning_rate': 3.212669683257919e-06, 'epoch': 0.1}

  3%|▎         | 355/11049 [03:38<1:49:14,  1.63it/s]
  3%|▎         | 356/11049 [03:39<1:49:14,  1.63it/s]
                                                     
{'loss': 0.3903, 'grad_norm': 0.7021186947822571, 'learning_rate': 3.221719457013575e-06, 'epoch': 0.1}

  3%|▎         | 356/11049 [03:39<1:49:14,  1.63it/s]
  3%|▎         | 357/11049 [03:40<1:49:16,  1.63it/s]
                                                     
{'loss': 0.416, 'grad_norm': 0.659383237361908, 'learning_rate': 3.2307692307692313e-06, 'epoch': 0.1}

  3%|▎         | 357/11049 [03:40<1:49:16,  1.63it/s]
  3%|▎         | 358/11049 [03:40<1:49:15,  1.63it/s]
                                                     
{'loss': 0.4713, 'grad_norm': 0.6629456281661987, 'learning_rate': 3.2398190045248875e-06, 'epoch': 0.1}

  3%|▎         | 358/11049 [03:40<1:49:15,  1.63it/s]
  3%|▎         | 359/11049 [03:41<1:49:18,  1.63it/s]
                                                     
{'loss': 0.3885, 'grad_norm': 0.6898381114006042, 'learning_rate': 3.248868778280543e-06, 'epoch': 0.1}

  3%|▎         | 359/11049 [03:41<1:49:18,  1.63it/s]
  3%|▎         | 360/11049 [03:41<1:49:17,  1.63it/s]
                                                     
{'loss': 0.5381, 'grad_norm': 0.7218804359436035, 'learning_rate': 3.2579185520361994e-06, 'epoch': 0.1}

  3%|▎         | 360/11049 [03:42<1:49:17,  1.63it/s]
  3%|▎         | 361/11049 [03:42<1:49:17,  1.63it/s]
                                                     
{'loss': 0.6211, 'grad_norm': 0.8722497224807739, 'learning_rate': 3.2669683257918555e-06, 'epoch': 0.1}

  3%|▎         | 361/11049 [03:42<1:49:17,  1.63it/s]
  3%|▎         | 362/11049 [03:43<1:49:16,  1.63it/s]
                                                     
{'loss': 0.477, 'grad_norm': 0.7688378691673279, 'learning_rate': 3.2760180995475117e-06, 'epoch': 0.1}

  3%|▎         | 362/11049 [03:43<1:49:16,  1.63it/s]
  3%|▎         | 363/11049 [03:43<1:49:12,  1.63it/s]
                                                     
{'loss': 0.5174, 'grad_norm': 0.8418317437171936, 'learning_rate': 3.285067873303168e-06, 'epoch': 0.1}

  3%|▎         | 363/11049 [03:43<1:49:12,  1.63it/s]
  3%|▎         | 364/11049 [03:44<1:49:11,  1.63it/s]
                                                     
{'loss': 0.4012, 'grad_norm': 0.7400394678115845, 'learning_rate': 3.2941176470588236e-06, 'epoch': 0.1}

  3%|▎         | 364/11049 [03:44<1:49:11,  1.63it/s]
  3%|▎         | 365/11049 [03:44<1:49:11,  1.63it/s]
                                                     
{'loss': 0.5232, 'grad_norm': 0.9145305752754211, 'learning_rate': 3.3031674208144797e-06, 'epoch': 0.1}

  3%|▎         | 365/11049 [03:45<1:49:11,  1.63it/s]
  3%|▎         | 366/11049 [03:45<1:49:10,  1.63it/s]
                                                     
{'loss': 0.4515, 'grad_norm': 0.7635939121246338, 'learning_rate': 3.312217194570136e-06, 'epoch': 0.1}

  3%|▎         | 366/11049 [03:45<1:49:10,  1.63it/s]
  3%|▎         | 367/11049 [03:46<1:49:12,  1.63it/s]
                                                     
{'loss': 0.435, 'grad_norm': 0.6406332850456238, 'learning_rate': 3.321266968325792e-06, 'epoch': 0.1}

  3%|▎         | 367/11049 [03:46<1:49:12,  1.63it/s]
  3%|▎         | 368/11049 [03:46<1:49:13,  1.63it/s]
                                                     
{'loss': 0.3812, 'grad_norm': 0.6715182662010193, 'learning_rate': 3.3303167420814482e-06, 'epoch': 0.1}

  3%|▎         | 368/11049 [03:46<1:49:13,  1.63it/s]
  3%|▎         | 369/11049 [03:47<1:49:12,  1.63it/s]
                                                     
{'loss': 0.4287, 'grad_norm': 0.6145111918449402, 'learning_rate': 3.339366515837104e-06, 'epoch': 0.1}

  3%|▎         | 369/11049 [03:47<1:49:12,  1.63it/s]
  3%|▎         | 370/11049 [03:48<1:49:10,  1.63it/s]
                                                     
{'loss': 0.4288, 'grad_norm': 0.6148973703384399, 'learning_rate': 3.34841628959276e-06, 'epoch': 0.1}

  3%|▎         | 370/11049 [03:48<1:49:10,  1.63it/s]
  3%|▎         | 371/11049 [03:48<1:49:09,  1.63it/s]
                                                     
{'loss': 0.5821, 'grad_norm': 0.9105344414710999, 'learning_rate': 3.3574660633484163e-06, 'epoch': 0.1}

  3%|▎         | 371/11049 [03:48<1:49:09,  1.63it/s]
  3%|▎         | 372/11049 [03:49<1:49:11,  1.63it/s]
                                                     
{'loss': 0.3863, 'grad_norm': 0.6470476984977722, 'learning_rate': 3.366515837104073e-06, 'epoch': 0.1}

  3%|▎         | 372/11049 [03:49<1:49:11,  1.63it/s]
  3%|▎         | 373/11049 [03:49<1:49:08,  1.63it/s]
                                                     
{'loss': 0.5182, 'grad_norm': 0.7805052399635315, 'learning_rate': 3.375565610859729e-06, 'epoch': 0.1}

  3%|▎         | 373/11049 [03:50<1:49:08,  1.63it/s]
  3%|▎         | 374/11049 [03:50<1:49:08,  1.63it/s]
                                                     
{'loss': 0.4728, 'grad_norm': 0.7632883787155151, 'learning_rate': 3.384615384615385e-06, 'epoch': 0.1}

  3%|▎         | 374/11049 [03:50<1:49:08,  1.63it/s]
  3%|▎         | 375/11049 [03:51<1:49:07,  1.63it/s]
                                                     
{'loss': 0.3677, 'grad_norm': 0.6100804209709167, 'learning_rate': 3.3936651583710413e-06, 'epoch': 0.1}

  3%|▎         | 375/11049 [03:51<1:49:07,  1.63it/s]
  3%|▎         | 376/11049 [03:51<1:49:05,  1.63it/s]
                                                     
{'loss': 0.4797, 'grad_norm': 0.6409674286842346, 'learning_rate': 3.402714932126697e-06, 'epoch': 0.1}

  3%|▎         | 376/11049 [03:51<1:49:05,  1.63it/s]
  3%|▎         | 377/11049 [03:52<1:49:04,  1.63it/s]
                                                     
{'loss': 0.4542, 'grad_norm': 0.6986057162284851, 'learning_rate': 3.4117647058823532e-06, 'epoch': 0.1}

  3%|▎         | 377/11049 [03:52<1:49:04,  1.63it/s]
  3%|▎         | 378/11049 [03:52<1:49:07,  1.63it/s]
                                                     
{'loss': 0.4456, 'grad_norm': 0.666355311870575, 'learning_rate': 3.4208144796380094e-06, 'epoch': 0.1}

  3%|▎         | 378/11049 [03:53<1:49:07,  1.63it/s]
  3%|▎         | 379/11049 [03:53<1:49:06,  1.63it/s]
                                                     
{'loss': 0.4715, 'grad_norm': 0.756523609161377, 'learning_rate': 3.4298642533936656e-06, 'epoch': 0.1}

  3%|▎         | 379/11049 [03:53<1:49:06,  1.63it/s]
  3%|▎         | 380/11049 [03:54<1:49:06,  1.63it/s]
                                                     
{'loss': 0.4435, 'grad_norm': 0.6548663973808289, 'learning_rate': 3.4389140271493217e-06, 'epoch': 0.1}

  3%|▎         | 380/11049 [03:54<1:49:06,  1.63it/s]
  3%|▎         | 381/11049 [03:54<1:49:06,  1.63it/s]
                                                     
{'loss': 0.4116, 'grad_norm': 0.6587477922439575, 'learning_rate': 3.4479638009049775e-06, 'epoch': 0.1}

  3%|▎         | 381/11049 [03:54<1:49:06,  1.63it/s]
  3%|▎         | 382/11049 [03:55<1:49:04,  1.63it/s]
                                                     
{'loss': 0.5816, 'grad_norm': 0.9396393299102783, 'learning_rate': 3.4570135746606336e-06, 'epoch': 0.1}

  3%|▎         | 382/11049 [03:55<1:49:04,  1.63it/s]
  3%|▎         | 383/11049 [03:56<1:49:03,  1.63it/s]
                                                     
{'loss': 0.4986, 'grad_norm': 0.8233727216720581, 'learning_rate': 3.4660633484162898e-06, 'epoch': 0.1}

  3%|▎         | 383/11049 [03:56<1:49:03,  1.63it/s]
  3%|▎         | 384/11049 [03:56<1:49:08,  1.63it/s]
                                                     
{'loss': 0.488, 'grad_norm': 0.7894731760025024, 'learning_rate': 3.475113122171946e-06, 'epoch': 0.1}

  3%|▎         | 384/11049 [03:56<1:49:08,  1.63it/s]
  3%|▎         | 385/11049 [03:57<1:49:04,  1.63it/s]
                                                     
{'loss': 0.4661, 'grad_norm': 0.687257707118988, 'learning_rate': 3.484162895927602e-06, 'epoch': 0.1}

  3%|▎         | 385/11049 [03:57<1:49:04,  1.63it/s]
  3%|▎         | 386/11049 [03:57<1:49:03,  1.63it/s]
                                                     
{'loss': 0.4634, 'grad_norm': 0.7396780252456665, 'learning_rate': 3.493212669683258e-06, 'epoch': 0.1}

  3%|▎         | 386/11049 [03:57<1:49:03,  1.63it/s]
  4%|▎         | 387/11049 [03:58<1:49:03,  1.63it/s]
                                                     
{'loss': 0.4683, 'grad_norm': 0.7217668294906616, 'learning_rate': 3.502262443438914e-06, 'epoch': 0.11}

  4%|▎         | 387/11049 [03:58<1:49:03,  1.63it/s]
  4%|▎         | 388/11049 [03:59<1:49:01,  1.63it/s]
                                                     
{'loss': 0.4271, 'grad_norm': 0.6457211375236511, 'learning_rate': 3.51131221719457e-06, 'epoch': 0.11}

  4%|▎         | 388/11049 [03:59<1:49:01,  1.63it/s]
  4%|▎         | 389/11049 [03:59<1:49:01,  1.63it/s]
                                                     
{'loss': 0.444, 'grad_norm': 0.7176119089126587, 'learning_rate': 3.5203619909502267e-06, 'epoch': 0.11}

  4%|▎         | 389/11049 [03:59<1:49:01,  1.63it/s]
  4%|▎         | 390/11049 [04:00<1:49:01,  1.63it/s]
                                                     
{'loss': 0.567, 'grad_norm': 0.7711572051048279, 'learning_rate': 3.529411764705883e-06, 'epoch': 0.11}

  4%|▎         | 390/11049 [04:00<1:49:01,  1.63it/s]
  4%|▎         | 391/11049 [04:00<1:52:04,  1.58it/s]
                                                     
{'loss': 0.4192, 'grad_norm': 0.7406527996063232, 'learning_rate': 3.538461538461539e-06, 'epoch': 0.11}

  4%|▎         | 391/11049 [04:01<1:52:04,  1.58it/s]
  4%|▎         | 392/11049 [04:01<1:51:41,  1.59it/s]
                                                     
{'loss': 0.391, 'grad_norm': 0.6009332537651062, 'learning_rate': 3.547511312217195e-06, 'epoch': 0.11}

  4%|▎         | 392/11049 [04:01<1:51:41,  1.59it/s]
  4%|▎         | 393/11049 [04:02<1:51:02,  1.60it/s]
                                                     
{'loss': 0.5396, 'grad_norm': 0.7380569577217102, 'learning_rate': 3.556561085972851e-06, 'epoch': 0.11}

  4%|▎         | 393/11049 [04:02<1:51:02,  1.60it/s]
  4%|▎         | 394/11049 [04:02<1:50:25,  1.61it/s]
                                                     
{'loss': 0.4974, 'grad_norm': 0.7763075232505798, 'learning_rate': 3.565610859728507e-06, 'epoch': 0.11}

  4%|▎         | 394/11049 [04:02<1:50:25,  1.61it/s]
  4%|▎         | 395/11049 [04:03<1:49:57,  1.61it/s]
                                                     
{'loss': 0.4697, 'grad_norm': 0.7064224481582642, 'learning_rate': 3.5746606334841633e-06, 'epoch': 0.11}

  4%|▎         | 395/11049 [04:03<1:49:57,  1.61it/s]
  4%|▎         | 396/11049 [04:04<1:49:40,  1.62it/s]
                                                     
{'loss': 0.4525, 'grad_norm': 0.7423190474510193, 'learning_rate': 3.5837104072398194e-06, 'epoch': 0.11}

  4%|▎         | 396/11049 [04:04<1:49:40,  1.62it/s]
  4%|▎         | 397/11049 [04:04<1:49:37,  1.62it/s]
                                                     
{'loss': 0.3677, 'grad_norm': 0.6619893908500671, 'learning_rate': 3.5927601809954756e-06, 'epoch': 0.11}

  4%|▎         | 397/11049 [04:04<1:49:37,  1.62it/s]
  4%|▎         | 398/11049 [04:05<1:49:26,  1.62it/s]
                                                     
{'loss': 0.4372, 'grad_norm': 0.6865612864494324, 'learning_rate': 3.6018099547511313e-06, 'epoch': 0.11}

  4%|▎         | 398/11049 [04:05<1:49:26,  1.62it/s]
  4%|▎         | 399/11049 [04:05<1:49:18,  1.62it/s]
                                                     
{'loss': 0.4184, 'grad_norm': 0.7470064163208008, 'learning_rate': 3.6108597285067875e-06, 'epoch': 0.11}

  4%|▎         | 399/11049 [04:06<1:49:18,  1.62it/s]
  4%|▎         | 400/11049 [04:06<1:49:09,  1.63it/s]
                                                     
{'loss': 0.4248, 'grad_norm': 0.6867095828056335, 'learning_rate': 3.6199095022624436e-06, 'epoch': 0.11}

  4%|▎         | 400/11049 [04:06<1:49:09,  1.63it/s]
  4%|▎         | 401/11049 [04:07<1:49:03,  1.63it/s]
                                                     
{'loss': 0.4637, 'grad_norm': 0.7069872617721558, 'learning_rate': 3.6289592760181e-06, 'epoch': 0.11}

  4%|▎         | 401/11049 [04:07<1:49:03,  1.63it/s]
  4%|▎         | 402/11049 [04:07<1:49:12,  1.62it/s]
                                                     
{'loss': 0.4804, 'grad_norm': 0.778482973575592, 'learning_rate': 3.638009049773756e-06, 'epoch': 0.11}

  4%|▎         | 402/11049 [04:07<1:49:12,  1.62it/s]
  4%|▎         | 403/11049 [04:08<1:49:07,  1.63it/s]
                                                     
{'loss': 0.4249, 'grad_norm': 0.6843646764755249, 'learning_rate': 3.6470588235294117e-06, 'epoch': 0.11}

  4%|▎         | 403/11049 [04:08<1:49:07,  1.63it/s]
  4%|▎         | 404/11049 [04:08<1:49:01,  1.63it/s]
                                                     
{'loss': 0.3799, 'grad_norm': 0.6521209478378296, 'learning_rate': 3.656108597285068e-06, 'epoch': 0.11}

  4%|▎         | 404/11049 [04:09<1:49:01,  1.63it/s]
  4%|▎         | 405/11049 [04:09<1:48:55,  1.63it/s]
                                                     
{'loss': 0.3917, 'grad_norm': 0.7132573127746582, 'learning_rate': 3.665158371040724e-06, 'epoch': 0.11}

  4%|▎         | 405/11049 [04:09<1:48:55,  1.63it/s]
  4%|▎         | 406/11049 [04:10<1:48:55,  1.63it/s]
                                                     
{'loss': 0.3786, 'grad_norm': 0.5890000462532043, 'learning_rate': 3.6742081447963806e-06, 'epoch': 0.11}

  4%|▎         | 406/11049 [04:10<1:48:55,  1.63it/s]
  4%|▎         | 407/11049 [04:10<1:48:59,  1.63it/s]
                                                     
{'loss': 0.4247, 'grad_norm': 0.6598055362701416, 'learning_rate': 3.6832579185520368e-06, 'epoch': 0.11}

  4%|▎         | 407/11049 [04:10<1:48:59,  1.63it/s]
  4%|▎         | 408/11049 [04:11<1:49:04,  1.63it/s]
                                                     
{'loss': 0.4808, 'grad_norm': 0.7630977034568787, 'learning_rate': 3.692307692307693e-06, 'epoch': 0.11}

  4%|▎         | 408/11049 [04:11<1:49:04,  1.63it/s]
  4%|▎         | 409/11049 [04:12<1:48:58,  1.63it/s]
                                                     
{'loss': 0.4145, 'grad_norm': 0.777794361114502, 'learning_rate': 3.701357466063349e-06, 'epoch': 0.11}

  4%|▎         | 409/11049 [04:12<1:48:58,  1.63it/s]
  4%|▎         | 410/11049 [04:12<1:48:53,  1.63it/s]
                                                     
{'loss': 0.4123, 'grad_norm': 0.8284676671028137, 'learning_rate': 3.710407239819005e-06, 'epoch': 0.11}

  4%|▎         | 410/11049 [04:12<1:48:53,  1.63it/s]
  4%|▎         | 411/11049 [04:13<1:48:53,  1.63it/s]
                                                     
{'loss': 0.4986, 'grad_norm': 0.6881372928619385, 'learning_rate': 3.719457013574661e-06, 'epoch': 0.11}

  4%|▎         | 411/11049 [04:13<1:48:53,  1.63it/s]
  4%|▎         | 412/11049 [04:13<1:49:03,  1.63it/s]
                                                     
{'loss': 0.4248, 'grad_norm': 0.6859004497528076, 'learning_rate': 3.728506787330317e-06, 'epoch': 0.11}

  4%|▎         | 412/11049 [04:14<1:49:03,  1.63it/s]
  4%|▎         | 413/11049 [04:14<1:48:55,  1.63it/s]
                                                     
{'loss': 0.4357, 'grad_norm': 0.7426102161407471, 'learning_rate': 3.7375565610859733e-06, 'epoch': 0.11}

  4%|▎         | 413/11049 [04:14<1:48:55,  1.63it/s]
  4%|▎         | 414/11049 [04:15<1:48:51,  1.63it/s]
                                                     
{'loss': 0.4527, 'grad_norm': 0.7237312197685242, 'learning_rate': 3.7466063348416295e-06, 'epoch': 0.11}

  4%|▎         | 414/11049 [04:15<1:48:51,  1.63it/s]
  4%|▍         | 415/11049 [04:15<1:48:49,  1.63it/s]
                                                     
{'loss': 0.4274, 'grad_norm': 0.721413254737854, 'learning_rate': 3.755656108597285e-06, 'epoch': 0.11}

  4%|▍         | 415/11049 [04:15<1:48:49,  1.63it/s]
  4%|▍         | 416/11049 [04:16<1:48:53,  1.63it/s]
                                                     
{'loss': 0.4155, 'grad_norm': 0.6923296451568604, 'learning_rate': 3.7647058823529414e-06, 'epoch': 0.11}

  4%|▍         | 416/11049 [04:16<1:48:53,  1.63it/s]
  4%|▍         | 417/11049 [04:16<1:49:02,  1.63it/s]
                                                     
{'loss': 0.4883, 'grad_norm': 0.6076958775520325, 'learning_rate': 3.7737556561085975e-06, 'epoch': 0.11}

  4%|▍         | 417/11049 [04:17<1:49:02,  1.63it/s]
  4%|▍         | 418/11049 [04:17<1:48:55,  1.63it/s]
                                                     
{'loss': 0.3902, 'grad_norm': 0.684668242931366, 'learning_rate': 3.7828054298642537e-06, 'epoch': 0.11}

  4%|▍         | 418/11049 [04:17<1:48:55,  1.63it/s]
  4%|▍         | 419/11049 [04:18<1:48:50,  1.63it/s]
                                                     
{'loss': 0.3661, 'grad_norm': 0.6558871865272522, 'learning_rate': 3.79185520361991e-06, 'epoch': 0.11}

  4%|▍         | 419/11049 [04:18<1:48:50,  1.63it/s]
  4%|▍         | 420/11049 [04:18<1:48:44,  1.63it/s]
                                                     
{'loss': 0.3825, 'grad_norm': 0.7231869697570801, 'learning_rate': 3.8009049773755656e-06, 'epoch': 0.11}

  4%|▍         | 420/11049 [04:18<1:48:44,  1.63it/s]
  4%|▍         | 421/11049 [04:19<1:48:44,  1.63it/s]
                                                     
{'loss': 0.3957, 'grad_norm': 0.7396750450134277, 'learning_rate': 3.8099547511312217e-06, 'epoch': 0.11}

  4%|▍         | 421/11049 [04:19<1:48:44,  1.63it/s]
  4%|▍         | 422/11049 [04:20<1:48:58,  1.63it/s]
                                                     
{'loss': 0.3349, 'grad_norm': 0.5867669582366943, 'learning_rate': 3.819004524886878e-06, 'epoch': 0.11}

  4%|▍         | 422/11049 [04:20<1:48:58,  1.63it/s]
  4%|▍         | 423/11049 [04:20<1:48:57,  1.63it/s]
                                                     
{'loss': 0.4499, 'grad_norm': 0.7811197638511658, 'learning_rate': 3.828054298642534e-06, 'epoch': 0.11}

  4%|▍         | 423/11049 [04:20<1:48:57,  1.63it/s]
  4%|▍         | 424/11049 [04:21<1:48:53,  1.63it/s]
                                                     
{'loss': 0.4036, 'grad_norm': 0.7627854347229004, 'learning_rate': 3.837104072398191e-06, 'epoch': 0.12}

  4%|▍         | 424/11049 [04:21<1:48:53,  1.63it/s]
  4%|▍         | 425/11049 [04:21<1:48:47,  1.63it/s]
                                                     
{'loss': 0.3582, 'grad_norm': 0.6196509003639221, 'learning_rate': 3.846153846153847e-06, 'epoch': 0.12}

  4%|▍         | 425/11049 [04:22<1:48:47,  1.63it/s]
  4%|▍         | 426/11049 [04:22<1:48:44,  1.63it/s]
                                                     
{'loss': 0.5102, 'grad_norm': 0.6729833483695984, 'learning_rate': 3.855203619909503e-06, 'epoch': 0.12}

  4%|▍         | 426/11049 [04:22<1:48:44,  1.63it/s]
  4%|▍         | 427/11049 [04:23<1:48:52,  1.63it/s]
                                                     
{'loss': 0.5393, 'grad_norm': 0.7146499156951904, 'learning_rate': 3.864253393665159e-06, 'epoch': 0.12}

  4%|▍         | 427/11049 [04:23<1:48:52,  1.63it/s]
  4%|▍         | 428/11049 [04:23<1:48:57,  1.62it/s]
                                                     
{'loss': 0.399, 'grad_norm': 0.6555804014205933, 'learning_rate': 3.873303167420815e-06, 'epoch': 0.12}

  4%|▍         | 428/11049 [04:23<1:48:57,  1.62it/s]
  4%|▍         | 429/11049 [04:24<1:48:50,  1.63it/s]
                                                     
{'loss': 0.454, 'grad_norm': 0.6751609444618225, 'learning_rate': 3.882352941176471e-06, 'epoch': 0.12}

  4%|▍         | 429/11049 [04:24<1:48:50,  1.63it/s]
  4%|▍         | 430/11049 [04:24<1:48:43,  1.63it/s]
                                                     
{'loss': 0.3938, 'grad_norm': 0.6304214596748352, 'learning_rate': 3.891402714932127e-06, 'epoch': 0.12}

  4%|▍         | 430/11049 [04:25<1:48:43,  1.63it/s]
  4%|▍         | 431/11049 [04:25<1:48:44,  1.63it/s]
                                                     
{'loss': 0.5399, 'grad_norm': 0.7144843935966492, 'learning_rate': 3.900452488687783e-06, 'epoch': 0.12}

  4%|▍         | 431/11049 [04:25<1:48:44,  1.63it/s]
  4%|▍         | 432/11049 [04:26<1:49:17,  1.62it/s]
                                                     
{'loss': 0.3872, 'grad_norm': 0.621015727519989, 'learning_rate': 3.909502262443439e-06, 'epoch': 0.12}

  4%|▍         | 432/11049 [04:26<1:49:17,  1.62it/s]
  4%|▍         | 433/11049 [04:26<1:49:08,  1.62it/s]
                                                     
{'loss': 0.4233, 'grad_norm': 0.6626269817352295, 'learning_rate': 3.918552036199095e-06, 'epoch': 0.12}

  4%|▍         | 433/11049 [04:26<1:49:08,  1.62it/s]
  4%|▍         | 434/11049 [04:27<1:48:54,  1.62it/s]
                                                     
{'loss': 0.5031, 'grad_norm': 0.6896083950996399, 'learning_rate': 3.927601809954751e-06, 'epoch': 0.12}

  4%|▍         | 434/11049 [04:27<1:48:54,  1.62it/s]
  4%|▍         | 435/11049 [04:28<1:48:46,  1.63it/s]
                                                     
{'loss': 0.3965, 'grad_norm': 0.8210969567298889, 'learning_rate': 3.9366515837104075e-06, 'epoch': 0.12}

  4%|▍         | 435/11049 [04:28<1:48:46,  1.63it/s]
  4%|▍         | 436/11049 [04:28<1:48:41,  1.63it/s]
                                                     
{'loss': 0.5463, 'grad_norm': 0.8546420335769653, 'learning_rate': 3.945701357466064e-06, 'epoch': 0.12}

  4%|▍         | 436/11049 [04:28<1:48:41,  1.63it/s]
  4%|▍         | 437/11049 [04:29<1:48:50,  1.62it/s]
                                                     
{'loss': 0.4474, 'grad_norm': 0.700328528881073, 'learning_rate': 3.95475113122172e-06, 'epoch': 0.12}

  4%|▍         | 437/11049 [04:29<1:48:50,  1.62it/s]
  4%|▍         | 438/11049 [04:29<1:48:51,  1.62it/s]
                                                     
{'loss': 0.3966, 'grad_norm': 0.6187232136726379, 'learning_rate': 3.963800904977376e-06, 'epoch': 0.12}

  4%|▍         | 438/11049 [04:30<1:48:51,  1.62it/s]
  4%|▍         | 439/11049 [04:30<1:48:47,  1.63it/s]
                                                     
{'loss': 0.5624, 'grad_norm': 0.7890937924385071, 'learning_rate': 3.972850678733031e-06, 'epoch': 0.12}

  4%|▍         | 439/11049 [04:30<1:48:47,  1.63it/s]
  4%|▍         | 440/11049 [04:31<1:48:38,  1.63it/s]
                                                     
{'loss': 0.3046, 'grad_norm': 0.6244643926620483, 'learning_rate': 3.9819004524886875e-06, 'epoch': 0.12}

  4%|▍         | 440/11049 [04:31<1:48:38,  1.63it/s]
  4%|▍         | 441/11049 [04:31<1:48:35,  1.63it/s]
                                                     
{'loss': 0.4149, 'grad_norm': 0.6378055810928345, 'learning_rate': 3.9909502262443445e-06, 'epoch': 0.12}

  4%|▍         | 441/11049 [04:31<1:48:35,  1.63it/s]
  4%|▍         | 442/11049 [04:32<1:48:45,  1.63it/s]
                                                     
{'loss': 0.4442, 'grad_norm': 0.800894021987915, 'learning_rate': 4.000000000000001e-06, 'epoch': 0.12}

  4%|▍         | 442/11049 [04:32<1:48:45,  1.63it/s]
  4%|▍         | 443/11049 [04:32<1:48:38,  1.63it/s]
                                                     
{'loss': 0.5474, 'grad_norm': 0.7453424334526062, 'learning_rate': 4.009049773755657e-06, 'epoch': 0.12}

  4%|▍         | 443/11049 [04:33<1:48:38,  1.63it/s]
  4%|▍         | 444/11049 [04:33<1:48:34,  1.63it/s]
                                                     
{'loss': 0.331, 'grad_norm': 0.6304260492324829, 'learning_rate': 4.018099547511313e-06, 'epoch': 0.12}

  4%|▍         | 444/11049 [04:33<1:48:34,  1.63it/s]
  4%|▍         | 445/11049 [04:34<1:48:30,  1.63it/s]
                                                     
{'loss': 0.4395, 'grad_norm': 0.6891616582870483, 'learning_rate': 4.027149321266969e-06, 'epoch': 0.12}

  4%|▍         | 445/11049 [04:34<1:48:30,  1.63it/s]
  4%|▍         | 446/11049 [04:34<1:48:28,  1.63it/s]
                                                     
{'loss': 0.4282, 'grad_norm': 0.7286535501480103, 'learning_rate': 4.0361990950226245e-06, 'epoch': 0.12}

  4%|▍         | 446/11049 [04:34<1:48:28,  1.63it/s]
  4%|▍         | 447/11049 [04:35<1:48:40,  1.63it/s]
                                                     
{'loss': 0.5495, 'grad_norm': 0.6974045038223267, 'learning_rate': 4.045248868778281e-06, 'epoch': 0.12}

  4%|▍         | 447/11049 [04:35<1:48:40,  1.63it/s]
  4%|▍         | 448/11049 [04:36<1:48:33,  1.63it/s]
                                                     
{'loss': 0.4586, 'grad_norm': 0.7680150270462036, 'learning_rate': 4.054298642533937e-06, 'epoch': 0.12}

  4%|▍         | 448/11049 [04:36<1:48:33,  1.63it/s]
  4%|▍         | 449/11049 [04:36<1:48:28,  1.63it/s]
                                                     
{'loss': 0.4302, 'grad_norm': 0.7639330625534058, 'learning_rate': 4.063348416289593e-06, 'epoch': 0.12}

  4%|▍         | 449/11049 [04:36<1:48:28,  1.63it/s]
  4%|▍         | 450/11049 [04:37<1:48:24,  1.63it/s]
                                                     
{'loss': 0.384, 'grad_norm': 0.6717514991760254, 'learning_rate': 4.072398190045249e-06, 'epoch': 0.12}

  4%|▍         | 450/11049 [04:37<1:48:24,  1.63it/s]
  4%|▍         | 451/11049 [04:37<1:48:22,  1.63it/s]
                                                     
{'loss': 0.4784, 'grad_norm': 0.8220816254615784, 'learning_rate': 4.081447963800905e-06, 'epoch': 0.12}

  4%|▍         | 451/11049 [04:38<1:48:22,  1.63it/s]
  4%|▍         | 452/11049 [04:38<1:48:31,  1.63it/s]
                                                     
{'loss': 0.4453, 'grad_norm': 0.6778345108032227, 'learning_rate': 4.090497737556561e-06, 'epoch': 0.12}

  4%|▍         | 452/11049 [04:38<1:48:31,  1.63it/s]
  4%|▍         | 453/11049 [04:39<1:48:25,  1.63it/s]
                                                     
{'loss': 0.4583, 'grad_norm': 0.8006123900413513, 'learning_rate': 4.099547511312218e-06, 'epoch': 0.12}

  4%|▍         | 453/11049 [04:39<1:48:25,  1.63it/s]
  4%|▍         | 454/11049 [04:39<1:48:24,  1.63it/s]
                                                     
{'loss': 0.4396, 'grad_norm': 0.7984000444412231, 'learning_rate': 4.108597285067874e-06, 'epoch': 0.12}

  4%|▍         | 454/11049 [04:39<1:48:24,  1.63it/s]
  4%|▍         | 455/11049 [04:40<1:48:48,  1.62it/s]
                                                     
{'loss': 0.4372, 'grad_norm': 0.6440999507904053, 'learning_rate': 4.11764705882353e-06, 'epoch': 0.12}

  4%|▍         | 455/11049 [04:40<1:48:48,  1.62it/s]
  4%|▍         | 456/11049 [04:40<1:48:37,  1.63it/s]
                                                     
{'loss': 0.6054, 'grad_norm': 0.7677968144416809, 'learning_rate': 4.126696832579185e-06, 'epoch': 0.12}

  4%|▍         | 456/11049 [04:41<1:48:37,  1.63it/s]
  4%|▍         | 457/11049 [04:41<1:48:39,  1.62it/s]
                                                     
{'loss': 0.4428, 'grad_norm': 0.6715267896652222, 'learning_rate': 4.135746606334841e-06, 'epoch': 0.12}

  4%|▍         | 457/11049 [04:41<1:48:39,  1.62it/s]
  4%|▍         | 458/11049 [04:42<1:48:34,  1.63it/s]
                                                     
{'loss': 0.4531, 'grad_norm': 0.7700802683830261, 'learning_rate': 4.144796380090498e-06, 'epoch': 0.12}

  4%|▍         | 458/11049 [04:42<1:48:34,  1.63it/s]
  4%|▍         | 459/11049 [04:42<1:48:30,  1.63it/s]
                                                     
{'loss': 0.4648, 'grad_norm': 0.7391918301582336, 'learning_rate': 4.1538461538461545e-06, 'epoch': 0.12}

  4%|▍         | 459/11049 [04:42<1:48:30,  1.63it/s]
  4%|▍         | 460/11049 [04:43<1:48:23,  1.63it/s]
                                                     
{'loss': 0.3874, 'grad_norm': 0.6088336110115051, 'learning_rate': 4.162895927601811e-06, 'epoch': 0.12}

  4%|▍         | 460/11049 [04:43<1:48:23,  1.63it/s]
  4%|▍         | 461/11049 [04:44<1:48:20,  1.63it/s]
                                                     
{'loss': 0.3984, 'grad_norm': 0.6484740972518921, 'learning_rate': 4.171945701357467e-06, 'epoch': 0.13}

  4%|▍         | 461/11049 [04:44<1:48:20,  1.63it/s]
  4%|▍         | 462/11049 [04:44<1:48:28,  1.63it/s]
                                                     
{'loss': 0.3678, 'grad_norm': 0.6144160628318787, 'learning_rate': 4.180995475113123e-06, 'epoch': 0.13}

  4%|▍         | 462/11049 [04:44<1:48:28,  1.63it/s]
  4%|▍         | 463/11049 [04:45<1:48:30,  1.63it/s]
                                                     
{'loss': 0.5104, 'grad_norm': 0.7680591344833374, 'learning_rate': 4.190045248868778e-06, 'epoch': 0.13}

  4%|▍         | 463/11049 [04:45<1:48:30,  1.63it/s]
  4%|▍         | 464/11049 [04:45<1:48:32,  1.63it/s]
                                                     
{'loss': 0.4158, 'grad_norm': 0.7110497355461121, 'learning_rate': 4.1990950226244345e-06, 'epoch': 0.13}

  4%|▍         | 464/11049 [04:45<1:48:32,  1.63it/s]
  4%|▍         | 465/11049 [04:46<1:48:29,  1.63it/s]
                                                     
{'loss': 0.5391, 'grad_norm': 0.8951210975646973, 'learning_rate': 4.208144796380091e-06, 'epoch': 0.13}

  4%|▍         | 465/11049 [04:46<1:48:29,  1.63it/s]
  4%|▍         | 466/11049 [04:47<1:48:28,  1.63it/s]
                                                     
{'loss': 0.4865, 'grad_norm': 0.7007055282592773, 'learning_rate': 4.217194570135747e-06, 'epoch': 0.13}

  4%|▍         | 466/11049 [04:47<1:48:28,  1.63it/s]
  4%|▍         | 467/11049 [04:47<1:48:55,  1.62it/s]
                                                     
{'loss': 0.481, 'grad_norm': 0.7172190546989441, 'learning_rate': 4.226244343891403e-06, 'epoch': 0.13}

  4%|▍         | 467/11049 [04:47<1:48:55,  1.62it/s]
  4%|▍         | 468/11049 [04:48<1:49:11,  1.62it/s]
                                                     
{'loss': 0.5322, 'grad_norm': 0.757617712020874, 'learning_rate': 4.235294117647059e-06, 'epoch': 0.13}

  4%|▍         | 468/11049 [04:48<1:49:11,  1.62it/s]
  4%|▍         | 469/11049 [04:48<1:48:53,  1.62it/s]
                                                     
{'loss': 0.4218, 'grad_norm': 0.8157471418380737, 'learning_rate': 4.244343891402715e-06, 'epoch': 0.13}

  4%|▍         | 469/11049 [04:49<1:48:53,  1.62it/s]
  4%|▍         | 470/11049 [04:49<1:48:39,  1.62it/s]
                                                     
{'loss': 0.468, 'grad_norm': 0.7492876052856445, 'learning_rate': 4.2533936651583714e-06, 'epoch': 0.13}

  4%|▍         | 470/11049 [04:49<1:48:39,  1.62it/s]
  4%|▍         | 471/11049 [04:50<1:48:28,  1.63it/s]
                                                     
{'loss': 0.4646, 'grad_norm': 0.6682203412055969, 'learning_rate': 4.262443438914028e-06, 'epoch': 0.13}

  4%|▍         | 471/11049 [04:50<1:48:28,  1.63it/s]
  4%|▍         | 472/11049 [04:50<1:48:27,  1.63it/s]
                                                     
{'loss': 0.3687, 'grad_norm': 0.6804217100143433, 'learning_rate': 4.271493212669684e-06, 'epoch': 0.13}

  4%|▍         | 472/11049 [04:50<1:48:27,  1.63it/s]
  4%|▍         | 473/11049 [04:51<1:48:26,  1.63it/s]
                                                     
{'loss': 0.3941, 'grad_norm': 0.6752704381942749, 'learning_rate': 4.280542986425339e-06, 'epoch': 0.13}

  4%|▍         | 473/11049 [04:51<1:48:26,  1.63it/s]
  4%|▍         | 474/11049 [04:52<1:48:17,  1.63it/s]
                                                     
{'loss': 0.4543, 'grad_norm': 0.6494093537330627, 'learning_rate': 4.289592760180995e-06, 'epoch': 0.13}

  4%|▍         | 474/11049 [04:52<1:48:17,  1.63it/s]
  4%|▍         | 475/11049 [04:52<1:48:11,  1.63it/s]
                                                     
{'loss': 0.5064, 'grad_norm': 0.7240394949913025, 'learning_rate': 4.298642533936652e-06, 'epoch': 0.13}

  4%|▍         | 475/11049 [04:52<1:48:11,  1.63it/s]
  4%|▍         | 476/11049 [04:53<1:48:16,  1.63it/s]
                                                     
{'loss': 0.4364, 'grad_norm': 0.6646638512611389, 'learning_rate': 4.307692307692308e-06, 'epoch': 0.13}

  4%|▍         | 476/11049 [04:53<1:48:16,  1.63it/s]
  4%|▍         | 477/11049 [04:53<1:48:23,  1.63it/s]
                                                     
{'loss': 0.5123, 'grad_norm': 0.8073949813842773, 'learning_rate': 4.3167420814479646e-06, 'epoch': 0.13}

  4%|▍         | 477/11049 [04:54<1:48:23,  1.63it/s]
  4%|▍         | 478/11049 [04:54<1:48:22,  1.63it/s]
                                                     
{'loss': 0.3954, 'grad_norm': 0.7507007122039795, 'learning_rate': 4.325791855203621e-06, 'epoch': 0.13}

  4%|▍         | 478/11049 [04:54<1:48:22,  1.63it/s]
  4%|▍         | 479/11049 [04:55<1:48:16,  1.63it/s]
                                                     
{'loss': 0.4103, 'grad_norm': 0.6556596755981445, 'learning_rate': 4.334841628959277e-06, 'epoch': 0.13}

  4%|▍         | 479/11049 [04:55<1:48:16,  1.63it/s]
  4%|▍         | 480/11049 [04:55<1:48:19,  1.63it/s]
                                                     
{'loss': 0.3796, 'grad_norm': 0.632182776927948, 'learning_rate': 4.343891402714932e-06, 'epoch': 0.13}

  4%|▍         | 480/11049 [04:55<1:48:19,  1.63it/s]
  4%|▍         | 481/11049 [04:56<1:48:12,  1.63it/s]
                                                     
{'loss': 0.4386, 'grad_norm': 0.6035498976707458, 'learning_rate': 4.352941176470588e-06, 'epoch': 0.13}

  4%|▍         | 481/11049 [04:56<1:48:12,  1.63it/s]
  4%|▍         | 482/11049 [04:56<1:48:14,  1.63it/s]
                                                     
{'loss': 0.4144, 'grad_norm': 0.7240180969238281, 'learning_rate': 4.3619909502262445e-06, 'epoch': 0.13}

  4%|▍         | 482/11049 [04:57<1:48:14,  1.63it/s]
  4%|▍         | 483/11049 [04:57<1:48:08,  1.63it/s]
                                                     
{'loss': 0.4012, 'grad_norm': 0.6463353633880615, 'learning_rate': 4.371040723981901e-06, 'epoch': 0.13}

  4%|▍         | 483/11049 [04:57<1:48:08,  1.63it/s]
  4%|▍         | 484/11049 [04:58<1:48:05,  1.63it/s]
                                                     
{'loss': 0.4199, 'grad_norm': 0.7667245268821716, 'learning_rate': 4.380090497737557e-06, 'epoch': 0.13}

  4%|▍         | 484/11049 [04:58<1:48:05,  1.63it/s]
  4%|▍         | 485/11049 [04:58<1:48:02,  1.63it/s]
                                                     
{'loss': 0.3765, 'grad_norm': 0.7257287502288818, 'learning_rate': 4.389140271493213e-06, 'epoch': 0.13}

  4%|▍         | 485/11049 [04:58<1:48:02,  1.63it/s]
  4%|▍         | 486/11049 [04:59<1:48:00,  1.63it/s]
                                                     
{'loss': 0.3586, 'grad_norm': 0.7714277505874634, 'learning_rate': 4.398190045248869e-06, 'epoch': 0.13}

  4%|▍         | 486/11049 [04:59<1:48:00,  1.63it/s]
  4%|▍         | 487/11049 [05:00<1:48:07,  1.63it/s]
                                                     
{'loss': 0.465, 'grad_norm': 0.7591763138771057, 'learning_rate': 4.407239819004525e-06, 'epoch': 0.13}

  4%|▍         | 487/11049 [05:00<1:48:07,  1.63it/s]
  4%|▍         | 488/11049 [05:00<1:48:05,  1.63it/s]
                                                     
{'loss': 0.3911, 'grad_norm': 0.6369550228118896, 'learning_rate': 4.4162895927601815e-06, 'epoch': 0.13}

  4%|▍         | 488/11049 [05:00<1:48:05,  1.63it/s]
  4%|▍         | 489/11049 [05:01<1:48:01,  1.63it/s]
                                                     
{'loss': 0.404, 'grad_norm': 0.6465025544166565, 'learning_rate': 4.425339366515838e-06, 'epoch': 0.13}

  4%|▍         | 489/11049 [05:01<1:48:01,  1.63it/s]
  4%|▍         | 490/11049 [05:01<1:48:00,  1.63it/s]
                                                     
{'loss': 0.5361, 'grad_norm': 0.8451747894287109, 'learning_rate': 4.434389140271493e-06, 'epoch': 0.13}

  4%|▍         | 490/11049 [05:01<1:48:00,  1.63it/s]
  4%|▍         | 491/11049 [05:02<1:47:58,  1.63it/s]
                                                     
{'loss': 0.4152, 'grad_norm': 0.6216044425964355, 'learning_rate': 4.443438914027149e-06, 'epoch': 0.13}

  4%|▍         | 491/11049 [05:02<1:47:58,  1.63it/s]
  4%|▍         | 492/11049 [05:03<1:48:05,  1.63it/s]
                                                     
{'loss': 0.4327, 'grad_norm': 0.6816044449806213, 'learning_rate': 4.452488687782805e-06, 'epoch': 0.13}

  4%|▍         | 492/11049 [05:03<1:48:05,  1.63it/s]
  4%|▍         | 493/11049 [05:03<1:48:03,  1.63it/s]
                                                     
{'loss': 0.3904, 'grad_norm': 0.633094847202301, 'learning_rate': 4.461538461538462e-06, 'epoch': 0.13}

  4%|▍         | 493/11049 [05:03<1:48:03,  1.63it/s]
  4%|▍         | 494/11049 [05:04<1:47:59,  1.63it/s]
                                                     
{'loss': 0.3509, 'grad_norm': 0.6995134353637695, 'learning_rate': 4.4705882352941184e-06, 'epoch': 0.13}

  4%|▍         | 494/11049 [05:04<1:47:59,  1.63it/s]
  4%|▍         | 495/11049 [05:04<1:48:07,  1.63it/s]
                                                     
{'loss': 0.4433, 'grad_norm': 0.7683199048042297, 'learning_rate': 4.479638009049775e-06, 'epoch': 0.13}

  4%|▍         | 495/11049 [05:05<1:48:07,  1.63it/s]
  4%|▍         | 496/11049 [05:05<1:47:58,  1.63it/s]
                                                     
{'loss': 0.3441, 'grad_norm': 0.6425478458404541, 'learning_rate': 4.488687782805431e-06, 'epoch': 0.13}

  4%|▍         | 496/11049 [05:05<1:47:58,  1.63it/s]
  4%|▍         | 497/11049 [05:06<1:48:03,  1.63it/s]
                                                     
{'loss': 0.4611, 'grad_norm': 0.6520597338676453, 'learning_rate': 4.497737556561086e-06, 'epoch': 0.13}

  4%|▍         | 497/11049 [05:06<1:48:03,  1.63it/s]
  5%|▍         | 498/11049 [05:06<1:47:56,  1.63it/s]
                                                     
{'loss': 0.3365, 'grad_norm': 0.599732518196106, 'learning_rate': 4.506787330316742e-06, 'epoch': 0.14}

  5%|▍         | 498/11049 [05:06<1:47:56,  1.63it/s]
  5%|▍         | 499/11049 [05:07<1:47:56,  1.63it/s]
                                                     
{'loss': 0.3999, 'grad_norm': 0.6891661286354065, 'learning_rate': 4.515837104072398e-06, 'epoch': 0.14}

  5%|▍         | 499/11049 [05:07<1:47:56,  1.63it/s]
  5%|▍         | 500/11049 [05:07<1:47:55,  1.63it/s]
                                                     
{'loss': 0.4712, 'grad_norm': 0.6954378485679626, 'learning_rate': 4.5248868778280546e-06, 'epoch': 0.14}

  5%|▍         | 500/11049 [05:08<1:47:55,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.34it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                     

                                               
{'eval_loss': 0.8296516537666321, 'eval_runtime': 1.9537, 'eval_samples_per_second': 102.371, 'eval_steps_per_second': 6.654, 'epoch': 0.14}

  5%|▍         | 500/11049 [05:10<1:47:55,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
  5%|▍         | 501/11049 [05:10<3:31:16,  1.20s/it]
                                                     
{'loss': 0.4337, 'grad_norm': 0.7907257080078125, 'learning_rate': 4.533936651583711e-06, 'epoch': 0.14}

  5%|▍         | 501/11049 [05:10<3:31:16,  1.20s/it]
  5%|▍         | 502/11049 [05:11<3:00:12,  1.03s/it]
                                                     
{'loss': 0.3563, 'grad_norm': 0.5762811899185181, 'learning_rate': 4.542986425339367e-06, 'epoch': 0.14}

  5%|▍         | 502/11049 [05:11<3:00:12,  1.03s/it]
  5%|▍         | 503/11049 [05:11<2:38:32,  1.11it/s]
                                                     
{'loss': 0.3989, 'grad_norm': 0.7503023147583008, 'learning_rate': 4.552036199095023e-06, 'epoch': 0.14}

  5%|▍         | 503/11049 [05:11<2:38:32,  1.11it/s]
  5%|▍         | 504/11049 [05:12<2:23:17,  1.23it/s]
                                                     
{'loss': 0.4465, 'grad_norm': 0.7433663606643677, 'learning_rate': 4.561085972850679e-06, 'epoch': 0.14}

  5%|▍         | 504/11049 [05:12<2:23:17,  1.23it/s]
  5%|▍         | 505/11049 [05:13<2:12:39,  1.32it/s]
                                                     
{'loss': 0.364, 'grad_norm': 0.6433505415916443, 'learning_rate': 4.570135746606335e-06, 'epoch': 0.14}

  5%|▍         | 505/11049 [05:13<2:12:39,  1.32it/s]
  5%|▍         | 506/11049 [05:13<2:05:12,  1.40it/s]
                                                     
{'loss': 0.4415, 'grad_norm': 0.7073898911476135, 'learning_rate': 4.5791855203619915e-06, 'epoch': 0.14}

  5%|▍         | 506/11049 [05:13<2:05:12,  1.40it/s]
  5%|▍         | 507/11049 [05:14<2:00:03,  1.46it/s]
                                                     
{'loss': 0.4036, 'grad_norm': 0.8087499141693115, 'learning_rate': 4.588235294117647e-06, 'epoch': 0.14}

  5%|▍         | 507/11049 [05:14<2:00:03,  1.46it/s]
  5%|▍         | 508/11049 [05:14<1:56:22,  1.51it/s]
                                                     
{'loss': 0.3546, 'grad_norm': 0.6584208607673645, 'learning_rate': 4.597285067873303e-06, 'epoch': 0.14}

  5%|▍         | 508/11049 [05:14<1:56:22,  1.51it/s]
  5%|▍         | 509/11049 [05:15<1:53:44,  1.54it/s]
                                                     
{'loss': 0.4772, 'grad_norm': 0.6907399892807007, 'learning_rate': 4.606334841628959e-06, 'epoch': 0.14}

  5%|▍         | 509/11049 [05:15<1:53:44,  1.54it/s]
  5%|▍         | 510/11049 [05:16<1:51:59,  1.57it/s]
                                                     
{'loss': 0.4358, 'grad_norm': 0.6907498836517334, 'learning_rate': 4.615384615384616e-06, 'epoch': 0.14}

  5%|▍         | 510/11049 [05:16<1:51:59,  1.57it/s]
  5%|▍         | 511/11049 [05:16<1:50:44,  1.59it/s]
                                                     
{'loss': 0.3932, 'grad_norm': 0.6365717649459839, 'learning_rate': 4.624434389140272e-06, 'epoch': 0.14}

  5%|▍         | 511/11049 [05:16<1:50:44,  1.59it/s]
  5%|▍         | 512/11049 [05:17<1:50:04,  1.60it/s]
                                                     
{'loss': 0.6068, 'grad_norm': 0.6936221122741699, 'learning_rate': 4.6334841628959285e-06, 'epoch': 0.14}

  5%|▍         | 512/11049 [05:17<1:50:04,  1.60it/s]
  5%|▍         | 513/11049 [05:17<1:49:18,  1.61it/s]
                                                     
{'loss': 0.4904, 'grad_norm': 0.7091673016548157, 'learning_rate': 4.642533936651585e-06, 'epoch': 0.14}

  5%|▍         | 513/11049 [05:18<1:49:18,  1.61it/s]
  5%|▍         | 514/11049 [05:18<1:48:49,  1.61it/s]
                                                     
{'loss': 0.5147, 'grad_norm': 0.7503306269645691, 'learning_rate': 4.65158371040724e-06, 'epoch': 0.14}

  5%|▍         | 514/11049 [05:18<1:48:49,  1.61it/s]
  5%|▍         | 515/11049 [05:19<1:48:27,  1.62it/s]
                                                     
{'loss': 0.5044, 'grad_norm': 0.7001110315322876, 'learning_rate': 4.660633484162896e-06, 'epoch': 0.14}

  5%|▍         | 515/11049 [05:19<1:48:27,  1.62it/s]
  5%|▍         | 516/11049 [05:19<1:48:12,  1.62it/s]
                                                     
{'loss': 0.3465, 'grad_norm': 0.7442470788955688, 'learning_rate': 4.669683257918552e-06, 'epoch': 0.14}

  5%|▍         | 516/11049 [05:19<1:48:12,  1.62it/s]
  5%|▍         | 517/11049 [05:20<1:48:07,  1.62it/s]
                                                     
{'loss': 0.514, 'grad_norm': 0.7118129134178162, 'learning_rate': 4.6787330316742084e-06, 'epoch': 0.14}

  5%|▍         | 517/11049 [05:20<1:48:07,  1.62it/s]
  5%|▍         | 518/11049 [05:21<1:47:57,  1.63it/s]
                                                     
{'loss': 0.4159, 'grad_norm': 0.7136288285255432, 'learning_rate': 4.687782805429865e-06, 'epoch': 0.14}

  5%|▍         | 518/11049 [05:21<1:47:57,  1.63it/s]
  5%|▍         | 519/11049 [05:21<1:47:50,  1.63it/s]
                                                     
{'loss': 0.4381, 'grad_norm': 0.738602340221405, 'learning_rate': 4.696832579185521e-06, 'epoch': 0.14}

  5%|▍         | 519/11049 [05:21<1:47:50,  1.63it/s]
  5%|▍         | 520/11049 [05:22<1:47:48,  1.63it/s]
                                                     
{'loss': 0.4339, 'grad_norm': 0.7193412184715271, 'learning_rate': 4.705882352941177e-06, 'epoch': 0.14}

  5%|▍         | 520/11049 [05:22<1:47:48,  1.63it/s]
  5%|▍         | 521/11049 [05:22<1:47:42,  1.63it/s]
                                                     
{'loss': 0.3616, 'grad_norm': 0.7017682790756226, 'learning_rate': 4.714932126696833e-06, 'epoch': 0.14}

  5%|▍         | 521/11049 [05:22<1:47:42,  1.63it/s]
  5%|▍         | 522/11049 [05:23<1:47:49,  1.63it/s]
                                                     
{'loss': 0.4875, 'grad_norm': 0.6919624209403992, 'learning_rate': 4.723981900452489e-06, 'epoch': 0.14}

  5%|▍         | 522/11049 [05:23<1:47:49,  1.63it/s]
  5%|▍         | 523/11049 [05:24<1:47:45,  1.63it/s]
                                                     
{'loss': 0.3691, 'grad_norm': 0.767010509967804, 'learning_rate': 4.733031674208145e-06, 'epoch': 0.14}

  5%|▍         | 523/11049 [05:24<1:47:45,  1.63it/s]
  5%|▍         | 524/11049 [05:24<1:47:42,  1.63it/s]
                                                     
{'loss': 0.489, 'grad_norm': 0.8529474139213562, 'learning_rate': 4.742081447963801e-06, 'epoch': 0.14}

  5%|▍         | 524/11049 [05:24<1:47:42,  1.63it/s]
  5%|▍         | 525/11049 [05:25<1:47:39,  1.63it/s]
                                                     
{'loss': 0.3827, 'grad_norm': 0.7356329560279846, 'learning_rate': 4.751131221719457e-06, 'epoch': 0.14}

  5%|▍         | 525/11049 [05:25<1:47:39,  1.63it/s]
  5%|▍         | 526/11049 [05:25<1:47:37,  1.63it/s]
                                                     
{'loss': 0.4522, 'grad_norm': 0.6954004764556885, 'learning_rate': 4.760180995475113e-06, 'epoch': 0.14}

  5%|▍         | 526/11049 [05:26<1:47:37,  1.63it/s]
  5%|▍         | 527/11049 [05:26<1:47:48,  1.63it/s]
                                                     
{'loss': 0.3371, 'grad_norm': 0.6753402352333069, 'learning_rate': 4.76923076923077e-06, 'epoch': 0.14}

  5%|▍         | 527/11049 [05:26<1:47:48,  1.63it/s]
  5%|▍         | 528/11049 [05:27<1:47:43,  1.63it/s]
                                                     
{'loss': 0.3957, 'grad_norm': 0.6707132458686829, 'learning_rate': 4.778280542986426e-06, 'epoch': 0.14}

  5%|▍         | 528/11049 [05:27<1:47:43,  1.63it/s]
  5%|▍         | 529/11049 [05:27<1:47:39,  1.63it/s]
                                                     
{'loss': 0.4678, 'grad_norm': 0.8126471638679504, 'learning_rate': 4.787330316742082e-06, 'epoch': 0.14}

  5%|▍         | 529/11049 [05:27<1:47:39,  1.63it/s]
  5%|▍         | 530/11049 [05:28<1:47:38,  1.63it/s]
                                                     
{'loss': 0.4743, 'grad_norm': 0.7502910494804382, 'learning_rate': 4.7963800904977385e-06, 'epoch': 0.14}

  5%|▍         | 530/11049 [05:28<1:47:38,  1.63it/s]
  5%|▍         | 531/11049 [05:28<1:47:36,  1.63it/s]
                                                     
{'loss': 0.4214, 'grad_norm': 0.6349620223045349, 'learning_rate': 4.805429864253394e-06, 'epoch': 0.14}

  5%|▍         | 531/11049 [05:29<1:47:36,  1.63it/s]
  5%|▍         | 532/11049 [05:29<1:47:48,  1.63it/s]
                                                     
{'loss': 0.4659, 'grad_norm': 0.7766925096511841, 'learning_rate': 4.81447963800905e-06, 'epoch': 0.14}

  5%|▍         | 532/11049 [05:29<1:47:48,  1.63it/s]
  5%|▍         | 533/11049 [05:30<1:47:43,  1.63it/s]
                                                     
{'loss': 0.3851, 'grad_norm': 0.7033711671829224, 'learning_rate': 4.823529411764706e-06, 'epoch': 0.14}

  5%|▍         | 533/11049 [05:30<1:47:43,  1.63it/s]
  5%|▍         | 534/11049 [05:30<1:47:37,  1.63it/s]
                                                     
{'loss': 0.4325, 'grad_norm': 0.68083655834198, 'learning_rate': 4.832579185520362e-06, 'epoch': 0.14}

  5%|▍         | 534/11049 [05:30<1:47:37,  1.63it/s]
  5%|▍         | 535/11049 [05:31<1:47:36,  1.63it/s]
                                                     
{'loss': 0.3694, 'grad_norm': 0.632479190826416, 'learning_rate': 4.8416289592760185e-06, 'epoch': 0.15}

  5%|▍         | 535/11049 [05:31<1:47:36,  1.63it/s]
  5%|▍         | 536/11049 [05:32<1:47:32,  1.63it/s]
                                                     
{'loss': 0.4531, 'grad_norm': 0.7159519195556641, 'learning_rate': 4.850678733031675e-06, 'epoch': 0.15}

  5%|▍         | 536/11049 [05:32<1:47:32,  1.63it/s]
  5%|▍         | 537/11049 [05:32<1:47:35,  1.63it/s]
                                                     
{'loss': 0.4079, 'grad_norm': 0.7972321510314941, 'learning_rate': 4.859728506787331e-06, 'epoch': 0.15}

  5%|▍         | 537/11049 [05:32<1:47:35,  1.63it/s]
  5%|▍         | 538/11049 [05:33<1:47:31,  1.63it/s]
                                                     
{'loss': 0.4172, 'grad_norm': 0.6388364434242249, 'learning_rate': 4.868778280542987e-06, 'epoch': 0.15}

  5%|▍         | 538/11049 [05:33<1:47:31,  1.63it/s]
  5%|▍         | 539/11049 [05:33<1:47:31,  1.63it/s]
                                                     
{'loss': 0.4084, 'grad_norm': 0.6720996499061584, 'learning_rate': 4.877828054298643e-06, 'epoch': 0.15}

  5%|▍         | 539/11049 [05:34<1:47:31,  1.63it/s]
  5%|▍         | 540/11049 [05:34<1:47:27,  1.63it/s]
                                                     
{'loss': 0.3984, 'grad_norm': 0.6934126615524292, 'learning_rate': 4.886877828054299e-06, 'epoch': 0.15}

  5%|▍         | 540/11049 [05:34<1:47:27,  1.63it/s]
  5%|▍         | 541/11049 [05:35<1:47:27,  1.63it/s]
                                                     
{'loss': 0.3855, 'grad_norm': 0.6346809267997742, 'learning_rate': 4.8959276018099546e-06, 'epoch': 0.15}

  5%|▍         | 541/11049 [05:35<1:47:27,  1.63it/s]
  5%|▍         | 542/11049 [05:35<1:47:33,  1.63it/s]
                                                     
{'loss': 0.4068, 'grad_norm': 0.6996573209762573, 'learning_rate': 4.904977375565611e-06, 'epoch': 0.15}

  5%|▍         | 542/11049 [05:35<1:47:33,  1.63it/s]
  5%|▍         | 543/11049 [05:36<1:47:26,  1.63it/s]
                                                     
{'loss': 0.4686, 'grad_norm': 0.6664851903915405, 'learning_rate': 4.914027149321267e-06, 'epoch': 0.15}

  5%|▍         | 543/11049 [05:36<1:47:26,  1.63it/s]
  5%|▍         | 544/11049 [05:36<1:47:23,  1.63it/s]
                                                     
{'loss': 0.4585, 'grad_norm': 0.8242189288139343, 'learning_rate': 4.923076923076924e-06, 'epoch': 0.15}

  5%|▍         | 544/11049 [05:37<1:47:23,  1.63it/s]
  5%|▍         | 545/11049 [05:37<1:47:23,  1.63it/s]
                                                     
{'loss': 0.4425, 'grad_norm': 0.7093883752822876, 'learning_rate': 4.93212669683258e-06, 'epoch': 0.15}

  5%|▍         | 545/11049 [05:37<1:47:23,  1.63it/s]
  5%|▍         | 546/11049 [05:38<1:47:23,  1.63it/s]
                                                     
{'loss': 0.4345, 'grad_norm': 0.7255208492279053, 'learning_rate': 4.941176470588236e-06, 'epoch': 0.15}

  5%|▍         | 546/11049 [05:38<1:47:23,  1.63it/s]
  5%|▍         | 547/11049 [05:38<1:47:55,  1.62it/s]
                                                     
{'loss': 0.4091, 'grad_norm': 0.6682544350624084, 'learning_rate': 4.950226244343892e-06, 'epoch': 0.15}

  5%|▍         | 547/11049 [05:38<1:47:55,  1.62it/s]
  5%|▍         | 548/11049 [05:39<1:47:46,  1.62it/s]
                                                     
{'loss': 0.5522, 'grad_norm': 0.7676634788513184, 'learning_rate': 4.959276018099548e-06, 'epoch': 0.15}

  5%|▍         | 548/11049 [05:39<1:47:46,  1.62it/s]
  5%|▍         | 549/11049 [05:40<1:47:39,  1.63it/s]
                                                     
{'loss': 0.3999, 'grad_norm': 0.6486372351646423, 'learning_rate': 4.968325791855204e-06, 'epoch': 0.15}

  5%|▍         | 549/11049 [05:40<1:47:39,  1.63it/s]
  5%|▍         | 550/11049 [05:40<1:47:34,  1.63it/s]
                                                     
{'loss': 0.3841, 'grad_norm': 0.6419934034347534, 'learning_rate': 4.97737556561086e-06, 'epoch': 0.15}

  5%|▍         | 550/11049 [05:40<1:47:34,  1.63it/s]
  5%|▍         | 551/11049 [05:41<1:47:26,  1.63it/s]
                                                     
{'loss': 0.4078, 'grad_norm': 0.7946075797080994, 'learning_rate': 4.986425339366516e-06, 'epoch': 0.15}

  5%|▍         | 551/11049 [05:41<1:47:26,  1.63it/s]
  5%|▍         | 552/11049 [05:41<1:47:32,  1.63it/s]
                                                     
{'loss': 0.3844, 'grad_norm': 0.700126588344574, 'learning_rate': 4.995475113122172e-06, 'epoch': 0.15}

  5%|▍         | 552/11049 [05:42<1:47:32,  1.63it/s]
  5%|▌         | 553/11049 [05:42<1:47:32,  1.63it/s]
                                                     
{'loss': 0.375, 'grad_norm': 0.7306500673294067, 'learning_rate': 5.0045248868778285e-06, 'epoch': 0.15}

  5%|▌         | 553/11049 [05:42<1:47:32,  1.63it/s]
  5%|▌         | 554/11049 [05:43<1:47:27,  1.63it/s]
                                                     
{'loss': 0.4438, 'grad_norm': 0.6572211384773254, 'learning_rate': 5.013574660633485e-06, 'epoch': 0.15}

  5%|▌         | 554/11049 [05:43<1:47:27,  1.63it/s]
  5%|▌         | 555/11049 [05:43<1:47:23,  1.63it/s]
                                                     
{'loss': 0.4046, 'grad_norm': 0.5918910503387451, 'learning_rate': 5.022624434389141e-06, 'epoch': 0.15}

  5%|▌         | 555/11049 [05:43<1:47:23,  1.63it/s]
  5%|▌         | 556/11049 [05:44<1:47:21,  1.63it/s]
                                                     
{'loss': 0.475, 'grad_norm': 0.6280173659324646, 'learning_rate': 5.031674208144797e-06, 'epoch': 0.15}

  5%|▌         | 556/11049 [05:44<1:47:21,  1.63it/s]
  5%|▌         | 557/11049 [05:44<1:47:18,  1.63it/s]
                                                     
{'loss': 0.3689, 'grad_norm': 0.5887503027915955, 'learning_rate': 5.040723981900453e-06, 'epoch': 0.15}

  5%|▌         | 557/11049 [05:45<1:47:18,  1.63it/s]
  5%|▌         | 558/11049 [05:45<1:47:25,  1.63it/s]
                                                     
{'loss': 0.471, 'grad_norm': 0.7099791169166565, 'learning_rate': 5.0497737556561084e-06, 'epoch': 0.15}

  5%|▌         | 558/11049 [05:45<1:47:25,  1.63it/s]
  5%|▌         | 559/11049 [05:46<1:47:21,  1.63it/s]
                                                     
{'loss': 0.4894, 'grad_norm': 0.7865204811096191, 'learning_rate': 5.058823529411765e-06, 'epoch': 0.15}

  5%|▌         | 559/11049 [05:46<1:47:21,  1.63it/s]
  5%|▌         | 560/11049 [05:46<1:47:17,  1.63it/s]
                                                     
{'loss': 0.4495, 'grad_norm': 0.7612689733505249, 'learning_rate': 5.067873303167421e-06, 'epoch': 0.15}

  5%|▌         | 560/11049 [05:46<1:47:17,  1.63it/s]
  5%|▌         | 561/11049 [05:47<1:47:17,  1.63it/s]
                                                     
{'loss': 0.3941, 'grad_norm': 0.6215258836746216, 'learning_rate': 5.076923076923077e-06, 'epoch': 0.15}

  5%|▌         | 561/11049 [05:47<1:47:17,  1.63it/s]
  5%|▌         | 562/11049 [05:48<1:47:16,  1.63it/s]
                                                     
{'loss': 0.4348, 'grad_norm': 0.6531107425689697, 'learning_rate': 5.085972850678733e-06, 'epoch': 0.15}

  5%|▌         | 562/11049 [05:48<1:47:16,  1.63it/s]
  5%|▌         | 563/11049 [05:48<1:47:16,  1.63it/s]
                                                     
{'loss': 0.4284, 'grad_norm': 0.6003748178482056, 'learning_rate': 5.095022624434389e-06, 'epoch': 0.15}

  5%|▌         | 563/11049 [05:48<1:47:16,  1.63it/s]
  5%|▌         | 564/11049 [05:49<1:47:14,  1.63it/s]
                                                     
{'loss': 0.3825, 'grad_norm': 0.6591053009033203, 'learning_rate': 5.104072398190045e-06, 'epoch': 0.15}

  5%|▌         | 564/11049 [05:49<1:47:14,  1.63it/s]
  5%|▌         | 565/11049 [05:49<1:47:16,  1.63it/s]
                                                     
{'loss': 0.3953, 'grad_norm': 0.6091214418411255, 'learning_rate': 5.1131221719457016e-06, 'epoch': 0.15}

  5%|▌         | 565/11049 [05:49<1:47:16,  1.63it/s]
  5%|▌         | 566/11049 [05:50<1:47:12,  1.63it/s]
                                                     
{'loss': 0.3584, 'grad_norm': 0.6622373461723328, 'learning_rate': 5.122171945701358e-06, 'epoch': 0.15}

  5%|▌         | 566/11049 [05:50<1:47:12,  1.63it/s]
  5%|▌         | 567/11049 [05:51<1:47:13,  1.63it/s]
                                                     
{'loss': 0.3928, 'grad_norm': 0.6444288492202759, 'learning_rate': 5.131221719457014e-06, 'epoch': 0.15}

  5%|▌         | 567/11049 [05:51<1:47:13,  1.63it/s]
  5%|▌         | 568/11049 [05:51<1:47:18,  1.63it/s]
                                                     
{'loss': 0.3175, 'grad_norm': 0.6502096652984619, 'learning_rate': 5.140271493212669e-06, 'epoch': 0.15}

  5%|▌         | 568/11049 [05:51<1:47:18,  1.63it/s]
  5%|▌         | 569/11049 [05:52<1:47:12,  1.63it/s]
                                                     
{'loss': 0.4688, 'grad_norm': 0.8774319887161255, 'learning_rate': 5.149321266968325e-06, 'epoch': 0.15}

  5%|▌         | 569/11049 [05:52<1:47:12,  1.63it/s]
  5%|▌         | 570/11049 [05:52<1:47:13,  1.63it/s]
                                                     
{'loss': 0.3687, 'grad_norm': 0.704561710357666, 'learning_rate': 5.158371040723983e-06, 'epoch': 0.15}

  5%|▌         | 570/11049 [05:53<1:47:13,  1.63it/s]
  5%|▌         | 571/11049 [05:53<1:47:08,  1.63it/s]
                                                     
{'loss': 0.3697, 'grad_norm': 0.6746878623962402, 'learning_rate': 5.167420814479639e-06, 'epoch': 0.16}

  5%|▌         | 571/11049 [05:53<1:47:08,  1.63it/s]
  5%|▌         | 572/11049 [05:54<1:47:07,  1.63it/s]
                                                     
{'loss': 0.3919, 'grad_norm': 0.7427464723587036, 'learning_rate': 5.176470588235295e-06, 'epoch': 0.16}

  5%|▌         | 572/11049 [05:54<1:47:07,  1.63it/s]
  5%|▌         | 573/11049 [05:54<1:47:12,  1.63it/s]
                                                     
{'loss': 0.4333, 'grad_norm': 0.6528164744377136, 'learning_rate': 5.185520361990951e-06, 'epoch': 0.16}

  5%|▌         | 573/11049 [05:54<1:47:12,  1.63it/s]
  5%|▌         | 574/11049 [05:55<1:47:07,  1.63it/s]
                                                     
{'loss': 0.5125, 'grad_norm': 0.6918955445289612, 'learning_rate': 5.194570135746607e-06, 'epoch': 0.16}

  5%|▌         | 574/11049 [05:55<1:47:07,  1.63it/s]
  5%|▌         | 575/11049 [05:56<1:47:03,  1.63it/s]
                                                     
{'loss': 0.3777, 'grad_norm': 0.6268325448036194, 'learning_rate': 5.203619909502263e-06, 'epoch': 0.16}

  5%|▌         | 575/11049 [05:56<1:47:03,  1.63it/s]
  5%|▌         | 576/11049 [05:56<1:47:05,  1.63it/s]
                                                     
{'loss': 0.3419, 'grad_norm': 0.6709346175193787, 'learning_rate': 5.212669683257919e-06, 'epoch': 0.16}

  5%|▌         | 576/11049 [05:56<1:47:05,  1.63it/s]
  5%|▌         | 577/11049 [05:57<1:47:04,  1.63it/s]
                                                     
{'loss': 0.3876, 'grad_norm': 0.7726145386695862, 'learning_rate': 5.2217194570135755e-06, 'epoch': 0.16}

  5%|▌         | 577/11049 [05:57<1:47:04,  1.63it/s]
  5%|▌         | 578/11049 [05:57<1:47:12,  1.63it/s]
                                                     
{'loss': 0.3533, 'grad_norm': 0.7035765051841736, 'learning_rate': 5.230769230769232e-06, 'epoch': 0.16}

  5%|▌         | 578/11049 [05:57<1:47:12,  1.63it/s]
  5%|▌         | 579/11049 [05:58<1:47:07,  1.63it/s]
                                                     
{'loss': 0.4285, 'grad_norm': 0.6244248747825623, 'learning_rate': 5.239819004524888e-06, 'epoch': 0.16}

  5%|▌         | 579/11049 [05:58<1:47:07,  1.63it/s]
  5%|▌         | 580/11049 [05:59<1:47:02,  1.63it/s]
                                                     
{'loss': 0.4764, 'grad_norm': 0.74222731590271, 'learning_rate': 5.248868778280544e-06, 'epoch': 0.16}

  5%|▌         | 580/11049 [05:59<1:47:02,  1.63it/s]
  5%|▌         | 581/11049 [05:59<1:47:01,  1.63it/s]
                                                     
{'loss': 0.3744, 'grad_norm': 0.6638467311859131, 'learning_rate': 5.2579185520362e-06, 'epoch': 0.16}

  5%|▌         | 581/11049 [05:59<1:47:01,  1.63it/s]
  5%|▌         | 582/11049 [06:00<1:47:00,  1.63it/s]
                                                     
{'loss': 0.3939, 'grad_norm': 0.7938324213027954, 'learning_rate': 5.2669683257918554e-06, 'epoch': 0.16}

  5%|▌         | 582/11049 [06:00<1:47:00,  1.63it/s]
  5%|▌         | 583/11049 [06:00<1:47:07,  1.63it/s]
                                                     
{'loss': 0.4055, 'grad_norm': 0.6673415899276733, 'learning_rate': 5.276018099547512e-06, 'epoch': 0.16}

  5%|▌         | 583/11049 [06:01<1:47:07,  1.63it/s]
  5%|▌         | 584/11049 [06:01<1:47:01,  1.63it/s]
                                                     
{'loss': 0.3741, 'grad_norm': 0.5873792171478271, 'learning_rate': 5.285067873303168e-06, 'epoch': 0.16}

  5%|▌         | 584/11049 [06:01<1:47:01,  1.63it/s]
  5%|▌         | 585/11049 [06:02<1:46:59,  1.63it/s]
                                                     
{'loss': 0.4515, 'grad_norm': 0.7510412335395813, 'learning_rate': 5.294117647058824e-06, 'epoch': 0.16}

  5%|▌         | 585/11049 [06:02<1:46:59,  1.63it/s]
  5%|▌         | 586/11049 [06:02<1:46:56,  1.63it/s]
                                                     
{'loss': 0.3772, 'grad_norm': 0.7399776577949524, 'learning_rate': 5.30316742081448e-06, 'epoch': 0.16}

  5%|▌         | 586/11049 [06:02<1:46:56,  1.63it/s]
  5%|▌         | 587/11049 [06:03<1:46:56,  1.63it/s]
                                                     
{'loss': 0.2999, 'grad_norm': 0.537864625453949, 'learning_rate': 5.312217194570136e-06, 'epoch': 0.16}

  5%|▌         | 587/11049 [06:03<1:46:56,  1.63it/s]
  5%|▌         | 588/11049 [06:03<1:47:04,  1.63it/s]
                                                     
{'loss': 0.4137, 'grad_norm': 0.7193777561187744, 'learning_rate': 5.321266968325792e-06, 'epoch': 0.16}

  5%|▌         | 588/11049 [06:04<1:47:04,  1.63it/s]
  5%|▌         | 589/11049 [06:04<1:47:03,  1.63it/s]
                                                     
{'loss': 0.3569, 'grad_norm': 0.6023125052452087, 'learning_rate': 5.3303167420814486e-06, 'epoch': 0.16}

  5%|▌         | 589/11049 [06:04<1:47:03,  1.63it/s]
  5%|▌         | 590/11049 [06:05<1:47:03,  1.63it/s]
                                                     
{'loss': 0.4156, 'grad_norm': 0.7141112089157104, 'learning_rate': 5.339366515837105e-06, 'epoch': 0.16}

  5%|▌         | 590/11049 [06:05<1:47:03,  1.63it/s]
  5%|▌         | 591/11049 [06:05<1:47:00,  1.63it/s]
                                                     
{'loss': 0.483, 'grad_norm': 0.7838273644447327, 'learning_rate': 5.348416289592761e-06, 'epoch': 0.16}

  5%|▌         | 591/11049 [06:05<1:47:00,  1.63it/s]
  5%|▌         | 592/11049 [06:06<1:46:57,  1.63it/s]
                                                     
{'loss': 0.4006, 'grad_norm': 0.7012024521827698, 'learning_rate': 5.357466063348416e-06, 'epoch': 0.16}

  5%|▌         | 592/11049 [06:06<1:46:57,  1.63it/s]
  5%|▌         | 593/11049 [06:07<1:47:00,  1.63it/s]
                                                     
{'loss': 0.3911, 'grad_norm': 0.7260808348655701, 'learning_rate': 5.366515837104072e-06, 'epoch': 0.16}

  5%|▌         | 593/11049 [06:07<1:47:00,  1.63it/s]
  5%|▌         | 594/11049 [06:07<1:46:58,  1.63it/s]
                                                     
{'loss': 0.3024, 'grad_norm': 0.5271974802017212, 'learning_rate': 5.3755656108597285e-06, 'epoch': 0.16}

  5%|▌         | 594/11049 [06:07<1:46:58,  1.63it/s]
  5%|▌         | 595/11049 [06:08<1:46:56,  1.63it/s]
                                                     
{'loss': 0.3783, 'grad_norm': 0.7825736999511719, 'learning_rate': 5.384615384615385e-06, 'epoch': 0.16}

  5%|▌         | 595/11049 [06:08<1:46:56,  1.63it/s]
  5%|▌         | 596/11049 [06:08<1:46:54,  1.63it/s]
                                                     
{'loss': 0.4575, 'grad_norm': 0.730421245098114, 'learning_rate': 5.393665158371041e-06, 'epoch': 0.16}

  5%|▌         | 596/11049 [06:09<1:46:54,  1.63it/s]
  5%|▌         | 597/11049 [06:09<1:46:52,  1.63it/s]
                                                     
{'loss': 0.535, 'grad_norm': 0.77004474401474, 'learning_rate': 5.402714932126697e-06, 'epoch': 0.16}

  5%|▌         | 597/11049 [06:09<1:46:52,  1.63it/s]
  5%|▌         | 598/11049 [06:10<1:46:56,  1.63it/s]
                                                     
{'loss': 0.3838, 'grad_norm': 0.6994116306304932, 'learning_rate': 5.411764705882353e-06, 'epoch': 0.16}

  5%|▌         | 598/11049 [06:10<1:46:56,  1.63it/s]
  5%|▌         | 599/11049 [06:10<1:46:56,  1.63it/s]
                                                     
{'loss': 0.4197, 'grad_norm': 0.7807598114013672, 'learning_rate': 5.420814479638009e-06, 'epoch': 0.16}

  5%|▌         | 599/11049 [06:10<1:46:56,  1.63it/s]
  5%|▌         | 600/11049 [06:11<1:46:53,  1.63it/s]
                                                     
{'loss': 0.4604, 'grad_norm': 0.6514766812324524, 'learning_rate': 5.4298642533936655e-06, 'epoch': 0.16}

  5%|▌         | 600/11049 [06:11<1:46:53,  1.63it/s]
  5%|▌         | 601/11049 [06:11<1:46:51,  1.63it/s]
                                                     
{'loss': 0.3828, 'grad_norm': 0.6825774312019348, 'learning_rate': 5.438914027149322e-06, 'epoch': 0.16}

  5%|▌         | 601/11049 [06:12<1:46:51,  1.63it/s]
  5%|▌         | 602/11049 [06:12<1:46:47,  1.63it/s]
                                                     
{'loss': 0.4198, 'grad_norm': 0.6358989477157593, 'learning_rate': 5.447963800904977e-06, 'epoch': 0.16}

  5%|▌         | 602/11049 [06:12<1:46:47,  1.63it/s]
  5%|▌         | 603/11049 [06:13<1:46:55,  1.63it/s]
                                                     
{'loss': 0.3702, 'grad_norm': 0.7446462512016296, 'learning_rate': 5.457013574660633e-06, 'epoch': 0.16}

  5%|▌         | 603/11049 [06:13<1:46:55,  1.63it/s]
  5%|▌         | 604/11049 [06:13<1:46:52,  1.63it/s]
                                                     
{'loss': 0.3637, 'grad_norm': 0.6561965346336365, 'learning_rate': 5.466063348416289e-06, 'epoch': 0.16}

  5%|▌         | 604/11049 [06:13<1:46:52,  1.63it/s]
  5%|▌         | 605/11049 [06:14<1:46:47,  1.63it/s]
                                                     
{'loss': 0.3644, 'grad_norm': 0.7019832134246826, 'learning_rate': 5.475113122171946e-06, 'epoch': 0.16}

  5%|▌         | 605/11049 [06:14<1:46:47,  1.63it/s]
  5%|▌         | 606/11049 [06:15<1:46:48,  1.63it/s]
                                                     
{'loss': 0.3517, 'grad_norm': 0.6108132004737854, 'learning_rate': 5.4841628959276024e-06, 'epoch': 0.16}

  5%|▌         | 606/11049 [06:15<1:46:48,  1.63it/s]
  5%|▌         | 607/11049 [06:15<1:46:45,  1.63it/s]
                                                     
{'loss': 0.3693, 'grad_norm': 0.6296431422233582, 'learning_rate': 5.493212669683259e-06, 'epoch': 0.16}

  5%|▌         | 607/11049 [06:15<1:46:45,  1.63it/s]
  6%|▌         | 608/11049 [06:16<1:46:54,  1.63it/s]
                                                     
{'loss': 0.4329, 'grad_norm': 0.6837649941444397, 'learning_rate': 5.502262443438915e-06, 'epoch': 0.17}

  6%|▌         | 608/11049 [06:16<1:46:54,  1.63it/s]
  6%|▌         | 609/11049 [06:16<1:46:51,  1.63it/s]
                                                     
{'loss': 0.3804, 'grad_norm': 0.6810299158096313, 'learning_rate': 5.511312217194571e-06, 'epoch': 0.17}

  6%|▌         | 609/11049 [06:17<1:46:51,  1.63it/s]
  6%|▌         | 610/11049 [06:17<1:46:46,  1.63it/s]
                                                     
{'loss': 0.4384, 'grad_norm': 0.6748002767562866, 'learning_rate': 5.520361990950227e-06, 'epoch': 0.17}

  6%|▌         | 610/11049 [06:17<1:46:46,  1.63it/s]
  6%|▌         | 611/11049 [06:18<1:46:42,  1.63it/s]
                                                     
{'loss': 0.4386, 'grad_norm': 0.830833911895752, 'learning_rate': 5.529411764705883e-06, 'epoch': 0.17}

  6%|▌         | 611/11049 [06:18<1:46:42,  1.63it/s]
  6%|▌         | 612/11049 [06:18<1:46:41,  1.63it/s]
                                                     
{'loss': 0.421, 'grad_norm': 0.7674447894096375, 'learning_rate': 5.538461538461539e-06, 'epoch': 0.17}

  6%|▌         | 612/11049 [06:18<1:46:41,  1.63it/s]
  6%|▌         | 613/11049 [06:19<1:46:44,  1.63it/s]
                                                     
{'loss': 0.4807, 'grad_norm': 0.7272747755050659, 'learning_rate': 5.5475113122171955e-06, 'epoch': 0.17}

  6%|▌         | 613/11049 [06:19<1:46:44,  1.63it/s]
  6%|▌         | 614/11049 [06:19<1:46:44,  1.63it/s]
                                                     
{'loss': 0.4628, 'grad_norm': 0.6886056065559387, 'learning_rate': 5.556561085972852e-06, 'epoch': 0.17}

  6%|▌         | 614/11049 [06:20<1:46:44,  1.63it/s]
  6%|▌         | 615/11049 [06:20<1:46:42,  1.63it/s]
                                                     
{'loss': 0.3827, 'grad_norm': 0.6542238593101501, 'learning_rate': 5.565610859728508e-06, 'epoch': 0.17}

  6%|▌         | 615/11049 [06:20<1:46:42,  1.63it/s]
  6%|▌         | 616/11049 [06:21<1:46:41,  1.63it/s]
                                                     
{'loss': 0.4842, 'grad_norm': 0.7672366499900818, 'learning_rate': 5.574660633484163e-06, 'epoch': 0.17}

  6%|▌         | 616/11049 [06:21<1:46:41,  1.63it/s]
  6%|▌         | 617/11049 [06:21<1:46:40,  1.63it/s]
                                                     
{'loss': 0.3235, 'grad_norm': 0.5757163166999817, 'learning_rate': 5.583710407239819e-06, 'epoch': 0.17}

  6%|▌         | 617/11049 [06:21<1:46:40,  1.63it/s]
  6%|▌         | 618/11049 [06:22<1:46:44,  1.63it/s]
                                                     
{'loss': 0.3582, 'grad_norm': 0.6517677903175354, 'learning_rate': 5.5927601809954755e-06, 'epoch': 0.17}

  6%|▌         | 618/11049 [06:22<1:46:44,  1.63it/s]
  6%|▌         | 619/11049 [06:23<1:46:41,  1.63it/s]
                                                     
{'loss': 0.3758, 'grad_norm': 0.6439102292060852, 'learning_rate': 5.601809954751132e-06, 'epoch': 0.17}

  6%|▌         | 619/11049 [06:23<1:46:41,  1.63it/s]
  6%|▌         | 620/11049 [06:23<1:46:38,  1.63it/s]
                                                     
{'loss': 0.3919, 'grad_norm': 0.6281623244285583, 'learning_rate': 5.610859728506788e-06, 'epoch': 0.17}

  6%|▌         | 620/11049 [06:23<1:46:38,  1.63it/s]
  6%|▌         | 621/11049 [06:24<1:46:35,  1.63it/s]
                                                     
{'loss': 0.3754, 'grad_norm': 0.6961594820022583, 'learning_rate': 5.619909502262444e-06, 'epoch': 0.17}

  6%|▌         | 621/11049 [06:24<1:46:35,  1.63it/s]
  6%|▌         | 622/11049 [06:24<1:46:35,  1.63it/s]
                                                     
{'loss': 0.319, 'grad_norm': 0.6201807260513306, 'learning_rate': 5.6289592760181e-06, 'epoch': 0.17}

  6%|▌         | 622/11049 [06:24<1:46:35,  1.63it/s]
  6%|▌         | 623/11049 [06:25<1:46:38,  1.63it/s]
                                                     
{'loss': 0.4139, 'grad_norm': 0.7393789291381836, 'learning_rate': 5.638009049773756e-06, 'epoch': 0.17}

  6%|▌         | 623/11049 [06:25<1:46:38,  1.63it/s]
  6%|▌         | 624/11049 [06:26<1:46:37,  1.63it/s]
                                                     
{'loss': 0.3772, 'grad_norm': 0.7411971688270569, 'learning_rate': 5.6470588235294125e-06, 'epoch': 0.17}

  6%|▌         | 624/11049 [06:26<1:46:37,  1.63it/s]
  6%|▌         | 625/11049 [06:26<1:46:35,  1.63it/s]
                                                     
{'loss': 0.421, 'grad_norm': 0.7620317935943604, 'learning_rate': 5.656108597285069e-06, 'epoch': 0.17}

  6%|▌         | 625/11049 [06:26<1:46:35,  1.63it/s]
  6%|▌         | 626/11049 [06:27<1:46:35,  1.63it/s]
                                                     
{'loss': 0.3909, 'grad_norm': 0.658745527267456, 'learning_rate': 5.665158371040724e-06, 'epoch': 0.17}

  6%|▌         | 626/11049 [06:27<1:46:35,  1.63it/s]
  6%|▌         | 627/11049 [06:27<1:46:32,  1.63it/s]
                                                     
{'loss': 0.3729, 'grad_norm': 0.6536843180656433, 'learning_rate': 5.67420814479638e-06, 'epoch': 0.17}

  6%|▌         | 627/11049 [06:28<1:46:32,  1.63it/s]
  6%|▌         | 628/11049 [06:28<1:46:37,  1.63it/s]
                                                     
{'loss': 0.3995, 'grad_norm': 0.7394686937332153, 'learning_rate': 5.683257918552036e-06, 'epoch': 0.17}

  6%|▌         | 628/11049 [06:28<1:46:37,  1.63it/s]
  6%|▌         | 629/11049 [06:29<1:46:36,  1.63it/s]
                                                     
{'loss': 0.413, 'grad_norm': 0.6281831860542297, 'learning_rate': 5.692307692307692e-06, 'epoch': 0.17}

  6%|▌         | 629/11049 [06:29<1:46:36,  1.63it/s]
  6%|▌         | 630/11049 [06:29<1:46:34,  1.63it/s]
                                                     
{'loss': 0.4766, 'grad_norm': 0.7450938820838928, 'learning_rate': 5.7013574660633486e-06, 'epoch': 0.17}

  6%|▌         | 630/11049 [06:29<1:46:34,  1.63it/s]
  6%|▌         | 631/11049 [06:30<1:46:30,  1.63it/s]
                                                     
{'loss': 0.3686, 'grad_norm': 0.7021564841270447, 'learning_rate': 5.710407239819005e-06, 'epoch': 0.17}

  6%|▌         | 631/11049 [06:30<1:46:30,  1.63it/s]
  6%|▌         | 632/11049 [06:30<1:46:30,  1.63it/s]
                                                     
{'loss': 0.4877, 'grad_norm': 0.754204273223877, 'learning_rate': 5.719457013574661e-06, 'epoch': 0.17}

  6%|▌         | 632/11049 [06:31<1:46:30,  1.63it/s]
  6%|▌         | 633/11049 [06:31<1:46:32,  1.63it/s]
                                                     
{'loss': 0.4488, 'grad_norm': 0.6574681401252747, 'learning_rate': 5.728506787330317e-06, 'epoch': 0.17}

  6%|▌         | 633/11049 [06:31<1:46:32,  1.63it/s]
  6%|▌         | 634/11049 [06:32<1:46:32,  1.63it/s]
                                                     
{'loss': 0.4731, 'grad_norm': 0.7568027973175049, 'learning_rate': 5.737556561085973e-06, 'epoch': 0.17}

  6%|▌         | 634/11049 [06:32<1:46:32,  1.63it/s]
  6%|▌         | 635/11049 [06:32<1:46:30,  1.63it/s]
                                                     
{'loss': 0.3234, 'grad_norm': 0.6997312903404236, 'learning_rate': 5.746606334841629e-06, 'epoch': 0.17}

  6%|▌         | 635/11049 [06:32<1:46:30,  1.63it/s]
  6%|▌         | 636/11049 [06:33<1:46:29,  1.63it/s]
                                                     
{'loss': 0.4446, 'grad_norm': 0.7265352010726929, 'learning_rate': 5.755656108597285e-06, 'epoch': 0.17}

  6%|▌         | 636/11049 [06:33<1:46:29,  1.63it/s]
  6%|▌         | 637/11049 [06:34<1:46:31,  1.63it/s]
                                                     
{'loss': 0.4413, 'grad_norm': 0.733635425567627, 'learning_rate': 5.764705882352941e-06, 'epoch': 0.17}

  6%|▌         | 637/11049 [06:34<1:46:31,  1.63it/s]
  6%|▌         | 638/11049 [06:34<1:46:39,  1.63it/s]
                                                     
{'loss': 0.3489, 'grad_norm': 0.6594910025596619, 'learning_rate': 5.773755656108597e-06, 'epoch': 0.17}

  6%|▌         | 638/11049 [06:34<1:46:39,  1.63it/s]
  6%|▌         | 639/11049 [06:35<1:46:35,  1.63it/s]
                                                     
{'loss': 0.3064, 'grad_norm': 0.6677846312522888, 'learning_rate': 5.782805429864254e-06, 'epoch': 0.17}

  6%|▌         | 639/11049 [06:35<1:46:35,  1.63it/s]
  6%|▌         | 640/11049 [06:35<1:46:32,  1.63it/s]
                                                     
{'loss': 0.4075, 'grad_norm': 0.6871740818023682, 'learning_rate': 5.79185520361991e-06, 'epoch': 0.17}

  6%|▌         | 640/11049 [06:36<1:46:32,  1.63it/s]
  6%|▌         | 641/11049 [06:36<1:46:27,  1.63it/s]
                                                     
{'loss': 0.4022, 'grad_norm': 0.6839454770088196, 'learning_rate': 5.800904977375566e-06, 'epoch': 0.17}

  6%|▌         | 641/11049 [06:36<1:46:27,  1.63it/s]
  6%|▌         | 642/11049 [06:37<1:46:22,  1.63it/s]
                                                     
{'loss': 0.4382, 'grad_norm': 0.6820501089096069, 'learning_rate': 5.8099547511312225e-06, 'epoch': 0.17}

  6%|▌         | 642/11049 [06:37<1:46:22,  1.63it/s]
  6%|▌         | 643/11049 [06:37<1:46:29,  1.63it/s]
                                                     
{'loss': 0.3639, 'grad_norm': 0.7222800850868225, 'learning_rate': 5.819004524886879e-06, 'epoch': 0.17}

  6%|▌         | 643/11049 [06:37<1:46:29,  1.63it/s]
  6%|▌         | 644/11049 [06:38<1:46:29,  1.63it/s]
                                                     
{'loss': 0.4134, 'grad_norm': 0.7712659239768982, 'learning_rate': 5.828054298642535e-06, 'epoch': 0.17}

  6%|▌         | 644/11049 [06:38<1:46:29,  1.63it/s]
  6%|▌         | 645/11049 [06:38<1:46:24,  1.63it/s]
                                                     
{'loss': 0.5268, 'grad_norm': 0.818182647228241, 'learning_rate': 5.837104072398191e-06, 'epoch': 0.18}

  6%|▌         | 645/11049 [06:39<1:46:24,  1.63it/s]
  6%|▌         | 646/11049 [06:39<1:46:22,  1.63it/s]
                                                     
{'loss': 0.3639, 'grad_norm': 0.6885508894920349, 'learning_rate': 5.846153846153847e-06, 'epoch': 0.18}

  6%|▌         | 646/11049 [06:39<1:46:22,  1.63it/s]
  6%|▌         | 647/11049 [06:40<1:46:18,  1.63it/s]
                                                     
{'loss': 0.3521, 'grad_norm': 0.6206400394439697, 'learning_rate': 5.855203619909503e-06, 'epoch': 0.18}

  6%|▌         | 647/11049 [06:40<1:46:18,  1.63it/s]
  6%|▌         | 648/11049 [06:40<1:46:22,  1.63it/s]
                                                     
{'loss': 0.363, 'grad_norm': 0.7612865567207336, 'learning_rate': 5.8642533936651594e-06, 'epoch': 0.18}

  6%|▌         | 648/11049 [06:40<1:46:22,  1.63it/s]
  6%|▌         | 649/11049 [06:41<1:46:19,  1.63it/s]
                                                     
{'loss': 0.5241, 'grad_norm': 0.717412531375885, 'learning_rate': 5.873303167420816e-06, 'epoch': 0.18}

  6%|▌         | 649/11049 [06:41<1:46:19,  1.63it/s]
  6%|▌         | 650/11049 [06:42<1:46:17,  1.63it/s]
                                                     
{'loss': 0.3833, 'grad_norm': 0.6302081346511841, 'learning_rate': 5.882352941176471e-06, 'epoch': 0.18}

  6%|▌         | 650/11049 [06:42<1:46:17,  1.63it/s]
  6%|▌         | 651/11049 [06:42<1:46:16,  1.63it/s]
                                                     
{'loss': 0.4111, 'grad_norm': 0.7387964129447937, 'learning_rate': 5.891402714932127e-06, 'epoch': 0.18}

  6%|▌         | 651/11049 [06:42<1:46:16,  1.63it/s]
  6%|▌         | 652/11049 [06:43<1:46:13,  1.63it/s]
                                                     
{'loss': 0.3482, 'grad_norm': 0.6489056348800659, 'learning_rate': 5.900452488687783e-06, 'epoch': 0.18}

  6%|▌         | 652/11049 [06:43<1:46:13,  1.63it/s]
  6%|▌         | 653/11049 [06:43<1:46:18,  1.63it/s]
                                                     
{'loss': 0.3822, 'grad_norm': 0.7855434417724609, 'learning_rate': 5.909502262443439e-06, 'epoch': 0.18}

  6%|▌         | 653/11049 [06:44<1:46:18,  1.63it/s]
  6%|▌         | 654/11049 [06:44<1:46:16,  1.63it/s]
                                                     
{'loss': 0.448, 'grad_norm': 0.7982355952262878, 'learning_rate': 5.9185520361990956e-06, 'epoch': 0.18}

  6%|▌         | 654/11049 [06:44<1:46:16,  1.63it/s]
  6%|▌         | 655/11049 [06:45<1:46:14,  1.63it/s]
                                                     
{'loss': 0.4105, 'grad_norm': 0.7539448142051697, 'learning_rate': 5.927601809954752e-06, 'epoch': 0.18}

  6%|▌         | 655/11049 [06:45<1:46:14,  1.63it/s]
  6%|▌         | 656/11049 [06:45<1:46:13,  1.63it/s]
                                                     
{'loss': 0.3521, 'grad_norm': 0.6759240031242371, 'learning_rate': 5.936651583710408e-06, 'epoch': 0.18}

  6%|▌         | 656/11049 [06:45<1:46:13,  1.63it/s]
  6%|▌         | 657/11049 [06:46<1:46:13,  1.63it/s]
                                                     
{'loss': 0.4709, 'grad_norm': 0.7429554462432861, 'learning_rate': 5.945701357466064e-06, 'epoch': 0.18}

  6%|▌         | 657/11049 [06:46<1:46:13,  1.63it/s]
  6%|▌         | 658/11049 [06:46<1:46:18,  1.63it/s]
                                                     
{'loss': 0.3538, 'grad_norm': 0.6024540066719055, 'learning_rate': 5.95475113122172e-06, 'epoch': 0.18}

  6%|▌         | 658/11049 [06:47<1:46:18,  1.63it/s]
  6%|▌         | 659/11049 [06:47<1:46:18,  1.63it/s]
                                                     
{'loss': 0.5748, 'grad_norm': 0.7720531821250916, 'learning_rate': 5.963800904977376e-06, 'epoch': 0.18}

  6%|▌         | 659/11049 [06:47<1:46:18,  1.63it/s]
  6%|▌         | 660/11049 [06:48<1:46:48,  1.62it/s]
                                                     
{'loss': 0.3454, 'grad_norm': 0.6113770008087158, 'learning_rate': 5.972850678733032e-06, 'epoch': 0.18}

  6%|▌         | 660/11049 [06:48<1:46:48,  1.62it/s]
  6%|▌         | 661/11049 [06:48<1:46:35,  1.62it/s]
                                                     
{'loss': 0.3943, 'grad_norm': 0.6328091621398926, 'learning_rate': 5.981900452488688e-06, 'epoch': 0.18}

  6%|▌         | 661/11049 [06:48<1:46:35,  1.62it/s]
  6%|▌         | 662/11049 [06:49<1:46:29,  1.63it/s]
                                                     
{'loss': 0.3612, 'grad_norm': 0.6458014845848083, 'learning_rate': 5.990950226244344e-06, 'epoch': 0.18}

  6%|▌         | 662/11049 [06:49<1:46:29,  1.63it/s]
  6%|▌         | 663/11049 [06:50<1:46:26,  1.63it/s]
                                                     
{'loss': 0.4049, 'grad_norm': 0.7938635349273682, 'learning_rate': 6e-06, 'epoch': 0.18}

  6%|▌         | 663/11049 [06:50<1:46:26,  1.63it/s]
  6%|▌         | 664/11049 [06:50<1:46:21,  1.63it/s]
                                                     
{'loss': 0.4191, 'grad_norm': 0.6207418441772461, 'learning_rate': 6.009049773755656e-06, 'epoch': 0.18}

  6%|▌         | 664/11049 [06:50<1:46:21,  1.63it/s]
  6%|▌         | 665/11049 [06:51<1:46:18,  1.63it/s]
                                                     
{'loss': 0.3678, 'grad_norm': 0.6289525032043457, 'learning_rate': 6.0180995475113125e-06, 'epoch': 0.18}

  6%|▌         | 665/11049 [06:51<1:46:18,  1.63it/s]
  6%|▌         | 666/11049 [06:51<1:46:16,  1.63it/s]
                                                     
{'loss': 0.4104, 'grad_norm': 0.6461897492408752, 'learning_rate': 6.027149321266969e-06, 'epoch': 0.18}

  6%|▌         | 666/11049 [06:51<1:46:16,  1.63it/s]
  6%|▌         | 667/11049 [06:52<1:46:09,  1.63it/s]
                                                     
{'loss': 0.3664, 'grad_norm': 0.6533366441726685, 'learning_rate': 6.036199095022625e-06, 'epoch': 0.18}

  6%|▌         | 667/11049 [06:52<1:46:09,  1.63it/s]
  6%|▌         | 668/11049 [06:53<1:46:16,  1.63it/s]
                                                     
{'loss': 0.4087, 'grad_norm': 0.6902408003807068, 'learning_rate': 6.045248868778281e-06, 'epoch': 0.18}

  6%|▌         | 668/11049 [06:53<1:46:16,  1.63it/s]
  6%|▌         | 669/11049 [06:53<1:46:10,  1.63it/s]
                                                     
{'loss': 0.3284, 'grad_norm': 0.6911761164665222, 'learning_rate': 6.054298642533937e-06, 'epoch': 0.18}

  6%|▌         | 669/11049 [06:53<1:46:10,  1.63it/s]
  6%|▌         | 670/11049 [06:54<1:46:07,  1.63it/s]
                                                     
{'loss': 0.4356, 'grad_norm': 0.7183007001876831, 'learning_rate': 6.0633484162895924e-06, 'epoch': 0.18}

  6%|▌         | 670/11049 [06:54<1:46:07,  1.63it/s]
  6%|▌         | 671/11049 [06:54<1:46:05,  1.63it/s]
                                                     
{'loss': 0.2831, 'grad_norm': 0.588736355304718, 'learning_rate': 6.072398190045249e-06, 'epoch': 0.18}

  6%|▌         | 671/11049 [06:55<1:46:05,  1.63it/s]
  6%|▌         | 672/11049 [06:55<1:46:05,  1.63it/s]
                                                     
{'loss': 0.4125, 'grad_norm': 0.7314308285713196, 'learning_rate': 6.081447963800905e-06, 'epoch': 0.18}

  6%|▌         | 672/11049 [06:55<1:46:05,  1.63it/s]
  6%|▌         | 673/11049 [06:56<1:46:10,  1.63it/s]
                                                     
{'loss': 0.3226, 'grad_norm': 0.6066823601722717, 'learning_rate': 6.090497737556561e-06, 'epoch': 0.18}

  6%|▌         | 673/11049 [06:56<1:46:10,  1.63it/s]
  6%|▌         | 674/11049 [06:56<1:46:07,  1.63it/s]
                                                     
{'loss': 0.4461, 'grad_norm': 0.6328669190406799, 'learning_rate': 6.099547511312218e-06, 'epoch': 0.18}

  6%|▌         | 674/11049 [06:56<1:46:07,  1.63it/s]
  6%|▌         | 675/11049 [06:57<1:46:07,  1.63it/s]
                                                     
{'loss': 0.3435, 'grad_norm': 0.8158767223358154, 'learning_rate': 6.108597285067874e-06, 'epoch': 0.18}

  6%|▌         | 675/11049 [06:57<1:46:07,  1.63it/s]
  6%|▌         | 676/11049 [06:57<1:46:06,  1.63it/s]
                                                     
{'loss': 0.439, 'grad_norm': 0.7176150679588318, 'learning_rate': 6.11764705882353e-06, 'epoch': 0.18}

  6%|▌         | 676/11049 [06:58<1:46:06,  1.63it/s]
  6%|▌         | 677/11049 [06:58<1:46:06,  1.63it/s]
                                                     
{'loss': 0.3785, 'grad_norm': 0.6564766764640808, 'learning_rate': 6.126696832579186e-06, 'epoch': 0.18}

  6%|▌         | 677/11049 [06:58<1:46:06,  1.63it/s]
  6%|▌         | 678/11049 [06:59<1:46:14,  1.63it/s]
                                                     
{'loss': 0.3579, 'grad_norm': 0.7651128768920898, 'learning_rate': 6.1357466063348426e-06, 'epoch': 0.18}

  6%|▌         | 678/11049 [06:59<1:46:14,  1.63it/s]
  6%|▌         | 679/11049 [06:59<1:46:09,  1.63it/s]
                                                     
{'loss': 0.391, 'grad_norm': 0.7391939759254456, 'learning_rate': 6.144796380090499e-06, 'epoch': 0.18}

  6%|▌         | 679/11049 [06:59<1:46:09,  1.63it/s]
  6%|▌         | 680/11049 [07:00<1:46:05,  1.63it/s]
                                                     
{'loss': 0.4225, 'grad_norm': 0.6398262977600098, 'learning_rate': 6.153846153846155e-06, 'epoch': 0.18}

  6%|▌         | 680/11049 [07:00<1:46:05,  1.63it/s]
  6%|▌         | 681/11049 [07:01<1:46:01,  1.63it/s]
                                                     
{'loss': 0.3676, 'grad_norm': 0.756641149520874, 'learning_rate': 6.162895927601811e-06, 'epoch': 0.18}

  6%|▌         | 681/11049 [07:01<1:46:01,  1.63it/s]
  6%|▌         | 682/11049 [07:01<1:46:05,  1.63it/s]
                                                     
{'loss': 0.3423, 'grad_norm': 0.7178434133529663, 'learning_rate': 6.171945701357467e-06, 'epoch': 0.19}

  6%|▌         | 682/11049 [07:01<1:46:05,  1.63it/s]
  6%|▌         | 683/11049 [07:02<1:46:09,  1.63it/s]
                                                     
{'loss': 0.4245, 'grad_norm': 0.7394434809684753, 'learning_rate': 6.1809954751131225e-06, 'epoch': 0.19}

  6%|▌         | 683/11049 [07:02<1:46:09,  1.63it/s]
  6%|▌         | 684/11049 [07:02<1:46:04,  1.63it/s]
                                                     
{'loss': 0.375, 'grad_norm': 0.6756404638290405, 'learning_rate': 6.190045248868779e-06, 'epoch': 0.19}

  6%|▌         | 684/11049 [07:03<1:46:04,  1.63it/s]
  6%|▌         | 685/11049 [07:03<1:46:00,  1.63it/s]
                                                     
{'loss': 0.3521, 'grad_norm': 0.6513130068778992, 'learning_rate': 6.199095022624435e-06, 'epoch': 0.19}

  6%|▌         | 685/11049 [07:03<1:46:00,  1.63it/s]
  6%|▌         | 686/11049 [07:04<1:45:55,  1.63it/s]
                                                     
{'loss': 0.3474, 'grad_norm': 0.5700684189796448, 'learning_rate': 6.208144796380091e-06, 'epoch': 0.19}

  6%|▌         | 686/11049 [07:04<1:45:55,  1.63it/s]
  6%|▌         | 687/11049 [07:04<1:45:55,  1.63it/s]
                                                     
{'loss': 0.5688, 'grad_norm': 0.7113377451896667, 'learning_rate': 6.217194570135747e-06, 'epoch': 0.19}

  6%|▌         | 687/11049 [07:04<1:45:55,  1.63it/s]
  6%|▌         | 688/11049 [07:05<1:45:59,  1.63it/s]
                                                     
{'loss': 0.3485, 'grad_norm': 0.631222665309906, 'learning_rate': 6.226244343891403e-06, 'epoch': 0.19}

  6%|▌         | 688/11049 [07:05<1:45:59,  1.63it/s]
  6%|▌         | 689/11049 [07:05<1:45:59,  1.63it/s]
                                                     
{'loss': 0.4994, 'grad_norm': 0.7295597791671753, 'learning_rate': 6.2352941176470595e-06, 'epoch': 0.19}

  6%|▌         | 689/11049 [07:06<1:45:59,  1.63it/s]
  6%|▌         | 690/11049 [07:06<1:45:58,  1.63it/s]
                                                     
{'loss': 0.3804, 'grad_norm': 0.5993178486824036, 'learning_rate': 6.244343891402716e-06, 'epoch': 0.19}

  6%|▌         | 690/11049 [07:06<1:45:58,  1.63it/s]
  6%|▋         | 691/11049 [07:07<1:45:56,  1.63it/s]
                                                     
{'loss': 0.4003, 'grad_norm': 0.6301611661911011, 'learning_rate': 6.253393665158372e-06, 'epoch': 0.19}

  6%|▋         | 691/11049 [07:07<1:45:56,  1.63it/s]
  6%|▋         | 692/11049 [07:07<1:45:57,  1.63it/s]
                                                     
{'loss': 0.3359, 'grad_norm': 0.6713477373123169, 'learning_rate': 6.262443438914028e-06, 'epoch': 0.19}

  6%|▋         | 692/11049 [07:07<1:45:57,  1.63it/s]
  6%|▋         | 693/11049 [07:08<1:46:06,  1.63it/s]
                                                     
{'loss': 0.3102, 'grad_norm': 0.5587674379348755, 'learning_rate': 6.271493212669684e-06, 'epoch': 0.19}

  6%|▋         | 693/11049 [07:08<1:46:06,  1.63it/s]
  6%|▋         | 694/11049 [07:09<1:46:00,  1.63it/s]
                                                     
{'loss': 0.4253, 'grad_norm': 0.7412341237068176, 'learning_rate': 6.280542986425339e-06, 'epoch': 0.19}

  6%|▋         | 694/11049 [07:09<1:46:00,  1.63it/s]
  6%|▋         | 695/11049 [07:09<1:45:58,  1.63it/s]
                                                     
{'loss': 0.3782, 'grad_norm': 0.7105637788772583, 'learning_rate': 6.2895927601809956e-06, 'epoch': 0.19}

  6%|▋         | 695/11049 [07:09<1:45:58,  1.63it/s]
  6%|▋         | 696/11049 [07:10<1:45:54,  1.63it/s]
                                                     
{'loss': 0.4794, 'grad_norm': 0.7931124567985535, 'learning_rate': 6.298642533936652e-06, 'epoch': 0.19}

  6%|▋         | 696/11049 [07:10<1:45:54,  1.63it/s]
  6%|▋         | 697/11049 [07:10<1:46:01,  1.63it/s]
                                                     
{'loss': 0.3429, 'grad_norm': 0.6496452689170837, 'learning_rate': 6.307692307692308e-06, 'epoch': 0.19}

  6%|▋         | 697/11049 [07:11<1:46:01,  1.63it/s]
  6%|▋         | 698/11049 [07:11<1:46:00,  1.63it/s]
                                                     
{'loss': 0.4975, 'grad_norm': 0.8407363295555115, 'learning_rate': 6.316742081447964e-06, 'epoch': 0.19}

  6%|▋         | 698/11049 [07:11<1:46:00,  1.63it/s]
  6%|▋         | 699/11049 [07:12<1:45:55,  1.63it/s]
                                                     
{'loss': 0.3803, 'grad_norm': 0.6315991282463074, 'learning_rate': 6.32579185520362e-06, 'epoch': 0.19}

  6%|▋         | 699/11049 [07:12<1:45:55,  1.63it/s]
  6%|▋         | 700/11049 [07:12<1:45:56,  1.63it/s]
                                                     
{'loss': 0.3252, 'grad_norm': 0.6581563949584961, 'learning_rate': 6.334841628959276e-06, 'epoch': 0.19}

  6%|▋         | 700/11049 [07:12<1:45:56,  1.63it/s]
  6%|▋         | 701/11049 [07:13<1:45:51,  1.63it/s]
                                                     
{'loss': 0.4482, 'grad_norm': 0.7910968661308289, 'learning_rate': 6.3438914027149325e-06, 'epoch': 0.19}

  6%|▋         | 701/11049 [07:13<1:45:51,  1.63it/s]
  6%|▋         | 702/11049 [07:13<1:45:58,  1.63it/s]
                                                     
{'loss': 0.5219, 'grad_norm': 0.7958207726478577, 'learning_rate': 6.352941176470589e-06, 'epoch': 0.19}

  6%|▋         | 702/11049 [07:14<1:45:58,  1.63it/s]
  6%|▋         | 703/11049 [07:14<1:46:00,  1.63it/s]
                                                     
{'loss': 0.4565, 'grad_norm': 0.8146462440490723, 'learning_rate': 6.361990950226245e-06, 'epoch': 0.19}

  6%|▋         | 703/11049 [07:14<1:46:00,  1.63it/s]
  6%|▋         | 704/11049 [07:15<1:45:55,  1.63it/s]
                                                     
{'loss': 0.4141, 'grad_norm': 0.690448522567749, 'learning_rate': 6.3710407239819e-06, 'epoch': 0.19}

  6%|▋         | 704/11049 [07:15<1:45:55,  1.63it/s]
  6%|▋         | 705/11049 [07:15<1:45:59,  1.63it/s]
                                                     
{'loss': 0.4299, 'grad_norm': 0.7722362279891968, 'learning_rate': 6.380090497737556e-06, 'epoch': 0.19}

  6%|▋         | 705/11049 [07:15<1:45:59,  1.63it/s]
  6%|▋         | 706/11049 [07:16<1:45:56,  1.63it/s]
                                                     
{'loss': 0.3243, 'grad_norm': 0.5962359309196472, 'learning_rate': 6.3891402714932125e-06, 'epoch': 0.19}

  6%|▋         | 706/11049 [07:16<1:45:56,  1.63it/s]
  6%|▋         | 707/11049 [07:17<1:45:58,  1.63it/s]
                                                     
{'loss': 0.4063, 'grad_norm': 0.6652329564094543, 'learning_rate': 6.398190045248869e-06, 'epoch': 0.19}

  6%|▋         | 707/11049 [07:17<1:45:58,  1.63it/s]
  6%|▋         | 708/11049 [07:17<1:45:59,  1.63it/s]
                                                     
{'loss': 0.4464, 'grad_norm': 0.7040114402770996, 'learning_rate': 6.407239819004526e-06, 'epoch': 0.19}

  6%|▋         | 708/11049 [07:17<1:45:59,  1.63it/s]
  6%|▋         | 709/11049 [07:18<1:45:54,  1.63it/s]
                                                     
{'loss': 0.3754, 'grad_norm': 0.721208393573761, 'learning_rate': 6.416289592760182e-06, 'epoch': 0.19}

  6%|▋         | 709/11049 [07:18<1:45:54,  1.63it/s]
  6%|▋         | 710/11049 [07:18<1:45:50,  1.63it/s]
                                                     
{'loss': 0.4146, 'grad_norm': 0.5794716477394104, 'learning_rate': 6.425339366515838e-06, 'epoch': 0.19}

  6%|▋         | 710/11049 [07:19<1:45:50,  1.63it/s]
  6%|▋         | 711/11049 [07:19<1:45:48,  1.63it/s]
                                                     
{'loss': 0.4171, 'grad_norm': 0.66767418384552, 'learning_rate': 6.434389140271494e-06, 'epoch': 0.19}

  6%|▋         | 711/11049 [07:19<1:45:48,  1.63it/s]
  6%|▋         | 712/11049 [07:20<1:45:51,  1.63it/s]
                                                     
{'loss': 0.5086, 'grad_norm': 0.7296386361122131, 'learning_rate': 6.44343891402715e-06, 'epoch': 0.19}

  6%|▋         | 712/11049 [07:20<1:45:51,  1.63it/s]
  6%|▋         | 713/11049 [07:20<1:45:50,  1.63it/s]
                                                     
{'loss': 0.4377, 'grad_norm': 0.8786347508430481, 'learning_rate': 6.4524886877828065e-06, 'epoch': 0.19}

  6%|▋         | 713/11049 [07:20<1:45:50,  1.63it/s]
  6%|▋         | 714/11049 [07:21<1:45:43,  1.63it/s]
                                                     
{'loss': 0.3901, 'grad_norm': 0.7172581553459167, 'learning_rate': 6.461538461538463e-06, 'epoch': 0.19}

  6%|▋         | 714/11049 [07:21<1:45:43,  1.63it/s]
  6%|▋         | 715/11049 [07:21<1:45:40,  1.63it/s]
                                                     
{'loss': 0.3693, 'grad_norm': 0.6447142362594604, 'learning_rate': 6.470588235294119e-06, 'epoch': 0.19}

  6%|▋         | 715/11049 [07:22<1:45:40,  1.63it/s]
  6%|▋         | 716/11049 [07:22<1:45:40,  1.63it/s]
                                                     
{'loss': 0.3394, 'grad_norm': 0.6398745775222778, 'learning_rate': 6.479638009049775e-06, 'epoch': 0.19}

  6%|▋         | 716/11049 [07:22<1:45:40,  1.63it/s]
  6%|▋         | 717/11049 [07:23<1:45:50,  1.63it/s]
                                                     
{'loss': 0.4655, 'grad_norm': 0.7471985220909119, 'learning_rate': 6.48868778280543e-06, 'epoch': 0.19}

  6%|▋         | 717/11049 [07:23<1:45:50,  1.63it/s]
  6%|▋         | 718/11049 [07:23<1:45:47,  1.63it/s]
                                                     
{'loss': 0.3572, 'grad_norm': 0.6779223084449768, 'learning_rate': 6.497737556561086e-06, 'epoch': 0.19}

  6%|▋         | 718/11049 [07:23<1:45:47,  1.63it/s]
  7%|▋         | 719/11049 [07:24<1:45:43,  1.63it/s]
                                                     
{'loss': 0.3958, 'grad_norm': 0.6841803789138794, 'learning_rate': 6.5067873303167426e-06, 'epoch': 0.2}

  7%|▋         | 719/11049 [07:24<1:45:43,  1.63it/s]
  7%|▋         | 720/11049 [07:25<1:45:40,  1.63it/s]
                                                     
{'loss': 0.4055, 'grad_norm': 0.6904163956642151, 'learning_rate': 6.515837104072399e-06, 'epoch': 0.2}

  7%|▋         | 720/11049 [07:25<1:45:40,  1.63it/s]
  7%|▋         | 721/11049 [07:25<1:45:39,  1.63it/s]
                                                     
{'loss': 0.4148, 'grad_norm': 0.7460340857505798, 'learning_rate': 6.524886877828055e-06, 'epoch': 0.2}

  7%|▋         | 721/11049 [07:25<1:45:39,  1.63it/s]
  7%|▋         | 722/11049 [07:26<1:45:50,  1.63it/s]
                                                     
{'loss': 0.3012, 'grad_norm': 0.5981729030609131, 'learning_rate': 6.533936651583711e-06, 'epoch': 0.2}

  7%|▋         | 722/11049 [07:26<1:45:50,  1.63it/s]
  7%|▋         | 723/11049 [07:26<1:45:53,  1.63it/s]
                                                     
{'loss': 0.3911, 'grad_norm': 0.7552799582481384, 'learning_rate': 6.542986425339367e-06, 'epoch': 0.2}

  7%|▋         | 723/11049 [07:26<1:45:53,  1.63it/s]
  7%|▋         | 724/11049 [07:27<1:45:47,  1.63it/s]
                                                     
{'loss': 0.464, 'grad_norm': 0.7098822593688965, 'learning_rate': 6.552036199095023e-06, 'epoch': 0.2}

  7%|▋         | 724/11049 [07:27<1:45:47,  1.63it/s]
  7%|▋         | 725/11049 [07:28<1:45:43,  1.63it/s]
                                                     
{'loss': 0.3939, 'grad_norm': 0.8037281632423401, 'learning_rate': 6.5610859728506795e-06, 'epoch': 0.2}

  7%|▋         | 725/11049 [07:28<1:45:43,  1.63it/s]
  7%|▋         | 726/11049 [07:28<1:45:39,  1.63it/s]
                                                     
{'loss': 0.3564, 'grad_norm': 0.7494347095489502, 'learning_rate': 6.570135746606336e-06, 'epoch': 0.2}

  7%|▋         | 726/11049 [07:28<1:45:39,  1.63it/s]
  7%|▋         | 727/11049 [07:29<1:45:48,  1.63it/s]
                                                     
{'loss': 0.4484, 'grad_norm': 0.6539506316184998, 'learning_rate': 6.579185520361992e-06, 'epoch': 0.2}

  7%|▋         | 727/11049 [07:29<1:45:48,  1.63it/s]
  7%|▋         | 728/11049 [07:29<1:45:42,  1.63it/s]
                                                     
{'loss': 0.3666, 'grad_norm': 0.6445801854133606, 'learning_rate': 6.588235294117647e-06, 'epoch': 0.2}

  7%|▋         | 728/11049 [07:30<1:45:42,  1.63it/s]
  7%|▋         | 729/11049 [07:30<1:45:40,  1.63it/s]
                                                     
{'loss': 0.292, 'grad_norm': 0.6581112742424011, 'learning_rate': 6.597285067873303e-06, 'epoch': 0.2}

  7%|▋         | 729/11049 [07:30<1:45:40,  1.63it/s]
  7%|▋         | 730/11049 [07:31<1:45:34,  1.63it/s]
                                                     
{'loss': 0.2657, 'grad_norm': 0.6347885131835938, 'learning_rate': 6.6063348416289595e-06, 'epoch': 0.2}

  7%|▋         | 730/11049 [07:31<1:45:34,  1.63it/s]
  7%|▋         | 731/11049 [07:31<1:45:33,  1.63it/s]
                                                     
{'loss': 0.3334, 'grad_norm': 0.6633484363555908, 'learning_rate': 6.615384615384616e-06, 'epoch': 0.2}

  7%|▋         | 731/11049 [07:31<1:45:33,  1.63it/s]
  7%|▋         | 732/11049 [07:32<1:45:30,  1.63it/s]
                                                     
{'loss': 0.3211, 'grad_norm': 0.6386780142784119, 'learning_rate': 6.624434389140272e-06, 'epoch': 0.2}

  7%|▋         | 732/11049 [07:32<1:45:30,  1.63it/s]
  7%|▋         | 733/11049 [07:33<1:45:28,  1.63it/s]
                                                     
{'loss': 0.3449, 'grad_norm': 0.7156688570976257, 'learning_rate': 6.633484162895928e-06, 'epoch': 0.2}

  7%|▋         | 733/11049 [07:33<1:45:28,  1.63it/s]
  7%|▋         | 734/11049 [07:33<1:45:27,  1.63it/s]
                                                     
{'loss': 0.264, 'grad_norm': 0.5821859240531921, 'learning_rate': 6.642533936651584e-06, 'epoch': 0.2}

  7%|▋         | 734/11049 [07:33<1:45:27,  1.63it/s]
  7%|▋         | 735/11049 [07:34<1:45:26,  1.63it/s]
                                                     
{'loss': 0.3461, 'grad_norm': 0.7206791639328003, 'learning_rate': 6.65158371040724e-06, 'epoch': 0.2}

  7%|▋         | 735/11049 [07:34<1:45:26,  1.63it/s]
  7%|▋         | 736/11049 [07:34<1:45:28,  1.63it/s]
                                                     
{'loss': 0.4198, 'grad_norm': 0.6663486361503601, 'learning_rate': 6.6606334841628964e-06, 'epoch': 0.2}

  7%|▋         | 736/11049 [07:34<1:45:28,  1.63it/s]
  7%|▋         | 737/11049 [07:35<1:45:25,  1.63it/s]
                                                     
{'loss': 0.4351, 'grad_norm': 0.7087528705596924, 'learning_rate': 6.669683257918553e-06, 'epoch': 0.2}

  7%|▋         | 737/11049 [07:35<1:45:25,  1.63it/s]
  7%|▋         | 738/11049 [07:36<1:45:24,  1.63it/s]
                                                     
{'loss': 0.3572, 'grad_norm': 0.6299538016319275, 'learning_rate': 6.678733031674208e-06, 'epoch': 0.2}

  7%|▋         | 738/11049 [07:36<1:45:24,  1.63it/s]
  7%|▋         | 739/11049 [07:36<1:45:23,  1.63it/s]
                                                     
{'loss': 0.3659, 'grad_norm': 0.6915119290351868, 'learning_rate': 6.687782805429864e-06, 'epoch': 0.2}

  7%|▋         | 739/11049 [07:36<1:45:23,  1.63it/s]
  7%|▋         | 740/11049 [07:37<1:45:23,  1.63it/s]
                                                     
{'loss': 0.4091, 'grad_norm': 0.749714732170105, 'learning_rate': 6.69683257918552e-06, 'epoch': 0.2}

  7%|▋         | 740/11049 [07:37<1:45:23,  1.63it/s]
  7%|▋         | 741/11049 [07:37<1:45:21,  1.63it/s]
                                                     
{'loss': 0.3951, 'grad_norm': 0.6860628128051758, 'learning_rate': 6.705882352941176e-06, 'epoch': 0.2}

  7%|▋         | 741/11049 [07:38<1:45:21,  1.63it/s]
  7%|▋         | 742/11049 [07:38<1:45:21,  1.63it/s]
                                                     
{'loss': 0.3732, 'grad_norm': 0.6534168720245361, 'learning_rate': 6.7149321266968326e-06, 'epoch': 0.2}

  7%|▋         | 742/11049 [07:38<1:45:21,  1.63it/s]
  7%|▋         | 743/11049 [07:39<1:45:25,  1.63it/s]
                                                     
{'loss': 0.4102, 'grad_norm': 0.7985302805900574, 'learning_rate': 6.7239819004524896e-06, 'epoch': 0.2}

  7%|▋         | 743/11049 [07:39<1:45:25,  1.63it/s]
  7%|▋         | 744/11049 [07:39<1:45:25,  1.63it/s]
                                                     
{'loss': 0.3438, 'grad_norm': 0.7349813580513, 'learning_rate': 6.733031674208146e-06, 'epoch': 0.2}

  7%|▋         | 744/11049 [07:39<1:45:25,  1.63it/s]
  7%|▋         | 745/11049 [07:40<1:45:25,  1.63it/s]
                                                     
{'loss': 0.3367, 'grad_norm': 0.7190889120101929, 'learning_rate': 6.742081447963802e-06, 'epoch': 0.2}

  7%|▋         | 745/11049 [07:40<1:45:25,  1.63it/s]
  7%|▋         | 746/11049 [07:40<1:45:22,  1.63it/s]
                                                     
{'loss': 0.3413, 'grad_norm': 0.7278811931610107, 'learning_rate': 6.751131221719458e-06, 'epoch': 0.2}

  7%|▋         | 746/11049 [07:41<1:45:22,  1.63it/s]
  7%|▋         | 747/11049 [07:41<1:45:18,  1.63it/s]
                                                     
{'loss': 0.4714, 'grad_norm': 0.6946294903755188, 'learning_rate': 6.760180995475114e-06, 'epoch': 0.2}

  7%|▋         | 747/11049 [07:41<1:45:18,  1.63it/s]
  7%|▋         | 748/11049 [07:42<1:45:18,  1.63it/s]
                                                     
{'loss': 0.3356, 'grad_norm': 0.6786924004554749, 'learning_rate': 6.76923076923077e-06, 'epoch': 0.2}

  7%|▋         | 748/11049 [07:42<1:45:18,  1.63it/s]
  7%|▋         | 749/11049 [07:42<1:45:16,  1.63it/s]
                                                     
{'loss': 0.3514, 'grad_norm': 0.6753982901573181, 'learning_rate': 6.7782805429864265e-06, 'epoch': 0.2}

  7%|▋         | 749/11049 [07:42<1:45:16,  1.63it/s]
  7%|▋         | 750/11049 [07:43<1:45:19,  1.63it/s]
                                                     
{'loss': 0.3369, 'grad_norm': 0.5946304202079773, 'learning_rate': 6.787330316742083e-06, 'epoch': 0.2}

  7%|▋         | 750/11049 [07:43<1:45:19,  1.63it/s]
  7%|▋         | 751/11049 [07:44<1:45:16,  1.63it/s]
                                                     
{'loss': 0.3863, 'grad_norm': 0.6777146458625793, 'learning_rate': 6.796380090497738e-06, 'epoch': 0.2}

  7%|▋         | 751/11049 [07:44<1:45:16,  1.63it/s]
  7%|▋         | 752/11049 [07:44<1:45:12,  1.63it/s]
                                                     
{'loss': 0.4079, 'grad_norm': 0.787090003490448, 'learning_rate': 6.805429864253394e-06, 'epoch': 0.2}

  7%|▋         | 752/11049 [07:44<1:45:12,  1.63it/s]
  7%|▋         | 753/11049 [07:45<1:45:13,  1.63it/s]
                                                     
{'loss': 0.4572, 'grad_norm': 0.8158517479896545, 'learning_rate': 6.81447963800905e-06, 'epoch': 0.2}

  7%|▋         | 753/11049 [07:45<1:45:13,  1.63it/s]
  7%|▋         | 754/11049 [07:45<1:45:11,  1.63it/s]
                                                     
{'loss': 0.4249, 'grad_norm': 0.6959381103515625, 'learning_rate': 6.8235294117647065e-06, 'epoch': 0.2}

  7%|▋         | 754/11049 [07:46<1:45:11,  1.63it/s]
  7%|▋         | 755/11049 [07:46<1:45:14,  1.63it/s]
                                                     
{'loss': 0.3585, 'grad_norm': 0.7806492447853088, 'learning_rate': 6.832579185520363e-06, 'epoch': 0.2}

  7%|▋         | 755/11049 [07:46<1:45:14,  1.63it/s]
  7%|▋         | 756/11049 [07:47<1:45:14,  1.63it/s]
                                                     
{'loss': 0.4617, 'grad_norm': 0.7201366424560547, 'learning_rate': 6.841628959276019e-06, 'epoch': 0.21}

  7%|▋         | 756/11049 [07:47<1:45:14,  1.63it/s]
  7%|▋         | 757/11049 [07:47<1:45:15,  1.63it/s]
                                                     
{'loss': 0.3367, 'grad_norm': 0.6462452411651611, 'learning_rate': 6.850678733031675e-06, 'epoch': 0.21}

  7%|▋         | 757/11049 [07:47<1:45:15,  1.63it/s]
  7%|▋         | 758/11049 [07:48<1:45:14,  1.63it/s]
                                                     
{'loss': 0.3687, 'grad_norm': 0.6506755352020264, 'learning_rate': 6.859728506787331e-06, 'epoch': 0.21}

  7%|▋         | 758/11049 [07:48<1:45:14,  1.63it/s]
  7%|▋         | 759/11049 [07:48<1:45:15,  1.63it/s]
                                                     
{'loss': 0.3588, 'grad_norm': 0.6625093817710876, 'learning_rate': 6.868778280542987e-06, 'epoch': 0.21}

  7%|▋         | 759/11049 [07:49<1:45:15,  1.63it/s]
  7%|▋         | 760/11049 [07:49<1:45:14,  1.63it/s]
                                                     
{'loss': 0.4106, 'grad_norm': 0.6493693590164185, 'learning_rate': 6.8778280542986434e-06, 'epoch': 0.21}

  7%|▋         | 760/11049 [07:49<1:45:14,  1.63it/s]
  7%|▋         | 761/11049 [07:50<1:45:13,  1.63it/s]
                                                     
{'loss': 0.4045, 'grad_norm': 0.6400578618049622, 'learning_rate': 6.886877828054299e-06, 'epoch': 0.21}

  7%|▋         | 761/11049 [07:50<1:45:13,  1.63it/s]
  7%|▋         | 762/11049 [07:50<1:45:13,  1.63it/s]
                                                     
{'loss': 0.3317, 'grad_norm': 0.6764522790908813, 'learning_rate': 6.895927601809955e-06, 'epoch': 0.21}

  7%|▋         | 762/11049 [07:50<1:45:13,  1.63it/s]
  7%|▋         | 763/11049 [07:51<1:45:13,  1.63it/s]
                                                     
{'loss': 0.3643, 'grad_norm': 0.6905056834220886, 'learning_rate': 6.904977375565611e-06, 'epoch': 0.21}

  7%|▋         | 763/11049 [07:51<1:45:13,  1.63it/s]
  7%|▋         | 764/11049 [07:52<1:45:13,  1.63it/s]
                                                     
{'loss': 0.3765, 'grad_norm': 0.6562072038650513, 'learning_rate': 6.914027149321267e-06, 'epoch': 0.21}

  7%|▋         | 764/11049 [07:52<1:45:13,  1.63it/s]
  7%|▋         | 765/11049 [07:52<1:45:12,  1.63it/s]
                                                     
{'loss': 0.4646, 'grad_norm': 0.7244579195976257, 'learning_rate': 6.923076923076923e-06, 'epoch': 0.21}

  7%|▋         | 765/11049 [07:52<1:45:12,  1.63it/s]
  7%|▋         | 766/11049 [07:53<1:45:09,  1.63it/s]
                                                     
{'loss': 0.3507, 'grad_norm': 0.7189484238624573, 'learning_rate': 6.9321266968325795e-06, 'epoch': 0.21}

  7%|▋         | 766/11049 [07:53<1:45:09,  1.63it/s]
  7%|▋         | 767/11049 [07:53<1:45:07,  1.63it/s]
                                                     
{'loss': 0.3897, 'grad_norm': 0.6605725884437561, 'learning_rate': 6.941176470588236e-06, 'epoch': 0.21}

  7%|▋         | 767/11049 [07:53<1:45:07,  1.63it/s]
  7%|▋         | 768/11049 [07:54<1:45:06,  1.63it/s]
                                                     
{'loss': 0.3191, 'grad_norm': 0.6623338460922241, 'learning_rate': 6.950226244343892e-06, 'epoch': 0.21}

  7%|▋         | 768/11049 [07:54<1:45:06,  1.63it/s]
  7%|▋         | 769/11049 [07:55<1:45:03,  1.63it/s]
                                                     
{'loss': 0.3303, 'grad_norm': 0.6203989386558533, 'learning_rate': 6.959276018099548e-06, 'epoch': 0.21}

  7%|▋         | 769/11049 [07:55<1:45:03,  1.63it/s]
  7%|▋         | 770/11049 [07:55<1:45:31,  1.62it/s]
                                                     
{'loss': 0.4229, 'grad_norm': 0.7167301177978516, 'learning_rate': 6.968325791855204e-06, 'epoch': 0.21}

  7%|▋         | 770/11049 [07:55<1:45:31,  1.62it/s]
  7%|▋         | 771/11049 [07:56<1:45:22,  1.63it/s]
                                                     
{'loss': 0.4659, 'grad_norm': 0.7033461928367615, 'learning_rate': 6.97737556561086e-06, 'epoch': 0.21}

  7%|▋         | 771/11049 [07:56<1:45:22,  1.63it/s]
  7%|▋         | 772/11049 [07:56<1:45:15,  1.63it/s]
                                                     
{'loss': 0.4101, 'grad_norm': 0.6766210794448853, 'learning_rate': 6.986425339366516e-06, 'epoch': 0.21}

  7%|▋         | 772/11049 [07:57<1:45:15,  1.63it/s]
  7%|▋         | 773/11049 [07:57<1:45:17,  1.63it/s]
                                                     
{'loss': 0.4196, 'grad_norm': 0.6985735893249512, 'learning_rate': 6.995475113122172e-06, 'epoch': 0.21}

  7%|▋         | 773/11049 [07:57<1:45:17,  1.63it/s]
  7%|▋         | 774/11049 [07:58<1:45:12,  1.63it/s]
                                                     
{'loss': 0.3616, 'grad_norm': 0.770917534828186, 'learning_rate': 7.004524886877828e-06, 'epoch': 0.21}

  7%|▋         | 774/11049 [07:58<1:45:12,  1.63it/s]
  7%|▋         | 775/11049 [07:58<1:45:10,  1.63it/s]
                                                     
{'loss': 0.4027, 'grad_norm': 0.6722999811172485, 'learning_rate': 7.013574660633484e-06, 'epoch': 0.21}

  7%|▋         | 775/11049 [07:58<1:45:10,  1.63it/s]
  7%|▋         | 776/11049 [07:59<1:45:07,  1.63it/s]
                                                     
{'loss': 0.4528, 'grad_norm': 0.6990002393722534, 'learning_rate': 7.02262443438914e-06, 'epoch': 0.21}

  7%|▋         | 776/11049 [07:59<1:45:07,  1.63it/s]
  7%|▋         | 777/11049 [08:00<1:45:21,  1.62it/s]
                                                     
{'loss': 0.4583, 'grad_norm': 0.6648110747337341, 'learning_rate': 7.031674208144797e-06, 'epoch': 0.21}

  7%|▋         | 777/11049 [08:00<1:45:21,  1.62it/s]
  7%|▋         | 778/11049 [08:00<1:45:17,  1.63it/s]
                                                     
{'loss': 0.426, 'grad_norm': 0.7300942540168762, 'learning_rate': 7.0407239819004535e-06, 'epoch': 0.21}

  7%|▋         | 778/11049 [08:00<1:45:17,  1.63it/s]
  7%|▋         | 779/11049 [08:01<1:45:13,  1.63it/s]
                                                     
{'loss': 0.4421, 'grad_norm': 0.6545361876487732, 'learning_rate': 7.04977375565611e-06, 'epoch': 0.21}

  7%|▋         | 779/11049 [08:01<1:45:13,  1.63it/s]
  7%|▋         | 780/11049 [08:01<1:45:08,  1.63it/s]
                                                     
{'loss': 0.3405, 'grad_norm': 0.725749135017395, 'learning_rate': 7.058823529411766e-06, 'epoch': 0.21}

  7%|▋         | 780/11049 [08:01<1:45:08,  1.63it/s]
  7%|▋         | 781/11049 [08:02<1:45:00,  1.63it/s]
                                                     
{'loss': 0.405, 'grad_norm': 0.7841042280197144, 'learning_rate': 7.067873303167422e-06, 'epoch': 0.21}

  7%|▋         | 781/11049 [08:02<1:45:00,  1.63it/s]
  7%|▋         | 782/11049 [08:03<1:45:08,  1.63it/s]
                                                     
{'loss': 0.371, 'grad_norm': 0.6694930791854858, 'learning_rate': 7.076923076923078e-06, 'epoch': 0.21}

  7%|▋         | 782/11049 [08:03<1:45:08,  1.63it/s]
  7%|▋         | 783/11049 [08:03<1:45:10,  1.63it/s]
                                                     
{'loss': 0.3479, 'grad_norm': 0.635539174079895, 'learning_rate': 7.085972850678734e-06, 'epoch': 0.21}

  7%|▋         | 783/11049 [08:03<1:45:10,  1.63it/s]
  7%|▋         | 784/11049 [08:04<1:45:09,  1.63it/s]
                                                     
{'loss': 0.3431, 'grad_norm': 0.8029416799545288, 'learning_rate': 7.09502262443439e-06, 'epoch': 0.21}

  7%|▋         | 784/11049 [08:04<1:45:09,  1.63it/s]
  7%|▋         | 785/11049 [08:04<1:45:03,  1.63it/s]
                                                     
{'loss': 0.396, 'grad_norm': 0.705928385257721, 'learning_rate': 7.104072398190046e-06, 'epoch': 0.21}

  7%|▋         | 785/11049 [08:05<1:45:03,  1.63it/s]
  7%|▋         | 786/11049 [08:05<1:44:58,  1.63it/s]
                                                     
{'loss': 0.3414, 'grad_norm': 0.6163344383239746, 'learning_rate': 7.113122171945702e-06, 'epoch': 0.21}

  7%|▋         | 786/11049 [08:05<1:44:58,  1.63it/s]
  7%|▋         | 787/11049 [08:06<1:45:07,  1.63it/s]
                                                     
{'loss': 0.2466, 'grad_norm': 0.6146127581596375, 'learning_rate': 7.122171945701358e-06, 'epoch': 0.21}

  7%|▋         | 787/11049 [08:06<1:45:07,  1.63it/s]
  7%|▋         | 788/11049 [08:06<1:45:28,  1.62it/s]
                                                     
{'loss': 0.3861, 'grad_norm': 0.657300591468811, 'learning_rate': 7.131221719457014e-06, 'epoch': 0.21}

  7%|▋         | 788/11049 [08:06<1:45:28,  1.62it/s]
  7%|▋         | 789/11049 [08:07<1:45:16,  1.62it/s]
                                                     
{'loss': 0.4048, 'grad_norm': 0.6860654950141907, 'learning_rate': 7.14027149321267e-06, 'epoch': 0.21}

  7%|▋         | 789/11049 [08:07<1:45:16,  1.62it/s]
  7%|▋         | 790/11049 [08:08<1:45:07,  1.63it/s]
                                                     
{'loss': 0.3841, 'grad_norm': 0.7180430293083191, 'learning_rate': 7.1493212669683265e-06, 'epoch': 0.21}

  7%|▋         | 790/11049 [08:08<1:45:07,  1.63it/s]
  7%|▋         | 791/11049 [08:08<1:45:00,  1.63it/s]
                                                     
{'loss': 0.328, 'grad_norm': 0.671583354473114, 'learning_rate': 7.158371040723983e-06, 'epoch': 0.21}

  7%|▋         | 791/11049 [08:08<1:45:00,  1.63it/s]
  7%|▋         | 792/11049 [08:09<1:44:57,  1.63it/s]
                                                     
{'loss': 0.513, 'grad_norm': 0.7358958125114441, 'learning_rate': 7.167420814479639e-06, 'epoch': 0.22}

  7%|▋         | 792/11049 [08:09<1:44:57,  1.63it/s]
  7%|▋         | 793/11049 [08:09<1:45:00,  1.63it/s]
                                                     
{'loss': 0.4026, 'grad_norm': 0.6657257080078125, 'learning_rate': 7.176470588235295e-06, 'epoch': 0.22}

  7%|▋         | 793/11049 [08:09<1:45:00,  1.63it/s]
  7%|▋         | 794/11049 [08:10<1:45:02,  1.63it/s]
                                                     
{'loss': 0.3069, 'grad_norm': 0.6803723573684692, 'learning_rate': 7.185520361990951e-06, 'epoch': 0.22}

  7%|▋         | 794/11049 [08:10<1:45:02,  1.63it/s]
  7%|▋         | 795/11049 [08:11<1:44:58,  1.63it/s]
                                                     
{'loss': 0.4513, 'grad_norm': 0.7221797704696655, 'learning_rate': 7.1945701357466065e-06, 'epoch': 0.22}

  7%|▋         | 795/11049 [08:11<1:44:58,  1.63it/s]
  7%|▋         | 796/11049 [08:11<1:44:55,  1.63it/s]
                                                     
{'loss': 0.3465, 'grad_norm': 0.7644687294960022, 'learning_rate': 7.203619909502263e-06, 'epoch': 0.22}

  7%|▋         | 796/11049 [08:11<1:44:55,  1.63it/s]
  7%|▋         | 797/11049 [08:12<1:44:52,  1.63it/s]
                                                     
{'loss': 0.3455, 'grad_norm': 0.6381279230117798, 'learning_rate': 7.212669683257919e-06, 'epoch': 0.22}

  7%|▋         | 797/11049 [08:12<1:44:52,  1.63it/s]
  7%|▋         | 798/11049 [08:12<1:44:56,  1.63it/s]
                                                     
{'loss': 0.384, 'grad_norm': 0.6342193484306335, 'learning_rate': 7.221719457013575e-06, 'epoch': 0.22}

  7%|▋         | 798/11049 [08:13<1:44:56,  1.63it/s]
  7%|▋         | 799/11049 [08:13<1:44:55,  1.63it/s]
                                                     
{'loss': 0.3699, 'grad_norm': 0.6833086013793945, 'learning_rate': 7.230769230769231e-06, 'epoch': 0.22}

  7%|▋         | 799/11049 [08:13<1:44:55,  1.63it/s]
  7%|▋         | 800/11049 [08:14<1:44:55,  1.63it/s]
                                                     
{'loss': 0.3595, 'grad_norm': 0.7580531239509583, 'learning_rate': 7.239819004524887e-06, 'epoch': 0.22}

  7%|▋         | 800/11049 [08:14<1:44:55,  1.63it/s]
  7%|▋         | 801/11049 [08:14<1:44:55,  1.63it/s]
                                                     
{'loss': 0.3849, 'grad_norm': 0.6715925931930542, 'learning_rate': 7.2488687782805434e-06, 'epoch': 0.22}

  7%|▋         | 801/11049 [08:14<1:44:55,  1.63it/s]
  7%|▋         | 802/11049 [08:15<1:44:52,  1.63it/s]
                                                     
{'loss': 0.4798, 'grad_norm': 0.8187554478645325, 'learning_rate': 7.2579185520362e-06, 'epoch': 0.22}

  7%|▋         | 802/11049 [08:15<1:44:52,  1.63it/s]
  7%|▋         | 803/11049 [08:15<1:44:53,  1.63it/s]
                                                     
{'loss': 0.3987, 'grad_norm': 0.7773988246917725, 'learning_rate': 7.266968325791856e-06, 'epoch': 0.22}

  7%|▋         | 803/11049 [08:16<1:44:53,  1.63it/s]
  7%|▋         | 804/11049 [08:16<1:44:56,  1.63it/s]
                                                     
{'loss': 0.3061, 'grad_norm': 0.7054852843284607, 'learning_rate': 7.276018099547512e-06, 'epoch': 0.22}

  7%|▋         | 804/11049 [08:16<1:44:56,  1.63it/s]
  7%|▋         | 805/11049 [08:17<1:44:56,  1.63it/s]
                                                     
{'loss': 0.3847, 'grad_norm': 0.7563863396644592, 'learning_rate': 7.285067873303168e-06, 'epoch': 0.22}

  7%|▋         | 805/11049 [08:17<1:44:56,  1.63it/s]
  7%|▋         | 806/11049 [08:17<1:44:49,  1.63it/s]
                                                     
{'loss': 0.4194, 'grad_norm': 0.6400895714759827, 'learning_rate': 7.294117647058823e-06, 'epoch': 0.22}

  7%|▋         | 806/11049 [08:17<1:44:49,  1.63it/s]
  7%|▋         | 807/11049 [08:18<1:44:52,  1.63it/s]
                                                     
{'loss': 0.384, 'grad_norm': 0.7996800541877747, 'learning_rate': 7.3031674208144796e-06, 'epoch': 0.22}

  7%|▋         | 807/11049 [08:18<1:44:52,  1.63it/s]
  7%|▋         | 808/11049 [08:19<1:44:52,  1.63it/s]
                                                     
{'loss': 0.4828, 'grad_norm': 0.8641437292098999, 'learning_rate': 7.312217194570136e-06, 'epoch': 0.22}

  7%|▋         | 808/11049 [08:19<1:44:52,  1.63it/s]
  7%|▋         | 809/11049 [08:19<1:44:50,  1.63it/s]
                                                     
{'loss': 0.3735, 'grad_norm': 0.7326787710189819, 'learning_rate': 7.321266968325792e-06, 'epoch': 0.22}

  7%|▋         | 809/11049 [08:19<1:44:50,  1.63it/s]
  7%|▋         | 810/11049 [08:20<1:44:51,  1.63it/s]
                                                     
{'loss': 0.3171, 'grad_norm': 0.6568357348442078, 'learning_rate': 7.330316742081448e-06, 'epoch': 0.22}

  7%|▋         | 810/11049 [08:20<1:44:51,  1.63it/s]
  7%|▋         | 811/11049 [08:20<1:44:47,  1.63it/s]
                                                     
{'loss': 0.3877, 'grad_norm': 0.7614900469779968, 'learning_rate': 7.339366515837104e-06, 'epoch': 0.22}

  7%|▋         | 811/11049 [08:21<1:44:47,  1.63it/s]
  7%|▋         | 812/11049 [08:21<1:44:43,  1.63it/s]
                                                     
{'loss': 0.467, 'grad_norm': 0.8244365453720093, 'learning_rate': 7.348416289592761e-06, 'epoch': 0.22}

  7%|▋         | 812/11049 [08:21<1:44:43,  1.63it/s]
  7%|▋         | 813/11049 [08:22<1:44:46,  1.63it/s]
                                                     
{'loss': 0.4076, 'grad_norm': 0.9197876453399658, 'learning_rate': 7.357466063348417e-06, 'epoch': 0.22}

  7%|▋         | 813/11049 [08:22<1:44:46,  1.63it/s]
  7%|▋         | 814/11049 [08:22<1:44:44,  1.63it/s]
                                                     
{'loss': 0.4066, 'grad_norm': 1.395594835281372, 'learning_rate': 7.3665158371040735e-06, 'epoch': 0.22}

  7%|▋         | 814/11049 [08:22<1:44:44,  1.63it/s]
  7%|▋         | 815/11049 [08:23<1:44:39,  1.63it/s]
                                                     
{'loss': 0.3817, 'grad_norm': 0.7843578457832336, 'learning_rate': 7.37556561085973e-06, 'epoch': 0.22}

  7%|▋         | 815/11049 [08:23<1:44:39,  1.63it/s]
  7%|▋         | 816/11049 [08:23<1:44:38,  1.63it/s]
                                                     
{'loss': 0.3442, 'grad_norm': 0.6535305976867676, 'learning_rate': 7.384615384615386e-06, 'epoch': 0.22}

  7%|▋         | 816/11049 [08:24<1:44:38,  1.63it/s]
  7%|▋         | 817/11049 [08:24<1:44:38,  1.63it/s]
                                                     
{'loss': 0.4357, 'grad_norm': 0.793484628200531, 'learning_rate': 7.393665158371042e-06, 'epoch': 0.22}

  7%|▋         | 817/11049 [08:24<1:44:38,  1.63it/s]
  7%|▋         | 818/11049 [08:25<1:44:43,  1.63it/s]
                                                     
{'loss': 0.3881, 'grad_norm': 0.6558584570884705, 'learning_rate': 7.402714932126698e-06, 'epoch': 0.22}

  7%|▋         | 818/11049 [08:25<1:44:43,  1.63it/s]
  7%|▋         | 819/11049 [08:25<1:44:42,  1.63it/s]
                                                     
{'loss': 0.4161, 'grad_norm': 0.7553694248199463, 'learning_rate': 7.4117647058823535e-06, 'epoch': 0.22}

  7%|▋         | 819/11049 [08:25<1:44:42,  1.63it/s]
  7%|▋         | 820/11049 [08:26<1:44:38,  1.63it/s]
                                                     
{'loss': 0.3728, 'grad_norm': 0.7106400728225708, 'learning_rate': 7.42081447963801e-06, 'epoch': 0.22}

  7%|▋         | 820/11049 [08:26<1:44:38,  1.63it/s]
  7%|▋         | 821/11049 [08:27<1:44:39,  1.63it/s]
                                                     
{'loss': 0.4021, 'grad_norm': 0.6956592798233032, 'learning_rate': 7.429864253393666e-06, 'epoch': 0.22}

  7%|▋         | 821/11049 [08:27<1:44:39,  1.63it/s]
  7%|▋         | 822/11049 [08:27<1:44:37,  1.63it/s]
                                                     
{'loss': 0.4842, 'grad_norm': 0.8236398696899414, 'learning_rate': 7.438914027149322e-06, 'epoch': 0.22}

  7%|▋         | 822/11049 [08:27<1:44:37,  1.63it/s]
  7%|▋         | 823/11049 [08:28<1:44:39,  1.63it/s]
                                                     
{'loss': 0.3329, 'grad_norm': 0.6253112554550171, 'learning_rate': 7.447963800904978e-06, 'epoch': 0.22}

  7%|▋         | 823/11049 [08:28<1:44:39,  1.63it/s]
  7%|▋         | 824/11049 [08:28<1:44:41,  1.63it/s]
                                                     
{'loss': 0.4024, 'grad_norm': 0.6316778063774109, 'learning_rate': 7.457013574660634e-06, 'epoch': 0.22}

  7%|▋         | 824/11049 [08:29<1:44:41,  1.63it/s]
  7%|▋         | 825/11049 [08:29<1:44:35,  1.63it/s]
                                                     
{'loss': 0.4471, 'grad_norm': 0.7355362176895142, 'learning_rate': 7.4660633484162904e-06, 'epoch': 0.22}

  7%|▋         | 825/11049 [08:29<1:44:35,  1.63it/s]
  7%|▋         | 826/11049 [08:30<1:44:35,  1.63it/s]
                                                     
{'loss': 0.4013, 'grad_norm': 0.7046860456466675, 'learning_rate': 7.475113122171947e-06, 'epoch': 0.22}

  7%|▋         | 826/11049 [08:30<1:44:35,  1.63it/s]
  7%|▋         | 827/11049 [08:30<1:44:31,  1.63it/s]
                                                     
{'loss': 0.384, 'grad_norm': 0.7278599739074707, 'learning_rate': 7.484162895927603e-06, 'epoch': 0.22}

  7%|▋         | 827/11049 [08:30<1:44:31,  1.63it/s]
  7%|▋         | 828/11049 [08:31<1:44:38,  1.63it/s]
                                                     
{'loss': 0.3614, 'grad_norm': 0.6195026636123657, 'learning_rate': 7.493212669683259e-06, 'epoch': 0.22}

  7%|▋         | 828/11049 [08:31<1:44:38,  1.63it/s]
  8%|▊         | 829/11049 [08:31<1:44:36,  1.63it/s]
                                                     
{'loss': 0.3074, 'grad_norm': 0.6093134880065918, 'learning_rate': 7.502262443438914e-06, 'epoch': 0.23}

  8%|▊         | 829/11049 [08:32<1:44:36,  1.63it/s]
  8%|▊         | 830/11049 [08:32<1:44:33,  1.63it/s]
                                                     
{'loss': 0.3817, 'grad_norm': 0.568574845790863, 'learning_rate': 7.51131221719457e-06, 'epoch': 0.23}

  8%|▊         | 830/11049 [08:32<1:44:33,  1.63it/s]
  8%|▊         | 831/11049 [08:33<1:44:28,  1.63it/s]
                                                     
{'loss': 0.4212, 'grad_norm': 0.7354427576065063, 'learning_rate': 7.5203619909502265e-06, 'epoch': 0.23}

  8%|▊         | 831/11049 [08:33<1:44:28,  1.63it/s]
  8%|▊         | 832/11049 [08:33<1:44:25,  1.63it/s]
                                                     
{'loss': 0.3078, 'grad_norm': 0.6727440357208252, 'learning_rate': 7.529411764705883e-06, 'epoch': 0.23}

  8%|▊         | 832/11049 [08:33<1:44:25,  1.63it/s]
  8%|▊         | 833/11049 [08:34<1:44:33,  1.63it/s]
                                                     
{'loss': 0.448, 'grad_norm': 0.7343852519989014, 'learning_rate': 7.538461538461539e-06, 'epoch': 0.23}

  8%|▊         | 833/11049 [08:34<1:44:33,  1.63it/s]
  8%|▊         | 834/11049 [08:35<1:44:30,  1.63it/s]
                                                     
{'loss': 0.357, 'grad_norm': 0.5837724804878235, 'learning_rate': 7.547511312217195e-06, 'epoch': 0.23}

  8%|▊         | 834/11049 [08:35<1:44:30,  1.63it/s]
  8%|▊         | 835/11049 [08:35<1:44:26,  1.63it/s]
                                                     
{'loss': 0.3183, 'grad_norm': 0.6697717905044556, 'learning_rate': 7.556561085972851e-06, 'epoch': 0.23}

  8%|▊         | 835/11049 [08:35<1:44:26,  1.63it/s]
  8%|▊         | 836/11049 [08:36<1:44:26,  1.63it/s]
                                                     
{'loss': 0.3847, 'grad_norm': 0.7309252023696899, 'learning_rate': 7.565610859728507e-06, 'epoch': 0.23}

  8%|▊         | 836/11049 [08:36<1:44:26,  1.63it/s]
  8%|▊         | 837/11049 [08:36<1:44:22,  1.63it/s]
                                                     
{'loss': 0.3246, 'grad_norm': 0.7811505794525146, 'learning_rate': 7.5746606334841635e-06, 'epoch': 0.23}

  8%|▊         | 837/11049 [08:36<1:44:22,  1.63it/s]
  8%|▊         | 838/11049 [08:37<1:44:31,  1.63it/s]
                                                     
{'loss': 0.386, 'grad_norm': 0.6836063861846924, 'learning_rate': 7.58371040723982e-06, 'epoch': 0.23}

  8%|▊         | 838/11049 [08:37<1:44:31,  1.63it/s]
  8%|▊         | 839/11049 [08:38<1:44:30,  1.63it/s]
                                                     
{'loss': 0.4045, 'grad_norm': 0.6954448223114014, 'learning_rate': 7.592760180995475e-06, 'epoch': 0.23}

  8%|▊         | 839/11049 [08:38<1:44:30,  1.63it/s]
  8%|▊         | 840/11049 [08:38<1:44:30,  1.63it/s]
                                                     
{'loss': 0.372, 'grad_norm': 0.6815757751464844, 'learning_rate': 7.601809954751131e-06, 'epoch': 0.23}

  8%|▊         | 840/11049 [08:38<1:44:30,  1.63it/s]
  8%|▊         | 841/11049 [08:39<1:44:28,  1.63it/s]
                                                     
{'loss': 0.3383, 'grad_norm': 0.6594481468200684, 'learning_rate': 7.610859728506787e-06, 'epoch': 0.23}

  8%|▊         | 841/11049 [08:39<1:44:28,  1.63it/s]
  8%|▊         | 842/11049 [08:39<1:44:29,  1.63it/s]
                                                     
{'loss': 0.3729, 'grad_norm': 0.7291803359985352, 'learning_rate': 7.6199095022624435e-06, 'epoch': 0.23}

  8%|▊         | 842/11049 [08:40<1:44:29,  1.63it/s]
  8%|▊         | 843/11049 [08:40<1:44:31,  1.63it/s]
                                                     
{'loss': 0.3503, 'grad_norm': 0.7349615693092346, 'learning_rate': 7.6289592760181e-06, 'epoch': 0.23}

  8%|▊         | 843/11049 [08:40<1:44:31,  1.63it/s]
  8%|▊         | 844/11049 [08:41<1:44:25,  1.63it/s]
                                                     
{'loss': 0.3914, 'grad_norm': 0.8382735252380371, 'learning_rate': 7.638009049773757e-06, 'epoch': 0.23}

  8%|▊         | 844/11049 [08:41<1:44:25,  1.63it/s]
  8%|▊         | 845/11049 [08:41<1:44:23,  1.63it/s]
                                                     
{'loss': 0.4109, 'grad_norm': 0.6031955480575562, 'learning_rate': 7.647058823529411e-06, 'epoch': 0.23}

  8%|▊         | 845/11049 [08:41<1:44:23,  1.63it/s]
  8%|▊         | 846/11049 [08:42<1:44:21,  1.63it/s]
                                                     
{'loss': 0.3644, 'grad_norm': 0.6380112171173096, 'learning_rate': 7.656108597285067e-06, 'epoch': 0.23}

  8%|▊         | 846/11049 [08:42<1:44:21,  1.63it/s]
  8%|▊         | 847/11049 [08:43<1:44:21,  1.63it/s]
                                                     
{'loss': 0.4401, 'grad_norm': 0.7221205830574036, 'learning_rate': 7.665158371040725e-06, 'epoch': 0.23}

  8%|▊         | 847/11049 [08:43<1:44:21,  1.63it/s]
  8%|▊         | 848/11049 [08:43<1:44:22,  1.63it/s]
                                                     
{'loss': 0.3344, 'grad_norm': 0.6962651610374451, 'learning_rate': 7.674208144796381e-06, 'epoch': 0.23}

  8%|▊         | 848/11049 [08:43<1:44:22,  1.63it/s]
  8%|▊         | 849/11049 [08:44<1:44:19,  1.63it/s]
                                                     
{'loss': 0.302, 'grad_norm': 0.5609612464904785, 'learning_rate': 7.683257918552037e-06, 'epoch': 0.23}

  8%|▊         | 849/11049 [08:44<1:44:19,  1.63it/s]
  8%|▊         | 850/11049 [08:44<1:44:22,  1.63it/s]
                                                     
{'loss': 0.3793, 'grad_norm': 0.7777340412139893, 'learning_rate': 7.692307692307694e-06, 'epoch': 0.23}

  8%|▊         | 850/11049 [08:44<1:44:22,  1.63it/s]
  8%|▊         | 851/11049 [08:45<1:44:25,  1.63it/s]
                                                     
{'loss': 0.3556, 'grad_norm': 0.7513397336006165, 'learning_rate': 7.70135746606335e-06, 'epoch': 0.23}

  8%|▊         | 851/11049 [08:45<1:44:25,  1.63it/s]
  8%|▊         | 852/11049 [08:46<1:44:21,  1.63it/s]
                                                     
{'loss': 0.3474, 'grad_norm': 0.7455713152885437, 'learning_rate': 7.710407239819006e-06, 'epoch': 0.23}

  8%|▊         | 852/11049 [08:46<1:44:21,  1.63it/s]
  8%|▊         | 853/11049 [08:46<1:44:20,  1.63it/s]
                                                     
{'loss': 0.3808, 'grad_norm': 0.6387410759925842, 'learning_rate': 7.719457013574662e-06, 'epoch': 0.23}

  8%|▊         | 853/11049 [08:46<1:44:20,  1.63it/s]
  8%|▊         | 854/11049 [08:47<1:44:17,  1.63it/s]
                                                     
{'loss': 0.3299, 'grad_norm': 0.628646969795227, 'learning_rate': 7.728506787330318e-06, 'epoch': 0.23}

  8%|▊         | 854/11049 [08:47<1:44:17,  1.63it/s]
  8%|▊         | 855/11049 [08:47<1:44:16,  1.63it/s]
                                                     
{'loss': 0.3479, 'grad_norm': 0.6268238425254822, 'learning_rate': 7.737556561085974e-06, 'epoch': 0.23}

  8%|▊         | 855/11049 [08:48<1:44:16,  1.63it/s]
  8%|▊         | 856/11049 [08:48<1:44:14,  1.63it/s]
                                                     
{'loss': 0.359, 'grad_norm': 0.7405362129211426, 'learning_rate': 7.74660633484163e-06, 'epoch': 0.23}

  8%|▊         | 856/11049 [08:48<1:44:14,  1.63it/s]
  8%|▊         | 857/11049 [08:49<1:44:10,  1.63it/s]
                                                     
{'loss': 0.4121, 'grad_norm': 0.6970988512039185, 'learning_rate': 7.755656108597287e-06, 'epoch': 0.23}

  8%|▊         | 857/11049 [08:49<1:44:10,  1.63it/s]
  8%|▊         | 858/11049 [08:49<1:44:17,  1.63it/s]
                                                     
{'loss': 0.2847, 'grad_norm': 0.6168254613876343, 'learning_rate': 7.764705882352941e-06, 'epoch': 0.23}

  8%|▊         | 858/11049 [08:49<1:44:17,  1.63it/s]
  8%|▊         | 859/11049 [08:50<1:44:13,  1.63it/s]
                                                     
{'loss': 0.4109, 'grad_norm': 0.7598191499710083, 'learning_rate': 7.773755656108597e-06, 'epoch': 0.23}

  8%|▊         | 859/11049 [08:50<1:44:13,  1.63it/s]
  8%|▊         | 860/11049 [08:50<1:44:14,  1.63it/s]
                                                     
{'loss': 0.3693, 'grad_norm': 0.622135579586029, 'learning_rate': 7.782805429864253e-06, 'epoch': 0.23}

  8%|▊         | 860/11049 [08:51<1:44:14,  1.63it/s]
  8%|▊         | 861/11049 [08:51<1:44:13,  1.63it/s]
                                                     
{'loss': 0.2901, 'grad_norm': 0.6155178546905518, 'learning_rate': 7.79185520361991e-06, 'epoch': 0.23}

  8%|▊         | 861/11049 [08:51<1:44:13,  1.63it/s]
  8%|▊         | 862/11049 [08:52<1:44:10,  1.63it/s]
                                                     
{'loss': 0.4212, 'grad_norm': 0.6456596851348877, 'learning_rate': 7.800904977375566e-06, 'epoch': 0.23}

  8%|▊         | 862/11049 [08:52<1:44:10,  1.63it/s]
  8%|▊         | 863/11049 [08:52<1:44:12,  1.63it/s]
                                                     
{'loss': 0.3338, 'grad_norm': 0.6372914910316467, 'learning_rate': 7.809954751131222e-06, 'epoch': 0.23}

  8%|▊         | 863/11049 [08:52<1:44:12,  1.63it/s]
  8%|▊         | 864/11049 [08:53<1:44:10,  1.63it/s]
                                                     
{'loss': 0.4277, 'grad_norm': 0.732811689376831, 'learning_rate': 7.819004524886878e-06, 'epoch': 0.23}

  8%|▊         | 864/11049 [08:53<1:44:10,  1.63it/s]
  8%|▊         | 865/11049 [08:54<1:44:09,  1.63it/s]
                                                     
{'loss': 0.3507, 'grad_norm': 0.6916719079017639, 'learning_rate': 7.828054298642534e-06, 'epoch': 0.23}

  8%|▊         | 865/11049 [08:54<1:44:09,  1.63it/s]
  8%|▊         | 866/11049 [08:54<1:44:07,  1.63it/s]
                                                     
{'loss': 0.4359, 'grad_norm': 0.7693077325820923, 'learning_rate': 7.83710407239819e-06, 'epoch': 0.24}

  8%|▊         | 866/11049 [08:54<1:44:07,  1.63it/s]
  8%|▊         | 867/11049 [08:55<1:44:06,  1.63it/s]
                                                     
{'loss': 0.3064, 'grad_norm': 0.626950740814209, 'learning_rate': 7.846153846153847e-06, 'epoch': 0.24}

  8%|▊         | 867/11049 [08:55<1:44:06,  1.63it/s]
  8%|▊         | 868/11049 [08:55<1:44:11,  1.63it/s]
                                                     
{'loss': 0.4, 'grad_norm': 0.7725783586502075, 'learning_rate': 7.855203619909503e-06, 'epoch': 0.24}

  8%|▊         | 868/11049 [08:56<1:44:11,  1.63it/s]
  8%|▊         | 869/11049 [08:56<1:44:08,  1.63it/s]
                                                     
{'loss': 0.3852, 'grad_norm': 0.6751063466072083, 'learning_rate': 7.864253393665159e-06, 'epoch': 0.24}

  8%|▊         | 869/11049 [08:56<1:44:08,  1.63it/s]
  8%|▊         | 870/11049 [08:57<1:44:06,  1.63it/s]
                                                     
{'loss': 0.39, 'grad_norm': 0.6838275790214539, 'learning_rate': 7.873303167420815e-06, 'epoch': 0.24}

  8%|▊         | 870/11049 [08:57<1:44:06,  1.63it/s]
  8%|▊         | 871/11049 [08:57<1:44:09,  1.63it/s]
                                                     
{'loss': 0.4071, 'grad_norm': 0.7510324120521545, 'learning_rate': 7.882352941176471e-06, 'epoch': 0.24}

  8%|▊         | 871/11049 [08:57<1:44:09,  1.63it/s]
  8%|▊         | 872/11049 [08:58<1:44:06,  1.63it/s]
                                                     
{'loss': 0.4705, 'grad_norm': 0.8562307953834534, 'learning_rate': 7.891402714932127e-06, 'epoch': 0.24}

  8%|▊         | 872/11049 [08:58<1:44:06,  1.63it/s]
  8%|▊         | 873/11049 [08:58<1:44:04,  1.63it/s]
                                                     
{'loss': 0.414, 'grad_norm': 0.605919361114502, 'learning_rate': 7.900452488687784e-06, 'epoch': 0.24}

  8%|▊         | 873/11049 [08:59<1:44:04,  1.63it/s]
  8%|▊         | 874/11049 [08:59<1:44:05,  1.63it/s]
                                                     
{'loss': 0.3428, 'grad_norm': 0.5975925922393799, 'learning_rate': 7.90950226244344e-06, 'epoch': 0.24}

  8%|▊         | 874/11049 [08:59<1:44:05,  1.63it/s]
  8%|▊         | 875/11049 [09:00<1:44:07,  1.63it/s]
                                                     
{'loss': 0.3109, 'grad_norm': 0.6237676739692688, 'learning_rate': 7.918552036199096e-06, 'epoch': 0.24}

  8%|▊         | 875/11049 [09:00<1:44:07,  1.63it/s]
  8%|▊         | 876/11049 [09:00<1:44:04,  1.63it/s]
                                                     
{'loss': 0.3824, 'grad_norm': 0.6117947101593018, 'learning_rate': 7.927601809954752e-06, 'epoch': 0.24}

  8%|▊         | 876/11049 [09:00<1:44:04,  1.63it/s]
  8%|▊         | 877/11049 [09:01<1:44:00,  1.63it/s]
                                                     
{'loss': 0.3639, 'grad_norm': 0.6701990962028503, 'learning_rate': 7.936651583710408e-06, 'epoch': 0.24}

  8%|▊         | 877/11049 [09:01<1:44:00,  1.63it/s]
  8%|▊         | 878/11049 [09:02<1:44:01,  1.63it/s]
                                                     
{'loss': 0.4704, 'grad_norm': 0.7016111612319946, 'learning_rate': 7.945701357466063e-06, 'epoch': 0.24}

  8%|▊         | 878/11049 [09:02<1:44:01,  1.63it/s]
  8%|▊         | 879/11049 [09:02<1:44:00,  1.63it/s]
                                                     
{'loss': 0.4035, 'grad_norm': 0.7222011685371399, 'learning_rate': 7.954751131221719e-06, 'epoch': 0.24}

  8%|▊         | 879/11049 [09:02<1:44:00,  1.63it/s]
  8%|▊         | 880/11049 [09:03<1:44:00,  1.63it/s]
                                                     
{'loss': 0.3907, 'grad_norm': 0.6780474185943604, 'learning_rate': 7.963800904977375e-06, 'epoch': 0.24}

  8%|▊         | 880/11049 [09:03<1:44:00,  1.63it/s]
  8%|▊         | 881/11049 [09:03<1:43:58,  1.63it/s]
                                                     
{'loss': 0.3519, 'grad_norm': 0.6532970666885376, 'learning_rate': 7.972850678733033e-06, 'epoch': 0.24}

  8%|▊         | 881/11049 [09:04<1:43:58,  1.63it/s]
  8%|▊         | 882/11049 [09:04<1:43:59,  1.63it/s]
                                                     
{'loss': 0.2929, 'grad_norm': 0.6177768111228943, 'learning_rate': 7.981900452488689e-06, 'epoch': 0.24}

  8%|▊         | 882/11049 [09:04<1:43:59,  1.63it/s]
  8%|▊         | 883/11049 [09:05<1:43:58,  1.63it/s]
                                                     
{'loss': 0.4557, 'grad_norm': 0.7170803546905518, 'learning_rate': 7.990950226244345e-06, 'epoch': 0.24}

  8%|▊         | 883/11049 [09:05<1:43:58,  1.63it/s]
  8%|▊         | 884/11049 [09:05<1:43:55,  1.63it/s]
                                                     
{'loss': 0.2875, 'grad_norm': 0.5988157391548157, 'learning_rate': 8.000000000000001e-06, 'epoch': 0.24}

  8%|▊         | 884/11049 [09:05<1:43:55,  1.63it/s]
  8%|▊         | 885/11049 [09:06<1:43:53,  1.63it/s]
                                                     
{'loss': 0.4443, 'grad_norm': 0.7788857817649841, 'learning_rate': 8.009049773755657e-06, 'epoch': 0.24}

  8%|▊         | 885/11049 [09:06<1:43:53,  1.63it/s]
  8%|▊         | 886/11049 [09:06<1:43:50,  1.63it/s]
                                                     
{'loss': 0.4232, 'grad_norm': 0.9277218580245972, 'learning_rate': 8.018099547511314e-06, 'epoch': 0.24}

  8%|▊         | 886/11049 [09:07<1:43:50,  1.63it/s]
  8%|▊         | 887/11049 [09:07<1:43:53,  1.63it/s]
                                                     
{'loss': 0.3603, 'grad_norm': 0.658696711063385, 'learning_rate': 8.02714932126697e-06, 'epoch': 0.24}

  8%|▊         | 887/11049 [09:07<1:43:53,  1.63it/s]
  8%|▊         | 888/11049 [09:08<1:44:19,  1.62it/s]
                                                     
{'loss': 0.3557, 'grad_norm': 0.6176788806915283, 'learning_rate': 8.036199095022626e-06, 'epoch': 0.24}

  8%|▊         | 888/11049 [09:08<1:44:19,  1.62it/s]
  8%|▊         | 889/11049 [09:08<1:44:11,  1.63it/s]
                                                     
{'loss': 0.3386, 'grad_norm': 0.6653143167495728, 'learning_rate': 8.045248868778282e-06, 'epoch': 0.24}

  8%|▊         | 889/11049 [09:08<1:44:11,  1.63it/s]
  8%|▊         | 890/11049 [09:09<1:44:06,  1.63it/s]
                                                     
{'loss': 0.3574, 'grad_norm': 0.6559087634086609, 'learning_rate': 8.054298642533938e-06, 'epoch': 0.24}

  8%|▊         | 890/11049 [09:09<1:44:06,  1.63it/s]
  8%|▊         | 891/11049 [09:10<1:44:02,  1.63it/s]
                                                     
{'loss': 0.3824, 'grad_norm': 0.6657917499542236, 'learning_rate': 8.063348416289594e-06, 'epoch': 0.24}

  8%|▊         | 891/11049 [09:10<1:44:02,  1.63it/s]
  8%|▊         | 892/11049 [09:10<1:44:04,  1.63it/s]
                                                     
{'loss': 0.3747, 'grad_norm': 0.6241945028305054, 'learning_rate': 8.072398190045249e-06, 'epoch': 0.24}

  8%|▊         | 892/11049 [09:10<1:44:04,  1.63it/s]
  8%|▊         | 893/11049 [09:11<1:44:00,  1.63it/s]
                                                     
{'loss': 0.3569, 'grad_norm': 0.6663831472396851, 'learning_rate': 8.081447963800905e-06, 'epoch': 0.24}

  8%|▊         | 893/11049 [09:11<1:44:00,  1.63it/s]
  8%|▊         | 894/11049 [09:11<1:43:59,  1.63it/s]
                                                     
{'loss': 0.3575, 'grad_norm': 0.6800709366798401, 'learning_rate': 8.090497737556561e-06, 'epoch': 0.24}

  8%|▊         | 894/11049 [09:11<1:43:59,  1.63it/s]
  8%|▊         | 895/11049 [09:12<1:43:57,  1.63it/s]
                                                     
{'loss': 0.3195, 'grad_norm': 0.6915602684020996, 'learning_rate': 8.099547511312217e-06, 'epoch': 0.24}

  8%|▊         | 895/11049 [09:12<1:43:57,  1.63it/s]
  8%|▊         | 896/11049 [09:13<1:43:53,  1.63it/s]
                                                     
{'loss': 0.3499, 'grad_norm': 0.6340577602386475, 'learning_rate': 8.108597285067874e-06, 'epoch': 0.24}

  8%|▊         | 896/11049 [09:13<1:43:53,  1.63it/s]
  8%|▊         | 897/11049 [09:13<1:43:59,  1.63it/s]
                                                     
{'loss': 0.3331, 'grad_norm': 0.6696895956993103, 'learning_rate': 8.11764705882353e-06, 'epoch': 0.24}

  8%|▊         | 897/11049 [09:13<1:43:59,  1.63it/s]
  8%|▊         | 898/11049 [09:14<1:43:54,  1.63it/s]
                                                     
{'loss': 0.408, 'grad_norm': 0.6828070878982544, 'learning_rate': 8.126696832579186e-06, 'epoch': 0.24}

  8%|▊         | 898/11049 [09:14<1:43:54,  1.63it/s]
  8%|▊         | 899/11049 [09:14<1:43:52,  1.63it/s]
                                                     
{'loss': 0.4051, 'grad_norm': 0.8257474303245544, 'learning_rate': 8.135746606334842e-06, 'epoch': 0.24}

  8%|▊         | 899/11049 [09:15<1:43:52,  1.63it/s]
  8%|▊         | 900/11049 [09:15<1:43:51,  1.63it/s]
                                                     
{'loss': 0.2895, 'grad_norm': 0.6205788254737854, 'learning_rate': 8.144796380090498e-06, 'epoch': 0.24}

  8%|▊         | 900/11049 [09:15<1:43:51,  1.63it/s]
  8%|▊         | 901/11049 [09:16<1:43:46,  1.63it/s]
                                                     
{'loss': 0.2775, 'grad_norm': 0.9131436944007874, 'learning_rate': 8.153846153846154e-06, 'epoch': 0.24}

  8%|▊         | 901/11049 [09:16<1:43:46,  1.63it/s]
  8%|▊         | 902/11049 [09:16<1:43:56,  1.63it/s]
                                                     
{'loss': 0.2705, 'grad_norm': 0.6714426875114441, 'learning_rate': 8.16289592760181e-06, 'epoch': 0.24}

  8%|▊         | 902/11049 [09:16<1:43:56,  1.63it/s]
  8%|▊         | 903/11049 [09:17<1:43:50,  1.63it/s]
                                                     
{'loss': 0.4301, 'grad_norm': 0.7125820517539978, 'learning_rate': 8.171945701357467e-06, 'epoch': 0.25}

  8%|▊         | 903/11049 [09:17<1:43:50,  1.63it/s]
  8%|▊         | 904/11049 [09:17<1:43:45,  1.63it/s]
                                                     
{'loss': 0.3958, 'grad_norm': 0.7716654539108276, 'learning_rate': 8.180995475113123e-06, 'epoch': 0.25}

  8%|▊         | 904/11049 [09:18<1:43:45,  1.63it/s]
  8%|▊         | 905/11049 [09:18<1:43:45,  1.63it/s]
                                                     
{'loss': 0.2876, 'grad_norm': 0.6464900374412537, 'learning_rate': 8.190045248868779e-06, 'epoch': 0.25}

  8%|▊         | 905/11049 [09:18<1:43:45,  1.63it/s]
  8%|▊         | 906/11049 [09:19<1:43:47,  1.63it/s]
                                                     
{'loss': 0.232, 'grad_norm': 0.5237300395965576, 'learning_rate': 8.199095022624435e-06, 'epoch': 0.25}

  8%|▊         | 906/11049 [09:19<1:43:47,  1.63it/s]
  8%|▊         | 907/11049 [09:19<1:43:52,  1.63it/s]
                                                     
{'loss': 0.3956, 'grad_norm': 0.8701138496398926, 'learning_rate': 8.208144796380091e-06, 'epoch': 0.25}

  8%|▊         | 907/11049 [09:19<1:43:52,  1.63it/s]
  8%|▊         | 908/11049 [09:20<1:43:49,  1.63it/s]
                                                     
{'loss': 0.3455, 'grad_norm': 0.693935215473175, 'learning_rate': 8.217194570135747e-06, 'epoch': 0.25}

  8%|▊         | 908/11049 [09:20<1:43:49,  1.63it/s]
  8%|▊         | 909/11049 [09:21<1:43:44,  1.63it/s]
                                                     
{'loss': 0.3003, 'grad_norm': 0.663796067237854, 'learning_rate': 8.226244343891404e-06, 'epoch': 0.25}

  8%|▊         | 909/11049 [09:21<1:43:44,  1.63it/s]
  8%|▊         | 910/11049 [09:21<1:43:49,  1.63it/s]
                                                     
{'loss': 0.3543, 'grad_norm': 0.6712805032730103, 'learning_rate': 8.23529411764706e-06, 'epoch': 0.25}

  8%|▊         | 910/11049 [09:21<1:43:49,  1.63it/s]
  8%|▊         | 911/11049 [09:22<1:43:44,  1.63it/s]
                                                     
{'loss': 0.3682, 'grad_norm': 0.6618577241897583, 'learning_rate': 8.244343891402716e-06, 'epoch': 0.25}

  8%|▊         | 911/11049 [09:22<1:43:44,  1.63it/s]
  8%|▊         | 912/11049 [09:22<1:43:52,  1.63it/s]
                                                     
{'loss': 0.321, 'grad_norm': 0.7058276534080505, 'learning_rate': 8.25339366515837e-06, 'epoch': 0.25}

  8%|▊         | 912/11049 [09:23<1:43:52,  1.63it/s]
  8%|▊         | 913/11049 [09:23<1:43:45,  1.63it/s]
                                                     
{'loss': 0.5122, 'grad_norm': 0.895088255405426, 'learning_rate': 8.262443438914027e-06, 'epoch': 0.25}

  8%|▊         | 913/11049 [09:23<1:43:45,  1.63it/s]
  8%|▊         | 914/11049 [09:24<1:43:47,  1.63it/s]
                                                     
{'loss': 0.3297, 'grad_norm': 0.6500238180160522, 'learning_rate': 8.271493212669683e-06, 'epoch': 0.25}

  8%|▊         | 914/11049 [09:24<1:43:47,  1.63it/s]
  8%|▊         | 915/11049 [09:24<1:43:45,  1.63it/s]
                                                     
{'loss': 0.352, 'grad_norm': 0.7574811577796936, 'learning_rate': 8.280542986425339e-06, 'epoch': 0.25}

  8%|▊         | 915/11049 [09:24<1:43:45,  1.63it/s]
  8%|▊         | 916/11049 [09:25<1:43:43,  1.63it/s]
                                                     
{'loss': 0.3203, 'grad_norm': 0.6540330052375793, 'learning_rate': 8.289592760180997e-06, 'epoch': 0.25}

  8%|▊         | 916/11049 [09:25<1:43:43,  1.63it/s]
  8%|▊         | 917/11049 [09:25<1:43:42,  1.63it/s]
                                                     
{'loss': 0.3145, 'grad_norm': 0.7338301539421082, 'learning_rate': 8.298642533936653e-06, 'epoch': 0.25}

  8%|▊         | 917/11049 [09:26<1:43:42,  1.63it/s]
  8%|▊         | 918/11049 [09:26<1:43:40,  1.63it/s]
                                                     
{'loss': 0.3187, 'grad_norm': 0.7948343753814697, 'learning_rate': 8.307692307692309e-06, 'epoch': 0.25}

  8%|▊         | 918/11049 [09:26<1:43:40,  1.63it/s]
  8%|▊         | 919/11049 [09:27<1:43:35,  1.63it/s]
                                                     
{'loss': 0.3066, 'grad_norm': 0.665888249874115, 'learning_rate': 8.316742081447965e-06, 'epoch': 0.25}

  8%|▊         | 919/11049 [09:27<1:43:35,  1.63it/s]
  8%|▊         | 920/11049 [09:27<1:43:34,  1.63it/s]
                                                     
{'loss': 0.3525, 'grad_norm': 0.7286103367805481, 'learning_rate': 8.325791855203621e-06, 'epoch': 0.25}

  8%|▊         | 920/11049 [09:27<1:43:34,  1.63it/s]
  8%|▊         | 921/11049 [09:28<1:43:31,  1.63it/s]
                                                     
{'loss': 0.3216, 'grad_norm': 0.7486239075660706, 'learning_rate': 8.334841628959278e-06, 'epoch': 0.25}

  8%|▊         | 921/11049 [09:28<1:43:31,  1.63it/s]
  8%|▊         | 922/11049 [09:29<1:43:41,  1.63it/s]
                                                     
{'loss': 0.3325, 'grad_norm': 0.6520456075668335, 'learning_rate': 8.343891402714934e-06, 'epoch': 0.25}

  8%|▊         | 922/11049 [09:29<1:43:41,  1.63it/s]
  8%|▊         | 923/11049 [09:29<1:43:38,  1.63it/s]
                                                     
{'loss': 0.3634, 'grad_norm': 0.7142286896705627, 'learning_rate': 8.35294117647059e-06, 'epoch': 0.25}

  8%|▊         | 923/11049 [09:29<1:43:38,  1.63it/s]
  8%|▊         | 924/11049 [09:30<1:43:35,  1.63it/s]
                                                     
{'loss': 0.2891, 'grad_norm': 0.5750152468681335, 'learning_rate': 8.361990950226246e-06, 'epoch': 0.25}

  8%|▊         | 924/11049 [09:30<1:43:35,  1.63it/s]
  8%|▊         | 925/11049 [09:30<1:43:33,  1.63it/s]
                                                     
{'loss': 0.343, 'grad_norm': 0.6558372974395752, 'learning_rate': 8.371040723981902e-06, 'epoch': 0.25}

  8%|▊         | 925/11049 [09:31<1:43:33,  1.63it/s]
  8%|▊         | 926/11049 [09:31<1:43:32,  1.63it/s]
                                                     
{'loss': 0.2717, 'grad_norm': 0.5707759857177734, 'learning_rate': 8.380090497737557e-06, 'epoch': 0.25}

  8%|▊         | 926/11049 [09:31<1:43:32,  1.63it/s]
  8%|▊         | 927/11049 [09:32<1:43:37,  1.63it/s]
                                                     
{'loss': 0.3223, 'grad_norm': 0.6513221263885498, 'learning_rate': 8.389140271493213e-06, 'epoch': 0.25}

  8%|▊         | 927/11049 [09:32<1:43:37,  1.63it/s]
  8%|▊         | 928/11049 [09:32<1:43:36,  1.63it/s]
                                                     
{'loss': 0.3693, 'grad_norm': 0.6721975207328796, 'learning_rate': 8.398190045248869e-06, 'epoch': 0.25}

  8%|▊         | 928/11049 [09:32<1:43:36,  1.63it/s]
  8%|▊         | 929/11049 [09:33<1:43:33,  1.63it/s]
                                                     
{'loss': 0.3345, 'grad_norm': 0.641426682472229, 'learning_rate': 8.407239819004525e-06, 'epoch': 0.25}

  8%|▊         | 929/11049 [09:33<1:43:33,  1.63it/s]
  8%|▊         | 930/11049 [09:33<1:43:31,  1.63it/s]
                                                     
{'loss': 0.3328, 'grad_norm': 0.7377240657806396, 'learning_rate': 8.416289592760181e-06, 'epoch': 0.25}

  8%|▊         | 930/11049 [09:34<1:43:31,  1.63it/s]
  8%|▊         | 931/11049 [09:34<1:43:28,  1.63it/s]
                                                     
{'loss': 0.3014, 'grad_norm': 0.7127923965454102, 'learning_rate': 8.425339366515837e-06, 'epoch': 0.25}

  8%|▊         | 931/11049 [09:34<1:43:28,  1.63it/s]
  8%|▊         | 932/11049 [09:35<1:43:25,  1.63it/s]
                                                     
{'loss': 0.3092, 'grad_norm': 0.6586944460868835, 'learning_rate': 8.434389140271494e-06, 'epoch': 0.25}

  8%|▊         | 932/11049 [09:35<1:43:25,  1.63it/s]
  8%|▊         | 933/11049 [09:35<1:43:26,  1.63it/s]
                                                     
{'loss': 0.2906, 'grad_norm': 0.6401954293251038, 'learning_rate': 8.44343891402715e-06, 'epoch': 0.25}

  8%|▊         | 933/11049 [09:35<1:43:26,  1.63it/s]
  8%|▊         | 934/11049 [09:36<1:43:26,  1.63it/s]
                                                     
{'loss': 0.2737, 'grad_norm': 0.5902532339096069, 'learning_rate': 8.452488687782806e-06, 'epoch': 0.25}

  8%|▊         | 934/11049 [09:36<1:43:26,  1.63it/s]
  8%|▊         | 935/11049 [09:37<1:43:26,  1.63it/s]
                                                     
{'loss': 0.3129, 'grad_norm': 0.6711642742156982, 'learning_rate': 8.461538461538462e-06, 'epoch': 0.25}

  8%|▊         | 935/11049 [09:37<1:43:26,  1.63it/s]
  8%|▊         | 936/11049 [09:37<1:43:31,  1.63it/s]
                                                     
{'loss': 0.2979, 'grad_norm': 0.6051099300384521, 'learning_rate': 8.470588235294118e-06, 'epoch': 0.25}

  8%|▊         | 936/11049 [09:37<1:43:31,  1.63it/s]
  8%|▊         | 937/11049 [09:38<1:43:30,  1.63it/s]
                                                     
{'loss': 0.3479, 'grad_norm': 0.8080226182937622, 'learning_rate': 8.479638009049774e-06, 'epoch': 0.25}

  8%|▊         | 937/11049 [09:38<1:43:30,  1.63it/s]
  8%|▊         | 938/11049 [09:38<1:43:26,  1.63it/s]
                                                     
{'loss': 0.3689, 'grad_norm': 0.764648973941803, 'learning_rate': 8.48868778280543e-06, 'epoch': 0.25}

  8%|▊         | 938/11049 [09:39<1:43:26,  1.63it/s]
  8%|▊         | 939/11049 [09:39<1:43:23,  1.63it/s]
                                                     
{'loss': 0.3704, 'grad_norm': 0.7180910110473633, 'learning_rate': 8.497737556561087e-06, 'epoch': 0.25}

  8%|▊         | 939/11049 [09:39<1:43:23,  1.63it/s]
  9%|▊         | 940/11049 [09:40<1:43:27,  1.63it/s]
                                                     
{'loss': 0.4285, 'grad_norm': 0.6872262954711914, 'learning_rate': 8.506787330316743e-06, 'epoch': 0.26}

  9%|▊         | 940/11049 [09:40<1:43:27,  1.63it/s]
  9%|▊         | 941/11049 [09:40<1:43:25,  1.63it/s]
                                                     
{'loss': 0.3075, 'grad_norm': 0.6163449287414551, 'learning_rate': 8.515837104072399e-06, 'epoch': 0.26}

  9%|▊         | 941/11049 [09:40<1:43:25,  1.63it/s]
  9%|▊         | 942/11049 [09:41<1:43:22,  1.63it/s]
                                                     
{'loss': 0.3318, 'grad_norm': 0.592481791973114, 'learning_rate': 8.524886877828055e-06, 'epoch': 0.26}

  9%|▊         | 942/11049 [09:41<1:43:22,  1.63it/s]
  9%|▊         | 943/11049 [09:41<1:43:20,  1.63it/s]
                                                     
{'loss': 0.4021, 'grad_norm': 0.7274137735366821, 'learning_rate': 8.533936651583711e-06, 'epoch': 0.26}

  9%|▊         | 943/11049 [09:42<1:43:20,  1.63it/s]
  9%|▊         | 944/11049 [09:42<1:43:17,  1.63it/s]
                                                     
{'loss': 0.3495, 'grad_norm': 0.7579127550125122, 'learning_rate': 8.542986425339368e-06, 'epoch': 0.26}

  9%|▊         | 944/11049 [09:42<1:43:17,  1.63it/s]
  9%|▊         | 945/11049 [09:43<1:43:19,  1.63it/s]
                                                     
{'loss': 0.3988, 'grad_norm': 0.7317478060722351, 'learning_rate': 8.552036199095024e-06, 'epoch': 0.26}

  9%|▊         | 945/11049 [09:43<1:43:19,  1.63it/s]
  9%|▊         | 946/11049 [09:43<1:43:19,  1.63it/s]
                                                     
{'loss': 0.3681, 'grad_norm': 0.662551760673523, 'learning_rate': 8.561085972850678e-06, 'epoch': 0.26}

  9%|▊         | 946/11049 [09:43<1:43:19,  1.63it/s]
  9%|▊         | 947/11049 [09:44<1:43:16,  1.63it/s]
                                                     
{'loss': 0.3416, 'grad_norm': 0.7036562561988831, 'learning_rate': 8.570135746606334e-06, 'epoch': 0.26}

  9%|▊         | 947/11049 [09:44<1:43:16,  1.63it/s]
  9%|▊         | 948/11049 [09:45<1:43:15,  1.63it/s]
                                                     
{'loss': 0.3944, 'grad_norm': 0.8349830508232117, 'learning_rate': 8.57918552036199e-06, 'epoch': 0.26}

  9%|▊         | 948/11049 [09:45<1:43:15,  1.63it/s]
  9%|▊         | 949/11049 [09:45<1:43:14,  1.63it/s]
                                                     
{'loss': 0.3537, 'grad_norm': 0.5976478457450867, 'learning_rate': 8.588235294117647e-06, 'epoch': 0.26}

  9%|▊         | 949/11049 [09:45<1:43:14,  1.63it/s]
  9%|▊         | 950/11049 [09:46<1:43:15,  1.63it/s]
                                                     
{'loss': 0.5024, 'grad_norm': 0.8512236475944519, 'learning_rate': 8.597285067873304e-06, 'epoch': 0.26}

  9%|▊         | 950/11049 [09:46<1:43:15,  1.63it/s]
  9%|▊         | 951/11049 [09:46<1:43:15,  1.63it/s]
                                                     
{'loss': 0.4282, 'grad_norm': 0.8029907941818237, 'learning_rate': 8.60633484162896e-06, 'epoch': 0.26}

  9%|▊         | 951/11049 [09:46<1:43:15,  1.63it/s]
  9%|▊         | 952/11049 [09:47<1:43:14,  1.63it/s]
                                                     
{'loss': 0.4139, 'grad_norm': 0.7414638996124268, 'learning_rate': 8.615384615384617e-06, 'epoch': 0.26}

  9%|▊         | 952/11049 [09:47<1:43:14,  1.63it/s]
  9%|▊         | 953/11049 [09:48<1:43:12,  1.63it/s]
                                                     
{'loss': 0.315, 'grad_norm': 0.6555681824684143, 'learning_rate': 8.624434389140273e-06, 'epoch': 0.26}

  9%|▊         | 953/11049 [09:48<1:43:12,  1.63it/s]
  9%|▊         | 954/11049 [09:48<1:43:10,  1.63it/s]
                                                     
{'loss': 0.3223, 'grad_norm': 0.5961602926254272, 'learning_rate': 8.633484162895929e-06, 'epoch': 0.26}

  9%|▊         | 954/11049 [09:48<1:43:10,  1.63it/s]
  9%|▊         | 955/11049 [09:49<1:43:11,  1.63it/s]
                                                     
{'loss': 0.4272, 'grad_norm': 0.7963621616363525, 'learning_rate': 8.642533936651585e-06, 'epoch': 0.26}

  9%|▊         | 955/11049 [09:49<1:43:11,  1.63it/s]
  9%|▊         | 956/11049 [09:49<1:43:22,  1.63it/s]
                                                     
{'loss': 0.372, 'grad_norm': 0.7162472009658813, 'learning_rate': 8.651583710407241e-06, 'epoch': 0.26}

  9%|▊         | 956/11049 [09:50<1:43:22,  1.63it/s]
  9%|▊         | 957/11049 [09:50<1:43:16,  1.63it/s]
                                                     
{'loss': 0.3693, 'grad_norm': 0.6570107936859131, 'learning_rate': 8.660633484162898e-06, 'epoch': 0.26}

  9%|▊         | 957/11049 [09:50<1:43:16,  1.63it/s]
  9%|▊         | 958/11049 [09:51<1:43:15,  1.63it/s]
                                                     
{'loss': 0.3539, 'grad_norm': 0.6761870384216309, 'learning_rate': 8.669683257918554e-06, 'epoch': 0.26}

  9%|▊         | 958/11049 [09:51<1:43:15,  1.63it/s]
  9%|▊         | 959/11049 [09:51<1:43:14,  1.63it/s]
                                                     
{'loss': 0.3747, 'grad_norm': 0.7445845007896423, 'learning_rate': 8.67873303167421e-06, 'epoch': 0.26}

  9%|▊         | 959/11049 [09:51<1:43:14,  1.63it/s]
  9%|▊         | 960/11049 [09:52<1:43:12,  1.63it/s]
                                                     
{'loss': 0.352, 'grad_norm': 0.6600087881088257, 'learning_rate': 8.687782805429864e-06, 'epoch': 0.26}

  9%|▊         | 960/11049 [09:52<1:43:12,  1.63it/s]
  9%|▊         | 961/11049 [09:52<1:43:12,  1.63it/s]
                                                     
{'loss': 0.4064, 'grad_norm': 0.7318333387374878, 'learning_rate': 8.69683257918552e-06, 'epoch': 0.26}

  9%|▊         | 961/11049 [09:53<1:43:12,  1.63it/s]
  9%|▊         | 962/11049 [09:53<1:43:15,  1.63it/s]
                                                     
{'loss': 0.34, 'grad_norm': 0.7013589143753052, 'learning_rate': 8.705882352941177e-06, 'epoch': 0.26}

  9%|▊         | 962/11049 [09:53<1:43:15,  1.63it/s]
  9%|▊         | 963/11049 [09:54<1:43:13,  1.63it/s]
                                                     
{'loss': 0.333, 'grad_norm': 0.6356445550918579, 'learning_rate': 8.714932126696833e-06, 'epoch': 0.26}

  9%|▊         | 963/11049 [09:54<1:43:13,  1.63it/s]
  9%|▊         | 964/11049 [09:54<1:43:07,  1.63it/s]
                                                     
{'loss': 0.344, 'grad_norm': 0.676156222820282, 'learning_rate': 8.723981900452489e-06, 'epoch': 0.26}

  9%|▊         | 964/11049 [09:54<1:43:07,  1.63it/s]
  9%|▊         | 965/11049 [09:55<1:43:04,  1.63it/s]
                                                     
{'loss': 0.3531, 'grad_norm': 0.6762687563896179, 'learning_rate': 8.733031674208145e-06, 'epoch': 0.26}

  9%|▊         | 965/11049 [09:55<1:43:04,  1.63it/s]
  9%|▊         | 966/11049 [09:56<1:43:09,  1.63it/s]
                                                     
{'loss': 0.3636, 'grad_norm': 0.559674859046936, 'learning_rate': 8.742081447963801e-06, 'epoch': 0.26}

  9%|▊         | 966/11049 [09:56<1:43:09,  1.63it/s]
  9%|▉         | 967/11049 [09:56<1:43:05,  1.63it/s]
                                                     
{'loss': 0.3556, 'grad_norm': 0.6491990089416504, 'learning_rate': 8.751131221719458e-06, 'epoch': 0.26}

  9%|▉         | 967/11049 [09:56<1:43:05,  1.63it/s]
  9%|▉         | 968/11049 [09:57<1:43:06,  1.63it/s]
                                                     
{'loss': 0.5237, 'grad_norm': 0.7522391676902771, 'learning_rate': 8.760180995475114e-06, 'epoch': 0.26}

  9%|▉         | 968/11049 [09:57<1:43:06,  1.63it/s]
  9%|▉         | 969/11049 [09:57<1:43:03,  1.63it/s]
                                                     
{'loss': 0.3432, 'grad_norm': 0.5513051748275757, 'learning_rate': 8.76923076923077e-06, 'epoch': 0.26}

  9%|▉         | 969/11049 [09:58<1:43:03,  1.63it/s]
  9%|▉         | 970/11049 [09:58<1:43:24,  1.62it/s]
                                                     
{'loss': 0.3757, 'grad_norm': 0.7270303964614868, 'learning_rate': 8.778280542986426e-06, 'epoch': 0.26}

  9%|▉         | 970/11049 [09:58<1:43:24,  1.62it/s]
  9%|▉         | 971/11049 [09:59<1:43:19,  1.63it/s]
                                                     
{'loss': 0.3446, 'grad_norm': 0.6707302331924438, 'learning_rate': 8.787330316742082e-06, 'epoch': 0.26}

  9%|▉         | 971/11049 [09:59<1:43:19,  1.63it/s]
  9%|▉         | 972/11049 [09:59<1:43:13,  1.63it/s]
                                                     
{'loss': 0.3716, 'grad_norm': 0.7475958466529846, 'learning_rate': 8.796380090497738e-06, 'epoch': 0.26}

  9%|▉         | 972/11049 [09:59<1:43:13,  1.63it/s]
  9%|▉         | 973/11049 [10:00<1:43:07,  1.63it/s]
                                                     
{'loss': 0.3538, 'grad_norm': 0.666999340057373, 'learning_rate': 8.805429864253394e-06, 'epoch': 0.26}

  9%|▉         | 973/11049 [10:00<1:43:07,  1.63it/s]
  9%|▉         | 974/11049 [10:00<1:43:03,  1.63it/s]
                                                     
{'loss': 0.3551, 'grad_norm': 0.6890268325805664, 'learning_rate': 8.81447963800905e-06, 'epoch': 0.26}

  9%|▉         | 974/11049 [10:01<1:43:03,  1.63it/s]
  9%|▉         | 975/11049 [10:01<1:43:02,  1.63it/s]
                                                     
{'loss': 0.4641, 'grad_norm': 0.8101295828819275, 'learning_rate': 8.823529411764707e-06, 'epoch': 0.26}

  9%|▉         | 975/11049 [10:01<1:43:02,  1.63it/s]
  9%|▉         | 976/11049 [10:02<1:43:03,  1.63it/s]
                                                     
{'loss': 0.2666, 'grad_norm': 0.5383700728416443, 'learning_rate': 8.832579185520363e-06, 'epoch': 0.27}

  9%|▉         | 976/11049 [10:02<1:43:03,  1.63it/s]
  9%|▉         | 977/11049 [10:02<1:43:03,  1.63it/s]
                                                     
{'loss': 0.3082, 'grad_norm': 0.7889311909675598, 'learning_rate': 8.841628959276019e-06, 'epoch': 0.27}

  9%|▉         | 977/11049 [10:02<1:43:03,  1.63it/s]
  9%|▉         | 978/11049 [10:03<1:43:02,  1.63it/s]
                                                     
{'loss': 0.3353, 'grad_norm': 0.5932492613792419, 'learning_rate': 8.850678733031675e-06, 'epoch': 0.27}

  9%|▉         | 978/11049 [10:03<1:43:02,  1.63it/s]
  9%|▉         | 979/11049 [10:04<1:43:00,  1.63it/s]
                                                     
{'loss': 0.4022, 'grad_norm': 0.6864941716194153, 'learning_rate': 8.859728506787331e-06, 'epoch': 0.27}

  9%|▉         | 979/11049 [10:04<1:43:00,  1.63it/s]
  9%|▉         | 980/11049 [10:04<1:43:01,  1.63it/s]
                                                     
{'loss': 0.3154, 'grad_norm': 0.5962185263633728, 'learning_rate': 8.868778280542986e-06, 'epoch': 0.27}

  9%|▉         | 980/11049 [10:04<1:43:01,  1.63it/s]
  9%|▉         | 981/11049 [10:05<1:43:01,  1.63it/s]
                                                     
{'loss': 0.2532, 'grad_norm': 0.5799915790557861, 'learning_rate': 8.877828054298642e-06, 'epoch': 0.27}

  9%|▉         | 981/11049 [10:05<1:43:01,  1.63it/s]
  9%|▉         | 982/11049 [10:05<1:43:00,  1.63it/s]
                                                     
{'loss': 0.3389, 'grad_norm': 0.700164258480072, 'learning_rate': 8.886877828054298e-06, 'epoch': 0.27}

  9%|▉         | 982/11049 [10:06<1:43:00,  1.63it/s]
  9%|▉         | 983/11049 [10:06<1:43:00,  1.63it/s]
                                                     
{'loss': 0.4413, 'grad_norm': 0.8061731457710266, 'learning_rate': 8.895927601809954e-06, 'epoch': 0.27}

  9%|▉         | 983/11049 [10:06<1:43:00,  1.63it/s]
  9%|▉         | 984/11049 [10:07<1:42:57,  1.63it/s]
                                                     
{'loss': 0.3784, 'grad_norm': 0.6666973829269409, 'learning_rate': 8.90497737556561e-06, 'epoch': 0.27}

  9%|▉         | 984/11049 [10:07<1:42:57,  1.63it/s]
  9%|▉         | 985/11049 [10:07<1:52:01,  1.50it/s]
                                                     
{'loss': 0.3114, 'grad_norm': 0.6540750861167908, 'learning_rate': 8.914027149321268e-06, 'epoch': 0.27}

  9%|▉         | 985/11049 [10:08<1:52:01,  1.50it/s]
  9%|▉         | 986/11049 [10:08<1:49:13,  1.54it/s]
                                                     
{'loss': 0.2811, 'grad_norm': 0.574921727180481, 'learning_rate': 8.923076923076925e-06, 'epoch': 0.27}

  9%|▉         | 986/11049 [10:08<1:49:13,  1.54it/s]
  9%|▉         | 987/11049 [10:09<1:47:17,  1.56it/s]
                                                     
{'loss': 0.3944, 'grad_norm': 0.8508642911911011, 'learning_rate': 8.93212669683258e-06, 'epoch': 0.27}

  9%|▉         | 987/11049 [10:09<1:47:17,  1.56it/s]
  9%|▉         | 988/11049 [10:09<1:45:56,  1.58it/s]
                                                     
{'loss': 0.2732, 'grad_norm': 0.6074817776679993, 'learning_rate': 8.941176470588237e-06, 'epoch': 0.27}

  9%|▉         | 988/11049 [10:09<1:45:56,  1.58it/s]
  9%|▉         | 989/11049 [10:10<1:45:00,  1.60it/s]
                                                     
{'loss': 0.4021, 'grad_norm': 0.6689063906669617, 'learning_rate': 8.950226244343893e-06, 'epoch': 0.27}

  9%|▉         | 989/11049 [10:10<1:45:00,  1.60it/s]
  9%|▉         | 990/11049 [10:10<1:44:20,  1.61it/s]
                                                     
{'loss': 0.3368, 'grad_norm': 0.7323232293128967, 'learning_rate': 8.95927601809955e-06, 'epoch': 0.27}

  9%|▉         | 990/11049 [10:11<1:44:20,  1.61it/s]
  9%|▉         | 991/11049 [10:11<1:43:54,  1.61it/s]
                                                     
{'loss': 0.2817, 'grad_norm': 0.585072934627533, 'learning_rate': 8.968325791855205e-06, 'epoch': 0.27}

  9%|▉         | 991/11049 [10:11<1:43:54,  1.61it/s]
  9%|▉         | 992/11049 [10:12<1:43:32,  1.62it/s]
                                                     
{'loss': 0.4032, 'grad_norm': 0.7057331800460815, 'learning_rate': 8.977375565610862e-06, 'epoch': 0.27}

  9%|▉         | 992/11049 [10:12<1:43:32,  1.62it/s]
  9%|▉         | 993/11049 [10:12<1:43:19,  1.62it/s]
                                                     
{'loss': 0.3515, 'grad_norm': 0.72950679063797, 'learning_rate': 8.986425339366518e-06, 'epoch': 0.27}

  9%|▉         | 993/11049 [10:12<1:43:19,  1.62it/s]
  9%|▉         | 994/11049 [10:13<1:43:11,  1.62it/s]
                                                     
{'loss': 0.3451, 'grad_norm': 0.6062607765197754, 'learning_rate': 8.995475113122172e-06, 'epoch': 0.27}

  9%|▉         | 994/11049 [10:13<1:43:11,  1.62it/s]
  9%|▉         | 995/11049 [10:14<1:43:01,  1.63it/s]
                                                     
{'loss': 0.3567, 'grad_norm': 0.6881667971611023, 'learning_rate': 9.004524886877828e-06, 'epoch': 0.27}

  9%|▉         | 995/11049 [10:14<1:43:01,  1.63it/s]
  9%|▉         | 996/11049 [10:14<1:42:59,  1.63it/s]
                                                     
{'loss': 0.3075, 'grad_norm': 0.5863509178161621, 'learning_rate': 9.013574660633484e-06, 'epoch': 0.27}

  9%|▉         | 996/11049 [10:14<1:42:59,  1.63it/s]
  9%|▉         | 997/11049 [10:15<1:42:54,  1.63it/s]
                                                     
{'loss': 0.3116, 'grad_norm': 0.5879639983177185, 'learning_rate': 9.02262443438914e-06, 'epoch': 0.27}

  9%|▉         | 997/11049 [10:15<1:42:54,  1.63it/s]
  9%|▉         | 998/11049 [10:15<1:42:48,  1.63it/s]
                                                     
{'loss': 0.3565, 'grad_norm': 0.7107070088386536, 'learning_rate': 9.031674208144797e-06, 'epoch': 0.27}

  9%|▉         | 998/11049 [10:16<1:42:48,  1.63it/s]
  9%|▉         | 999/11049 [10:16<1:42:48,  1.63it/s]
                                                     
{'loss': 0.3454, 'grad_norm': 0.6686956882476807, 'learning_rate': 9.040723981900453e-06, 'epoch': 0.27}

  9%|▉         | 999/11049 [10:16<1:42:48,  1.63it/s]
  9%|▉         | 1000/11049 [10:17<1:42:45,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.7039129734039307, 'learning_rate': 9.049773755656109e-06, 'epoch': 0.27}

  9%|▉         | 1000/11049 [10:17<1:42:45,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.35it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.7891575694084167, 'eval_runtime': 1.9531, 'eval_samples_per_second': 102.402, 'eval_steps_per_second': 6.656, 'epoch': 0.27}

  9%|▉         | 1000/11049 [10:19<1:42:45,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
  9%|▉         | 1001/11049 [10:19<3:21:09,  1.20s/it]
                                                      
{'loss': 0.313, 'grad_norm': 0.5810621380805969, 'learning_rate': 9.058823529411765e-06, 'epoch': 0.27}

  9%|▉         | 1001/11049 [10:19<3:21:09,  1.20s/it]
  9%|▉         | 1002/11049 [10:20<2:51:38,  1.03s/it]
                                                      
{'loss': 0.3408, 'grad_norm': 0.6646644473075867, 'learning_rate': 9.067873303167421e-06, 'epoch': 0.27}

  9%|▉         | 1002/11049 [10:20<2:51:38,  1.03s/it]
  9%|▉         | 1003/11049 [10:20<2:30:56,  1.11it/s]
                                                      
{'loss': 0.4385, 'grad_norm': 0.7083856463432312, 'learning_rate': 9.076923076923078e-06, 'epoch': 0.27}

  9%|▉         | 1003/11049 [10:21<2:30:56,  1.11it/s]
  9%|▉         | 1004/11049 [10:21<2:16:26,  1.23it/s]
                                                      
{'loss': 0.3447, 'grad_norm': 0.7188582420349121, 'learning_rate': 9.085972850678734e-06, 'epoch': 0.27}

  9%|▉         | 1004/11049 [10:21<2:16:26,  1.23it/s]
  9%|▉         | 1005/11049 [10:22<2:06:17,  1.33it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.7158611416816711, 'learning_rate': 9.09502262443439e-06, 'epoch': 0.27}

  9%|▉         | 1005/11049 [10:22<2:06:17,  1.33it/s]
  9%|▉         | 1006/11049 [10:22<1:59:11,  1.40it/s]
                                                      
{'loss': 0.3258, 'grad_norm': 0.6329540610313416, 'learning_rate': 9.104072398190046e-06, 'epoch': 0.27}

  9%|▉         | 1006/11049 [10:22<1:59:11,  1.40it/s]
  9%|▉         | 1007/11049 [10:23<1:54:14,  1.47it/s]
                                                      
{'loss': 0.2993, 'grad_norm': 0.5673093199729919, 'learning_rate': 9.113122171945702e-06, 'epoch': 0.27}

  9%|▉         | 1007/11049 [10:23<1:54:14,  1.47it/s]
  9%|▉         | 1008/11049 [10:23<1:50:49,  1.51it/s]
                                                      
{'loss': 0.2668, 'grad_norm': 0.5190349817276001, 'learning_rate': 9.122171945701358e-06, 'epoch': 0.27}

  9%|▉         | 1008/11049 [10:24<1:50:49,  1.51it/s]
  9%|▉         | 1009/11049 [10:24<1:48:19,  1.54it/s]
                                                      
{'loss': 0.3417, 'grad_norm': 0.7251651287078857, 'learning_rate': 9.131221719457015e-06, 'epoch': 0.27}

  9%|▉         | 1009/11049 [10:24<1:48:19,  1.54it/s]
  9%|▉         | 1010/11049 [10:25<1:46:34,  1.57it/s]
                                                      
{'loss': 0.3147, 'grad_norm': 0.6166060566902161, 'learning_rate': 9.14027149321267e-06, 'epoch': 0.27}

  9%|▉         | 1010/11049 [10:25<1:46:34,  1.57it/s]
  9%|▉         | 1011/11049 [10:25<1:45:40,  1.58it/s]
                                                      
{'loss': 0.2706, 'grad_norm': 0.6189326047897339, 'learning_rate': 9.149321266968327e-06, 'epoch': 0.27}

  9%|▉         | 1011/11049 [10:25<1:45:40,  1.58it/s]
  9%|▉         | 1012/11049 [10:26<1:44:56,  1.59it/s]
                                                      
{'loss': 0.288, 'grad_norm': 0.6552272439002991, 'learning_rate': 9.158371040723983e-06, 'epoch': 0.27}

  9%|▉         | 1012/11049 [10:26<1:44:56,  1.59it/s]
  9%|▉         | 1013/11049 [10:27<1:44:13,  1.60it/s]
                                                      
{'loss': 0.3511, 'grad_norm': 0.7203536033630371, 'learning_rate': 9.16742081447964e-06, 'epoch': 0.28}

  9%|▉         | 1013/11049 [10:27<1:44:13,  1.60it/s]
  9%|▉         | 1014/11049 [10:27<1:43:43,  1.61it/s]
                                                      
{'loss': 0.3699, 'grad_norm': 0.7552691698074341, 'learning_rate': 9.176470588235294e-06, 'epoch': 0.28}

  9%|▉         | 1014/11049 [10:27<1:43:43,  1.61it/s]
  9%|▉         | 1015/11049 [10:28<1:43:26,  1.62it/s]
                                                      
{'loss': 0.3547, 'grad_norm': 0.7099367380142212, 'learning_rate': 9.18552036199095e-06, 'epoch': 0.28}

  9%|▉         | 1015/11049 [10:28<1:43:26,  1.62it/s]
  9%|▉         | 1016/11049 [10:28<1:43:18,  1.62it/s]
                                                      
{'loss': 0.4181, 'grad_norm': 0.7075774669647217, 'learning_rate': 9.194570135746606e-06, 'epoch': 0.28}

  9%|▉         | 1016/11049 [10:29<1:43:18,  1.62it/s]
  9%|▉         | 1017/11049 [10:29<1:43:04,  1.62it/s]
                                                      
{'loss': 0.3588, 'grad_norm': 0.804790198802948, 'learning_rate': 9.203619909502262e-06, 'epoch': 0.28}

  9%|▉         | 1017/11049 [10:29<1:43:04,  1.62it/s]
  9%|▉         | 1018/11049 [10:30<1:42:54,  1.62it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.6732577681541443, 'learning_rate': 9.212669683257918e-06, 'epoch': 0.28}

  9%|▉         | 1018/11049 [10:30<1:42:54,  1.62it/s]
  9%|▉         | 1019/11049 [10:30<1:42:48,  1.63it/s]
                                                      
{'loss': 0.3868, 'grad_norm': 0.7265573740005493, 'learning_rate': 9.221719457013576e-06, 'epoch': 0.28}

  9%|▉         | 1019/11049 [10:30<1:42:48,  1.63it/s]
  9%|▉         | 1020/11049 [10:31<1:42:50,  1.63it/s]
                                                      
{'loss': 0.3263, 'grad_norm': 0.788175106048584, 'learning_rate': 9.230769230769232e-06, 'epoch': 0.28}

  9%|▉         | 1020/11049 [10:31<1:42:50,  1.63it/s]
  9%|▉         | 1021/11049 [10:31<1:42:49,  1.63it/s]
                                                      
{'loss': 0.3237, 'grad_norm': 0.6234728097915649, 'learning_rate': 9.239819004524888e-06, 'epoch': 0.28}

  9%|▉         | 1021/11049 [10:32<1:42:49,  1.63it/s]
  9%|▉         | 1022/11049 [10:32<1:42:40,  1.63it/s]
                                                      
{'loss': 0.3276, 'grad_norm': 0.6861841082572937, 'learning_rate': 9.248868778280545e-06, 'epoch': 0.28}

  9%|▉         | 1022/11049 [10:32<1:42:40,  1.63it/s]
  9%|▉         | 1023/11049 [10:33<1:42:36,  1.63it/s]
                                                      
{'loss': 0.3663, 'grad_norm': 0.6891741752624512, 'learning_rate': 9.2579185520362e-06, 'epoch': 0.28}

  9%|▉         | 1023/11049 [10:33<1:42:36,  1.63it/s]
  9%|▉         | 1024/11049 [10:33<1:42:31,  1.63it/s]
                                                      
{'loss': 0.309, 'grad_norm': 0.7487739324569702, 'learning_rate': 9.266968325791857e-06, 'epoch': 0.28}

  9%|▉         | 1024/11049 [10:33<1:42:31,  1.63it/s]
  9%|▉         | 1025/11049 [10:34<1:42:39,  1.63it/s]
                                                      
{'loss': 0.3368, 'grad_norm': 0.6037783026695251, 'learning_rate': 9.276018099547513e-06, 'epoch': 0.28}

  9%|▉         | 1025/11049 [10:34<1:42:39,  1.63it/s]
  9%|▉         | 1026/11049 [10:35<1:42:40,  1.63it/s]
                                                      
{'loss': 0.3939, 'grad_norm': 0.6570254564285278, 'learning_rate': 9.28506787330317e-06, 'epoch': 0.28}

  9%|▉         | 1026/11049 [10:35<1:42:40,  1.63it/s]
  9%|▉         | 1027/11049 [10:35<1:42:34,  1.63it/s]
                                                      
{'loss': 0.326, 'grad_norm': 0.6382942795753479, 'learning_rate': 9.294117647058824e-06, 'epoch': 0.28}

  9%|▉         | 1027/11049 [10:35<1:42:34,  1.63it/s]
  9%|▉         | 1028/11049 [10:36<1:42:36,  1.63it/s]
                                                      
{'loss': 0.3534, 'grad_norm': 0.6875911355018616, 'learning_rate': 9.30316742081448e-06, 'epoch': 0.28}

  9%|▉         | 1028/11049 [10:36<1:42:36,  1.63it/s]
  9%|▉         | 1029/11049 [10:36<1:42:32,  1.63it/s]
                                                      
{'loss': 0.3264, 'grad_norm': 0.6585596799850464, 'learning_rate': 9.312217194570136e-06, 'epoch': 0.28}

  9%|▉         | 1029/11049 [10:37<1:42:32,  1.63it/s]
  9%|▉         | 1030/11049 [10:37<1:42:36,  1.63it/s]
                                                      
{'loss': 0.3066, 'grad_norm': 0.6711781620979309, 'learning_rate': 9.321266968325792e-06, 'epoch': 0.28}

  9%|▉         | 1030/11049 [10:37<1:42:36,  1.63it/s]
  9%|▉         | 1031/11049 [10:38<1:42:33,  1.63it/s]
                                                      
{'loss': 0.3254, 'grad_norm': 0.5571070909500122, 'learning_rate': 9.330316742081448e-06, 'epoch': 0.28}

  9%|▉         | 1031/11049 [10:38<1:42:33,  1.63it/s]
  9%|▉         | 1032/11049 [10:38<1:42:34,  1.63it/s]
                                                      
{'loss': 0.3448, 'grad_norm': 0.5760059356689453, 'learning_rate': 9.339366515837105e-06, 'epoch': 0.28}

  9%|▉         | 1032/11049 [10:38<1:42:34,  1.63it/s]
  9%|▉         | 1033/11049 [10:39<1:42:29,  1.63it/s]
                                                      
{'loss': 0.3693, 'grad_norm': 0.6410621404647827, 'learning_rate': 9.34841628959276e-06, 'epoch': 0.28}

  9%|▉         | 1033/11049 [10:39<1:42:29,  1.63it/s]
  9%|▉         | 1034/11049 [10:39<1:42:24,  1.63it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.5965511798858643, 'learning_rate': 9.357466063348417e-06, 'epoch': 0.28}

  9%|▉         | 1034/11049 [10:40<1:42:24,  1.63it/s]
  9%|▉         | 1035/11049 [10:40<1:42:35,  1.63it/s]
                                                      
{'loss': 0.404, 'grad_norm': 0.7577148675918579, 'learning_rate': 9.366515837104073e-06, 'epoch': 0.28}

  9%|▉         | 1035/11049 [10:40<1:42:35,  1.63it/s]
  9%|▉         | 1036/11049 [10:41<1:42:26,  1.63it/s]
                                                      
{'loss': 0.3544, 'grad_norm': 0.7494600415229797, 'learning_rate': 9.37556561085973e-06, 'epoch': 0.28}

  9%|▉         | 1036/11049 [10:41<1:42:26,  1.63it/s]
  9%|▉         | 1037/11049 [10:41<1:42:25,  1.63it/s]
                                                      
{'loss': 0.3344, 'grad_norm': 0.6317049264907837, 'learning_rate': 9.384615384615385e-06, 'epoch': 0.28}

  9%|▉         | 1037/11049 [10:41<1:42:25,  1.63it/s]
  9%|▉         | 1038/11049 [10:42<1:42:24,  1.63it/s]
                                                      
{'loss': 0.3408, 'grad_norm': 0.6740336418151855, 'learning_rate': 9.393665158371041e-06, 'epoch': 0.28}

  9%|▉         | 1038/11049 [10:42<1:42:24,  1.63it/s]
  9%|▉         | 1039/11049 [10:43<1:42:21,  1.63it/s]
                                                      
{'loss': 0.4041, 'grad_norm': 0.685781717300415, 'learning_rate': 9.402714932126698e-06, 'epoch': 0.28}

  9%|▉         | 1039/11049 [10:43<1:42:21,  1.63it/s]
  9%|▉         | 1040/11049 [10:43<1:42:26,  1.63it/s]
                                                      
{'loss': 0.253, 'grad_norm': 0.739481508731842, 'learning_rate': 9.411764705882354e-06, 'epoch': 0.28}

  9%|▉         | 1040/11049 [10:43<1:42:26,  1.63it/s]
  9%|▉         | 1041/11049 [10:44<1:42:23,  1.63it/s]
                                                      
{'loss': 0.3779, 'grad_norm': 0.6381948590278625, 'learning_rate': 9.42081447963801e-06, 'epoch': 0.28}

  9%|▉         | 1041/11049 [10:44<1:42:23,  1.63it/s]
  9%|▉         | 1042/11049 [10:44<1:42:19,  1.63it/s]
                                                      
{'loss': 0.3031, 'grad_norm': 0.634415328502655, 'learning_rate': 9.429864253393666e-06, 'epoch': 0.28}

  9%|▉         | 1042/11049 [10:44<1:42:19,  1.63it/s]
  9%|▉         | 1043/11049 [10:45<1:42:18,  1.63it/s]
                                                      
{'loss': 0.3057, 'grad_norm': 0.7387532591819763, 'learning_rate': 9.438914027149322e-06, 'epoch': 0.28}

  9%|▉         | 1043/11049 [10:45<1:42:18,  1.63it/s]
  9%|▉         | 1044/11049 [10:46<1:42:21,  1.63it/s]
                                                      
{'loss': 0.3614, 'grad_norm': 0.597099781036377, 'learning_rate': 9.447963800904978e-06, 'epoch': 0.28}

  9%|▉         | 1044/11049 [10:46<1:42:21,  1.63it/s]
  9%|▉         | 1045/11049 [10:46<1:42:26,  1.63it/s]
                                                      
{'loss': 0.3004, 'grad_norm': 0.757326602935791, 'learning_rate': 9.457013574660635e-06, 'epoch': 0.28}

  9%|▉         | 1045/11049 [10:46<1:42:26,  1.63it/s]
  9%|▉         | 1046/11049 [10:47<1:42:21,  1.63it/s]
                                                      
{'loss': 0.3771, 'grad_norm': 0.6550952792167664, 'learning_rate': 9.46606334841629e-06, 'epoch': 0.28}

  9%|▉         | 1046/11049 [10:47<1:42:21,  1.63it/s]
  9%|▉         | 1047/11049 [10:47<1:42:20,  1.63it/s]
                                                      
{'loss': 0.4329, 'grad_norm': 0.6793117523193359, 'learning_rate': 9.475113122171947e-06, 'epoch': 0.28}

  9%|▉         | 1047/11049 [10:48<1:42:20,  1.63it/s]
  9%|▉         | 1048/11049 [10:48<1:42:16,  1.63it/s]
                                                      
{'loss': 0.3402, 'grad_norm': 0.7795924544334412, 'learning_rate': 9.484162895927601e-06, 'epoch': 0.28}

  9%|▉         | 1048/11049 [10:48<1:42:16,  1.63it/s]
  9%|▉         | 1049/11049 [10:49<1:42:12,  1.63it/s]
                                                      
{'loss': 0.3188, 'grad_norm': 0.6379607915878296, 'learning_rate': 9.493212669683258e-06, 'epoch': 0.28}

  9%|▉         | 1049/11049 [10:49<1:42:12,  1.63it/s]
 10%|▉         | 1050/11049 [10:49<1:42:17,  1.63it/s]
                                                      
{'loss': 0.265, 'grad_norm': 0.6253644824028015, 'learning_rate': 9.502262443438914e-06, 'epoch': 0.29}

 10%|▉         | 1050/11049 [10:49<1:42:17,  1.63it/s]
 10%|▉         | 1051/11049 [10:50<1:42:16,  1.63it/s]
                                                      
{'loss': 0.2954, 'grad_norm': 0.5942063927650452, 'learning_rate': 9.51131221719457e-06, 'epoch': 0.29}

 10%|▉         | 1051/11049 [10:50<1:42:16,  1.63it/s]
 10%|▉         | 1052/11049 [10:50<1:42:14,  1.63it/s]
                                                      
{'loss': 0.3486, 'grad_norm': 0.6496803760528564, 'learning_rate': 9.520361990950226e-06, 'epoch': 0.29}

 10%|▉         | 1052/11049 [10:51<1:42:14,  1.63it/s]
 10%|▉         | 1053/11049 [10:51<1:42:15,  1.63it/s]
                                                      
{'loss': 0.2767, 'grad_norm': 0.5512323975563049, 'learning_rate': 9.529411764705882e-06, 'epoch': 0.29}

 10%|▉         | 1053/11049 [10:51<1:42:15,  1.63it/s]
 10%|▉         | 1054/11049 [10:52<1:42:13,  1.63it/s]
                                                      
{'loss': 0.3686, 'grad_norm': 0.7044991254806519, 'learning_rate': 9.53846153846154e-06, 'epoch': 0.29}

 10%|▉         | 1054/11049 [10:52<1:42:13,  1.63it/s]
 10%|▉         | 1055/11049 [10:52<1:42:14,  1.63it/s]
                                                      
{'loss': 0.2753, 'grad_norm': 0.5836891531944275, 'learning_rate': 9.547511312217196e-06, 'epoch': 0.29}

 10%|▉         | 1055/11049 [10:52<1:42:14,  1.63it/s]
 10%|▉         | 1056/11049 [10:53<1:42:11,  1.63it/s]
                                                      
{'loss': 0.307, 'grad_norm': 0.6200211048126221, 'learning_rate': 9.556561085972852e-06, 'epoch': 0.29}

 10%|▉         | 1056/11049 [10:53<1:42:11,  1.63it/s]
 10%|▉         | 1057/11049 [10:54<1:42:10,  1.63it/s]
                                                      
{'loss': 0.3249, 'grad_norm': 0.736257791519165, 'learning_rate': 9.565610859728509e-06, 'epoch': 0.29}

 10%|▉         | 1057/11049 [10:54<1:42:10,  1.63it/s]
 10%|▉         | 1058/11049 [10:54<1:42:10,  1.63it/s]
                                                      
{'loss': 0.3538, 'grad_norm': 0.6808784008026123, 'learning_rate': 9.574660633484165e-06, 'epoch': 0.29}

 10%|▉         | 1058/11049 [10:54<1:42:10,  1.63it/s]
 10%|▉         | 1059/11049 [10:55<1:42:17,  1.63it/s]
                                                      
{'loss': 0.3453, 'grad_norm': 0.615754246711731, 'learning_rate': 9.583710407239821e-06, 'epoch': 0.29}

 10%|▉         | 1059/11049 [10:55<1:42:17,  1.63it/s]
 10%|▉         | 1060/11049 [10:55<1:42:20,  1.63it/s]
                                                      
{'loss': 0.2995, 'grad_norm': 0.6762872934341431, 'learning_rate': 9.592760180995477e-06, 'epoch': 0.29}

 10%|▉         | 1060/11049 [10:56<1:42:20,  1.63it/s]
 10%|▉         | 1061/11049 [10:56<1:42:19,  1.63it/s]
                                                      
{'loss': 0.3686, 'grad_norm': 0.7118551731109619, 'learning_rate': 9.601809954751131e-06, 'epoch': 0.29}

 10%|▉         | 1061/11049 [10:56<1:42:19,  1.63it/s]
 10%|▉         | 1062/11049 [10:57<1:42:38,  1.62it/s]
                                                      
{'loss': 0.2848, 'grad_norm': 0.6116538643836975, 'learning_rate': 9.610859728506788e-06, 'epoch': 0.29}

 10%|▉         | 1062/11049 [10:57<1:42:38,  1.62it/s]
 10%|▉         | 1063/11049 [10:57<1:42:27,  1.62it/s]
                                                      
{'loss': 0.2882, 'grad_norm': 0.6302045583724976, 'learning_rate': 9.619909502262444e-06, 'epoch': 0.29}

 10%|▉         | 1063/11049 [10:57<1:42:27,  1.62it/s]
 10%|▉         | 1064/11049 [10:58<1:42:18,  1.63it/s]
                                                      
{'loss': 0.3978, 'grad_norm': 0.7349503636360168, 'learning_rate': 9.6289592760181e-06, 'epoch': 0.29}

 10%|▉         | 1064/11049 [10:58<1:42:18,  1.63it/s]
 10%|▉         | 1065/11049 [10:58<1:42:17,  1.63it/s]
                                                      
{'loss': 0.3422, 'grad_norm': 0.7367602586746216, 'learning_rate': 9.638009049773756e-06, 'epoch': 0.29}

 10%|▉         | 1065/11049 [10:59<1:42:17,  1.63it/s]
 10%|▉         | 1066/11049 [10:59<1:42:12,  1.63it/s]
                                                      
{'loss': 0.3282, 'grad_norm': 0.7212531566619873, 'learning_rate': 9.647058823529412e-06, 'epoch': 0.29}

 10%|▉         | 1066/11049 [10:59<1:42:12,  1.63it/s]
 10%|▉         | 1067/11049 [11:00<1:42:10,  1.63it/s]
                                                      
{'loss': 0.3178, 'grad_norm': 0.6796283721923828, 'learning_rate': 9.656108597285068e-06, 'epoch': 0.29}

 10%|▉         | 1067/11049 [11:00<1:42:10,  1.63it/s]
 10%|▉         | 1068/11049 [11:00<1:42:05,  1.63it/s]
                                                      
{'loss': 0.3466, 'grad_norm': 0.6126070022583008, 'learning_rate': 9.665158371040725e-06, 'epoch': 0.29}

 10%|▉         | 1068/11049 [11:00<1:42:05,  1.63it/s]
 10%|▉         | 1069/11049 [11:01<1:42:02,  1.63it/s]
                                                      
{'loss': 0.2868, 'grad_norm': 0.6293426752090454, 'learning_rate': 9.67420814479638e-06, 'epoch': 0.29}

 10%|▉         | 1069/11049 [11:01<1:42:02,  1.63it/s]
 10%|▉         | 1070/11049 [11:02<1:42:00,  1.63it/s]
                                                      
{'loss': 0.3094, 'grad_norm': 0.7101432085037231, 'learning_rate': 9.683257918552037e-06, 'epoch': 0.29}

 10%|▉         | 1070/11049 [11:02<1:42:00,  1.63it/s]
 10%|▉         | 1071/11049 [11:02<1:42:01,  1.63it/s]
                                                      
{'loss': 0.3458, 'grad_norm': 0.7338792085647583, 'learning_rate': 9.692307692307693e-06, 'epoch': 0.29}

 10%|▉         | 1071/11049 [11:02<1:42:01,  1.63it/s]
 10%|▉         | 1072/11049 [11:03<1:41:57,  1.63it/s]
                                                      
{'loss': 0.3385, 'grad_norm': 0.641067385673523, 'learning_rate': 9.70135746606335e-06, 'epoch': 0.29}

 10%|▉         | 1072/11049 [11:03<1:41:57,  1.63it/s]
 10%|▉         | 1073/11049 [11:03<1:44:50,  1.59it/s]
                                                      
{'loss': 0.3954, 'grad_norm': 0.695828378200531, 'learning_rate': 9.710407239819005e-06, 'epoch': 0.29}

 10%|▉         | 1073/11049 [11:04<1:44:50,  1.59it/s]
 10%|▉         | 1074/11049 [11:04<1:44:22,  1.59it/s]
                                                      
{'loss': 0.3239, 'grad_norm': 0.6341031193733215, 'learning_rate': 9.719457013574662e-06, 'epoch': 0.29}

 10%|▉         | 1074/11049 [11:04<1:44:22,  1.59it/s]
 10%|▉         | 1075/11049 [11:05<1:43:49,  1.60it/s]
                                                      
{'loss': 0.3146, 'grad_norm': 0.6972061395645142, 'learning_rate': 9.728506787330318e-06, 'epoch': 0.29}

 10%|▉         | 1075/11049 [11:05<1:43:49,  1.60it/s]
 10%|▉         | 1076/11049 [11:05<1:43:24,  1.61it/s]
                                                      
{'loss': 0.3495, 'grad_norm': 0.6386586427688599, 'learning_rate': 9.737556561085974e-06, 'epoch': 0.29}

 10%|▉         | 1076/11049 [11:05<1:43:24,  1.61it/s]
 10%|▉         | 1077/11049 [11:06<1:42:58,  1.61it/s]
                                                      
{'loss': 0.3619, 'grad_norm': 0.6716954708099365, 'learning_rate': 9.74660633484163e-06, 'epoch': 0.29}

 10%|▉         | 1077/11049 [11:06<1:42:58,  1.61it/s]
 10%|▉         | 1078/11049 [11:07<1:42:37,  1.62it/s]
                                                      
{'loss': 0.3159, 'grad_norm': 0.6826634407043457, 'learning_rate': 9.755656108597286e-06, 'epoch': 0.29}

 10%|▉         | 1078/11049 [11:07<1:42:37,  1.62it/s]
 10%|▉         | 1079/11049 [11:07<1:42:21,  1.62it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.6055260896682739, 'learning_rate': 9.764705882352942e-06, 'epoch': 0.29}

 10%|▉         | 1079/11049 [11:07<1:42:21,  1.62it/s]
 10%|▉         | 1080/11049 [11:08<1:42:23,  1.62it/s]
                                                      
{'loss': 0.2884, 'grad_norm': 0.7761950492858887, 'learning_rate': 9.773755656108599e-06, 'epoch': 0.29}

 10%|▉         | 1080/11049 [11:08<1:42:23,  1.62it/s]
 10%|▉         | 1081/11049 [11:08<1:42:18,  1.62it/s]
                                                      
{'loss': 0.3636, 'grad_norm': 0.6295874714851379, 'learning_rate': 9.782805429864255e-06, 'epoch': 0.29}

 10%|▉         | 1081/11049 [11:08<1:42:18,  1.62it/s]
 10%|▉         | 1082/11049 [11:09<1:42:09,  1.63it/s]
                                                      
{'loss': 0.322, 'grad_norm': 0.725334882736206, 'learning_rate': 9.791855203619909e-06, 'epoch': 0.29}

 10%|▉         | 1082/11049 [11:09<1:42:09,  1.63it/s]
 10%|▉         | 1083/11049 [11:10<1:42:06,  1.63it/s]
                                                      
{'loss': 0.3058, 'grad_norm': 0.6714178323745728, 'learning_rate': 9.800904977375565e-06, 'epoch': 0.29}

 10%|▉         | 1083/11049 [11:10<1:42:06,  1.63it/s]
 10%|▉         | 1084/11049 [11:10<1:42:05,  1.63it/s]
                                                      
{'loss': 0.3189, 'grad_norm': 0.6314918398857117, 'learning_rate': 9.809954751131221e-06, 'epoch': 0.29}

 10%|▉         | 1084/11049 [11:10<1:42:05,  1.63it/s]
 10%|▉         | 1085/11049 [11:11<1:42:06,  1.63it/s]
                                                      
{'loss': 0.2925, 'grad_norm': 0.611764669418335, 'learning_rate': 9.819004524886878e-06, 'epoch': 0.29}

 10%|▉         | 1085/11049 [11:11<1:42:06,  1.63it/s]
 10%|▉         | 1086/11049 [11:11<1:41:59,  1.63it/s]
                                                      
{'loss': 0.3397, 'grad_norm': 0.683882474899292, 'learning_rate': 9.828054298642534e-06, 'epoch': 0.29}

 10%|▉         | 1086/11049 [11:12<1:41:59,  1.63it/s]
 10%|▉         | 1087/11049 [11:12<1:41:56,  1.63it/s]
                                                      
{'loss': 0.4136, 'grad_norm': 0.686366856098175, 'learning_rate': 9.83710407239819e-06, 'epoch': 0.3}

 10%|▉         | 1087/11049 [11:12<1:41:56,  1.63it/s]
 10%|▉         | 1088/11049 [11:13<1:41:50,  1.63it/s]
                                                      
{'loss': 0.3546, 'grad_norm': 0.7239113450050354, 'learning_rate': 9.846153846153848e-06, 'epoch': 0.3}

 10%|▉         | 1088/11049 [11:13<1:41:50,  1.63it/s]
 10%|▉         | 1089/11049 [11:13<1:41:49,  1.63it/s]
                                                      
{'loss': 0.3659, 'grad_norm': 0.6552540063858032, 'learning_rate': 9.855203619909504e-06, 'epoch': 0.3}

 10%|▉         | 1089/11049 [11:13<1:41:49,  1.63it/s]
 10%|▉         | 1090/11049 [11:14<1:41:58,  1.63it/s]
                                                      
{'loss': 0.4326, 'grad_norm': 0.7495299577713013, 'learning_rate': 9.86425339366516e-06, 'epoch': 0.3}

 10%|▉         | 1090/11049 [11:14<1:41:58,  1.63it/s]
 10%|▉         | 1091/11049 [11:15<1:41:55,  1.63it/s]
                                                      
{'loss': 0.3533, 'grad_norm': 0.6485477685928345, 'learning_rate': 9.873303167420816e-06, 'epoch': 0.3}

 10%|▉         | 1091/11049 [11:15<1:41:55,  1.63it/s]
 10%|▉         | 1092/11049 [11:15<1:41:52,  1.63it/s]
                                                      
{'loss': 0.2868, 'grad_norm': 0.5773823261260986, 'learning_rate': 9.882352941176472e-06, 'epoch': 0.3}

 10%|▉         | 1092/11049 [11:15<1:41:52,  1.63it/s]
 10%|▉         | 1093/11049 [11:16<1:41:51,  1.63it/s]
                                                      
{'loss': 0.4384, 'grad_norm': 0.7992625832557678, 'learning_rate': 9.891402714932129e-06, 'epoch': 0.3}

 10%|▉         | 1093/11049 [11:16<1:41:51,  1.63it/s]
 10%|▉         | 1094/11049 [11:16<1:41:50,  1.63it/s]
                                                      
{'loss': 0.4575, 'grad_norm': 0.6516428589820862, 'learning_rate': 9.900452488687785e-06, 'epoch': 0.3}

 10%|▉         | 1094/11049 [11:16<1:41:50,  1.63it/s]
 10%|▉         | 1095/11049 [11:17<1:41:46,  1.63it/s]
                                                      
{'loss': 0.3548, 'grad_norm': 0.6152515411376953, 'learning_rate': 9.90950226244344e-06, 'epoch': 0.3}

 10%|▉         | 1095/11049 [11:17<1:41:46,  1.63it/s]
 10%|▉         | 1096/11049 [11:18<1:41:45,  1.63it/s]
                                                      
{'loss': 0.3359, 'grad_norm': 0.6032410264015198, 'learning_rate': 9.918552036199095e-06, 'epoch': 0.3}

 10%|▉         | 1096/11049 [11:18<1:41:45,  1.63it/s]
 10%|▉         | 1097/11049 [11:18<1:41:44,  1.63it/s]
                                                      
{'loss': 0.3358, 'grad_norm': 0.6362032294273376, 'learning_rate': 9.927601809954752e-06, 'epoch': 0.3}

 10%|▉         | 1097/11049 [11:18<1:41:44,  1.63it/s]
 10%|▉         | 1098/11049 [11:19<1:41:43,  1.63it/s]
                                                      
{'loss': 0.5076, 'grad_norm': 0.6868684887886047, 'learning_rate': 9.936651583710408e-06, 'epoch': 0.3}

 10%|▉         | 1098/11049 [11:19<1:41:43,  1.63it/s]
 10%|▉         | 1099/11049 [11:19<1:41:41,  1.63it/s]
                                                      
{'loss': 0.2707, 'grad_norm': 0.6345863342285156, 'learning_rate': 9.945701357466064e-06, 'epoch': 0.3}

 10%|▉         | 1099/11049 [11:20<1:41:41,  1.63it/s]
 10%|▉         | 1100/11049 [11:20<1:41:41,  1.63it/s]
                                                      
{'loss': 0.4148, 'grad_norm': 0.7264812588691711, 'learning_rate': 9.95475113122172e-06, 'epoch': 0.3}

 10%|▉         | 1100/11049 [11:20<1:41:41,  1.63it/s]
 10%|▉         | 1101/11049 [11:21<1:41:43,  1.63it/s]
                                                      
{'loss': 0.3478, 'grad_norm': 0.6932289600372314, 'learning_rate': 9.963800904977376e-06, 'epoch': 0.3}

 10%|▉         | 1101/11049 [11:21<1:41:43,  1.63it/s]
 10%|▉         | 1102/11049 [11:21<1:41:42,  1.63it/s]
                                                      
{'loss': 0.4452, 'grad_norm': 0.7258678078651428, 'learning_rate': 9.972850678733032e-06, 'epoch': 0.3}

 10%|▉         | 1102/11049 [11:21<1:41:42,  1.63it/s]
 10%|▉         | 1103/11049 [11:22<1:41:46,  1.63it/s]
                                                      
{'loss': 0.3105, 'grad_norm': 0.6740434765815735, 'learning_rate': 9.981900452488688e-06, 'epoch': 0.3}

 10%|▉         | 1103/11049 [11:22<1:41:46,  1.63it/s]
 10%|▉         | 1104/11049 [11:22<1:41:45,  1.63it/s]
                                                      
{'loss': 0.3219, 'grad_norm': 0.5806502103805542, 'learning_rate': 9.990950226244345e-06, 'epoch': 0.3}

 10%|▉         | 1104/11049 [11:23<1:41:45,  1.63it/s]
 10%|█         | 1105/11049 [11:23<1:41:45,  1.63it/s]
                                                      
{'loss': 0.3558, 'grad_norm': 0.6827442049980164, 'learning_rate': 1e-05, 'epoch': 0.3}

 10%|█         | 1105/11049 [11:23<1:41:45,  1.63it/s]
 10%|█         | 1106/11049 [11:24<1:41:44,  1.63it/s]
                                                      
{'loss': 0.4003, 'grad_norm': 0.6560943722724915, 'learning_rate': 9.999999750473016e-06, 'epoch': 0.3}

 10%|█         | 1106/11049 [11:24<1:41:44,  1.63it/s]
 10%|█         | 1107/11049 [11:24<1:41:42,  1.63it/s]
                                                      
{'loss': 0.3082, 'grad_norm': 0.5938026309013367, 'learning_rate': 9.999999001892085e-06, 'epoch': 0.3}

 10%|█         | 1107/11049 [11:24<1:41:42,  1.63it/s]
 10%|█         | 1108/11049 [11:25<1:41:39,  1.63it/s]
                                                      
{'loss': 0.3311, 'grad_norm': 0.9481866955757141, 'learning_rate': 9.999997754257284e-06, 'epoch': 0.3}

 10%|█         | 1108/11049 [11:25<1:41:39,  1.63it/s]
 10%|█         | 1109/11049 [11:26<1:41:38,  1.63it/s]
                                                      
{'loss': 0.2911, 'grad_norm': 0.6113352179527283, 'learning_rate': 9.999996007568737e-06, 'epoch': 0.3}

 10%|█         | 1109/11049 [11:26<1:41:38,  1.63it/s]
 10%|█         | 1110/11049 [11:26<1:41:37,  1.63it/s]
                                                      
{'loss': 0.3525, 'grad_norm': 0.7414975762367249, 'learning_rate': 9.99999376182662e-06, 'epoch': 0.3}

 10%|█         | 1110/11049 [11:26<1:41:37,  1.63it/s]
 10%|█         | 1111/11049 [11:27<1:41:31,  1.63it/s]
                                                      
{'loss': 0.3235, 'grad_norm': 0.6797473430633545, 'learning_rate': 9.999991017031154e-06, 'epoch': 0.3}

 10%|█         | 1111/11049 [11:27<1:41:31,  1.63it/s]
 10%|█         | 1112/11049 [11:27<1:41:31,  1.63it/s]
                                                      
{'loss': 0.4399, 'grad_norm': 0.7345651388168335, 'learning_rate': 9.999987773182615e-06, 'epoch': 0.3}

 10%|█         | 1112/11049 [11:28<1:41:31,  1.63it/s]
 10%|█         | 1113/11049 [11:28<1:41:29,  1.63it/s]
                                                      
{'loss': 0.2876, 'grad_norm': 0.6433156132698059, 'learning_rate': 9.999984030281327e-06, 'epoch': 0.3}

 10%|█         | 1113/11049 [11:28<1:41:29,  1.63it/s]
 10%|█         | 1114/11049 [11:29<1:41:28,  1.63it/s]
                                                      
{'loss': 0.2834, 'grad_norm': 0.6664468050003052, 'learning_rate': 9.999979788327662e-06, 'epoch': 0.3}

 10%|█         | 1114/11049 [11:29<1:41:28,  1.63it/s]
 10%|█         | 1115/11049 [11:29<1:41:32,  1.63it/s]
                                                      
{'loss': 0.4236, 'grad_norm': 0.6780148148536682, 'learning_rate': 9.999975047322044e-06, 'epoch': 0.3}

 10%|█         | 1115/11049 [11:29<1:41:32,  1.63it/s]
 10%|█         | 1116/11049 [11:30<1:41:33,  1.63it/s]
                                                      
{'loss': 0.4081, 'grad_norm': 0.7206311225891113, 'learning_rate': 9.999969807264946e-06, 'epoch': 0.3}

 10%|█         | 1116/11049 [11:30<1:41:33,  1.63it/s]
 10%|█         | 1117/11049 [11:30<1:41:32,  1.63it/s]
                                                      
{'loss': 0.4108, 'grad_norm': 0.7303975820541382, 'learning_rate': 9.999964068156893e-06, 'epoch': 0.3}

 10%|█         | 1117/11049 [11:31<1:41:32,  1.63it/s]
 10%|█         | 1118/11049 [11:31<1:41:34,  1.63it/s]
                                                      
{'loss': 0.4211, 'grad_norm': 0.6909642219543457, 'learning_rate': 9.999957829998454e-06, 'epoch': 0.3}

 10%|█         | 1118/11049 [11:31<1:41:34,  1.63it/s]
 10%|█         | 1119/11049 [11:32<1:41:31,  1.63it/s]
                                                      
{'loss': 0.2912, 'grad_norm': 0.6032736301422119, 'learning_rate': 9.999951092790257e-06, 'epoch': 0.3}

 10%|█         | 1119/11049 [11:32<1:41:31,  1.63it/s]
 10%|█         | 1120/11049 [11:32<1:41:30,  1.63it/s]
                                                      
{'loss': 0.3136, 'grad_norm': 0.6455705165863037, 'learning_rate': 9.99994385653297e-06, 'epoch': 0.3}

 10%|█         | 1120/11049 [11:32<1:41:30,  1.63it/s]
 10%|█         | 1121/11049 [11:33<1:41:29,  1.63it/s]
                                                      
{'loss': 0.3587, 'grad_norm': 0.6362136602401733, 'learning_rate': 9.999936121227315e-06, 'epoch': 0.3}

 10%|█         | 1121/11049 [11:33<1:41:29,  1.63it/s]
 10%|█         | 1122/11049 [11:34<1:41:27,  1.63it/s]
                                                      
{'loss': 0.3117, 'grad_norm': 0.5799442529678345, 'learning_rate': 9.999927886874068e-06, 'epoch': 0.3}

 10%|█         | 1122/11049 [11:34<1:41:27,  1.63it/s]
 10%|█         | 1123/11049 [11:34<1:41:24,  1.63it/s]
                                                      
{'loss': 0.3151, 'grad_norm': 0.7243636846542358, 'learning_rate': 9.999919153474048e-06, 'epoch': 0.3}

 10%|█         | 1123/11049 [11:34<1:41:24,  1.63it/s]
 10%|█         | 1124/11049 [11:35<1:41:29,  1.63it/s]
                                                      
{'loss': 0.3642, 'grad_norm': 0.6327452659606934, 'learning_rate': 9.999909921028126e-06, 'epoch': 0.31}

 10%|█         | 1124/11049 [11:35<1:41:29,  1.63it/s]
 10%|█         | 1125/11049 [11:35<1:41:27,  1.63it/s]
                                                      
{'loss': 0.5443, 'grad_norm': 0.7626241445541382, 'learning_rate': 9.999900189537226e-06, 'epoch': 0.31}

 10%|█         | 1125/11049 [11:35<1:41:27,  1.63it/s]
 10%|█         | 1126/11049 [11:36<1:41:32,  1.63it/s]
                                                      
{'loss': 0.3521, 'grad_norm': 0.6793771386146545, 'learning_rate': 9.99988995900232e-06, 'epoch': 0.31}

 10%|█         | 1126/11049 [11:36<1:41:32,  1.63it/s]
 10%|█         | 1127/11049 [11:37<1:41:27,  1.63it/s]
                                                      
{'loss': 0.4361, 'grad_norm': 0.7918938398361206, 'learning_rate': 9.999879229424423e-06, 'epoch': 0.31}

 10%|█         | 1127/11049 [11:37<1:41:27,  1.63it/s]
 10%|█         | 1128/11049 [11:37<1:41:28,  1.63it/s]
                                                      
{'loss': 0.4063, 'grad_norm': 0.762592077255249, 'learning_rate': 9.999868000804613e-06, 'epoch': 0.31}

 10%|█         | 1128/11049 [11:37<1:41:28,  1.63it/s]
 10%|█         | 1129/11049 [11:38<1:41:25,  1.63it/s]
                                                      
{'loss': 0.3619, 'grad_norm': 0.5738109350204468, 'learning_rate': 9.999856273144007e-06, 'epoch': 0.31}

 10%|█         | 1129/11049 [11:38<1:41:25,  1.63it/s]
 10%|█         | 1130/11049 [11:38<1:41:25,  1.63it/s]
                                                      
{'loss': 0.2434, 'grad_norm': 0.5075996518135071, 'learning_rate': 9.999844046443776e-06, 'epoch': 0.31}

 10%|█         | 1130/11049 [11:39<1:41:25,  1.63it/s]
 10%|█         | 1131/11049 [11:39<1:41:24,  1.63it/s]
                                                      
{'loss': 0.3653, 'grad_norm': 0.7579595446586609, 'learning_rate': 9.999831320705143e-06, 'epoch': 0.31}

 10%|█         | 1131/11049 [11:39<1:41:24,  1.63it/s]
 10%|█         | 1132/11049 [11:40<1:41:24,  1.63it/s]
                                                      
{'loss': 0.4068, 'grad_norm': 0.7145383954048157, 'learning_rate': 9.999818095929373e-06, 'epoch': 0.31}

 10%|█         | 1132/11049 [11:40<1:41:24,  1.63it/s]
 10%|█         | 1133/11049 [11:40<1:41:23,  1.63it/s]
                                                      
{'loss': 0.3664, 'grad_norm': 0.7123559713363647, 'learning_rate': 9.999804372117789e-06, 'epoch': 0.31}

 10%|█         | 1133/11049 [11:40<1:41:23,  1.63it/s]
 10%|█         | 1134/11049 [11:41<1:41:21,  1.63it/s]
                                                      
{'loss': 0.3414, 'grad_norm': 0.5875226855278015, 'learning_rate': 9.999790149271764e-06, 'epoch': 0.31}

 10%|█         | 1134/11049 [11:41<1:41:21,  1.63it/s]
 10%|█         | 1135/11049 [11:41<1:41:20,  1.63it/s]
                                                      
{'loss': 0.293, 'grad_norm': 0.5749862194061279, 'learning_rate': 9.99977542739271e-06, 'epoch': 0.31}

 10%|█         | 1135/11049 [11:42<1:41:20,  1.63it/s]
 10%|█         | 1136/11049 [11:42<1:41:22,  1.63it/s]
                                                      
{'loss': 0.3939, 'grad_norm': 0.6198819875717163, 'learning_rate': 9.999760206482103e-06, 'epoch': 0.31}

 10%|█         | 1136/11049 [11:42<1:41:22,  1.63it/s]
 10%|█         | 1137/11049 [11:43<1:41:23,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5259716510772705, 'learning_rate': 9.99974448654146e-06, 'epoch': 0.31}

 10%|█         | 1137/11049 [11:43<1:41:23,  1.63it/s]
 10%|█         | 1138/11049 [11:43<1:41:44,  1.62it/s]
                                                      
{'loss': 0.2833, 'grad_norm': 0.6186957359313965, 'learning_rate': 9.99972826757235e-06, 'epoch': 0.31}

 10%|█         | 1138/11049 [11:43<1:41:44,  1.62it/s]
 10%|█         | 1139/11049 [11:44<1:41:36,  1.63it/s]
                                                      
{'loss': 0.3031, 'grad_norm': 0.5804041624069214, 'learning_rate': 9.999711549576391e-06, 'epoch': 0.31}

 10%|█         | 1139/11049 [11:44<1:41:36,  1.63it/s]
 10%|█         | 1140/11049 [11:45<1:41:29,  1.63it/s]
                                                      
{'loss': 0.4003, 'grad_norm': 0.6469964981079102, 'learning_rate': 9.999694332555252e-06, 'epoch': 0.31}

 10%|█         | 1140/11049 [11:45<1:41:29,  1.63it/s]
 10%|█         | 1141/11049 [11:45<1:41:23,  1.63it/s]
                                                      
{'loss': 0.4218, 'grad_norm': 0.8858168721199036, 'learning_rate': 9.999676616510653e-06, 'epoch': 0.31}

 10%|█         | 1141/11049 [11:45<1:41:23,  1.63it/s]
 10%|█         | 1142/11049 [11:46<1:41:20,  1.63it/s]
                                                      
{'loss': 0.3273, 'grad_norm': 0.6318796277046204, 'learning_rate': 9.99965840144436e-06, 'epoch': 0.31}

 10%|█         | 1142/11049 [11:46<1:41:20,  1.63it/s]
 10%|█         | 1143/11049 [11:46<1:41:15,  1.63it/s]
                                                      
{'loss': 0.2802, 'grad_norm': 0.543209969997406, 'learning_rate': 9.999639687358194e-06, 'epoch': 0.31}

 10%|█         | 1143/11049 [11:47<1:41:15,  1.63it/s]
 10%|█         | 1144/11049 [11:47<1:41:15,  1.63it/s]
                                                      
{'loss': 0.2871, 'grad_norm': 0.5564922094345093, 'learning_rate': 9.99962047425402e-06, 'epoch': 0.31}

 10%|█         | 1144/11049 [11:47<1:41:15,  1.63it/s]
 10%|█         | 1145/11049 [11:48<1:41:22,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5528036952018738, 'learning_rate': 9.999600762133756e-06, 'epoch': 0.31}

 10%|█         | 1145/11049 [11:48<1:41:22,  1.63it/s]
 10%|█         | 1146/11049 [11:48<1:41:15,  1.63it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.5603001117706299, 'learning_rate': 9.999580550999371e-06, 'epoch': 0.31}

 10%|█         | 1146/11049 [11:48<1:41:15,  1.63it/s]
 10%|█         | 1147/11049 [11:49<1:41:19,  1.63it/s]
                                                      
{'loss': 0.3621, 'grad_norm': 0.7004907131195068, 'learning_rate': 9.99955984085288e-06, 'epoch': 0.31}

 10%|█         | 1147/11049 [11:49<1:41:19,  1.63it/s]
 10%|█         | 1148/11049 [11:49<1:41:17,  1.63it/s]
                                                      
{'loss': 0.3304, 'grad_norm': 0.6796730160713196, 'learning_rate': 9.999538631696354e-06, 'epoch': 0.31}

 10%|█         | 1148/11049 [11:50<1:41:17,  1.63it/s]
 10%|█         | 1149/11049 [11:50<1:41:14,  1.63it/s]
                                                      
{'loss': 0.4106, 'grad_norm': 0.7073079943656921, 'learning_rate': 9.999516923531906e-06, 'epoch': 0.31}

 10%|█         | 1149/11049 [11:50<1:41:14,  1.63it/s]
 10%|█         | 1150/11049 [11:51<1:41:10,  1.63it/s]
                                                      
{'loss': 0.3092, 'grad_norm': 0.6730660200119019, 'learning_rate': 9.999494716361705e-06, 'epoch': 0.31}

 10%|█         | 1150/11049 [11:51<1:41:10,  1.63it/s]
 10%|█         | 1151/11049 [11:51<1:41:12,  1.63it/s]
                                                      
{'loss': 0.3247, 'grad_norm': 0.6360000371932983, 'learning_rate': 9.999472010187965e-06, 'epoch': 0.31}

 10%|█         | 1151/11049 [11:51<1:41:12,  1.63it/s]
 10%|█         | 1152/11049 [11:52<1:41:08,  1.63it/s]
                                                      
{'loss': 0.4466, 'grad_norm': 0.7777960300445557, 'learning_rate': 9.999448805012955e-06, 'epoch': 0.31}

 10%|█         | 1152/11049 [11:52<1:41:08,  1.63it/s]
 10%|█         | 1153/11049 [11:53<1:41:09,  1.63it/s]
                                                      
{'loss': 0.3578, 'grad_norm': 0.7569293975830078, 'learning_rate': 9.99942510083899e-06, 'epoch': 0.31}

 10%|█         | 1153/11049 [11:53<1:41:09,  1.63it/s]
 10%|█         | 1154/11049 [11:53<1:41:09,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.6243784427642822, 'learning_rate': 9.999400897668436e-06, 'epoch': 0.31}

 10%|█         | 1154/11049 [11:53<1:41:09,  1.63it/s]
 10%|█         | 1155/11049 [11:54<1:41:10,  1.63it/s]
                                                      
{'loss': 0.3783, 'grad_norm': 0.7265522480010986, 'learning_rate': 9.999376195503709e-06, 'epoch': 0.31}

 10%|█         | 1155/11049 [11:54<1:41:10,  1.63it/s]
 10%|█         | 1156/11049 [11:54<1:41:06,  1.63it/s]
                                                      
{'loss': 0.3156, 'grad_norm': 0.7404101490974426, 'learning_rate': 9.999350994347274e-06, 'epoch': 0.31}

 10%|█         | 1156/11049 [11:55<1:41:06,  1.63it/s]
 10%|█         | 1157/11049 [11:55<1:41:05,  1.63it/s]
                                                      
{'loss': 0.269, 'grad_norm': 0.6615054607391357, 'learning_rate': 9.999325294201647e-06, 'epoch': 0.31}

 10%|█         | 1157/11049 [11:55<1:41:05,  1.63it/s]
 10%|█         | 1158/11049 [11:56<1:41:04,  1.63it/s]
                                                      
{'loss': 0.375, 'grad_norm': 0.8385610580444336, 'learning_rate': 9.999299095069392e-06, 'epoch': 0.31}

 10%|█         | 1158/11049 [11:56<1:41:04,  1.63it/s]
 10%|█         | 1159/11049 [11:56<1:41:03,  1.63it/s]
                                                      
{'loss': 0.4347, 'grad_norm': 0.714027464389801, 'learning_rate': 9.999272396953127e-06, 'epoch': 0.31}

 10%|█         | 1159/11049 [11:56<1:41:03,  1.63it/s]
 10%|█         | 1160/11049 [11:57<1:41:02,  1.63it/s]
                                                      
{'loss': 0.329, 'grad_norm': 0.8010923862457275, 'learning_rate': 9.999245199855514e-06, 'epoch': 0.31}

 10%|█         | 1160/11049 [11:57<1:41:02,  1.63it/s]
 11%|█         | 1161/11049 [11:57<1:41:00,  1.63it/s]
                                                      
{'loss': 0.2633, 'grad_norm': 0.605471134185791, 'learning_rate': 9.999217503779266e-06, 'epoch': 0.32}

 11%|█         | 1161/11049 [11:58<1:41:00,  1.63it/s]
 11%|█         | 1162/11049 [11:58<1:41:00,  1.63it/s]
                                                      
{'loss': 0.3464, 'grad_norm': 0.7165087461471558, 'learning_rate': 9.99918930872715e-06, 'epoch': 0.32}

 11%|█         | 1162/11049 [11:58<1:41:00,  1.63it/s]
 11%|█         | 1163/11049 [11:59<1:41:00,  1.63it/s]
                                                      
{'loss': 0.2593, 'grad_norm': 0.5454654693603516, 'learning_rate': 9.999160614701982e-06, 'epoch': 0.32}

 11%|█         | 1163/11049 [11:59<1:41:00,  1.63it/s]
 11%|█         | 1164/11049 [11:59<1:41:00,  1.63it/s]
                                                      
{'loss': 0.3645, 'grad_norm': 0.6359745264053345, 'learning_rate': 9.99913142170662e-06, 'epoch': 0.32}

 11%|█         | 1164/11049 [11:59<1:41:00,  1.63it/s]
 11%|█         | 1165/11049 [12:00<1:41:00,  1.63it/s]
                                                      
{'loss': 0.3592, 'grad_norm': 0.7592574954032898, 'learning_rate': 9.999101729743985e-06, 'epoch': 0.32}

 11%|█         | 1165/11049 [12:00<1:41:00,  1.63it/s]
 11%|█         | 1166/11049 [12:01<1:41:02,  1.63it/s]
                                                      
{'loss': 0.2894, 'grad_norm': 0.6926611661911011, 'learning_rate': 9.999071538817036e-06, 'epoch': 0.32}

 11%|█         | 1166/11049 [12:01<1:41:02,  1.63it/s]
 11%|█         | 1167/11049 [12:01<1:40:59,  1.63it/s]
                                                      
{'loss': 0.3019, 'grad_norm': 0.5824082493782043, 'learning_rate': 9.999040848928786e-06, 'epoch': 0.32}

 11%|█         | 1167/11049 [12:01<1:40:59,  1.63it/s]
 11%|█         | 1168/11049 [12:02<1:41:03,  1.63it/s]
                                                      
{'loss': 0.2941, 'grad_norm': 0.704885721206665, 'learning_rate': 9.9990096600823e-06, 'epoch': 0.32}

 11%|█         | 1168/11049 [12:02<1:41:03,  1.63it/s]
 11%|█         | 1169/11049 [12:02<1:40:59,  1.63it/s]
                                                      
{'loss': 0.3339, 'grad_norm': 0.6186279654502869, 'learning_rate': 9.998977972280691e-06, 'epoch': 0.32}

 11%|█         | 1169/11049 [12:02<1:40:59,  1.63it/s]
 11%|█         | 1170/11049 [12:03<1:40:57,  1.63it/s]
                                                      
{'loss': 0.328, 'grad_norm': 0.7494012713432312, 'learning_rate': 9.998945785527122e-06, 'epoch': 0.32}

 11%|█         | 1170/11049 [12:03<1:40:57,  1.63it/s]
 11%|█         | 1171/11049 [12:04<1:40:55,  1.63it/s]
                                                      
{'loss': 0.2696, 'grad_norm': 0.5194951295852661, 'learning_rate': 9.998913099824804e-06, 'epoch': 0.32}

 11%|█         | 1171/11049 [12:04<1:40:55,  1.63it/s]
 11%|█         | 1172/11049 [12:04<1:40:52,  1.63it/s]
                                                      
{'loss': 0.4224, 'grad_norm': 0.7363208532333374, 'learning_rate': 9.998879915177e-06, 'epoch': 0.32}

 11%|█         | 1172/11049 [12:04<1:40:52,  1.63it/s]
 11%|█         | 1173/11049 [12:05<1:40:52,  1.63it/s]
                                                      
{'loss': 0.5097, 'grad_norm': 0.7209937572479248, 'learning_rate': 9.998846231587023e-06, 'epoch': 0.32}

 11%|█         | 1173/11049 [12:05<1:40:52,  1.63it/s]
 11%|█         | 1174/11049 [12:05<1:40:51,  1.63it/s]
                                                      
{'loss': 0.2546, 'grad_norm': 0.5826030969619751, 'learning_rate': 9.998812049058233e-06, 'epoch': 0.32}

 11%|█         | 1174/11049 [12:06<1:40:51,  1.63it/s]
 11%|█         | 1175/11049 [12:06<1:40:53,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.6182358860969543, 'learning_rate': 9.998777367594046e-06, 'epoch': 0.32}

 11%|█         | 1175/11049 [12:06<1:40:53,  1.63it/s]
 11%|█         | 1176/11049 [12:07<1:40:53,  1.63it/s]
                                                      
{'loss': 0.4162, 'grad_norm': 0.7127162218093872, 'learning_rate': 9.998742187197918e-06, 'epoch': 0.32}

 11%|█         | 1176/11049 [12:07<1:40:53,  1.63it/s]
 11%|█         | 1177/11049 [12:07<1:40:52,  1.63it/s]
                                                      
{'loss': 0.4078, 'grad_norm': 0.7713635563850403, 'learning_rate': 9.998706507873365e-06, 'epoch': 0.32}

 11%|█         | 1177/11049 [12:07<1:40:52,  1.63it/s]
 11%|█         | 1178/11049 [12:08<1:40:52,  1.63it/s]
                                                      
{'loss': 0.4015, 'grad_norm': 0.7479203939437866, 'learning_rate': 9.998670329623946e-06, 'epoch': 0.32}

 11%|█         | 1178/11049 [12:08<1:40:52,  1.63it/s]
 11%|█         | 1179/11049 [12:08<1:40:49,  1.63it/s]
                                                      
{'loss': 0.2881, 'grad_norm': 0.5682550668716431, 'learning_rate': 9.998633652453274e-06, 'epoch': 0.32}

 11%|█         | 1179/11049 [12:09<1:40:49,  1.63it/s]
 11%|█         | 1180/11049 [12:09<1:40:48,  1.63it/s]
                                                      
{'loss': 0.3916, 'grad_norm': 0.7660536170005798, 'learning_rate': 9.998596476365006e-06, 'epoch': 0.32}

 11%|█         | 1180/11049 [12:09<1:40:48,  1.63it/s]
 11%|█         | 1181/11049 [12:10<1:40:51,  1.63it/s]
                                                      
{'loss': 0.3377, 'grad_norm': 0.6394299268722534, 'learning_rate': 9.998558801362855e-06, 'epoch': 0.32}

 11%|█         | 1181/11049 [12:10<1:40:51,  1.63it/s]
 11%|█         | 1182/11049 [12:10<1:40:48,  1.63it/s]
                                                      
{'loss': 0.3154, 'grad_norm': 0.7609958648681641, 'learning_rate': 9.998520627450581e-06, 'epoch': 0.32}

 11%|█         | 1182/11049 [12:10<1:40:48,  1.63it/s]
 11%|█         | 1183/11049 [12:11<1:40:47,  1.63it/s]
                                                      
{'loss': 0.3552, 'grad_norm': 0.6830236315727234, 'learning_rate': 9.998481954631994e-06, 'epoch': 0.32}

 11%|█         | 1183/11049 [12:11<1:40:47,  1.63it/s]
 11%|█         | 1184/11049 [12:12<1:40:47,  1.63it/s]
                                                      
{'loss': 0.2822, 'grad_norm': 0.6737478375434875, 'learning_rate': 9.998442782910955e-06, 'epoch': 0.32}

 11%|█         | 1184/11049 [12:12<1:40:47,  1.63it/s]
 11%|█         | 1185/11049 [12:12<1:40:46,  1.63it/s]
                                                      
{'loss': 0.3093, 'grad_norm': 0.6646882891654968, 'learning_rate': 9.998403112291374e-06, 'epoch': 0.32}

 11%|█         | 1185/11049 [12:12<1:40:46,  1.63it/s]
 11%|█         | 1186/11049 [12:13<1:40:46,  1.63it/s]
                                                      
{'loss': 0.3027, 'grad_norm': 0.6991515755653381, 'learning_rate': 9.998362942777206e-06, 'epoch': 0.32}

 11%|█         | 1186/11049 [12:13<1:40:46,  1.63it/s]
 11%|█         | 1187/11049 [12:13<1:40:46,  1.63it/s]
                                                      
{'loss': 0.4304, 'grad_norm': 0.7661077380180359, 'learning_rate': 9.998322274372468e-06, 'epoch': 0.32}

 11%|█         | 1187/11049 [12:14<1:40:46,  1.63it/s]
 11%|█         | 1188/11049 [12:14<1:40:48,  1.63it/s]
                                                      
{'loss': 0.3576, 'grad_norm': 0.695797324180603, 'learning_rate': 9.998281107081214e-06, 'epoch': 0.32}

 11%|█         | 1188/11049 [12:14<1:40:48,  1.63it/s]
 11%|█         | 1189/11049 [12:15<1:40:49,  1.63it/s]
                                                      
{'loss': 0.4006, 'grad_norm': 0.7287901043891907, 'learning_rate': 9.998239440907553e-06, 'epoch': 0.32}

 11%|█         | 1189/11049 [12:15<1:40:49,  1.63it/s]
 11%|█         | 1190/11049 [12:15<1:40:47,  1.63it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.7036826610565186, 'learning_rate': 9.998197275855645e-06, 'epoch': 0.32}

 11%|█         | 1190/11049 [12:15<1:40:47,  1.63it/s]
 11%|█         | 1191/11049 [12:16<1:40:48,  1.63it/s]
                                                      
{'loss': 0.3479, 'grad_norm': 0.701358437538147, 'learning_rate': 9.998154611929697e-06, 'epoch': 0.32}

 11%|█         | 1191/11049 [12:16<1:40:48,  1.63it/s]
 11%|█         | 1192/11049 [12:16<1:40:44,  1.63it/s]
                                                      
{'loss': 0.3254, 'grad_norm': 0.6385166049003601, 'learning_rate': 9.99811144913397e-06, 'epoch': 0.32}

 11%|█         | 1192/11049 [12:17<1:40:44,  1.63it/s]
 11%|█         | 1193/11049 [12:17<1:40:41,  1.63it/s]
                                                      
{'loss': 0.458, 'grad_norm': 0.7668143510818481, 'learning_rate': 9.998067787472772e-06, 'epoch': 0.32}

 11%|█         | 1193/11049 [12:17<1:40:41,  1.63it/s]
 11%|█         | 1194/11049 [12:18<1:40:41,  1.63it/s]
                                                      
{'loss': 0.3504, 'grad_norm': 0.6382220387458801, 'learning_rate': 9.998023626950458e-06, 'epoch': 0.32}

 11%|█         | 1194/11049 [12:18<1:40:41,  1.63it/s]
 11%|█         | 1195/11049 [12:18<1:40:41,  1.63it/s]
                                                      
{'loss': 0.3139, 'grad_norm': 0.5995844602584839, 'learning_rate': 9.997978967571436e-06, 'epoch': 0.32}

 11%|█         | 1195/11049 [12:18<1:40:41,  1.63it/s]
 11%|█         | 1196/11049 [12:19<1:40:41,  1.63it/s]
                                                      
{'loss': 0.3308, 'grad_norm': 0.6387499570846558, 'learning_rate': 9.997933809340166e-06, 'epoch': 0.32}

 11%|█         | 1196/11049 [12:19<1:40:41,  1.63it/s]
 11%|█         | 1197/11049 [12:20<1:40:48,  1.63it/s]
                                                      
{'loss': 0.3285, 'grad_norm': 0.6578479409217834, 'learning_rate': 9.997888152261155e-06, 'epoch': 0.33}

 11%|█         | 1197/11049 [12:20<1:40:48,  1.63it/s]
 11%|█         | 1198/11049 [12:20<1:40:47,  1.63it/s]
                                                      
{'loss': 0.3037, 'grad_norm': 0.7146188616752625, 'learning_rate': 9.997841996338957e-06, 'epoch': 0.33}

 11%|█         | 1198/11049 [12:20<1:40:47,  1.63it/s]
 11%|█         | 1199/11049 [12:21<1:40:42,  1.63it/s]
                                                      
{'loss': 0.3238, 'grad_norm': 0.674335241317749, 'learning_rate': 9.997795341578183e-06, 'epoch': 0.33}

 11%|█         | 1199/11049 [12:21<1:40:42,  1.63it/s]
 11%|█         | 1200/11049 [12:21<1:40:40,  1.63it/s]
                                                      
{'loss': 0.2923, 'grad_norm': 0.6353352665901184, 'learning_rate': 9.997748187983488e-06, 'epoch': 0.33}

 11%|█         | 1200/11049 [12:21<1:40:40,  1.63it/s]
 11%|█         | 1201/11049 [12:22<1:40:41,  1.63it/s]
                                                      
{'loss': 0.357, 'grad_norm': 0.7758983373641968, 'learning_rate': 9.997700535559575e-06, 'epoch': 0.33}

 11%|█         | 1201/11049 [12:22<1:40:41,  1.63it/s]
 11%|█         | 1202/11049 [12:23<1:40:40,  1.63it/s]
                                                      
{'loss': 0.3443, 'grad_norm': 0.7590182423591614, 'learning_rate': 9.997652384311206e-06, 'epoch': 0.33}

 11%|█         | 1202/11049 [12:23<1:40:40,  1.63it/s]
 11%|█         | 1203/11049 [12:23<1:40:37,  1.63it/s]
                                                      
{'loss': 0.3627, 'grad_norm': 0.6811250448226929, 'learning_rate': 9.997603734243184e-06, 'epoch': 0.33}

 11%|█         | 1203/11049 [12:23<1:40:37,  1.63it/s]
 11%|█         | 1204/11049 [12:24<1:40:41,  1.63it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.6598883867263794, 'learning_rate': 9.997554585360365e-06, 'epoch': 0.33}

 11%|█         | 1204/11049 [12:24<1:40:41,  1.63it/s]
 11%|█         | 1205/11049 [12:24<1:40:37,  1.63it/s]
                                                      
{'loss': 0.4349, 'grad_norm': 0.8671560287475586, 'learning_rate': 9.997504937667654e-06, 'epoch': 0.33}

 11%|█         | 1205/11049 [12:25<1:40:37,  1.63it/s]
 11%|█         | 1206/11049 [12:25<1:40:37,  1.63it/s]
                                                      
{'loss': 0.3492, 'grad_norm': 0.7231142520904541, 'learning_rate': 9.997454791170008e-06, 'epoch': 0.33}

 11%|█         | 1206/11049 [12:25<1:40:37,  1.63it/s]
 11%|█         | 1207/11049 [12:26<1:40:38,  1.63it/s]
                                                      
{'loss': 0.3379, 'grad_norm': 0.6585626602172852, 'learning_rate': 9.99740414587243e-06, 'epoch': 0.33}

 11%|█         | 1207/11049 [12:26<1:40:38,  1.63it/s]
 11%|█         | 1208/11049 [12:26<1:40:34,  1.63it/s]
                                                      
{'loss': 0.4346, 'grad_norm': 0.6701410412788391, 'learning_rate': 9.997353001779977e-06, 'epoch': 0.33}

 11%|█         | 1208/11049 [12:26<1:40:34,  1.63it/s]
 11%|█         | 1209/11049 [12:27<1:40:38,  1.63it/s]
                                                      
{'loss': 0.2943, 'grad_norm': 0.6026089787483215, 'learning_rate': 9.997301358897752e-06, 'epoch': 0.33}

 11%|█         | 1209/11049 [12:27<1:40:38,  1.63it/s]
 11%|█         | 1210/11049 [12:28<1:40:37,  1.63it/s]
                                                      
{'loss': 0.2752, 'grad_norm': 0.5670957565307617, 'learning_rate': 9.99724921723091e-06, 'epoch': 0.33}

 11%|█         | 1210/11049 [12:28<1:40:37,  1.63it/s]
 11%|█         | 1211/11049 [12:28<1:40:33,  1.63it/s]
                                                      
{'loss': 0.3873, 'grad_norm': 0.7589759826660156, 'learning_rate': 9.997196576784658e-06, 'epoch': 0.33}

 11%|█         | 1211/11049 [12:28<1:40:33,  1.63it/s]
 11%|█         | 1212/11049 [12:29<1:40:32,  1.63it/s]
                                                      
{'loss': 0.3247, 'grad_norm': 0.7473604083061218, 'learning_rate': 9.997143437564248e-06, 'epoch': 0.33}

 11%|█         | 1212/11049 [12:29<1:40:32,  1.63it/s]
 11%|█         | 1213/11049 [12:29<1:40:34,  1.63it/s]
                                                      
{'loss': 0.2926, 'grad_norm': 0.6430185437202454, 'learning_rate': 9.997089799574982e-06, 'epoch': 0.33}

 11%|█         | 1213/11049 [12:29<1:40:34,  1.63it/s]
 11%|█         | 1214/11049 [12:30<1:40:35,  1.63it/s]
                                                      
{'loss': 0.3175, 'grad_norm': 0.6618717908859253, 'learning_rate': 9.997035662822216e-06, 'epoch': 0.33}

 11%|█         | 1214/11049 [12:30<1:40:35,  1.63it/s]
 11%|█         | 1215/11049 [12:31<1:40:33,  1.63it/s]
                                                      
{'loss': 0.3326, 'grad_norm': 0.7288587093353271, 'learning_rate': 9.996981027311352e-06, 'epoch': 0.33}

 11%|█         | 1215/11049 [12:31<1:40:33,  1.63it/s]
 11%|█         | 1216/11049 [12:31<1:40:33,  1.63it/s]
                                                      
{'loss': 0.3193, 'grad_norm': 0.6674772500991821, 'learning_rate': 9.996925893047844e-06, 'epoch': 0.33}

 11%|█         | 1216/11049 [12:31<1:40:33,  1.63it/s]
 11%|█         | 1217/11049 [12:32<1:40:30,  1.63it/s]
                                                      
{'loss': 0.3183, 'grad_norm': 0.5730006694793701, 'learning_rate': 9.996870260037196e-06, 'epoch': 0.33}

 11%|█         | 1217/11049 [12:32<1:40:30,  1.63it/s]
 11%|█         | 1218/11049 [12:32<1:40:33,  1.63it/s]
                                                      
{'loss': 0.3515, 'grad_norm': 0.6125736236572266, 'learning_rate': 9.99681412828496e-06, 'epoch': 0.33}

 11%|█         | 1218/11049 [12:33<1:40:33,  1.63it/s]
 11%|█         | 1219/11049 [12:33<1:40:31,  1.63it/s]
                                                      
{'loss': 0.2749, 'grad_norm': 0.6080039739608765, 'learning_rate': 9.996757497796736e-06, 'epoch': 0.33}

 11%|█         | 1219/11049 [12:33<1:40:31,  1.63it/s]
 11%|█         | 1220/11049 [12:34<1:40:31,  1.63it/s]
                                                      
{'loss': 0.3665, 'grad_norm': 0.7076063752174377, 'learning_rate': 9.996700368578181e-06, 'epoch': 0.33}

 11%|█         | 1220/11049 [12:34<1:40:31,  1.63it/s]
 11%|█         | 1221/11049 [12:34<1:40:32,  1.63it/s]
                                                      
{'loss': 0.2897, 'grad_norm': 0.6298311948776245, 'learning_rate': 9.996642740634994e-06, 'epoch': 0.33}

 11%|█         | 1221/11049 [12:34<1:40:32,  1.63it/s]
 11%|█         | 1222/11049 [12:35<1:40:30,  1.63it/s]
                                                      
{'loss': 0.3333, 'grad_norm': 0.7428305745124817, 'learning_rate': 9.996584613972928e-06, 'epoch': 0.33}

 11%|█         | 1222/11049 [12:35<1:40:30,  1.63it/s]
 11%|█         | 1223/11049 [12:35<1:40:28,  1.63it/s]
                                                      
{'loss': 0.2856, 'grad_norm': 0.5869134068489075, 'learning_rate': 9.996525988597782e-06, 'epoch': 0.33}

 11%|█         | 1223/11049 [12:36<1:40:28,  1.63it/s]
 11%|█         | 1224/11049 [12:36<1:40:32,  1.63it/s]
                                                      
{'loss': 0.2657, 'grad_norm': 0.5044445991516113, 'learning_rate': 9.996466864515413e-06, 'epoch': 0.33}

 11%|█         | 1224/11049 [12:36<1:40:32,  1.63it/s]
 11%|█         | 1225/11049 [12:37<1:40:33,  1.63it/s]
                                                      
{'loss': 0.2316, 'grad_norm': 0.6326848864555359, 'learning_rate': 9.996407241731718e-06, 'epoch': 0.33}

 11%|█         | 1225/11049 [12:37<1:40:33,  1.63it/s]
 11%|█         | 1226/11049 [12:37<1:40:30,  1.63it/s]
                                                      
{'loss': 0.3153, 'grad_norm': 0.6408834457397461, 'learning_rate': 9.996347120252647e-06, 'epoch': 0.33}

 11%|█         | 1226/11049 [12:37<1:40:30,  1.63it/s]
 11%|█         | 1227/11049 [12:38<1:40:30,  1.63it/s]
                                                      
{'loss': 0.3504, 'grad_norm': 0.8305054306983948, 'learning_rate': 9.996286500084204e-06, 'epoch': 0.33}

 11%|█         | 1227/11049 [12:38<1:40:30,  1.63it/s]
 11%|█         | 1228/11049 [12:39<1:40:27,  1.63it/s]
                                                      
{'loss': 0.3336, 'grad_norm': 0.6507139801979065, 'learning_rate': 9.99622538123244e-06, 'epoch': 0.33}

 11%|█         | 1228/11049 [12:39<1:40:27,  1.63it/s]
 11%|█         | 1229/11049 [12:39<1:40:24,  1.63it/s]
                                                      
{'loss': 0.3498, 'grad_norm': 0.7082558870315552, 'learning_rate': 9.996163763703453e-06, 'epoch': 0.33}

 11%|█         | 1229/11049 [12:39<1:40:24,  1.63it/s]
 11%|█         | 1230/11049 [12:40<1:40:24,  1.63it/s]
                                                      
{'loss': 0.2724, 'grad_norm': 0.7958043813705444, 'learning_rate': 9.996101647503391e-06, 'epoch': 0.33}

 11%|█         | 1230/11049 [12:40<1:40:24,  1.63it/s]
 11%|█         | 1231/11049 [12:40<1:40:23,  1.63it/s]
                                                      
{'loss': 0.3501, 'grad_norm': 0.7420366406440735, 'learning_rate': 9.996039032638459e-06, 'epoch': 0.33}

 11%|█         | 1231/11049 [12:41<1:40:23,  1.63it/s]
 11%|█         | 1232/11049 [12:41<1:40:22,  1.63it/s]
                                                      
{'loss': 0.2819, 'grad_norm': 0.6066584587097168, 'learning_rate': 9.995975919114904e-06, 'epoch': 0.33}

 11%|█         | 1232/11049 [12:41<1:40:22,  1.63it/s]
 11%|█         | 1233/11049 [12:42<1:40:24,  1.63it/s]
                                                      
{'loss': 0.2761, 'grad_norm': 0.6529521942138672, 'learning_rate': 9.995912306939026e-06, 'epoch': 0.33}

 11%|█         | 1233/11049 [12:42<1:40:24,  1.63it/s]
 11%|█         | 1234/11049 [12:42<1:40:24,  1.63it/s]
                                                      
{'loss': 0.3554, 'grad_norm': 0.7004538774490356, 'learning_rate': 9.995848196117173e-06, 'epoch': 0.34}

 11%|█         | 1234/11049 [12:42<1:40:24,  1.63it/s]
 11%|█         | 1235/11049 [12:43<1:40:17,  1.63it/s]
                                                      
{'loss': 0.3491, 'grad_norm': 0.6744189262390137, 'learning_rate': 9.995783586655745e-06, 'epoch': 0.34}

 11%|█         | 1235/11049 [12:43<1:40:17,  1.63it/s]
 11%|█         | 1236/11049 [12:43<1:40:19,  1.63it/s]
                                                      
{'loss': 0.2642, 'grad_norm': 0.6778343915939331, 'learning_rate': 9.99571847856119e-06, 'epoch': 0.34}

 11%|█         | 1236/11049 [12:44<1:40:19,  1.63it/s]
 11%|█         | 1237/11049 [12:44<1:40:19,  1.63it/s]
                                                      
{'loss': 0.3193, 'grad_norm': 0.654795229434967, 'learning_rate': 9.995652871840006e-06, 'epoch': 0.34}

 11%|█         | 1237/11049 [12:44<1:40:19,  1.63it/s]
 11%|█         | 1238/11049 [12:45<1:40:17,  1.63it/s]
                                                      
{'loss': 0.2765, 'grad_norm': 0.6177912354469299, 'learning_rate': 9.995586766498745e-06, 'epoch': 0.34}

 11%|█         | 1238/11049 [12:45<1:40:17,  1.63it/s]
 11%|█         | 1239/11049 [12:45<1:40:16,  1.63it/s]
                                                      
{'loss': 0.345, 'grad_norm': 0.6686140894889832, 'learning_rate': 9.995520162544e-06, 'epoch': 0.34}

 11%|█         | 1239/11049 [12:45<1:40:16,  1.63it/s]
 11%|█         | 1240/11049 [12:46<1:40:15,  1.63it/s]
                                                      
{'loss': 0.2589, 'grad_norm': 0.7868413925170898, 'learning_rate': 9.995453059982422e-06, 'epoch': 0.34}

 11%|█         | 1240/11049 [12:46<1:40:15,  1.63it/s]
 11%|█         | 1241/11049 [12:47<1:40:15,  1.63it/s]
                                                      
{'loss': 0.3626, 'grad_norm': 0.6078990697860718, 'learning_rate': 9.995385458820708e-06, 'epoch': 0.34}

 11%|█         | 1241/11049 [12:47<1:40:15,  1.63it/s]
 11%|█         | 1242/11049 [12:47<1:40:14,  1.63it/s]
                                                      
{'loss': 0.2853, 'grad_norm': 0.6805893778800964, 'learning_rate': 9.995317359065603e-06, 'epoch': 0.34}

 11%|█         | 1242/11049 [12:47<1:40:14,  1.63it/s]
 11%|█         | 1243/11049 [12:48<1:40:13,  1.63it/s]
                                                      
{'loss': 0.3229, 'grad_norm': 0.6800456643104553, 'learning_rate': 9.995248760723909e-06, 'epoch': 0.34}

 11%|█         | 1243/11049 [12:48<1:40:13,  1.63it/s]
 11%|█▏        | 1244/11049 [12:48<1:40:13,  1.63it/s]
                                                      
{'loss': 0.321, 'grad_norm': 0.6671311855316162, 'learning_rate': 9.995179663802468e-06, 'epoch': 0.34}

 11%|█▏        | 1244/11049 [12:48<1:40:13,  1.63it/s]
 11%|█▏        | 1245/11049 [12:49<1:40:14,  1.63it/s]
                                                      
{'loss': 0.3795, 'grad_norm': 0.6275811195373535, 'learning_rate': 9.995110068308178e-06, 'epoch': 0.34}

 11%|█▏        | 1245/11049 [12:49<1:40:14,  1.63it/s]
 11%|█▏        | 1246/11049 [12:50<1:40:14,  1.63it/s]
                                                      
{'loss': 0.3091, 'grad_norm': 0.6370922327041626, 'learning_rate': 9.995039974247989e-06, 'epoch': 0.34}

 11%|█▏        | 1246/11049 [12:50<1:40:14,  1.63it/s]
 11%|█▏        | 1247/11049 [12:50<1:40:13,  1.63it/s]
                                                      
{'loss': 0.3196, 'grad_norm': 0.6475148797035217, 'learning_rate': 9.99496938162889e-06, 'epoch': 0.34}

 11%|█▏        | 1247/11049 [12:50<1:40:13,  1.63it/s]
 11%|█▏        | 1248/11049 [12:51<1:40:12,  1.63it/s]
                                                      
{'loss': 0.3058, 'grad_norm': 0.8345809578895569, 'learning_rate': 9.994898290457932e-06, 'epoch': 0.34}

 11%|█▏        | 1248/11049 [12:51<1:40:12,  1.63it/s]
 11%|█▏        | 1249/11049 [12:51<1:40:12,  1.63it/s]
                                                      
{'loss': 0.2503, 'grad_norm': 0.5301605463027954, 'learning_rate': 9.994826700742211e-06, 'epoch': 0.34}

 11%|█▏        | 1249/11049 [12:52<1:40:12,  1.63it/s]
 11%|█▏        | 1250/11049 [12:52<1:40:11,  1.63it/s]
                                                      
{'loss': 0.3025, 'grad_norm': 0.6503642797470093, 'learning_rate': 9.99475461248887e-06, 'epoch': 0.34}

 11%|█▏        | 1250/11049 [12:52<1:40:11,  1.63it/s]
 11%|█▏        | 1251/11049 [12:53<1:40:08,  1.63it/s]
                                                      
{'loss': 0.3097, 'grad_norm': 0.5588874816894531, 'learning_rate': 9.994682025705107e-06, 'epoch': 0.34}

 11%|█▏        | 1251/11049 [12:53<1:40:08,  1.63it/s]
 11%|█▏        | 1252/11049 [12:53<1:40:04,  1.63it/s]
                                                      
{'loss': 0.2539, 'grad_norm': 0.5787231922149658, 'learning_rate': 9.994608940398163e-06, 'epoch': 0.34}

 11%|█▏        | 1252/11049 [12:53<1:40:04,  1.63it/s]
 11%|█▏        | 1253/11049 [12:54<1:40:05,  1.63it/s]
                                                      
{'loss': 0.2819, 'grad_norm': 0.610502302646637, 'learning_rate': 9.994535356575336e-06, 'epoch': 0.34}

 11%|█▏        | 1253/11049 [12:54<1:40:05,  1.63it/s]
 11%|█▏        | 1254/11049 [12:54<1:40:08,  1.63it/s]
                                                      
{'loss': 0.403, 'grad_norm': 0.8597722053527832, 'learning_rate': 9.994461274243968e-06, 'epoch': 0.34}

 11%|█▏        | 1254/11049 [12:55<1:40:08,  1.63it/s]
 11%|█▏        | 1255/11049 [12:55<1:40:04,  1.63it/s]
                                                      
{'loss': 0.3891, 'grad_norm': 0.6679761409759521, 'learning_rate': 9.994386693411456e-06, 'epoch': 0.34}

 11%|█▏        | 1255/11049 [12:55<1:40:04,  1.63it/s]
 11%|█▏        | 1256/11049 [12:56<1:40:05,  1.63it/s]
                                                      
{'loss': 0.31, 'grad_norm': 0.5827556848526001, 'learning_rate': 9.994311614085241e-06, 'epoch': 0.34}

 11%|█▏        | 1256/11049 [12:56<1:40:05,  1.63it/s]
 11%|█▏        | 1257/11049 [12:56<1:40:04,  1.63it/s]
                                                      
{'loss': 0.3173, 'grad_norm': 0.6785059571266174, 'learning_rate': 9.994236036272819e-06, 'epoch': 0.34}

 11%|█▏        | 1257/11049 [12:56<1:40:04,  1.63it/s]
 11%|█▏        | 1258/11049 [12:57<1:40:07,  1.63it/s]
                                                      
{'loss': 0.481, 'grad_norm': 0.7222580313682556, 'learning_rate': 9.994159959981734e-06, 'epoch': 0.34}

 11%|█▏        | 1258/11049 [12:57<1:40:07,  1.63it/s]
 11%|█▏        | 1259/11049 [12:58<1:40:10,  1.63it/s]
                                                      
{'loss': 0.3274, 'grad_norm': 0.669520378112793, 'learning_rate': 9.994083385219578e-06, 'epoch': 0.34}

 11%|█▏        | 1259/11049 [12:58<1:40:10,  1.63it/s]
 11%|█▏        | 1260/11049 [12:58<1:40:07,  1.63it/s]
                                                      
{'loss': 0.2884, 'grad_norm': 0.5517908930778503, 'learning_rate': 9.99400631199399e-06, 'epoch': 0.34}

 11%|█▏        | 1260/11049 [12:58<1:40:07,  1.63it/s]
 11%|█▏        | 1261/11049 [12:59<1:40:07,  1.63it/s]
                                                      
{'loss': 0.3775, 'grad_norm': 0.6725715398788452, 'learning_rate': 9.99392874031267e-06, 'epoch': 0.34}

 11%|█▏        | 1261/11049 [12:59<1:40:07,  1.63it/s]
 11%|█▏        | 1262/11049 [12:59<1:40:05,  1.63it/s]
                                                      
{'loss': 0.3681, 'grad_norm': 0.7530138492584229, 'learning_rate': 9.993850670183357e-06, 'epoch': 0.34}

 11%|█▏        | 1262/11049 [13:00<1:40:05,  1.63it/s]
 11%|█▏        | 1263/11049 [13:00<1:40:06,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.6035922765731812, 'learning_rate': 9.993772101613844e-06, 'epoch': 0.34}

 11%|█▏        | 1263/11049 [13:00<1:40:06,  1.63it/s]
 11%|█▏        | 1264/11049 [13:01<1:40:02,  1.63it/s]
                                                      
{'loss': 0.3418, 'grad_norm': 0.7589396834373474, 'learning_rate': 9.993693034611972e-06, 'epoch': 0.34}

 11%|█▏        | 1264/11049 [13:01<1:40:02,  1.63it/s]
 11%|█▏        | 1265/11049 [13:01<1:39:59,  1.63it/s]
                                                      
{'loss': 0.3682, 'grad_norm': 0.6368406414985657, 'learning_rate': 9.993613469185631e-06, 'epoch': 0.34}

 11%|█▏        | 1265/11049 [13:01<1:39:59,  1.63it/s]
 11%|█▏        | 1266/11049 [13:02<1:40:02,  1.63it/s]
                                                      
{'loss': 0.3176, 'grad_norm': 0.6750198602676392, 'learning_rate': 9.993533405342765e-06, 'epoch': 0.34}

 11%|█▏        | 1266/11049 [13:02<1:40:02,  1.63it/s]
 11%|█▏        | 1267/11049 [13:02<1:39:56,  1.63it/s]
                                                      
{'loss': 0.2666, 'grad_norm': 0.6145618557929993, 'learning_rate': 9.993452843091366e-06, 'epoch': 0.34}

 11%|█▏        | 1267/11049 [13:03<1:39:56,  1.63it/s]
 11%|█▏        | 1268/11049 [13:03<1:39:56,  1.63it/s]
                                                      
{'loss': 0.3564, 'grad_norm': 0.6794209480285645, 'learning_rate': 9.993371782439476e-06, 'epoch': 0.34}

 11%|█▏        | 1268/11049 [13:03<1:39:56,  1.63it/s]
 11%|█▏        | 1269/11049 [13:04<1:39:55,  1.63it/s]
                                                      
{'loss': 0.2716, 'grad_norm': 0.6651943922042847, 'learning_rate': 9.99329022339518e-06, 'epoch': 0.34}

 11%|█▏        | 1269/11049 [13:04<1:39:55,  1.63it/s]
 11%|█▏        | 1270/11049 [13:04<1:39:54,  1.63it/s]
                                                      
{'loss': 0.3289, 'grad_norm': 0.6311401128768921, 'learning_rate': 9.993208165966624e-06, 'epoch': 0.34}

 11%|█▏        | 1270/11049 [13:04<1:39:54,  1.63it/s]
 12%|█▏        | 1271/11049 [13:05<1:39:55,  1.63it/s]
                                                      
{'loss': 0.3813, 'grad_norm': 0.6930119395256042, 'learning_rate': 9.993125610161996e-06, 'epoch': 0.35}

 12%|█▏        | 1271/11049 [13:05<1:39:55,  1.63it/s]
 12%|█▏        | 1272/11049 [13:06<1:39:52,  1.63it/s]
                                                      
{'loss': 0.29, 'grad_norm': 0.6830783486366272, 'learning_rate': 9.993042555989535e-06, 'epoch': 0.35}

 12%|█▏        | 1272/11049 [13:06<1:39:52,  1.63it/s]
 12%|█▏        | 1273/11049 [13:06<1:39:52,  1.63it/s]
                                                      
{'loss': 0.3191, 'grad_norm': 0.7686970829963684, 'learning_rate': 9.992959003457534e-06, 'epoch': 0.35}

 12%|█▏        | 1273/11049 [13:06<1:39:52,  1.63it/s]
 12%|█▏        | 1274/11049 [13:07<1:39:55,  1.63it/s]
                                                      
{'loss': 0.2806, 'grad_norm': 0.7141839265823364, 'learning_rate': 9.99287495257433e-06, 'epoch': 0.35}

 12%|█▏        | 1274/11049 [13:07<1:39:55,  1.63it/s]
 12%|█▏        | 1275/11049 [13:07<1:39:56,  1.63it/s]
                                                      
{'loss': 0.2992, 'grad_norm': 0.6850236058235168, 'learning_rate': 9.992790403348312e-06, 'epoch': 0.35}

 12%|█▏        | 1275/11049 [13:08<1:39:56,  1.63it/s]
 12%|█▏        | 1276/11049 [13:08<1:39:56,  1.63it/s]
                                                      
{'loss': 0.2669, 'grad_norm': 0.6797786951065063, 'learning_rate': 9.992705355787918e-06, 'epoch': 0.35}

 12%|█▏        | 1276/11049 [13:08<1:39:56,  1.63it/s]
 12%|█▏        | 1277/11049 [13:09<1:39:57,  1.63it/s]
                                                      
{'loss': 0.379, 'grad_norm': 0.6678248643875122, 'learning_rate': 9.99261980990164e-06, 'epoch': 0.35}

 12%|█▏        | 1277/11049 [13:09<1:39:57,  1.63it/s]
 12%|█▏        | 1278/11049 [13:09<1:39:56,  1.63it/s]
                                                      
{'loss': 0.3132, 'grad_norm': 0.68999844789505, 'learning_rate': 9.992533765698014e-06, 'epoch': 0.35}

 12%|█▏        | 1278/11049 [13:09<1:39:56,  1.63it/s]
 12%|█▏        | 1279/11049 [13:10<1:39:56,  1.63it/s]
                                                      
{'loss': 0.3248, 'grad_norm': 0.6467475295066833, 'learning_rate': 9.992447223185629e-06, 'epoch': 0.35}

 12%|█▏        | 1279/11049 [13:10<1:39:56,  1.63it/s]
 12%|█▏        | 1280/11049 [13:10<1:39:52,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.5729347467422485, 'learning_rate': 9.992360182373122e-06, 'epoch': 0.35}

 12%|█▏        | 1280/11049 [13:11<1:39:52,  1.63it/s]
 12%|█▏        | 1281/11049 [13:11<1:39:53,  1.63it/s]
                                                      
{'loss': 0.2952, 'grad_norm': 0.614162027835846, 'learning_rate': 9.992272643269181e-06, 'epoch': 0.35}

 12%|█▏        | 1281/11049 [13:11<1:39:53,  1.63it/s]
 12%|█▏        | 1282/11049 [13:12<1:39:52,  1.63it/s]
                                                      
{'loss': 0.3513, 'grad_norm': 0.7955994009971619, 'learning_rate': 9.992184605882544e-06, 'epoch': 0.35}

 12%|█▏        | 1282/11049 [13:12<1:39:52,  1.63it/s]
 12%|█▏        | 1283/11049 [13:12<1:39:52,  1.63it/s]
                                                      
{'loss': 0.5115, 'grad_norm': 0.679337739944458, 'learning_rate': 9.992096070221997e-06, 'epoch': 0.35}

 12%|█▏        | 1283/11049 [13:12<1:39:52,  1.63it/s]
 12%|█▏        | 1284/11049 [13:13<1:39:49,  1.63it/s]
                                                      
{'loss': 0.2399, 'grad_norm': 0.5912048816680908, 'learning_rate': 9.992007036296378e-06, 'epoch': 0.35}

 12%|█▏        | 1284/11049 [13:13<1:39:49,  1.63it/s]
 12%|█▏        | 1285/11049 [13:14<1:39:47,  1.63it/s]
                                                      
{'loss': 0.2868, 'grad_norm': 0.6081841588020325, 'learning_rate': 9.991917504114574e-06, 'epoch': 0.35}

 12%|█▏        | 1285/11049 [13:14<1:39:47,  1.63it/s]
 12%|█▏        | 1286/11049 [13:14<1:39:47,  1.63it/s]
                                                      
{'loss': 0.2775, 'grad_norm': 0.6561242938041687, 'learning_rate': 9.991827473685519e-06, 'epoch': 0.35}

 12%|█▏        | 1286/11049 [13:14<1:39:47,  1.63it/s]
 12%|█▏        | 1287/11049 [13:15<1:39:46,  1.63it/s]
                                                      
{'loss': 0.4776, 'grad_norm': 0.8219491243362427, 'learning_rate': 9.9917369450182e-06, 'epoch': 0.35}

 12%|█▏        | 1287/11049 [13:15<1:39:46,  1.63it/s]
 12%|█▏        | 1288/11049 [13:15<1:39:46,  1.63it/s]
                                                      
{'loss': 0.3262, 'grad_norm': 0.653150737285614, 'learning_rate': 9.991645918121654e-06, 'epoch': 0.35}

 12%|█▏        | 1288/11049 [13:15<1:39:46,  1.63it/s]
 12%|█▏        | 1289/11049 [13:16<1:39:44,  1.63it/s]
                                                      
{'loss': 0.3172, 'grad_norm': 0.6762862801551819, 'learning_rate': 9.991554393004965e-06, 'epoch': 0.35}

 12%|█▏        | 1289/11049 [13:16<1:39:44,  1.63it/s]
 12%|█▏        | 1290/11049 [13:17<1:39:45,  1.63it/s]
                                                      
{'loss': 0.3347, 'grad_norm': 0.6917020678520203, 'learning_rate': 9.991462369677269e-06, 'epoch': 0.35}

 12%|█▏        | 1290/11049 [13:17<1:39:45,  1.63it/s]
 12%|█▏        | 1291/11049 [13:17<1:39:45,  1.63it/s]
                                                      
{'loss': 0.2976, 'grad_norm': 0.7210416197776794, 'learning_rate': 9.99136984814775e-06, 'epoch': 0.35}

 12%|█▏        | 1291/11049 [13:17<1:39:45,  1.63it/s]
 12%|█▏        | 1292/11049 [13:18<1:39:42,  1.63it/s]
                                                      
{'loss': 0.3275, 'grad_norm': 0.6844819188117981, 'learning_rate': 9.991276828425642e-06, 'epoch': 0.35}

 12%|█▏        | 1292/11049 [13:18<1:39:42,  1.63it/s]
 12%|█▏        | 1293/11049 [13:18<1:39:41,  1.63it/s]
                                                      
{'loss': 0.2784, 'grad_norm': 0.6412713527679443, 'learning_rate': 9.991183310520234e-06, 'epoch': 0.35}

 12%|█▏        | 1293/11049 [13:19<1:39:41,  1.63it/s]
 12%|█▏        | 1294/11049 [13:19<1:39:38,  1.63it/s]
                                                      
{'loss': 0.3318, 'grad_norm': 0.6840740442276001, 'learning_rate': 9.991089294440855e-06, 'epoch': 0.35}

 12%|█▏        | 1294/11049 [13:19<1:39:38,  1.63it/s]
 12%|█▏        | 1295/11049 [13:20<1:39:37,  1.63it/s]
                                                      
{'loss': 0.4345, 'grad_norm': 0.8080791234970093, 'learning_rate': 9.99099478019689e-06, 'epoch': 0.35}

 12%|█▏        | 1295/11049 [13:20<1:39:37,  1.63it/s]
 12%|█▏        | 1296/11049 [13:20<1:39:39,  1.63it/s]
                                                      
{'loss': 0.3316, 'grad_norm': 0.6679157018661499, 'learning_rate': 9.990899767797772e-06, 'epoch': 0.35}

 12%|█▏        | 1296/11049 [13:20<1:39:39,  1.63it/s]
 12%|█▏        | 1297/11049 [13:21<1:39:39,  1.63it/s]
                                                      
{'loss': 0.2497, 'grad_norm': 0.561091423034668, 'learning_rate': 9.990804257252987e-06, 'epoch': 0.35}

 12%|█▏        | 1297/11049 [13:21<1:39:39,  1.63it/s]
 12%|█▏        | 1298/11049 [13:21<1:39:38,  1.63it/s]
                                                      
{'loss': 0.3717, 'grad_norm': 0.7388803958892822, 'learning_rate': 9.990708248572065e-06, 'epoch': 0.35}

 12%|█▏        | 1298/11049 [13:22<1:39:38,  1.63it/s]
 12%|█▏        | 1299/11049 [13:22<1:39:36,  1.63it/s]
                                                      
{'loss': 0.24, 'grad_norm': 0.5498367547988892, 'learning_rate': 9.990611741764593e-06, 'epoch': 0.35}

 12%|█▏        | 1299/11049 [13:22<1:39:36,  1.63it/s]
 12%|█▏        | 1300/11049 [13:23<1:39:40,  1.63it/s]
                                                      
{'loss': 0.4344, 'grad_norm': 0.6521177291870117, 'learning_rate': 9.990514736840197e-06, 'epoch': 0.35}

 12%|█▏        | 1300/11049 [13:23<1:39:40,  1.63it/s]
 12%|█▏        | 1301/11049 [13:23<1:39:39,  1.63it/s]
                                                      
{'loss': 0.2617, 'grad_norm': 0.5261813402175903, 'learning_rate': 9.990417233808564e-06, 'epoch': 0.35}

 12%|█▏        | 1301/11049 [13:23<1:39:39,  1.63it/s]
 12%|█▏        | 1302/11049 [13:24<1:39:35,  1.63it/s]
                                                      
{'loss': 0.3257, 'grad_norm': 0.6928198933601379, 'learning_rate': 9.990319232679424e-06, 'epoch': 0.35}

 12%|█▏        | 1302/11049 [13:24<1:39:35,  1.63it/s]
 12%|█▏        | 1303/11049 [13:25<1:39:33,  1.63it/s]
                                                      
{'loss': 0.3428, 'grad_norm': 0.9434661269187927, 'learning_rate': 9.990220733462559e-06, 'epoch': 0.35}

 12%|█▏        | 1303/11049 [13:25<1:39:33,  1.63it/s]
 12%|█▏        | 1304/11049 [13:25<1:39:33,  1.63it/s]
                                                      
{'loss': 0.3759, 'grad_norm': 0.7722768783569336, 'learning_rate': 9.990121736167802e-06, 'epoch': 0.35}

 12%|█▏        | 1304/11049 [13:25<1:39:33,  1.63it/s]
 12%|█▏        | 1305/11049 [13:26<1:39:33,  1.63it/s]
                                                      
{'loss': 0.3302, 'grad_norm': 0.6585659384727478, 'learning_rate': 9.99002224080503e-06, 'epoch': 0.35}

 12%|█▏        | 1305/11049 [13:26<1:39:33,  1.63it/s]
 12%|█▏        | 1306/11049 [13:26<1:39:30,  1.63it/s]
                                                      
{'loss': 0.3416, 'grad_norm': 0.7284547090530396, 'learning_rate': 9.989922247384177e-06, 'epoch': 0.35}

 12%|█▏        | 1306/11049 [13:27<1:39:30,  1.63it/s]
 12%|█▏        | 1307/11049 [13:27<1:39:31,  1.63it/s]
                                                      
{'loss': 0.2808, 'grad_norm': 0.5993046760559082, 'learning_rate': 9.989821755915222e-06, 'epoch': 0.35}

 12%|█▏        | 1307/11049 [13:27<1:39:31,  1.63it/s]
 12%|█▏        | 1308/11049 [13:28<1:39:29,  1.63it/s]
                                                      
{'loss': 0.4012, 'grad_norm': 0.6955395340919495, 'learning_rate': 9.989720766408196e-06, 'epoch': 0.36}

 12%|█▏        | 1308/11049 [13:28<1:39:29,  1.63it/s]
 12%|█▏        | 1309/11049 [13:28<1:39:31,  1.63it/s]
                                                      
{'loss': 0.2869, 'grad_norm': 0.6595327854156494, 'learning_rate': 9.989619278873179e-06, 'epoch': 0.36}

 12%|█▏        | 1309/11049 [13:28<1:39:31,  1.63it/s]
 12%|█▏        | 1310/11049 [13:29<1:39:31,  1.63it/s]
                                                      
{'loss': 0.3568, 'grad_norm': 0.6866689920425415, 'learning_rate': 9.9895172933203e-06, 'epoch': 0.36}

 12%|█▏        | 1310/11049 [13:29<1:39:31,  1.63it/s]
 12%|█▏        | 1311/11049 [13:29<1:39:30,  1.63it/s]
                                                      
{'loss': 0.3605, 'grad_norm': 0.5891342759132385, 'learning_rate': 9.989414809759736e-06, 'epoch': 0.36}

 12%|█▏        | 1311/11049 [13:30<1:39:30,  1.63it/s]
 12%|█▏        | 1312/11049 [13:30<1:39:31,  1.63it/s]
                                                      
{'loss': 0.3412, 'grad_norm': 0.7717442512512207, 'learning_rate': 9.98931182820172e-06, 'epoch': 0.36}

 12%|█▏        | 1312/11049 [13:30<1:39:31,  1.63it/s]
 12%|█▏        | 1313/11049 [13:31<1:39:32,  1.63it/s]
                                                      
{'loss': 0.3095, 'grad_norm': 0.6564860939979553, 'learning_rate': 9.989208348656528e-06, 'epoch': 0.36}

 12%|█▏        | 1313/11049 [13:31<1:39:32,  1.63it/s]
 12%|█▏        | 1314/11049 [13:31<1:39:32,  1.63it/s]
                                                      
{'loss': 0.3266, 'grad_norm': 0.7894708514213562, 'learning_rate': 9.989104371134489e-06, 'epoch': 0.36}

 12%|█▏        | 1314/11049 [13:31<1:39:32,  1.63it/s]
 12%|█▏        | 1315/11049 [13:32<1:39:28,  1.63it/s]
                                                      
{'loss': 0.3742, 'grad_norm': 0.643782377243042, 'learning_rate': 9.988999895645982e-06, 'epoch': 0.36}

 12%|█▏        | 1315/11049 [13:32<1:39:28,  1.63it/s]
 12%|█▏        | 1316/11049 [13:33<1:39:27,  1.63it/s]
                                                      
{'loss': 0.2828, 'grad_norm': 0.5500074028968811, 'learning_rate': 9.988894922201433e-06, 'epoch': 0.36}

 12%|█▏        | 1316/11049 [13:33<1:39:27,  1.63it/s]
 12%|█▏        | 1317/11049 [13:33<1:39:29,  1.63it/s]
                                                      
{'loss': 0.3434, 'grad_norm': 0.629618763923645, 'learning_rate': 9.988789450811322e-06, 'epoch': 0.36}

 12%|█▏        | 1317/11049 [13:33<1:39:29,  1.63it/s]
 12%|█▏        | 1318/11049 [13:34<1:39:34,  1.63it/s]
                                                      
{'loss': 0.2647, 'grad_norm': 0.5951254367828369, 'learning_rate': 9.988683481486175e-06, 'epoch': 0.36}

 12%|█▏        | 1318/11049 [13:34<1:39:34,  1.63it/s]
 12%|█▏        | 1319/11049 [13:34<1:39:37,  1.63it/s]
                                                      
{'loss': 0.3179, 'grad_norm': 0.664793074131012, 'learning_rate': 9.988577014236567e-06, 'epoch': 0.36}

 12%|█▏        | 1319/11049 [13:34<1:39:37,  1.63it/s]
 12%|█▏        | 1320/11049 [13:35<1:39:34,  1.63it/s]
                                                      
{'loss': 0.2543, 'grad_norm': 0.6747415661811829, 'learning_rate': 9.988470049073127e-06, 'epoch': 0.36}

 12%|█▏        | 1320/11049 [13:35<1:39:34,  1.63it/s]
 12%|█▏        | 1321/11049 [13:36<1:39:32,  1.63it/s]
                                                      
{'loss': 0.303, 'grad_norm': 0.6835963726043701, 'learning_rate': 9.988362586006531e-06, 'epoch': 0.36}

 12%|█▏        | 1321/11049 [13:36<1:39:32,  1.63it/s]
 12%|█▏        | 1322/11049 [13:36<1:39:33,  1.63it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.8135627508163452, 'learning_rate': 9.988254625047504e-06, 'epoch': 0.36}

 12%|█▏        | 1322/11049 [13:36<1:39:33,  1.63it/s]
 12%|█▏        | 1323/11049 [13:37<1:39:27,  1.63it/s]
                                                      
{'loss': 0.3022, 'grad_norm': 0.5676355361938477, 'learning_rate': 9.988146166206822e-06, 'epoch': 0.36}

 12%|█▏        | 1323/11049 [13:37<1:39:27,  1.63it/s]
 12%|█▏        | 1324/11049 [13:37<1:39:25,  1.63it/s]
                                                      
{'loss': 0.3841, 'grad_norm': 0.7068724036216736, 'learning_rate': 9.98803720949531e-06, 'epoch': 0.36}

 12%|█▏        | 1324/11049 [13:38<1:39:25,  1.63it/s]
 12%|█▏        | 1325/11049 [13:38<1:39:27,  1.63it/s]
                                                      
{'loss': 0.3416, 'grad_norm': 0.6779422163963318, 'learning_rate': 9.987927754923844e-06, 'epoch': 0.36}

 12%|█▏        | 1325/11049 [13:38<1:39:27,  1.63it/s]
 12%|█▏        | 1326/11049 [13:39<1:39:32,  1.63it/s]
                                                      
{'loss': 0.3107, 'grad_norm': 0.6116988658905029, 'learning_rate': 9.987817802503347e-06, 'epoch': 0.36}

 12%|█▏        | 1326/11049 [13:39<1:39:32,  1.63it/s]
 12%|█▏        | 1327/11049 [13:39<1:39:29,  1.63it/s]
                                                      
{'loss': 0.282, 'grad_norm': 0.5985251665115356, 'learning_rate': 9.987707352244797e-06, 'epoch': 0.36}

 12%|█▏        | 1327/11049 [13:39<1:39:29,  1.63it/s]
 12%|█▏        | 1328/11049 [13:40<1:39:26,  1.63it/s]
                                                      
{'loss': 0.3464, 'grad_norm': 0.6594244837760925, 'learning_rate': 9.987596404159214e-06, 'epoch': 0.36}

 12%|█▏        | 1328/11049 [13:40<1:39:26,  1.63it/s]
 12%|█▏        | 1329/11049 [13:41<1:39:21,  1.63it/s]
                                                      
{'loss': 0.3616, 'grad_norm': 0.7097268104553223, 'learning_rate': 9.987484958257675e-06, 'epoch': 0.36}

 12%|█▏        | 1329/11049 [13:41<1:39:21,  1.63it/s]
 12%|█▏        | 1330/11049 [13:41<1:39:19,  1.63it/s]
                                                      
{'loss': 0.2568, 'grad_norm': 0.6625463366508484, 'learning_rate': 9.987373014551302e-06, 'epoch': 0.36}

 12%|█▏        | 1330/11049 [13:41<1:39:19,  1.63it/s]
 12%|█▏        | 1331/11049 [13:42<1:39:25,  1.63it/s]
                                                      
{'loss': 0.2851, 'grad_norm': 0.6628356575965881, 'learning_rate': 9.987260573051268e-06, 'epoch': 0.36}

 12%|█▏        | 1331/11049 [13:42<1:39:25,  1.63it/s]
 12%|█▏        | 1332/11049 [13:42<1:39:22,  1.63it/s]
                                                      
{'loss': 0.2257, 'grad_norm': 0.5497474670410156, 'learning_rate': 9.987147633768798e-06, 'epoch': 0.36}

 12%|█▏        | 1332/11049 [13:42<1:39:22,  1.63it/s]
 12%|█▏        | 1333/11049 [13:43<1:39:20,  1.63it/s]
                                                      
{'loss': 0.2984, 'grad_norm': 0.6244874596595764, 'learning_rate': 9.98703419671516e-06, 'epoch': 0.36}

 12%|█▏        | 1333/11049 [13:43<1:39:20,  1.63it/s]
 12%|█▏        | 1334/11049 [13:44<1:39:20,  1.63it/s]
                                                      
{'loss': 0.2883, 'grad_norm': 0.6237589120864868, 'learning_rate': 9.98692026190168e-06, 'epoch': 0.36}

 12%|█▏        | 1334/11049 [13:44<1:39:20,  1.63it/s]
 12%|█▏        | 1335/11049 [13:44<1:39:18,  1.63it/s]
                                                      
{'loss': 0.3241, 'grad_norm': 0.7047566175460815, 'learning_rate': 9.98680582933973e-06, 'epoch': 0.36}

 12%|█▏        | 1335/11049 [13:44<1:39:18,  1.63it/s]
 12%|█▏        | 1336/11049 [13:45<1:39:33,  1.63it/s]
                                                      
{'loss': 0.4453, 'grad_norm': 0.7301381230354309, 'learning_rate': 9.98669089904073e-06, 'epoch': 0.36}

 12%|█▏        | 1336/11049 [13:45<1:39:33,  1.63it/s]
 12%|█▏        | 1337/11049 [13:45<1:39:23,  1.63it/s]
                                                      
{'loss': 0.2568, 'grad_norm': 0.5927438139915466, 'learning_rate': 9.986575471016152e-06, 'epoch': 0.36}

 12%|█▏        | 1337/11049 [13:46<1:39:23,  1.63it/s]
 12%|█▏        | 1338/11049 [13:46<1:39:23,  1.63it/s]
                                                      
{'loss': 0.2884, 'grad_norm': 0.6278825998306274, 'learning_rate': 9.986459545277515e-06, 'epoch': 0.36}

 12%|█▏        | 1338/11049 [13:46<1:39:23,  1.63it/s]
 12%|█▏        | 1339/11049 [13:47<1:39:19,  1.63it/s]
                                                      
{'loss': 0.3556, 'grad_norm': 0.7557564377784729, 'learning_rate': 9.986343121836393e-06, 'epoch': 0.36}

 12%|█▏        | 1339/11049 [13:47<1:39:19,  1.63it/s]
 12%|█▏        | 1340/11049 [13:47<1:39:17,  1.63it/s]
                                                      
{'loss': 0.3385, 'grad_norm': 0.7075732946395874, 'learning_rate': 9.986226200704405e-06, 'epoch': 0.36}

 12%|█▏        | 1340/11049 [13:47<1:39:17,  1.63it/s]
 12%|█▏        | 1341/11049 [13:48<1:39:22,  1.63it/s]
                                                      
{'loss': 0.3416, 'grad_norm': 0.697961688041687, 'learning_rate': 9.98610878189322e-06, 'epoch': 0.36}

 12%|█▏        | 1341/11049 [13:48<1:39:22,  1.63it/s]
 12%|█▏        | 1342/11049 [13:48<1:39:17,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.5595077276229858, 'learning_rate': 9.985990865414558e-06, 'epoch': 0.36}

 12%|█▏        | 1342/11049 [13:49<1:39:17,  1.63it/s]
 12%|█▏        | 1343/11049 [13:49<1:39:16,  1.63it/s]
                                                      
{'loss': 0.2804, 'grad_norm': 0.7031214237213135, 'learning_rate': 9.98587245128019e-06, 'epoch': 0.36}

 12%|█▏        | 1343/11049 [13:49<1:39:16,  1.63it/s]
 12%|█▏        | 1344/11049 [13:50<1:39:14,  1.63it/s]
                                                      
{'loss': 0.254, 'grad_norm': 0.5858187079429626, 'learning_rate': 9.985753539501933e-06, 'epoch': 0.36}

 12%|█▏        | 1344/11049 [13:50<1:39:14,  1.63it/s]
 12%|█▏        | 1345/11049 [13:50<1:39:11,  1.63it/s]
                                                      
{'loss': 0.3094, 'grad_norm': 0.5843153595924377, 'learning_rate': 9.985634130091656e-06, 'epoch': 0.37}

 12%|█▏        | 1345/11049 [13:50<1:39:11,  1.63it/s]
 12%|█▏        | 1346/11049 [13:51<1:39:20,  1.63it/s]
                                                      
{'loss': 0.3889, 'grad_norm': 0.7294453978538513, 'learning_rate': 9.98551422306128e-06, 'epoch': 0.37}

 12%|█▏        | 1346/11049 [13:51<1:39:20,  1.63it/s]
 12%|█▏        | 1347/11049 [13:52<1:39:15,  1.63it/s]
                                                      
{'loss': 0.3834, 'grad_norm': 0.8569225072860718, 'learning_rate': 9.985393818422768e-06, 'epoch': 0.37}

 12%|█▏        | 1347/11049 [13:52<1:39:15,  1.63it/s]
 12%|█▏        | 1348/11049 [13:52<1:39:16,  1.63it/s]
                                                      
{'loss': 0.3697, 'grad_norm': 0.6715961694717407, 'learning_rate': 9.985272916188142e-06, 'epoch': 0.37}

 12%|█▏        | 1348/11049 [13:52<1:39:16,  1.63it/s]
 12%|█▏        | 1349/11049 [13:53<1:39:13,  1.63it/s]
                                                      
{'loss': 0.2919, 'grad_norm': 0.5618409514427185, 'learning_rate': 9.985151516369469e-06, 'epoch': 0.37}

 12%|█▏        | 1349/11049 [13:53<1:39:13,  1.63it/s]
 12%|█▏        | 1350/11049 [13:53<1:39:10,  1.63it/s]
                                                      
{'loss': 0.3674, 'grad_norm': 0.6866025328636169, 'learning_rate': 9.985029618978863e-06, 'epoch': 0.37}

 12%|█▏        | 1350/11049 [13:54<1:39:10,  1.63it/s]
 12%|█▏        | 1351/11049 [13:54<1:39:15,  1.63it/s]
                                                      
{'loss': 0.3078, 'grad_norm': 0.6789352893829346, 'learning_rate': 9.984907224028492e-06, 'epoch': 0.37}

 12%|█▏        | 1351/11049 [13:54<1:39:15,  1.63it/s]
 12%|█▏        | 1352/11049 [13:55<1:39:14,  1.63it/s]
                                                      
{'loss': 0.2836, 'grad_norm': 0.6832115650177002, 'learning_rate': 9.984784331530575e-06, 'epoch': 0.37}

 12%|█▏        | 1352/11049 [13:55<1:39:14,  1.63it/s]
 12%|█▏        | 1353/11049 [13:55<1:39:09,  1.63it/s]
                                                      
{'loss': 0.3739, 'grad_norm': 0.5893692970275879, 'learning_rate': 9.984660941497375e-06, 'epoch': 0.37}

 12%|█▏        | 1353/11049 [13:55<1:39:09,  1.63it/s]
 12%|█▏        | 1354/11049 [13:56<1:39:07,  1.63it/s]
                                                      
{'loss': 0.3267, 'grad_norm': 0.6878709197044373, 'learning_rate': 9.984537053941208e-06, 'epoch': 0.37}

 12%|█▏        | 1354/11049 [13:56<1:39:07,  1.63it/s]
 12%|█▏        | 1355/11049 [13:56<1:39:11,  1.63it/s]
                                                      
{'loss': 0.3334, 'grad_norm': 0.6728023886680603, 'learning_rate': 9.98441266887444e-06, 'epoch': 0.37}

 12%|█▏        | 1355/11049 [13:57<1:39:11,  1.63it/s]
 12%|█▏        | 1356/11049 [13:57<1:39:14,  1.63it/s]
                                                      
{'loss': 0.3384, 'grad_norm': 0.6617223024368286, 'learning_rate': 9.984287786309487e-06, 'epoch': 0.37}

 12%|█▏        | 1356/11049 [13:57<1:39:14,  1.63it/s]
 12%|█▏        | 1357/11049 [13:58<1:39:10,  1.63it/s]
                                                      
{'loss': 0.3512, 'grad_norm': 0.6482625007629395, 'learning_rate': 9.98416240625881e-06, 'epoch': 0.37}

 12%|█▏        | 1357/11049 [13:58<1:39:10,  1.63it/s]
 12%|█▏        | 1358/11049 [13:58<1:39:10,  1.63it/s]
                                                      
{'loss': 0.3224, 'grad_norm': 0.6400099992752075, 'learning_rate': 9.984036528734928e-06, 'epoch': 0.37}

 12%|█▏        | 1358/11049 [13:58<1:39:10,  1.63it/s]
 12%|█▏        | 1359/11049 [13:59<1:39:05,  1.63it/s]
                                                      
{'loss': 0.3467, 'grad_norm': 0.7254176735877991, 'learning_rate': 9.983910153750402e-06, 'epoch': 0.37}

 12%|█▏        | 1359/11049 [13:59<1:39:05,  1.63it/s]
 12%|█▏        | 1360/11049 [14:00<1:39:06,  1.63it/s]
                                                      
{'loss': 0.3078, 'grad_norm': 0.7295545339584351, 'learning_rate': 9.983783281317847e-06, 'epoch': 0.37}

 12%|█▏        | 1360/11049 [14:00<1:39:06,  1.63it/s]
 12%|█▏        | 1361/11049 [14:00<1:39:14,  1.63it/s]
                                                      
{'loss': 0.2866, 'grad_norm': 0.6383029818534851, 'learning_rate': 9.983655911449922e-06, 'epoch': 0.37}

 12%|█▏        | 1361/11049 [14:00<1:39:14,  1.63it/s]
 12%|█▏        | 1362/11049 [14:01<1:39:12,  1.63it/s]
                                                      
{'loss': 0.3887, 'grad_norm': 0.677056610584259, 'learning_rate': 9.983528044159348e-06, 'epoch': 0.37}

 12%|█▏        | 1362/11049 [14:01<1:39:12,  1.63it/s]
 12%|█▏        | 1363/11049 [14:01<1:39:08,  1.63it/s]
                                                      
{'loss': 0.2367, 'grad_norm': 0.4884684681892395, 'learning_rate': 9.98339967945888e-06, 'epoch': 0.37}

 12%|█▏        | 1363/11049 [14:02<1:39:08,  1.63it/s]
 12%|█▏        | 1364/11049 [14:02<1:39:04,  1.63it/s]
                                                      
{'loss': 0.3329, 'grad_norm': 0.7045698761940002, 'learning_rate': 9.983270817361335e-06, 'epoch': 0.37}

 12%|█▏        | 1364/11049 [14:02<1:39:04,  1.63it/s]
 12%|█▏        | 1365/11049 [14:03<1:38:59,  1.63it/s]
                                                      
{'loss': 0.3623, 'grad_norm': 0.741098165512085, 'learning_rate': 9.983141457879572e-06, 'epoch': 0.37}

 12%|█▏        | 1365/11049 [14:03<1:38:59,  1.63it/s]
 12%|█▏        | 1366/11049 [14:03<1:39:07,  1.63it/s]
                                                      
{'loss': 0.3375, 'grad_norm': 0.7131298184394836, 'learning_rate': 9.983011601026503e-06, 'epoch': 0.37}

 12%|█▏        | 1366/11049 [14:03<1:39:07,  1.63it/s]
 12%|█▏        | 1367/11049 [14:04<1:39:05,  1.63it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.5188421607017517, 'learning_rate': 9.982881246815091e-06, 'epoch': 0.37}

 12%|█▏        | 1367/11049 [14:04<1:39:05,  1.63it/s]
 12%|█▏        | 1368/11049 [14:04<1:39:03,  1.63it/s]
                                                      
{'loss': 0.3105, 'grad_norm': 0.7021260261535645, 'learning_rate': 9.982750395258343e-06, 'epoch': 0.37}

 12%|█▏        | 1368/11049 [14:05<1:39:03,  1.63it/s]
 12%|█▏        | 1369/11049 [14:05<1:38:58,  1.63it/s]
                                                      
{'loss': 0.4151, 'grad_norm': 0.7215383052825928, 'learning_rate': 9.982619046369321e-06, 'epoch': 0.37}

 12%|█▏        | 1369/11049 [14:05<1:38:58,  1.63it/s]
 12%|█▏        | 1370/11049 [14:06<1:38:54,  1.63it/s]
                                                      
{'loss': 0.3918, 'grad_norm': 0.7853930592536926, 'learning_rate': 9.98248720016114e-06, 'epoch': 0.37}

 12%|█▏        | 1370/11049 [14:06<1:38:54,  1.63it/s]
 12%|█▏        | 1371/11049 [14:06<1:38:55,  1.63it/s]
                                                      
{'loss': 0.3325, 'grad_norm': 0.6821686029434204, 'learning_rate': 9.982354856646951e-06, 'epoch': 0.37}

 12%|█▏        | 1371/11049 [14:06<1:38:55,  1.63it/s]
 12%|█▏        | 1372/11049 [14:07<1:38:55,  1.63it/s]
                                                      
{'loss': 0.2962, 'grad_norm': 0.5975596308708191, 'learning_rate': 9.982222015839971e-06, 'epoch': 0.37}

 12%|█▏        | 1372/11049 [14:07<1:38:55,  1.63it/s]
 12%|█▏        | 1373/11049 [14:08<1:38:57,  1.63it/s]
                                                      
{'loss': 0.3557, 'grad_norm': 0.7323317527770996, 'learning_rate': 9.982088677753453e-06, 'epoch': 0.37}

 12%|█▏        | 1373/11049 [14:08<1:38:57,  1.63it/s]
 12%|█▏        | 1374/11049 [14:08<1:38:55,  1.63it/s]
                                                      
{'loss': 0.3067, 'grad_norm': 0.7269939184188843, 'learning_rate': 9.98195484240071e-06, 'epoch': 0.37}

 12%|█▏        | 1374/11049 [14:08<1:38:55,  1.63it/s]
 12%|█▏        | 1375/11049 [14:09<1:38:54,  1.63it/s]
                                                      
{'loss': 0.3349, 'grad_norm': 0.5842382907867432, 'learning_rate': 9.981820509795097e-06, 'epoch': 0.37}

 12%|█▏        | 1375/11049 [14:09<1:38:54,  1.63it/s]
 12%|█▏        | 1376/11049 [14:09<1:39:02,  1.63it/s]
                                                      
{'loss': 0.2369, 'grad_norm': 0.5969855189323425, 'learning_rate': 9.981685679950024e-06, 'epoch': 0.37}

 12%|█▏        | 1376/11049 [14:09<1:39:02,  1.63it/s]
 12%|█▏        | 1377/11049 [14:10<1:38:57,  1.63it/s]
                                                      
{'loss': 0.3041, 'grad_norm': 0.6360580921173096, 'learning_rate': 9.981550352878948e-06, 'epoch': 0.37}

 12%|█▏        | 1377/11049 [14:10<1:38:57,  1.63it/s]
 12%|█▏        | 1378/11049 [14:11<1:38:53,  1.63it/s]
                                                      
{'loss': 0.4184, 'grad_norm': 0.8072965145111084, 'learning_rate': 9.981414528595375e-06, 'epoch': 0.37}

 12%|█▏        | 1378/11049 [14:11<1:38:53,  1.63it/s]
 12%|█▏        | 1379/11049 [14:11<1:38:55,  1.63it/s]
                                                      
{'loss': 0.3401, 'grad_norm': 0.7053810358047485, 'learning_rate': 9.981278207112863e-06, 'epoch': 0.37}

 12%|█▏        | 1379/11049 [14:11<1:38:55,  1.63it/s]
 12%|█▏        | 1380/11049 [14:12<1:38:53,  1.63it/s]
                                                      
{'loss': 0.3701, 'grad_norm': 0.6010837554931641, 'learning_rate': 9.981141388445019e-06, 'epoch': 0.37}

 12%|█▏        | 1380/11049 [14:12<1:38:53,  1.63it/s]
 12%|█▏        | 1381/11049 [14:12<1:38:59,  1.63it/s]
                                                      
{'loss': 0.2865, 'grad_norm': 0.6379466652870178, 'learning_rate': 9.981004072605497e-06, 'epoch': 0.37}

 12%|█▏        | 1381/11049 [14:13<1:38:59,  1.63it/s]
 13%|█▎        | 1382/11049 [14:13<1:38:53,  1.63it/s]
                                                      
{'loss': 0.2848, 'grad_norm': 0.6512793302536011, 'learning_rate': 9.980866259608004e-06, 'epoch': 0.38}

 13%|█▎        | 1382/11049 [14:13<1:38:53,  1.63it/s]
 13%|█▎        | 1383/11049 [14:14<1:38:51,  1.63it/s]
                                                      
{'loss': 0.3396, 'grad_norm': 0.6309974789619446, 'learning_rate': 9.980727949466293e-06, 'epoch': 0.38}

 13%|█▎        | 1383/11049 [14:14<1:38:51,  1.63it/s]
 13%|█▎        | 1384/11049 [14:14<1:38:48,  1.63it/s]
                                                      
{'loss': 0.3164, 'grad_norm': 0.6181610226631165, 'learning_rate': 9.980589142194173e-06, 'epoch': 0.38}

 13%|█▎        | 1384/11049 [14:14<1:38:48,  1.63it/s]
 13%|█▎        | 1385/11049 [14:15<1:38:47,  1.63it/s]
                                                      
{'loss': 0.3437, 'grad_norm': 0.7630828022956848, 'learning_rate': 9.980449837805495e-06, 'epoch': 0.38}

 13%|█▎        | 1385/11049 [14:15<1:38:47,  1.63it/s]
 13%|█▎        | 1386/11049 [14:15<1:38:55,  1.63it/s]
                                                      
{'loss': 0.2674, 'grad_norm': 0.5632255673408508, 'learning_rate': 9.980310036314163e-06, 'epoch': 0.38}

 13%|█▎        | 1386/11049 [14:16<1:38:55,  1.63it/s]
 13%|█▎        | 1387/11049 [14:16<1:38:50,  1.63it/s]
                                                      
{'loss': 0.3315, 'grad_norm': 0.6324520707130432, 'learning_rate': 9.980169737734133e-06, 'epoch': 0.38}

 13%|█▎        | 1387/11049 [14:16<1:38:50,  1.63it/s]
 13%|█▎        | 1388/11049 [14:17<1:38:49,  1.63it/s]
                                                      
{'loss': 0.3698, 'grad_norm': 0.6598489880561829, 'learning_rate': 9.980028942079408e-06, 'epoch': 0.38}

 13%|█▎        | 1388/11049 [14:17<1:38:49,  1.63it/s]
 13%|█▎        | 1389/11049 [14:17<1:38:47,  1.63it/s]
                                                      
{'loss': 0.4074, 'grad_norm': 0.7265639901161194, 'learning_rate': 9.979887649364038e-06, 'epoch': 0.38}

 13%|█▎        | 1389/11049 [14:17<1:38:47,  1.63it/s]
 13%|█▎        | 1390/11049 [14:18<1:38:45,  1.63it/s]
                                                      
{'loss': 0.3053, 'grad_norm': 0.577301025390625, 'learning_rate': 9.979745859602129e-06, 'epoch': 0.38}

 13%|█▎        | 1390/11049 [14:18<1:38:45,  1.63it/s]
 13%|█▎        | 1391/11049 [14:19<1:38:52,  1.63it/s]
                                                      
{'loss': 0.3327, 'grad_norm': 0.7083006501197815, 'learning_rate': 9.979603572807831e-06, 'epoch': 0.38}

 13%|█▎        | 1391/11049 [14:19<1:38:52,  1.63it/s]
 13%|█▎        | 1392/11049 [14:19<1:38:46,  1.63it/s]
                                                      
{'loss': 0.2901, 'grad_norm': 0.6088129281997681, 'learning_rate': 9.979460788995348e-06, 'epoch': 0.38}

 13%|█▎        | 1392/11049 [14:19<1:38:46,  1.63it/s]
 13%|█▎        | 1393/11049 [14:20<1:38:43,  1.63it/s]
                                                      
{'loss': 0.2946, 'grad_norm': 0.5995288491249084, 'learning_rate': 9.979317508178929e-06, 'epoch': 0.38}

 13%|█▎        | 1393/11049 [14:20<1:38:43,  1.63it/s]
 13%|█▎        | 1394/11049 [14:20<1:38:42,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.5813639163970947, 'learning_rate': 9.979173730372875e-06, 'epoch': 0.38}

 13%|█▎        | 1394/11049 [14:21<1:38:42,  1.63it/s]
 13%|█▎        | 1395/11049 [14:21<1:38:40,  1.63it/s]
                                                      
{'loss': 0.3419, 'grad_norm': 0.5821318030357361, 'learning_rate': 9.979029455591538e-06, 'epoch': 0.38}

 13%|█▎        | 1395/11049 [14:21<1:38:40,  1.63it/s]
 13%|█▎        | 1396/11049 [14:22<1:38:44,  1.63it/s]
                                                      
{'loss': 0.3309, 'grad_norm': 0.6437402367591858, 'learning_rate': 9.978884683849317e-06, 'epoch': 0.38}

 13%|█▎        | 1396/11049 [14:22<1:38:44,  1.63it/s]
 13%|█▎        | 1397/11049 [14:22<1:38:43,  1.63it/s]
                                                      
{'loss': 0.3147, 'grad_norm': 0.6304412484169006, 'learning_rate': 9.978739415160663e-06, 'epoch': 0.38}

 13%|█▎        | 1397/11049 [14:22<1:38:43,  1.63it/s]
 13%|█▎        | 1398/11049 [14:23<1:38:40,  1.63it/s]
                                                      
{'loss': 0.3337, 'grad_norm': 0.630934476852417, 'learning_rate': 9.978593649540076e-06, 'epoch': 0.38}

 13%|█▎        | 1398/11049 [14:23<1:38:40,  1.63it/s]
 13%|█▎        | 1399/11049 [14:23<1:38:37,  1.63it/s]
                                                      
{'loss': 0.3395, 'grad_norm': 0.6415051221847534, 'learning_rate': 9.978447387002102e-06, 'epoch': 0.38}

 13%|█▎        | 1399/11049 [14:24<1:38:37,  1.63it/s]
 13%|█▎        | 1400/11049 [14:24<1:38:35,  1.63it/s]
                                                      
{'loss': 0.2903, 'grad_norm': 0.660109281539917, 'learning_rate': 9.978300627561343e-06, 'epoch': 0.38}

 13%|█▎        | 1400/11049 [14:24<1:38:35,  1.63it/s]
 13%|█▎        | 1401/11049 [14:25<1:38:36,  1.63it/s]
                                                      
{'loss': 0.2779, 'grad_norm': 0.5720487236976624, 'learning_rate': 9.978153371232444e-06, 'epoch': 0.38}

 13%|█▎        | 1401/11049 [14:25<1:38:36,  1.63it/s]
 13%|█▎        | 1402/11049 [14:25<1:38:33,  1.63it/s]
                                                      
{'loss': 0.3322, 'grad_norm': 0.7073920369148254, 'learning_rate': 9.978005618030104e-06, 'epoch': 0.38}

 13%|█▎        | 1402/11049 [14:25<1:38:33,  1.63it/s]
 13%|█▎        | 1403/11049 [14:26<1:38:34,  1.63it/s]
                                                      
{'loss': 0.3775, 'grad_norm': 0.6127465963363647, 'learning_rate': 9.977857367969073e-06, 'epoch': 0.38}

 13%|█▎        | 1403/11049 [14:26<1:38:34,  1.63it/s]
 13%|█▎        | 1404/11049 [14:27<1:38:36,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.6625940799713135, 'learning_rate': 9.977708621064143e-06, 'epoch': 0.38}

 13%|█▎        | 1404/11049 [14:27<1:38:36,  1.63it/s]
 13%|█▎        | 1405/11049 [14:27<1:38:36,  1.63it/s]
                                                      
{'loss': 0.3319, 'grad_norm': 0.7171489596366882, 'learning_rate': 9.977559377330164e-06, 'epoch': 0.38}

 13%|█▎        | 1405/11049 [14:27<1:38:36,  1.63it/s]
 13%|█▎        | 1406/11049 [14:28<1:38:42,  1.63it/s]
                                                      
{'loss': 0.3521, 'grad_norm': 0.7128744721412659, 'learning_rate': 9.977409636782031e-06, 'epoch': 0.38}

 13%|█▎        | 1406/11049 [14:28<1:38:42,  1.63it/s]
 13%|█▎        | 1407/11049 [14:28<1:38:39,  1.63it/s]
                                                      
{'loss': 0.2864, 'grad_norm': 0.6337640881538391, 'learning_rate': 9.977259399434691e-06, 'epoch': 0.38}

 13%|█▎        | 1407/11049 [14:29<1:38:39,  1.63it/s]
 13%|█▎        | 1408/11049 [14:29<1:38:34,  1.63it/s]
                                                      
{'loss': 0.3387, 'grad_norm': 0.6644595861434937, 'learning_rate': 9.977108665303138e-06, 'epoch': 0.38}

 13%|█▎        | 1408/11049 [14:29<1:38:34,  1.63it/s]
 13%|█▎        | 1409/11049 [14:30<1:38:32,  1.63it/s]
                                                      
{'loss': 0.346, 'grad_norm': 0.7071075439453125, 'learning_rate': 9.976957434402416e-06, 'epoch': 0.38}

 13%|█▎        | 1409/11049 [14:30<1:38:32,  1.63it/s]
 13%|█▎        | 1410/11049 [14:30<1:38:32,  1.63it/s]
                                                      
{'loss': 0.2944, 'grad_norm': 0.578685462474823, 'learning_rate': 9.976805706747623e-06, 'epoch': 0.38}

 13%|█▎        | 1410/11049 [14:30<1:38:32,  1.63it/s]
 13%|█▎        | 1411/11049 [14:31<1:38:37,  1.63it/s]
                                                      
{'loss': 0.2556, 'grad_norm': 0.6258132457733154, 'learning_rate': 9.976653482353898e-06, 'epoch': 0.38}

 13%|█▎        | 1411/11049 [14:31<1:38:37,  1.63it/s]
 13%|█▎        | 1412/11049 [14:31<1:38:35,  1.63it/s]
                                                      
{'loss': 0.3413, 'grad_norm': 0.6465216279029846, 'learning_rate': 9.97650076123644e-06, 'epoch': 0.38}

 13%|█▎        | 1412/11049 [14:32<1:38:35,  1.63it/s]
 13%|█▎        | 1413/11049 [14:32<1:38:31,  1.63it/s]
                                                      
{'loss': 0.297, 'grad_norm': 0.691727876663208, 'learning_rate': 9.976347543410487e-06, 'epoch': 0.38}

 13%|█▎        | 1413/11049 [14:32<1:38:31,  1.63it/s]
 13%|█▎        | 1414/11049 [14:33<1:38:29,  1.63it/s]
                                                      
{'loss': 0.2951, 'grad_norm': 0.6598231792449951, 'learning_rate': 9.976193828891337e-06, 'epoch': 0.38}

 13%|█▎        | 1414/11049 [14:33<1:38:29,  1.63it/s]
 13%|█▎        | 1415/11049 [14:33<1:38:31,  1.63it/s]
                                                      
{'loss': 0.3225, 'grad_norm': 0.5852864980697632, 'learning_rate': 9.976039617694329e-06, 'epoch': 0.38}

 13%|█▎        | 1415/11049 [14:33<1:38:31,  1.63it/s]
 13%|█▎        | 1416/11049 [14:34<1:38:34,  1.63it/s]
                                                      
{'loss': 0.4307, 'grad_norm': 0.8350153565406799, 'learning_rate': 9.975884909834855e-06, 'epoch': 0.38}

 13%|█▎        | 1416/11049 [14:34<1:38:34,  1.63it/s]
 13%|█▎        | 1417/11049 [14:35<1:38:28,  1.63it/s]
                                                      
{'loss': 0.2883, 'grad_norm': 0.7140329480171204, 'learning_rate': 9.975729705328356e-06, 'epoch': 0.38}

 13%|█▎        | 1417/11049 [14:35<1:38:28,  1.63it/s]
 13%|█▎        | 1418/11049 [14:35<1:38:28,  1.63it/s]
                                                      
{'loss': 0.2688, 'grad_norm': 0.5676367878913879, 'learning_rate': 9.975574004190327e-06, 'epoch': 0.39}

 13%|█▎        | 1418/11049 [14:35<1:38:28,  1.63it/s]
 13%|█▎        | 1419/11049 [14:36<1:38:28,  1.63it/s]
                                                      
{'loss': 0.3078, 'grad_norm': 0.648481547832489, 'learning_rate': 9.975417806436304e-06, 'epoch': 0.39}

 13%|█▎        | 1419/11049 [14:36<1:38:28,  1.63it/s]
 13%|█▎        | 1420/11049 [14:36<1:38:28,  1.63it/s]
                                                      
{'loss': 0.3395, 'grad_norm': 0.71086585521698, 'learning_rate': 9.97526111208188e-06, 'epoch': 0.39}

 13%|█▎        | 1420/11049 [14:36<1:38:28,  1.63it/s]
 13%|█▎        | 1421/11049 [14:37<1:38:33,  1.63it/s]
                                                      
{'loss': 0.3218, 'grad_norm': 0.7270665168762207, 'learning_rate': 9.975103921142694e-06, 'epoch': 0.39}

 13%|█▎        | 1421/11049 [14:37<1:38:33,  1.63it/s]
 13%|█▎        | 1422/11049 [14:38<1:38:30,  1.63it/s]
                                                      
{'loss': 0.3032, 'grad_norm': 0.866134762763977, 'learning_rate': 9.974946233634436e-06, 'epoch': 0.39}

 13%|█▎        | 1422/11049 [14:38<1:38:30,  1.63it/s]
 13%|█▎        | 1423/11049 [14:38<1:38:24,  1.63it/s]
                                                      
{'loss': 0.2795, 'grad_norm': 0.6420880556106567, 'learning_rate': 9.974788049572842e-06, 'epoch': 0.39}

 13%|█▎        | 1423/11049 [14:38<1:38:24,  1.63it/s]
 13%|█▎        | 1424/11049 [14:39<1:38:25,  1.63it/s]
                                                      
{'loss': 0.2679, 'grad_norm': 0.5696603059768677, 'learning_rate': 9.974629368973705e-06, 'epoch': 0.39}

 13%|█▎        | 1424/11049 [14:39<1:38:25,  1.63it/s]
 13%|█▎        | 1425/11049 [14:39<1:38:22,  1.63it/s]
                                                      
{'loss': 0.2239, 'grad_norm': 0.5829034447669983, 'learning_rate': 9.974470191852858e-06, 'epoch': 0.39}

 13%|█▎        | 1425/11049 [14:40<1:38:22,  1.63it/s]
 13%|█▎        | 1426/11049 [14:40<1:38:26,  1.63it/s]
                                                      
{'loss': 0.3155, 'grad_norm': 0.6942071318626404, 'learning_rate': 9.974310518226195e-06, 'epoch': 0.39}

 13%|█▎        | 1426/11049 [14:40<1:38:26,  1.63it/s]
 13%|█▎        | 1427/11049 [14:41<1:38:27,  1.63it/s]
                                                      
{'loss': 0.2516, 'grad_norm': 0.530174195766449, 'learning_rate': 9.974150348109647e-06, 'epoch': 0.39}

 13%|█▎        | 1427/11049 [14:41<1:38:27,  1.63it/s]
 13%|█▎        | 1428/11049 [14:41<1:38:23,  1.63it/s]
                                                      
{'loss': 0.3459, 'grad_norm': 0.7874974608421326, 'learning_rate': 9.973989681519204e-06, 'epoch': 0.39}

 13%|█▎        | 1428/11049 [14:41<1:38:23,  1.63it/s]
 13%|█▎        | 1429/11049 [14:42<1:38:22,  1.63it/s]
                                                      
{'loss': 0.2888, 'grad_norm': 0.587531328201294, 'learning_rate': 9.9738285184709e-06, 'epoch': 0.39}

 13%|█▎        | 1429/11049 [14:42<1:38:22,  1.63it/s]
 13%|█▎        | 1430/11049 [14:42<1:38:19,  1.63it/s]
                                                      
{'loss': 0.4337, 'grad_norm': 0.6893409490585327, 'learning_rate': 9.973666858980826e-06, 'epoch': 0.39}

 13%|█▎        | 1430/11049 [14:43<1:38:19,  1.63it/s]
 13%|█▎        | 1431/11049 [14:43<1:38:24,  1.63it/s]
                                                      
{'loss': 0.2326, 'grad_norm': 0.5929780602455139, 'learning_rate': 9.97350470306511e-06, 'epoch': 0.39}

 13%|█▎        | 1431/11049 [14:43<1:38:24,  1.63it/s]
 13%|█▎        | 1432/11049 [14:44<1:38:20,  1.63it/s]
                                                      
{'loss': 0.3242, 'grad_norm': 0.6723946332931519, 'learning_rate': 9.973342050739943e-06, 'epoch': 0.39}

 13%|█▎        | 1432/11049 [14:44<1:38:20,  1.63it/s]
 13%|█▎        | 1433/11049 [14:44<1:38:19,  1.63it/s]
                                                      
{'loss': 0.3093, 'grad_norm': 0.5985034108161926, 'learning_rate': 9.973178902021555e-06, 'epoch': 0.39}

 13%|█▎        | 1433/11049 [14:44<1:38:19,  1.63it/s]
 13%|█▎        | 1434/11049 [14:45<1:38:18,  1.63it/s]
                                                      
{'loss': 0.2685, 'grad_norm': 0.5607872009277344, 'learning_rate': 9.973015256926233e-06, 'epoch': 0.39}

 13%|█▎        | 1434/11049 [14:45<1:38:18,  1.63it/s]
 13%|█▎        | 1435/11049 [14:46<1:38:17,  1.63it/s]
                                                      
{'loss': 0.3866, 'grad_norm': 0.8128392100334167, 'learning_rate': 9.972851115470308e-06, 'epoch': 0.39}

 13%|█▎        | 1435/11049 [14:46<1:38:17,  1.63it/s]
 13%|█▎        | 1436/11049 [14:46<1:38:23,  1.63it/s]
                                                      
{'loss': 0.3123, 'grad_norm': 0.6052477955818176, 'learning_rate': 9.972686477670167e-06, 'epoch': 0.39}

 13%|█▎        | 1436/11049 [14:46<1:38:23,  1.63it/s]
 13%|█▎        | 1437/11049 [14:47<1:38:22,  1.63it/s]
                                                      
{'loss': 0.2593, 'grad_norm': 0.6064935922622681, 'learning_rate': 9.972521343542239e-06, 'epoch': 0.39}

 13%|█▎        | 1437/11049 [14:47<1:38:22,  1.63it/s]
 13%|█▎        | 1438/11049 [14:47<1:38:16,  1.63it/s]
                                                      
{'loss': 0.272, 'grad_norm': 0.5778237581253052, 'learning_rate': 9.972355713103008e-06, 'epoch': 0.39}

 13%|█▎        | 1438/11049 [14:48<1:38:16,  1.63it/s]
 13%|█▎        | 1439/11049 [14:48<1:38:14,  1.63it/s]
                                                      
{'loss': 0.3632, 'grad_norm': 0.7146244049072266, 'learning_rate': 9.972189586369004e-06, 'epoch': 0.39}

 13%|█▎        | 1439/11049 [14:48<1:38:14,  1.63it/s]
 13%|█▎        | 1440/11049 [14:49<1:38:13,  1.63it/s]
                                                      
{'loss': 0.2882, 'grad_norm': 0.5913406610488892, 'learning_rate': 9.972022963356811e-06, 'epoch': 0.39}

 13%|█▎        | 1440/11049 [14:49<1:38:13,  1.63it/s]
 13%|█▎        | 1441/11049 [14:49<1:38:16,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.5639413595199585, 'learning_rate': 9.971855844083055e-06, 'epoch': 0.39}

 13%|█▎        | 1441/11049 [14:49<1:38:16,  1.63it/s]
 13%|█▎        | 1442/11049 [14:50<1:38:13,  1.63it/s]
                                                      
{'loss': 0.3167, 'grad_norm': 0.5550621151924133, 'learning_rate': 9.971688228564423e-06, 'epoch': 0.39}

 13%|█▎        | 1442/11049 [14:50<1:38:13,  1.63it/s]
 13%|█▎        | 1443/11049 [14:50<1:38:14,  1.63it/s]
                                                      
{'loss': 0.3201, 'grad_norm': 0.6578736305236816, 'learning_rate': 9.971520116817642e-06, 'epoch': 0.39}

 13%|█▎        | 1443/11049 [14:51<1:38:14,  1.63it/s]
 13%|█▎        | 1444/11049 [14:51<1:38:15,  1.63it/s]
                                                      
{'loss': 0.2565, 'grad_norm': 0.6042134761810303, 'learning_rate': 9.971351508859488e-06, 'epoch': 0.39}

 13%|█▎        | 1444/11049 [14:51<1:38:15,  1.63it/s]
 13%|█▎        | 1445/11049 [14:52<1:38:13,  1.63it/s]
                                                      
{'loss': 0.4026, 'grad_norm': 0.69492107629776, 'learning_rate': 9.971182404706794e-06, 'epoch': 0.39}

 13%|█▎        | 1445/11049 [14:52<1:38:13,  1.63it/s]
 13%|█▎        | 1446/11049 [14:52<1:38:51,  1.62it/s]
                                                      
{'loss': 0.3154, 'grad_norm': 0.6576046347618103, 'learning_rate': 9.971012804376433e-06, 'epoch': 0.39}

 13%|█▎        | 1446/11049 [14:52<1:38:51,  1.62it/s]
 13%|█▎        | 1447/11049 [14:53<1:38:38,  1.62it/s]
                                                      
{'loss': 0.2988, 'grad_norm': 0.6579251289367676, 'learning_rate': 9.970842707885342e-06, 'epoch': 0.39}

 13%|█▎        | 1447/11049 [14:53<1:38:38,  1.62it/s]
 13%|█▎        | 1448/11049 [14:54<1:38:30,  1.62it/s]
                                                      
{'loss': 0.2515, 'grad_norm': 0.5225808024406433, 'learning_rate': 9.970672115250492e-06, 'epoch': 0.39}

 13%|█▎        | 1448/11049 [14:54<1:38:30,  1.62it/s]
 13%|█▎        | 1449/11049 [14:54<1:38:27,  1.63it/s]
                                                      
{'loss': 0.3474, 'grad_norm': 0.6535815596580505, 'learning_rate': 9.97050102648891e-06, 'epoch': 0.39}

 13%|█▎        | 1449/11049 [14:54<1:38:27,  1.63it/s]
 13%|█▎        | 1450/11049 [14:55<1:38:50,  1.62it/s]
                                                      
{'loss': 0.3243, 'grad_norm': 0.6222238540649414, 'learning_rate': 9.970329441617677e-06, 'epoch': 0.39}

 13%|█▎        | 1450/11049 [14:55<1:38:50,  1.62it/s]
 13%|█▎        | 1451/11049 [14:55<1:39:04,  1.61it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.5677844285964966, 'learning_rate': 9.970157360653912e-06, 'epoch': 0.39}

 13%|█▎        | 1451/11049 [14:56<1:39:04,  1.61it/s]
 13%|█▎        | 1452/11049 [14:56<1:38:46,  1.62it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.5946595668792725, 'learning_rate': 9.969984783614797e-06, 'epoch': 0.39}

 13%|█▎        | 1452/11049 [14:56<1:38:46,  1.62it/s]
 13%|█▎        | 1453/11049 [14:57<1:38:31,  1.62it/s]
                                                      
{'loss': 0.3233, 'grad_norm': 0.7368179559707642, 'learning_rate': 9.969811710517554e-06, 'epoch': 0.39}

 13%|█▎        | 1453/11049 [14:57<1:38:31,  1.62it/s]
 13%|█▎        | 1454/11049 [14:57<1:38:24,  1.63it/s]
                                                      
{'loss': 0.2978, 'grad_norm': 0.6129789352416992, 'learning_rate': 9.96963814137946e-06, 'epoch': 0.39}

 13%|█▎        | 1454/11049 [14:57<1:38:24,  1.63it/s]
 13%|█▎        | 1455/11049 [14:58<1:38:28,  1.62it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.5839199423789978, 'learning_rate': 9.969464076217832e-06, 'epoch': 0.4}

 13%|█▎        | 1455/11049 [14:58<1:38:28,  1.62it/s]
 13%|█▎        | 1456/11049 [14:58<1:38:53,  1.62it/s]
                                                      
{'loss': 0.3162, 'grad_norm': 0.6058788299560547, 'learning_rate': 9.969289515050052e-06, 'epoch': 0.4}

 13%|█▎        | 1456/11049 [14:59<1:38:53,  1.62it/s]
 13%|█▎        | 1457/11049 [14:59<1:38:39,  1.62it/s]
                                                      
{'loss': 0.2878, 'grad_norm': 0.5645529627799988, 'learning_rate': 9.96911445789354e-06, 'epoch': 0.4}

 13%|█▎        | 1457/11049 [14:59<1:38:39,  1.62it/s]
 13%|█▎        | 1458/11049 [15:00<1:38:28,  1.62it/s]
                                                      
{'loss': 0.3857, 'grad_norm': 0.7775186896324158, 'learning_rate': 9.968938904765769e-06, 'epoch': 0.4}

 13%|█▎        | 1458/11049 [15:00<1:38:28,  1.62it/s]
 13%|█▎        | 1459/11049 [15:00<1:38:17,  1.63it/s]
                                                      
{'loss': 0.2994, 'grad_norm': 0.6624270677566528, 'learning_rate': 9.968762855684257e-06, 'epoch': 0.4}

 13%|█▎        | 1459/11049 [15:00<1:38:17,  1.63it/s]
 13%|█▎        | 1460/11049 [15:01<1:38:19,  1.63it/s]
                                                      
{'loss': 0.3271, 'grad_norm': 0.6801655888557434, 'learning_rate': 9.968586310666582e-06, 'epoch': 0.4}

 13%|█▎        | 1460/11049 [15:01<1:38:19,  1.63it/s]
 13%|█▎        | 1461/11049 [15:02<1:38:19,  1.63it/s]
                                                      
{'loss': 0.23, 'grad_norm': 0.5845140218734741, 'learning_rate': 9.968409269730363e-06, 'epoch': 0.4}

 13%|█▎        | 1461/11049 [15:02<1:38:19,  1.63it/s]
 13%|█▎        | 1462/11049 [15:02<1:38:18,  1.63it/s]
                                                      
{'loss': 0.2771, 'grad_norm': 0.6454792618751526, 'learning_rate': 9.968231732893267e-06, 'epoch': 0.4}

 13%|█▎        | 1462/11049 [15:02<1:38:18,  1.63it/s]
 13%|█▎        | 1463/11049 [15:03<1:38:11,  1.63it/s]
                                                      
{'loss': 0.3597, 'grad_norm': 0.744967520236969, 'learning_rate': 9.96805370017302e-06, 'epoch': 0.4}

 13%|█▎        | 1463/11049 [15:03<1:38:11,  1.63it/s]
 13%|█▎        | 1464/11049 [15:03<1:38:04,  1.63it/s]
                                                      
{'loss': 0.3252, 'grad_norm': 0.5934486389160156, 'learning_rate': 9.967875171587387e-06, 'epoch': 0.4}

 13%|█▎        | 1464/11049 [15:04<1:38:04,  1.63it/s]
 13%|█▎        | 1465/11049 [15:04<1:38:31,  1.62it/s]
                                                      
{'loss': 0.3686, 'grad_norm': 0.736397922039032, 'learning_rate': 9.967696147154187e-06, 'epoch': 0.4}

 13%|█▎        | 1465/11049 [15:04<1:38:31,  1.62it/s]
 13%|█▎        | 1466/11049 [15:05<1:38:23,  1.62it/s]
                                                      
{'loss': 0.309, 'grad_norm': 0.6990949511528015, 'learning_rate': 9.967516626891291e-06, 'epoch': 0.4}

 13%|█▎        | 1466/11049 [15:05<1:38:23,  1.62it/s]
 13%|█▎        | 1467/11049 [15:05<1:38:12,  1.63it/s]
                                                      
{'loss': 0.3341, 'grad_norm': 0.6570963263511658, 'learning_rate': 9.967336610816618e-06, 'epoch': 0.4}

 13%|█▎        | 1467/11049 [15:05<1:38:12,  1.63it/s]
 13%|█▎        | 1468/11049 [15:06<1:38:08,  1.63it/s]
                                                      
{'loss': 0.3256, 'grad_norm': 0.6222761273384094, 'learning_rate': 9.967156098948132e-06, 'epoch': 0.4}

 13%|█▎        | 1468/11049 [15:06<1:38:08,  1.63it/s]
 13%|█▎        | 1469/11049 [15:06<1:38:02,  1.63it/s]
                                                      
{'loss': 0.3653, 'grad_norm': 0.7070972919464111, 'learning_rate': 9.966975091303853e-06, 'epoch': 0.4}

 13%|█▎        | 1469/11049 [15:07<1:38:02,  1.63it/s]
 13%|█▎        | 1470/11049 [15:07<1:38:05,  1.63it/s]
                                                      
{'loss': 0.2929, 'grad_norm': 0.6314826011657715, 'learning_rate': 9.966793587901843e-06, 'epoch': 0.4}

 13%|█▎        | 1470/11049 [15:07<1:38:05,  1.63it/s]
 13%|█▎        | 1471/11049 [15:08<1:38:07,  1.63it/s]
                                                      
{'loss': 0.3544, 'grad_norm': 0.6413292288780212, 'learning_rate': 9.966611588760224e-06, 'epoch': 0.4}

 13%|█▎        | 1471/11049 [15:08<1:38:07,  1.63it/s]
 13%|█▎        | 1472/11049 [15:08<1:38:02,  1.63it/s]
                                                      
{'loss': 0.2831, 'grad_norm': 0.6362960934638977, 'learning_rate': 9.966429093897159e-06, 'epoch': 0.4}

 13%|█▎        | 1472/11049 [15:08<1:38:02,  1.63it/s]
 13%|█▎        | 1473/11049 [15:09<1:37:58,  1.63it/s]
                                                      
{'loss': 0.2818, 'grad_norm': 0.577599048614502, 'learning_rate': 9.966246103330863e-06, 'epoch': 0.4}

 13%|█▎        | 1473/11049 [15:09<1:37:58,  1.63it/s]
 13%|█▎        | 1474/11049 [15:10<1:37:57,  1.63it/s]
                                                      
{'loss': 0.3204, 'grad_norm': 0.6675174236297607, 'learning_rate': 9.9660626170796e-06, 'epoch': 0.4}

 13%|█▎        | 1474/11049 [15:10<1:37:57,  1.63it/s]
 13%|█▎        | 1475/11049 [15:10<1:38:00,  1.63it/s]
                                                      
{'loss': 0.3981, 'grad_norm': 0.701393187046051, 'learning_rate': 9.965878635161683e-06, 'epoch': 0.4}

 13%|█▎        | 1475/11049 [15:10<1:38:00,  1.63it/s]
 13%|█▎        | 1476/11049 [15:11<1:37:57,  1.63it/s]
                                                      
{'loss': 0.3088, 'grad_norm': 0.6377955079078674, 'learning_rate': 9.965694157595476e-06, 'epoch': 0.4}

 13%|█▎        | 1476/11049 [15:11<1:37:57,  1.63it/s]
 13%|█▎        | 1477/11049 [15:11<1:37:54,  1.63it/s]
                                                      
{'loss': 0.2676, 'grad_norm': 0.5727841854095459, 'learning_rate': 9.965509184399394e-06, 'epoch': 0.4}

 13%|█▎        | 1477/11049 [15:12<1:37:54,  1.63it/s]
 13%|█▎        | 1478/11049 [15:12<1:37:49,  1.63it/s]
                                                      
{'loss': 0.3529, 'grad_norm': 0.6729867458343506, 'learning_rate': 9.965323715591896e-06, 'epoch': 0.4}

 13%|█▎        | 1478/11049 [15:12<1:37:49,  1.63it/s]
 13%|█▎        | 1479/11049 [15:13<1:37:53,  1.63it/s]
                                                      
{'loss': 0.2997, 'grad_norm': 0.6210417151451111, 'learning_rate': 9.965137751191496e-06, 'epoch': 0.4}

 13%|█▎        | 1479/11049 [15:13<1:37:53,  1.63it/s]
 13%|█▎        | 1480/11049 [15:13<1:37:59,  1.63it/s]
                                                      
{'loss': 0.4632, 'grad_norm': 0.7547423839569092, 'learning_rate': 9.964951291216756e-06, 'epoch': 0.4}

 13%|█▎        | 1480/11049 [15:13<1:37:59,  1.63it/s]
 13%|█▎        | 1481/11049 [15:14<1:37:54,  1.63it/s]
                                                      
{'loss': 0.2989, 'grad_norm': 0.5983095765113831, 'learning_rate': 9.964764335686284e-06, 'epoch': 0.4}

 13%|█▎        | 1481/11049 [15:14<1:37:54,  1.63it/s]
 13%|█▎        | 1482/11049 [15:14<1:37:51,  1.63it/s]
                                                      
{'loss': 0.366, 'grad_norm': 0.7633230686187744, 'learning_rate': 9.96457688461874e-06, 'epoch': 0.4}

 13%|█▎        | 1482/11049 [15:15<1:37:51,  1.63it/s]
 13%|█▎        | 1483/11049 [15:15<1:37:48,  1.63it/s]
                                                      
{'loss': 0.2697, 'grad_norm': 0.626533031463623, 'learning_rate': 9.964388938032839e-06, 'epoch': 0.4}

 13%|█▎        | 1483/11049 [15:15<1:37:48,  1.63it/s]
 13%|█▎        | 1484/11049 [15:16<1:37:46,  1.63it/s]
                                                      
{'loss': 0.2869, 'grad_norm': 0.6608302593231201, 'learning_rate': 9.964200495947332e-06, 'epoch': 0.4}

 13%|█▎        | 1484/11049 [15:16<1:37:46,  1.63it/s]
 13%|█▎        | 1485/11049 [15:16<1:37:52,  1.63it/s]
                                                      
{'loss': 0.2965, 'grad_norm': 0.5770823359489441, 'learning_rate': 9.964011558381036e-06, 'epoch': 0.4}

 13%|█▎        | 1485/11049 [15:16<1:37:52,  1.63it/s]
 13%|█▎        | 1486/11049 [15:17<1:37:48,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.600494384765625, 'learning_rate': 9.963822125352802e-06, 'epoch': 0.4}

 13%|█▎        | 1486/11049 [15:17<1:37:48,  1.63it/s]
 13%|█▎        | 1487/11049 [15:18<1:37:45,  1.63it/s]
                                                      
{'loss': 0.2022, 'grad_norm': 0.49589797854423523, 'learning_rate': 9.963632196881541e-06, 'epoch': 0.4}

 13%|█▎        | 1487/11049 [15:18<1:37:45,  1.63it/s]
 13%|█▎        | 1488/11049 [15:18<1:37:43,  1.63it/s]
                                                      
{'loss': 0.3047, 'grad_norm': 0.6616845726966858, 'learning_rate': 9.963441772986209e-06, 'epoch': 0.4}

 13%|█▎        | 1488/11049 [15:18<1:37:43,  1.63it/s]
 13%|█▎        | 1489/11049 [15:19<1:37:45,  1.63it/s]
                                                      
{'loss': 0.3229, 'grad_norm': 0.6321662664413452, 'learning_rate': 9.963250853685813e-06, 'epoch': 0.4}

 13%|█▎        | 1489/11049 [15:19<1:37:45,  1.63it/s]
 13%|█▎        | 1490/11049 [15:19<1:37:52,  1.63it/s]
                                                      
{'loss': 0.3281, 'grad_norm': 0.602747917175293, 'learning_rate': 9.963059438999408e-06, 'epoch': 0.4}

 13%|█▎        | 1490/11049 [15:19<1:37:52,  1.63it/s]
 13%|█▎        | 1491/11049 [15:20<1:37:54,  1.63it/s]
                                                      
{'loss': 0.3623, 'grad_norm': 0.6522478461265564, 'learning_rate': 9.962867528946101e-06, 'epoch': 0.4}

 13%|█▎        | 1491/11049 [15:20<1:37:54,  1.63it/s]
 14%|█▎        | 1492/11049 [15:21<1:37:51,  1.63it/s]
                                                      
{'loss': 0.2474, 'grad_norm': 0.5944944620132446, 'learning_rate': 9.962675123545043e-06, 'epoch': 0.41}

 14%|█▎        | 1492/11049 [15:21<1:37:51,  1.63it/s]
 14%|█▎        | 1493/11049 [15:21<1:37:47,  1.63it/s]
                                                      
{'loss': 0.3784, 'grad_norm': 0.7100399136543274, 'learning_rate': 9.962482222815443e-06, 'epoch': 0.41}

 14%|█▎        | 1493/11049 [15:21<1:37:47,  1.63it/s]
 14%|█▎        | 1494/11049 [15:22<1:37:45,  1.63it/s]
                                                      
{'loss': 0.2435, 'grad_norm': 0.5309298038482666, 'learning_rate': 9.96228882677655e-06, 'epoch': 0.41}

 14%|█▎        | 1494/11049 [15:22<1:37:45,  1.63it/s]
 14%|█▎        | 1495/11049 [15:22<1:37:48,  1.63it/s]
                                                      
{'loss': 0.3882, 'grad_norm': 0.7313499450683594, 'learning_rate': 9.96209493544767e-06, 'epoch': 0.41}

 14%|█▎        | 1495/11049 [15:23<1:37:48,  1.63it/s]
 14%|█▎        | 1496/11049 [15:23<1:37:44,  1.63it/s]
                                                      
{'loss': 0.2666, 'grad_norm': 0.5787503123283386, 'learning_rate': 9.961900548848156e-06, 'epoch': 0.41}

 14%|█▎        | 1496/11049 [15:23<1:37:44,  1.63it/s]
 14%|█▎        | 1497/11049 [15:24<1:37:43,  1.63it/s]
                                                      
{'loss': 0.3137, 'grad_norm': 0.6181991696357727, 'learning_rate': 9.961705666997406e-06, 'epoch': 0.41}

 14%|█▎        | 1497/11049 [15:24<1:37:43,  1.63it/s]
 14%|█▎        | 1498/11049 [15:24<1:37:43,  1.63it/s]
                                                      
{'loss': 0.364, 'grad_norm': 0.7357754111289978, 'learning_rate': 9.961510289914873e-06, 'epoch': 0.41}

 14%|█▎        | 1498/11049 [15:24<1:37:43,  1.63it/s]
 14%|█▎        | 1499/11049 [15:25<1:37:43,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.5799666047096252, 'learning_rate': 9.961314417620061e-06, 'epoch': 0.41}

 14%|█▎        | 1499/11049 [15:25<1:37:43,  1.63it/s]
 14%|█▎        | 1500/11049 [15:26<1:37:47,  1.63it/s]
                                                      
{'loss': 0.3797, 'grad_norm': 0.7114619016647339, 'learning_rate': 9.961118050132517e-06, 'epoch': 0.41}

 14%|█▎        | 1500/11049 [15:26<1:37:47,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.35it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.7489266991615295, 'eval_runtime': 1.953, 'eval_samples_per_second': 102.407, 'eval_steps_per_second': 6.656, 'epoch': 0.41}

 14%|█▎        | 1500/11049 [15:28<1:37:47,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 14%|█▎        | 1501/11049 [15:28<3:11:12,  1.20s/it]
                                                      
{'loss': 0.2868, 'grad_norm': 0.6384989619255066, 'learning_rate': 9.960921187471841e-06, 'epoch': 0.41}

 14%|█▎        | 1501/11049 [15:28<3:11:12,  1.20s/it]
 14%|█▎        | 1502/11049 [15:29<2:43:04,  1.02s/it]
                                                      
{'loss': 0.2985, 'grad_norm': 0.6651399731636047, 'learning_rate': 9.960723829657681e-06, 'epoch': 0.41}

 14%|█▎        | 1502/11049 [15:29<2:43:04,  1.02s/it]
 14%|█▎        | 1503/11049 [15:29<2:23:32,  1.11it/s]
                                                      
{'loss': 0.2585, 'grad_norm': 0.6033529043197632, 'learning_rate': 9.960525976709738e-06, 'epoch': 0.41}

 14%|█▎        | 1503/11049 [15:29<2:23:32,  1.11it/s]
 14%|█▎        | 1504/11049 [15:30<2:09:44,  1.23it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.527800977230072, 'learning_rate': 9.960327628647759e-06, 'epoch': 0.41}

 14%|█▎        | 1504/11049 [15:30<2:09:44,  1.23it/s]
 14%|█▎        | 1505/11049 [15:31<2:00:04,  1.32it/s]
                                                      
{'loss': 0.2811, 'grad_norm': 0.6174948215484619, 'learning_rate': 9.96012878549154e-06, 'epoch': 0.41}

 14%|█▎        | 1505/11049 [15:31<2:00:04,  1.32it/s]
 14%|█▎        | 1506/11049 [15:31<1:53:18,  1.40it/s]
                                                      
{'loss': 0.305, 'grad_norm': 0.6943981647491455, 'learning_rate': 9.959929447260928e-06, 'epoch': 0.41}

 14%|█▎        | 1506/11049 [15:31<1:53:18,  1.40it/s]
 14%|█▎        | 1507/11049 [15:32<1:48:32,  1.47it/s]
                                                      
{'loss': 0.2636, 'grad_norm': 0.5226469039916992, 'learning_rate': 9.95972961397582e-06, 'epoch': 0.41}

 14%|█▎        | 1507/11049 [15:32<1:48:32,  1.47it/s]
 14%|█▎        | 1508/11049 [15:32<1:45:13,  1.51it/s]
                                                      
{'loss': 0.253, 'grad_norm': 0.5527839660644531, 'learning_rate': 9.95952928565616e-06, 'epoch': 0.41}

 14%|█▎        | 1508/11049 [15:33<1:45:13,  1.51it/s]
 14%|█▎        | 1509/11049 [15:33<1:42:53,  1.55it/s]
                                                      
{'loss': 0.3262, 'grad_norm': 0.6798880696296692, 'learning_rate': 9.959328462321946e-06, 'epoch': 0.41}

 14%|█▎        | 1509/11049 [15:33<1:42:53,  1.55it/s]
 14%|█▎        | 1510/11049 [15:34<1:41:14,  1.57it/s]
                                                      
{'loss': 0.3797, 'grad_norm': 0.660304844379425, 'learning_rate': 9.95912714399322e-06, 'epoch': 0.41}

 14%|█▎        | 1510/11049 [15:34<1:41:14,  1.57it/s]
 14%|█▎        | 1511/11049 [15:34<1:40:04,  1.59it/s]
                                                      
{'loss': 0.3642, 'grad_norm': 0.759192705154419, 'learning_rate': 9.958925330690076e-06, 'epoch': 0.41}

 14%|█▎        | 1511/11049 [15:34<1:40:04,  1.59it/s]
 14%|█▎        | 1512/11049 [15:35<1:39:16,  1.60it/s]
                                                      
{'loss': 0.2567, 'grad_norm': 0.5342756509780884, 'learning_rate': 9.958723022432658e-06, 'epoch': 0.41}

 14%|█▎        | 1512/11049 [15:35<1:39:16,  1.60it/s]
 14%|█▎        | 1513/11049 [15:35<1:38:41,  1.61it/s]
                                                      
{'loss': 0.3372, 'grad_norm': 0.56357342004776, 'learning_rate': 9.958520219241156e-06, 'epoch': 0.41}

 14%|█▎        | 1513/11049 [15:36<1:38:41,  1.61it/s]
 14%|█▎        | 1514/11049 [15:36<1:38:20,  1.62it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.5898668169975281, 'learning_rate': 9.958316921135814e-06, 'epoch': 0.41}

 14%|█▎        | 1514/11049 [15:36<1:38:20,  1.62it/s]
 14%|█▎        | 1515/11049 [15:37<1:38:03,  1.62it/s]
                                                      
{'loss': 0.2766, 'grad_norm': 0.6354639530181885, 'learning_rate': 9.958113128136924e-06, 'epoch': 0.41}

 14%|█▎        | 1515/11049 [15:37<1:38:03,  1.62it/s]
 14%|█▎        | 1516/11049 [15:37<1:37:51,  1.62it/s]
                                                      
{'loss': 0.3266, 'grad_norm': 0.6523618698120117, 'learning_rate': 9.957908840264826e-06, 'epoch': 0.41}

 14%|█▎        | 1516/11049 [15:37<1:37:51,  1.62it/s]
 14%|█▎        | 1517/11049 [15:38<1:37:43,  1.63it/s]
                                                      
{'loss': 0.3327, 'grad_norm': 0.67289137840271, 'learning_rate': 9.957704057539909e-06, 'epoch': 0.41}

 14%|█▎        | 1517/11049 [15:38<1:37:43,  1.63it/s]
 14%|█▎        | 1518/11049 [15:39<1:37:38,  1.63it/s]
                                                      
{'loss': 0.3986, 'grad_norm': 0.6624546051025391, 'learning_rate': 9.957498779982616e-06, 'epoch': 0.41}

 14%|█▎        | 1518/11049 [15:39<1:37:38,  1.63it/s]
 14%|█▎        | 1519/11049 [15:39<1:37:34,  1.63it/s]
                                                      
{'loss': 0.3895, 'grad_norm': 0.6490479111671448, 'learning_rate': 9.957293007613432e-06, 'epoch': 0.41}

 14%|█▎        | 1519/11049 [15:39<1:37:34,  1.63it/s]
 14%|█▍        | 1520/11049 [15:40<1:37:33,  1.63it/s]
                                                      
{'loss': 0.4032, 'grad_norm': 1.3540189266204834, 'learning_rate': 9.957086740452895e-06, 'epoch': 0.41}

 14%|█▍        | 1520/11049 [15:40<1:37:33,  1.63it/s]
 14%|█▍        | 1521/11049 [15:40<1:37:32,  1.63it/s]
                                                      
{'loss': 0.315, 'grad_norm': 0.616773784160614, 'learning_rate': 9.956879978521596e-06, 'epoch': 0.41}

 14%|█▍        | 1521/11049 [15:40<1:37:32,  1.63it/s]
 14%|█▍        | 1522/11049 [15:41<1:37:26,  1.63it/s]
                                                      
{'loss': 0.2764, 'grad_norm': 0.6918711066246033, 'learning_rate': 9.956672721840169e-06, 'epoch': 0.41}

 14%|█▍        | 1522/11049 [15:41<1:37:26,  1.63it/s]
 14%|█▍        | 1523/11049 [15:42<1:37:23,  1.63it/s]
                                                      
{'loss': 0.3251, 'grad_norm': 0.6459735035896301, 'learning_rate': 9.956464970429303e-06, 'epoch': 0.41}

 14%|█▍        | 1523/11049 [15:42<1:37:23,  1.63it/s]
 14%|█▍        | 1524/11049 [15:42<1:37:20,  1.63it/s]
                                                      
{'loss': 0.3504, 'grad_norm': 0.609855592250824, 'learning_rate': 9.956256724309735e-06, 'epoch': 0.41}

 14%|█▍        | 1524/11049 [15:42<1:37:20,  1.63it/s]
 14%|█▍        | 1525/11049 [15:43<1:37:16,  1.63it/s]
                                                      
{'loss': 0.2949, 'grad_norm': 0.5914214849472046, 'learning_rate': 9.956047983502245e-06, 'epoch': 0.41}

 14%|█▍        | 1525/11049 [15:43<1:37:16,  1.63it/s]
 14%|█▍        | 1526/11049 [15:43<1:37:21,  1.63it/s]
                                                      
{'loss': 0.3444, 'grad_norm': 0.7560031414031982, 'learning_rate': 9.95583874802767e-06, 'epoch': 0.41}

 14%|█▍        | 1526/11049 [15:44<1:37:21,  1.63it/s]
 14%|█▍        | 1527/11049 [15:44<1:37:19,  1.63it/s]
                                                      
{'loss': 0.2649, 'grad_norm': 0.6232380270957947, 'learning_rate': 9.955629017906898e-06, 'epoch': 0.41}

 14%|█▍        | 1527/11049 [15:44<1:37:19,  1.63it/s]
 14%|█▍        | 1528/11049 [15:45<1:37:19,  1.63it/s]
                                                      
{'loss': 0.2553, 'grad_norm': 0.6122766733169556, 'learning_rate': 9.955418793160856e-06, 'epoch': 0.41}

 14%|█▍        | 1528/11049 [15:45<1:37:19,  1.63it/s]
 14%|█▍        | 1529/11049 [15:45<1:37:22,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.6145955920219421, 'learning_rate': 9.955208073810532e-06, 'epoch': 0.42}

 14%|█▍        | 1529/11049 [15:45<1:37:22,  1.63it/s]
 14%|█▍        | 1530/11049 [15:46<1:37:21,  1.63it/s]
                                                      
{'loss': 0.3123, 'grad_norm': 0.6587706208229065, 'learning_rate': 9.954996859876953e-06, 'epoch': 0.42}

 14%|█▍        | 1530/11049 [15:46<1:37:21,  1.63it/s]
 14%|█▍        | 1531/11049 [15:46<1:37:18,  1.63it/s]
                                                      
{'loss': 0.4219, 'grad_norm': 0.7683010101318359, 'learning_rate': 9.954785151381204e-06, 'epoch': 0.42}

 14%|█▍        | 1531/11049 [15:47<1:37:18,  1.63it/s]
 14%|█▍        | 1532/11049 [15:47<1:37:18,  1.63it/s]
                                                      
{'loss': 0.3394, 'grad_norm': 0.7144973874092102, 'learning_rate': 9.954572948344415e-06, 'epoch': 0.42}

 14%|█▍        | 1532/11049 [15:47<1:37:18,  1.63it/s]
 14%|█▍        | 1533/11049 [15:48<1:37:17,  1.63it/s]
                                                      
{'loss': 0.2866, 'grad_norm': 0.5909656286239624, 'learning_rate': 9.954360250787766e-06, 'epoch': 0.42}

 14%|█▍        | 1533/11049 [15:48<1:37:17,  1.63it/s]
 14%|█▍        | 1534/11049 [15:48<1:37:16,  1.63it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.6853799819946289, 'learning_rate': 9.954147058732487e-06, 'epoch': 0.42}

 14%|█▍        | 1534/11049 [15:48<1:37:16,  1.63it/s]
 14%|█▍        | 1535/11049 [15:49<1:37:14,  1.63it/s]
                                                      
{'loss': 0.3284, 'grad_norm': 0.7305908799171448, 'learning_rate': 9.953933372199855e-06, 'epoch': 0.42}

 14%|█▍        | 1535/11049 [15:49<1:37:14,  1.63it/s]
 14%|█▍        | 1536/11049 [15:50<1:37:11,  1.63it/s]
                                                      
{'loss': 0.2529, 'grad_norm': 0.567925214767456, 'learning_rate': 9.953719191211203e-06, 'epoch': 0.42}

 14%|█▍        | 1536/11049 [15:50<1:37:11,  1.63it/s]
 14%|█▍        | 1537/11049 [15:50<1:37:10,  1.63it/s]
                                                      
{'loss': 0.2542, 'grad_norm': 0.6353824138641357, 'learning_rate': 9.953504515787902e-06, 'epoch': 0.42}

 14%|█▍        | 1537/11049 [15:50<1:37:10,  1.63it/s]
 14%|█▍        | 1538/11049 [15:51<1:37:09,  1.63it/s]
                                                      
{'loss': 0.2618, 'grad_norm': 0.551030695438385, 'learning_rate': 9.953289345951383e-06, 'epoch': 0.42}

 14%|█▍        | 1538/11049 [15:51<1:37:09,  1.63it/s]
 14%|█▍        | 1539/11049 [15:51<1:37:09,  1.63it/s]
                                                      
{'loss': 0.3023, 'grad_norm': 0.5638449192047119, 'learning_rate': 9.953073681723122e-06, 'epoch': 0.42}

 14%|█▍        | 1539/11049 [15:52<1:37:09,  1.63it/s]
 14%|█▍        | 1540/11049 [15:52<1:37:09,  1.63it/s]
                                                      
{'loss': 0.267, 'grad_norm': 0.5952837467193604, 'learning_rate': 9.952857523124641e-06, 'epoch': 0.42}

 14%|█▍        | 1540/11049 [15:52<1:37:09,  1.63it/s]
 14%|█▍        | 1541/11049 [15:53<1:37:11,  1.63it/s]
                                                      
{'loss': 0.2949, 'grad_norm': 0.5892305374145508, 'learning_rate': 9.95264087017752e-06, 'epoch': 0.42}

 14%|█▍        | 1541/11049 [15:53<1:37:11,  1.63it/s]
 14%|█▍        | 1542/11049 [15:53<1:37:10,  1.63it/s]
                                                      
{'loss': 0.2725, 'grad_norm': 0.7063558101654053, 'learning_rate': 9.952423722903384e-06, 'epoch': 0.42}

 14%|█▍        | 1542/11049 [15:53<1:37:10,  1.63it/s]
 14%|█▍        | 1543/11049 [15:54<1:37:09,  1.63it/s]
                                                      
{'loss': 0.2868, 'grad_norm': 0.6550943851470947, 'learning_rate': 9.9522060813239e-06, 'epoch': 0.42}

 14%|█▍        | 1543/11049 [15:54<1:37:09,  1.63it/s]
 14%|█▍        | 1544/11049 [15:54<1:37:12,  1.63it/s]
                                                      
{'loss': 0.2844, 'grad_norm': 0.671708881855011, 'learning_rate': 9.951987945460796e-06, 'epoch': 0.42}

 14%|█▍        | 1544/11049 [15:55<1:37:12,  1.63it/s]
 14%|█▍        | 1545/11049 [15:55<1:37:09,  1.63it/s]
                                                      
{'loss': 0.3767, 'grad_norm': 0.6352084279060364, 'learning_rate': 9.951769315335843e-06, 'epoch': 0.42}

 14%|█▍        | 1545/11049 [15:55<1:37:09,  1.63it/s]
 14%|█▍        | 1546/11049 [15:56<1:37:09,  1.63it/s]
                                                      
{'loss': 0.2972, 'grad_norm': 0.6251540184020996, 'learning_rate': 9.951550190970864e-06, 'epoch': 0.42}

 14%|█▍        | 1546/11049 [15:56<1:37:09,  1.63it/s]
 14%|█▍        | 1547/11049 [15:56<1:37:07,  1.63it/s]
                                                      
{'loss': 0.3537, 'grad_norm': 0.6384565234184265, 'learning_rate': 9.95133057238773e-06, 'epoch': 0.42}

 14%|█▍        | 1547/11049 [15:56<1:37:07,  1.63it/s]
 14%|█▍        | 1548/11049 [15:57<1:37:06,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.5102353692054749, 'learning_rate': 9.951110459608357e-06, 'epoch': 0.42}

 14%|█▍        | 1548/11049 [15:57<1:37:06,  1.63it/s]
 14%|█▍        | 1549/11049 [15:58<1:37:06,  1.63it/s]
                                                      
{'loss': 0.3441, 'grad_norm': 0.6385157108306885, 'learning_rate': 9.95088985265472e-06, 'epoch': 0.42}

 14%|█▍        | 1549/11049 [15:58<1:37:06,  1.63it/s]
 14%|█▍        | 1550/11049 [15:58<1:37:06,  1.63it/s]
                                                      
{'loss': 0.3633, 'grad_norm': 0.6860216856002808, 'learning_rate': 9.950668751548836e-06, 'epoch': 0.42}

 14%|█▍        | 1550/11049 [15:58<1:37:06,  1.63it/s]
 14%|█▍        | 1551/11049 [15:59<1:37:05,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.6158093214035034, 'learning_rate': 9.95044715631277e-06, 'epoch': 0.42}

 14%|█▍        | 1551/11049 [15:59<1:37:05,  1.63it/s]
 14%|█▍        | 1552/11049 [15:59<1:37:03,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.5780007243156433, 'learning_rate': 9.950225066968646e-06, 'epoch': 0.42}

 14%|█▍        | 1552/11049 [15:59<1:37:03,  1.63it/s]
 14%|█▍        | 1553/11049 [16:00<1:37:07,  1.63it/s]
                                                      
{'loss': 0.2719, 'grad_norm': 0.6056033372879028, 'learning_rate': 9.950002483538626e-06, 'epoch': 0.42}

 14%|█▍        | 1553/11049 [16:00<1:37:07,  1.63it/s]
 14%|█▍        | 1554/11049 [16:01<1:37:07,  1.63it/s]
                                                      
{'loss': 0.3579, 'grad_norm': 0.8787233233451843, 'learning_rate': 9.949779406044927e-06, 'epoch': 0.42}

 14%|█▍        | 1554/11049 [16:01<1:37:07,  1.63it/s]
 14%|█▍        | 1555/11049 [16:01<1:37:05,  1.63it/s]
                                                      
{'loss': 0.2662, 'grad_norm': 0.5721876621246338, 'learning_rate': 9.949555834509817e-06, 'epoch': 0.42}

 14%|█▍        | 1555/11049 [16:01<1:37:05,  1.63it/s]
 14%|█▍        | 1556/11049 [16:02<1:37:04,  1.63it/s]
                                                      
{'loss': 0.4152, 'grad_norm': 0.7104756236076355, 'learning_rate': 9.949331768955606e-06, 'epoch': 0.42}

 14%|█▍        | 1556/11049 [16:02<1:37:04,  1.63it/s]
 14%|█▍        | 1557/11049 [16:02<1:37:00,  1.63it/s]
                                                      
{'loss': 0.2932, 'grad_norm': 0.6673613786697388, 'learning_rate': 9.949107209404664e-06, 'epoch': 0.42}

 14%|█▍        | 1557/11049 [16:03<1:37:00,  1.63it/s]
 14%|█▍        | 1558/11049 [16:03<1:37:01,  1.63it/s]
                                                      
{'loss': 0.2971, 'grad_norm': 0.5932362079620361, 'learning_rate': 9.948882155879402e-06, 'epoch': 0.42}

 14%|█▍        | 1558/11049 [16:03<1:37:01,  1.63it/s]
 14%|█▍        | 1559/11049 [16:04<1:37:00,  1.63it/s]
                                                      
{'loss': 0.2908, 'grad_norm': 0.6129612922668457, 'learning_rate': 9.94865660840228e-06, 'epoch': 0.42}

 14%|█▍        | 1559/11049 [16:04<1:37:00,  1.63it/s]
 14%|█▍        | 1560/11049 [16:04<1:37:01,  1.63it/s]
                                                      
{'loss': 0.2577, 'grad_norm': 0.5715572237968445, 'learning_rate': 9.948430566995816e-06, 'epoch': 0.42}

 14%|█▍        | 1560/11049 [16:04<1:37:01,  1.63it/s]
 14%|█▍        | 1561/11049 [16:05<1:37:00,  1.63it/s]
                                                      
{'loss': 0.2514, 'grad_norm': 0.6133484840393066, 'learning_rate': 9.948204031682566e-06, 'epoch': 0.42}

 14%|█▍        | 1561/11049 [16:05<1:37:00,  1.63it/s]
 14%|█▍        | 1562/11049 [16:05<1:36:55,  1.63it/s]
                                                      
{'loss': 0.3113, 'grad_norm': 0.6245781183242798, 'learning_rate': 9.947977002485143e-06, 'epoch': 0.42}

 14%|█▍        | 1562/11049 [16:06<1:36:55,  1.63it/s]
 14%|█▍        | 1563/11049 [16:06<1:36:55,  1.63it/s]
                                                      
{'loss': 0.3333, 'grad_norm': 0.6310305595397949, 'learning_rate': 9.947749479426207e-06, 'epoch': 0.42}

 14%|█▍        | 1563/11049 [16:06<1:36:55,  1.63it/s]
 14%|█▍        | 1564/11049 [16:07<1:36:54,  1.63it/s]
                                                      
{'loss': 0.2569, 'grad_norm': 0.5692834854125977, 'learning_rate': 9.947521462528465e-06, 'epoch': 0.42}

 14%|█▍        | 1564/11049 [16:07<1:36:54,  1.63it/s]
 14%|█▍        | 1565/11049 [16:07<1:36:57,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.6443929076194763, 'learning_rate': 9.94729295181468e-06, 'epoch': 0.42}

 14%|█▍        | 1565/11049 [16:07<1:36:57,  1.63it/s]
 14%|█▍        | 1566/11049 [16:08<1:36:58,  1.63it/s]
                                                      
{'loss': 0.2813, 'grad_norm': 0.584522545337677, 'learning_rate': 9.947063947307656e-06, 'epoch': 0.43}

 14%|█▍        | 1566/11049 [16:08<1:36:58,  1.63it/s]
 14%|█▍        | 1567/11049 [16:09<1:36:54,  1.63it/s]
                                                      
{'loss': 0.3341, 'grad_norm': 0.73572838306427, 'learning_rate': 9.946834449030252e-06, 'epoch': 0.43}

 14%|█▍        | 1567/11049 [16:09<1:36:54,  1.63it/s]
 14%|█▍        | 1568/11049 [16:09<1:36:53,  1.63it/s]
                                                      
{'loss': 0.3232, 'grad_norm': 0.6992066502571106, 'learning_rate': 9.946604457005373e-06, 'epoch': 0.43}

 14%|█▍        | 1568/11049 [16:09<1:36:53,  1.63it/s]
 14%|█▍        | 1569/11049 [16:10<1:36:51,  1.63it/s]
                                                      
{'loss': 0.233, 'grad_norm': 0.5595865845680237, 'learning_rate': 9.946373971255975e-06, 'epoch': 0.43}

 14%|█▍        | 1569/11049 [16:10<1:36:51,  1.63it/s]
 14%|█▍        | 1570/11049 [16:10<1:36:54,  1.63it/s]
                                                      
{'loss': 0.238, 'grad_norm': 0.5639538764953613, 'learning_rate': 9.946142991805063e-06, 'epoch': 0.43}

 14%|█▍        | 1570/11049 [16:11<1:36:54,  1.63it/s]
 14%|█▍        | 1571/11049 [16:11<1:36:53,  1.63it/s]
                                                      
{'loss': 0.3243, 'grad_norm': 0.6954284906387329, 'learning_rate': 9.945911518675693e-06, 'epoch': 0.43}

 14%|█▍        | 1571/11049 [16:11<1:36:53,  1.63it/s]
 14%|█▍        | 1572/11049 [16:12<1:36:54,  1.63it/s]
                                                      
{'loss': 0.3246, 'grad_norm': 0.7509540915489197, 'learning_rate': 9.945679551890967e-06, 'epoch': 0.43}

 14%|█▍        | 1572/11049 [16:12<1:36:54,  1.63it/s]
 14%|█▍        | 1573/11049 [16:12<1:36:55,  1.63it/s]
                                                      
{'loss': 0.3048, 'grad_norm': 0.6366955041885376, 'learning_rate': 9.945447091474039e-06, 'epoch': 0.43}

 14%|█▍        | 1573/11049 [16:12<1:36:55,  1.63it/s]
 14%|█▍        | 1574/11049 [16:13<1:36:55,  1.63it/s]
                                                      
{'loss': 0.2765, 'grad_norm': 0.6149055361747742, 'learning_rate': 9.945214137448108e-06, 'epoch': 0.43}

 14%|█▍        | 1574/11049 [16:13<1:36:55,  1.63it/s]
 14%|█▍        | 1575/11049 [16:13<1:36:55,  1.63it/s]
                                                      
{'loss': 0.2205, 'grad_norm': 0.4831128716468811, 'learning_rate': 9.944980689836428e-06, 'epoch': 0.43}

 14%|█▍        | 1575/11049 [16:14<1:36:55,  1.63it/s]
 14%|█▍        | 1576/11049 [16:14<1:36:53,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.6150604486465454, 'learning_rate': 9.944746748662299e-06, 'epoch': 0.43}

 14%|█▍        | 1576/11049 [16:14<1:36:53,  1.63it/s]
 14%|█▍        | 1577/11049 [16:15<1:36:54,  1.63it/s]
                                                      
{'loss': 0.442, 'grad_norm': 0.6418073773384094, 'learning_rate': 9.944512313949071e-06, 'epoch': 0.43}

 14%|█▍        | 1577/11049 [16:15<1:36:54,  1.63it/s]
 14%|█▍        | 1578/11049 [16:15<1:36:51,  1.63it/s]
                                                      
{'loss': 0.3325, 'grad_norm': 0.5919997692108154, 'learning_rate': 9.944277385720143e-06, 'epoch': 0.43}

 14%|█▍        | 1578/11049 [16:15<1:36:51,  1.63it/s]
 14%|█▍        | 1579/11049 [16:16<1:36:50,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.5537261366844177, 'learning_rate': 9.944041963998963e-06, 'epoch': 0.43}

 14%|█▍        | 1579/11049 [16:16<1:36:50,  1.63it/s]
 14%|█▍        | 1580/11049 [16:17<1:36:50,  1.63it/s]
                                                      
{'loss': 0.27, 'grad_norm': 0.6133323311805725, 'learning_rate': 9.943806048809031e-06, 'epoch': 0.43}

 14%|█▍        | 1580/11049 [16:17<1:36:50,  1.63it/s]
 14%|█▍        | 1581/11049 [16:17<1:36:50,  1.63it/s]
                                                      
{'loss': 0.271, 'grad_norm': 0.6349402666091919, 'learning_rate': 9.943569640173889e-06, 'epoch': 0.43}

 14%|█▍        | 1581/11049 [16:17<1:36:50,  1.63it/s]
 14%|█▍        | 1582/11049 [16:18<1:36:48,  1.63it/s]
                                                      
{'loss': 0.2934, 'grad_norm': 0.6135333776473999, 'learning_rate': 9.943332738117137e-06, 'epoch': 0.43}

 14%|█▍        | 1582/11049 [16:18<1:36:48,  1.63it/s]
 14%|█▍        | 1583/11049 [16:18<1:36:47,  1.63it/s]
                                                      
{'loss': 0.2448, 'grad_norm': 0.5257080793380737, 'learning_rate': 9.94309534266242e-06, 'epoch': 0.43}

 14%|█▍        | 1583/11049 [16:19<1:36:47,  1.63it/s]
 14%|█▍        | 1584/11049 [16:19<1:36:44,  1.63it/s]
                                                      
{'loss': 0.2592, 'grad_norm': 0.673621654510498, 'learning_rate': 9.94285745383343e-06, 'epoch': 0.43}

 14%|█▍        | 1584/11049 [16:19<1:36:44,  1.63it/s]
 14%|█▍        | 1585/11049 [16:20<1:36:43,  1.63it/s]
                                                      
{'loss': 0.3304, 'grad_norm': 0.6650879383087158, 'learning_rate': 9.942619071653914e-06, 'epoch': 0.43}

 14%|█▍        | 1585/11049 [16:20<1:36:43,  1.63it/s]
 14%|█▍        | 1586/11049 [16:20<1:36:42,  1.63it/s]
                                                      
{'loss': 0.3039, 'grad_norm': 0.6543920636177063, 'learning_rate': 9.942380196147665e-06, 'epoch': 0.43}

 14%|█▍        | 1586/11049 [16:20<1:36:42,  1.63it/s]
 14%|█▍        | 1587/11049 [16:21<1:36:41,  1.63it/s]
                                                      
{'loss': 0.2934, 'grad_norm': 0.7146271467208862, 'learning_rate': 9.942140827338522e-06, 'epoch': 0.43}

 14%|█▍        | 1587/11049 [16:21<1:36:41,  1.63it/s]
 14%|█▍        | 1588/11049 [16:21<1:36:42,  1.63it/s]
                                                      
{'loss': 0.2246, 'grad_norm': 0.48621344566345215, 'learning_rate': 9.941900965250382e-06, 'epoch': 0.43}

 14%|█▍        | 1588/11049 [16:22<1:36:42,  1.63it/s]
 14%|█▍        | 1589/11049 [16:22<1:36:41,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.5482258796691895, 'learning_rate': 9.94166060990718e-06, 'epoch': 0.43}

 14%|█▍        | 1589/11049 [16:22<1:36:41,  1.63it/s]
 14%|█▍        | 1590/11049 [16:23<1:36:38,  1.63it/s]
                                                      
{'loss': 0.3106, 'grad_norm': 0.6609176397323608, 'learning_rate': 9.94141976133291e-06, 'epoch': 0.43}

 14%|█▍        | 1590/11049 [16:23<1:36:38,  1.63it/s]
 14%|█▍        | 1591/11049 [16:23<1:36:42,  1.63it/s]
                                                      
{'loss': 0.289, 'grad_norm': 0.59922856092453, 'learning_rate': 9.94117841955161e-06, 'epoch': 0.43}

 14%|█▍        | 1591/11049 [16:23<1:36:42,  1.63it/s]
 14%|█▍        | 1592/11049 [16:24<1:36:39,  1.63it/s]
                                                      
{'loss': 0.4059, 'grad_norm': 0.6824231743812561, 'learning_rate': 9.940936584587368e-06, 'epoch': 0.43}

 14%|█▍        | 1592/11049 [16:24<1:36:39,  1.63it/s]
 14%|█▍        | 1593/11049 [16:25<1:36:38,  1.63it/s]
                                                      
{'loss': 0.3083, 'grad_norm': 0.6787537932395935, 'learning_rate': 9.940694256464322e-06, 'epoch': 0.43}

 14%|█▍        | 1593/11049 [16:25<1:36:38,  1.63it/s]
 14%|█▍        | 1594/11049 [16:25<1:36:37,  1.63it/s]
                                                      
{'loss': 0.3042, 'grad_norm': 0.761924684047699, 'learning_rate': 9.94045143520666e-06, 'epoch': 0.43}

 14%|█▍        | 1594/11049 [16:25<1:36:37,  1.63it/s]
 14%|█▍        | 1595/11049 [16:26<1:36:37,  1.63it/s]
                                                      
{'loss': 0.282, 'grad_norm': 0.6325827240943909, 'learning_rate': 9.940208120838617e-06, 'epoch': 0.43}

 14%|█▍        | 1595/11049 [16:26<1:36:37,  1.63it/s]
 14%|█▍        | 1596/11049 [16:26<1:36:36,  1.63it/s]
                                                      
{'loss': 0.3102, 'grad_norm': 0.6906644701957703, 'learning_rate': 9.939964313384479e-06, 'epoch': 0.43}

 14%|█▍        | 1596/11049 [16:26<1:36:36,  1.63it/s]
 14%|█▍        | 1597/11049 [16:27<1:36:37,  1.63it/s]
                                                      
{'loss': 0.2793, 'grad_norm': 0.613356351852417, 'learning_rate': 9.93972001286858e-06, 'epoch': 0.43}

 14%|█▍        | 1597/11049 [16:27<1:36:37,  1.63it/s]
 14%|█▍        | 1598/11049 [16:28<1:36:37,  1.63it/s]
                                                      
{'loss': 0.2844, 'grad_norm': 0.7247421145439148, 'learning_rate': 9.939475219315306e-06, 'epoch': 0.43}

 14%|█▍        | 1598/11049 [16:28<1:36:37,  1.63it/s]
 14%|█▍        | 1599/11049 [16:28<1:36:37,  1.63it/s]
                                                      
{'loss': 0.2262, 'grad_norm': 0.5342384576797485, 'learning_rate': 9.939229932749086e-06, 'epoch': 0.43}

 14%|█▍        | 1599/11049 [16:28<1:36:37,  1.63it/s]
 14%|█▍        | 1600/11049 [16:29<1:36:37,  1.63it/s]
                                                      
{'loss': 0.3458, 'grad_norm': 0.6683545112609863, 'learning_rate': 9.938984153194406e-06, 'epoch': 0.43}

 14%|█▍        | 1600/11049 [16:29<1:36:37,  1.63it/s]
 14%|█▍        | 1601/11049 [16:29<1:36:40,  1.63it/s]
                                                      
{'loss': 0.3932, 'grad_norm': 0.7103466987609863, 'learning_rate': 9.938737880675796e-06, 'epoch': 0.43}

 14%|█▍        | 1601/11049 [16:30<1:36:40,  1.63it/s]
 14%|█▍        | 1602/11049 [16:30<1:36:37,  1.63it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.605935275554657, 'learning_rate': 9.938491115217836e-06, 'epoch': 0.43}

 14%|█▍        | 1602/11049 [16:30<1:36:37,  1.63it/s]
 15%|█▍        | 1603/11049 [16:31<1:36:36,  1.63it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.5797910094261169, 'learning_rate': 9.938243856845158e-06, 'epoch': 0.44}

 15%|█▍        | 1603/11049 [16:31<1:36:36,  1.63it/s]
 15%|█▍        | 1604/11049 [16:31<1:36:32,  1.63it/s]
                                                      
{'loss': 0.3121, 'grad_norm': 0.6161479949951172, 'learning_rate': 9.93799610558244e-06, 'epoch': 0.44}

 15%|█▍        | 1604/11049 [16:31<1:36:32,  1.63it/s]
 15%|█▍        | 1605/11049 [16:32<1:36:29,  1.63it/s]
                                                      
{'loss': 0.3752, 'grad_norm': 0.6751661896705627, 'learning_rate': 9.937747861454408e-06, 'epoch': 0.44}

 15%|█▍        | 1605/11049 [16:32<1:36:29,  1.63it/s]
 15%|█▍        | 1606/11049 [16:32<1:36:29,  1.63it/s]
                                                      
{'loss': 0.3146, 'grad_norm': 0.693706214427948, 'learning_rate': 9.93749912448584e-06, 'epoch': 0.44}

 15%|█▍        | 1606/11049 [16:33<1:36:29,  1.63it/s]
 15%|█▍        | 1607/11049 [16:33<1:36:32,  1.63it/s]
                                                      
{'loss': 0.2732, 'grad_norm': 0.5346565246582031, 'learning_rate': 9.937249894701565e-06, 'epoch': 0.44}

 15%|█▍        | 1607/11049 [16:33<1:36:32,  1.63it/s]
 15%|█▍        | 1608/11049 [16:34<1:36:33,  1.63it/s]
                                                      
{'loss': 0.3339, 'grad_norm': 0.6972452402114868, 'learning_rate': 9.93700017212646e-06, 'epoch': 0.44}

 15%|█▍        | 1608/11049 [16:34<1:36:33,  1.63it/s]
 15%|█▍        | 1609/11049 [16:34<1:36:34,  1.63it/s]
                                                      
{'loss': 0.2824, 'grad_norm': 0.5546117424964905, 'learning_rate': 9.936749956785446e-06, 'epoch': 0.44}

 15%|█▍        | 1609/11049 [16:34<1:36:34,  1.63it/s]
 15%|█▍        | 1610/11049 [16:35<1:36:32,  1.63it/s]
                                                      
{'loss': 0.2925, 'grad_norm': 0.5842963457107544, 'learning_rate': 9.9364992487035e-06, 'epoch': 0.44}

 15%|█▍        | 1610/11049 [16:35<1:36:32,  1.63it/s]
 15%|█▍        | 1611/11049 [16:36<1:36:31,  1.63it/s]
                                                      
{'loss': 0.3715, 'grad_norm': 0.7737592458724976, 'learning_rate': 9.936248047905644e-06, 'epoch': 0.44}

 15%|█▍        | 1611/11049 [16:36<1:36:31,  1.63it/s]
 15%|█▍        | 1612/11049 [16:36<1:36:28,  1.63it/s]
                                                      
{'loss': 0.2533, 'grad_norm': 0.6269692182540894, 'learning_rate': 9.935996354416949e-06, 'epoch': 0.44}

 15%|█▍        | 1612/11049 [16:36<1:36:28,  1.63it/s]
 15%|█▍        | 1613/11049 [16:37<1:36:30,  1.63it/s]
                                                      
{'loss': 0.2408, 'grad_norm': 0.5339102149009705, 'learning_rate': 9.93574416826254e-06, 'epoch': 0.44}

 15%|█▍        | 1613/11049 [16:37<1:36:30,  1.63it/s]
 15%|█▍        | 1614/11049 [16:37<1:36:30,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.6170531511306763, 'learning_rate': 9.935491489467588e-06, 'epoch': 0.44}

 15%|█▍        | 1614/11049 [16:38<1:36:30,  1.63it/s]
 15%|█▍        | 1615/11049 [16:38<1:36:30,  1.63it/s]
                                                      
{'loss': 0.2657, 'grad_norm': 0.6406053304672241, 'learning_rate': 9.935238318057309e-06, 'epoch': 0.44}

 15%|█▍        | 1615/11049 [16:38<1:36:30,  1.63it/s]
 15%|█▍        | 1616/11049 [16:39<1:36:33,  1.63it/s]
                                                      
{'loss': 0.3681, 'grad_norm': 0.5914429426193237, 'learning_rate': 9.934984654056977e-06, 'epoch': 0.44}

 15%|█▍        | 1616/11049 [16:39<1:36:33,  1.63it/s]
 15%|█▍        | 1617/11049 [16:39<1:36:32,  1.63it/s]
                                                      
{'loss': 0.3774, 'grad_norm': 0.6824545860290527, 'learning_rate': 9.934730497491907e-06, 'epoch': 0.44}

 15%|█▍        | 1617/11049 [16:39<1:36:32,  1.63it/s]
 15%|█▍        | 1618/11049 [16:40<1:36:31,  1.63it/s]
                                                      
{'loss': 0.2364, 'grad_norm': 0.5814283490180969, 'learning_rate': 9.934475848387468e-06, 'epoch': 0.44}

 15%|█▍        | 1618/11049 [16:40<1:36:31,  1.63it/s]
 15%|█▍        | 1619/11049 [16:40<1:36:25,  1.63it/s]
                                                      
{'loss': 0.2801, 'grad_norm': 0.6591271162033081, 'learning_rate': 9.934220706769075e-06, 'epoch': 0.44}

 15%|█▍        | 1619/11049 [16:41<1:36:25,  1.63it/s]
 15%|█▍        | 1620/11049 [16:41<1:36:27,  1.63it/s]
                                                      
{'loss': 0.3145, 'grad_norm': 0.5954892635345459, 'learning_rate': 9.933965072662197e-06, 'epoch': 0.44}

 15%|█▍        | 1620/11049 [16:41<1:36:27,  1.63it/s]
 15%|█▍        | 1621/11049 [16:42<1:36:24,  1.63it/s]
                                                      
{'loss': 0.2252, 'grad_norm': 0.5573891401290894, 'learning_rate': 9.933708946092347e-06, 'epoch': 0.44}

 15%|█▍        | 1621/11049 [16:42<1:36:24,  1.63it/s]
 15%|█▍        | 1622/11049 [16:42<1:36:24,  1.63it/s]
                                                      
{'loss': 0.2771, 'grad_norm': 0.584243893623352, 'learning_rate': 9.93345232708509e-06, 'epoch': 0.44}

 15%|█▍        | 1622/11049 [16:42<1:36:24,  1.63it/s]
 15%|█▍        | 1623/11049 [16:43<1:36:23,  1.63it/s]
                                                      
{'loss': 0.4044, 'grad_norm': 0.8189394474029541, 'learning_rate': 9.93319521566604e-06, 'epoch': 0.44}

 15%|█▍        | 1623/11049 [16:43<1:36:23,  1.63it/s]
 15%|█▍        | 1624/11049 [16:44<1:36:24,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.5736943483352661, 'learning_rate': 9.932937611860857e-06, 'epoch': 0.44}

 15%|█▍        | 1624/11049 [16:44<1:36:24,  1.63it/s]
 15%|█▍        | 1625/11049 [16:44<1:36:25,  1.63it/s]
                                                      
{'loss': 0.2349, 'grad_norm': 0.5810621976852417, 'learning_rate': 9.932679515695254e-06, 'epoch': 0.44}

 15%|█▍        | 1625/11049 [16:44<1:36:25,  1.63it/s]
 15%|█▍        | 1626/11049 [16:45<1:36:23,  1.63it/s]
                                                      
{'loss': 0.2942, 'grad_norm': 0.5829670429229736, 'learning_rate': 9.932420927194993e-06, 'epoch': 0.44}

 15%|█▍        | 1626/11049 [16:45<1:36:23,  1.63it/s]
 15%|█▍        | 1627/11049 [16:45<1:36:20,  1.63it/s]
                                                      
{'loss': 0.3036, 'grad_norm': 0.6037500500679016, 'learning_rate': 9.932161846385881e-06, 'epoch': 0.44}

 15%|█▍        | 1627/11049 [16:46<1:36:20,  1.63it/s]
 15%|█▍        | 1628/11049 [16:46<1:36:19,  1.63it/s]
                                                      
{'loss': 0.2627, 'grad_norm': 0.6701352596282959, 'learning_rate': 9.93190227329378e-06, 'epoch': 0.44}

 15%|█▍        | 1628/11049 [16:46<1:36:19,  1.63it/s]
 15%|█▍        | 1629/11049 [16:47<1:36:21,  1.63it/s]
                                                      
{'loss': 0.2848, 'grad_norm': 0.5969380140304565, 'learning_rate': 9.931642207944598e-06, 'epoch': 0.44}

 15%|█▍        | 1629/11049 [16:47<1:36:21,  1.63it/s]
 15%|█▍        | 1630/11049 [16:47<1:36:21,  1.63it/s]
                                                      
{'loss': 0.3068, 'grad_norm': 0.5613607168197632, 'learning_rate': 9.931381650364292e-06, 'epoch': 0.44}

 15%|█▍        | 1630/11049 [16:47<1:36:21,  1.63it/s]
 15%|█▍        | 1631/11049 [16:48<1:36:18,  1.63it/s]
                                                      
{'loss': 0.2742, 'grad_norm': 0.6041814088821411, 'learning_rate': 9.931120600578866e-06, 'epoch': 0.44}

 15%|█▍        | 1631/11049 [16:48<1:36:18,  1.63it/s]
 15%|█▍        | 1632/11049 [16:48<1:36:17,  1.63it/s]
                                                      
{'loss': 0.2444, 'grad_norm': 0.7013814449310303, 'learning_rate': 9.930859058614378e-06, 'epoch': 0.44}

 15%|█▍        | 1632/11049 [16:49<1:36:17,  1.63it/s]
 15%|█▍        | 1633/11049 [16:49<1:36:16,  1.63it/s]
                                                      
{'loss': 0.2802, 'grad_norm': 0.6358752846717834, 'learning_rate': 9.930597024496933e-06, 'epoch': 0.44}

 15%|█▍        | 1633/11049 [16:49<1:36:16,  1.63it/s]
 15%|█▍        | 1634/11049 [16:50<1:36:16,  1.63it/s]
                                                      
{'loss': 0.3273, 'grad_norm': 0.6162408590316772, 'learning_rate': 9.930334498252681e-06, 'epoch': 0.44}

 15%|█▍        | 1634/11049 [16:50<1:36:16,  1.63it/s]
 15%|█▍        | 1635/11049 [16:50<1:36:14,  1.63it/s]
                                                      
{'loss': 0.2833, 'grad_norm': 0.5913447141647339, 'learning_rate': 9.930071479907832e-06, 'epoch': 0.44}

 15%|█▍        | 1635/11049 [16:50<1:36:14,  1.63it/s]
 15%|█▍        | 1636/11049 [16:51<1:36:13,  1.63it/s]
                                                      
{'loss': 0.2995, 'grad_norm': 0.6365178227424622, 'learning_rate': 9.929807969488631e-06, 'epoch': 0.44}

 15%|█▍        | 1636/11049 [16:51<1:36:13,  1.63it/s]
 15%|█▍        | 1637/11049 [16:52<1:36:14,  1.63it/s]
                                                      
{'loss': 0.2975, 'grad_norm': 0.618541419506073, 'learning_rate': 9.929543967021385e-06, 'epoch': 0.44}

 15%|█▍        | 1637/11049 [16:52<1:36:14,  1.63it/s]
 15%|█▍        | 1638/11049 [16:52<1:36:14,  1.63it/s]
                                                      
{'loss': 0.3228, 'grad_norm': 0.8638227581977844, 'learning_rate': 9.929279472532438e-06, 'epoch': 0.44}

 15%|█▍        | 1638/11049 [16:52<1:36:14,  1.63it/s]
 15%|█▍        | 1639/11049 [16:53<1:36:12,  1.63it/s]
                                                      
{'loss': 0.3199, 'grad_norm': 0.7197266221046448, 'learning_rate': 9.929014486048196e-06, 'epoch': 0.45}

 15%|█▍        | 1639/11049 [16:53<1:36:12,  1.63it/s]
 15%|█▍        | 1640/11049 [16:53<1:36:11,  1.63it/s]
                                                      
{'loss': 0.3444, 'grad_norm': 0.677351713180542, 'learning_rate': 9.928749007595102e-06, 'epoch': 0.45}

 15%|█▍        | 1640/11049 [16:53<1:36:11,  1.63it/s]
 15%|█▍        | 1641/11049 [16:54<1:36:12,  1.63it/s]
                                                      
{'loss': 0.3168, 'grad_norm': 0.6771168112754822, 'learning_rate': 9.92848303719966e-06, 'epoch': 0.45}

 15%|█▍        | 1641/11049 [16:54<1:36:12,  1.63it/s]
 15%|█▍        | 1642/11049 [16:55<1:36:10,  1.63it/s]
                                                      
{'loss': 0.3204, 'grad_norm': 0.6328599452972412, 'learning_rate': 9.928216574888408e-06, 'epoch': 0.45}

 15%|█▍        | 1642/11049 [16:55<1:36:10,  1.63it/s]
 15%|█▍        | 1643/11049 [16:55<1:36:10,  1.63it/s]
                                                      
{'loss': 0.2251, 'grad_norm': 0.44585150480270386, 'learning_rate': 9.927949620687949e-06, 'epoch': 0.45}

 15%|█▍        | 1643/11049 [16:55<1:36:10,  1.63it/s]
 15%|█▍        | 1644/11049 [16:56<1:36:09,  1.63it/s]
                                                      
{'loss': 0.285, 'grad_norm': 0.6289033889770508, 'learning_rate': 9.927682174624925e-06, 'epoch': 0.45}

 15%|█▍        | 1644/11049 [16:56<1:36:09,  1.63it/s]
 15%|█▍        | 1645/11049 [16:56<1:36:07,  1.63it/s]
                                                      
{'loss': 0.295, 'grad_norm': 0.6557005047798157, 'learning_rate': 9.927414236726031e-06, 'epoch': 0.45}

 15%|█▍        | 1645/11049 [16:57<1:36:07,  1.63it/s]
 15%|█▍        | 1646/11049 [16:57<1:36:05,  1.63it/s]
                                                      
{'loss': 0.2572, 'grad_norm': 0.583194375038147, 'learning_rate': 9.927145807018008e-06, 'epoch': 0.45}

 15%|█▍        | 1646/11049 [16:57<1:36:05,  1.63it/s]
 15%|█▍        | 1647/11049 [16:58<1:36:08,  1.63it/s]
                                                      
{'loss': 0.3221, 'grad_norm': 0.62232905626297, 'learning_rate': 9.926876885527651e-06, 'epoch': 0.45}

 15%|█▍        | 1647/11049 [16:58<1:36:08,  1.63it/s]
 15%|█▍        | 1648/11049 [16:58<1:36:06,  1.63it/s]
                                                      
{'loss': 0.3047, 'grad_norm': 0.8057745695114136, 'learning_rate': 9.9266074722818e-06, 'epoch': 0.45}

 15%|█▍        | 1648/11049 [16:58<1:36:06,  1.63it/s]
 15%|█▍        | 1649/11049 [16:59<1:36:05,  1.63it/s]
                                                      
{'loss': 0.2938, 'grad_norm': 0.5778443217277527, 'learning_rate': 9.926337567307346e-06, 'epoch': 0.45}

 15%|█▍        | 1649/11049 [16:59<1:36:05,  1.63it/s]
 15%|█▍        | 1650/11049 [16:59<1:36:06,  1.63it/s]
                                                      
{'loss': 0.2684, 'grad_norm': 0.6576311588287354, 'learning_rate': 9.926067170631227e-06, 'epoch': 0.45}

 15%|█▍        | 1650/11049 [17:00<1:36:06,  1.63it/s]
 15%|█▍        | 1651/11049 [17:00<1:36:06,  1.63it/s]
                                                      
{'loss': 0.3089, 'grad_norm': 0.6148679256439209, 'learning_rate': 9.925796282280433e-06, 'epoch': 0.45}

 15%|█▍        | 1651/11049 [17:00<1:36:06,  1.63it/s]
 15%|█▍        | 1652/11049 [17:01<1:36:05,  1.63it/s]
                                                      
{'loss': 0.309, 'grad_norm': 0.6396786570549011, 'learning_rate': 9.925524902282e-06, 'epoch': 0.45}

 15%|█▍        | 1652/11049 [17:01<1:36:05,  1.63it/s]
 15%|█▍        | 1653/11049 [17:01<1:36:19,  1.63it/s]
                                                      
{'loss': 0.2844, 'grad_norm': 0.6051164865493774, 'learning_rate': 9.925253030663016e-06, 'epoch': 0.45}

 15%|█▍        | 1653/11049 [17:01<1:36:19,  1.63it/s]
 15%|█▍        | 1654/11049 [17:02<1:36:12,  1.63it/s]
                                                      
{'loss': 0.4808, 'grad_norm': 0.9340261816978455, 'learning_rate': 9.924980667450617e-06, 'epoch': 0.45}

 15%|█▍        | 1654/11049 [17:02<1:36:12,  1.63it/s]
 15%|█▍        | 1655/11049 [17:03<1:36:10,  1.63it/s]
                                                      
{'loss': 0.3238, 'grad_norm': 0.5865598320960999, 'learning_rate': 9.924707812671986e-06, 'epoch': 0.45}

 15%|█▍        | 1655/11049 [17:03<1:36:10,  1.63it/s]
 15%|█▍        | 1656/11049 [17:03<1:36:09,  1.63it/s]
                                                      
{'loss': 0.2872, 'grad_norm': 0.5712597370147705, 'learning_rate': 9.924434466354358e-06, 'epoch': 0.45}

 15%|█▍        | 1656/11049 [17:03<1:36:09,  1.63it/s]
 15%|█▍        | 1657/11049 [17:04<1:36:07,  1.63it/s]
                                                      
{'loss': 0.3267, 'grad_norm': 0.6764105558395386, 'learning_rate': 9.924160628525016e-06, 'epoch': 0.45}

 15%|█▍        | 1657/11049 [17:04<1:36:07,  1.63it/s]
 15%|█▌        | 1658/11049 [17:04<1:36:06,  1.63it/s]
                                                      
{'loss': 0.2946, 'grad_norm': 0.5832130312919617, 'learning_rate': 9.923886299211292e-06, 'epoch': 0.45}

 15%|█▌        | 1658/11049 [17:05<1:36:06,  1.63it/s]
 15%|█▌        | 1659/11049 [17:05<1:36:05,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.5608583092689514, 'learning_rate': 9.923611478440566e-06, 'epoch': 0.45}

 15%|█▌        | 1659/11049 [17:05<1:36:05,  1.63it/s]
 15%|█▌        | 1660/11049 [17:06<1:36:14,  1.63it/s]
                                                      
{'loss': 0.3783, 'grad_norm': 0.6558392643928528, 'learning_rate': 9.92333616624027e-06, 'epoch': 0.45}

 15%|█▌        | 1660/11049 [17:06<1:36:14,  1.63it/s]
 15%|█▌        | 1661/11049 [17:06<1:36:15,  1.63it/s]
                                                      
{'loss': 0.346, 'grad_norm': 0.6564379334449768, 'learning_rate': 9.923060362637882e-06, 'epoch': 0.45}

 15%|█▌        | 1661/11049 [17:06<1:36:15,  1.63it/s]
 15%|█▌        | 1662/11049 [17:07<1:36:06,  1.63it/s]
                                                      
{'loss': 0.2909, 'grad_norm': 0.6130052208900452, 'learning_rate': 9.92278406766093e-06, 'epoch': 0.45}

 15%|█▌        | 1662/11049 [17:07<1:36:06,  1.63it/s]
 15%|█▌        | 1663/11049 [17:07<1:36:05,  1.63it/s]
                                                      
{'loss': 0.3513, 'grad_norm': 0.6034836173057556, 'learning_rate': 9.922507281336992e-06, 'epoch': 0.45}

 15%|█▌        | 1663/11049 [17:08<1:36:05,  1.63it/s]
 15%|█▌        | 1664/11049 [17:08<1:36:00,  1.63it/s]
                                                      
{'loss': 0.1961, 'grad_norm': 0.5092778205871582, 'learning_rate': 9.922230003693692e-06, 'epoch': 0.45}

 15%|█▌        | 1664/11049 [17:08<1:36:00,  1.63it/s]
 15%|█▌        | 1665/11049 [17:09<1:36:07,  1.63it/s]
                                                      
{'loss': 0.3072, 'grad_norm': 0.5653060674667358, 'learning_rate': 9.921952234758708e-06, 'epoch': 0.45}

 15%|█▌        | 1665/11049 [17:09<1:36:07,  1.63it/s]
 15%|█▌        | 1666/11049 [17:09<1:36:07,  1.63it/s]
                                                      
{'loss': 0.3144, 'grad_norm': 0.6532292366027832, 'learning_rate': 9.921673974559763e-06, 'epoch': 0.45}

 15%|█▌        | 1666/11049 [17:09<1:36:07,  1.63it/s]
 15%|█▌        | 1667/11049 [17:10<1:35:59,  1.63it/s]
                                                      
{'loss': 0.2679, 'grad_norm': 0.5825595259666443, 'learning_rate': 9.921395223124632e-06, 'epoch': 0.45}

 15%|█▌        | 1667/11049 [17:10<1:35:59,  1.63it/s]
 15%|█▌        | 1668/11049 [17:11<1:35:57,  1.63it/s]
                                                      
{'loss': 0.2852, 'grad_norm': 0.5979815125465393, 'learning_rate': 9.921115980481135e-06, 'epoch': 0.45}

 15%|█▌        | 1668/11049 [17:11<1:35:57,  1.63it/s]
 15%|█▌        | 1669/11049 [17:11<1:35:54,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.5787903666496277, 'learning_rate': 9.920836246657145e-06, 'epoch': 0.45}

 15%|█▌        | 1669/11049 [17:11<1:35:54,  1.63it/s]
 15%|█▌        | 1670/11049 [17:12<1:35:53,  1.63it/s]
                                                      
{'loss': 0.2635, 'grad_norm': 0.6500210165977478, 'learning_rate': 9.92055602168058e-06, 'epoch': 0.45}

 15%|█▌        | 1670/11049 [17:12<1:35:53,  1.63it/s]
 15%|█▌        | 1671/11049 [17:12<1:35:53,  1.63it/s]
                                                      
{'loss': 0.2006, 'grad_norm': 0.5254402756690979, 'learning_rate': 9.920275305579415e-06, 'epoch': 0.45}

 15%|█▌        | 1671/11049 [17:13<1:35:53,  1.63it/s]
 15%|█▌        | 1672/11049 [17:13<1:35:53,  1.63it/s]
                                                      
{'loss': 0.437, 'grad_norm': 0.8063002228736877, 'learning_rate': 9.919994098381662e-06, 'epoch': 0.45}

 15%|█▌        | 1672/11049 [17:13<1:35:53,  1.63it/s]
 15%|█▌        | 1673/11049 [17:14<1:38:32,  1.59it/s]
                                                      
{'loss': 0.3173, 'grad_norm': 0.6652427315711975, 'learning_rate': 9.919712400115393e-06, 'epoch': 0.45}

 15%|█▌        | 1673/11049 [17:14<1:38:32,  1.59it/s]
 15%|█▌        | 1674/11049 [17:14<1:37:42,  1.60it/s]
                                                      
{'loss': 0.2925, 'grad_norm': 0.6359377503395081, 'learning_rate': 9.919430210808722e-06, 'epoch': 0.45}

 15%|█▌        | 1674/11049 [17:14<1:37:42,  1.60it/s]
 15%|█▌        | 1675/11049 [17:15<1:37:22,  1.60it/s]
                                                      
{'loss': 0.3051, 'grad_norm': 0.6771001815795898, 'learning_rate': 9.919147530489816e-06, 'epoch': 0.45}

 15%|█▌        | 1675/11049 [17:15<1:37:22,  1.60it/s]
 15%|█▌        | 1676/11049 [17:16<1:37:02,  1.61it/s]
                                                      
{'loss': 0.3416, 'grad_norm': 0.6405343413352966, 'learning_rate': 9.91886435918689e-06, 'epoch': 0.46}

 15%|█▌        | 1676/11049 [17:16<1:37:02,  1.61it/s]
 15%|█▌        | 1677/11049 [17:16<1:36:40,  1.62it/s]
                                                      
{'loss': 0.2955, 'grad_norm': 0.7306695580482483, 'learning_rate': 9.918580696928206e-06, 'epoch': 0.46}

 15%|█▌        | 1677/11049 [17:16<1:36:40,  1.62it/s]
 15%|█▌        | 1678/11049 [17:17<1:36:24,  1.62it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.5662873983383179, 'learning_rate': 9.918296543742077e-06, 'epoch': 0.46}

 15%|█▌        | 1678/11049 [17:17<1:36:24,  1.62it/s]
 15%|█▌        | 1679/11049 [17:17<1:36:11,  1.62it/s]
                                                      
{'loss': 0.3448, 'grad_norm': 0.6167957186698914, 'learning_rate': 9.918011899656865e-06, 'epoch': 0.46}

 15%|█▌        | 1679/11049 [17:17<1:36:11,  1.62it/s]
 15%|█▌        | 1680/11049 [17:18<1:36:13,  1.62it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.6603395342826843, 'learning_rate': 9.917726764700982e-06, 'epoch': 0.46}

 15%|█▌        | 1680/11049 [17:18<1:36:13,  1.62it/s]
 15%|█▌        | 1681/11049 [17:19<1:36:21,  1.62it/s]
                                                      
{'loss': 0.2903, 'grad_norm': 0.6071164011955261, 'learning_rate': 9.917441138902883e-06, 'epoch': 0.46}

 15%|█▌        | 1681/11049 [17:19<1:36:21,  1.62it/s]
 15%|█▌        | 1682/11049 [17:19<1:36:09,  1.62it/s]
                                                      
{'loss': 0.2794, 'grad_norm': 0.5519079566001892, 'learning_rate': 9.91715502229108e-06, 'epoch': 0.46}

 15%|█▌        | 1682/11049 [17:19<1:36:09,  1.62it/s]
 15%|█▌        | 1683/11049 [17:20<1:36:01,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.610068678855896, 'learning_rate': 9.916868414894131e-06, 'epoch': 0.46}

 15%|█▌        | 1683/11049 [17:20<1:36:01,  1.63it/s]
 15%|█▌        | 1684/11049 [17:20<1:35:54,  1.63it/s]
                                                      
{'loss': 0.273, 'grad_norm': 0.5839815735816956, 'learning_rate': 9.916581316740641e-06, 'epoch': 0.46}

 15%|█▌        | 1684/11049 [17:21<1:35:54,  1.63it/s]
 15%|█▌        | 1685/11049 [17:21<1:35:53,  1.63it/s]
                                                      
{'loss': 0.3393, 'grad_norm': 0.6941364407539368, 'learning_rate': 9.916293727859265e-06, 'epoch': 0.46}

 15%|█▌        | 1685/11049 [17:21<1:35:53,  1.63it/s]
 15%|█▌        | 1686/11049 [17:22<1:35:56,  1.63it/s]
                                                      
{'loss': 0.2696, 'grad_norm': 0.5705347657203674, 'learning_rate': 9.91600564827871e-06, 'epoch': 0.46}

 15%|█▌        | 1686/11049 [17:22<1:35:56,  1.63it/s]
 15%|█▌        | 1687/11049 [17:22<1:35:53,  1.63it/s]
                                                      
{'loss': 0.2474, 'grad_norm': 0.6040704846382141, 'learning_rate': 9.915717078027727e-06, 'epoch': 0.46}

 15%|█▌        | 1687/11049 [17:22<1:35:53,  1.63it/s]
 15%|█▌        | 1688/11049 [17:23<1:35:49,  1.63it/s]
                                                      
{'loss': 0.3629, 'grad_norm': 0.6211002469062805, 'learning_rate': 9.915428017135117e-06, 'epoch': 0.46}

 15%|█▌        | 1688/11049 [17:23<1:35:49,  1.63it/s]
 15%|█▌        | 1689/11049 [17:23<1:35:45,  1.63it/s]
                                                      
{'loss': 0.324, 'grad_norm': 0.6457273364067078, 'learning_rate': 9.915138465629737e-06, 'epoch': 0.46}

 15%|█▌        | 1689/11049 [17:24<1:35:45,  1.63it/s]
 15%|█▌        | 1690/11049 [17:24<1:35:53,  1.63it/s]
                                                      
{'loss': 0.3141, 'grad_norm': 0.6870874762535095, 'learning_rate': 9.914848423540484e-06, 'epoch': 0.46}

 15%|█▌        | 1690/11049 [17:24<1:35:53,  1.63it/s]
 15%|█▌        | 1691/11049 [17:25<1:35:48,  1.63it/s]
                                                      
{'loss': 0.3152, 'grad_norm': 0.5894924402236938, 'learning_rate': 9.914557890896305e-06, 'epoch': 0.46}

 15%|█▌        | 1691/11049 [17:25<1:35:48,  1.63it/s]
 15%|█▌        | 1692/11049 [17:25<1:35:45,  1.63it/s]
                                                      
{'loss': 0.2763, 'grad_norm': 0.6593320369720459, 'learning_rate': 9.914266867726204e-06, 'epoch': 0.46}

 15%|█▌        | 1692/11049 [17:25<1:35:45,  1.63it/s]
 15%|█▌        | 1693/11049 [17:26<1:35:43,  1.63it/s]
                                                      
{'loss': 0.3224, 'grad_norm': 0.7495174407958984, 'learning_rate': 9.913975354059222e-06, 'epoch': 0.46}

 15%|█▌        | 1693/11049 [17:26<1:35:43,  1.63it/s]
 15%|█▌        | 1694/11049 [17:27<1:35:42,  1.63it/s]
                                                      
{'loss': 0.3042, 'grad_norm': 0.582141101360321, 'learning_rate': 9.913683349924459e-06, 'epoch': 0.46}

 15%|█▌        | 1694/11049 [17:27<1:35:42,  1.63it/s]
 15%|█▌        | 1695/11049 [17:27<1:35:44,  1.63it/s]
                                                      
{'loss': 0.2643, 'grad_norm': 0.6001525521278381, 'learning_rate': 9.91339085535106e-06, 'epoch': 0.46}

 15%|█▌        | 1695/11049 [17:27<1:35:44,  1.63it/s]
 15%|█▌        | 1696/11049 [17:28<1:35:44,  1.63it/s]
                                                      
{'loss': 0.2899, 'grad_norm': 0.6470443606376648, 'learning_rate': 9.913097870368217e-06, 'epoch': 0.46}

 15%|█▌        | 1696/11049 [17:28<1:35:44,  1.63it/s]
 15%|█▌        | 1697/11049 [17:28<1:35:40,  1.63it/s]
                                                      
{'loss': 0.2612, 'grad_norm': 0.5930647253990173, 'learning_rate': 9.912804395005176e-06, 'epoch': 0.46}

 15%|█▌        | 1697/11049 [17:29<1:35:40,  1.63it/s]
 15%|█▌        | 1698/11049 [17:29<1:35:38,  1.63it/s]
                                                      
{'loss': 0.2447, 'grad_norm': 0.5667638778686523, 'learning_rate': 9.912510429291227e-06, 'epoch': 0.46}

 15%|█▌        | 1698/11049 [17:29<1:35:38,  1.63it/s]
 15%|█▌        | 1699/11049 [17:30<1:35:35,  1.63it/s]
                                                      
{'loss': 0.2736, 'grad_norm': 0.6157833933830261, 'learning_rate': 9.91221597325571e-06, 'epoch': 0.46}

 15%|█▌        | 1699/11049 [17:30<1:35:35,  1.63it/s]
 15%|█▌        | 1700/11049 [17:30<1:35:44,  1.63it/s]
                                                      
{'loss': 0.2458, 'grad_norm': 0.5983065962791443, 'learning_rate': 9.91192102692802e-06, 'epoch': 0.46}

 15%|█▌        | 1700/11049 [17:30<1:35:44,  1.63it/s]
 15%|█▌        | 1701/11049 [17:31<1:35:45,  1.63it/s]
                                                      
{'loss': 0.2645, 'grad_norm': 0.5179880857467651, 'learning_rate': 9.911625590337588e-06, 'epoch': 0.46}

 15%|█▌        | 1701/11049 [17:31<1:35:45,  1.63it/s]
 15%|█▌        | 1702/11049 [17:31<1:35:39,  1.63it/s]
                                                      
{'loss': 0.3954, 'grad_norm': 0.6985354423522949, 'learning_rate': 9.911329663513908e-06, 'epoch': 0.46}

 15%|█▌        | 1702/11049 [17:32<1:35:39,  1.63it/s]
 15%|█▌        | 1703/11049 [17:32<1:35:40,  1.63it/s]
                                                      
{'loss': 0.3189, 'grad_norm': 0.6264491677284241, 'learning_rate': 9.911033246486514e-06, 'epoch': 0.46}

 15%|█▌        | 1703/11049 [17:32<1:35:40,  1.63it/s]
 15%|█▌        | 1704/11049 [17:33<1:35:39,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.612954318523407, 'learning_rate': 9.910736339284991e-06, 'epoch': 0.46}

 15%|█▌        | 1704/11049 [17:33<1:35:39,  1.63it/s]
 15%|█▌        | 1705/11049 [17:33<1:35:46,  1.63it/s]
                                                      
{'loss': 0.2782, 'grad_norm': 0.5816984176635742, 'learning_rate': 9.910438941938977e-06, 'epoch': 0.46}

 15%|█▌        | 1705/11049 [17:33<1:35:46,  1.63it/s]
 15%|█▌        | 1706/11049 [17:34<1:35:40,  1.63it/s]
                                                      
{'loss': 0.2475, 'grad_norm': 0.5550294518470764, 'learning_rate': 9.910141054478153e-06, 'epoch': 0.46}

 15%|█▌        | 1706/11049 [17:34<1:35:40,  1.63it/s]
 15%|█▌        | 1707/11049 [17:35<1:35:34,  1.63it/s]
                                                      
{'loss': 0.3162, 'grad_norm': 0.6198613047599792, 'learning_rate': 9.909842676932251e-06, 'epoch': 0.46}

 15%|█▌        | 1707/11049 [17:35<1:35:34,  1.63it/s]
 15%|█▌        | 1708/11049 [17:35<1:35:30,  1.63it/s]
                                                      
{'loss': 0.3126, 'grad_norm': 0.6400821805000305, 'learning_rate': 9.909543809331053e-06, 'epoch': 0.46}

 15%|█▌        | 1708/11049 [17:35<1:35:30,  1.63it/s]
 15%|█▌        | 1709/11049 [17:36<1:35:29,  1.63it/s]
                                                      
{'loss': 0.3803, 'grad_norm': 0.7701480388641357, 'learning_rate': 9.909244451704389e-06, 'epoch': 0.46}

 15%|█▌        | 1709/11049 [17:36<1:35:29,  1.63it/s]
 15%|█▌        | 1710/11049 [17:36<1:35:37,  1.63it/s]
                                                      
{'loss': 0.2834, 'grad_norm': 0.6307326555252075, 'learning_rate': 9.908944604082139e-06, 'epoch': 0.46}

 15%|█▌        | 1710/11049 [17:37<1:35:37,  1.63it/s]
 15%|█▌        | 1711/11049 [17:37<1:35:34,  1.63it/s]
                                                      
{'loss': 0.2517, 'grad_norm': 0.622413158416748, 'learning_rate': 9.90864426649423e-06, 'epoch': 0.46}

 15%|█▌        | 1711/11049 [17:37<1:35:34,  1.63it/s]
 15%|█▌        | 1712/11049 [17:38<1:35:30,  1.63it/s]
                                                      
{'loss': 0.3034, 'grad_norm': 0.6485410928726196, 'learning_rate': 9.90834343897064e-06, 'epoch': 0.46}

 15%|█▌        | 1712/11049 [17:38<1:35:30,  1.63it/s]
 16%|█▌        | 1713/11049 [17:38<1:35:27,  1.63it/s]
                                                      
{'loss': 0.2433, 'grad_norm': 0.6090506911277771, 'learning_rate': 9.908042121541392e-06, 'epoch': 0.47}

 16%|█▌        | 1713/11049 [17:38<1:35:27,  1.63it/s]
 16%|█▌        | 1714/11049 [17:39<1:35:27,  1.63it/s]
                                                      
{'loss': 0.3501, 'grad_norm': 0.614778995513916, 'learning_rate': 9.907740314236563e-06, 'epoch': 0.47}

 16%|█▌        | 1714/11049 [17:39<1:35:27,  1.63it/s]
 16%|█▌        | 1715/11049 [17:39<1:35:33,  1.63it/s]
                                                      
{'loss': 0.2767, 'grad_norm': 0.6163809299468994, 'learning_rate': 9.907438017086277e-06, 'epoch': 0.47}

 16%|█▌        | 1715/11049 [17:40<1:35:33,  1.63it/s]
 16%|█▌        | 1716/11049 [17:40<1:35:29,  1.63it/s]
                                                      
{'loss': 0.2659, 'grad_norm': 0.5622733235359192, 'learning_rate': 9.907135230120706e-06, 'epoch': 0.47}

 16%|█▌        | 1716/11049 [17:40<1:35:29,  1.63it/s]
 16%|█▌        | 1717/11049 [17:41<1:35:30,  1.63it/s]
                                                      
{'loss': 0.2231, 'grad_norm': 0.576067328453064, 'learning_rate': 9.906831953370073e-06, 'epoch': 0.47}

 16%|█▌        | 1717/11049 [17:41<1:35:30,  1.63it/s]
 16%|█▌        | 1718/11049 [17:41<1:35:29,  1.63it/s]
                                                      
{'loss': 0.3515, 'grad_norm': 0.5467789173126221, 'learning_rate': 9.906528186864644e-06, 'epoch': 0.47}

 16%|█▌        | 1718/11049 [17:41<1:35:29,  1.63it/s]
 16%|█▌        | 1719/11049 [17:42<1:35:24,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.7198491096496582, 'learning_rate': 9.906223930634741e-06, 'epoch': 0.47}

 16%|█▌        | 1719/11049 [17:42<1:35:24,  1.63it/s]
 16%|█▌        | 1720/11049 [17:43<1:35:38,  1.63it/s]
                                                      
{'loss': 0.2845, 'grad_norm': 0.5829900503158569, 'learning_rate': 9.905919184710733e-06, 'epoch': 0.47}

 16%|█▌        | 1720/11049 [17:43<1:35:38,  1.63it/s]
 16%|█▌        | 1721/11049 [17:43<1:35:33,  1.63it/s]
                                                      
{'loss': 0.3081, 'grad_norm': 0.6308878064155579, 'learning_rate': 9.905613949123036e-06, 'epoch': 0.47}

 16%|█▌        | 1721/11049 [17:43<1:35:33,  1.63it/s]
 16%|█▌        | 1722/11049 [17:44<1:35:28,  1.63it/s]
                                                      
{'loss': 0.2954, 'grad_norm': 0.538769543170929, 'learning_rate': 9.905308223902114e-06, 'epoch': 0.47}

 16%|█▌        | 1722/11049 [17:44<1:35:28,  1.63it/s]
 16%|█▌        | 1723/11049 [17:44<1:35:26,  1.63it/s]
                                                      
{'loss': 0.3648, 'grad_norm': 0.8079872131347656, 'learning_rate': 9.905002009078485e-06, 'epoch': 0.47}

 16%|█▌        | 1723/11049 [17:45<1:35:26,  1.63it/s]
 16%|█▌        | 1724/11049 [17:45<1:35:23,  1.63it/s]
                                                      
{'loss': 0.2705, 'grad_norm': 0.5752925276756287, 'learning_rate': 9.904695304682711e-06, 'epoch': 0.47}

 16%|█▌        | 1724/11049 [17:45<1:35:23,  1.63it/s]
 16%|█▌        | 1725/11049 [17:46<1:35:29,  1.63it/s]
                                                      
{'loss': 0.299, 'grad_norm': 0.6419761180877686, 'learning_rate': 9.904388110745402e-06, 'epoch': 0.47}

 16%|█▌        | 1725/11049 [17:46<1:35:29,  1.63it/s]
 16%|█▌        | 1726/11049 [17:46<1:35:25,  1.63it/s]
                                                      
{'loss': 0.264, 'grad_norm': 0.5852106213569641, 'learning_rate': 9.904080427297225e-06, 'epoch': 0.47}

 16%|█▌        | 1726/11049 [17:46<1:35:25,  1.63it/s]
 16%|█▌        | 1727/11049 [17:47<1:35:23,  1.63it/s]
                                                      
{'loss': 0.3049, 'grad_norm': 0.6122698187828064, 'learning_rate': 9.903772254368885e-06, 'epoch': 0.47}

 16%|█▌        | 1727/11049 [17:47<1:35:23,  1.63it/s]
 16%|█▌        | 1728/11049 [17:47<1:35:20,  1.63it/s]
                                                      
{'loss': 0.3599, 'grad_norm': 0.5813900828361511, 'learning_rate': 9.90346359199114e-06, 'epoch': 0.47}

 16%|█▌        | 1728/11049 [17:48<1:35:20,  1.63it/s]
 16%|█▌        | 1729/11049 [17:48<1:35:20,  1.63it/s]
                                                      
{'loss': 0.2728, 'grad_norm': 0.6046329736709595, 'learning_rate': 9.903154440194804e-06, 'epoch': 0.47}

 16%|█▌        | 1729/11049 [17:48<1:35:20,  1.63it/s]
 16%|█▌        | 1730/11049 [17:49<1:35:24,  1.63it/s]
                                                      
{'loss': 0.3377, 'grad_norm': 0.7339783310890198, 'learning_rate': 9.90284479901073e-06, 'epoch': 0.47}

 16%|█▌        | 1730/11049 [17:49<1:35:24,  1.63it/s]
 16%|█▌        | 1731/11049 [17:49<1:35:21,  1.63it/s]
                                                      
{'loss': 0.3238, 'grad_norm': 0.6320992112159729, 'learning_rate': 9.902534668469822e-06, 'epoch': 0.47}

 16%|█▌        | 1731/11049 [17:49<1:35:21,  1.63it/s]
 16%|█▌        | 1732/11049 [17:50<1:35:22,  1.63it/s]
                                                      
{'loss': 0.3205, 'grad_norm': 0.5908650755882263, 'learning_rate': 9.902224048603036e-06, 'epoch': 0.47}

 16%|█▌        | 1732/11049 [17:50<1:35:22,  1.63it/s]
 16%|█▌        | 1733/11049 [17:51<1:35:21,  1.63it/s]
                                                      
{'loss': 0.2698, 'grad_norm': 0.5403745174407959, 'learning_rate': 9.901912939441376e-06, 'epoch': 0.47}

 16%|█▌        | 1733/11049 [17:51<1:35:21,  1.63it/s]
 16%|█▌        | 1734/11049 [17:51<1:35:20,  1.63it/s]
                                                      
{'loss': 0.3349, 'grad_norm': 0.8666381239891052, 'learning_rate': 9.901601341015891e-06, 'epoch': 0.47}

 16%|█▌        | 1734/11049 [17:51<1:35:20,  1.63it/s]
 16%|█▌        | 1735/11049 [17:52<1:35:27,  1.63it/s]
                                                      
{'loss': 0.2524, 'grad_norm': 0.5343551635742188, 'learning_rate': 9.901289253357688e-06, 'epoch': 0.47}

 16%|█▌        | 1735/11049 [17:52<1:35:27,  1.63it/s]
 16%|█▌        | 1736/11049 [17:52<1:35:21,  1.63it/s]
                                                      
{'loss': 0.3292, 'grad_norm': 0.5582662224769592, 'learning_rate': 9.900976676497912e-06, 'epoch': 0.47}

 16%|█▌        | 1736/11049 [17:52<1:35:21,  1.63it/s]
 16%|█▌        | 1737/11049 [17:53<1:35:17,  1.63it/s]
                                                      
{'loss': 0.2529, 'grad_norm': 0.5244906544685364, 'learning_rate': 9.90066361046776e-06, 'epoch': 0.47}

 16%|█▌        | 1737/11049 [17:53<1:35:17,  1.63it/s]
 16%|█▌        | 1738/11049 [17:54<1:35:14,  1.63it/s]
                                                      
{'loss': 0.3736, 'grad_norm': 0.63813316822052, 'learning_rate': 9.900350055298484e-06, 'epoch': 0.47}

 16%|█▌        | 1738/11049 [17:54<1:35:14,  1.63it/s]
 16%|█▌        | 1739/11049 [17:54<1:35:14,  1.63it/s]
                                                      
{'loss': 0.3332, 'grad_norm': 0.7614856958389282, 'learning_rate': 9.900036011021376e-06, 'epoch': 0.47}

 16%|█▌        | 1739/11049 [17:54<1:35:14,  1.63it/s]
 16%|█▌        | 1740/11049 [17:55<1:35:24,  1.63it/s]
                                                      
{'loss': 0.3212, 'grad_norm': 0.6352057456970215, 'learning_rate': 9.899721477667785e-06, 'epoch': 0.47}

 16%|█▌        | 1740/11049 [17:55<1:35:24,  1.63it/s]
 16%|█▌        | 1741/11049 [17:55<1:35:17,  1.63it/s]
                                                      
{'loss': 0.297, 'grad_norm': 0.6296541094779968, 'learning_rate': 9.899406455269103e-06, 'epoch': 0.47}

 16%|█▌        | 1741/11049 [17:56<1:35:17,  1.63it/s]
 16%|█▌        | 1742/11049 [17:56<1:35:15,  1.63it/s]
                                                      
{'loss': 0.2886, 'grad_norm': 0.6152142286300659, 'learning_rate': 9.899090943856773e-06, 'epoch': 0.47}

 16%|█▌        | 1742/11049 [17:56<1:35:15,  1.63it/s]
 16%|█▌        | 1743/11049 [17:57<1:35:12,  1.63it/s]
                                                      
{'loss': 0.3206, 'grad_norm': 0.6297300457954407, 'learning_rate': 9.898774943462285e-06, 'epoch': 0.47}

 16%|█▌        | 1743/11049 [17:57<1:35:12,  1.63it/s]
 16%|█▌        | 1744/11049 [17:57<1:35:12,  1.63it/s]
                                                      
{'loss': 0.2412, 'grad_norm': 0.5447819828987122, 'learning_rate': 9.898458454117179e-06, 'epoch': 0.47}

 16%|█▌        | 1744/11049 [17:57<1:35:12,  1.63it/s]
 16%|█▌        | 1745/11049 [17:58<1:35:19,  1.63it/s]
                                                      
{'loss': 0.2629, 'grad_norm': 0.5674167275428772, 'learning_rate': 9.898141475853047e-06, 'epoch': 0.47}

 16%|█▌        | 1745/11049 [17:58<1:35:19,  1.63it/s]
 16%|█▌        | 1746/11049 [17:59<1:35:16,  1.63it/s]
                                                      
{'loss': 0.2695, 'grad_norm': 0.5949392318725586, 'learning_rate': 9.897824008701525e-06, 'epoch': 0.47}

 16%|█▌        | 1746/11049 [17:59<1:35:16,  1.63it/s]
 16%|█▌        | 1747/11049 [17:59<1:35:14,  1.63it/s]
                                                      
{'loss': 0.2868, 'grad_norm': 0.6733345985412598, 'learning_rate': 9.897506052694299e-06, 'epoch': 0.47}

 16%|█▌        | 1747/11049 [17:59<1:35:14,  1.63it/s]
 16%|█▌        | 1748/11049 [18:00<1:35:10,  1.63it/s]
                                                      
{'loss': 0.3382, 'grad_norm': 0.5755280256271362, 'learning_rate': 9.897187607863103e-06, 'epoch': 0.47}

 16%|█▌        | 1748/11049 [18:00<1:35:10,  1.63it/s]
 16%|█▌        | 1749/11049 [18:00<1:35:06,  1.63it/s]
                                                      
{'loss': 0.2523, 'grad_norm': 0.5335016250610352, 'learning_rate': 9.896868674239726e-06, 'epoch': 0.47}

 16%|█▌        | 1749/11049 [18:00<1:35:06,  1.63it/s]
 16%|█▌        | 1750/11049 [18:01<1:35:10,  1.63it/s]
                                                      
{'loss': 0.3159, 'grad_norm': 0.6770134568214417, 'learning_rate': 9.896549251855999e-06, 'epoch': 0.48}

 16%|█▌        | 1750/11049 [18:01<1:35:10,  1.63it/s]
 16%|█▌        | 1751/11049 [18:02<1:35:09,  1.63it/s]
                                                      
{'loss': 0.285, 'grad_norm': 0.6543351411819458, 'learning_rate': 9.896229340743802e-06, 'epoch': 0.48}

 16%|█▌        | 1751/11049 [18:02<1:35:09,  1.63it/s]
 16%|█▌        | 1752/11049 [18:02<1:35:06,  1.63it/s]
                                                      
{'loss': 0.3, 'grad_norm': 0.5886512398719788, 'learning_rate': 9.895908940935067e-06, 'epoch': 0.48}

 16%|█▌        | 1752/11049 [18:02<1:35:06,  1.63it/s]
 16%|█▌        | 1753/11049 [18:03<1:35:28,  1.62it/s]
                                                      
{'loss': 0.3071, 'grad_norm': 0.6520683169364929, 'learning_rate': 9.895588052461773e-06, 'epoch': 0.48}

 16%|█▌        | 1753/11049 [18:03<1:35:28,  1.62it/s]
 16%|█▌        | 1754/11049 [18:03<1:35:20,  1.62it/s]
                                                      
{'loss': 0.3655, 'grad_norm': 0.601142168045044, 'learning_rate': 9.895266675355949e-06, 'epoch': 0.48}

 16%|█▌        | 1754/11049 [18:04<1:35:20,  1.62it/s]
 16%|█▌        | 1755/11049 [18:04<1:35:18,  1.63it/s]
                                                      
{'loss': 0.2514, 'grad_norm': 0.5721869468688965, 'learning_rate': 9.894944809649671e-06, 'epoch': 0.48}

 16%|█▌        | 1755/11049 [18:04<1:35:18,  1.63it/s]
 16%|█▌        | 1756/11049 [18:05<1:37:30,  1.59it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.5687025189399719, 'learning_rate': 9.894622455375065e-06, 'epoch': 0.48}

 16%|█▌        | 1756/11049 [18:05<1:37:30,  1.59it/s]
 16%|█▌        | 1757/11049 [18:05<1:37:06,  1.59it/s]
                                                      
{'loss': 0.3154, 'grad_norm': 0.6421091556549072, 'learning_rate': 9.894299612564304e-06, 'epoch': 0.48}

 16%|█▌        | 1757/11049 [18:05<1:37:06,  1.59it/s]
 16%|█▌        | 1758/11049 [18:06<1:36:26,  1.61it/s]
                                                      
{'loss': 0.3346, 'grad_norm': 0.6823651790618896, 'learning_rate': 9.893976281249614e-06, 'epoch': 0.48}

 16%|█▌        | 1758/11049 [18:06<1:36:26,  1.61it/s]
 16%|█▌        | 1759/11049 [18:07<1:35:57,  1.61it/s]
                                                      
{'loss': 0.2749, 'grad_norm': 0.6242900490760803, 'learning_rate': 9.893652461463265e-06, 'epoch': 0.48}

 16%|█▌        | 1759/11049 [18:07<1:35:57,  1.61it/s]
 16%|█▌        | 1760/11049 [18:07<1:35:49,  1.62it/s]
                                                      
{'loss': 0.3164, 'grad_norm': 0.5933509469032288, 'learning_rate': 9.893328153237578e-06, 'epoch': 0.48}

 16%|█▌        | 1760/11049 [18:07<1:35:49,  1.62it/s]
 16%|█▌        | 1761/11049 [18:08<1:35:40,  1.62it/s]
                                                      
{'loss': 0.2638, 'grad_norm': 0.5449627041816711, 'learning_rate': 9.893003356604923e-06, 'epoch': 0.48}

 16%|█▌        | 1761/11049 [18:08<1:35:40,  1.62it/s]
 16%|█▌        | 1762/11049 [18:08<1:37:40,  1.58it/s]
                                                      
{'loss': 0.2734, 'grad_norm': 0.593451201915741, 'learning_rate': 9.892678071597717e-06, 'epoch': 0.48}

 16%|█▌        | 1762/11049 [18:09<1:37:40,  1.58it/s]
 16%|█▌        | 1763/11049 [18:09<1:37:17,  1.59it/s]
                                                      
{'loss': 0.3174, 'grad_norm': 0.68085116147995, 'learning_rate': 9.89235229824843e-06, 'epoch': 0.48}

 16%|█▌        | 1763/11049 [18:09<1:37:17,  1.59it/s]
 16%|█▌        | 1764/11049 [18:10<1:36:36,  1.60it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.5538164973258972, 'learning_rate': 9.892026036589574e-06, 'epoch': 0.48}

 16%|█▌        | 1764/11049 [18:10<1:36:36,  1.60it/s]
 16%|█▌        | 1765/11049 [18:10<1:36:15,  1.61it/s]
                                                      
{'loss': 0.3279, 'grad_norm': 0.5904690027236938, 'learning_rate': 9.891699286653714e-06, 'epoch': 0.48}

 16%|█▌        | 1765/11049 [18:10<1:36:15,  1.61it/s]
 16%|█▌        | 1766/11049 [18:11<1:36:00,  1.61it/s]
                                                      
{'loss': 0.2655, 'grad_norm': 0.606222927570343, 'learning_rate': 9.891372048473466e-06, 'epoch': 0.48}

 16%|█▌        | 1766/11049 [18:11<1:36:00,  1.61it/s]
 16%|█▌        | 1767/11049 [18:12<1:35:39,  1.62it/s]
                                                      
{'loss': 0.2999, 'grad_norm': 0.6364272832870483, 'learning_rate': 9.891044322081489e-06, 'epoch': 0.48}

 16%|█▌        | 1767/11049 [18:12<1:35:39,  1.62it/s]
 16%|█▌        | 1768/11049 [18:12<1:35:27,  1.62it/s]
                                                      
{'loss': 0.2789, 'grad_norm': 0.5894739627838135, 'learning_rate': 9.890716107510494e-06, 'epoch': 0.48}

 16%|█▌        | 1768/11049 [18:12<1:35:27,  1.62it/s]
 16%|█▌        | 1769/11049 [18:13<1:35:15,  1.62it/s]
                                                      
{'loss': 0.2487, 'grad_norm': 0.5514621734619141, 'learning_rate': 9.890387404793243e-06, 'epoch': 0.48}

 16%|█▌        | 1769/11049 [18:13<1:35:15,  1.62it/s]
 16%|█▌        | 1770/11049 [18:13<1:35:13,  1.62it/s]
                                                      
{'loss': 0.2526, 'grad_norm': 0.5114431381225586, 'learning_rate': 9.890058213962539e-06, 'epoch': 0.48}

 16%|█▌        | 1770/11049 [18:13<1:35:13,  1.62it/s]
 16%|█▌        | 1771/11049 [18:14<1:35:05,  1.63it/s]
                                                      
{'loss': 0.2641, 'grad_norm': 0.5522448420524597, 'learning_rate': 9.889728535051244e-06, 'epoch': 0.48}

 16%|█▌        | 1771/11049 [18:14<1:35:05,  1.63it/s]
 16%|█▌        | 1772/11049 [18:15<1:35:02,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.7392565011978149, 'learning_rate': 9.889398368092262e-06, 'epoch': 0.48}

 16%|█▌        | 1772/11049 [18:15<1:35:02,  1.63it/s]
 16%|█▌        | 1773/11049 [18:15<1:34:59,  1.63it/s]
                                                      
{'loss': 0.2486, 'grad_norm': 0.503375232219696, 'learning_rate': 9.889067713118546e-06, 'epoch': 0.48}

 16%|█▌        | 1773/11049 [18:15<1:34:59,  1.63it/s]
 16%|█▌        | 1774/11049 [18:16<1:34:56,  1.63it/s]
                                                      
{'loss': 0.2795, 'grad_norm': 0.628131628036499, 'learning_rate': 9.888736570163097e-06, 'epoch': 0.48}

 16%|█▌        | 1774/11049 [18:16<1:34:56,  1.63it/s]
 16%|█▌        | 1775/11049 [18:16<1:35:01,  1.63it/s]
                                                      
{'loss': 0.2772, 'grad_norm': 0.5911384224891663, 'learning_rate': 9.888404939258973e-06, 'epoch': 0.48}

 16%|█▌        | 1775/11049 [18:17<1:35:01,  1.63it/s]
 16%|█▌        | 1776/11049 [18:17<1:34:55,  1.63it/s]
                                                      
{'loss': 0.2563, 'grad_norm': 0.5643629431724548, 'learning_rate': 9.88807282043927e-06, 'epoch': 0.48}

 16%|█▌        | 1776/11049 [18:17<1:34:55,  1.63it/s]
 16%|█▌        | 1777/11049 [18:18<1:34:51,  1.63it/s]
                                                      
{'loss': 0.4084, 'grad_norm': 0.6639102101325989, 'learning_rate': 9.887740213737136e-06, 'epoch': 0.48}

 16%|█▌        | 1777/11049 [18:18<1:34:51,  1.63it/s]
 16%|█▌        | 1778/11049 [18:18<1:34:49,  1.63it/s]
                                                      
{'loss': 0.3438, 'grad_norm': 0.6143438816070557, 'learning_rate': 9.887407119185771e-06, 'epoch': 0.48}

 16%|█▌        | 1778/11049 [18:18<1:34:49,  1.63it/s]
 16%|█▌        | 1779/11049 [18:19<1:34:45,  1.63it/s]
                                                      
{'loss': 0.3563, 'grad_norm': 0.7143799066543579, 'learning_rate': 9.88707353681842e-06, 'epoch': 0.48}

 16%|█▌        | 1779/11049 [18:19<1:34:45,  1.63it/s]
 16%|█▌        | 1780/11049 [18:20<1:34:54,  1.63it/s]
                                                      
{'loss': 0.2883, 'grad_norm': 0.5638521909713745, 'learning_rate': 9.886739466668379e-06, 'epoch': 0.48}

 16%|█▌        | 1780/11049 [18:20<1:34:54,  1.63it/s]
 16%|█▌        | 1781/11049 [18:20<1:34:51,  1.63it/s]
                                                      
{'loss': 0.2854, 'grad_norm': 0.6252045035362244, 'learning_rate': 9.886404908768991e-06, 'epoch': 0.48}

 16%|█▌        | 1781/11049 [18:20<1:34:51,  1.63it/s]
 16%|█▌        | 1782/11049 [18:21<1:34:49,  1.63it/s]
                                                      
{'loss': 0.2369, 'grad_norm': 0.5486466884613037, 'learning_rate': 9.886069863153652e-06, 'epoch': 0.48}

 16%|█▌        | 1782/11049 [18:21<1:34:49,  1.63it/s]
 16%|█▌        | 1783/11049 [18:21<1:34:45,  1.63it/s]
                                                      
{'loss': 0.2858, 'grad_norm': 0.5810123085975647, 'learning_rate': 9.885734329855798e-06, 'epoch': 0.48}

 16%|█▌        | 1783/11049 [18:21<1:34:45,  1.63it/s]
 16%|█▌        | 1784/11049 [18:22<1:34:44,  1.63it/s]
                                                      
{'loss': 0.3464, 'grad_norm': 0.6600297093391418, 'learning_rate': 9.885398308908923e-06, 'epoch': 0.48}

 16%|█▌        | 1784/11049 [18:22<1:34:44,  1.63it/s]
 16%|█▌        | 1785/11049 [18:23<1:34:47,  1.63it/s]
                                                      
{'loss': 0.3993, 'grad_norm': 0.7453498244285583, 'learning_rate': 9.885061800346563e-06, 'epoch': 0.48}

 16%|█▌        | 1785/11049 [18:23<1:34:47,  1.63it/s]
 16%|█▌        | 1786/11049 [18:23<1:34:45,  1.63it/s]
                                                      
{'loss': 0.2822, 'grad_norm': 0.6273903846740723, 'learning_rate': 9.884724804202304e-06, 'epoch': 0.48}

 16%|█▌        | 1786/11049 [18:23<1:34:45,  1.63it/s]
 16%|█▌        | 1787/11049 [18:24<1:34:51,  1.63it/s]
                                                      
{'loss': 0.2566, 'grad_norm': 0.4882863461971283, 'learning_rate': 9.884387320509785e-06, 'epoch': 0.49}

 16%|█▌        | 1787/11049 [18:24<1:34:51,  1.63it/s]
 16%|█▌        | 1788/11049 [18:24<1:34:44,  1.63it/s]
                                                      
{'loss': 0.2557, 'grad_norm': 0.4996090829372406, 'learning_rate': 9.88404934930269e-06, 'epoch': 0.49}

 16%|█▌        | 1788/11049 [18:25<1:34:44,  1.63it/s]
 16%|█▌        | 1789/11049 [18:25<1:34:44,  1.63it/s]
                                                      
{'loss': 0.2973, 'grad_norm': 0.5946150422096252, 'learning_rate': 9.883710890614751e-06, 'epoch': 0.49}

 16%|█▌        | 1789/11049 [18:25<1:34:44,  1.63it/s]
 16%|█▌        | 1790/11049 [18:26<1:34:53,  1.63it/s]
                                                      
{'loss': 0.2547, 'grad_norm': 0.5567334294319153, 'learning_rate': 9.88337194447975e-06, 'epoch': 0.49}

 16%|█▌        | 1790/11049 [18:26<1:34:53,  1.63it/s]
 16%|█▌        | 1791/11049 [18:26<1:34:51,  1.63it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.5619609355926514, 'learning_rate': 9.883032510931518e-06, 'epoch': 0.49}

 16%|█▌        | 1791/11049 [18:26<1:34:51,  1.63it/s]
 16%|█▌        | 1792/11049 [18:27<1:34:45,  1.63it/s]
                                                      
{'loss': 0.294, 'grad_norm': 0.6039636135101318, 'learning_rate': 9.882692590003933e-06, 'epoch': 0.49}

 16%|█▌        | 1792/11049 [18:27<1:34:45,  1.63it/s]
 16%|█▌        | 1793/11049 [18:27<1:34:42,  1.63it/s]
                                                      
{'loss': 0.3281, 'grad_norm': 0.6349294781684875, 'learning_rate': 9.882352181730925e-06, 'epoch': 0.49}

 16%|█▌        | 1793/11049 [18:28<1:34:42,  1.63it/s]
 16%|█▌        | 1794/11049 [18:28<1:34:41,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.585265576839447, 'learning_rate': 9.882011286146469e-06, 'epoch': 0.49}

 16%|█▌        | 1794/11049 [18:28<1:34:41,  1.63it/s]
 16%|█▌        | 1795/11049 [18:29<1:34:46,  1.63it/s]
                                                      
{'loss': 0.3118, 'grad_norm': 0.6921768188476562, 'learning_rate': 9.881669903284589e-06, 'epoch': 0.49}

 16%|█▌        | 1795/11049 [18:29<1:34:46,  1.63it/s]
 16%|█▋        | 1796/11049 [18:29<1:34:41,  1.63it/s]
                                                      
{'loss': 0.2673, 'grad_norm': 0.5516487956047058, 'learning_rate': 9.881328033179361e-06, 'epoch': 0.49}

 16%|█▋        | 1796/11049 [18:29<1:34:41,  1.63it/s]
 16%|█▋        | 1797/11049 [18:30<1:34:41,  1.63it/s]
                                                      
{'loss': 0.2521, 'grad_norm': 0.5757580995559692, 'learning_rate': 9.880985675864905e-06, 'epoch': 0.49}

 16%|█▋        | 1797/11049 [18:30<1:34:41,  1.63it/s]
 16%|█▋        | 1798/11049 [18:31<1:34:38,  1.63it/s]
                                                      
{'loss': 0.267, 'grad_norm': 0.6743544340133667, 'learning_rate': 9.880642831375394e-06, 'epoch': 0.49}

 16%|█▋        | 1798/11049 [18:31<1:34:38,  1.63it/s]
 16%|█▋        | 1799/11049 [18:31<1:34:37,  1.63it/s]
                                                      
{'loss': 0.2821, 'grad_norm': 0.5865318775177002, 'learning_rate': 9.880299499745046e-06, 'epoch': 0.49}

 16%|█▋        | 1799/11049 [18:31<1:34:37,  1.63it/s]
 16%|█▋        | 1800/11049 [18:32<1:34:40,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.5259645581245422, 'learning_rate': 9.87995568100813e-06, 'epoch': 0.49}

 16%|█▋        | 1800/11049 [18:32<1:34:40,  1.63it/s]
 16%|█▋        | 1801/11049 [18:32<1:34:36,  1.63it/s]
                                                      
{'loss': 0.3287, 'grad_norm': 0.6164426207542419, 'learning_rate': 9.879611375198963e-06, 'epoch': 0.49}

 16%|█▋        | 1801/11049 [18:33<1:34:36,  1.63it/s]
 16%|█▋        | 1802/11049 [18:33<1:34:33,  1.63it/s]
                                                      
{'loss': 0.3306, 'grad_norm': 0.6543952822685242, 'learning_rate': 9.879266582351911e-06, 'epoch': 0.49}

 16%|█▋        | 1802/11049 [18:33<1:34:33,  1.63it/s]
 16%|█▋        | 1803/11049 [18:34<1:34:34,  1.63it/s]
                                                      
{'loss': 0.3945, 'grad_norm': 0.7405915856361389, 'learning_rate': 9.878921302501385e-06, 'epoch': 0.49}

 16%|█▋        | 1803/11049 [18:34<1:34:34,  1.63it/s]
 16%|█▋        | 1804/11049 [18:34<1:34:34,  1.63it/s]
                                                      
{'loss': 0.2863, 'grad_norm': 0.6139333844184875, 'learning_rate': 9.878575535681851e-06, 'epoch': 0.49}

 16%|█▋        | 1804/11049 [18:34<1:34:34,  1.63it/s]
 16%|█▋        | 1805/11049 [18:35<1:34:41,  1.63it/s]
                                                      
{'loss': 0.2312, 'grad_norm': 0.5199505686759949, 'learning_rate': 9.87822928192782e-06, 'epoch': 0.49}

 16%|█▋        | 1805/11049 [18:35<1:34:41,  1.63it/s]
 16%|█▋        | 1806/11049 [18:35<1:34:40,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.6061384081840515, 'learning_rate': 9.877882541273852e-06, 'epoch': 0.49}

 16%|█▋        | 1806/11049 [18:36<1:34:40,  1.63it/s]
 16%|█▋        | 1807/11049 [18:36<1:34:35,  1.63it/s]
                                                      
{'loss': 0.3511, 'grad_norm': 0.7231301069259644, 'learning_rate': 9.877535313754552e-06, 'epoch': 0.49}

 16%|█▋        | 1807/11049 [18:36<1:34:35,  1.63it/s]
 16%|█▋        | 1808/11049 [18:37<1:34:32,  1.63it/s]
                                                      
{'loss': 0.3375, 'grad_norm': 0.7199438214302063, 'learning_rate': 9.87718759940458e-06, 'epoch': 0.49}

 16%|█▋        | 1808/11049 [18:37<1:34:32,  1.63it/s]
 16%|█▋        | 1809/11049 [18:37<1:34:30,  1.63it/s]
                                                      
{'loss': 0.2996, 'grad_norm': 0.5742035508155823, 'learning_rate': 9.87683939825864e-06, 'epoch': 0.49}

 16%|█▋        | 1809/11049 [18:37<1:34:30,  1.63it/s]
 16%|█▋        | 1810/11049 [18:38<1:34:34,  1.63it/s]
                                                      
{'loss': 0.3973, 'grad_norm': 0.7627360224723816, 'learning_rate': 9.87649071035149e-06, 'epoch': 0.49}

 16%|█▋        | 1810/11049 [18:38<1:34:34,  1.63it/s]
 16%|█▋        | 1811/11049 [18:39<1:34:28,  1.63it/s]
                                                      
{'loss': 0.2888, 'grad_norm': 0.6122828125953674, 'learning_rate': 9.87614153571793e-06, 'epoch': 0.49}

 16%|█▋        | 1811/11049 [18:39<1:34:28,  1.63it/s]
 16%|█▋        | 1812/11049 [18:39<1:34:27,  1.63it/s]
                                                      
{'loss': 0.4743, 'grad_norm': 0.754146158695221, 'learning_rate': 9.87579187439281e-06, 'epoch': 0.49}

 16%|█▋        | 1812/11049 [18:39<1:34:27,  1.63it/s]
 16%|█▋        | 1813/11049 [18:40<1:34:26,  1.63it/s]
                                                      
{'loss': 0.2348, 'grad_norm': 0.5433804988861084, 'learning_rate': 9.875441726411032e-06, 'epoch': 0.49}

 16%|█▋        | 1813/11049 [18:40<1:34:26,  1.63it/s]
 16%|█▋        | 1814/11049 [18:40<1:34:22,  1.63it/s]
                                                      
{'loss': 0.2595, 'grad_norm': 0.4964374899864197, 'learning_rate': 9.875091091807543e-06, 'epoch': 0.49}

 16%|█▋        | 1814/11049 [18:41<1:34:22,  1.63it/s]
 16%|█▋        | 1815/11049 [18:41<1:34:31,  1.63it/s]
                                                      
{'loss': 0.2637, 'grad_norm': 0.5762786865234375, 'learning_rate': 9.874739970617342e-06, 'epoch': 0.49}

 16%|█▋        | 1815/11049 [18:41<1:34:31,  1.63it/s]
 16%|█▋        | 1816/11049 [18:42<1:34:27,  1.63it/s]
                                                      
{'loss': 0.2603, 'grad_norm': 0.5476474165916443, 'learning_rate': 9.874388362875476e-06, 'epoch': 0.49}

 16%|█▋        | 1816/11049 [18:42<1:34:27,  1.63it/s]
 16%|█▋        | 1817/11049 [18:42<1:34:24,  1.63it/s]
                                                      
{'loss': 0.3504, 'grad_norm': 0.666142463684082, 'learning_rate': 9.874036268617034e-06, 'epoch': 0.49}

 16%|█▋        | 1817/11049 [18:42<1:34:24,  1.63it/s]
 16%|█▋        | 1818/11049 [18:43<1:34:24,  1.63it/s]
                                                      
{'loss': 0.2961, 'grad_norm': 0.5976452231407166, 'learning_rate': 9.873683687877164e-06, 'epoch': 0.49}

 16%|█▋        | 1818/11049 [18:43<1:34:24,  1.63it/s]
 16%|█▋        | 1819/11049 [18:43<1:34:20,  1.63it/s]
                                                      
{'loss': 0.2866, 'grad_norm': 0.6303009390830994, 'learning_rate': 9.873330620691056e-06, 'epoch': 0.49}

 16%|█▋        | 1819/11049 [18:44<1:34:20,  1.63it/s]
 16%|█▋        | 1820/11049 [18:44<1:34:24,  1.63it/s]
                                                      
{'loss': 0.3435, 'grad_norm': 0.6044914126396179, 'learning_rate': 9.872977067093948e-06, 'epoch': 0.49}

 16%|█▋        | 1820/11049 [18:44<1:34:24,  1.63it/s]
 16%|█▋        | 1821/11049 [18:45<1:34:25,  1.63it/s]
                                                      
{'loss': 0.2994, 'grad_norm': 0.5808449983596802, 'learning_rate': 9.872623027121128e-06, 'epoch': 0.49}

 16%|█▋        | 1821/11049 [18:45<1:34:25,  1.63it/s]
 16%|█▋        | 1822/11049 [18:45<1:34:21,  1.63it/s]
                                                      
{'loss': 0.281, 'grad_norm': 0.5488422513008118, 'learning_rate': 9.872268500807936e-06, 'epoch': 0.49}

 16%|█▋        | 1822/11049 [18:45<1:34:21,  1.63it/s]
 16%|█▋        | 1823/11049 [18:46<1:34:19,  1.63it/s]
                                                      
{'loss': 0.3929, 'grad_norm': 0.6755332350730896, 'learning_rate': 9.871913488189757e-06, 'epoch': 0.49}

 16%|█▋        | 1823/11049 [18:46<1:34:19,  1.63it/s]
 17%|█▋        | 1824/11049 [18:47<1:34:19,  1.63it/s]
                                                      
{'loss': 0.2736, 'grad_norm': 0.5608673691749573, 'learning_rate': 9.871557989302024e-06, 'epoch': 0.5}

 17%|█▋        | 1824/11049 [18:47<1:34:19,  1.63it/s]
 17%|█▋        | 1825/11049 [18:47<1:34:26,  1.63it/s]
                                                      
{'loss': 0.3707, 'grad_norm': 0.7464777827262878, 'learning_rate': 9.871202004180221e-06, 'epoch': 0.5}

 17%|█▋        | 1825/11049 [18:47<1:34:26,  1.63it/s]
 17%|█▋        | 1826/11049 [18:48<1:34:23,  1.63it/s]
                                                      
{'loss': 0.3729, 'grad_norm': 0.6945750713348389, 'learning_rate': 9.870845532859876e-06, 'epoch': 0.5}

 17%|█▋        | 1826/11049 [18:48<1:34:23,  1.63it/s]
 17%|█▋        | 1827/11049 [18:48<1:34:17,  1.63it/s]
                                                      
{'loss': 0.2446, 'grad_norm': 0.5430474281311035, 'learning_rate': 9.870488575376573e-06, 'epoch': 0.5}

 17%|█▋        | 1827/11049 [18:48<1:34:17,  1.63it/s]
 17%|█▋        | 1828/11049 [18:49<1:34:18,  1.63it/s]
                                                      
{'loss': 0.3053, 'grad_norm': 0.5821265578269958, 'learning_rate': 9.870131131765936e-06, 'epoch': 0.5}

 17%|█▋        | 1828/11049 [18:49<1:34:18,  1.63it/s]
 17%|█▋        | 1829/11049 [18:50<1:34:17,  1.63it/s]
                                                      
{'loss': 0.3732, 'grad_norm': 0.6078847050666809, 'learning_rate': 9.869773202063646e-06, 'epoch': 0.5}

 17%|█▋        | 1829/11049 [18:50<1:34:17,  1.63it/s]
 17%|█▋        | 1830/11049 [18:50<1:34:29,  1.63it/s]
                                                      
{'loss': 0.3186, 'grad_norm': 0.4575708210468292, 'learning_rate': 9.869414786305424e-06, 'epoch': 0.5}

 17%|█▋        | 1830/11049 [18:50<1:34:29,  1.63it/s]
 17%|█▋        | 1831/11049 [18:51<1:34:25,  1.63it/s]
                                                      
{'loss': 0.2721, 'grad_norm': 0.6101832985877991, 'learning_rate': 9.869055884527047e-06, 'epoch': 0.5}

 17%|█▋        | 1831/11049 [18:51<1:34:25,  1.63it/s]
 17%|█▋        | 1832/11049 [18:51<1:34:22,  1.63it/s]
                                                      
{'loss': 0.3297, 'grad_norm': 0.6286510825157166, 'learning_rate': 9.868696496764335e-06, 'epoch': 0.5}

 17%|█▋        | 1832/11049 [18:52<1:34:22,  1.63it/s]
 17%|█▋        | 1833/11049 [18:52<1:34:19,  1.63it/s]
                                                      
{'loss': 0.3155, 'grad_norm': 0.6199005842208862, 'learning_rate': 9.86833662305316e-06, 'epoch': 0.5}

 17%|█▋        | 1833/11049 [18:52<1:34:19,  1.63it/s]
 17%|█▋        | 1834/11049 [18:53<1:34:15,  1.63it/s]
                                                      
{'loss': 0.2945, 'grad_norm': 0.613973081111908, 'learning_rate': 9.867976263429443e-06, 'epoch': 0.5}

 17%|█▋        | 1834/11049 [18:53<1:34:15,  1.63it/s]
 17%|█▋        | 1835/11049 [18:53<1:34:23,  1.63it/s]
                                                      
{'loss': 0.2168, 'grad_norm': 0.535634458065033, 'learning_rate': 9.867615417929149e-06, 'epoch': 0.5}

 17%|█▋        | 1835/11049 [18:53<1:34:23,  1.63it/s]
 17%|█▋        | 1836/11049 [18:54<1:34:24,  1.63it/s]
                                                      
{'loss': 0.2963, 'grad_norm': 0.5364401936531067, 'learning_rate': 9.867254086588294e-06, 'epoch': 0.5}

 17%|█▋        | 1836/11049 [18:54<1:34:24,  1.63it/s]
 17%|█▋        | 1837/11049 [18:55<1:34:21,  1.63it/s]
                                                      
{'loss': 0.3518, 'grad_norm': 0.7420567870140076, 'learning_rate': 9.866892269442944e-06, 'epoch': 0.5}

 17%|█▋        | 1837/11049 [18:55<1:34:21,  1.63it/s]
 17%|█▋        | 1838/11049 [18:55<1:34:17,  1.63it/s]
                                                      
{'loss': 0.2843, 'grad_norm': 0.5790735483169556, 'learning_rate': 9.866529966529213e-06, 'epoch': 0.5}

 17%|█▋        | 1838/11049 [18:55<1:34:17,  1.63it/s]
 17%|█▋        | 1839/11049 [18:56<1:34:12,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.6270296573638916, 'learning_rate': 9.866167177883262e-06, 'epoch': 0.5}

 17%|█▋        | 1839/11049 [18:56<1:34:12,  1.63it/s]
 17%|█▋        | 1840/11049 [18:56<1:34:20,  1.63it/s]
                                                      
{'loss': 0.3486, 'grad_norm': 0.8088468313217163, 'learning_rate': 9.865803903541301e-06, 'epoch': 0.5}

 17%|█▋        | 1840/11049 [18:56<1:34:20,  1.63it/s]
 17%|█▋        | 1841/11049 [18:57<1:34:15,  1.63it/s]
                                                      
{'loss': 0.2433, 'grad_norm': 0.5470184683799744, 'learning_rate': 9.865440143539589e-06, 'epoch': 0.5}

 17%|█▋        | 1841/11049 [18:57<1:34:15,  1.63it/s]
 17%|█▋        | 1842/11049 [18:58<1:34:14,  1.63it/s]
                                                      
{'loss': 0.2784, 'grad_norm': 0.5532235503196716, 'learning_rate': 9.865075897914433e-06, 'epoch': 0.5}

 17%|█▋        | 1842/11049 [18:58<1:34:14,  1.63it/s]
 17%|█▋        | 1843/11049 [18:58<1:34:12,  1.63it/s]
                                                      
{'loss': 0.2935, 'grad_norm': 0.5322139859199524, 'learning_rate': 9.864711166702188e-06, 'epoch': 0.5}

 17%|█▋        | 1843/11049 [18:58<1:34:12,  1.63it/s]
 17%|█▋        | 1844/11049 [18:59<1:34:11,  1.63it/s]
                                                      
{'loss': 0.2675, 'grad_norm': 0.5826280117034912, 'learning_rate': 9.86434594993926e-06, 'epoch': 0.5}

 17%|█▋        | 1844/11049 [18:59<1:34:11,  1.63it/s]
 17%|█▋        | 1845/11049 [18:59<1:34:18,  1.63it/s]
                                                      
{'loss': 0.2693, 'grad_norm': 0.6277438998222351, 'learning_rate': 9.8639802476621e-06, 'epoch': 0.5}

 17%|█▋        | 1845/11049 [19:00<1:34:18,  1.63it/s]
 17%|█▋        | 1846/11049 [19:00<1:34:14,  1.63it/s]
                                                      
{'loss': 0.2836, 'grad_norm': 0.6189611554145813, 'learning_rate': 9.863614059907208e-06, 'epoch': 0.5}

 17%|█▋        | 1846/11049 [19:00<1:34:14,  1.63it/s]
 17%|█▋        | 1847/11049 [19:01<1:34:11,  1.63it/s]
                                                      
{'loss': 0.2625, 'grad_norm': 0.6603581309318542, 'learning_rate': 9.863247386711136e-06, 'epoch': 0.5}

 17%|█▋        | 1847/11049 [19:01<1:34:11,  1.63it/s]
 17%|█▋        | 1848/11049 [19:01<1:34:06,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.6674858927726746, 'learning_rate': 9.862880228110481e-06, 'epoch': 0.5}

 17%|█▋        | 1848/11049 [19:01<1:34:06,  1.63it/s]
 17%|█▋        | 1849/11049 [19:02<1:34:06,  1.63it/s]
                                                      
{'loss': 0.3337, 'grad_norm': 0.6576988697052002, 'learning_rate': 9.86251258414189e-06, 'epoch': 0.5}

 17%|█▋        | 1849/11049 [19:02<1:34:06,  1.63it/s]
 17%|█▋        | 1850/11049 [19:02<1:34:10,  1.63it/s]
                                                      
{'loss': 0.2498, 'grad_norm': 0.6416062712669373, 'learning_rate': 9.862144454842055e-06, 'epoch': 0.5}

 17%|█▋        | 1850/11049 [19:03<1:34:10,  1.63it/s]
 17%|█▋        | 1851/11049 [19:03<1:34:06,  1.63it/s]
                                                      
{'loss': 0.2986, 'grad_norm': 0.6063180565834045, 'learning_rate': 9.861775840247723e-06, 'epoch': 0.5}

 17%|█▋        | 1851/11049 [19:03<1:34:06,  1.63it/s]
 17%|█▋        | 1852/11049 [19:04<1:34:04,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.5658546090126038, 'learning_rate': 9.861406740395682e-06, 'epoch': 0.5}

 17%|█▋        | 1852/11049 [19:04<1:34:04,  1.63it/s]
 17%|█▋        | 1853/11049 [19:04<1:34:03,  1.63it/s]
                                                      
{'loss': 0.3347, 'grad_norm': 0.6305974125862122, 'learning_rate': 9.861037155322777e-06, 'epoch': 0.5}

 17%|█▋        | 1853/11049 [19:04<1:34:03,  1.63it/s]
 17%|█▋        | 1854/11049 [19:05<1:34:02,  1.63it/s]
                                                      
{'loss': 0.268, 'grad_norm': 0.5803066492080688, 'learning_rate': 9.860667085065893e-06, 'epoch': 0.5}

 17%|█▋        | 1854/11049 [19:05<1:34:02,  1.63it/s]
 17%|█▋        | 1855/11049 [19:06<1:34:11,  1.63it/s]
                                                      
{'loss': 0.2504, 'grad_norm': 0.5858590602874756, 'learning_rate': 9.860296529661965e-06, 'epoch': 0.5}

 17%|█▋        | 1855/11049 [19:06<1:34:11,  1.63it/s]
 17%|█▋        | 1856/11049 [19:06<1:34:06,  1.63it/s]
                                                      
{'loss': 0.2984, 'grad_norm': 0.5690171122550964, 'learning_rate': 9.859925489147985e-06, 'epoch': 0.5}

 17%|█▋        | 1856/11049 [19:06<1:34:06,  1.63it/s]
 17%|█▋        | 1857/11049 [19:07<1:34:03,  1.63it/s]
                                                      
{'loss': 0.3001, 'grad_norm': 0.6334707736968994, 'learning_rate': 9.859553963560982e-06, 'epoch': 0.5}

 17%|█▋        | 1857/11049 [19:07<1:34:03,  1.63it/s]
 17%|█▋        | 1858/11049 [19:07<1:34:00,  1.63it/s]
                                                      
{'loss': 0.2924, 'grad_norm': 0.6150559782981873, 'learning_rate': 9.85918195293804e-06, 'epoch': 0.5}

 17%|█▋        | 1858/11049 [19:08<1:34:00,  1.63it/s]
 17%|█▋        | 1859/11049 [19:08<1:33:59,  1.63it/s]
                                                      
{'loss': 0.2646, 'grad_norm': 0.5777867436408997, 'learning_rate': 9.858809457316286e-06, 'epoch': 0.5}

 17%|█▋        | 1859/11049 [19:08<1:33:59,  1.63it/s]
 17%|█▋        | 1860/11049 [19:09<1:34:03,  1.63it/s]
                                                      
{'loss': 0.2869, 'grad_norm': 0.6594895124435425, 'learning_rate': 9.858436476732905e-06, 'epoch': 0.51}

 17%|█▋        | 1860/11049 [19:09<1:34:03,  1.63it/s]
 17%|█▋        | 1861/11049 [19:09<1:34:03,  1.63it/s]
                                                      
{'loss': 0.3029, 'grad_norm': 0.6054074168205261, 'learning_rate': 9.85806301122512e-06, 'epoch': 0.51}

 17%|█▋        | 1861/11049 [19:09<1:34:03,  1.63it/s]
 17%|█▋        | 1862/11049 [19:10<1:34:00,  1.63it/s]
                                                      
{'loss': 0.3319, 'grad_norm': 0.7271921038627625, 'learning_rate': 9.857689060830209e-06, 'epoch': 0.51}

 17%|█▋        | 1862/11049 [19:10<1:34:00,  1.63it/s]
 17%|█▋        | 1863/11049 [19:10<1:33:56,  1.63it/s]
                                                      
{'loss': 0.289, 'grad_norm': 0.5760378241539001, 'learning_rate': 9.857314625585495e-06, 'epoch': 0.51}

 17%|█▋        | 1863/11049 [19:11<1:33:56,  1.63it/s]
 17%|█▋        | 1864/11049 [19:11<1:33:56,  1.63it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.5787853598594666, 'learning_rate': 9.856939705528352e-06, 'epoch': 0.51}

 17%|█▋        | 1864/11049 [19:11<1:33:56,  1.63it/s]
 17%|█▋        | 1865/11049 [19:12<1:34:00,  1.63it/s]
                                                      
{'loss': 0.3121, 'grad_norm': 1.4535372257232666, 'learning_rate': 9.856564300696201e-06, 'epoch': 0.51}

 17%|█▋        | 1865/11049 [19:12<1:34:00,  1.63it/s]
 17%|█▋        | 1866/11049 [19:12<1:33:55,  1.63it/s]
                                                      
{'loss': 0.2501, 'grad_norm': 0.6339378952980042, 'learning_rate': 9.85618841112651e-06, 'epoch': 0.51}

 17%|█▋        | 1866/11049 [19:12<1:33:55,  1.63it/s]
 17%|█▋        | 1867/11049 [19:13<1:33:54,  1.63it/s]
                                                      
{'loss': 0.3266, 'grad_norm': 0.6013109683990479, 'learning_rate': 9.8558120368568e-06, 'epoch': 0.51}

 17%|█▋        | 1867/11049 [19:13<1:33:54,  1.63it/s]
 17%|█▋        | 1868/11049 [19:14<1:33:52,  1.63it/s]
                                                      
{'loss': 0.3503, 'grad_norm': 0.7891278862953186, 'learning_rate': 9.855435177924632e-06, 'epoch': 0.51}

 17%|█▋        | 1868/11049 [19:14<1:33:52,  1.63it/s]
 17%|█▋        | 1869/11049 [19:14<1:33:51,  1.63it/s]
                                                      
{'loss': 0.3031, 'grad_norm': 0.6874694228172302, 'learning_rate': 9.855057834367627e-06, 'epoch': 0.51}

 17%|█▋        | 1869/11049 [19:14<1:33:51,  1.63it/s]
 17%|█▋        | 1870/11049 [19:15<1:33:58,  1.63it/s]
                                                      
{'loss': 0.3237, 'grad_norm': 0.6415019035339355, 'learning_rate': 9.854680006223442e-06, 'epoch': 0.51}

 17%|█▋        | 1870/11049 [19:15<1:33:58,  1.63it/s]
 17%|█▋        | 1871/11049 [19:15<1:33:53,  1.63it/s]
                                                      
{'loss': 0.2776, 'grad_norm': 0.6094448566436768, 'learning_rate': 9.85430169352979e-06, 'epoch': 0.51}

 17%|█▋        | 1871/11049 [19:16<1:33:53,  1.63it/s]
 17%|█▋        | 1872/11049 [19:16<1:33:52,  1.63it/s]
                                                      
{'loss': 0.2806, 'grad_norm': 0.6655049324035645, 'learning_rate': 9.853922896324435e-06, 'epoch': 0.51}

 17%|█▋        | 1872/11049 [19:16<1:33:52,  1.63it/s]
 17%|█▋        | 1873/11049 [19:17<1:33:55,  1.63it/s]
                                                      
{'loss': 0.3348, 'grad_norm': 0.6679713726043701, 'learning_rate': 9.85354361464518e-06, 'epoch': 0.51}

 17%|█▋        | 1873/11049 [19:17<1:33:55,  1.63it/s]
 17%|█▋        | 1874/11049 [19:17<1:33:54,  1.63it/s]
                                                      
{'loss': 0.2694, 'grad_norm': 0.58347487449646, 'learning_rate': 9.853163848529881e-06, 'epoch': 0.51}

 17%|█▋        | 1874/11049 [19:17<1:33:54,  1.63it/s]
 17%|█▋        | 1875/11049 [19:18<1:34:26,  1.62it/s]
                                                      
{'loss': 0.2672, 'grad_norm': 0.6623311042785645, 'learning_rate': 9.852783598016447e-06, 'epoch': 0.51}

 17%|█▋        | 1875/11049 [19:18<1:34:26,  1.62it/s]
 17%|█▋        | 1876/11049 [19:18<1:34:14,  1.62it/s]
                                                      
{'loss': 0.351, 'grad_norm': 0.5966688990592957, 'learning_rate': 9.852402863142829e-06, 'epoch': 0.51}

 17%|█▋        | 1876/11049 [19:19<1:34:14,  1.62it/s]
 17%|█▋        | 1877/11049 [19:19<1:34:06,  1.62it/s]
                                                      
{'loss': 0.3361, 'grad_norm': 0.6528568267822266, 'learning_rate': 9.852021643947027e-06, 'epoch': 0.51}

 17%|█▋        | 1877/11049 [19:19<1:34:06,  1.62it/s]
 17%|█▋        | 1878/11049 [19:20<1:34:13,  1.62it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.5643275380134583, 'learning_rate': 9.851639940467092e-06, 'epoch': 0.51}

 17%|█▋        | 1878/11049 [19:20<1:34:13,  1.62it/s]
 17%|█▋        | 1879/11049 [19:20<1:34:03,  1.62it/s]
                                                      
{'loss': 0.331, 'grad_norm': 0.6384403705596924, 'learning_rate': 9.851257752741123e-06, 'epoch': 0.51}

 17%|█▋        | 1879/11049 [19:20<1:34:03,  1.62it/s]
 17%|█▋        | 1880/11049 [19:21<1:34:05,  1.62it/s]
                                                      
{'loss': 0.2492, 'grad_norm': 0.5400541424751282, 'learning_rate': 9.850875080807268e-06, 'epoch': 0.51}

 17%|█▋        | 1880/11049 [19:21<1:34:05,  1.62it/s]
 17%|█▋        | 1881/11049 [19:22<1:33:59,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.5592488050460815, 'learning_rate': 9.850491924703716e-06, 'epoch': 0.51}

 17%|█▋        | 1881/11049 [19:22<1:33:59,  1.63it/s]
 17%|█▋        | 1882/11049 [19:22<1:33:55,  1.63it/s]
                                                      
{'loss': 0.3171, 'grad_norm': 0.5907171964645386, 'learning_rate': 9.850108284468715e-06, 'epoch': 0.51}

 17%|█▋        | 1882/11049 [19:22<1:33:55,  1.63it/s]
 17%|█▋        | 1883/11049 [19:23<1:33:52,  1.63it/s]
                                                      
{'loss': 0.2637, 'grad_norm': 0.5946897864341736, 'learning_rate': 9.849724160140554e-06, 'epoch': 0.51}

 17%|█▋        | 1883/11049 [19:23<1:33:52,  1.63it/s]
 17%|█▋        | 1884/11049 [19:23<1:33:47,  1.63it/s]
                                                      
{'loss': 0.338, 'grad_norm': 0.5740223526954651, 'learning_rate': 9.849339551757576e-06, 'epoch': 0.51}

 17%|█▋        | 1884/11049 [19:24<1:33:47,  1.63it/s]
 17%|█▋        | 1885/11049 [19:24<1:33:49,  1.63it/s]
                                                      
{'loss': 0.2422, 'grad_norm': 0.46259304881095886, 'learning_rate': 9.848954459358167e-06, 'epoch': 0.51}

 17%|█▋        | 1885/11049 [19:24<1:33:49,  1.63it/s]
 17%|█▋        | 1886/11049 [19:25<1:33:53,  1.63it/s]
                                                      
{'loss': 0.2737, 'grad_norm': 0.5380753874778748, 'learning_rate': 9.84856888298076e-06, 'epoch': 0.51}

 17%|█▋        | 1886/11049 [19:25<1:33:53,  1.63it/s]
 17%|█▋        | 1887/11049 [19:25<1:33:47,  1.63it/s]
                                                      
{'loss': 0.3393, 'grad_norm': 0.6216899752616882, 'learning_rate': 9.848182822663846e-06, 'epoch': 0.51}

 17%|█▋        | 1887/11049 [19:25<1:33:47,  1.63it/s]
 17%|█▋        | 1888/11049 [19:26<1:33:44,  1.63it/s]
                                                      
{'loss': 0.2781, 'grad_norm': 0.5488622784614563, 'learning_rate': 9.847796278445954e-06, 'epoch': 0.51}

 17%|█▋        | 1888/11049 [19:26<1:33:44,  1.63it/s]
 17%|█▋        | 1889/11049 [19:26<1:33:39,  1.63it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.46639370918273926, 'learning_rate': 9.847409250365666e-06, 'epoch': 0.51}

 17%|█▋        | 1889/11049 [19:27<1:33:39,  1.63it/s]
 17%|█▋        | 1890/11049 [19:27<1:33:45,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.6628995537757874, 'learning_rate': 9.847021738461612e-06, 'epoch': 0.51}

 17%|█▋        | 1890/11049 [19:27<1:33:45,  1.63it/s]
 17%|█▋        | 1891/11049 [19:28<1:33:48,  1.63it/s]
                                                      
{'loss': 0.2652, 'grad_norm': 0.5421911478042603, 'learning_rate': 9.846633742772468e-06, 'epoch': 0.51}

 17%|█▋        | 1891/11049 [19:28<1:33:48,  1.63it/s]
 17%|█▋        | 1892/11049 [19:28<1:33:45,  1.63it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.6697341203689575, 'learning_rate': 9.846245263336964e-06, 'epoch': 0.51}

 17%|█▋        | 1892/11049 [19:28<1:33:45,  1.63it/s]
 17%|█▋        | 1893/11049 [19:29<1:33:41,  1.63it/s]
                                                      
{'loss': 0.2545, 'grad_norm': 0.5583879351615906, 'learning_rate': 9.845856300193872e-06, 'epoch': 0.51}

 17%|█▋        | 1893/11049 [19:29<1:33:41,  1.63it/s]
 17%|█▋        | 1894/11049 [19:30<1:33:43,  1.63it/s]
                                                      
{'loss': 0.2192, 'grad_norm': 0.5501134395599365, 'learning_rate': 9.845466853382016e-06, 'epoch': 0.51}

 17%|█▋        | 1894/11049 [19:30<1:33:43,  1.63it/s]
 17%|█▋        | 1895/11049 [19:30<1:33:47,  1.63it/s]
                                                      
{'loss': 0.2971, 'grad_norm': 0.6754655838012695, 'learning_rate': 9.845076922940265e-06, 'epoch': 0.51}

 17%|█▋        | 1895/11049 [19:30<1:33:47,  1.63it/s]
 17%|█▋        | 1896/11049 [19:31<1:33:43,  1.63it/s]
                                                      
{'loss': 0.2733, 'grad_norm': 0.5876926183700562, 'learning_rate': 9.844686508907538e-06, 'epoch': 0.51}

 17%|█▋        | 1896/11049 [19:31<1:33:43,  1.63it/s]
 17%|█▋        | 1897/11049 [19:31<1:33:39,  1.63it/s]
                                                      
{'loss': 0.3702, 'grad_norm': 0.727791965007782, 'learning_rate': 9.844295611322804e-06, 'epoch': 0.52}

 17%|█▋        | 1897/11049 [19:31<1:33:39,  1.63it/s]
 17%|█▋        | 1898/11049 [19:32<1:33:35,  1.63it/s]
                                                      
{'loss': 0.3241, 'grad_norm': 0.6246572732925415, 'learning_rate': 9.843904230225078e-06, 'epoch': 0.52}

 17%|█▋        | 1898/11049 [19:32<1:33:35,  1.63it/s]
 17%|█▋        | 1899/11049 [19:33<1:33:33,  1.63it/s]
                                                      
{'loss': 0.2631, 'grad_norm': 0.5782224535942078, 'learning_rate': 9.843512365653426e-06, 'epoch': 0.52}

 17%|█▋        | 1899/11049 [19:33<1:33:33,  1.63it/s]
 17%|█▋        | 1900/11049 [19:33<1:33:39,  1.63it/s]
                                                      
{'loss': 0.3037, 'grad_norm': 0.7139402627944946, 'learning_rate': 9.84312001764696e-06, 'epoch': 0.52}

 17%|█▋        | 1900/11049 [19:33<1:33:39,  1.63it/s]
 17%|█▋        | 1901/11049 [19:34<1:33:37,  1.63it/s]
                                                      
{'loss': 0.3751, 'grad_norm': 0.7482017278671265, 'learning_rate': 9.842727186244837e-06, 'epoch': 0.52}

 17%|█▋        | 1901/11049 [19:34<1:33:37,  1.63it/s]
 17%|█▋        | 1902/11049 [19:34<1:33:33,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.4814164638519287, 'learning_rate': 9.842333871486271e-06, 'epoch': 0.52}

 17%|█▋        | 1902/11049 [19:35<1:33:33,  1.63it/s]
 17%|█▋        | 1903/11049 [19:35<1:33:33,  1.63it/s]
                                                      
{'loss': 0.2039, 'grad_norm': 0.5161843299865723, 'learning_rate': 9.841940073410515e-06, 'epoch': 0.52}

 17%|█▋        | 1903/11049 [19:35<1:33:33,  1.63it/s]
 17%|█▋        | 1904/11049 [19:36<1:33:32,  1.63it/s]
                                                      
{'loss': 0.2635, 'grad_norm': 0.5206716656684875, 'learning_rate': 9.841545792056877e-06, 'epoch': 0.52}

 17%|█▋        | 1904/11049 [19:36<1:33:32,  1.63it/s]
 17%|█▋        | 1905/11049 [19:36<1:33:33,  1.63it/s]
                                                      
{'loss': 0.303, 'grad_norm': 0.7394367456436157, 'learning_rate': 9.841151027464707e-06, 'epoch': 0.52}

 17%|█▋        | 1905/11049 [19:36<1:33:33,  1.63it/s]
 17%|█▋        | 1906/11049 [19:37<1:33:31,  1.63it/s]
                                                      
{'loss': 0.2145, 'grad_norm': 0.48768943548202515, 'learning_rate': 9.84075577967341e-06, 'epoch': 0.52}

 17%|█▋        | 1906/11049 [19:37<1:33:31,  1.63it/s]
 17%|█▋        | 1907/11049 [19:37<1:33:31,  1.63it/s]
                                                      
{'loss': 0.2864, 'grad_norm': 0.6507745385169983, 'learning_rate': 9.840360048722435e-06, 'epoch': 0.52}

 17%|█▋        | 1907/11049 [19:38<1:33:31,  1.63it/s]
 17%|█▋        | 1908/11049 [19:38<1:33:29,  1.63it/s]
                                                      
{'loss': 0.3459, 'grad_norm': 0.6080302000045776, 'learning_rate': 9.83996383465128e-06, 'epoch': 0.52}

 17%|█▋        | 1908/11049 [19:38<1:33:29,  1.63it/s]
 17%|█▋        | 1909/11049 [19:39<1:33:26,  1.63it/s]
                                                      
{'loss': 0.3029, 'grad_norm': 0.6382430195808411, 'learning_rate': 9.839567137499493e-06, 'epoch': 0.52}

 17%|█▋        | 1909/11049 [19:39<1:33:26,  1.63it/s]
 17%|█▋        | 1910/11049 [19:39<1:33:33,  1.63it/s]
                                                      
{'loss': 0.3041, 'grad_norm': 0.5673572421073914, 'learning_rate': 9.839169957306665e-06, 'epoch': 0.52}

 17%|█▋        | 1910/11049 [19:39<1:33:33,  1.63it/s]
 17%|█▋        | 1911/11049 [19:40<1:33:29,  1.63it/s]
                                                      
{'loss': 0.2215, 'grad_norm': 0.5589994192123413, 'learning_rate': 9.838772294112441e-06, 'epoch': 0.52}

 17%|█▋        | 1911/11049 [19:40<1:33:29,  1.63it/s]
 17%|█▋        | 1912/11049 [19:41<1:33:25,  1.63it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.5795102715492249, 'learning_rate': 9.838374147956515e-06, 'epoch': 0.52}

 17%|█▋        | 1912/11049 [19:41<1:33:25,  1.63it/s]
 17%|█▋        | 1913/11049 [19:41<1:33:25,  1.63it/s]
                                                      
{'loss': 0.309, 'grad_norm': 0.628783643245697, 'learning_rate': 9.837975518878622e-06, 'epoch': 0.52}

 17%|█▋        | 1913/11049 [19:41<1:33:25,  1.63it/s]
 17%|█▋        | 1914/11049 [19:42<1:33:21,  1.63it/s]
                                                      
{'loss': 0.2609, 'grad_norm': 0.5953584313392639, 'learning_rate': 9.837576406918553e-06, 'epoch': 0.52}

 17%|█▋        | 1914/11049 [19:42<1:33:21,  1.63it/s]
 17%|█▋        | 1915/11049 [19:42<1:33:52,  1.62it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.48557108640670776, 'learning_rate': 9.837176812116139e-06, 'epoch': 0.52}

 17%|█▋        | 1915/11049 [19:43<1:33:52,  1.62it/s]
 17%|█▋        | 1916/11049 [19:43<1:33:43,  1.62it/s]
                                                      
{'loss': 0.3003, 'grad_norm': 0.6091299057006836, 'learning_rate': 9.836776734511266e-06, 'epoch': 0.52}

 17%|█▋        | 1916/11049 [19:43<1:33:43,  1.62it/s]
 17%|█▋        | 1917/11049 [19:44<1:33:37,  1.63it/s]
                                                      
{'loss': 0.2452, 'grad_norm': 0.5039551854133606, 'learning_rate': 9.836376174143869e-06, 'epoch': 0.52}

 17%|█▋        | 1917/11049 [19:44<1:33:37,  1.63it/s]
 17%|█▋        | 1918/11049 [19:44<1:33:33,  1.63it/s]
                                                      
{'loss': 0.3037, 'grad_norm': 0.6543471813201904, 'learning_rate': 9.835975131053926e-06, 'epoch': 0.52}

 17%|█▋        | 1918/11049 [19:44<1:33:33,  1.63it/s]
 17%|█▋        | 1919/11049 [19:45<1:33:28,  1.63it/s]
                                                      
{'loss': 0.2426, 'grad_norm': 0.5615232586860657, 'learning_rate': 9.835573605281462e-06, 'epoch': 0.52}

 17%|█▋        | 1919/11049 [19:45<1:33:28,  1.63it/s]
 17%|█▋        | 1920/11049 [19:45<1:33:57,  1.62it/s]
                                                      
{'loss': 0.3972, 'grad_norm': 0.6600677371025085, 'learning_rate': 9.835171596866561e-06, 'epoch': 0.52}

 17%|█▋        | 1920/11049 [19:46<1:33:57,  1.62it/s]
 17%|█▋        | 1921/11049 [19:46<1:33:45,  1.62it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.5653067827224731, 'learning_rate': 9.834769105849341e-06, 'epoch': 0.52}

 17%|█▋        | 1921/11049 [19:46<1:33:45,  1.62it/s]
 17%|█▋        | 1922/11049 [19:47<1:33:37,  1.62it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.518976092338562, 'learning_rate': 9.834366132269979e-06, 'epoch': 0.52}

 17%|█▋        | 1922/11049 [19:47<1:33:37,  1.62it/s]
 17%|█▋        | 1923/11049 [19:47<1:33:29,  1.63it/s]
                                                      
{'loss': 0.3707, 'grad_norm': 0.7137563824653625, 'learning_rate': 9.833962676168696e-06, 'epoch': 0.52}

 17%|█▋        | 1923/11049 [19:47<1:33:29,  1.63it/s]
 17%|█▋        | 1924/11049 [19:48<1:33:24,  1.63it/s]
                                                      
{'loss': 0.3284, 'grad_norm': 0.6009570956230164, 'learning_rate': 9.833558737585757e-06, 'epoch': 0.52}

 17%|█▋        | 1924/11049 [19:48<1:33:24,  1.63it/s]
 17%|█▋        | 1925/11049 [19:49<1:33:30,  1.63it/s]
                                                      
{'loss': 0.2933, 'grad_norm': 0.5487805008888245, 'learning_rate': 9.833154316561485e-06, 'epoch': 0.52}

 17%|█▋        | 1925/11049 [19:49<1:33:30,  1.63it/s]
 17%|█▋        | 1926/11049 [19:49<1:33:25,  1.63it/s]
                                                      
{'loss': 0.3008, 'grad_norm': 0.6950262188911438, 'learning_rate': 9.832749413136241e-06, 'epoch': 0.52}

 17%|█▋        | 1926/11049 [19:49<1:33:25,  1.63it/s]
 17%|█▋        | 1927/11049 [19:50<1:33:21,  1.63it/s]
                                                      
{'loss': 0.2569, 'grad_norm': 0.5616127252578735, 'learning_rate': 9.832344027350443e-06, 'epoch': 0.52}

 17%|█▋        | 1927/11049 [19:50<1:33:21,  1.63it/s]
 17%|█▋        | 1928/11049 [19:50<1:33:21,  1.63it/s]
                                                      
{'loss': 0.2583, 'grad_norm': 0.5588047504425049, 'learning_rate': 9.831938159244548e-06, 'epoch': 0.52}

 17%|█▋        | 1928/11049 [19:51<1:33:21,  1.63it/s]
 17%|█▋        | 1929/11049 [19:51<1:33:18,  1.63it/s]
                                                      
{'loss': 0.2612, 'grad_norm': 0.5808104276657104, 'learning_rate': 9.83153180885907e-06, 'epoch': 0.52}

 17%|█▋        | 1929/11049 [19:51<1:33:18,  1.63it/s]
 17%|█▋        | 1930/11049 [19:52<1:33:23,  1.63it/s]
                                                      
{'loss': 0.2984, 'grad_norm': 0.5043513774871826, 'learning_rate': 9.831124976234568e-06, 'epoch': 0.52}

 17%|█▋        | 1930/11049 [19:52<1:33:23,  1.63it/s]
 17%|█▋        | 1931/11049 [19:52<1:33:20,  1.63it/s]
                                                      
{'loss': 0.3296, 'grad_norm': 0.6714684963226318, 'learning_rate': 9.830717661411642e-06, 'epoch': 0.52}

 17%|█▋        | 1931/11049 [19:52<1:33:20,  1.63it/s]
 17%|█▋        | 1932/11049 [19:53<1:33:16,  1.63it/s]
                                                      
{'loss': 0.3672, 'grad_norm': 0.640203058719635, 'learning_rate': 9.830309864430954e-06, 'epoch': 0.52}

 17%|█▋        | 1932/11049 [19:53<1:33:16,  1.63it/s]
 17%|█▋        | 1933/11049 [19:53<1:33:16,  1.63it/s]
                                                      
{'loss': 0.2493, 'grad_norm': 0.5118752121925354, 'learning_rate': 9.8299015853332e-06, 'epoch': 0.52}

 17%|█▋        | 1933/11049 [19:54<1:33:16,  1.63it/s]
 18%|█▊        | 1934/11049 [19:54<1:33:16,  1.63it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.6233848929405212, 'learning_rate': 9.829492824159137e-06, 'epoch': 0.53}

 18%|█▊        | 1934/11049 [19:54<1:33:16,  1.63it/s]
 18%|█▊        | 1935/11049 [19:55<1:33:12,  1.63it/s]
                                                      
{'loss': 0.2663, 'grad_norm': 0.5540920495986938, 'learning_rate': 9.829083580949558e-06, 'epoch': 0.53}

 18%|█▊        | 1935/11049 [19:55<1:33:12,  1.63it/s]
 18%|█▊        | 1936/11049 [19:55<1:33:10,  1.63it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.6009103655815125, 'learning_rate': 9.828673855745314e-06, 'epoch': 0.53}

 18%|█▊        | 1936/11049 [19:55<1:33:10,  1.63it/s]
 18%|█▊        | 1937/11049 [19:56<1:33:09,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.5632637739181519, 'learning_rate': 9.828263648587298e-06, 'epoch': 0.53}

 18%|█▊        | 1937/11049 [19:56<1:33:09,  1.63it/s]
 18%|█▊        | 1938/11049 [19:57<1:33:09,  1.63it/s]
                                                      
{'loss': 0.273, 'grad_norm': 0.5431256294250488, 'learning_rate': 9.827852959516453e-06, 'epoch': 0.53}

 18%|█▊        | 1938/11049 [19:57<1:33:09,  1.63it/s]
 18%|█▊        | 1939/11049 [19:57<1:33:12,  1.63it/s]
                                                      
{'loss': 0.3963, 'grad_norm': 0.821491539478302, 'learning_rate': 9.827441788573771e-06, 'epoch': 0.53}

 18%|█▊        | 1939/11049 [19:57<1:33:12,  1.63it/s]
 18%|█▊        | 1940/11049 [19:58<1:33:13,  1.63it/s]
                                                      
{'loss': 0.3021, 'grad_norm': 0.6833903193473816, 'learning_rate': 9.827030135800291e-06, 'epoch': 0.53}

 18%|█▊        | 1940/11049 [19:58<1:33:13,  1.63it/s]
 18%|█▊        | 1941/11049 [19:58<1:33:08,  1.63it/s]
                                                      
{'loss': 0.3977, 'grad_norm': 0.6596235036849976, 'learning_rate': 9.826618001237101e-06, 'epoch': 0.53}

 18%|█▊        | 1941/11049 [19:59<1:33:08,  1.63it/s]
 18%|█▊        | 1942/11049 [19:59<1:33:06,  1.63it/s]
                                                      
{'loss': 0.3238, 'grad_norm': 0.719468891620636, 'learning_rate': 9.826205384925335e-06, 'epoch': 0.53}

 18%|█▊        | 1942/11049 [19:59<1:33:06,  1.63it/s]
 18%|█▊        | 1943/11049 [20:00<1:33:07,  1.63it/s]
                                                      
{'loss': 0.2951, 'grad_norm': 0.6130943894386292, 'learning_rate': 9.825792286906178e-06, 'epoch': 0.53}

 18%|█▊        | 1943/11049 [20:00<1:33:07,  1.63it/s]
 18%|█▊        | 1944/11049 [20:00<1:33:03,  1.63it/s]
                                                      
{'loss': 0.3393, 'grad_norm': 0.6797961592674255, 'learning_rate': 9.825378707220861e-06, 'epoch': 0.53}

 18%|█▊        | 1944/11049 [20:00<1:33:03,  1.63it/s]
 18%|█▊        | 1945/11049 [20:01<1:33:04,  1.63it/s]
                                                      
{'loss': 0.3218, 'grad_norm': 0.6157007813453674, 'learning_rate': 9.824964645910664e-06, 'epoch': 0.53}

 18%|█▊        | 1945/11049 [20:01<1:33:04,  1.63it/s]
 18%|█▊        | 1946/11049 [20:01<1:33:06,  1.63it/s]
                                                      
{'loss': 0.3711, 'grad_norm': 0.5766708254814148, 'learning_rate': 9.824550103016915e-06, 'epoch': 0.53}

 18%|█▊        | 1946/11049 [20:02<1:33:06,  1.63it/s]
 18%|█▊        | 1947/11049 [20:02<1:33:02,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.5485416054725647, 'learning_rate': 9.824135078580987e-06, 'epoch': 0.53}

 18%|█▊        | 1947/11049 [20:02<1:33:02,  1.63it/s]
 18%|█▊        | 1948/11049 [20:03<1:33:01,  1.63it/s]
                                                      
{'loss': 0.2873, 'grad_norm': 0.6254124641418457, 'learning_rate': 9.823719572644309e-06, 'epoch': 0.53}

 18%|█▊        | 1948/11049 [20:03<1:33:01,  1.63it/s]
 18%|█▊        | 1949/11049 [20:03<1:33:01,  1.63it/s]
                                                      
{'loss': 0.3325, 'grad_norm': 0.5667294859886169, 'learning_rate': 9.82330358524835e-06, 'epoch': 0.53}

 18%|█▊        | 1949/11049 [20:03<1:33:01,  1.63it/s]
 18%|█▊        | 1950/11049 [20:04<1:33:00,  1.63it/s]
                                                      
{'loss': 0.3291, 'grad_norm': 0.6251633763313293, 'learning_rate': 9.82288711643463e-06, 'epoch': 0.53}

 18%|█▊        | 1950/11049 [20:04<1:33:00,  1.63it/s]
 18%|█▊        | 1951/11049 [20:05<1:33:00,  1.63it/s]
                                                      
{'loss': 0.2771, 'grad_norm': 0.5819041132926941, 'learning_rate': 9.822470166244718e-06, 'epoch': 0.53}

 18%|█▊        | 1951/11049 [20:05<1:33:00,  1.63it/s]
 18%|█▊        | 1952/11049 [20:05<1:32:59,  1.63it/s]
                                                      
{'loss': 0.2979, 'grad_norm': 0.6874694228172302, 'learning_rate': 9.822052734720228e-06, 'epoch': 0.53}

 18%|█▊        | 1952/11049 [20:05<1:32:59,  1.63it/s]
 18%|█▊        | 1953/11049 [20:06<1:32:57,  1.63it/s]
                                                      
{'loss': 0.2752, 'grad_norm': 0.5466580390930176, 'learning_rate': 9.821634821902825e-06, 'epoch': 0.53}

 18%|█▊        | 1953/11049 [20:06<1:32:57,  1.63it/s]
 18%|█▊        | 1954/11049 [20:06<1:33:01,  1.63it/s]
                                                      
{'loss': 0.248, 'grad_norm': 0.5757065415382385, 'learning_rate': 9.821216427834225e-06, 'epoch': 0.53}

 18%|█▊        | 1954/11049 [20:06<1:33:01,  1.63it/s]
 18%|█▊        | 1955/11049 [20:07<1:32:59,  1.63it/s]
                                                      
{'loss': 0.2812, 'grad_norm': 0.5711185336112976, 'learning_rate': 9.820797552556184e-06, 'epoch': 0.53}

 18%|█▊        | 1955/11049 [20:07<1:32:59,  1.63it/s]
 18%|█▊        | 1956/11049 [20:08<1:32:59,  1.63it/s]
                                                      
{'loss': 0.2646, 'grad_norm': 0.556466817855835, 'learning_rate': 9.82037819611051e-06, 'epoch': 0.53}

 18%|█▊        | 1956/11049 [20:08<1:32:59,  1.63it/s]
 18%|█▊        | 1957/11049 [20:08<1:32:56,  1.63it/s]
                                                      
{'loss': 0.2558, 'grad_norm': 0.5968321561813354, 'learning_rate': 9.819958358539063e-06, 'epoch': 0.53}

 18%|█▊        | 1957/11049 [20:08<1:32:56,  1.63it/s]
 18%|█▊        | 1958/11049 [20:09<1:32:58,  1.63it/s]
                                                      
{'loss': 0.3353, 'grad_norm': 0.6609208583831787, 'learning_rate': 9.819538039883744e-06, 'epoch': 0.53}

 18%|█▊        | 1958/11049 [20:09<1:32:58,  1.63it/s]
 18%|█▊        | 1959/11049 [20:09<1:33:03,  1.63it/s]
                                                      
{'loss': 0.2976, 'grad_norm': 0.6218528151512146, 'learning_rate': 9.819117240186506e-06, 'epoch': 0.53}

 18%|█▊        | 1959/11049 [20:10<1:33:03,  1.63it/s]
 18%|█▊        | 1960/11049 [20:10<1:32:59,  1.63it/s]
                                                      
{'loss': 0.3301, 'grad_norm': 0.6776041984558105, 'learning_rate': 9.818695959489352e-06, 'epoch': 0.53}

 18%|█▊        | 1960/11049 [20:10<1:32:59,  1.63it/s]
 18%|█▊        | 1961/11049 [20:11<1:33:00,  1.63it/s]
                                                      
{'loss': 0.3168, 'grad_norm': 0.6897189617156982, 'learning_rate': 9.818274197834326e-06, 'epoch': 0.53}

 18%|█▊        | 1961/11049 [20:11<1:33:00,  1.63it/s]
 18%|█▊        | 1962/11049 [20:11<1:32:56,  1.63it/s]
                                                      
{'loss': 0.252, 'grad_norm': 0.5632015466690063, 'learning_rate': 9.817851955263526e-06, 'epoch': 0.53}

 18%|█▊        | 1962/11049 [20:11<1:32:56,  1.63it/s]
 18%|█▊        | 1963/11049 [20:12<1:32:55,  1.63it/s]
                                                      
{'loss': 0.2861, 'grad_norm': 0.5248368382453918, 'learning_rate': 9.8174292318191e-06, 'epoch': 0.53}

 18%|█▊        | 1963/11049 [20:12<1:32:55,  1.63it/s]
 18%|█▊        | 1964/11049 [20:12<1:32:54,  1.63it/s]
                                                      
{'loss': 0.2854, 'grad_norm': 0.6342616677284241, 'learning_rate': 9.817006027543234e-06, 'epoch': 0.53}

 18%|█▊        | 1964/11049 [20:13<1:32:54,  1.63it/s]
 18%|█▊        | 1965/11049 [20:13<1:32:52,  1.63it/s]
                                                      
{'loss': 0.3174, 'grad_norm': 0.6759522557258606, 'learning_rate': 9.816582342478173e-06, 'epoch': 0.53}

 18%|█▊        | 1965/11049 [20:13<1:32:52,  1.63it/s]
 18%|█▊        | 1966/11049 [20:14<1:32:52,  1.63it/s]
                                                      
{'loss': 0.2664, 'grad_norm': 0.5376136898994446, 'learning_rate': 9.816158176666203e-06, 'epoch': 0.53}

 18%|█▊        | 1966/11049 [20:14<1:32:52,  1.63it/s]
 18%|█▊        | 1967/11049 [20:14<1:32:49,  1.63it/s]
                                                      
{'loss': 0.2154, 'grad_norm': 0.5283404588699341, 'learning_rate': 9.815733530149663e-06, 'epoch': 0.53}

 18%|█▊        | 1967/11049 [20:14<1:32:49,  1.63it/s]
 18%|█▊        | 1968/11049 [20:15<1:32:49,  1.63it/s]
                                                      
{'loss': 0.4215, 'grad_norm': 0.572970449924469, 'learning_rate': 9.815308402970935e-06, 'epoch': 0.53}

 18%|█▊        | 1968/11049 [20:15<1:32:49,  1.63it/s]
 18%|█▊        | 1969/11049 [20:16<1:32:51,  1.63it/s]
                                                      
{'loss': 0.2691, 'grad_norm': 0.6075327396392822, 'learning_rate': 9.814882795172451e-06, 'epoch': 0.53}

 18%|█▊        | 1969/11049 [20:16<1:32:51,  1.63it/s]
 18%|█▊        | 1970/11049 [20:16<1:32:50,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.4470278322696686, 'learning_rate': 9.814456706796694e-06, 'epoch': 0.53}

 18%|█▊        | 1970/11049 [20:16<1:32:50,  1.63it/s]
 18%|█▊        | 1971/11049 [20:17<1:32:49,  1.63it/s]
                                                      
{'loss': 0.2966, 'grad_norm': 0.5452770590782166, 'learning_rate': 9.814030137886188e-06, 'epoch': 0.54}

 18%|█▊        | 1971/11049 [20:17<1:32:49,  1.63it/s]
 18%|█▊        | 1972/11049 [20:17<1:32:46,  1.63it/s]
                                                      
{'loss': 0.2436, 'grad_norm': 0.4958449900150299, 'learning_rate': 9.813603088483512e-06, 'epoch': 0.54}

 18%|█▊        | 1972/11049 [20:18<1:32:46,  1.63it/s]
 18%|█▊        | 1973/11049 [20:18<1:32:46,  1.63it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.6120733618736267, 'learning_rate': 9.813175558631291e-06, 'epoch': 0.54}

 18%|█▊        | 1973/11049 [20:18<1:32:46,  1.63it/s]
 18%|█▊        | 1974/11049 [20:19<1:32:45,  1.63it/s]
                                                      
{'loss': 0.2638, 'grad_norm': 0.6186068654060364, 'learning_rate': 9.812747548372195e-06, 'epoch': 0.54}

 18%|█▊        | 1974/11049 [20:19<1:32:45,  1.63it/s]
 18%|█▊        | 1975/11049 [20:19<1:32:42,  1.63it/s]
                                                      
{'loss': 0.2858, 'grad_norm': 0.5920650959014893, 'learning_rate': 9.812319057748944e-06, 'epoch': 0.54}

 18%|█▊        | 1975/11049 [20:19<1:32:42,  1.63it/s]
 18%|█▊        | 1976/11049 [20:20<1:32:43,  1.63it/s]
                                                      
{'loss': 0.3473, 'grad_norm': 0.5346663594245911, 'learning_rate': 9.811890086804308e-06, 'epoch': 0.54}

 18%|█▊        | 1976/11049 [20:20<1:32:43,  1.63it/s]
 18%|█▊        | 1977/11049 [20:20<1:32:43,  1.63it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.5942696928977966, 'learning_rate': 9.811460635581102e-06, 'epoch': 0.54}

 18%|█▊        | 1977/11049 [20:21<1:32:43,  1.63it/s]
 18%|█▊        | 1978/11049 [20:21<1:32:44,  1.63it/s]
                                                      
{'loss': 0.2355, 'grad_norm': 0.5965465903282166, 'learning_rate': 9.811030704122189e-06, 'epoch': 0.54}

 18%|█▊        | 1978/11049 [20:21<1:32:44,  1.63it/s]
 18%|█▊        | 1979/11049 [20:22<1:32:43,  1.63it/s]
                                                      
{'loss': 0.3321, 'grad_norm': 0.7001728415489197, 'learning_rate': 9.81060029247048e-06, 'epoch': 0.54}

 18%|█▊        | 1979/11049 [20:22<1:32:43,  1.63it/s]
 18%|█▊        | 1980/11049 [20:22<1:32:40,  1.63it/s]
                                                      
{'loss': 0.3268, 'grad_norm': 0.5754361748695374, 'learning_rate': 9.810169400668939e-06, 'epoch': 0.54}

 18%|█▊        | 1980/11049 [20:22<1:32:40,  1.63it/s]
 18%|█▊        | 1981/11049 [20:23<1:32:40,  1.63it/s]
                                                      
{'loss': 0.4024, 'grad_norm': 0.6716434359550476, 'learning_rate': 9.809738028760568e-06, 'epoch': 0.54}

 18%|█▊        | 1981/11049 [20:23<1:32:40,  1.63it/s]
 18%|█▊        | 1982/11049 [20:24<1:32:40,  1.63it/s]
                                                      
{'loss': 0.2885, 'grad_norm': 0.57757169008255, 'learning_rate': 9.809306176788427e-06, 'epoch': 0.54}

 18%|█▊        | 1982/11049 [20:24<1:32:40,  1.63it/s]
 18%|█▊        | 1983/11049 [20:24<1:32:39,  1.63it/s]
                                                      
{'loss': 0.2348, 'grad_norm': 0.5834488868713379, 'learning_rate': 9.808873844795616e-06, 'epoch': 0.54}

 18%|█▊        | 1983/11049 [20:24<1:32:39,  1.63it/s]
 18%|█▊        | 1984/11049 [20:25<1:32:39,  1.63it/s]
                                                      
{'loss': 0.3198, 'grad_norm': 0.5888093113899231, 'learning_rate': 9.80844103282529e-06, 'epoch': 0.54}

 18%|█▊        | 1984/11049 [20:25<1:32:39,  1.63it/s]
 18%|█▊        | 1985/11049 [20:25<1:32:38,  1.63it/s]
                                                      
{'loss': 0.3455, 'grad_norm': 0.7239556908607483, 'learning_rate': 9.808007740920647e-06, 'epoch': 0.54}

 18%|█▊        | 1985/11049 [20:26<1:32:38,  1.63it/s]
 18%|█▊        | 1986/11049 [20:26<1:32:40,  1.63it/s]
                                                      
{'loss': 0.3502, 'grad_norm': 0.6356297731399536, 'learning_rate': 9.807573969124932e-06, 'epoch': 0.54}

 18%|█▊        | 1986/11049 [20:26<1:32:40,  1.63it/s]
 18%|█▊        | 1987/11049 [20:27<1:32:37,  1.63it/s]
                                                      
{'loss': 0.3111, 'grad_norm': 0.606686532497406, 'learning_rate': 9.807139717481441e-06, 'epoch': 0.54}

 18%|█▊        | 1987/11049 [20:27<1:32:37,  1.63it/s]
 18%|█▊        | 1988/11049 [20:27<1:32:41,  1.63it/s]
                                                      
{'loss': 0.4057, 'grad_norm': 0.6225981712341309, 'learning_rate': 9.80670498603352e-06, 'epoch': 0.54}

 18%|█▊        | 1988/11049 [20:27<1:32:41,  1.63it/s]
 18%|█▊        | 1989/11049 [20:28<1:32:40,  1.63it/s]
                                                      
{'loss': 0.3381, 'grad_norm': 0.6384080052375793, 'learning_rate': 9.806269774824557e-06, 'epoch': 0.54}

 18%|█▊        | 1989/11049 [20:28<1:32:40,  1.63it/s]
 18%|█▊        | 1990/11049 [20:28<1:32:37,  1.63it/s]
                                                      
{'loss': 0.3428, 'grad_norm': 0.6251136660575867, 'learning_rate': 9.805834083897993e-06, 'epoch': 0.54}

 18%|█▊        | 1990/11049 [20:29<1:32:37,  1.63it/s]
 18%|█▊        | 1991/11049 [20:29<1:32:38,  1.63it/s]
                                                      
{'loss': 0.2765, 'grad_norm': 0.5690307021141052, 'learning_rate': 9.805397913297312e-06, 'epoch': 0.54}

 18%|█▊        | 1991/11049 [20:29<1:32:38,  1.63it/s]
 18%|█▊        | 1992/11049 [20:30<1:32:37,  1.63it/s]
                                                      
{'loss': 0.3243, 'grad_norm': 0.6478739976882935, 'learning_rate': 9.804961263066048e-06, 'epoch': 0.54}

 18%|█▊        | 1992/11049 [20:30<1:32:37,  1.63it/s]
 18%|█▊        | 1993/11049 [20:30<1:32:32,  1.63it/s]
                                                      
{'loss': 0.2721, 'grad_norm': 0.5597327351570129, 'learning_rate': 9.804524133247788e-06, 'epoch': 0.54}

 18%|█▊        | 1993/11049 [20:30<1:32:32,  1.63it/s]
 18%|█▊        | 1994/11049 [20:31<1:32:32,  1.63it/s]
                                                      
{'loss': 0.3149, 'grad_norm': 0.5661056041717529, 'learning_rate': 9.804086523886158e-06, 'epoch': 0.54}

 18%|█▊        | 1994/11049 [20:31<1:32:32,  1.63it/s]
 18%|█▊        | 1995/11049 [20:32<1:32:31,  1.63it/s]
                                                      
{'loss': 0.2972, 'grad_norm': 0.679030179977417, 'learning_rate': 9.803648435024838e-06, 'epoch': 0.54}

 18%|█▊        | 1995/11049 [20:32<1:32:31,  1.63it/s]
 18%|█▊        | 1996/11049 [20:32<1:32:32,  1.63it/s]
                                                      
{'loss': 0.2462, 'grad_norm': 0.5830324292182922, 'learning_rate': 9.803209866707553e-06, 'epoch': 0.54}

 18%|█▊        | 1996/11049 [20:32<1:32:32,  1.63it/s]
 18%|█▊        | 1997/11049 [20:33<1:32:32,  1.63it/s]
                                                      
{'loss': 0.3237, 'grad_norm': 0.6176900267601013, 'learning_rate': 9.802770818978078e-06, 'epoch': 0.54}

 18%|█▊        | 1997/11049 [20:33<1:32:32,  1.63it/s]
 18%|█▊        | 1998/11049 [20:33<1:32:32,  1.63it/s]
                                                      
{'loss': 0.2998, 'grad_norm': 0.5504977703094482, 'learning_rate': 9.802331291880233e-06, 'epoch': 0.54}

 18%|█▊        | 1998/11049 [20:33<1:32:32,  1.63it/s]
 18%|█▊        | 1999/11049 [20:34<1:32:30,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.5451292395591736, 'learning_rate': 9.80189128545789e-06, 'epoch': 0.54}

 18%|█▊        | 1999/11049 [20:34<1:32:30,  1.63it/s]
 18%|█▊        | 2000/11049 [20:35<1:32:31,  1.63it/s]
                                                      
{'loss': 0.2804, 'grad_norm': 0.6358550190925598, 'learning_rate': 9.801450799754964e-06, 'epoch': 0.54}

 18%|█▊        | 2000/11049 [20:35<1:32:31,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.34it/s]

 31%|███       | 4/13 [00:00<00:01,  8.38it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.78it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.41it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.00it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.89it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.82it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.77it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.73it/s]

100%|██████████| 13/13 [00:01<00:00,  6.74it/s]
                                                      

                                               
{'eval_loss': 0.7032429575920105, 'eval_runtime': 1.9567, 'eval_samples_per_second': 102.212, 'eval_steps_per_second': 6.644, 'epoch': 0.54}

 18%|█▊        | 2000/11049 [20:37<1:32:31,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.74it/s]

                                               
 18%|█▊        | 2001/11049 [20:37<3:01:20,  1.20s/it]
                                                      
{'loss': 0.2762, 'grad_norm': 0.6057843565940857, 'learning_rate': 9.80100983481542e-06, 'epoch': 0.54}

 18%|█▊        | 2001/11049 [20:37<3:01:20,  1.20s/it]
 18%|█▊        | 2002/11049 [20:38<2:34:38,  1.03s/it]
                                                      
{'loss': 0.2675, 'grad_norm': 0.5513032674789429, 'learning_rate': 9.800568390683274e-06, 'epoch': 0.54}

 18%|█▊        | 2002/11049 [20:38<2:34:38,  1.03s/it]
 18%|█▊        | 2003/11049 [20:38<2:15:58,  1.11it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.49997177720069885, 'learning_rate': 9.800126467402586e-06, 'epoch': 0.54}

 18%|█▊        | 2003/11049 [20:39<2:15:58,  1.11it/s]
 18%|█▊        | 2004/11049 [20:39<2:02:54,  1.23it/s]
                                                      
{'loss': 0.372, 'grad_norm': 0.5799804329872131, 'learning_rate': 9.799684065017463e-06, 'epoch': 0.54}

 18%|█▊        | 2004/11049 [20:39<2:02:54,  1.23it/s]
 18%|█▊        | 2005/11049 [20:40<1:53:52,  1.32it/s]
                                                      
{'loss': 0.2871, 'grad_norm': 0.5798008441925049, 'learning_rate': 9.799241183572062e-06, 'epoch': 0.54}

 18%|█▊        | 2005/11049 [20:40<1:53:52,  1.32it/s]
 18%|█▊        | 2006/11049 [20:40<1:47:26,  1.40it/s]
                                                      
{'loss': 0.3051, 'grad_norm': 0.6340157985687256, 'learning_rate': 9.798797823110589e-06, 'epoch': 0.54}

 18%|█▊        | 2006/11049 [20:40<1:47:26,  1.40it/s]
 18%|█▊        | 2007/11049 [20:41<1:43:00,  1.46it/s]
                                                      
{'loss': 0.3352, 'grad_norm': 0.6004648804664612, 'learning_rate': 9.798353983677294e-06, 'epoch': 0.54}

 18%|█▊        | 2007/11049 [20:41<1:43:00,  1.46it/s]
 18%|█▊        | 2008/11049 [20:41<1:39:43,  1.51it/s]
                                                      
{'loss': 0.2977, 'grad_norm': 0.6429808735847473, 'learning_rate': 9.797909665316477e-06, 'epoch': 0.55}

 18%|█▊        | 2008/11049 [20:42<1:39:43,  1.51it/s]
 18%|█▊        | 2009/11049 [20:42<1:37:30,  1.55it/s]
                                                      
{'loss': 0.2807, 'grad_norm': 0.5491591691970825, 'learning_rate': 9.797464868072489e-06, 'epoch': 0.55}

 18%|█▊        | 2009/11049 [20:42<1:37:30,  1.55it/s]
 18%|█▊        | 2010/11049 [20:43<1:35:58,  1.57it/s]
                                                      
{'loss': 0.2754, 'grad_norm': 0.5424213409423828, 'learning_rate': 9.79701959198972e-06, 'epoch': 0.55}

 18%|█▊        | 2010/11049 [20:43<1:35:58,  1.57it/s]
 18%|█▊        | 2011/11049 [20:43<1:34:56,  1.59it/s]
                                                      
{'loss': 0.3264, 'grad_norm': 0.6696804761886597, 'learning_rate': 9.79657383711262e-06, 'epoch': 0.55}

 18%|█▊        | 2011/11049 [20:43<1:34:56,  1.59it/s]
 18%|█▊        | 2012/11049 [20:44<1:34:09,  1.60it/s]
                                                      
{'loss': 0.3242, 'grad_norm': 0.6318032741546631, 'learning_rate': 9.796127603485674e-06, 'epoch': 0.55}

 18%|█▊        | 2012/11049 [20:44<1:34:09,  1.60it/s]
 18%|█▊        | 2013/11049 [20:45<1:33:38,  1.61it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.5252684354782104, 'learning_rate': 9.795680891153425e-06, 'epoch': 0.55}

 18%|█▊        | 2013/11049 [20:45<1:33:38,  1.61it/s]
 18%|█▊        | 2014/11049 [20:45<1:33:16,  1.61it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.5067297220230103, 'learning_rate': 9.795233700160459e-06, 'epoch': 0.55}

 18%|█▊        | 2014/11049 [20:45<1:33:16,  1.61it/s]
 18%|█▊        | 2015/11049 [20:46<1:32:58,  1.62it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5153039693832397, 'learning_rate': 9.79478603055141e-06, 'epoch': 0.55}

 18%|█▊        | 2015/11049 [20:46<1:32:58,  1.62it/s]
 18%|█▊        | 2016/11049 [20:46<1:32:50,  1.62it/s]
                                                      
{'loss': 0.2955, 'grad_norm': 0.5922356247901917, 'learning_rate': 9.794337882370958e-06, 'epoch': 0.55}

 18%|█▊        | 2016/11049 [20:46<1:32:50,  1.62it/s]
 18%|█▊        | 2017/11049 [20:47<1:32:39,  1.62it/s]
                                                      
{'loss': 0.3102, 'grad_norm': 0.5786392092704773, 'learning_rate': 9.793889255663838e-06, 'epoch': 0.55}

 18%|█▊        | 2017/11049 [20:47<1:32:39,  1.62it/s]
 18%|█▊        | 2018/11049 [20:48<1:32:31,  1.63it/s]
                                                      
{'loss': 0.2522, 'grad_norm': 0.5063517093658447, 'learning_rate': 9.793440150474822e-06, 'epoch': 0.55}

 18%|█▊        | 2018/11049 [20:48<1:32:31,  1.63it/s]
 18%|█▊        | 2019/11049 [20:48<1:32:25,  1.63it/s]
                                                      
{'loss': 0.295, 'grad_norm': 0.6350945234298706, 'learning_rate': 9.792990566848741e-06, 'epoch': 0.55}

 18%|█▊        | 2019/11049 [20:48<1:32:25,  1.63it/s]
 18%|█▊        | 2020/11049 [20:49<1:32:22,  1.63it/s]
                                                      
{'loss': 0.2535, 'grad_norm': 0.5295684337615967, 'learning_rate': 9.792540504830465e-06, 'epoch': 0.55}

 18%|█▊        | 2020/11049 [20:49<1:32:22,  1.63it/s]
 18%|█▊        | 2021/11049 [20:49<1:32:20,  1.63it/s]
                                                      
{'loss': 0.2315, 'grad_norm': 0.5415899753570557, 'learning_rate': 9.792089964464916e-06, 'epoch': 0.55}

 18%|█▊        | 2021/11049 [20:50<1:32:20,  1.63it/s]
 18%|█▊        | 2022/11049 [20:50<1:32:18,  1.63it/s]
                                                      
{'loss': 0.2426, 'grad_norm': 0.5848286151885986, 'learning_rate': 9.791638945797062e-06, 'epoch': 0.55}

 18%|█▊        | 2022/11049 [20:50<1:32:18,  1.63it/s]
 18%|█▊        | 2023/11049 [20:51<1:32:15,  1.63it/s]
                                                      
{'loss': 0.3534, 'grad_norm': 0.6530948877334595, 'learning_rate': 9.79118744887192e-06, 'epoch': 0.55}

 18%|█▊        | 2023/11049 [20:51<1:32:15,  1.63it/s]
 18%|█▊        | 2024/11049 [20:51<1:32:13,  1.63it/s]
                                                      
{'loss': 0.349, 'grad_norm': 0.6883516311645508, 'learning_rate': 9.790735473734557e-06, 'epoch': 0.55}

 18%|█▊        | 2024/11049 [20:51<1:32:13,  1.63it/s]
 18%|█▊        | 2025/11049 [20:52<1:32:12,  1.63it/s]
                                                      
{'loss': 0.2386, 'grad_norm': 0.5184568762779236, 'learning_rate': 9.79028302043008e-06, 'epoch': 0.55}

 18%|█▊        | 2025/11049 [20:52<1:32:12,  1.63it/s]
 18%|█▊        | 2026/11049 [20:52<1:32:13,  1.63it/s]
                                                      
{'loss': 0.252, 'grad_norm': 0.5322156548500061, 'learning_rate': 9.789830089003652e-06, 'epoch': 0.55}

 18%|█▊        | 2026/11049 [20:53<1:32:13,  1.63it/s]
 18%|█▊        | 2027/11049 [20:53<1:32:11,  1.63it/s]
                                                      
{'loss': 0.2586, 'grad_norm': 0.5522646903991699, 'learning_rate': 9.789376679500477e-06, 'epoch': 0.55}

 18%|█▊        | 2027/11049 [20:53<1:32:11,  1.63it/s]
 18%|█▊        | 2028/11049 [20:54<1:32:09,  1.63it/s]
                                                      
{'loss': 0.2771, 'grad_norm': 0.6201223134994507, 'learning_rate': 9.788922791965816e-06, 'epoch': 0.55}

 18%|█▊        | 2028/11049 [20:54<1:32:09,  1.63it/s]
 18%|█▊        | 2029/11049 [20:54<1:32:10,  1.63it/s]
                                                      
{'loss': 0.2861, 'grad_norm': 0.6337442994117737, 'learning_rate': 9.788468426444968e-06, 'epoch': 0.55}

 18%|█▊        | 2029/11049 [20:54<1:32:10,  1.63it/s]
 18%|█▊        | 2030/11049 [20:55<1:32:09,  1.63it/s]
                                                      
{'loss': 0.1997, 'grad_norm': 0.4875871241092682, 'learning_rate': 9.788013582983285e-06, 'epoch': 0.55}

 18%|█▊        | 2030/11049 [20:55<1:32:09,  1.63it/s]
 18%|█▊        | 2031/11049 [20:56<1:32:10,  1.63it/s]
                                                      
{'loss': 0.2278, 'grad_norm': 0.5095825791358948, 'learning_rate': 9.787558261626163e-06, 'epoch': 0.55}

 18%|█▊        | 2031/11049 [20:56<1:32:10,  1.63it/s]
 18%|█▊        | 2032/11049 [20:56<1:32:06,  1.63it/s]
                                                      
{'loss': 0.382, 'grad_norm': 0.8028372526168823, 'learning_rate': 9.787102462419049e-06, 'epoch': 0.55}

 18%|█▊        | 2032/11049 [20:56<1:32:06,  1.63it/s]
 18%|█▊        | 2033/11049 [20:57<1:32:08,  1.63it/s]
                                                      
{'loss': 0.238, 'grad_norm': 0.5844998955726624, 'learning_rate': 9.786646185407438e-06, 'epoch': 0.55}

 18%|█▊        | 2033/11049 [20:57<1:32:08,  1.63it/s]
 18%|█▊        | 2034/11049 [20:57<1:32:10,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.5401292443275452, 'learning_rate': 9.786189430636871e-06, 'epoch': 0.55}

 18%|█▊        | 2034/11049 [20:58<1:32:10,  1.63it/s]
 18%|█▊        | 2035/11049 [20:58<1:32:09,  1.63it/s]
                                                      
{'loss': 0.3645, 'grad_norm': 0.6088209748268127, 'learning_rate': 9.785732198152935e-06, 'epoch': 0.55}

 18%|█▊        | 2035/11049 [20:58<1:32:09,  1.63it/s]
 18%|█▊        | 2036/11049 [20:59<1:32:07,  1.63it/s]
                                                      
{'loss': 0.2149, 'grad_norm': 0.5266765356063843, 'learning_rate': 9.785274488001271e-06, 'epoch': 0.55}

 18%|█▊        | 2036/11049 [20:59<1:32:07,  1.63it/s]
 18%|█▊        | 2037/11049 [20:59<1:32:09,  1.63it/s]
                                                      
{'loss': 0.3103, 'grad_norm': 0.6309897899627686, 'learning_rate': 9.78481630022756e-06, 'epoch': 0.55}

 18%|█▊        | 2037/11049 [20:59<1:32:09,  1.63it/s]
 18%|█▊        | 2038/11049 [21:00<1:32:06,  1.63it/s]
                                                      
{'loss': 0.277, 'grad_norm': 0.7022249102592468, 'learning_rate': 9.784357634877533e-06, 'epoch': 0.55}

 18%|█▊        | 2038/11049 [21:00<1:32:06,  1.63it/s]
 18%|█▊        | 2039/11049 [21:00<1:32:03,  1.63it/s]
                                                      
{'loss': 0.2928, 'grad_norm': 0.6197507977485657, 'learning_rate': 9.783898491996974e-06, 'epoch': 0.55}

 18%|█▊        | 2039/11049 [21:01<1:32:03,  1.63it/s]
 18%|█▊        | 2040/11049 [21:01<1:32:05,  1.63it/s]
                                                      
{'loss': 0.4059, 'grad_norm': 0.6517504453659058, 'learning_rate': 9.783438871631708e-06, 'epoch': 0.55}

 18%|█▊        | 2040/11049 [21:01<1:32:05,  1.63it/s]
 18%|█▊        | 2041/11049 [21:02<1:32:07,  1.63it/s]
                                                      
{'loss': 0.3012, 'grad_norm': 0.6276090145111084, 'learning_rate': 9.782978773827607e-06, 'epoch': 0.55}

 18%|█▊        | 2041/11049 [21:02<1:32:07,  1.63it/s]
 18%|█▊        | 2042/11049 [21:02<1:32:05,  1.63it/s]
                                                      
{'loss': 0.2211, 'grad_norm': 0.5301361083984375, 'learning_rate': 9.7825181986306e-06, 'epoch': 0.55}

 18%|█▊        | 2042/11049 [21:02<1:32:05,  1.63it/s]
 18%|█▊        | 2043/11049 [21:03<1:32:05,  1.63it/s]
                                                      
{'loss': 0.3586, 'grad_norm': 0.5619902610778809, 'learning_rate': 9.782057146086652e-06, 'epoch': 0.55}

 18%|█▊        | 2043/11049 [21:03<1:32:05,  1.63it/s]
 18%|█▊        | 2044/11049 [21:04<1:32:06,  1.63it/s]
                                                      
{'loss': 0.2505, 'grad_norm': 0.6602334380149841, 'learning_rate': 9.781595616241785e-06, 'epoch': 0.55}

 18%|█▊        | 2044/11049 [21:04<1:32:06,  1.63it/s]
 19%|█▊        | 2045/11049 [21:04<1:32:03,  1.63it/s]
                                                      
{'loss': 0.2661, 'grad_norm': 0.639636218547821, 'learning_rate': 9.781133609142062e-06, 'epoch': 0.56}

 19%|█▊        | 2045/11049 [21:04<1:32:03,  1.63it/s]
 19%|█▊        | 2046/11049 [21:05<1:32:01,  1.63it/s]
                                                      
{'loss': 0.3061, 'grad_norm': 0.6001779437065125, 'learning_rate': 9.780671124833597e-06, 'epoch': 0.56}

 19%|█▊        | 2046/11049 [21:05<1:32:01,  1.63it/s]
 19%|█▊        | 2047/11049 [21:05<1:32:00,  1.63it/s]
                                                      
{'loss': 0.3053, 'grad_norm': 0.537788987159729, 'learning_rate': 9.780208163362552e-06, 'epoch': 0.56}

 19%|█▊        | 2047/11049 [21:05<1:32:00,  1.63it/s]
 19%|█▊        | 2048/11049 [21:06<1:31:58,  1.63it/s]
                                                      
{'loss': 0.2532, 'grad_norm': 0.5826342701911926, 'learning_rate': 9.779744724775133e-06, 'epoch': 0.56}

 19%|█▊        | 2048/11049 [21:06<1:31:58,  1.63it/s]
 19%|█▊        | 2049/11049 [21:07<1:31:59,  1.63it/s]
                                                      
{'loss': 0.358, 'grad_norm': 0.5853226184844971, 'learning_rate': 9.7792808091176e-06, 'epoch': 0.56}

 19%|█▊        | 2049/11049 [21:07<1:31:59,  1.63it/s]
 19%|█▊        | 2050/11049 [21:07<1:31:58,  1.63it/s]
                                                      
{'loss': 0.3096, 'grad_norm': 0.5924950838088989, 'learning_rate': 9.778816416436253e-06, 'epoch': 0.56}

 19%|█▊        | 2050/11049 [21:07<1:31:58,  1.63it/s]
 19%|█▊        | 2051/11049 [21:08<1:31:57,  1.63it/s]
                                                      
{'loss': 0.3572, 'grad_norm': 0.573222279548645, 'learning_rate': 9.778351546777445e-06, 'epoch': 0.56}

 19%|█▊        | 2051/11049 [21:08<1:31:57,  1.63it/s]
 19%|█▊        | 2052/11049 [21:08<1:31:56,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.6171370148658752, 'learning_rate': 9.777886200187577e-06, 'epoch': 0.56}

 19%|█▊        | 2052/11049 [21:09<1:31:56,  1.63it/s]
 19%|█▊        | 2053/11049 [21:09<1:31:56,  1.63it/s]
                                                      
{'loss': 0.2504, 'grad_norm': 0.5324944853782654, 'learning_rate': 9.77742037671309e-06, 'epoch': 0.56}

 19%|█▊        | 2053/11049 [21:09<1:31:56,  1.63it/s]
 19%|█▊        | 2054/11049 [21:10<1:31:56,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.5792487263679504, 'learning_rate': 9.776954076400485e-06, 'epoch': 0.56}

 19%|█▊        | 2054/11049 [21:10<1:31:56,  1.63it/s]
 19%|█▊        | 2055/11049 [21:10<1:31:54,  1.63it/s]
                                                      
{'loss': 0.279, 'grad_norm': 0.668707013130188, 'learning_rate': 9.7764872992963e-06, 'epoch': 0.56}

 19%|█▊        | 2055/11049 [21:10<1:31:54,  1.63it/s]
 19%|█▊        | 2056/11049 [21:11<1:31:55,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.4789719879627228, 'learning_rate': 9.776020045447125e-06, 'epoch': 0.56}

 19%|█▊        | 2056/11049 [21:11<1:31:55,  1.63it/s]
 19%|█▊        | 2057/11049 [21:12<1:31:53,  1.63it/s]
                                                      
{'loss': 0.3519, 'grad_norm': 0.6050790548324585, 'learning_rate': 9.775552314899596e-06, 'epoch': 0.56}

 19%|█▊        | 2057/11049 [21:12<1:31:53,  1.63it/s]
 19%|█▊        | 2058/11049 [21:12<1:31:54,  1.63it/s]
                                                      
{'loss': 0.3457, 'grad_norm': 0.6292545199394226, 'learning_rate': 9.775084107700399e-06, 'epoch': 0.56}

 19%|█▊        | 2058/11049 [21:12<1:31:54,  1.63it/s]
 19%|█▊        | 2059/11049 [21:13<1:31:51,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.5170879364013672, 'learning_rate': 9.774615423896267e-06, 'epoch': 0.56}

 19%|█▊        | 2059/11049 [21:13<1:31:51,  1.63it/s]
 19%|█▊        | 2060/11049 [21:13<1:31:50,  1.63it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.5274729132652283, 'learning_rate': 9.774146263533977e-06, 'epoch': 0.56}

 19%|█▊        | 2060/11049 [21:13<1:31:50,  1.63it/s]
 19%|█▊        | 2061/11049 [21:14<1:31:49,  1.63it/s]
                                                      
{'loss': 0.3674, 'grad_norm': 0.6559541821479797, 'learning_rate': 9.773676626660359e-06, 'epoch': 0.56}

 19%|█▊        | 2061/11049 [21:14<1:31:49,  1.63it/s]
 19%|█▊        | 2062/11049 [21:15<1:31:51,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.6236224174499512, 'learning_rate': 9.773206513322284e-06, 'epoch': 0.56}

 19%|█▊        | 2062/11049 [21:15<1:31:51,  1.63it/s]
 19%|█▊        | 2063/11049 [21:15<1:31:49,  1.63it/s]
                                                      
{'loss': 0.2846, 'grad_norm': 0.6146063804626465, 'learning_rate': 9.772735923566678e-06, 'epoch': 0.56}

 19%|█▊        | 2063/11049 [21:15<1:31:49,  1.63it/s]
 19%|█▊        | 2064/11049 [21:16<1:31:49,  1.63it/s]
                                                      
{'loss': 0.2497, 'grad_norm': 0.5416976809501648, 'learning_rate': 9.772264857440512e-06, 'epoch': 0.56}

 19%|█▊        | 2064/11049 [21:16<1:31:49,  1.63it/s]
 19%|█▊        | 2065/11049 [21:16<1:31:47,  1.63it/s]
                                                      
{'loss': 0.2072, 'grad_norm': 0.5152135491371155, 'learning_rate': 9.7717933149908e-06, 'epoch': 0.56}

 19%|█▊        | 2065/11049 [21:17<1:31:47,  1.63it/s]
 19%|█▊        | 2066/11049 [21:17<1:31:49,  1.63it/s]
                                                      
{'loss': 0.2678, 'grad_norm': 0.6114649772644043, 'learning_rate': 9.771321296264608e-06, 'epoch': 0.56}

 19%|█▊        | 2066/11049 [21:17<1:31:49,  1.63it/s]
 19%|█▊        | 2067/11049 [21:18<1:31:47,  1.63it/s]
                                                      
{'loss': 0.3328, 'grad_norm': 0.6800031065940857, 'learning_rate': 9.77084880130905e-06, 'epoch': 0.56}

 19%|█▊        | 2067/11049 [21:18<1:31:47,  1.63it/s]
 19%|█▊        | 2068/11049 [21:18<1:31:48,  1.63it/s]
                                                      
{'loss': 0.2939, 'grad_norm': 0.6545555591583252, 'learning_rate': 9.770375830171283e-06, 'epoch': 0.56}

 19%|█▊        | 2068/11049 [21:18<1:31:48,  1.63it/s]
 19%|█▊        | 2069/11049 [21:19<1:31:47,  1.63it/s]
                                                      
{'loss': 0.4142, 'grad_norm': 0.750701904296875, 'learning_rate': 9.769902382898518e-06, 'epoch': 0.56}

 19%|█▊        | 2069/11049 [21:19<1:31:47,  1.63it/s]
 19%|█▊        | 2070/11049 [21:19<1:32:06,  1.62it/s]
                                                      
{'loss': 0.2651, 'grad_norm': 0.5629423260688782, 'learning_rate': 9.769428459538007e-06, 'epoch': 0.56}

 19%|█▊        | 2070/11049 [21:20<1:32:06,  1.62it/s]
 19%|█▊        | 2071/11049 [21:20<1:31:54,  1.63it/s]
                                                      
{'loss': 0.2849, 'grad_norm': 0.571163535118103, 'learning_rate': 9.768954060137057e-06, 'epoch': 0.56}

 19%|█▊        | 2071/11049 [21:20<1:31:54,  1.63it/s]
 19%|█▉        | 2072/11049 [21:21<1:31:52,  1.63it/s]
                                                      
{'loss': 0.3719, 'grad_norm': 0.7276574373245239, 'learning_rate': 9.768479184743014e-06, 'epoch': 0.56}

 19%|█▉        | 2072/11049 [21:21<1:31:52,  1.63it/s]
 19%|█▉        | 2073/11049 [21:21<1:31:51,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.5200322866439819, 'learning_rate': 9.768003833403278e-06, 'epoch': 0.56}

 19%|█▉        | 2073/11049 [21:21<1:31:51,  1.63it/s]
 19%|█▉        | 2074/11049 [21:22<1:31:52,  1.63it/s]
                                                      
{'loss': 0.2661, 'grad_norm': 0.5618182420730591, 'learning_rate': 9.767528006165293e-06, 'epoch': 0.56}

 19%|█▉        | 2074/11049 [21:22<1:31:52,  1.63it/s]
 19%|█▉        | 2075/11049 [21:23<1:31:50,  1.63it/s]
                                                      
{'loss': 0.3304, 'grad_norm': 0.7595348358154297, 'learning_rate': 9.767051703076553e-06, 'epoch': 0.56}

 19%|█▉        | 2075/11049 [21:23<1:31:50,  1.63it/s]
 19%|█▉        | 2076/11049 [21:23<1:31:46,  1.63it/s]
                                                      
{'loss': 0.3194, 'grad_norm': 0.6392070651054382, 'learning_rate': 9.766574924184597e-06, 'epoch': 0.56}

 19%|█▉        | 2076/11049 [21:23<1:31:46,  1.63it/s]
 19%|█▉        | 2077/11049 [21:24<1:31:45,  1.63it/s]
                                                      
{'loss': 0.326, 'grad_norm': 0.6102232336997986, 'learning_rate': 9.766097669537013e-06, 'epoch': 0.56}

 19%|█▉        | 2077/11049 [21:24<1:31:45,  1.63it/s]
 19%|█▉        | 2078/11049 [21:24<1:31:45,  1.63it/s]
                                                      
{'loss': 0.2301, 'grad_norm': 0.5072634220123291, 'learning_rate': 9.765619939181435e-06, 'epoch': 0.56}

 19%|█▉        | 2078/11049 [21:25<1:31:45,  1.63it/s]
 19%|█▉        | 2079/11049 [21:25<1:31:44,  1.63it/s]
                                                      
{'loss': 0.2435, 'grad_norm': 0.5471115708351135, 'learning_rate': 9.765141733165549e-06, 'epoch': 0.56}

 19%|█▉        | 2079/11049 [21:25<1:31:44,  1.63it/s]
 19%|█▉        | 2080/11049 [21:26<1:31:45,  1.63it/s]
                                                      
{'loss': 0.3497, 'grad_norm': 0.6808252930641174, 'learning_rate': 9.764663051537081e-06, 'epoch': 0.56}

 19%|█▉        | 2080/11049 [21:26<1:31:45,  1.63it/s]
 19%|█▉        | 2081/11049 [21:26<1:31:43,  1.63it/s]
                                                      
{'loss': 0.2775, 'grad_norm': 0.5013396143913269, 'learning_rate': 9.764183894343812e-06, 'epoch': 0.57}

 19%|█▉        | 2081/11049 [21:26<1:31:43,  1.63it/s]
 19%|█▉        | 2082/11049 [21:27<1:31:40,  1.63it/s]
                                                      
{'loss': 0.316, 'grad_norm': 0.6166329383850098, 'learning_rate': 9.763704261633567e-06, 'epoch': 0.57}

 19%|█▉        | 2082/11049 [21:27<1:31:40,  1.63it/s]
 19%|█▉        | 2083/11049 [21:27<1:31:37,  1.63it/s]
                                                      
{'loss': 0.3083, 'grad_norm': 0.6832801699638367, 'learning_rate': 9.763224153454214e-06, 'epoch': 0.57}

 19%|█▉        | 2083/11049 [21:28<1:31:37,  1.63it/s]
 19%|█▉        | 2084/11049 [21:28<1:31:39,  1.63it/s]
                                                      
{'loss': 0.2389, 'grad_norm': 0.5754706859588623, 'learning_rate': 9.762743569853678e-06, 'epoch': 0.57}

 19%|█▉        | 2084/11049 [21:28<1:31:39,  1.63it/s]
 19%|█▉        | 2085/11049 [21:29<1:31:42,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.5644994378089905, 'learning_rate': 9.762262510879925e-06, 'epoch': 0.57}

 19%|█▉        | 2085/11049 [21:29<1:31:42,  1.63it/s]
 19%|█▉        | 2086/11049 [21:29<1:31:39,  1.63it/s]
                                                      
{'loss': 0.2585, 'grad_norm': 0.5595118403434753, 'learning_rate': 9.761780976580967e-06, 'epoch': 0.57}

 19%|█▉        | 2086/11049 [21:29<1:31:39,  1.63it/s]
 19%|█▉        | 2087/11049 [21:30<1:31:40,  1.63it/s]
                                                      
{'loss': 0.3867, 'grad_norm': 0.560390830039978, 'learning_rate': 9.761298967004871e-06, 'epoch': 0.57}

 19%|█▉        | 2087/11049 [21:30<1:31:40,  1.63it/s]
 19%|█▉        | 2088/11049 [21:31<1:31:38,  1.63it/s]
                                                      
{'loss': 0.244, 'grad_norm': 0.5742537975311279, 'learning_rate': 9.760816482199745e-06, 'epoch': 0.57}

 19%|█▉        | 2088/11049 [21:31<1:31:38,  1.63it/s]
 19%|█▉        | 2089/11049 [21:31<1:31:35,  1.63it/s]
                                                      
{'loss': 0.365, 'grad_norm': 0.6003047823905945, 'learning_rate': 9.760333522213746e-06, 'epoch': 0.57}

 19%|█▉        | 2089/11049 [21:31<1:31:35,  1.63it/s]
 19%|█▉        | 2090/11049 [21:32<1:31:33,  1.63it/s]
                                                      
{'loss': 0.34, 'grad_norm': 0.6839379072189331, 'learning_rate': 9.759850087095076e-06, 'epoch': 0.57}

 19%|█▉        | 2090/11049 [21:32<1:31:33,  1.63it/s]
 19%|█▉        | 2091/11049 [21:32<1:31:33,  1.63it/s]
                                                      
{'loss': 0.2486, 'grad_norm': 0.6264643669128418, 'learning_rate': 9.759366176891991e-06, 'epoch': 0.57}

 19%|█▉        | 2091/11049 [21:32<1:31:33,  1.63it/s]
 19%|█▉        | 2092/11049 [21:33<1:31:33,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.5356970429420471, 'learning_rate': 9.758881791652788e-06, 'epoch': 0.57}

 19%|█▉        | 2092/11049 [21:33<1:31:33,  1.63it/s]
 19%|█▉        | 2093/11049 [21:34<1:31:33,  1.63it/s]
                                                      
{'loss': 0.3042, 'grad_norm': 1.1248029470443726, 'learning_rate': 9.758396931425815e-06, 'epoch': 0.57}

 19%|█▉        | 2093/11049 [21:34<1:31:33,  1.63it/s]
 19%|█▉        | 2094/11049 [21:34<1:31:32,  1.63it/s]
                                                      
{'loss': 0.32, 'grad_norm': 0.6782110929489136, 'learning_rate': 9.757911596259467e-06, 'epoch': 0.57}

 19%|█▉        | 2094/11049 [21:34<1:31:32,  1.63it/s]
 19%|█▉        | 2095/11049 [21:35<1:31:31,  1.63it/s]
                                                      
{'loss': 0.2657, 'grad_norm': 0.6936582326889038, 'learning_rate': 9.757425786202184e-06, 'epoch': 0.57}

 19%|█▉        | 2095/11049 [21:35<1:31:31,  1.63it/s]
 19%|█▉        | 2096/11049 [21:35<1:31:32,  1.63it/s]
                                                      
{'loss': 0.3291, 'grad_norm': 0.6084426045417786, 'learning_rate': 9.756939501302457e-06, 'epoch': 0.57}

 19%|█▉        | 2096/11049 [21:36<1:31:32,  1.63it/s]
 19%|█▉        | 2097/11049 [21:36<1:31:32,  1.63it/s]
                                                      
{'loss': 0.3328, 'grad_norm': 0.7972848415374756, 'learning_rate': 9.75645274160882e-06, 'epoch': 0.57}

 19%|█▉        | 2097/11049 [21:36<1:31:32,  1.63it/s]
 19%|█▉        | 2098/11049 [21:37<1:31:29,  1.63it/s]
                                                      
{'loss': 0.3084, 'grad_norm': 0.6749657392501831, 'learning_rate': 9.755965507169858e-06, 'epoch': 0.57}

 19%|█▉        | 2098/11049 [21:37<1:31:29,  1.63it/s]
 19%|█▉        | 2099/11049 [21:37<1:31:29,  1.63it/s]
                                                      
{'loss': 0.2658, 'grad_norm': 0.6000137329101562, 'learning_rate': 9.755477798034203e-06, 'epoch': 0.57}

 19%|█▉        | 2099/11049 [21:37<1:31:29,  1.63it/s]
 19%|█▉        | 2100/11049 [21:38<1:31:28,  1.63it/s]
                                                      
{'loss': 0.2216, 'grad_norm': 0.5070696473121643, 'learning_rate': 9.754989614250532e-06, 'epoch': 0.57}

 19%|█▉        | 2100/11049 [21:38<1:31:28,  1.63it/s]
 19%|█▉        | 2101/11049 [21:38<1:31:29,  1.63it/s]
                                                      
{'loss': 0.32, 'grad_norm': 0.7501346468925476, 'learning_rate': 9.754500955867573e-06, 'epoch': 0.57}

 19%|█▉        | 2101/11049 [21:39<1:31:29,  1.63it/s]
 19%|█▉        | 2102/11049 [21:39<1:31:27,  1.63it/s]
                                                      
{'loss': 0.3241, 'grad_norm': 0.6916318535804749, 'learning_rate': 9.754011822934098e-06, 'epoch': 0.57}

 19%|█▉        | 2102/11049 [21:39<1:31:27,  1.63it/s]
 19%|█▉        | 2103/11049 [21:40<1:31:25,  1.63it/s]
                                                      
{'loss': 0.2849, 'grad_norm': 0.5837973952293396, 'learning_rate': 9.75352221549893e-06, 'epoch': 0.57}

 19%|█▉        | 2103/11049 [21:40<1:31:25,  1.63it/s]
 19%|█▉        | 2104/11049 [21:40<1:31:24,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.5623762607574463, 'learning_rate': 9.753032133610932e-06, 'epoch': 0.57}

 19%|█▉        | 2104/11049 [21:40<1:31:24,  1.63it/s]
 19%|█▉        | 2105/11049 [21:41<1:31:24,  1.63it/s]
                                                      
{'loss': 0.312, 'grad_norm': 0.6099073886871338, 'learning_rate': 9.752541577319026e-06, 'epoch': 0.57}

 19%|█▉        | 2105/11049 [21:41<1:31:24,  1.63it/s]
 19%|█▉        | 2106/11049 [21:42<1:31:24,  1.63it/s]
                                                      
{'loss': 0.3192, 'grad_norm': 0.8227481245994568, 'learning_rate': 9.75205054667217e-06, 'epoch': 0.57}

 19%|█▉        | 2106/11049 [21:42<1:31:24,  1.63it/s]
 19%|█▉        | 2107/11049 [21:42<1:31:24,  1.63it/s]
                                                      
{'loss': 0.3254, 'grad_norm': 0.6449194550514221, 'learning_rate': 9.751559041719376e-06, 'epoch': 0.57}

 19%|█▉        | 2107/11049 [21:42<1:31:24,  1.63it/s]
 19%|█▉        | 2108/11049 [21:43<1:31:24,  1.63it/s]
                                                      
{'loss': 0.1664, 'grad_norm': 0.4239571988582611, 'learning_rate': 9.7510670625097e-06, 'epoch': 0.57}

 19%|█▉        | 2108/11049 [21:43<1:31:24,  1.63it/s]
 19%|█▉        | 2109/11049 [21:43<1:31:22,  1.63it/s]
                                                      
{'loss': 0.2719, 'grad_norm': 0.5472854971885681, 'learning_rate': 9.75057460909225e-06, 'epoch': 0.57}

 19%|█▉        | 2109/11049 [21:44<1:31:22,  1.63it/s]
 19%|█▉        | 2110/11049 [21:44<1:31:21,  1.63it/s]
                                                      
{'loss': 0.3883, 'grad_norm': 0.6916096210479736, 'learning_rate': 9.750081681516175e-06, 'epoch': 0.57}

 19%|█▉        | 2110/11049 [21:44<1:31:21,  1.63it/s]
 19%|█▉        | 2111/11049 [21:45<1:31:21,  1.63it/s]
                                                      
{'loss': 0.2595, 'grad_norm': 0.5873110890388489, 'learning_rate': 9.749588279830674e-06, 'epoch': 0.57}

 19%|█▉        | 2111/11049 [21:45<1:31:21,  1.63it/s]
 19%|█▉        | 2112/11049 [21:45<1:31:20,  1.63it/s]
                                                      
{'loss': 0.2988, 'grad_norm': 0.7241216897964478, 'learning_rate': 9.749094404085e-06, 'epoch': 0.57}

 19%|█▉        | 2112/11049 [21:45<1:31:20,  1.63it/s]
 19%|█▉        | 2113/11049 [21:46<1:31:22,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.493918240070343, 'learning_rate': 9.74860005432844e-06, 'epoch': 0.57}

 19%|█▉        | 2113/11049 [21:46<1:31:22,  1.63it/s]
 19%|█▉        | 2114/11049 [21:46<1:31:23,  1.63it/s]
                                                      
{'loss': 0.3277, 'grad_norm': 0.5389146208763123, 'learning_rate': 9.748105230610339e-06, 'epoch': 0.57}

 19%|█▉        | 2114/11049 [21:47<1:31:23,  1.63it/s]
 19%|█▉        | 2115/11049 [21:47<1:31:19,  1.63it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.5573790669441223, 'learning_rate': 9.747609932980084e-06, 'epoch': 0.57}

 19%|█▉        | 2115/11049 [21:47<1:31:19,  1.63it/s]
 19%|█▉        | 2116/11049 [21:48<1:31:41,  1.62it/s]
                                                      
{'loss': 0.3019, 'grad_norm': 0.6927140355110168, 'learning_rate': 9.747114161487111e-06, 'epoch': 0.57}

 19%|█▉        | 2116/11049 [21:48<1:31:41,  1.62it/s]
 19%|█▉        | 2117/11049 [21:48<1:31:36,  1.63it/s]
                                                      
{'loss': 0.2411, 'grad_norm': 0.5607938170433044, 'learning_rate': 9.746617916180906e-06, 'epoch': 0.57}

 19%|█▉        | 2117/11049 [21:48<1:31:36,  1.63it/s]
 19%|█▉        | 2118/11049 [21:49<1:31:29,  1.63it/s]
                                                      
{'loss': 0.3726, 'grad_norm': 0.6830184459686279, 'learning_rate': 9.746121197110996e-06, 'epoch': 0.58}

 19%|█▉        | 2118/11049 [21:49<1:31:29,  1.63it/s]
 19%|█▉        | 2119/11049 [21:50<1:31:28,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.6632415652275085, 'learning_rate': 9.745624004326964e-06, 'epoch': 0.58}

 19%|█▉        | 2119/11049 [21:50<1:31:28,  1.63it/s]
 19%|█▉        | 2120/11049 [21:50<1:31:22,  1.63it/s]
                                                      
{'loss': 0.2766, 'grad_norm': 0.5722737312316895, 'learning_rate': 9.74512633787843e-06, 'epoch': 0.58}

 19%|█▉        | 2120/11049 [21:50<1:31:22,  1.63it/s]
 19%|█▉        | 2121/11049 [21:51<1:31:20,  1.63it/s]
                                                      
{'loss': 0.2242, 'grad_norm': 0.45241907238960266, 'learning_rate': 9.744628197815068e-06, 'epoch': 0.58}

 19%|█▉        | 2121/11049 [21:51<1:31:20,  1.63it/s]
 19%|█▉        | 2122/11049 [21:51<1:31:21,  1.63it/s]
                                                      
{'loss': 0.2061, 'grad_norm': 0.565464973449707, 'learning_rate': 9.744129584186599e-06, 'epoch': 0.58}

 19%|█▉        | 2122/11049 [21:52<1:31:21,  1.63it/s]
 19%|█▉        | 2123/11049 [21:52<1:31:17,  1.63it/s]
                                                      
{'loss': 0.1991, 'grad_norm': 0.4967272877693176, 'learning_rate': 9.743630497042789e-06, 'epoch': 0.58}

 19%|█▉        | 2123/11049 [21:52<1:31:17,  1.63it/s]
 19%|█▉        | 2124/11049 [21:53<1:31:14,  1.63it/s]
                                                      
{'loss': 0.2557, 'grad_norm': 0.5022333860397339, 'learning_rate': 9.743130936433453e-06, 'epoch': 0.58}

 19%|█▉        | 2124/11049 [21:53<1:31:14,  1.63it/s]
 19%|█▉        | 2125/11049 [21:53<1:31:25,  1.63it/s]
                                                      
{'loss': 0.2108, 'grad_norm': 0.5159618854522705, 'learning_rate': 9.742630902408452e-06, 'epoch': 0.58}

 19%|█▉        | 2125/11049 [21:53<1:31:25,  1.63it/s]
 19%|█▉        | 2126/11049 [21:54<1:31:21,  1.63it/s]
                                                      
{'loss': 0.339, 'grad_norm': 0.6877539157867432, 'learning_rate': 9.742130395017694e-06, 'epoch': 0.58}

 19%|█▉        | 2126/11049 [21:54<1:31:21,  1.63it/s]
 19%|█▉        | 2127/11049 [21:54<1:31:20,  1.63it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.6292914748191833, 'learning_rate': 9.741629414311137e-06, 'epoch': 0.58}

 19%|█▉        | 2127/11049 [21:55<1:31:20,  1.63it/s]
 19%|█▉        | 2128/11049 [21:55<1:31:19,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.5568750500679016, 'learning_rate': 9.741127960338784e-06, 'epoch': 0.58}

 19%|█▉        | 2128/11049 [21:55<1:31:19,  1.63it/s]
 19%|█▉        | 2129/11049 [21:56<1:31:15,  1.63it/s]
                                                      
{'loss': 0.2505, 'grad_norm': 0.5962061882019043, 'learning_rate': 9.740626033150683e-06, 'epoch': 0.58}

 19%|█▉        | 2129/11049 [21:56<1:31:15,  1.63it/s]
 19%|█▉        | 2130/11049 [21:56<1:31:21,  1.63it/s]
                                                      
{'loss': 0.2654, 'grad_norm': 0.5271895527839661, 'learning_rate': 9.740123632796934e-06, 'epoch': 0.58}

 19%|█▉        | 2130/11049 [21:56<1:31:21,  1.63it/s]
 19%|█▉        | 2131/11049 [21:57<1:31:22,  1.63it/s]
                                                      
{'loss': 0.3579, 'grad_norm': 0.7916930913925171, 'learning_rate': 9.739620759327682e-06, 'epoch': 0.58}

 19%|█▉        | 2131/11049 [21:57<1:31:22,  1.63it/s]
 19%|█▉        | 2132/11049 [21:58<1:31:17,  1.63it/s]
                                                      
{'loss': 0.2643, 'grad_norm': 0.6576216816902161, 'learning_rate': 9.739117412793117e-06, 'epoch': 0.58}

 19%|█▉        | 2132/11049 [21:58<1:31:17,  1.63it/s]
 19%|█▉        | 2133/11049 [21:58<1:31:13,  1.63it/s]
                                                      
{'loss': 0.2951, 'grad_norm': 0.6554843187332153, 'learning_rate': 9.738613593243483e-06, 'epoch': 0.58}

 19%|█▉        | 2133/11049 [21:58<1:31:13,  1.63it/s]
 19%|█▉        | 2134/11049 [21:59<1:31:10,  1.63it/s]
                                                      
{'loss': 0.3208, 'grad_norm': 0.6724183559417725, 'learning_rate': 9.738109300729062e-06, 'epoch': 0.58}

 19%|█▉        | 2134/11049 [21:59<1:31:10,  1.63it/s]
 19%|█▉        | 2135/11049 [21:59<1:31:12,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.49702903628349304, 'learning_rate': 9.73760453530019e-06, 'epoch': 0.58}

 19%|█▉        | 2135/11049 [21:59<1:31:12,  1.63it/s]
 19%|█▉        | 2136/11049 [22:00<1:31:10,  1.63it/s]
                                                      
{'loss': 0.2688, 'grad_norm': 0.5906360149383545, 'learning_rate': 9.737099297007247e-06, 'epoch': 0.58}

 19%|█▉        | 2136/11049 [22:00<1:31:10,  1.63it/s]
 19%|█▉        | 2137/11049 [22:01<1:31:09,  1.63it/s]
                                                      
{'loss': 0.2332, 'grad_norm': 0.664509117603302, 'learning_rate': 9.736593585900662e-06, 'epoch': 0.58}

 19%|█▉        | 2137/11049 [22:01<1:31:09,  1.63it/s]
 19%|█▉        | 2138/11049 [22:01<1:31:22,  1.63it/s]
                                                      
{'loss': 0.3223, 'grad_norm': 0.7056875228881836, 'learning_rate': 9.73608740203091e-06, 'epoch': 0.58}

 19%|█▉        | 2138/11049 [22:01<1:31:22,  1.63it/s]
 19%|█▉        | 2139/11049 [22:02<1:31:15,  1.63it/s]
                                                      
{'loss': 0.2283, 'grad_norm': 0.5845260620117188, 'learning_rate': 9.735580745448514e-06, 'epoch': 0.58}

 19%|█▉        | 2139/11049 [22:02<1:31:15,  1.63it/s]
 19%|█▉        | 2140/11049 [22:02<1:31:25,  1.62it/s]
                                                      
{'loss': 0.3119, 'grad_norm': 0.5966963171958923, 'learning_rate': 9.735073616204045e-06, 'epoch': 0.58}

 19%|█▉        | 2140/11049 [22:03<1:31:25,  1.62it/s]
 19%|█▉        | 2141/11049 [22:03<1:31:21,  1.63it/s]
                                                      
{'loss': 0.2194, 'grad_norm': 0.628937304019928, 'learning_rate': 9.734566014348117e-06, 'epoch': 0.58}

 19%|█▉        | 2141/11049 [22:03<1:31:21,  1.63it/s]
 19%|█▉        | 2142/11049 [22:04<1:31:13,  1.63it/s]
                                                      
{'loss': 0.2296, 'grad_norm': 0.5665099024772644, 'learning_rate': 9.734057939931395e-06, 'epoch': 0.58}

 19%|█▉        | 2142/11049 [22:04<1:31:13,  1.63it/s]
 19%|█▉        | 2143/11049 [22:04<1:31:11,  1.63it/s]
                                                      
{'loss': 0.2348, 'grad_norm': 0.6051347255706787, 'learning_rate': 9.733549393004595e-06, 'epoch': 0.58}

 19%|█▉        | 2143/11049 [22:04<1:31:11,  1.63it/s]
 19%|█▉        | 2144/11049 [22:05<1:31:06,  1.63it/s]
                                                      
{'loss': 0.3006, 'grad_norm': 0.6260091066360474, 'learning_rate': 9.733040373618468e-06, 'epoch': 0.58}

 19%|█▉        | 2144/11049 [22:05<1:31:06,  1.63it/s]
 19%|█▉        | 2145/11049 [22:06<1:31:05,  1.63it/s]
                                                      
{'loss': 0.3197, 'grad_norm': 0.5441282391548157, 'learning_rate': 9.732530881823825e-06, 'epoch': 0.58}

 19%|█▉        | 2145/11049 [22:06<1:31:05,  1.63it/s]
 19%|█▉        | 2146/11049 [22:06<1:31:04,  1.63it/s]
                                                      
{'loss': 0.2522, 'grad_norm': 0.514370322227478, 'learning_rate': 9.732020917671516e-06, 'epoch': 0.58}

 19%|█▉        | 2146/11049 [22:06<1:31:04,  1.63it/s]
 19%|█▉        | 2147/11049 [22:07<1:31:04,  1.63it/s]
                                                      
{'loss': 0.2657, 'grad_norm': 0.5337255001068115, 'learning_rate': 9.731510481212442e-06, 'epoch': 0.58}

 19%|█▉        | 2147/11049 [22:07<1:31:04,  1.63it/s]
 19%|█▉        | 2148/11049 [22:07<1:30:59,  1.63it/s]
                                                      
{'loss': 0.3058, 'grad_norm': 0.6397872567176819, 'learning_rate': 9.73099957249755e-06, 'epoch': 0.58}

 19%|█▉        | 2148/11049 [22:07<1:30:59,  1.63it/s]
 19%|█▉        | 2149/11049 [22:08<1:31:00,  1.63it/s]
                                                      
{'loss': 0.3038, 'grad_norm': 0.579988956451416, 'learning_rate': 9.730488191577834e-06, 'epoch': 0.58}

 19%|█▉        | 2149/11049 [22:08<1:31:00,  1.63it/s]
 19%|█▉        | 2150/11049 [22:09<1:30:58,  1.63it/s]
                                                      
{'loss': 0.2245, 'grad_norm': 0.5510395169258118, 'learning_rate': 9.729976338504336e-06, 'epoch': 0.58}

 19%|█▉        | 2150/11049 [22:09<1:30:58,  1.63it/s]
 19%|█▉        | 2151/11049 [22:09<1:30:59,  1.63it/s]
                                                      
{'loss': 0.2221, 'grad_norm': 0.49613505601882935, 'learning_rate': 9.729464013328144e-06, 'epoch': 0.58}

 19%|█▉        | 2151/11049 [22:09<1:30:59,  1.63it/s]
 19%|█▉        | 2152/11049 [22:10<1:30:59,  1.63it/s]
                                                      
{'loss': 0.3409, 'grad_norm': 0.6546155214309692, 'learning_rate': 9.728951216100392e-06, 'epoch': 0.58}

 19%|█▉        | 2152/11049 [22:10<1:30:59,  1.63it/s]
 19%|█▉        | 2153/11049 [22:10<1:30:57,  1.63it/s]
                                                      
{'loss': 0.257, 'grad_norm': 0.6057788729667664, 'learning_rate': 9.728437946872266e-06, 'epoch': 0.58}

 19%|█▉        | 2153/11049 [22:11<1:30:57,  1.63it/s]
 19%|█▉        | 2154/11049 [22:11<1:30:54,  1.63it/s]
                                                      
{'loss': 0.2024, 'grad_norm': 0.5098462700843811, 'learning_rate': 9.727924205694995e-06, 'epoch': 0.58}

 19%|█▉        | 2154/11049 [22:11<1:30:54,  1.63it/s]
 20%|█▉        | 2155/11049 [22:12<1:30:54,  1.63it/s]
                                                      
{'loss': 0.2559, 'grad_norm': 0.570640504360199, 'learning_rate': 9.727409992619853e-06, 'epoch': 0.59}

 20%|█▉        | 2155/11049 [22:12<1:30:54,  1.63it/s]
 20%|█▉        | 2156/11049 [22:12<1:30:54,  1.63it/s]
                                                      
{'loss': 0.3153, 'grad_norm': 0.7045376300811768, 'learning_rate': 9.726895307698167e-06, 'epoch': 0.59}

 20%|█▉        | 2156/11049 [22:12<1:30:54,  1.63it/s]
 20%|█▉        | 2157/11049 [22:13<1:30:53,  1.63it/s]
                                                      
{'loss': 0.3182, 'grad_norm': 0.6260472536087036, 'learning_rate': 9.726380150981306e-06, 'epoch': 0.59}

 20%|█▉        | 2157/11049 [22:13<1:30:53,  1.63it/s]
 20%|█▉        | 2158/11049 [22:13<1:30:54,  1.63it/s]
                                                      
{'loss': 0.3336, 'grad_norm': 0.6865735650062561, 'learning_rate': 9.725864522520689e-06, 'epoch': 0.59}

 20%|█▉        | 2158/11049 [22:14<1:30:54,  1.63it/s]
 20%|█▉        | 2159/11049 [22:14<1:30:55,  1.63it/s]
                                                      
{'loss': 0.3022, 'grad_norm': 0.5754417181015015, 'learning_rate': 9.725348422367785e-06, 'epoch': 0.59}

 20%|█▉        | 2159/11049 [22:14<1:30:55,  1.63it/s]
 20%|█▉        | 2160/11049 [22:15<1:30:56,  1.63it/s]
                                                      
{'loss': 0.3028, 'grad_norm': 0.6813286542892456, 'learning_rate': 9.7248318505741e-06, 'epoch': 0.59}

 20%|█▉        | 2160/11049 [22:15<1:30:56,  1.63it/s]
 20%|█▉        | 2161/11049 [22:15<1:30:57,  1.63it/s]
                                                      
{'loss': 0.2676, 'grad_norm': 0.525941789150238, 'learning_rate': 9.724314807191197e-06, 'epoch': 0.59}

 20%|█▉        | 2161/11049 [22:15<1:30:57,  1.63it/s]
 20%|█▉        | 2162/11049 [22:16<1:30:54,  1.63it/s]
                                                      
{'loss': 0.3231, 'grad_norm': 0.667365550994873, 'learning_rate': 9.723797292270682e-06, 'epoch': 0.59}

 20%|█▉        | 2162/11049 [22:16<1:30:54,  1.63it/s]
 20%|█▉        | 2163/11049 [22:17<1:30:52,  1.63it/s]
                                                      
{'loss': 0.2319, 'grad_norm': 0.4693349599838257, 'learning_rate': 9.723279305864209e-06, 'epoch': 0.59}

 20%|█▉        | 2163/11049 [22:17<1:30:52,  1.63it/s]
 20%|█▉        | 2164/11049 [22:17<1:30:50,  1.63it/s]
                                                      
{'loss': 0.2339, 'grad_norm': 0.5226710438728333, 'learning_rate': 9.722760848023476e-06, 'epoch': 0.59}

 20%|█▉        | 2164/11049 [22:17<1:30:50,  1.63it/s]
 20%|█▉        | 2165/11049 [22:18<1:30:52,  1.63it/s]
                                                      
{'loss': 0.3123, 'grad_norm': 0.641864001750946, 'learning_rate': 9.722241918800235e-06, 'epoch': 0.59}

 20%|█▉        | 2165/11049 [22:18<1:30:52,  1.63it/s]
 20%|█▉        | 2166/11049 [22:18<1:30:52,  1.63it/s]
                                                      
{'loss': 0.2887, 'grad_norm': 0.5925210118293762, 'learning_rate': 9.721722518246278e-06, 'epoch': 0.59}

 20%|█▉        | 2166/11049 [22:19<1:30:52,  1.63it/s]
 20%|█▉        | 2167/11049 [22:19<1:30:52,  1.63it/s]
                                                      
{'loss': 0.2558, 'grad_norm': 0.5346771478652954, 'learning_rate': 9.721202646413446e-06, 'epoch': 0.59}

 20%|█▉        | 2167/11049 [22:19<1:30:52,  1.63it/s]
 20%|█▉        | 2168/11049 [22:20<1:30:51,  1.63it/s]
                                                      
{'loss': 0.3339, 'grad_norm': 0.5892159938812256, 'learning_rate': 9.720682303353631e-06, 'epoch': 0.59}

 20%|█▉        | 2168/11049 [22:20<1:30:51,  1.63it/s]
 20%|█▉        | 2169/11049 [22:20<1:30:51,  1.63it/s]
                                                      
{'loss': 0.2586, 'grad_norm': 0.6645494103431702, 'learning_rate': 9.720161489118766e-06, 'epoch': 0.59}

 20%|█▉        | 2169/11049 [22:20<1:30:51,  1.63it/s]
 20%|█▉        | 2170/11049 [22:21<1:30:55,  1.63it/s]
                                                      
{'loss': 0.3268, 'grad_norm': 0.6188659071922302, 'learning_rate': 9.719640203760835e-06, 'epoch': 0.59}

 20%|█▉        | 2170/11049 [22:21<1:30:55,  1.63it/s]
 20%|█▉        | 2171/11049 [22:21<1:30:59,  1.63it/s]
                                                      
{'loss': 0.2733, 'grad_norm': 0.5860095024108887, 'learning_rate': 9.719118447331868e-06, 'epoch': 0.59}

 20%|█▉        | 2171/11049 [22:22<1:30:59,  1.63it/s]
 20%|█▉        | 2172/11049 [22:22<1:30:54,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.5689877271652222, 'learning_rate': 9.718596219883942e-06, 'epoch': 0.59}

 20%|█▉        | 2172/11049 [22:22<1:30:54,  1.63it/s]
 20%|█▉        | 2173/11049 [22:23<1:30:53,  1.63it/s]
                                                      
{'loss': 0.3714, 'grad_norm': 0.750767707824707, 'learning_rate': 9.71807352146918e-06, 'epoch': 0.59}

 20%|█▉        | 2173/11049 [22:23<1:30:53,  1.63it/s]
 20%|█▉        | 2174/11049 [22:23<1:30:50,  1.63it/s]
                                                      
{'loss': 0.2725, 'grad_norm': 0.5382604002952576, 'learning_rate': 9.717550352139755e-06, 'epoch': 0.59}

 20%|█▉        | 2174/11049 [22:23<1:30:50,  1.63it/s]
 20%|█▉        | 2175/11049 [22:24<1:30:52,  1.63it/s]
                                                      
{'loss': 0.3085, 'grad_norm': 0.6149936318397522, 'learning_rate': 9.717026711947882e-06, 'epoch': 0.59}

 20%|█▉        | 2175/11049 [22:24<1:30:52,  1.63it/s]
 20%|█▉        | 2176/11049 [22:25<1:30:54,  1.63it/s]
                                                      
{'loss': 0.2964, 'grad_norm': 0.6987959146499634, 'learning_rate': 9.716502600945827e-06, 'epoch': 0.59}

 20%|█▉        | 2176/11049 [22:25<1:30:54,  1.63it/s]
 20%|█▉        | 2177/11049 [22:25<1:30:49,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.563443660736084, 'learning_rate': 9.715978019185904e-06, 'epoch': 0.59}

 20%|█▉        | 2177/11049 [22:25<1:30:49,  1.63it/s]
 20%|█▉        | 2178/11049 [22:26<1:30:46,  1.63it/s]
                                                      
{'loss': 0.2654, 'grad_norm': 0.5186866521835327, 'learning_rate': 9.71545296672047e-06, 'epoch': 0.59}

 20%|█▉        | 2178/11049 [22:26<1:30:46,  1.63it/s]
 20%|█▉        | 2179/11049 [22:26<1:30:45,  1.63it/s]
                                                      
{'loss': 0.3234, 'grad_norm': 0.6070051193237305, 'learning_rate': 9.714927443601932e-06, 'epoch': 0.59}

 20%|█▉        | 2179/11049 [22:27<1:30:45,  1.63it/s]
 20%|█▉        | 2180/11049 [22:27<1:30:51,  1.63it/s]
                                                      
{'loss': 0.3048, 'grad_norm': 0.5829230546951294, 'learning_rate': 9.71440144988274e-06, 'epoch': 0.59}

 20%|█▉        | 2180/11049 [22:27<1:30:51,  1.63it/s]
 20%|█▉        | 2181/11049 [22:28<1:30:50,  1.63it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.5219849348068237, 'learning_rate': 9.713874985615397e-06, 'epoch': 0.59}

 20%|█▉        | 2181/11049 [22:28<1:30:50,  1.63it/s]
 20%|█▉        | 2182/11049 [22:28<1:30:43,  1.63it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.43835896253585815, 'learning_rate': 9.713348050852448e-06, 'epoch': 0.59}

 20%|█▉        | 2182/11049 [22:28<1:30:43,  1.63it/s]
 20%|█▉        | 2183/11049 [22:29<1:30:43,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.6509262323379517, 'learning_rate': 9.71282064564649e-06, 'epoch': 0.59}

 20%|█▉        | 2183/11049 [22:29<1:30:43,  1.63it/s]
 20%|█▉        | 2184/11049 [22:29<1:30:41,  1.63it/s]
                                                      
{'loss': 0.2449, 'grad_norm': 0.5097959637641907, 'learning_rate': 9.71229277005016e-06, 'epoch': 0.59}

 20%|█▉        | 2184/11049 [22:30<1:30:41,  1.63it/s]
 20%|█▉        | 2185/11049 [22:30<1:30:41,  1.63it/s]
                                                      
{'loss': 0.2603, 'grad_norm': 0.5621273517608643, 'learning_rate': 9.711764424116146e-06, 'epoch': 0.59}

 20%|█▉        | 2185/11049 [22:30<1:30:41,  1.63it/s]
 20%|█▉        | 2186/11049 [22:31<1:30:44,  1.63it/s]
                                                      
{'loss': 0.3028, 'grad_norm': 0.651615560054779, 'learning_rate': 9.711235607897184e-06, 'epoch': 0.59}

 20%|█▉        | 2186/11049 [22:31<1:30:44,  1.63it/s]
 20%|█▉        | 2187/11049 [22:31<1:30:40,  1.63it/s]
                                                      
{'loss': 0.3451, 'grad_norm': 0.6147239804267883, 'learning_rate': 9.710706321446056e-06, 'epoch': 0.59}

 20%|█▉        | 2187/11049 [22:31<1:30:40,  1.63it/s]
 20%|█▉        | 2188/11049 [22:32<1:30:37,  1.63it/s]
                                                      
{'loss': 0.293, 'grad_norm': 0.5630298256874084, 'learning_rate': 9.71017656481559e-06, 'epoch': 0.59}

 20%|█▉        | 2188/11049 [22:32<1:30:37,  1.63it/s]
 20%|█▉        | 2189/11049 [22:33<1:30:35,  1.63it/s]
                                                      
{'loss': 0.2764, 'grad_norm': 0.7001311182975769, 'learning_rate': 9.709646338058659e-06, 'epoch': 0.59}

 20%|█▉        | 2189/11049 [22:33<1:30:35,  1.63it/s]
 20%|█▉        | 2190/11049 [22:33<1:30:31,  1.63it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.7546600103378296, 'learning_rate': 9.70911564122819e-06, 'epoch': 0.59}

 20%|█▉        | 2190/11049 [22:33<1:30:31,  1.63it/s]
 20%|█▉        | 2191/11049 [22:34<1:30:36,  1.63it/s]
                                                      
{'loss': 0.3118, 'grad_norm': 0.5361689329147339, 'learning_rate': 9.708584474377148e-06, 'epoch': 0.59}

 20%|█▉        | 2191/11049 [22:34<1:30:36,  1.63it/s]
 20%|█▉        | 2192/11049 [22:34<1:30:34,  1.63it/s]
                                                      
{'loss': 0.2974, 'grad_norm': 0.5117419958114624, 'learning_rate': 9.70805283755855e-06, 'epoch': 0.6}

 20%|█▉        | 2192/11049 [22:34<1:30:34,  1.63it/s]
 20%|█▉        | 2193/11049 [22:35<1:30:33,  1.63it/s]
                                                      
{'loss': 0.2436, 'grad_norm': 0.5428343415260315, 'learning_rate': 9.707520730825461e-06, 'epoch': 0.6}

 20%|█▉        | 2193/11049 [22:35<1:30:33,  1.63it/s]
 20%|█▉        | 2194/11049 [22:36<1:30:32,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.5439193248748779, 'learning_rate': 9.706988154230992e-06, 'epoch': 0.6}

 20%|█▉        | 2194/11049 [22:36<1:30:32,  1.63it/s]
 20%|█▉        | 2195/11049 [22:36<1:30:30,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5460686683654785, 'learning_rate': 9.706455107828297e-06, 'epoch': 0.6}

 20%|█▉        | 2195/11049 [22:36<1:30:30,  1.63it/s]
 20%|█▉        | 2196/11049 [22:37<1:30:35,  1.63it/s]
                                                      
{'loss': 0.249, 'grad_norm': 0.49998536705970764, 'learning_rate': 9.70592159167058e-06, 'epoch': 0.6}

 20%|█▉        | 2196/11049 [22:37<1:30:35,  1.63it/s]
 20%|█▉        | 2197/11049 [22:37<1:30:33,  1.63it/s]
                                                      
{'loss': 0.3078, 'grad_norm': 0.6629904508590698, 'learning_rate': 9.705387605811093e-06, 'epoch': 0.6}

 20%|█▉        | 2197/11049 [22:38<1:30:33,  1.63it/s]
 20%|█▉        | 2198/11049 [22:38<1:30:31,  1.63it/s]
                                                      
{'loss': 0.3608, 'grad_norm': 0.6779823303222656, 'learning_rate': 9.70485315030313e-06, 'epoch': 0.6}

 20%|█▉        | 2198/11049 [22:38<1:30:31,  1.63it/s]
 20%|█▉        | 2199/11049 [22:39<1:30:27,  1.63it/s]
                                                      
{'loss': 0.2961, 'grad_norm': 0.5881525278091431, 'learning_rate': 9.704318225200042e-06, 'epoch': 0.6}

 20%|█▉        | 2199/11049 [22:39<1:30:27,  1.63it/s]
 20%|█▉        | 2200/11049 [22:39<1:30:26,  1.63it/s]
                                                      
{'loss': 0.2378, 'grad_norm': 0.5585101246833801, 'learning_rate': 9.703782830555215e-06, 'epoch': 0.6}

 20%|█▉        | 2200/11049 [22:39<1:30:26,  1.63it/s]
 20%|█▉        | 2201/11049 [22:40<1:30:32,  1.63it/s]
                                                      
{'loss': 0.4184, 'grad_norm': 0.7193536758422852, 'learning_rate': 9.703246966422088e-06, 'epoch': 0.6}

 20%|█▉        | 2201/11049 [22:40<1:30:32,  1.63it/s]
 20%|█▉        | 2202/11049 [22:41<1:30:29,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5134297013282776, 'learning_rate': 9.702710632854148e-06, 'epoch': 0.6}

 20%|█▉        | 2202/11049 [22:41<1:30:29,  1.63it/s]
 20%|█▉        | 2203/11049 [22:41<1:30:25,  1.63it/s]
                                                      
{'loss': 0.2416, 'grad_norm': 0.5365129709243774, 'learning_rate': 9.702173829904926e-06, 'epoch': 0.6}

 20%|█▉        | 2203/11049 [22:41<1:30:25,  1.63it/s]
 20%|█▉        | 2204/11049 [22:42<1:30:25,  1.63it/s]
                                                      
{'loss': 0.2518, 'grad_norm': 0.5576088428497314, 'learning_rate': 9.701636557628e-06, 'epoch': 0.6}

 20%|█▉        | 2204/11049 [22:42<1:30:25,  1.63it/s]
 20%|█▉        | 2205/11049 [22:42<1:30:24,  1.63it/s]
                                                      
{'loss': 0.2459, 'grad_norm': 0.5696545243263245, 'learning_rate': 9.701098816076995e-06, 'epoch': 0.6}

 20%|█▉        | 2205/11049 [22:42<1:30:24,  1.63it/s]
 20%|█▉        | 2206/11049 [22:43<1:30:29,  1.63it/s]
                                                      
{'loss': 0.2683, 'grad_norm': 0.628240704536438, 'learning_rate': 9.700560605305588e-06, 'epoch': 0.6}

 20%|█▉        | 2206/11049 [22:43<1:30:29,  1.63it/s]
 20%|█▉        | 2207/11049 [22:44<1:30:26,  1.63it/s]
                                                      
{'loss': 0.2854, 'grad_norm': 0.5962196588516235, 'learning_rate': 9.70002192536749e-06, 'epoch': 0.6}

 20%|█▉        | 2207/11049 [22:44<1:30:26,  1.63it/s]
 20%|█▉        | 2208/11049 [22:44<1:30:26,  1.63it/s]
                                                      
{'loss': 0.3202, 'grad_norm': 0.6397320628166199, 'learning_rate': 9.699482776316474e-06, 'epoch': 0.6}

 20%|█▉        | 2208/11049 [22:44<1:30:26,  1.63it/s]
 20%|█▉        | 2209/11049 [22:45<1:30:24,  1.63it/s]
                                                      
{'loss': 0.2975, 'grad_norm': 0.5129902958869934, 'learning_rate': 9.698943158206351e-06, 'epoch': 0.6}

 20%|█▉        | 2209/11049 [22:45<1:30:24,  1.63it/s]
 20%|██        | 2210/11049 [22:45<1:30:24,  1.63it/s]
                                                      
{'loss': 0.348, 'grad_norm': 0.5676394104957581, 'learning_rate': 9.69840307109098e-06, 'epoch': 0.6}

 20%|██        | 2210/11049 [22:46<1:30:24,  1.63it/s]
 20%|██        | 2211/11049 [22:46<1:30:26,  1.63it/s]
                                                      
{'loss': 0.2615, 'grad_norm': 0.5357536673545837, 'learning_rate': 9.697862515024267e-06, 'epoch': 0.6}

 20%|██        | 2211/11049 [22:46<1:30:26,  1.63it/s]
 20%|██        | 2212/11049 [22:47<1:30:23,  1.63it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.5040655136108398, 'learning_rate': 9.697321490060168e-06, 'epoch': 0.6}

 20%|██        | 2212/11049 [22:47<1:30:23,  1.63it/s]
 20%|██        | 2213/11049 [22:47<1:30:24,  1.63it/s]
                                                      
{'loss': 0.416, 'grad_norm': 0.656522274017334, 'learning_rate': 9.69677999625268e-06, 'epoch': 0.6}

 20%|██        | 2213/11049 [22:47<1:30:24,  1.63it/s]
 20%|██        | 2214/11049 [22:48<1:30:22,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.5544276833534241, 'learning_rate': 9.69623803365585e-06, 'epoch': 0.6}

 20%|██        | 2214/11049 [22:48<1:30:22,  1.63it/s]
 20%|██        | 2215/11049 [22:48<1:30:22,  1.63it/s]
                                                      
{'loss': 0.3192, 'grad_norm': 0.5601474046707153, 'learning_rate': 9.695695602323776e-06, 'epoch': 0.6}

 20%|██        | 2215/11049 [22:49<1:30:22,  1.63it/s]
 20%|██        | 2216/11049 [22:49<1:30:28,  1.63it/s]
                                                      
{'loss': 0.32, 'grad_norm': 0.7336546182632446, 'learning_rate': 9.695152702310592e-06, 'epoch': 0.6}

 20%|██        | 2216/11049 [22:49<1:30:28,  1.63it/s]
 20%|██        | 2217/11049 [22:50<1:30:23,  1.63it/s]
                                                      
{'loss': 0.3589, 'grad_norm': 0.6957723498344421, 'learning_rate': 9.694609333670493e-06, 'epoch': 0.6}

 20%|██        | 2217/11049 [22:50<1:30:23,  1.63it/s]
 20%|██        | 2218/11049 [22:50<1:30:20,  1.63it/s]
                                                      
{'loss': 0.2617, 'grad_norm': 0.5433427691459656, 'learning_rate': 9.694065496457705e-06, 'epoch': 0.6}

 20%|██        | 2218/11049 [22:50<1:30:20,  1.63it/s]
 20%|██        | 2219/11049 [22:51<1:30:18,  1.63it/s]
                                                      
{'loss': 0.2031, 'grad_norm': 0.5264924764633179, 'learning_rate': 9.693521190726514e-06, 'epoch': 0.6}

 20%|██        | 2219/11049 [22:51<1:30:18,  1.63it/s]
 20%|██        | 2220/11049 [22:52<1:30:16,  1.63it/s]
                                                      
{'loss': 0.3638, 'grad_norm': 0.6179043650627136, 'learning_rate': 9.692976416531247e-06, 'epoch': 0.6}

 20%|██        | 2220/11049 [22:52<1:30:16,  1.63it/s]
 20%|██        | 2221/11049 [22:52<1:30:24,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.6426090002059937, 'learning_rate': 9.692431173926276e-06, 'epoch': 0.6}

 20%|██        | 2221/11049 [22:52<1:30:24,  1.63it/s]
 20%|██        | 2222/11049 [22:53<1:30:19,  1.63it/s]
                                                      
{'loss': 0.3042, 'grad_norm': 0.5938423275947571, 'learning_rate': 9.691885462966025e-06, 'epoch': 0.6}

 20%|██        | 2222/11049 [22:53<1:30:19,  1.63it/s]
 20%|██        | 2223/11049 [22:53<1:30:16,  1.63it/s]
                                                      
{'loss': 0.3388, 'grad_norm': 0.7514705061912537, 'learning_rate': 9.69133928370496e-06, 'epoch': 0.6}

 20%|██        | 2223/11049 [22:54<1:30:16,  1.63it/s]
 20%|██        | 2224/11049 [22:54<1:30:15,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.4798106253147125, 'learning_rate': 9.690792636197597e-06, 'epoch': 0.6}

 20%|██        | 2224/11049 [22:54<1:30:15,  1.63it/s]
 20%|██        | 2225/11049 [22:55<1:30:12,  1.63it/s]
                                                      
{'loss': 0.2503, 'grad_norm': 0.535616397857666, 'learning_rate': 9.690245520498496e-06, 'epoch': 0.6}

 20%|██        | 2225/11049 [22:55<1:30:12,  1.63it/s]
 20%|██        | 2226/11049 [22:55<1:30:17,  1.63it/s]
                                                      
{'loss': 0.3342, 'grad_norm': 0.7592098116874695, 'learning_rate': 9.689697936662264e-06, 'epoch': 0.6}

 20%|██        | 2226/11049 [22:55<1:30:17,  1.63it/s]
 20%|██        | 2227/11049 [22:56<1:30:12,  1.63it/s]
                                                      
{'loss': 0.3618, 'grad_norm': 0.6862987875938416, 'learning_rate': 9.689149884743558e-06, 'epoch': 0.6}

 20%|██        | 2227/11049 [22:56<1:30:12,  1.63it/s]
 20%|██        | 2228/11049 [22:56<1:30:10,  1.63it/s]
                                                      
{'loss': 0.2082, 'grad_norm': 0.496309757232666, 'learning_rate': 9.688601364797078e-06, 'epoch': 0.6}

 20%|██        | 2228/11049 [22:57<1:30:10,  1.63it/s]
 20%|██        | 2229/11049 [22:57<1:30:10,  1.63it/s]
                                                      
{'loss': 0.2538, 'grad_norm': 0.5546659231185913, 'learning_rate': 9.688052376877574e-06, 'epoch': 0.61}

 20%|██        | 2229/11049 [22:57<1:30:10,  1.63it/s]
 20%|██        | 2230/11049 [22:58<1:30:08,  1.63it/s]
                                                      
{'loss': 0.2512, 'grad_norm': 0.6006470322608948, 'learning_rate': 9.687502921039843e-06, 'epoch': 0.61}

 20%|██        | 2230/11049 [22:58<1:30:08,  1.63it/s]
 20%|██        | 2231/11049 [22:58<1:30:10,  1.63it/s]
                                                      
{'loss': 0.2967, 'grad_norm': 0.5796043276786804, 'learning_rate': 9.68695299733872e-06, 'epoch': 0.61}

 20%|██        | 2231/11049 [22:58<1:30:10,  1.63it/s]
 20%|██        | 2232/11049 [22:59<1:30:10,  1.63it/s]
                                                      
{'loss': 0.2895, 'grad_norm': 0.5684393048286438, 'learning_rate': 9.686402605829095e-06, 'epoch': 0.61}

 20%|██        | 2232/11049 [22:59<1:30:10,  1.63it/s]
 20%|██        | 2233/11049 [23:00<1:30:09,  1.63it/s]
                                                      
{'loss': 0.464, 'grad_norm': 0.649665892124176, 'learning_rate': 9.685851746565908e-06, 'epoch': 0.61}

 20%|██        | 2233/11049 [23:00<1:30:09,  1.63it/s]
 20%|██        | 2234/11049 [23:00<1:30:08,  1.63it/s]
                                                      
{'loss': 0.2545, 'grad_norm': 0.5947858095169067, 'learning_rate': 9.685300419604135e-06, 'epoch': 0.61}

 20%|██        | 2234/11049 [23:00<1:30:08,  1.63it/s]
 20%|██        | 2235/11049 [23:01<1:30:07,  1.63it/s]
                                                      
{'loss': 0.1908, 'grad_norm': 0.515942394733429, 'learning_rate': 9.68474862499881e-06, 'epoch': 0.61}

 20%|██        | 2235/11049 [23:01<1:30:07,  1.63it/s]
 20%|██        | 2236/11049 [23:01<1:30:09,  1.63it/s]
                                                      
{'loss': 0.331, 'grad_norm': 0.6468104124069214, 'learning_rate': 9.684196362805003e-06, 'epoch': 0.61}

 20%|██        | 2236/11049 [23:01<1:30:09,  1.63it/s]
 20%|██        | 2237/11049 [23:02<1:30:06,  1.63it/s]
                                                      
{'loss': 0.3294, 'grad_norm': 0.58549565076828, 'learning_rate': 9.683643633077837e-06, 'epoch': 0.61}

 20%|██        | 2237/11049 [23:02<1:30:06,  1.63it/s]
 20%|██        | 2238/11049 [23:03<1:30:05,  1.63it/s]
                                                      
{'loss': 0.2974, 'grad_norm': 0.6025272607803345, 'learning_rate': 9.683090435872484e-06, 'epoch': 0.61}

 20%|██        | 2238/11049 [23:03<1:30:05,  1.63it/s]
 20%|██        | 2239/11049 [23:03<1:30:02,  1.63it/s]
                                                      
{'loss': 0.336, 'grad_norm': 0.6672161817550659, 'learning_rate': 9.682536771244154e-06, 'epoch': 0.61}

 20%|██        | 2239/11049 [23:03<1:30:02,  1.63it/s]
 20%|██        | 2240/11049 [23:04<1:30:01,  1.63it/s]
                                                      
{'loss': 0.2852, 'grad_norm': 0.6135757565498352, 'learning_rate': 9.68198263924811e-06, 'epoch': 0.61}

 20%|██        | 2240/11049 [23:04<1:30:01,  1.63it/s]
 20%|██        | 2241/11049 [23:04<1:30:08,  1.63it/s]
                                                      
{'loss': 0.303, 'grad_norm': 0.575093686580658, 'learning_rate': 9.681428039939664e-06, 'epoch': 0.61}

 20%|██        | 2241/11049 [23:05<1:30:08,  1.63it/s]
 20%|██        | 2242/11049 [23:05<1:30:07,  1.63it/s]
                                                      
{'loss': 0.2605, 'grad_norm': 0.5531066060066223, 'learning_rate': 9.680872973374165e-06, 'epoch': 0.61}

 20%|██        | 2242/11049 [23:05<1:30:07,  1.63it/s]
 20%|██        | 2243/11049 [23:06<1:30:06,  1.63it/s]
                                                      
{'loss': 0.2378, 'grad_norm': 0.5396689772605896, 'learning_rate': 9.68031743960702e-06, 'epoch': 0.61}

 20%|██        | 2243/11049 [23:06<1:30:06,  1.63it/s]
 20%|██        | 2244/11049 [23:06<1:30:06,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.7026242613792419, 'learning_rate': 9.679761438693674e-06, 'epoch': 0.61}

 20%|██        | 2244/11049 [23:06<1:30:06,  1.63it/s]
 20%|██        | 2245/11049 [23:07<1:30:02,  1.63it/s]
                                                      
{'loss': 0.2852, 'grad_norm': 0.6213365197181702, 'learning_rate': 9.679204970689623e-06, 'epoch': 0.61}

 20%|██        | 2245/11049 [23:07<1:30:02,  1.63it/s]
 20%|██        | 2246/11049 [23:08<1:30:05,  1.63it/s]
                                                      
{'loss': 0.293, 'grad_norm': 0.5925499200820923, 'learning_rate': 9.678648035650411e-06, 'epoch': 0.61}

 20%|██        | 2246/11049 [23:08<1:30:05,  1.63it/s]
 20%|██        | 2247/11049 [23:08<1:30:03,  1.63it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.6017783284187317, 'learning_rate': 9.67809063363162e-06, 'epoch': 0.61}

 20%|██        | 2247/11049 [23:08<1:30:03,  1.63it/s]
 20%|██        | 2248/11049 [23:09<1:29:59,  1.63it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.49957209825515747, 'learning_rate': 9.677532764688891e-06, 'epoch': 0.61}

 20%|██        | 2248/11049 [23:09<1:29:59,  1.63it/s]
 20%|██        | 2249/11049 [23:09<1:29:58,  1.63it/s]
                                                      
{'loss': 0.3039, 'grad_norm': 0.6494121551513672, 'learning_rate': 9.6769744288779e-06, 'epoch': 0.61}

 20%|██        | 2249/11049 [23:09<1:29:58,  1.63it/s]
 20%|██        | 2250/11049 [23:10<1:29:58,  1.63it/s]
                                                      
{'loss': 0.2651, 'grad_norm': 0.6652117967605591, 'learning_rate': 9.676415626254381e-06, 'epoch': 0.61}

 20%|██        | 2250/11049 [23:10<1:29:58,  1.63it/s]
 20%|██        | 2251/11049 [23:11<1:30:23,  1.62it/s]
                                                      
{'loss': 0.2508, 'grad_norm': 0.7054686546325684, 'learning_rate': 9.675856356874103e-06, 'epoch': 0.61}

 20%|██        | 2251/11049 [23:11<1:30:23,  1.62it/s]
 20%|██        | 2252/11049 [23:11<1:30:14,  1.62it/s]
                                                      
{'loss': 0.2929, 'grad_norm': 0.542280912399292, 'learning_rate': 9.675296620792891e-06, 'epoch': 0.61}

 20%|██        | 2252/11049 [23:11<1:30:14,  1.62it/s]
 20%|██        | 2253/11049 [23:12<1:30:12,  1.63it/s]
                                                      
{'loss': 0.2795, 'grad_norm': 0.6415375471115112, 'learning_rate': 9.67473641806661e-06, 'epoch': 0.61}

 20%|██        | 2253/11049 [23:12<1:30:12,  1.63it/s]
 20%|██        | 2254/11049 [23:12<1:30:06,  1.63it/s]
                                                      
{'loss': 0.3009, 'grad_norm': 0.6272951364517212, 'learning_rate': 9.674175748751175e-06, 'epoch': 0.61}

 20%|██        | 2254/11049 [23:13<1:30:06,  1.63it/s]
 20%|██        | 2255/11049 [23:13<1:30:03,  1.63it/s]
                                                      
{'loss': 0.3079, 'grad_norm': 0.6276219487190247, 'learning_rate': 9.673614612902546e-06, 'epoch': 0.61}

 20%|██        | 2255/11049 [23:13<1:30:03,  1.63it/s]
 20%|██        | 2256/11049 [23:14<1:30:10,  1.63it/s]
                                                      
{'loss': 0.2589, 'grad_norm': 0.5892317891120911, 'learning_rate': 9.673053010576735e-06, 'epoch': 0.61}

 20%|██        | 2256/11049 [23:14<1:30:10,  1.63it/s]
 20%|██        | 2257/11049 [23:14<1:30:03,  1.63it/s]
                                                      
{'loss': 0.3084, 'grad_norm': 0.6403157114982605, 'learning_rate': 9.67249094182979e-06, 'epoch': 0.61}

 20%|██        | 2257/11049 [23:14<1:30:03,  1.63it/s]
 20%|██        | 2258/11049 [23:15<1:30:00,  1.63it/s]
                                                      
{'loss': 0.3756, 'grad_norm': 0.7319343090057373, 'learning_rate': 9.671928406717814e-06, 'epoch': 0.61}

 20%|██        | 2258/11049 [23:15<1:30:00,  1.63it/s]
 20%|██        | 2259/11049 [23:15<1:29:58,  1.63it/s]
                                                      
{'loss': 0.2806, 'grad_norm': 0.5330306887626648, 'learning_rate': 9.671365405296955e-06, 'epoch': 0.61}

 20%|██        | 2259/11049 [23:16<1:29:58,  1.63it/s]
 20%|██        | 2260/11049 [23:16<1:29:55,  1.63it/s]
                                                      
{'loss': 0.324, 'grad_norm': 0.5388743281364441, 'learning_rate': 9.670801937623406e-06, 'epoch': 0.61}

 20%|██        | 2260/11049 [23:16<1:29:55,  1.63it/s]
 20%|██        | 2261/11049 [23:17<1:29:53,  1.63it/s]
                                                      
{'loss': 0.3101, 'grad_norm': 0.6537421941757202, 'learning_rate': 9.670238003753406e-06, 'epoch': 0.61}

 20%|██        | 2261/11049 [23:17<1:29:53,  1.63it/s]
 20%|██        | 2262/11049 [23:17<1:29:49,  1.63it/s]
                                                      
{'loss': 0.3094, 'grad_norm': 0.558842658996582, 'learning_rate': 9.669673603743243e-06, 'epoch': 0.61}

 20%|██        | 2262/11049 [23:17<1:29:49,  1.63it/s]
 20%|██        | 2263/11049 [23:18<1:29:49,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5272549390792847, 'learning_rate': 9.66910873764925e-06, 'epoch': 0.61}

 20%|██        | 2263/11049 [23:18<1:29:49,  1.63it/s]
 20%|██        | 2264/11049 [23:19<1:29:48,  1.63it/s]
                                                      
{'loss': 0.3324, 'grad_norm': 0.6012958288192749, 'learning_rate': 9.668543405527806e-06, 'epoch': 0.61}

 20%|██        | 2264/11049 [23:19<1:29:48,  1.63it/s]
 20%|██        | 2265/11049 [23:19<1:29:48,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.5828189253807068, 'learning_rate': 9.667977607435338e-06, 'epoch': 0.61}

 20%|██        | 2265/11049 [23:19<1:29:48,  1.63it/s]
 21%|██        | 2266/11049 [23:20<1:29:49,  1.63it/s]
                                                      
{'loss': 0.2583, 'grad_norm': 0.5075154304504395, 'learning_rate': 9.66741134342832e-06, 'epoch': 0.62}

 21%|██        | 2266/11049 [23:20<1:29:49,  1.63it/s]
 21%|██        | 2267/11049 [23:20<1:29:46,  1.63it/s]
                                                      
{'loss': 0.2244, 'grad_norm': 0.5012292861938477, 'learning_rate': 9.666844613563266e-06, 'epoch': 0.62}

 21%|██        | 2267/11049 [23:21<1:29:46,  1.63it/s]
 21%|██        | 2268/11049 [23:21<1:29:45,  1.63it/s]
                                                      
{'loss': 0.2648, 'grad_norm': 0.6184185147285461, 'learning_rate': 9.666277417896749e-06, 'epoch': 0.62}

 21%|██        | 2268/11049 [23:21<1:29:45,  1.63it/s]
 21%|██        | 2269/11049 [23:22<1:29:45,  1.63it/s]
                                                      
{'loss': 0.2874, 'grad_norm': 0.6159976124763489, 'learning_rate': 9.665709756485377e-06, 'epoch': 0.62}

 21%|██        | 2269/11049 [23:22<1:29:45,  1.63it/s]
 21%|██        | 2270/11049 [23:22<1:29:44,  1.63it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.5994133949279785, 'learning_rate': 9.66514162938581e-06, 'epoch': 0.62}

 21%|██        | 2270/11049 [23:22<1:29:44,  1.63it/s]
 21%|██        | 2271/11049 [23:23<1:29:43,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.48820412158966064, 'learning_rate': 9.664573036654751e-06, 'epoch': 0.62}

 21%|██        | 2271/11049 [23:23<1:29:43,  1.63it/s]
 21%|██        | 2272/11049 [23:23<1:29:42,  1.63it/s]
                                                      
{'loss': 0.2286, 'grad_norm': 0.5140051245689392, 'learning_rate': 9.664003978348956e-06, 'epoch': 0.62}

 21%|██        | 2272/11049 [23:24<1:29:42,  1.63it/s]
 21%|██        | 2273/11049 [23:24<1:29:43,  1.63it/s]
                                                      
{'loss': 0.277, 'grad_norm': 0.6271641850471497, 'learning_rate': 9.663434454525218e-06, 'epoch': 0.62}

 21%|██        | 2273/11049 [23:24<1:29:43,  1.63it/s]
 21%|██        | 2274/11049 [23:25<1:29:41,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.6677600145339966, 'learning_rate': 9.662864465240385e-06, 'epoch': 0.62}

 21%|██        | 2274/11049 [23:25<1:29:41,  1.63it/s]
 21%|██        | 2275/11049 [23:25<1:29:39,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.5342722535133362, 'learning_rate': 9.662294010551348e-06, 'epoch': 0.62}

 21%|██        | 2275/11049 [23:25<1:29:39,  1.63it/s]
 21%|██        | 2276/11049 [23:26<1:29:38,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5740827918052673, 'learning_rate': 9.661723090515044e-06, 'epoch': 0.62}

 21%|██        | 2276/11049 [23:26<1:29:38,  1.63it/s]
 21%|██        | 2277/11049 [23:27<1:29:36,  1.63it/s]
                                                      
{'loss': 0.2891, 'grad_norm': 0.5935946106910706, 'learning_rate': 9.661151705188457e-06, 'epoch': 0.62}

 21%|██        | 2277/11049 [23:27<1:29:36,  1.63it/s]
 21%|██        | 2278/11049 [23:27<1:29:38,  1.63it/s]
                                                      
{'loss': 0.2895, 'grad_norm': 0.6815776824951172, 'learning_rate': 9.660579854628616e-06, 'epoch': 0.62}

 21%|██        | 2278/11049 [23:27<1:29:38,  1.63it/s]
 21%|██        | 2279/11049 [23:28<1:29:37,  1.63it/s]
                                                      
{'loss': 0.2707, 'grad_norm': 0.6409097909927368, 'learning_rate': 9.660007538892601e-06, 'epoch': 0.62}

 21%|██        | 2279/11049 [23:28<1:29:37,  1.63it/s]
 21%|██        | 2280/11049 [23:28<1:29:36,  1.63it/s]
                                                      
{'loss': 0.3114, 'grad_norm': 0.8263699412345886, 'learning_rate': 9.659434758037532e-06, 'epoch': 0.62}

 21%|██        | 2280/11049 [23:29<1:29:36,  1.63it/s]
 21%|██        | 2281/11049 [23:29<1:29:37,  1.63it/s]
                                                      
{'loss': 0.3093, 'grad_norm': 0.7527516484260559, 'learning_rate': 9.65886151212058e-06, 'epoch': 0.62}

 21%|██        | 2281/11049 [23:29<1:29:37,  1.63it/s]
 21%|██        | 2282/11049 [23:30<1:29:36,  1.63it/s]
                                                      
{'loss': 0.1835, 'grad_norm': 0.4577953517436981, 'learning_rate': 9.658287801198963e-06, 'epoch': 0.62}

 21%|██        | 2282/11049 [23:30<1:29:36,  1.63it/s]
 21%|██        | 2283/11049 [23:30<1:29:35,  1.63it/s]
                                                      
{'loss': 0.2541, 'grad_norm': 0.5593307018280029, 'learning_rate': 9.65771362532994e-06, 'epoch': 0.62}

 21%|██        | 2283/11049 [23:30<1:29:35,  1.63it/s]
 21%|██        | 2284/11049 [23:31<1:29:35,  1.63it/s]
                                                      
{'loss': 0.3158, 'grad_norm': 0.6202521920204163, 'learning_rate': 9.657138984570822e-06, 'epoch': 0.62}

 21%|██        | 2284/11049 [23:31<1:29:35,  1.63it/s]
 21%|██        | 2285/11049 [23:31<1:29:34,  1.63it/s]
                                                      
{'loss': 0.2563, 'grad_norm': 0.5032945275306702, 'learning_rate': 9.656563878978965e-06, 'epoch': 0.62}

 21%|██        | 2285/11049 [23:32<1:29:34,  1.63it/s]
 21%|██        | 2286/11049 [23:32<1:29:34,  1.63it/s]
                                                      
{'loss': 0.2897, 'grad_norm': 0.5955601334571838, 'learning_rate': 9.65598830861177e-06, 'epoch': 0.62}

 21%|██        | 2286/11049 [23:32<1:29:34,  1.63it/s]
 21%|██        | 2287/11049 [23:33<1:29:32,  1.63it/s]
                                                      
{'loss': 0.3697, 'grad_norm': 0.7123147249221802, 'learning_rate': 9.655412273526683e-06, 'epoch': 0.62}

 21%|██        | 2287/11049 [23:33<1:29:32,  1.63it/s]
 21%|██        | 2288/11049 [23:33<1:29:34,  1.63it/s]
                                                      
{'loss': 0.3298, 'grad_norm': 0.7465333342552185, 'learning_rate': 9.654835773781203e-06, 'epoch': 0.62}

 21%|██        | 2288/11049 [23:33<1:29:34,  1.63it/s]
 21%|██        | 2289/11049 [23:34<1:29:33,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.412651002407074, 'learning_rate': 9.654258809432865e-06, 'epoch': 0.62}

 21%|██        | 2289/11049 [23:34<1:29:33,  1.63it/s]
 21%|██        | 2290/11049 [23:35<1:29:33,  1.63it/s]
                                                      
{'loss': 0.2439, 'grad_norm': 0.49236878752708435, 'learning_rate': 9.653681380539264e-06, 'epoch': 0.62}

 21%|██        | 2290/11049 [23:35<1:29:33,  1.63it/s]
 21%|██        | 2291/11049 [23:35<1:29:34,  1.63it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.6094865798950195, 'learning_rate': 9.653103487158027e-06, 'epoch': 0.62}

 21%|██        | 2291/11049 [23:35<1:29:34,  1.63it/s]
 21%|██        | 2292/11049 [23:36<1:29:32,  1.63it/s]
                                                      
{'loss': 0.2415, 'grad_norm': 0.5422071218490601, 'learning_rate': 9.652525129346837e-06, 'epoch': 0.62}

 21%|██        | 2292/11049 [23:36<1:29:32,  1.63it/s]
 21%|██        | 2293/11049 [23:36<1:29:30,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.5416584610939026, 'learning_rate': 9.651946307163417e-06, 'epoch': 0.62}

 21%|██        | 2293/11049 [23:36<1:29:30,  1.63it/s]
 21%|██        | 2294/11049 [23:37<1:29:28,  1.63it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.4684046804904938, 'learning_rate': 9.651367020665546e-06, 'epoch': 0.62}

 21%|██        | 2294/11049 [23:37<1:29:28,  1.63it/s]
 21%|██        | 2295/11049 [23:38<1:29:28,  1.63it/s]
                                                      
{'loss': 0.2633, 'grad_norm': 0.6994681358337402, 'learning_rate': 9.650787269911037e-06, 'epoch': 0.62}

 21%|██        | 2295/11049 [23:38<1:29:28,  1.63it/s]
 21%|██        | 2296/11049 [23:38<1:29:26,  1.63it/s]
                                                      
{'loss': 0.2699, 'grad_norm': 0.6058077216148376, 'learning_rate': 9.650207054957758e-06, 'epoch': 0.62}

 21%|██        | 2296/11049 [23:38<1:29:26,  1.63it/s]
 21%|██        | 2297/11049 [23:39<1:29:26,  1.63it/s]
                                                      
{'loss': 0.2594, 'grad_norm': 0.5163776278495789, 'learning_rate': 9.649626375863622e-06, 'epoch': 0.62}

 21%|██        | 2297/11049 [23:39<1:29:26,  1.63it/s]
 21%|██        | 2298/11049 [23:39<1:29:25,  1.63it/s]
                                                      
{'loss': 0.2755, 'grad_norm': 0.5941656827926636, 'learning_rate': 9.649045232686585e-06, 'epoch': 0.62}

 21%|██        | 2298/11049 [23:40<1:29:25,  1.63it/s]
 21%|██        | 2299/11049 [23:40<1:29:28,  1.63it/s]
                                                      
{'loss': 0.2943, 'grad_norm': 0.5755773782730103, 'learning_rate': 9.648463625484652e-06, 'epoch': 0.62}

 21%|██        | 2299/11049 [23:40<1:29:28,  1.63it/s]
 21%|██        | 2300/11049 [23:41<1:29:30,  1.63it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.6774481534957886, 'learning_rate': 9.647881554315873e-06, 'epoch': 0.62}

 21%|██        | 2300/11049 [23:41<1:29:30,  1.63it/s]
 21%|██        | 2301/11049 [23:41<1:29:28,  1.63it/s]
                                                      
{'loss': 0.2677, 'grad_norm': 0.7769915461540222, 'learning_rate': 9.647299019238345e-06, 'epoch': 0.62}

 21%|██        | 2301/11049 [23:41<1:29:28,  1.63it/s]
 21%|██        | 2302/11049 [23:42<1:29:28,  1.63it/s]
                                                      
{'loss': 0.2249, 'grad_norm': 0.5175143480300903, 'learning_rate': 9.646716020310214e-06, 'epoch': 0.63}

 21%|██        | 2302/11049 [23:42<1:29:28,  1.63it/s]
 21%|██        | 2303/11049 [23:42<1:29:24,  1.63it/s]
                                                      
{'loss': 0.2227, 'grad_norm': 0.47451168298721313, 'learning_rate': 9.646132557589666e-06, 'epoch': 0.63}

 21%|██        | 2303/11049 [23:43<1:29:24,  1.63it/s]
 21%|██        | 2304/11049 [23:43<1:29:24,  1.63it/s]
                                                      
{'loss': 0.3825, 'grad_norm': 0.7808190584182739, 'learning_rate': 9.645548631134938e-06, 'epoch': 0.63}

 21%|██        | 2304/11049 [23:43<1:29:24,  1.63it/s]
 21%|██        | 2305/11049 [23:44<1:29:23,  1.63it/s]
                                                      
{'loss': 0.2221, 'grad_norm': 0.48462188243865967, 'learning_rate': 9.644964241004312e-06, 'epoch': 0.63}

 21%|██        | 2305/11049 [23:44<1:29:23,  1.63it/s]
 21%|██        | 2306/11049 [23:44<1:29:23,  1.63it/s]
                                                      
{'loss': 0.2985, 'grad_norm': 0.6312326192855835, 'learning_rate': 9.64437938725612e-06, 'epoch': 0.63}

 21%|██        | 2306/11049 [23:44<1:29:23,  1.63it/s]
 21%|██        | 2307/11049 [23:45<1:29:24,  1.63it/s]
                                                      
{'loss': 0.2528, 'grad_norm': 0.5960411429405212, 'learning_rate': 9.64379406994873e-06, 'epoch': 0.63}

 21%|██        | 2307/11049 [23:45<1:29:24,  1.63it/s]
 21%|██        | 2308/11049 [23:46<1:29:21,  1.63it/s]
                                                      
{'loss': 0.2604, 'grad_norm': 0.649162769317627, 'learning_rate': 9.64320828914057e-06, 'epoch': 0.63}

 21%|██        | 2308/11049 [23:46<1:29:21,  1.63it/s]
 21%|██        | 2309/11049 [23:46<1:29:19,  1.63it/s]
                                                      
{'loss': 0.3197, 'grad_norm': 0.6470916271209717, 'learning_rate': 9.6426220448901e-06, 'epoch': 0.63}

 21%|██        | 2309/11049 [23:46<1:29:19,  1.63it/s]
 21%|██        | 2310/11049 [23:47<1:29:17,  1.63it/s]
                                                      
{'loss': 0.2248, 'grad_norm': 0.5230401754379272, 'learning_rate': 9.64203533725584e-06, 'epoch': 0.63}

 21%|██        | 2310/11049 [23:47<1:29:17,  1.63it/s]
 21%|██        | 2311/11049 [23:47<1:29:17,  1.63it/s]
                                                      
{'loss': 0.3073, 'grad_norm': 0.7090346217155457, 'learning_rate': 9.641448166296347e-06, 'epoch': 0.63}

 21%|██        | 2311/11049 [23:48<1:29:17,  1.63it/s]
 21%|██        | 2312/11049 [23:48<1:29:18,  1.63it/s]
                                                      
{'loss': 0.3607, 'grad_norm': 0.5951462388038635, 'learning_rate': 9.640860532070226e-06, 'epoch': 0.63}

 21%|██        | 2312/11049 [23:48<1:29:18,  1.63it/s]
 21%|██        | 2313/11049 [23:49<1:29:19,  1.63it/s]
                                                      
{'loss': 0.1929, 'grad_norm': 0.4693019986152649, 'learning_rate': 9.64027243463613e-06, 'epoch': 0.63}

 21%|██        | 2313/11049 [23:49<1:29:19,  1.63it/s]
 21%|██        | 2314/11049 [23:49<1:29:18,  1.63it/s]
                                                      
{'loss': 0.2841, 'grad_norm': 0.5707708597183228, 'learning_rate': 9.639683874052762e-06, 'epoch': 0.63}

 21%|██        | 2314/11049 [23:49<1:29:18,  1.63it/s]
 21%|██        | 2315/11049 [23:50<1:29:18,  1.63it/s]
                                                      
{'loss': 0.3545, 'grad_norm': 0.6157075762748718, 'learning_rate': 9.639094850378859e-06, 'epoch': 0.63}

 21%|██        | 2315/11049 [23:50<1:29:18,  1.63it/s]
 21%|██        | 2316/11049 [23:50<1:29:16,  1.63it/s]
                                                      
{'loss': 0.269, 'grad_norm': 0.5573626756668091, 'learning_rate': 9.638505363673214e-06, 'epoch': 0.63}

 21%|██        | 2316/11049 [23:51<1:29:16,  1.63it/s]
 21%|██        | 2317/11049 [23:51<1:29:15,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.4911656677722931, 'learning_rate': 9.637915413994667e-06, 'epoch': 0.63}

 21%|██        | 2317/11049 [23:51<1:29:15,  1.63it/s]
 21%|██        | 2318/11049 [23:52<1:29:20,  1.63it/s]
                                                      
{'loss': 0.267, 'grad_norm': 0.5425498485565186, 'learning_rate': 9.637325001402102e-06, 'epoch': 0.63}

 21%|██        | 2318/11049 [23:52<1:29:20,  1.63it/s]
 21%|██        | 2319/11049 [23:52<1:29:17,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.550586462020874, 'learning_rate': 9.636734125954445e-06, 'epoch': 0.63}

 21%|██        | 2319/11049 [23:52<1:29:17,  1.63it/s]
 21%|██        | 2320/11049 [23:53<1:29:16,  1.63it/s]
                                                      
{'loss': 0.2924, 'grad_norm': 0.5764349102973938, 'learning_rate': 9.636142787710672e-06, 'epoch': 0.63}

 21%|██        | 2320/11049 [23:53<1:29:16,  1.63it/s]
 21%|██        | 2321/11049 [23:54<1:29:15,  1.63it/s]
                                                      
{'loss': 0.196, 'grad_norm': 0.4769647419452667, 'learning_rate': 9.635550986729808e-06, 'epoch': 0.63}

 21%|██        | 2321/11049 [23:54<1:29:15,  1.63it/s]
 21%|██        | 2322/11049 [23:54<1:29:15,  1.63it/s]
                                                      
{'loss': 0.3203, 'grad_norm': 0.6067485809326172, 'learning_rate': 9.634958723070919e-06, 'epoch': 0.63}

 21%|██        | 2322/11049 [23:54<1:29:15,  1.63it/s]
 21%|██        | 2323/11049 [23:55<1:29:14,  1.63it/s]
                                                      
{'loss': 0.2267, 'grad_norm': 0.49608826637268066, 'learning_rate': 9.634365996793119e-06, 'epoch': 0.63}

 21%|██        | 2323/11049 [23:55<1:29:14,  1.63it/s]
 21%|██        | 2324/11049 [23:55<1:29:11,  1.63it/s]
                                                      
{'loss': 0.2798, 'grad_norm': 0.6023170948028564, 'learning_rate': 9.63377280795557e-06, 'epoch': 0.63}

 21%|██        | 2324/11049 [23:55<1:29:11,  1.63it/s]
 21%|██        | 2325/11049 [23:56<1:29:11,  1.63it/s]
                                                      
{'loss': 0.2836, 'grad_norm': 0.5328587889671326, 'learning_rate': 9.633179156617477e-06, 'epoch': 0.63}

 21%|██        | 2325/11049 [23:56<1:29:11,  1.63it/s]
 21%|██        | 2326/11049 [23:57<1:29:12,  1.63it/s]
                                                      
{'loss': 0.2145, 'grad_norm': 0.44959259033203125, 'learning_rate': 9.632585042838092e-06, 'epoch': 0.63}

 21%|██        | 2326/11049 [23:57<1:29:12,  1.63it/s]
 21%|██        | 2327/11049 [23:57<1:29:09,  1.63it/s]
                                                      
{'loss': 0.31, 'grad_norm': 0.6031931638717651, 'learning_rate': 9.631990466676719e-06, 'epoch': 0.63}

 21%|██        | 2327/11049 [23:57<1:29:09,  1.63it/s]
 21%|██        | 2328/11049 [23:58<1:29:07,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.5377616286277771, 'learning_rate': 9.631395428192697e-06, 'epoch': 0.63}

 21%|██        | 2328/11049 [23:58<1:29:07,  1.63it/s]
 21%|██        | 2329/11049 [23:58<1:29:05,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.4548923969268799, 'learning_rate': 9.63079992744542e-06, 'epoch': 0.63}

 21%|██        | 2329/11049 [23:59<1:29:05,  1.63it/s]
 21%|██        | 2330/11049 [23:59<1:29:06,  1.63it/s]
                                                      
{'loss': 0.3085, 'grad_norm': 0.5924432873725891, 'learning_rate': 9.630203964494326e-06, 'epoch': 0.63}

 21%|██        | 2330/11049 [23:59<1:29:06,  1.63it/s]
 21%|██        | 2331/11049 [24:00<1:29:08,  1.63it/s]
                                                      
{'loss': 0.2446, 'grad_norm': 0.5784637928009033, 'learning_rate': 9.629607539398898e-06, 'epoch': 0.63}

 21%|██        | 2331/11049 [24:00<1:29:08,  1.63it/s]
 21%|██        | 2332/11049 [24:00<1:29:07,  1.63it/s]
                                                      
{'loss': 0.198, 'grad_norm': 0.5158534646034241, 'learning_rate': 9.629010652218667e-06, 'epoch': 0.63}

 21%|██        | 2332/11049 [24:00<1:29:07,  1.63it/s]
 21%|██        | 2333/11049 [24:01<1:29:03,  1.63it/s]
                                                      
{'loss': 0.2878, 'grad_norm': 0.5905129909515381, 'learning_rate': 9.628413303013204e-06, 'epoch': 0.63}

 21%|██        | 2333/11049 [24:01<1:29:03,  1.63it/s]
 21%|██        | 2334/11049 [24:01<1:29:02,  1.63it/s]
                                                      
{'loss': 0.301, 'grad_norm': 0.5735122561454773, 'learning_rate': 9.627815491842136e-06, 'epoch': 0.63}

 21%|██        | 2334/11049 [24:02<1:29:02,  1.63it/s]
 21%|██        | 2335/11049 [24:02<1:29:00,  1.63it/s]
                                                      
{'loss': 0.3358, 'grad_norm': 0.6512662172317505, 'learning_rate': 9.62721721876513e-06, 'epoch': 0.63}

 21%|██        | 2335/11049 [24:02<1:29:00,  1.63it/s]
 21%|██        | 2336/11049 [24:03<1:29:01,  1.63it/s]
                                                      
{'loss': 0.2546, 'grad_norm': 0.574987530708313, 'learning_rate': 9.626618483841899e-06, 'epoch': 0.63}

 21%|██        | 2336/11049 [24:03<1:29:01,  1.63it/s]
 21%|██        | 2337/11049 [24:03<1:28:59,  1.63it/s]
                                                      
{'loss': 0.2475, 'grad_norm': 0.5643883347511292, 'learning_rate': 9.626019287132202e-06, 'epoch': 0.63}

 21%|██        | 2337/11049 [24:03<1:28:59,  1.63it/s]
 21%|██        | 2338/11049 [24:04<1:28:59,  1.63it/s]
                                                      
{'loss': 0.2861, 'grad_norm': 0.6086117625236511, 'learning_rate': 9.625419628695848e-06, 'epoch': 0.63}

 21%|██        | 2338/11049 [24:04<1:28:59,  1.63it/s]
 21%|██        | 2339/11049 [24:05<1:29:04,  1.63it/s]
                                                      
{'loss': 0.2672, 'grad_norm': 0.5621829032897949, 'learning_rate': 9.624819508592688e-06, 'epoch': 0.64}

 21%|██        | 2339/11049 [24:05<1:29:04,  1.63it/s]
 21%|██        | 2340/11049 [24:05<1:29:01,  1.63it/s]
                                                      
{'loss': 0.2674, 'grad_norm': 0.5022673606872559, 'learning_rate': 9.62421892688262e-06, 'epoch': 0.64}

 21%|██        | 2340/11049 [24:05<1:29:01,  1.63it/s]
 21%|██        | 2341/11049 [24:06<1:29:03,  1.63it/s]
                                                      
{'loss': 0.2823, 'grad_norm': 0.727357804775238, 'learning_rate': 9.62361788362559e-06, 'epoch': 0.64}

 21%|██        | 2341/11049 [24:06<1:29:03,  1.63it/s]
 21%|██        | 2342/11049 [24:06<1:29:02,  1.63it/s]
                                                      
{'loss': 0.2932, 'grad_norm': 0.6226075887680054, 'learning_rate': 9.62301637888159e-06, 'epoch': 0.64}

 21%|██        | 2342/11049 [24:07<1:29:02,  1.63it/s]
 21%|██        | 2343/11049 [24:07<1:29:05,  1.63it/s]
                                                      
{'loss': 0.2369, 'grad_norm': 0.5253632068634033, 'learning_rate': 9.62241441271065e-06, 'epoch': 0.64}

 21%|██        | 2343/11049 [24:07<1:29:05,  1.63it/s]
 21%|██        | 2344/11049 [24:08<1:29:04,  1.63it/s]
                                                      
{'loss': 0.2447, 'grad_norm': 0.5698783993721008, 'learning_rate': 9.62181198517286e-06, 'epoch': 0.64}

 21%|██        | 2344/11049 [24:08<1:29:04,  1.63it/s]
 21%|██        | 2345/11049 [24:08<1:29:05,  1.63it/s]
                                                      
{'loss': 0.2814, 'grad_norm': 0.6281987428665161, 'learning_rate': 9.621209096328344e-06, 'epoch': 0.64}

 21%|██        | 2345/11049 [24:08<1:29:05,  1.63it/s]
 21%|██        | 2346/11049 [24:09<1:29:04,  1.63it/s]
                                                      
{'loss': 0.2951, 'grad_norm': 0.6280980706214905, 'learning_rate': 9.620605746237281e-06, 'epoch': 0.64}

 21%|██        | 2346/11049 [24:09<1:29:04,  1.63it/s]
 21%|██        | 2347/11049 [24:09<1:28:59,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.5910056829452515, 'learning_rate': 9.620001934959889e-06, 'epoch': 0.64}

 21%|██        | 2347/11049 [24:10<1:28:59,  1.63it/s]
 21%|██▏       | 2348/11049 [24:10<1:29:00,  1.63it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.5277374982833862, 'learning_rate': 9.619397662556434e-06, 'epoch': 0.64}

 21%|██▏       | 2348/11049 [24:10<1:29:00,  1.63it/s]
 21%|██▏       | 2349/11049 [24:11<1:28:56,  1.63it/s]
                                                      
{'loss': 0.2236, 'grad_norm': 0.49897369742393494, 'learning_rate': 9.618792929087233e-06, 'epoch': 0.64}

 21%|██▏       | 2349/11049 [24:11<1:28:56,  1.63it/s]
 21%|██▏       | 2350/11049 [24:11<1:28:56,  1.63it/s]
                                                      
{'loss': 0.3229, 'grad_norm': 0.608961284160614, 'learning_rate': 9.61818773461264e-06, 'epoch': 0.64}

 21%|██▏       | 2350/11049 [24:11<1:28:56,  1.63it/s]
 21%|██▏       | 2351/11049 [24:12<1:28:55,  1.63it/s]
                                                      
{'loss': 0.2655, 'grad_norm': 0.5356122255325317, 'learning_rate': 9.617582079193064e-06, 'epoch': 0.64}

 21%|██▏       | 2351/11049 [24:12<1:28:55,  1.63it/s]
 21%|██▏       | 2352/11049 [24:13<1:28:53,  1.63it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.5832698345184326, 'learning_rate': 9.616975962888953e-06, 'epoch': 0.64}

 21%|██▏       | 2352/11049 [24:13<1:28:53,  1.63it/s]
 21%|██▏       | 2353/11049 [24:13<1:29:14,  1.62it/s]
                                                      
{'loss': 0.3266, 'grad_norm': 0.6221817135810852, 'learning_rate': 9.616369385760805e-06, 'epoch': 0.64}

 21%|██▏       | 2353/11049 [24:13<1:29:14,  1.62it/s]
 21%|██▏       | 2354/11049 [24:14<1:29:04,  1.63it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.5503019690513611, 'learning_rate': 9.615762347869164e-06, 'epoch': 0.64}

 21%|██▏       | 2354/11049 [24:14<1:29:04,  1.63it/s]
 21%|██▏       | 2355/11049 [24:14<1:29:00,  1.63it/s]
                                                      
{'loss': 0.271, 'grad_norm': 0.596629798412323, 'learning_rate': 9.615154849274618e-06, 'epoch': 0.64}

 21%|██▏       | 2355/11049 [24:15<1:29:00,  1.63it/s]
 21%|██▏       | 2356/11049 [24:15<1:28:57,  1.63it/s]
                                                      
{'loss': 0.2423, 'grad_norm': 0.5341591835021973, 'learning_rate': 9.614546890037801e-06, 'epoch': 0.64}

 21%|██▏       | 2356/11049 [24:15<1:28:57,  1.63it/s]
 21%|██▏       | 2357/11049 [24:16<1:28:53,  1.63it/s]
                                                      
{'loss': 0.3507, 'grad_norm': 0.6546252965927124, 'learning_rate': 9.613938470219397e-06, 'epoch': 0.64}

 21%|██▏       | 2357/11049 [24:16<1:28:53,  1.63it/s]
 21%|██▏       | 2358/11049 [24:16<1:28:53,  1.63it/s]
                                                      
{'loss': 0.3366, 'grad_norm': 0.6160022020339966, 'learning_rate': 9.613329589880129e-06, 'epoch': 0.64}

 21%|██▏       | 2358/11049 [24:16<1:28:53,  1.63it/s]
 21%|██▏       | 2359/11049 [24:17<1:28:53,  1.63it/s]
                                                      
{'loss': 0.261, 'grad_norm': 0.5496578812599182, 'learning_rate': 9.612720249080772e-06, 'epoch': 0.64}

 21%|██▏       | 2359/11049 [24:17<1:28:53,  1.63it/s]
 21%|██▏       | 2360/11049 [24:17<1:28:50,  1.63it/s]
                                                      
{'loss': 0.3036, 'grad_norm': 0.657244086265564, 'learning_rate': 9.612110447882145e-06, 'epoch': 0.64}

 21%|██▏       | 2360/11049 [24:18<1:28:50,  1.63it/s]
 21%|██▏       | 2361/11049 [24:18<1:28:56,  1.63it/s]
                                                      
{'loss': 0.2987, 'grad_norm': 0.5841543078422546, 'learning_rate': 9.611500186345112e-06, 'epoch': 0.64}

 21%|██▏       | 2361/11049 [24:18<1:28:56,  1.63it/s]
 21%|██▏       | 2362/11049 [24:19<1:31:23,  1.58it/s]
                                                      
{'loss': 0.3763, 'grad_norm': 0.6736221313476562, 'learning_rate': 9.610889464530583e-06, 'epoch': 0.64}

 21%|██▏       | 2362/11049 [24:19<1:31:23,  1.58it/s]
 21%|██▏       | 2363/11049 [24:19<1:30:33,  1.60it/s]
                                                      
{'loss': 0.316, 'grad_norm': 0.5919296741485596, 'learning_rate': 9.610278282499515e-06, 'epoch': 0.64}

 21%|██▏       | 2363/11049 [24:19<1:30:33,  1.60it/s]
 21%|██▏       | 2364/11049 [24:20<1:29:58,  1.61it/s]
                                                      
{'loss': 0.3397, 'grad_norm': 0.8276771306991577, 'learning_rate': 9.60966664031291e-06, 'epoch': 0.64}

 21%|██▏       | 2364/11049 [24:20<1:29:58,  1.61it/s]
 21%|██▏       | 2365/11049 [24:21<1:29:48,  1.61it/s]
                                                      
{'loss': 0.2427, 'grad_norm': 0.6039438843727112, 'learning_rate': 9.609054538031821e-06, 'epoch': 0.64}

 21%|██▏       | 2365/11049 [24:21<1:29:48,  1.61it/s]
 21%|██▏       | 2366/11049 [24:21<1:29:33,  1.62it/s]
                                                      
{'loss': 0.2908, 'grad_norm': 0.5838523507118225, 'learning_rate': 9.608441975717338e-06, 'epoch': 0.64}

 21%|██▏       | 2366/11049 [24:21<1:29:33,  1.62it/s]
 21%|██▏       | 2367/11049 [24:22<1:29:17,  1.62it/s]
                                                      
{'loss': 0.3221, 'grad_norm': 0.6603955626487732, 'learning_rate': 9.6078289534306e-06, 'epoch': 0.64}

 21%|██▏       | 2367/11049 [24:22<1:29:17,  1.62it/s]
 21%|██▏       | 2368/11049 [24:22<1:29:06,  1.62it/s]
                                                      
{'loss': 0.275, 'grad_norm': 0.6358420848846436, 'learning_rate': 9.607215471232799e-06, 'epoch': 0.64}

 21%|██▏       | 2368/11049 [24:23<1:29:06,  1.62it/s]
 21%|██▏       | 2369/11049 [24:23<1:29:01,  1.63it/s]
                                                      
{'loss': 0.3024, 'grad_norm': 0.563205897808075, 'learning_rate': 9.60660152918516e-06, 'epoch': 0.64}

 21%|██▏       | 2369/11049 [24:23<1:29:01,  1.63it/s]
 21%|██▏       | 2370/11049 [24:24<1:28:54,  1.63it/s]
                                                      
{'loss': 0.2207, 'grad_norm': 0.46617746353149414, 'learning_rate': 9.605987127348966e-06, 'epoch': 0.64}

 21%|██▏       | 2370/11049 [24:24<1:28:54,  1.63it/s]
 21%|██▏       | 2371/11049 [24:24<1:28:57,  1.63it/s]
                                                      
{'loss': 0.2812, 'grad_norm': 0.5936800241470337, 'learning_rate': 9.60537226578554e-06, 'epoch': 0.64}

 21%|██▏       | 2371/11049 [24:24<1:28:57,  1.63it/s]
 21%|██▏       | 2372/11049 [24:25<1:28:55,  1.63it/s]
                                                      
{'loss': 0.3073, 'grad_norm': 0.6624841690063477, 'learning_rate': 9.604756944556251e-06, 'epoch': 0.64}

 21%|██▏       | 2372/11049 [24:25<1:28:55,  1.63it/s]
 21%|██▏       | 2373/11049 [24:25<1:28:50,  1.63it/s]
                                                      
{'loss': 0.2471, 'grad_norm': 0.5291140675544739, 'learning_rate': 9.604141163722514e-06, 'epoch': 0.64}

 21%|██▏       | 2373/11049 [24:26<1:28:50,  1.63it/s]
 21%|██▏       | 2374/11049 [24:26<1:28:47,  1.63it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.45668351650238037, 'learning_rate': 9.603524923345794e-06, 'epoch': 0.64}

 21%|██▏       | 2374/11049 [24:26<1:28:47,  1.63it/s]
 21%|██▏       | 2375/11049 [24:27<1:28:44,  1.63it/s]
                                                      
{'loss': 0.2605, 'grad_norm': 0.5329582095146179, 'learning_rate': 9.602908223487594e-06, 'epoch': 0.64}

 21%|██▏       | 2375/11049 [24:27<1:28:44,  1.63it/s]
 22%|██▏       | 2376/11049 [24:27<1:28:46,  1.63it/s]
                                                      
{'loss': 0.3354, 'grad_norm': 0.6232019066810608, 'learning_rate': 9.602291064209471e-06, 'epoch': 0.65}

 22%|██▏       | 2376/11049 [24:27<1:28:46,  1.63it/s]
 22%|██▏       | 2377/11049 [24:28<1:28:44,  1.63it/s]
                                                      
{'loss': 0.3656, 'grad_norm': 0.7316388487815857, 'learning_rate': 9.601673445573021e-06, 'epoch': 0.65}

 22%|██▏       | 2377/11049 [24:28<1:28:44,  1.63it/s]
 22%|██▏       | 2378/11049 [24:29<1:28:42,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.47441548109054565, 'learning_rate': 9.601055367639893e-06, 'epoch': 0.65}

 22%|██▏       | 2378/11049 [24:29<1:28:42,  1.63it/s]
 22%|██▏       | 2379/11049 [24:29<1:28:39,  1.63it/s]
                                                      
{'loss': 0.2596, 'grad_norm': 0.5608177185058594, 'learning_rate': 9.600436830471773e-06, 'epoch': 0.65}

 22%|██▏       | 2379/11049 [24:29<1:28:39,  1.63it/s]
 22%|██▏       | 2380/11049 [24:30<1:28:39,  1.63it/s]
                                                      
{'loss': 0.44, 'grad_norm': 0.6711079478263855, 'learning_rate': 9.599817834130402e-06, 'epoch': 0.65}

 22%|██▏       | 2380/11049 [24:30<1:28:39,  1.63it/s]
 22%|██▏       | 2381/11049 [24:30<1:28:42,  1.63it/s]
                                                      
{'loss': 0.2409, 'grad_norm': 0.5002579689025879, 'learning_rate': 9.599198378677559e-06, 'epoch': 0.65}

 22%|██▏       | 2381/11049 [24:31<1:28:42,  1.63it/s]
 22%|██▏       | 2382/11049 [24:31<1:28:37,  1.63it/s]
                                                      
{'loss': 0.2422, 'grad_norm': 0.603879451751709, 'learning_rate': 9.598578464175075e-06, 'epoch': 0.65}

 22%|██▏       | 2382/11049 [24:31<1:28:37,  1.63it/s]
 22%|██▏       | 2383/11049 [24:32<1:28:37,  1.63it/s]
                                                      
{'loss': 0.2279, 'grad_norm': 0.5514699816703796, 'learning_rate': 9.597958090684823e-06, 'epoch': 0.65}

 22%|██▏       | 2383/11049 [24:32<1:28:37,  1.63it/s]
 22%|██▏       | 2384/11049 [24:32<1:28:36,  1.63it/s]
                                                      
{'loss': 0.2508, 'grad_norm': 0.48961347341537476, 'learning_rate': 9.597337258268724e-06, 'epoch': 0.65}

 22%|██▏       | 2384/11049 [24:32<1:28:36,  1.63it/s]
 22%|██▏       | 2385/11049 [24:33<1:28:35,  1.63it/s]
                                                      
{'loss': 0.2804, 'grad_norm': 0.6384524703025818, 'learning_rate': 9.59671596698874e-06, 'epoch': 0.65}

 22%|██▏       | 2385/11049 [24:33<1:28:35,  1.63it/s]
 22%|██▏       | 2386/11049 [24:33<1:29:01,  1.62it/s]
                                                      
{'loss': 0.2125, 'grad_norm': 0.5642703771591187, 'learning_rate': 9.596094216906889e-06, 'epoch': 0.65}

 22%|██▏       | 2386/11049 [24:34<1:29:01,  1.62it/s]
 22%|██▏       | 2387/11049 [24:34<1:28:57,  1.62it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.5899493098258972, 'learning_rate': 9.595472008085222e-06, 'epoch': 0.65}

 22%|██▏       | 2387/11049 [24:34<1:28:57,  1.62it/s]
 22%|██▏       | 2388/11049 [24:35<1:28:50,  1.62it/s]
                                                      
{'loss': 0.1898, 'grad_norm': 0.5084534287452698, 'learning_rate': 9.594849340585848e-06, 'epoch': 0.65}

 22%|██▏       | 2388/11049 [24:35<1:28:50,  1.62it/s]
 22%|██▏       | 2389/11049 [24:35<1:28:44,  1.63it/s]
                                                      
{'loss': 0.2696, 'grad_norm': 0.6586787700653076, 'learning_rate': 9.59422621447091e-06, 'epoch': 0.65}

 22%|██▏       | 2389/11049 [24:35<1:28:44,  1.63it/s]
 22%|██▏       | 2390/11049 [24:36<1:28:40,  1.63it/s]
                                                      
{'loss': 0.3059, 'grad_norm': 0.5398959517478943, 'learning_rate': 9.593602629802608e-06, 'epoch': 0.65}

 22%|██▏       | 2390/11049 [24:36<1:28:40,  1.63it/s]
 22%|██▏       | 2391/11049 [24:37<1:28:40,  1.63it/s]
                                                      
{'loss': 0.3669, 'grad_norm': 0.599181056022644, 'learning_rate': 9.592978586643179e-06, 'epoch': 0.65}

 22%|██▏       | 2391/11049 [24:37<1:28:40,  1.63it/s]
 22%|██▏       | 2392/11049 [24:37<1:28:33,  1.63it/s]
                                                      
{'loss': 0.3503, 'grad_norm': 0.6542630791664124, 'learning_rate': 9.592354085054909e-06, 'epoch': 0.65}

 22%|██▏       | 2392/11049 [24:37<1:28:33,  1.63it/s]
 22%|██▏       | 2393/11049 [24:38<1:28:32,  1.63it/s]
                                                      
{'loss': 0.3832, 'grad_norm': 0.6674483418464661, 'learning_rate': 9.591729125100133e-06, 'epoch': 0.65}

 22%|██▏       | 2393/11049 [24:38<1:28:32,  1.63it/s]
 22%|██▏       | 2394/11049 [24:38<1:28:30,  1.63it/s]
                                                      
{'loss': 0.2339, 'grad_norm': 0.5662682056427002, 'learning_rate': 9.591103706841227e-06, 'epoch': 0.65}

 22%|██▏       | 2394/11049 [24:39<1:28:30,  1.63it/s]
 22%|██▏       | 2395/11049 [24:39<1:28:28,  1.63it/s]
                                                      
{'loss': 0.337, 'grad_norm': 0.5908989310264587, 'learning_rate': 9.590477830340614e-06, 'epoch': 0.65}

 22%|██▏       | 2395/11049 [24:39<1:28:28,  1.63it/s]
 22%|██▏       | 2396/11049 [24:40<1:28:34,  1.63it/s]
                                                      
{'loss': 0.3627, 'grad_norm': 0.5974985957145691, 'learning_rate': 9.589851495660766e-06, 'epoch': 0.65}

 22%|██▏       | 2396/11049 [24:40<1:28:34,  1.63it/s]
 22%|██▏       | 2397/11049 [24:40<1:28:30,  1.63it/s]
                                                      
{'loss': 0.1963, 'grad_norm': 0.4765264391899109, 'learning_rate': 9.589224702864193e-06, 'epoch': 0.65}

 22%|██▏       | 2397/11049 [24:40<1:28:30,  1.63it/s]
 22%|██▏       | 2398/11049 [24:41<1:28:27,  1.63it/s]
                                                      
{'loss': 0.3432, 'grad_norm': 0.6566404104232788, 'learning_rate': 9.588597452013459e-06, 'epoch': 0.65}

 22%|██▏       | 2398/11049 [24:41<1:28:27,  1.63it/s]
 22%|██▏       | 2399/11049 [24:41<1:28:25,  1.63it/s]
                                                      
{'loss': 0.3243, 'grad_norm': 0.6025772094726562, 'learning_rate': 9.58796974317117e-06, 'epoch': 0.65}

 22%|██▏       | 2399/11049 [24:42<1:28:25,  1.63it/s]
 22%|██▏       | 2400/11049 [24:42<1:28:25,  1.63it/s]
                                                      
{'loss': 0.23, 'grad_norm': 0.5727792382240295, 'learning_rate': 9.587341576399979e-06, 'epoch': 0.65}

 22%|██▏       | 2400/11049 [24:42<1:28:25,  1.63it/s]
 22%|██▏       | 2401/11049 [24:43<1:28:24,  1.63it/s]
                                                      
{'loss': 0.3278, 'grad_norm': 0.5903873443603516, 'learning_rate': 9.586712951762583e-06, 'epoch': 0.65}

 22%|██▏       | 2401/11049 [24:43<1:28:24,  1.63it/s]
 22%|██▏       | 2402/11049 [24:43<1:28:24,  1.63it/s]
                                                      
{'loss': 0.2916, 'grad_norm': 0.5596587657928467, 'learning_rate': 9.586083869321723e-06, 'epoch': 0.65}

 22%|██▏       | 2402/11049 [24:43<1:28:24,  1.63it/s]
 22%|██▏       | 2403/11049 [24:44<1:28:23,  1.63it/s]
                                                      
{'loss': 0.2609, 'grad_norm': 0.5407522916793823, 'learning_rate': 9.585454329140194e-06, 'epoch': 0.65}

 22%|██▏       | 2403/11049 [24:44<1:28:23,  1.63it/s]
 22%|██▏       | 2404/11049 [24:45<1:28:22,  1.63it/s]
                                                      
{'loss': 0.3459, 'grad_norm': 0.7233973741531372, 'learning_rate': 9.584824331280824e-06, 'epoch': 0.65}

 22%|██▏       | 2404/11049 [24:45<1:28:22,  1.63it/s]
 22%|██▏       | 2405/11049 [24:45<1:28:21,  1.63it/s]
                                                      
{'loss': 0.2876, 'grad_norm': 0.5686474442481995, 'learning_rate': 9.584193875806499e-06, 'epoch': 0.65}

 22%|██▏       | 2405/11049 [24:45<1:28:21,  1.63it/s]
 22%|██▏       | 2406/11049 [24:46<1:28:19,  1.63it/s]
                                                      
{'loss': 0.3043, 'grad_norm': 0.5969923734664917, 'learning_rate': 9.583562962780144e-06, 'epoch': 0.65}

 22%|██▏       | 2406/11049 [24:46<1:28:19,  1.63it/s]
 22%|██▏       | 2407/11049 [24:46<1:28:18,  1.63it/s]
                                                      
{'loss': 0.3641, 'grad_norm': 0.6426588296890259, 'learning_rate': 9.582931592264728e-06, 'epoch': 0.65}

 22%|██▏       | 2407/11049 [24:46<1:28:18,  1.63it/s]
 22%|██▏       | 2408/11049 [24:47<1:28:18,  1.63it/s]
                                                      
{'loss': 0.2691, 'grad_norm': 0.5906108617782593, 'learning_rate': 9.582299764323274e-06, 'epoch': 0.65}

 22%|██▏       | 2408/11049 [24:47<1:28:18,  1.63it/s]
 22%|██▏       | 2409/11049 [24:48<1:28:17,  1.63it/s]
                                                      
{'loss': 0.2713, 'grad_norm': 0.5775486826896667, 'learning_rate': 9.58166747901884e-06, 'epoch': 0.65}

 22%|██▏       | 2409/11049 [24:48<1:28:17,  1.63it/s]
 22%|██▏       | 2410/11049 [24:48<1:28:16,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.5361554026603699, 'learning_rate': 9.581034736414535e-06, 'epoch': 0.65}

 22%|██▏       | 2410/11049 [24:48<1:28:16,  1.63it/s]
 22%|██▏       | 2411/11049 [24:49<1:28:15,  1.63it/s]
                                                      
{'loss': 0.3151, 'grad_norm': 0.6298462152481079, 'learning_rate': 9.580401536573519e-06, 'epoch': 0.65}

 22%|██▏       | 2411/11049 [24:49<1:28:15,  1.63it/s]
 22%|██▏       | 2412/11049 [24:49<1:28:15,  1.63it/s]
                                                      
{'loss': 0.235, 'grad_norm': 0.5447455048561096, 'learning_rate': 9.579767879558988e-06, 'epoch': 0.65}

 22%|██▏       | 2412/11049 [24:50<1:28:15,  1.63it/s]
 22%|██▏       | 2413/11049 [24:50<1:28:18,  1.63it/s]
                                                      
{'loss': 0.3227, 'grad_norm': 0.629856526851654, 'learning_rate': 9.579133765434187e-06, 'epoch': 0.66}

 22%|██▏       | 2413/11049 [24:50<1:28:18,  1.63it/s]
 22%|██▏       | 2414/11049 [24:51<1:28:16,  1.63it/s]
                                                      
{'loss': 0.2907, 'grad_norm': 0.6291707754135132, 'learning_rate': 9.578499194262411e-06, 'epoch': 0.66}

 22%|██▏       | 2414/11049 [24:51<1:28:16,  1.63it/s]
 22%|██▏       | 2415/11049 [24:51<1:28:14,  1.63it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.5108665227890015, 'learning_rate': 9.577864166106993e-06, 'epoch': 0.66}

 22%|██▏       | 2415/11049 [24:51<1:28:14,  1.63it/s]
 22%|██▏       | 2416/11049 [24:52<1:28:15,  1.63it/s]
                                                      
{'loss': 0.3319, 'grad_norm': 0.6000341773033142, 'learning_rate': 9.57722868103132e-06, 'epoch': 0.66}

 22%|██▏       | 2416/11049 [24:52<1:28:15,  1.63it/s]
 22%|██▏       | 2417/11049 [24:52<1:28:14,  1.63it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.6243166923522949, 'learning_rate': 9.576592739098816e-06, 'epoch': 0.66}

 22%|██▏       | 2417/11049 [24:53<1:28:14,  1.63it/s]
 22%|██▏       | 2418/11049 [24:53<1:28:13,  1.63it/s]
                                                      
{'loss': 0.1762, 'grad_norm': 0.41678836941719055, 'learning_rate': 9.575956340372959e-06, 'epoch': 0.66}

 22%|██▏       | 2418/11049 [24:53<1:28:13,  1.63it/s]
 22%|██▏       | 2419/11049 [24:54<1:28:13,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.5911445021629333, 'learning_rate': 9.575319484917263e-06, 'epoch': 0.66}

 22%|██▏       | 2419/11049 [24:54<1:28:13,  1.63it/s]
 22%|██▏       | 2420/11049 [24:54<1:28:11,  1.63it/s]
                                                      
{'loss': 0.2236, 'grad_norm': 0.4847022294998169, 'learning_rate': 9.574682172795298e-06, 'epoch': 0.66}

 22%|██▏       | 2420/11049 [24:54<1:28:11,  1.63it/s]
 22%|██▏       | 2421/11049 [24:55<1:28:13,  1.63it/s]
                                                      
{'loss': 0.2587, 'grad_norm': 0.5222340226173401, 'learning_rate': 9.574044404070673e-06, 'epoch': 0.66}

 22%|██▏       | 2421/11049 [24:55<1:28:13,  1.63it/s]
 22%|██▏       | 2422/11049 [24:56<1:28:12,  1.63it/s]
                                                      
{'loss': 0.3431, 'grad_norm': 0.651993989944458, 'learning_rate': 9.573406178807046e-06, 'epoch': 0.66}

 22%|██▏       | 2422/11049 [24:56<1:28:12,  1.63it/s]
 22%|██▏       | 2423/11049 [24:56<1:28:13,  1.63it/s]
                                                      
{'loss': 0.2903, 'grad_norm': 0.6074028611183167, 'learning_rate': 9.572767497068114e-06, 'epoch': 0.66}

 22%|██▏       | 2423/11049 [24:56<1:28:13,  1.63it/s]
 22%|██▏       | 2424/11049 [24:57<1:28:13,  1.63it/s]
                                                      
{'loss': 0.3728, 'grad_norm': 0.7621960639953613, 'learning_rate': 9.572128358917629e-06, 'epoch': 0.66}

 22%|██▏       | 2424/11049 [24:57<1:28:13,  1.63it/s]
 22%|██▏       | 2425/11049 [24:57<1:28:10,  1.63it/s]
                                                      
{'loss': 0.3022, 'grad_norm': 0.6308595538139343, 'learning_rate': 9.571488764419381e-06, 'epoch': 0.66}

 22%|██▏       | 2425/11049 [24:58<1:28:10,  1.63it/s]
 22%|██▏       | 2426/11049 [24:58<1:28:09,  1.63it/s]
                                                      
{'loss': 0.2775, 'grad_norm': 0.5479848384857178, 'learning_rate': 9.570848713637211e-06, 'epoch': 0.66}

 22%|██▏       | 2426/11049 [24:58<1:28:09,  1.63it/s]
 22%|██▏       | 2427/11049 [24:59<1:28:13,  1.63it/s]
                                                      
{'loss': 0.3139, 'grad_norm': 0.6562024354934692, 'learning_rate': 9.570208206635e-06, 'epoch': 0.66}

 22%|██▏       | 2427/11049 [24:59<1:28:13,  1.63it/s]
 22%|██▏       | 2428/11049 [24:59<1:28:11,  1.63it/s]
                                                      
{'loss': 0.3247, 'grad_norm': 0.5979442596435547, 'learning_rate': 9.56956724347668e-06, 'epoch': 0.66}

 22%|██▏       | 2428/11049 [24:59<1:28:11,  1.63it/s]
 22%|██▏       | 2429/11049 [25:00<1:28:12,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.6063075661659241, 'learning_rate': 9.568925824226225e-06, 'epoch': 0.66}

 22%|██▏       | 2429/11049 [25:00<1:28:12,  1.63it/s]
 22%|██▏       | 2430/11049 [25:00<1:28:11,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.5809165239334106, 'learning_rate': 9.568283948947655e-06, 'epoch': 0.66}

 22%|██▏       | 2430/11049 [25:01<1:28:11,  1.63it/s]
 22%|██▏       | 2431/11049 [25:01<1:28:10,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5229560136795044, 'learning_rate': 9.567641617705038e-06, 'epoch': 0.66}

 22%|██▏       | 2431/11049 [25:01<1:28:10,  1.63it/s]
 22%|██▏       | 2432/11049 [25:02<1:28:05,  1.63it/s]
                                                      
{'loss': 0.3241, 'grad_norm': 0.6656100153923035, 'learning_rate': 9.566998830562484e-06, 'epoch': 0.66}

 22%|██▏       | 2432/11049 [25:02<1:28:05,  1.63it/s]
 22%|██▏       | 2433/11049 [25:02<1:28:02,  1.63it/s]
                                                      
{'loss': 0.2897, 'grad_norm': 0.5705719590187073, 'learning_rate': 9.566355587584149e-06, 'epoch': 0.66}

 22%|██▏       | 2433/11049 [25:02<1:28:02,  1.63it/s]
 22%|██▏       | 2434/11049 [25:03<1:28:03,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.4511163830757141, 'learning_rate': 9.565711888834239e-06, 'epoch': 0.66}

 22%|██▏       | 2434/11049 [25:03<1:28:03,  1.63it/s]
 22%|██▏       | 2435/11049 [25:04<1:28:02,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.49386221170425415, 'learning_rate': 9.565067734377e-06, 'epoch': 0.66}

 22%|██▏       | 2435/11049 [25:04<1:28:02,  1.63it/s]
 22%|██▏       | 2436/11049 [25:04<1:28:00,  1.63it/s]
                                                      
{'loss': 0.2489, 'grad_norm': 0.6016321778297424, 'learning_rate': 9.564423124276726e-06, 'epoch': 0.66}

 22%|██▏       | 2436/11049 [25:04<1:28:00,  1.63it/s]
 22%|██▏       | 2437/11049 [25:05<1:28:00,  1.63it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.5642410516738892, 'learning_rate': 9.563778058597754e-06, 'epoch': 0.66}

 22%|██▏       | 2437/11049 [25:05<1:28:00,  1.63it/s]
 22%|██▏       | 2438/11049 [25:05<1:27:59,  1.63it/s]
                                                      
{'loss': 0.3275, 'grad_norm': 0.6598182320594788, 'learning_rate': 9.56313253740447e-06, 'epoch': 0.66}

 22%|██▏       | 2438/11049 [25:06<1:27:59,  1.63it/s]
 22%|██▏       | 2439/11049 [25:06<1:28:01,  1.63it/s]
                                                      
{'loss': 0.235, 'grad_norm': 0.5227651000022888, 'learning_rate': 9.562486560761305e-06, 'epoch': 0.66}

 22%|██▏       | 2439/11049 [25:06<1:28:01,  1.63it/s]
 22%|██▏       | 2440/11049 [25:07<1:27:59,  1.63it/s]
                                                      
{'loss': 0.3776, 'grad_norm': 0.6928455233573914, 'learning_rate': 9.561840128732735e-06, 'epoch': 0.66}

 22%|██▏       | 2440/11049 [25:07<1:27:59,  1.63it/s]
 22%|██▏       | 2441/11049 [25:07<1:27:59,  1.63it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.6122018694877625, 'learning_rate': 9.561193241383277e-06, 'epoch': 0.66}

 22%|██▏       | 2441/11049 [25:07<1:27:59,  1.63it/s]
 22%|██▏       | 2442/11049 [25:08<1:27:58,  1.63it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.6362351179122925, 'learning_rate': 9.560545898777503e-06, 'epoch': 0.66}

 22%|██▏       | 2442/11049 [25:08<1:27:58,  1.63it/s]
 22%|██▏       | 2443/11049 [25:08<1:27:58,  1.63it/s]
                                                      
{'loss': 0.388, 'grad_norm': 0.6469357013702393, 'learning_rate': 9.55989810098002e-06, 'epoch': 0.66}

 22%|██▏       | 2443/11049 [25:09<1:27:58,  1.63it/s]
 22%|██▏       | 2444/11049 [25:09<1:27:56,  1.63it/s]
                                                      
{'loss': 0.2859, 'grad_norm': 0.6031998991966248, 'learning_rate': 9.559249848055488e-06, 'epoch': 0.66}

 22%|██▏       | 2444/11049 [25:09<1:27:56,  1.63it/s]
 22%|██▏       | 2445/11049 [25:10<1:30:08,  1.59it/s]
                                                      
{'loss': 0.2598, 'grad_norm': 0.5885390043258667, 'learning_rate': 9.558601140068607e-06, 'epoch': 0.66}

 22%|██▏       | 2445/11049 [25:10<1:30:08,  1.59it/s]
 22%|██▏       | 2446/11049 [25:10<1:29:55,  1.59it/s]
                                                      
{'loss': 0.2577, 'grad_norm': 0.5915520787239075, 'learning_rate': 9.557951977084126e-06, 'epoch': 0.66}

 22%|██▏       | 2446/11049 [25:10<1:29:55,  1.59it/s]
 22%|██▏       | 2447/11049 [25:11<1:29:18,  1.61it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.5356975793838501, 'learning_rate': 9.55730235916684e-06, 'epoch': 0.66}

 22%|██▏       | 2447/11049 [25:11<1:29:18,  1.61it/s]
 22%|██▏       | 2448/11049 [25:12<1:28:55,  1.61it/s]
                                                      
{'loss': 0.2508, 'grad_norm': 0.5007649064064026, 'learning_rate': 9.556652286381589e-06, 'epoch': 0.66}

 22%|██▏       | 2448/11049 [25:12<1:28:55,  1.61it/s]
 22%|██▏       | 2449/11049 [25:12<1:28:37,  1.62it/s]
                                                      
{'loss': 0.2936, 'grad_norm': 0.5317387580871582, 'learning_rate': 9.556001758793252e-06, 'epoch': 0.66}

 22%|██▏       | 2449/11049 [25:12<1:28:37,  1.62it/s]
 22%|██▏       | 2450/11049 [25:13<1:28:31,  1.62it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.43525946140289307, 'learning_rate': 9.555350776466763e-06, 'epoch': 0.67}

 22%|██▏       | 2450/11049 [25:13<1:28:31,  1.62it/s]
 22%|██▏       | 2451/11049 [25:13<1:30:45,  1.58it/s]
                                                      
{'loss': 0.3046, 'grad_norm': 0.5468057990074158, 'learning_rate': 9.554699339467098e-06, 'epoch': 0.67}

 22%|██▏       | 2451/11049 [25:14<1:30:45,  1.58it/s]
 22%|██▏       | 2452/11049 [25:14<1:30:15,  1.59it/s]
                                                      
{'loss': 0.2171, 'grad_norm': 0.478914737701416, 'learning_rate': 9.554047447859274e-06, 'epoch': 0.67}

 22%|██▏       | 2452/11049 [25:14<1:30:15,  1.59it/s]
 22%|██▏       | 2453/11049 [25:15<1:29:31,  1.60it/s]
                                                      
{'loss': 0.2715, 'grad_norm': 0.4922686815261841, 'learning_rate': 9.553395101708357e-06, 'epoch': 0.67}

 22%|██▏       | 2453/11049 [25:15<1:29:31,  1.60it/s]
 22%|██▏       | 2454/11049 [25:15<1:29:05,  1.61it/s]
                                                      
{'loss': 0.2977, 'grad_norm': 0.6216723322868347, 'learning_rate': 9.552742301079461e-06, 'epoch': 0.67}

 22%|██▏       | 2454/11049 [25:15<1:29:05,  1.61it/s]
 22%|██▏       | 2455/11049 [25:16<1:28:48,  1.61it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.4865039587020874, 'learning_rate': 9.55208904603774e-06, 'epoch': 0.67}

 22%|██▏       | 2455/11049 [25:16<1:28:48,  1.61it/s]
 22%|██▏       | 2456/11049 [25:17<1:28:34,  1.62it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.5330410599708557, 'learning_rate': 9.551435336648399e-06, 'epoch': 0.67}

 22%|██▏       | 2456/11049 [25:17<1:28:34,  1.62it/s]
 22%|██▏       | 2457/11049 [25:17<1:28:21,  1.62it/s]
                                                      
{'loss': 0.2048, 'grad_norm': 0.4590412974357605, 'learning_rate': 9.550781172976679e-06, 'epoch': 0.67}

 22%|██▏       | 2457/11049 [25:17<1:28:21,  1.62it/s]
 22%|██▏       | 2458/11049 [25:18<1:28:11,  1.62it/s]
                                                      
{'loss': 0.2607, 'grad_norm': 0.7576463222503662, 'learning_rate': 9.55012655508788e-06, 'epoch': 0.67}

 22%|██▏       | 2458/11049 [25:18<1:28:11,  1.62it/s]
 22%|██▏       | 2459/11049 [25:18<1:28:03,  1.63it/s]
                                                      
{'loss': 0.2522, 'grad_norm': 0.5067490339279175, 'learning_rate': 9.549471483047336e-06, 'epoch': 0.67}

 22%|██▏       | 2459/11049 [25:19<1:28:03,  1.63it/s]
 22%|██▏       | 2460/11049 [25:19<1:27:59,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.5198780298233032, 'learning_rate': 9.548815956920429e-06, 'epoch': 0.67}

 22%|██▏       | 2460/11049 [25:19<1:27:59,  1.63it/s]
 22%|██▏       | 2461/11049 [25:20<1:27:58,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5694399476051331, 'learning_rate': 9.548159976772593e-06, 'epoch': 0.67}

 22%|██▏       | 2461/11049 [25:20<1:27:58,  1.63it/s]
 22%|██▏       | 2462/11049 [25:20<1:27:53,  1.63it/s]
                                                      
{'loss': 0.3396, 'grad_norm': 0.6660439968109131, 'learning_rate': 9.547503542669296e-06, 'epoch': 0.67}

 22%|██▏       | 2462/11049 [25:20<1:27:53,  1.63it/s]
 22%|██▏       | 2463/11049 [25:21<1:27:50,  1.63it/s]
                                                      
{'loss': 0.2074, 'grad_norm': 0.5009328126907349, 'learning_rate': 9.54684665467606e-06, 'epoch': 0.67}

 22%|██▏       | 2463/11049 [25:21<1:27:50,  1.63it/s]
 22%|██▏       | 2464/11049 [25:21<1:27:47,  1.63it/s]
                                                      
{'loss': 0.269, 'grad_norm': 0.5670030117034912, 'learning_rate': 9.54618931285845e-06, 'epoch': 0.67}

 22%|██▏       | 2464/11049 [25:22<1:27:47,  1.63it/s]
 22%|██▏       | 2465/11049 [25:22<1:27:46,  1.63it/s]
                                                      
{'loss': 0.293, 'grad_norm': 0.5674118995666504, 'learning_rate': 9.545531517282074e-06, 'epoch': 0.67}

 22%|██▏       | 2465/11049 [25:22<1:27:46,  1.63it/s]
 22%|██▏       | 2466/11049 [25:23<1:27:45,  1.63it/s]
                                                      
{'loss': 0.2751, 'grad_norm': 0.5803188681602478, 'learning_rate': 9.544873268012588e-06, 'epoch': 0.67}

 22%|██▏       | 2466/11049 [25:23<1:27:45,  1.63it/s]
 22%|██▏       | 2467/11049 [25:23<1:27:44,  1.63it/s]
                                                      
{'loss': 0.3612, 'grad_norm': 0.6029672622680664, 'learning_rate': 9.544214565115694e-06, 'epoch': 0.67}

 22%|██▏       | 2467/11049 [25:23<1:27:44,  1.63it/s]
 22%|██▏       | 2468/11049 [25:24<1:27:42,  1.63it/s]
                                                      
{'loss': 0.346, 'grad_norm': 0.6356789469718933, 'learning_rate': 9.543555408657135e-06, 'epoch': 0.67}

 22%|██▏       | 2468/11049 [25:24<1:27:42,  1.63it/s]
 22%|██▏       | 2469/11049 [25:25<1:27:45,  1.63it/s]
                                                      
{'loss': 0.2874, 'grad_norm': 0.6331201791763306, 'learning_rate': 9.542895798702702e-06, 'epoch': 0.67}

 22%|██▏       | 2469/11049 [25:25<1:27:45,  1.63it/s]
 22%|██▏       | 2470/11049 [25:25<1:27:43,  1.63it/s]
                                                      
{'loss': 0.2319, 'grad_norm': 0.580460250377655, 'learning_rate': 9.542235735318233e-06, 'epoch': 0.67}

 22%|██▏       | 2470/11049 [25:25<1:27:43,  1.63it/s]
 22%|██▏       | 2471/11049 [25:26<1:27:45,  1.63it/s]
                                                      
{'loss': 0.3673, 'grad_norm': 0.6704878211021423, 'learning_rate': 9.54157521856961e-06, 'epoch': 0.67}

 22%|██▏       | 2471/11049 [25:26<1:27:45,  1.63it/s]
 22%|██▏       | 2472/11049 [25:26<1:27:44,  1.63it/s]
                                                      
{'loss': 0.3343, 'grad_norm': 0.6635059118270874, 'learning_rate': 9.540914248522757e-06, 'epoch': 0.67}

 22%|██▏       | 2472/11049 [25:27<1:27:44,  1.63it/s]
 22%|██▏       | 2473/11049 [25:27<1:27:49,  1.63it/s]
                                                      
{'loss': 0.2826, 'grad_norm': 0.546964168548584, 'learning_rate': 9.540252825243646e-06, 'epoch': 0.67}

 22%|██▏       | 2473/11049 [25:27<1:27:49,  1.63it/s]
 22%|██▏       | 2474/11049 [25:28<1:27:48,  1.63it/s]
                                                      
{'loss': 0.274, 'grad_norm': 0.6842328310012817, 'learning_rate': 9.539590948798298e-06, 'epoch': 0.67}

 22%|██▏       | 2474/11049 [25:28<1:27:48,  1.63it/s]
 22%|██▏       | 2475/11049 [25:28<1:27:43,  1.63it/s]
                                                      
{'loss': 0.4232, 'grad_norm': 0.5960220098495483, 'learning_rate': 9.538928619252772e-06, 'epoch': 0.67}

 22%|██▏       | 2475/11049 [25:28<1:27:43,  1.63it/s]
 22%|██▏       | 2476/11049 [25:29<1:27:45,  1.63it/s]
                                                      
{'loss': 0.3046, 'grad_norm': 0.7108393907546997, 'learning_rate': 9.538265836673174e-06, 'epoch': 0.67}

 22%|██▏       | 2476/11049 [25:29<1:27:45,  1.63it/s]
 22%|██▏       | 2477/11049 [25:29<1:27:43,  1.63it/s]
                                                      
{'loss': 0.2094, 'grad_norm': 0.49665990471839905, 'learning_rate': 9.537602601125663e-06, 'epoch': 0.67}

 22%|██▏       | 2477/11049 [25:30<1:27:43,  1.63it/s]
 22%|██▏       | 2478/11049 [25:30<1:27:41,  1.63it/s]
                                                      
{'loss': 0.2592, 'grad_norm': 0.5029033422470093, 'learning_rate': 9.536938912676433e-06, 'epoch': 0.67}

 22%|██▏       | 2478/11049 [25:30<1:27:41,  1.63it/s]
 22%|██▏       | 2479/11049 [25:31<1:27:38,  1.63it/s]
                                                      
{'loss': 0.3793, 'grad_norm': 0.6712949275970459, 'learning_rate': 9.536274771391725e-06, 'epoch': 0.67}

 22%|██▏       | 2479/11049 [25:31<1:27:38,  1.63it/s]
 22%|██▏       | 2480/11049 [25:31<1:27:36,  1.63it/s]
                                                      
{'loss': 0.2838, 'grad_norm': 0.6400689482688904, 'learning_rate': 9.535610177337833e-06, 'epoch': 0.67}

 22%|██▏       | 2480/11049 [25:31<1:27:36,  1.63it/s]
 22%|██▏       | 2481/11049 [25:32<1:27:37,  1.63it/s]
                                                      
{'loss': 0.3218, 'grad_norm': 0.6341068744659424, 'learning_rate': 9.534945130581087e-06, 'epoch': 0.67}

 22%|██▏       | 2481/11049 [25:32<1:27:37,  1.63it/s]
 22%|██▏       | 2482/11049 [25:33<1:27:39,  1.63it/s]
                                                      
{'loss': 0.2522, 'grad_norm': 0.5463830828666687, 'learning_rate': 9.534279631187867e-06, 'epoch': 0.67}

 22%|██▏       | 2482/11049 [25:33<1:27:39,  1.63it/s]
 22%|██▏       | 2483/11049 [25:33<1:27:34,  1.63it/s]
                                                      
{'loss': 0.2933, 'grad_norm': 0.5760501623153687, 'learning_rate': 9.533613679224596e-06, 'epoch': 0.67}

 22%|██▏       | 2483/11049 [25:33<1:27:34,  1.63it/s]
 22%|██▏       | 2484/11049 [25:34<1:27:32,  1.63it/s]
                                                      
{'loss': 0.2857, 'grad_norm': 0.5896714329719543, 'learning_rate': 9.532947274757744e-06, 'epoch': 0.67}

 22%|██▏       | 2484/11049 [25:34<1:27:32,  1.63it/s]
 22%|██▏       | 2485/11049 [25:34<1:27:32,  1.63it/s]
                                                      
{'loss': 0.2727, 'grad_norm': 0.48028528690338135, 'learning_rate': 9.532280417853825e-06, 'epoch': 0.67}

 22%|██▏       | 2485/11049 [25:34<1:27:32,  1.63it/s]
 22%|██▏       | 2486/11049 [25:35<1:27:38,  1.63it/s]
                                                      
{'loss': 0.2316, 'grad_norm': 0.5042591094970703, 'learning_rate': 9.5316131085794e-06, 'epoch': 0.67}

 22%|██▏       | 2486/11049 [25:35<1:27:38,  1.63it/s]
 23%|██▎       | 2487/11049 [25:36<1:27:40,  1.63it/s]
                                                      
{'loss': 0.297, 'grad_norm': 0.6228830814361572, 'learning_rate': 9.53094534700107e-06, 'epoch': 0.68}

 23%|██▎       | 2487/11049 [25:36<1:27:40,  1.63it/s]
 23%|██▎       | 2488/11049 [25:36<1:27:38,  1.63it/s]
                                                      
{'loss': 0.2746, 'grad_norm': 0.5408570766448975, 'learning_rate': 9.53027713318549e-06, 'epoch': 0.68}

 23%|██▎       | 2488/11049 [25:36<1:27:38,  1.63it/s]
 23%|██▎       | 2489/11049 [25:37<1:27:34,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.6151800155639648, 'learning_rate': 9.529608467199351e-06, 'epoch': 0.68}

 23%|██▎       | 2489/11049 [25:37<1:27:34,  1.63it/s]
 23%|██▎       | 2490/11049 [25:37<1:27:31,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.5462012887001038, 'learning_rate': 9.528939349109394e-06, 'epoch': 0.68}

 23%|██▎       | 2490/11049 [25:38<1:27:31,  1.63it/s]
 23%|██▎       | 2491/11049 [25:38<1:27:37,  1.63it/s]
                                                      
{'loss': 0.2472, 'grad_norm': 0.5384848117828369, 'learning_rate': 9.528269778982407e-06, 'epoch': 0.68}

 23%|██▎       | 2491/11049 [25:38<1:27:37,  1.63it/s]
 23%|██▎       | 2492/11049 [25:39<1:27:33,  1.63it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.6836496591567993, 'learning_rate': 9.527599756885215e-06, 'epoch': 0.68}

 23%|██▎       | 2492/11049 [25:39<1:27:33,  1.63it/s]
 23%|██▎       | 2493/11049 [25:39<1:27:30,  1.63it/s]
                                                      
{'loss': 0.2854, 'grad_norm': 0.5807874798774719, 'learning_rate': 9.526929282884697e-06, 'epoch': 0.68}

 23%|██▎       | 2493/11049 [25:39<1:27:30,  1.63it/s]
 23%|██▎       | 2494/11049 [25:40<1:27:32,  1.63it/s]
                                                      
{'loss': 0.2455, 'grad_norm': 0.5869986414909363, 'learning_rate': 9.526258357047773e-06, 'epoch': 0.68}

 23%|██▎       | 2494/11049 [25:40<1:27:32,  1.63it/s]
 23%|██▎       | 2495/11049 [25:40<1:27:30,  1.63it/s]
                                                      
{'loss': 0.2517, 'grad_norm': 0.571096658706665, 'learning_rate': 9.525586979441408e-06, 'epoch': 0.68}

 23%|██▎       | 2495/11049 [25:41<1:27:30,  1.63it/s]
 23%|██▎       | 2496/11049 [25:41<1:27:28,  1.63it/s]
                                                      
{'loss': 0.3966, 'grad_norm': 0.6284255981445312, 'learning_rate': 9.524915150132614e-06, 'epoch': 0.68}

 23%|██▎       | 2496/11049 [25:41<1:27:28,  1.63it/s]
 23%|██▎       | 2497/11049 [25:42<1:27:26,  1.63it/s]
                                                      
{'loss': 0.325, 'grad_norm': 0.5615989565849304, 'learning_rate': 9.524242869188445e-06, 'epoch': 0.68}

 23%|██▎       | 2497/11049 [25:42<1:27:26,  1.63it/s]
 23%|██▎       | 2498/11049 [25:42<1:27:27,  1.63it/s]
                                                      
{'loss': 0.3473, 'grad_norm': 0.6119039058685303, 'learning_rate': 9.523570136676004e-06, 'epoch': 0.68}

 23%|██▎       | 2498/11049 [25:42<1:27:27,  1.63it/s]
 23%|██▎       | 2499/11049 [25:43<1:27:25,  1.63it/s]
                                                      
{'loss': 0.29, 'grad_norm': 0.529141366481781, 'learning_rate': 9.522896952662436e-06, 'epoch': 0.68}

 23%|██▎       | 2499/11049 [25:43<1:27:25,  1.63it/s]
 23%|██▎       | 2500/11049 [25:44<1:27:26,  1.63it/s]
                                                      
{'loss': 0.2777, 'grad_norm': 0.517922580242157, 'learning_rate': 9.522223317214931e-06, 'epoch': 0.68}

 23%|██▎       | 2500/11049 [25:44<1:27:26,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.36it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.6832600235939026, 'eval_runtime': 1.9529, 'eval_samples_per_second': 102.41, 'eval_steps_per_second': 6.657, 'epoch': 0.68}

 23%|██▎       | 2500/11049 [25:46<1:27:26,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 23%|██▎       | 2501/11049 [25:46<2:51:07,  1.20s/it]
                                                      
{'loss': 0.3115, 'grad_norm': 0.6360140442848206, 'learning_rate': 9.521549230400727e-06, 'epoch': 0.68}

 23%|██▎       | 2501/11049 [25:46<2:51:07,  1.20s/it]
 23%|██▎       | 2502/11049 [25:47<2:25:57,  1.02s/it]
                                                      
{'loss': 0.3531, 'grad_norm': 0.5925569534301758, 'learning_rate': 9.520874692287102e-06, 'epoch': 0.68}

 23%|██▎       | 2502/11049 [25:47<2:25:57,  1.02s/it]
 23%|██▎       | 2503/11049 [25:47<2:08:22,  1.11it/s]
                                                      
{'loss': 0.2636, 'grad_norm': 0.5865356922149658, 'learning_rate': 9.520199702941386e-06, 'epoch': 0.68}

 23%|██▎       | 2503/11049 [25:47<2:08:22,  1.11it/s]
 23%|██▎       | 2504/11049 [25:48<1:56:01,  1.23it/s]
                                                      
{'loss': 0.2776, 'grad_norm': 0.5940894484519958, 'learning_rate': 9.519524262430948e-06, 'epoch': 0.68}

 23%|██▎       | 2504/11049 [25:48<1:56:01,  1.23it/s]
 23%|██▎       | 2505/11049 [25:49<1:47:25,  1.33it/s]
                                                      
{'loss': 0.3037, 'grad_norm': 0.6575459241867065, 'learning_rate': 9.518848370823205e-06, 'epoch': 0.68}

 23%|██▎       | 2505/11049 [25:49<1:47:25,  1.33it/s]
 23%|██▎       | 2506/11049 [25:49<1:41:23,  1.40it/s]
                                                      
{'loss': 0.2424, 'grad_norm': 0.4988976716995239, 'learning_rate': 9.518172028185617e-06, 'epoch': 0.68}

 23%|██▎       | 2506/11049 [25:49<1:41:23,  1.40it/s]
 23%|██▎       | 2507/11049 [25:50<1:37:08,  1.47it/s]
                                                      
{'loss': 0.2574, 'grad_norm': 0.5739548802375793, 'learning_rate': 9.517495234585695e-06, 'epoch': 0.68}

 23%|██▎       | 2507/11049 [25:50<1:37:08,  1.47it/s]
 23%|██▎       | 2508/11049 [25:50<1:34:09,  1.51it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5879062414169312, 'learning_rate': 9.516817990090983e-06, 'epoch': 0.68}

 23%|██▎       | 2508/11049 [25:51<1:34:09,  1.51it/s]
 23%|██▎       | 2509/11049 [25:51<1:32:08,  1.54it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.5728185772895813, 'learning_rate': 9.516140294769081e-06, 'epoch': 0.68}

 23%|██▎       | 2509/11049 [25:51<1:32:08,  1.54it/s]
 23%|██▎       | 2510/11049 [25:52<1:30:38,  1.57it/s]
                                                      
{'loss': 0.2843, 'grad_norm': 0.5873936414718628, 'learning_rate': 9.515462148687633e-06, 'epoch': 0.68}

 23%|██▎       | 2510/11049 [25:52<1:30:38,  1.57it/s]
 23%|██▎       | 2511/11049 [25:52<1:29:40,  1.59it/s]
                                                      
{'loss': 0.3195, 'grad_norm': 0.7302008271217346, 'learning_rate': 9.514783551914321e-06, 'epoch': 0.68}

 23%|██▎       | 2511/11049 [25:52<1:29:40,  1.59it/s]
 23%|██▎       | 2512/11049 [25:53<1:29:00,  1.60it/s]
                                                      
{'loss': 0.3317, 'grad_norm': 0.5656671524047852, 'learning_rate': 9.514104504516876e-06, 'epoch': 0.68}

 23%|██▎       | 2512/11049 [25:53<1:29:00,  1.60it/s]
 23%|██▎       | 2513/11049 [25:53<1:28:27,  1.61it/s]
                                                      
{'loss': 0.28, 'grad_norm': 0.6282913088798523, 'learning_rate': 9.51342500656308e-06, 'epoch': 0.68}

 23%|██▎       | 2513/11049 [25:54<1:28:27,  1.61it/s]
 23%|██▎       | 2514/11049 [25:54<1:28:02,  1.62it/s]
                                                      
{'loss': 0.2954, 'grad_norm': 0.6296996474266052, 'learning_rate': 9.512745058120747e-06, 'epoch': 0.68}

 23%|██▎       | 2514/11049 [25:54<1:28:02,  1.62it/s]
 23%|██▎       | 2515/11049 [25:55<1:27:49,  1.62it/s]
                                                      
{'loss': 0.3283, 'grad_norm': 0.6605498194694519, 'learning_rate': 9.512064659257748e-06, 'epoch': 0.68}

 23%|██▎       | 2515/11049 [25:55<1:27:49,  1.62it/s]
 23%|██▎       | 2516/11049 [25:55<1:27:38,  1.62it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.5368383526802063, 'learning_rate': 9.511383810041994e-06, 'epoch': 0.68}

 23%|██▎       | 2516/11049 [25:55<1:27:38,  1.62it/s]
 23%|██▎       | 2517/11049 [25:56<1:27:28,  1.63it/s]
                                                      
{'loss': 0.2169, 'grad_norm': 0.49303117394447327, 'learning_rate': 9.510702510541437e-06, 'epoch': 0.68}

 23%|██▎       | 2517/11049 [25:56<1:27:28,  1.63it/s]
 23%|██▎       | 2518/11049 [25:57<1:27:23,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.5040043592453003, 'learning_rate': 9.510020760824084e-06, 'epoch': 0.68}

 23%|██▎       | 2518/11049 [25:57<1:27:23,  1.63it/s]
 23%|██▎       | 2519/11049 [25:57<1:27:21,  1.63it/s]
                                                      
{'loss': 0.2697, 'grad_norm': 0.5991723537445068, 'learning_rate': 9.509338560957975e-06, 'epoch': 0.68}

 23%|██▎       | 2519/11049 [25:57<1:27:21,  1.63it/s]
 23%|██▎       | 2520/11049 [25:58<1:27:16,  1.63it/s]
                                                      
{'loss': 0.2976, 'grad_norm': 0.5705286264419556, 'learning_rate': 9.508655911011204e-06, 'epoch': 0.68}

 23%|██▎       | 2520/11049 [25:58<1:27:16,  1.63it/s]
 23%|██▎       | 2521/11049 [25:58<1:27:13,  1.63it/s]
                                                      
{'loss': 0.3055, 'grad_norm': 0.5078194737434387, 'learning_rate': 9.507972811051909e-06, 'epoch': 0.68}

 23%|██▎       | 2521/11049 [25:59<1:27:13,  1.63it/s]
 23%|██▎       | 2522/11049 [25:59<1:27:09,  1.63it/s]
                                                      
{'loss': 0.2499, 'grad_norm': 0.4865366220474243, 'learning_rate': 9.507289261148267e-06, 'epoch': 0.68}

 23%|██▎       | 2522/11049 [25:59<1:27:09,  1.63it/s]
 23%|██▎       | 2523/11049 [26:00<1:27:10,  1.63it/s]
                                                      
{'loss': 0.2554, 'grad_norm': 0.5853974223136902, 'learning_rate': 9.506605261368503e-06, 'epoch': 0.69}

 23%|██▎       | 2523/11049 [26:00<1:27:10,  1.63it/s]
 23%|██▎       | 2524/11049 [26:00<1:27:08,  1.63it/s]
                                                      
{'loss': 0.2635, 'grad_norm': 0.6495452523231506, 'learning_rate': 9.505920811780892e-06, 'epoch': 0.69}

 23%|██▎       | 2524/11049 [26:00<1:27:08,  1.63it/s]
 23%|██▎       | 2525/11049 [26:01<1:27:06,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.5902278423309326, 'learning_rate': 9.505235912453746e-06, 'epoch': 0.69}

 23%|██▎       | 2525/11049 [26:01<1:27:06,  1.63it/s]
 23%|██▎       | 2526/11049 [26:01<1:27:04,  1.63it/s]
                                                      
{'loss': 0.24, 'grad_norm': 0.4629569947719574, 'learning_rate': 9.504550563455428e-06, 'epoch': 0.69}

 23%|██▎       | 2526/11049 [26:02<1:27:04,  1.63it/s]
 23%|██▎       | 2527/11049 [26:02<1:27:05,  1.63it/s]
                                                      
{'loss': 0.2863, 'grad_norm': 0.6069125533103943, 'learning_rate': 9.50386476485434e-06, 'epoch': 0.69}

 23%|██▎       | 2527/11049 [26:02<1:27:05,  1.63it/s]
 23%|██▎       | 2528/11049 [26:03<1:27:07,  1.63it/s]
                                                      
{'loss': 0.3038, 'grad_norm': 0.6463689208030701, 'learning_rate': 9.503178516718933e-06, 'epoch': 0.69}

 23%|██▎       | 2528/11049 [26:03<1:27:07,  1.63it/s]
 23%|██▎       | 2529/11049 [26:03<1:27:08,  1.63it/s]
                                                      
{'loss': 0.2481, 'grad_norm': 0.48144426941871643, 'learning_rate': 9.502491819117702e-06, 'epoch': 0.69}

 23%|██▎       | 2529/11049 [26:03<1:27:08,  1.63it/s]
 23%|██▎       | 2530/11049 [26:04<1:27:09,  1.63it/s]
                                                      
{'loss': 0.2615, 'grad_norm': 0.5475008487701416, 'learning_rate': 9.50180467211919e-06, 'epoch': 0.69}

 23%|██▎       | 2530/11049 [26:04<1:27:09,  1.63it/s]
 23%|██▎       | 2531/11049 [26:05<1:27:06,  1.63it/s]
                                                      
{'loss': 0.2247, 'grad_norm': 0.5094863176345825, 'learning_rate': 9.501117075791979e-06, 'epoch': 0.69}

 23%|██▎       | 2531/11049 [26:05<1:27:06,  1.63it/s]
 23%|██▎       | 2532/11049 [26:05<1:27:03,  1.63it/s]
                                                      
{'loss': 0.3479, 'grad_norm': 0.7440344095230103, 'learning_rate': 9.500429030204698e-06, 'epoch': 0.69}

 23%|██▎       | 2532/11049 [26:05<1:27:03,  1.63it/s]
 23%|██▎       | 2533/11049 [26:06<1:27:01,  1.63it/s]
                                                      
{'loss': 0.2728, 'grad_norm': 0.5357463359832764, 'learning_rate': 9.49974053542602e-06, 'epoch': 0.69}

 23%|██▎       | 2533/11049 [26:06<1:27:01,  1.63it/s]
 23%|██▎       | 2534/11049 [26:06<1:27:00,  1.63it/s]
                                                      
{'loss': 0.2995, 'grad_norm': 0.5862449407577515, 'learning_rate': 9.499051591524669e-06, 'epoch': 0.69}

 23%|██▎       | 2534/11049 [26:07<1:27:00,  1.63it/s]
 23%|██▎       | 2535/11049 [26:07<1:26:59,  1.63it/s]
                                                      
{'loss': 0.2518, 'grad_norm': 0.5749058127403259, 'learning_rate': 9.498362198569407e-06, 'epoch': 0.69}

 23%|██▎       | 2535/11049 [26:07<1:26:59,  1.63it/s]
 23%|██▎       | 2536/11049 [26:08<1:26:58,  1.63it/s]
                                                      
{'loss': 0.2835, 'grad_norm': 0.6125103235244751, 'learning_rate': 9.49767235662904e-06, 'epoch': 0.69}

 23%|██▎       | 2536/11049 [26:08<1:26:58,  1.63it/s]
 23%|██▎       | 2537/11049 [26:08<1:27:00,  1.63it/s]
                                                      
{'loss': 0.2622, 'grad_norm': 0.5495250821113586, 'learning_rate': 9.496982065772425e-06, 'epoch': 0.69}

 23%|██▎       | 2537/11049 [26:08<1:27:00,  1.63it/s]
 23%|██▎       | 2538/11049 [26:09<1:26:59,  1.63it/s]
                                                      
{'loss': 0.2997, 'grad_norm': 0.6202644109725952, 'learning_rate': 9.496291326068458e-06, 'epoch': 0.69}

 23%|██▎       | 2538/11049 [26:09<1:26:59,  1.63it/s]
 23%|██▎       | 2539/11049 [26:09<1:26:59,  1.63it/s]
                                                      
{'loss': 0.2396, 'grad_norm': 0.5132781863212585, 'learning_rate': 9.495600137586085e-06, 'epoch': 0.69}

 23%|██▎       | 2539/11049 [26:10<1:26:59,  1.63it/s]
 23%|██▎       | 2540/11049 [26:10<1:26:59,  1.63it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.6141948699951172, 'learning_rate': 9.494908500394293e-06, 'epoch': 0.69}

 23%|██▎       | 2540/11049 [26:10<1:26:59,  1.63it/s]
 23%|██▎       | 2541/11049 [26:11<1:26:59,  1.63it/s]
                                                      
{'loss': 0.3335, 'grad_norm': 0.5823420286178589, 'learning_rate': 9.494216414562112e-06, 'epoch': 0.69}

 23%|██▎       | 2541/11049 [26:11<1:26:59,  1.63it/s]
 23%|██▎       | 2542/11049 [26:11<1:26:59,  1.63it/s]
                                                      
{'loss': 0.267, 'grad_norm': 0.5167707204818726, 'learning_rate': 9.493523880158625e-06, 'epoch': 0.69}

 23%|██▎       | 2542/11049 [26:11<1:26:59,  1.63it/s]
 23%|██▎       | 2543/11049 [26:12<1:26:59,  1.63it/s]
                                                      
{'loss': 0.2777, 'grad_norm': 0.5567191243171692, 'learning_rate': 9.492830897252952e-06, 'epoch': 0.69}

 23%|██▎       | 2543/11049 [26:12<1:26:59,  1.63it/s]
 23%|██▎       | 2544/11049 [26:13<1:26:55,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.6205888986587524, 'learning_rate': 9.492137465914257e-06, 'epoch': 0.69}

 23%|██▎       | 2544/11049 [26:13<1:26:55,  1.63it/s]
 23%|██▎       | 2545/11049 [26:13<1:26:54,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5315300226211548, 'learning_rate': 9.491443586211756e-06, 'epoch': 0.69}

 23%|██▎       | 2545/11049 [26:13<1:26:54,  1.63it/s]
 23%|██▎       | 2546/11049 [26:14<1:26:55,  1.63it/s]
                                                      
{'loss': 0.2535, 'grad_norm': 0.5670944452285767, 'learning_rate': 9.490749258214704e-06, 'epoch': 0.69}

 23%|██▎       | 2546/11049 [26:14<1:26:55,  1.63it/s]
 23%|██▎       | 2547/11049 [26:14<1:26:53,  1.63it/s]
                                                      
{'loss': 0.2252, 'grad_norm': 0.5024298429489136, 'learning_rate': 9.490054481992403e-06, 'epoch': 0.69}

 23%|██▎       | 2547/11049 [26:14<1:26:53,  1.63it/s]
 23%|██▎       | 2548/11049 [26:15<1:26:53,  1.63it/s]
                                                      
{'loss': 0.2641, 'grad_norm': 0.4924640357494354, 'learning_rate': 9.4893592576142e-06, 'epoch': 0.69}

 23%|██▎       | 2548/11049 [26:15<1:26:53,  1.63it/s]
 23%|██▎       | 2549/11049 [26:16<1:26:55,  1.63it/s]
                                                      
{'loss': 0.3233, 'grad_norm': 0.7060714960098267, 'learning_rate': 9.488663585149484e-06, 'epoch': 0.69}

 23%|██▎       | 2549/11049 [26:16<1:26:55,  1.63it/s]
 23%|██▎       | 2550/11049 [26:16<1:26:55,  1.63it/s]
                                                      
{'loss': 0.1978, 'grad_norm': 0.5206562876701355, 'learning_rate': 9.487967464667692e-06, 'epoch': 0.69}

 23%|██▎       | 2550/11049 [26:16<1:26:55,  1.63it/s]
 23%|██▎       | 2551/11049 [26:17<1:26:52,  1.63it/s]
                                                      
{'loss': 0.2557, 'grad_norm': 0.5462107062339783, 'learning_rate': 9.487270896238303e-06, 'epoch': 0.69}

 23%|██▎       | 2551/11049 [26:17<1:26:52,  1.63it/s]
 23%|██▎       | 2552/11049 [26:17<1:26:50,  1.63it/s]
                                                      
{'loss': 0.2965, 'grad_norm': 0.5743359327316284, 'learning_rate': 9.486573879930842e-06, 'epoch': 0.69}

 23%|██▎       | 2552/11049 [26:18<1:26:50,  1.63it/s]
 23%|██▎       | 2553/11049 [26:18<1:26:50,  1.63it/s]
                                                      
{'loss': 0.3198, 'grad_norm': 0.6454516649246216, 'learning_rate': 9.485876415814882e-06, 'epoch': 0.69}

 23%|██▎       | 2553/11049 [26:18<1:26:50,  1.63it/s]
 23%|██▎       | 2554/11049 [26:19<1:26:52,  1.63it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.5346125960350037, 'learning_rate': 9.485178503960035e-06, 'epoch': 0.69}

 23%|██▎       | 2554/11049 [26:19<1:26:52,  1.63it/s]
 23%|██▎       | 2555/11049 [26:19<1:26:52,  1.63it/s]
                                                      
{'loss': 0.28, 'grad_norm': 0.5797936320304871, 'learning_rate': 9.484480144435959e-06, 'epoch': 0.69}

 23%|██▎       | 2555/11049 [26:19<1:26:52,  1.63it/s]
 23%|██▎       | 2556/11049 [26:20<1:26:53,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.5336059331893921, 'learning_rate': 9.483781337312359e-06, 'epoch': 0.69}

 23%|██▎       | 2556/11049 [26:20<1:26:53,  1.63it/s]
 23%|██▎       | 2557/11049 [26:20<1:26:54,  1.63it/s]
                                                      
{'loss': 0.3021, 'grad_norm': 0.611747145652771, 'learning_rate': 9.483082082658984e-06, 'epoch': 0.69}

 23%|██▎       | 2557/11049 [26:21<1:26:54,  1.63it/s]
 23%|██▎       | 2558/11049 [26:21<1:26:52,  1.63it/s]
                                                      
{'loss': 0.2675, 'grad_norm': 0.5925699472427368, 'learning_rate': 9.482382380545627e-06, 'epoch': 0.69}

 23%|██▎       | 2558/11049 [26:21<1:26:52,  1.63it/s]
 23%|██▎       | 2559/11049 [26:22<1:26:47,  1.63it/s]
                                                      
{'loss': 0.254, 'grad_norm': 0.6916448473930359, 'learning_rate': 9.481682231042124e-06, 'epoch': 0.69}

 23%|██▎       | 2559/11049 [26:22<1:26:47,  1.63it/s]
 23%|██▎       | 2560/11049 [26:22<1:26:44,  1.63it/s]
                                                      
{'loss': 0.2407, 'grad_norm': 0.5648972392082214, 'learning_rate': 9.48098163421836e-06, 'epoch': 0.7}

 23%|██▎       | 2560/11049 [26:22<1:26:44,  1.63it/s]
 23%|██▎       | 2561/11049 [26:23<1:26:44,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.4980226755142212, 'learning_rate': 9.480280590144261e-06, 'epoch': 0.7}

 23%|██▎       | 2561/11049 [26:23<1:26:44,  1.63it/s]
 23%|██▎       | 2562/11049 [26:24<1:26:42,  1.63it/s]
                                                      
{'loss': 0.383, 'grad_norm': 0.6321510076522827, 'learning_rate': 9.4795790988898e-06, 'epoch': 0.7}

 23%|██▎       | 2562/11049 [26:24<1:26:42,  1.63it/s]
 23%|██▎       | 2563/11049 [26:24<1:26:43,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.5560559034347534, 'learning_rate': 9.47887716052499e-06, 'epoch': 0.7}

 23%|██▎       | 2563/11049 [26:24<1:26:43,  1.63it/s]
 23%|██▎       | 2564/11049 [26:25<1:26:43,  1.63it/s]
                                                      
{'loss': 0.2761, 'grad_norm': 0.7035825252532959, 'learning_rate': 9.478174775119895e-06, 'epoch': 0.7}

 23%|██▎       | 2564/11049 [26:25<1:26:43,  1.63it/s]
 23%|██▎       | 2565/11049 [26:25<1:26:42,  1.63it/s]
                                                      
{'loss': 0.2581, 'grad_norm': 0.5750519633293152, 'learning_rate': 9.47747194274462e-06, 'epoch': 0.7}

 23%|██▎       | 2565/11049 [26:26<1:26:42,  1.63it/s]
 23%|██▎       | 2566/11049 [26:26<1:26:42,  1.63it/s]
                                                      
{'loss': 0.2989, 'grad_norm': 0.6238967180252075, 'learning_rate': 9.476768663469316e-06, 'epoch': 0.7}

 23%|██▎       | 2566/11049 [26:26<1:26:42,  1.63it/s]
 23%|██▎       | 2567/11049 [26:27<1:26:40,  1.63it/s]
                                                      
{'loss': 0.2257, 'grad_norm': 0.5794670581817627, 'learning_rate': 9.476064937364178e-06, 'epoch': 0.7}

 23%|██▎       | 2567/11049 [26:27<1:26:40,  1.63it/s]
 23%|██▎       | 2568/11049 [26:27<1:26:42,  1.63it/s]
                                                      
{'loss': 0.252, 'grad_norm': 0.49850377440452576, 'learning_rate': 9.475360764499442e-06, 'epoch': 0.7}

 23%|██▎       | 2568/11049 [26:27<1:26:42,  1.63it/s]
 23%|██▎       | 2569/11049 [26:28<1:26:41,  1.63it/s]
                                                      
{'loss': 0.2296, 'grad_norm': 0.5477957129478455, 'learning_rate': 9.474656144945397e-06, 'epoch': 0.7}

 23%|██▎       | 2569/11049 [26:28<1:26:41,  1.63it/s]
 23%|██▎       | 2570/11049 [26:28<1:26:45,  1.63it/s]
                                                      
{'loss': 0.3044, 'grad_norm': 0.5530405640602112, 'learning_rate': 9.473951078772367e-06, 'epoch': 0.7}

 23%|██▎       | 2570/11049 [26:29<1:26:45,  1.63it/s]
 23%|██▎       | 2571/11049 [26:29<1:26:41,  1.63it/s]
                                                      
{'loss': 0.196, 'grad_norm': 0.4423728883266449, 'learning_rate': 9.47324556605073e-06, 'epoch': 0.7}

 23%|██▎       | 2571/11049 [26:29<1:26:41,  1.63it/s]
 23%|██▎       | 2572/11049 [26:30<1:26:39,  1.63it/s]
                                                      
{'loss': 0.3966, 'grad_norm': 0.6501418948173523, 'learning_rate': 9.472539606850898e-06, 'epoch': 0.7}

 23%|██▎       | 2572/11049 [26:30<1:26:39,  1.63it/s]
 23%|██▎       | 2573/11049 [26:30<1:26:38,  1.63it/s]
                                                      
{'loss': 0.3571, 'grad_norm': 0.5848995447158813, 'learning_rate': 9.47183320124334e-06, 'epoch': 0.7}

 23%|██▎       | 2573/11049 [26:30<1:26:38,  1.63it/s]
 23%|██▎       | 2574/11049 [26:31<1:26:37,  1.63it/s]
                                                      
{'loss': 0.2742, 'grad_norm': 0.6043505072593689, 'learning_rate': 9.471126349298557e-06, 'epoch': 0.7}

 23%|██▎       | 2574/11049 [26:31<1:26:37,  1.63it/s]
 23%|██▎       | 2575/11049 [26:32<1:26:35,  1.63it/s]
                                                      
{'loss': 0.2556, 'grad_norm': 0.5855879187583923, 'learning_rate': 9.470419051087104e-06, 'epoch': 0.7}

 23%|██▎       | 2575/11049 [26:32<1:26:35,  1.63it/s]
 23%|██▎       | 2576/11049 [26:32<1:26:34,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.5414074659347534, 'learning_rate': 9.469711306679575e-06, 'epoch': 0.7}

 23%|██▎       | 2576/11049 [26:32<1:26:34,  1.63it/s]
 23%|██▎       | 2577/11049 [26:33<1:26:34,  1.63it/s]
                                                      
{'loss': 0.3091, 'grad_norm': 0.6741916537284851, 'learning_rate': 9.469003116146613e-06, 'epoch': 0.7}

 23%|██▎       | 2577/11049 [26:33<1:26:34,  1.63it/s]
 23%|██▎       | 2578/11049 [26:33<1:26:41,  1.63it/s]
                                                      
{'loss': 0.3324, 'grad_norm': 0.6047898530960083, 'learning_rate': 9.4682944795589e-06, 'epoch': 0.7}

 23%|██▎       | 2578/11049 [26:33<1:26:41,  1.63it/s]
 23%|██▎       | 2579/11049 [26:34<1:26:42,  1.63it/s]
                                                      
{'loss': 0.2943, 'grad_norm': 0.5744910836219788, 'learning_rate': 9.467585396987168e-06, 'epoch': 0.7}

 23%|██▎       | 2579/11049 [26:34<1:26:42,  1.63it/s]
 23%|██▎       | 2580/11049 [26:35<1:26:34,  1.63it/s]
                                                      
{'loss': 0.2821, 'grad_norm': 0.5897981524467468, 'learning_rate': 9.46687586850219e-06, 'epoch': 0.7}

 23%|██▎       | 2580/11049 [26:35<1:26:34,  1.63it/s]
 23%|██▎       | 2581/11049 [26:35<1:26:33,  1.63it/s]
                                                      
{'loss': 0.3503, 'grad_norm': 0.7141368389129639, 'learning_rate': 9.466165894174785e-06, 'epoch': 0.7}

 23%|██▎       | 2581/11049 [26:35<1:26:33,  1.63it/s]
 23%|██▎       | 2582/11049 [26:36<1:26:34,  1.63it/s]
                                                      
{'loss': 0.2491, 'grad_norm': 0.5029349327087402, 'learning_rate': 9.465455474075816e-06, 'epoch': 0.7}

 23%|██▎       | 2582/11049 [26:36<1:26:34,  1.63it/s]
 23%|██▎       | 2583/11049 [26:36<1:26:31,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.5661633014678955, 'learning_rate': 9.464744608276189e-06, 'epoch': 0.7}

 23%|██▎       | 2583/11049 [26:37<1:26:31,  1.63it/s]
 23%|██▎       | 2584/11049 [26:37<1:26:31,  1.63it/s]
                                                      
{'loss': 0.2645, 'grad_norm': 0.5979279279708862, 'learning_rate': 9.46403329684686e-06, 'epoch': 0.7}

 23%|██▎       | 2584/11049 [26:37<1:26:31,  1.63it/s]
 23%|██▎       | 2585/11049 [26:38<1:26:30,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.48984241485595703, 'learning_rate': 9.463321539858821e-06, 'epoch': 0.7}

 23%|██▎       | 2585/11049 [26:38<1:26:30,  1.63it/s]
 23%|██▎       | 2586/11049 [26:38<1:26:30,  1.63it/s]
                                                      
{'loss': 0.2316, 'grad_norm': 0.580544114112854, 'learning_rate': 9.462609337383116e-06, 'epoch': 0.7}

 23%|██▎       | 2586/11049 [26:38<1:26:30,  1.63it/s]
 23%|██▎       | 2587/11049 [26:39<1:26:27,  1.63it/s]
                                                      
{'loss': 0.2534, 'grad_norm': 0.5894713401794434, 'learning_rate': 9.461896689490829e-06, 'epoch': 0.7}

 23%|██▎       | 2587/11049 [26:39<1:26:27,  1.63it/s]
 23%|██▎       | 2588/11049 [26:39<1:26:28,  1.63it/s]
                                                      
{'loss': 0.2774, 'grad_norm': 0.5702301263809204, 'learning_rate': 9.461183596253092e-06, 'epoch': 0.7}

 23%|██▎       | 2588/11049 [26:40<1:26:28,  1.63it/s]
 23%|██▎       | 2589/11049 [26:40<1:26:25,  1.63it/s]
                                                      
{'loss': 0.2264, 'grad_norm': 0.5005671381950378, 'learning_rate': 9.460470057741077e-06, 'epoch': 0.7}

 23%|██▎       | 2589/11049 [26:40<1:26:25,  1.63it/s]
 23%|██▎       | 2590/11049 [26:41<1:26:25,  1.63it/s]
                                                      
{'loss': 0.3033, 'grad_norm': 0.5441225171089172, 'learning_rate': 9.459756074026002e-06, 'epoch': 0.7}

 23%|██▎       | 2590/11049 [26:41<1:26:25,  1.63it/s]
 23%|██▎       | 2591/11049 [26:41<1:26:25,  1.63it/s]
                                                      
{'loss': 0.2846, 'grad_norm': 0.6090176105499268, 'learning_rate': 9.459041645179137e-06, 'epoch': 0.7}

 23%|██▎       | 2591/11049 [26:41<1:26:25,  1.63it/s]
 23%|██▎       | 2592/11049 [26:42<1:26:26,  1.63it/s]
                                                      
{'loss': 0.3074, 'grad_norm': 0.6226426959037781, 'learning_rate': 9.458326771271781e-06, 'epoch': 0.7}

 23%|██▎       | 2592/11049 [26:42<1:26:26,  1.63it/s]
 23%|██▎       | 2593/11049 [26:43<1:26:24,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.7043719291687012, 'learning_rate': 9.45761145237529e-06, 'epoch': 0.7}

 23%|██▎       | 2593/11049 [26:43<1:26:24,  1.63it/s]
 23%|██▎       | 2594/11049 [26:43<1:26:24,  1.63it/s]
                                                      
{'loss': 0.2562, 'grad_norm': 0.5248952507972717, 'learning_rate': 9.456895688561062e-06, 'epoch': 0.7}

 23%|██▎       | 2594/11049 [26:43<1:26:24,  1.63it/s]
 23%|██▎       | 2595/11049 [26:44<1:26:22,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.6248279809951782, 'learning_rate': 9.456179479900535e-06, 'epoch': 0.7}

 23%|██▎       | 2595/11049 [26:44<1:26:22,  1.63it/s]
 23%|██▎       | 2596/11049 [26:44<1:26:22,  1.63it/s]
                                                      
{'loss': 0.2901, 'grad_norm': 0.5873005390167236, 'learning_rate': 9.455462826465199e-06, 'epoch': 0.7}

 23%|██▎       | 2596/11049 [26:45<1:26:22,  1.63it/s]
 24%|██▎       | 2597/11049 [26:45<1:26:24,  1.63it/s]
                                                      
{'loss': 0.2092, 'grad_norm': 0.5052863359451294, 'learning_rate': 9.454745728326578e-06, 'epoch': 0.71}

 24%|██▎       | 2597/11049 [26:45<1:26:24,  1.63it/s]
 24%|██▎       | 2598/11049 [26:46<1:26:24,  1.63it/s]
                                                      
{'loss': 0.3515, 'grad_norm': 0.9065179824829102, 'learning_rate': 9.45402818555625e-06, 'epoch': 0.71}

 24%|██▎       | 2598/11049 [26:46<1:26:24,  1.63it/s]
 24%|██▎       | 2599/11049 [26:46<1:26:24,  1.63it/s]
                                                      
{'loss': 0.3143, 'grad_norm': 0.5703372359275818, 'learning_rate': 9.45331019822583e-06, 'epoch': 0.71}

 24%|██▎       | 2599/11049 [26:46<1:26:24,  1.63it/s]
 24%|██▎       | 2600/11049 [26:47<1:26:24,  1.63it/s]
                                                      
{'loss': 0.3186, 'grad_norm': 0.6689622402191162, 'learning_rate': 9.452591766406985e-06, 'epoch': 0.71}

 24%|██▎       | 2600/11049 [26:47<1:26:24,  1.63it/s]
 24%|██▎       | 2601/11049 [26:47<1:26:23,  1.63it/s]
                                                      
{'loss': 0.3027, 'grad_norm': 0.7094696164131165, 'learning_rate': 9.451872890171419e-06, 'epoch': 0.71}

 24%|██▎       | 2601/11049 [26:48<1:26:23,  1.63it/s]
 24%|██▎       | 2602/11049 [26:48<1:26:21,  1.63it/s]
                                                      
{'loss': 0.2322, 'grad_norm': 0.5346581339836121, 'learning_rate': 9.451153569590887e-06, 'epoch': 0.71}

 24%|██▎       | 2602/11049 [26:48<1:26:21,  1.63it/s]
 24%|██▎       | 2603/11049 [26:49<1:26:18,  1.63it/s]
                                                      
{'loss': 0.3112, 'grad_norm': 0.6455671191215515, 'learning_rate': 9.45043380473718e-06, 'epoch': 0.71}

 24%|██▎       | 2603/11049 [26:49<1:26:18,  1.63it/s]
 24%|██▎       | 2604/11049 [26:49<1:26:18,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.5368496179580688, 'learning_rate': 9.449713595682143e-06, 'epoch': 0.71}

 24%|██▎       | 2604/11049 [26:49<1:26:18,  1.63it/s]
 24%|██▎       | 2605/11049 [26:50<1:26:17,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.60200035572052, 'learning_rate': 9.448992942497659e-06, 'epoch': 0.71}

 24%|██▎       | 2605/11049 [26:50<1:26:17,  1.63it/s]
 24%|██▎       | 2606/11049 [26:51<1:26:18,  1.63it/s]
                                                      
{'loss': 0.3668, 'grad_norm': 0.6763986945152283, 'learning_rate': 9.448271845255657e-06, 'epoch': 0.71}

 24%|██▎       | 2606/11049 [26:51<1:26:18,  1.63it/s]
 24%|██▎       | 2607/11049 [26:51<1:26:16,  1.63it/s]
                                                      
{'loss': 0.2155, 'grad_norm': 0.48768526315689087, 'learning_rate': 9.44755030402811e-06, 'epoch': 0.71}

 24%|██▎       | 2607/11049 [26:51<1:26:16,  1.63it/s]
 24%|██▎       | 2608/11049 [26:52<1:26:15,  1.63it/s]
                                                      
{'loss': 0.2398, 'grad_norm': 0.48233258724212646, 'learning_rate': 9.446828318887036e-06, 'epoch': 0.71}

 24%|██▎       | 2608/11049 [26:52<1:26:15,  1.63it/s]
 24%|██▎       | 2609/11049 [26:52<1:26:13,  1.63it/s]
                                                      
{'loss': 0.2721, 'grad_norm': 0.5892648696899414, 'learning_rate': 9.446105889904496e-06, 'epoch': 0.71}

 24%|██▎       | 2609/11049 [26:53<1:26:13,  1.63it/s]
 24%|██▎       | 2610/11049 [26:53<1:26:13,  1.63it/s]
                                                      
{'loss': 0.2441, 'grad_norm': 0.5412365794181824, 'learning_rate': 9.445383017152596e-06, 'epoch': 0.71}

 24%|██▎       | 2610/11049 [26:53<1:26:13,  1.63it/s]
 24%|██▎       | 2611/11049 [26:54<1:26:13,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.500827968120575, 'learning_rate': 9.444659700703488e-06, 'epoch': 0.71}

 24%|██▎       | 2611/11049 [26:54<1:26:13,  1.63it/s]
 24%|██▎       | 2612/11049 [26:54<1:26:12,  1.63it/s]
                                                      
{'loss': 0.3996, 'grad_norm': 0.6950596570968628, 'learning_rate': 9.443935940629368e-06, 'epoch': 0.71}

 24%|██▎       | 2612/11049 [26:54<1:26:12,  1.63it/s]
 24%|██▎       | 2613/11049 [26:55<1:26:12,  1.63it/s]
                                                      
{'loss': 0.2564, 'grad_norm': 0.5194723606109619, 'learning_rate': 9.443211737002471e-06, 'epoch': 0.71}

 24%|██▎       | 2613/11049 [26:55<1:26:12,  1.63it/s]
 24%|██▎       | 2614/11049 [26:55<1:26:12,  1.63it/s]
                                                      
{'loss': 0.3239, 'grad_norm': 0.6205942630767822, 'learning_rate': 9.442487089895082e-06, 'epoch': 0.71}

 24%|██▎       | 2614/11049 [26:56<1:26:12,  1.63it/s]
 24%|██▎       | 2615/11049 [26:56<1:26:09,  1.63it/s]
                                                      
{'loss': 0.2307, 'grad_norm': 0.5720192193984985, 'learning_rate': 9.441761999379532e-06, 'epoch': 0.71}

 24%|██▎       | 2615/11049 [26:56<1:26:09,  1.63it/s]
 24%|██▎       | 2616/11049 [26:57<1:26:10,  1.63it/s]
                                                      
{'loss': 0.3189, 'grad_norm': 0.6559154391288757, 'learning_rate': 9.441036465528188e-06, 'epoch': 0.71}

 24%|██▎       | 2616/11049 [26:57<1:26:10,  1.63it/s]
 24%|██▎       | 2617/11049 [26:57<1:26:11,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.48276427388191223, 'learning_rate': 9.440310488413469e-06, 'epoch': 0.71}

 24%|██▎       | 2617/11049 [26:57<1:26:11,  1.63it/s]
 24%|██▎       | 2618/11049 [26:58<1:26:10,  1.63it/s]
                                                      
{'loss': 0.1883, 'grad_norm': 0.5590276718139648, 'learning_rate': 9.439584068107834e-06, 'epoch': 0.71}

 24%|██▎       | 2618/11049 [26:58<1:26:10,  1.63it/s]
 24%|██▎       | 2619/11049 [26:59<1:26:09,  1.63it/s]
                                                      
{'loss': 0.2945, 'grad_norm': 0.6555081009864807, 'learning_rate': 9.438857204683788e-06, 'epoch': 0.71}

 24%|██▎       | 2619/11049 [26:59<1:26:09,  1.63it/s]
 24%|██▎       | 2620/11049 [26:59<1:26:09,  1.63it/s]
                                                      
{'loss': 0.281, 'grad_norm': 0.5349297523498535, 'learning_rate': 9.43812989821388e-06, 'epoch': 0.71}

 24%|██▎       | 2620/11049 [26:59<1:26:09,  1.63it/s]
 24%|██▎       | 2621/11049 [27:00<1:26:09,  1.63it/s]
                                                      
{'loss': 0.2574, 'grad_norm': 0.5892549157142639, 'learning_rate': 9.437402148770703e-06, 'epoch': 0.71}

 24%|██▎       | 2621/11049 [27:00<1:26:09,  1.63it/s]
 24%|██▎       | 2622/11049 [27:00<1:26:08,  1.63it/s]
                                                      
{'loss': 0.3234, 'grad_norm': 0.5932223200798035, 'learning_rate': 9.436673956426893e-06, 'epoch': 0.71}

 24%|██▎       | 2622/11049 [27:00<1:26:08,  1.63it/s]
 24%|██▎       | 2623/11049 [27:01<1:26:07,  1.63it/s]
                                                      
{'loss': 0.3085, 'grad_norm': 0.5719554424285889, 'learning_rate': 9.435945321255135e-06, 'epoch': 0.71}

 24%|██▎       | 2623/11049 [27:01<1:26:07,  1.63it/s]
 24%|██▎       | 2624/11049 [27:02<1:26:04,  1.63it/s]
                                                      
{'loss': 0.2341, 'grad_norm': 0.4916509687900543, 'learning_rate': 9.43521624332815e-06, 'epoch': 0.71}

 24%|██▎       | 2624/11049 [27:02<1:26:04,  1.63it/s]
 24%|██▍       | 2625/11049 [27:02<1:26:03,  1.63it/s]
                                                      
{'loss': 0.2014, 'grad_norm': 0.4779404401779175, 'learning_rate': 9.434486722718712e-06, 'epoch': 0.71}

 24%|██▍       | 2625/11049 [27:02<1:26:03,  1.63it/s]
 24%|██▍       | 2626/11049 [27:03<1:26:04,  1.63it/s]
                                                      
{'loss': 0.2663, 'grad_norm': 0.562367856502533, 'learning_rate': 9.433756759499631e-06, 'epoch': 0.71}

 24%|██▍       | 2626/11049 [27:03<1:26:04,  1.63it/s]
 24%|██▍       | 2627/11049 [27:03<1:26:03,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.5297923684120178, 'learning_rate': 9.433026353743768e-06, 'epoch': 0.71}

 24%|██▍       | 2627/11049 [27:04<1:26:03,  1.63it/s]
 24%|██▍       | 2628/11049 [27:04<1:26:04,  1.63it/s]
                                                      
{'loss': 0.2625, 'grad_norm': 0.6268872618675232, 'learning_rate': 9.432295505524026e-06, 'epoch': 0.71}

 24%|██▍       | 2628/11049 [27:04<1:26:04,  1.63it/s]
 24%|██▍       | 2629/11049 [27:05<1:26:07,  1.63it/s]
                                                      
{'loss': 0.2385, 'grad_norm': 0.5164292454719543, 'learning_rate': 9.43156421491335e-06, 'epoch': 0.71}

 24%|██▍       | 2629/11049 [27:05<1:26:07,  1.63it/s]
 24%|██▍       | 2630/11049 [27:05<1:26:04,  1.63it/s]
                                                      
{'loss': 0.2668, 'grad_norm': 0.5718887448310852, 'learning_rate': 9.43083248198473e-06, 'epoch': 0.71}

 24%|██▍       | 2630/11049 [27:05<1:26:04,  1.63it/s]
 24%|██▍       | 2631/11049 [27:06<1:26:04,  1.63it/s]
                                                      
{'loss': 0.2962, 'grad_norm': 0.5573845505714417, 'learning_rate': 9.430100306811203e-06, 'epoch': 0.71}

 24%|██▍       | 2631/11049 [27:06<1:26:04,  1.63it/s]
 24%|██▍       | 2632/11049 [27:06<1:26:03,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.6554454565048218, 'learning_rate': 9.429367689465845e-06, 'epoch': 0.71}

 24%|██▍       | 2632/11049 [27:07<1:26:03,  1.63it/s]
 24%|██▍       | 2633/11049 [27:07<1:25:59,  1.63it/s]
                                                      
{'loss': 0.2048, 'grad_norm': 0.48600849509239197, 'learning_rate': 9.428634630021783e-06, 'epoch': 0.71}

 24%|██▍       | 2633/11049 [27:07<1:25:59,  1.63it/s]
 24%|██▍       | 2634/11049 [27:08<1:26:00,  1.63it/s]
                                                      
{'loss': 0.2949, 'grad_norm': 0.6009290814399719, 'learning_rate': 9.427901128552182e-06, 'epoch': 0.72}

 24%|██▍       | 2634/11049 [27:08<1:26:00,  1.63it/s]
 24%|██▍       | 2635/11049 [27:08<1:25:58,  1.63it/s]
                                                      
{'loss': 0.2494, 'grad_norm': 0.5120038390159607, 'learning_rate': 9.427167185130252e-06, 'epoch': 0.72}

 24%|██▍       | 2635/11049 [27:08<1:25:58,  1.63it/s]
 24%|██▍       | 2636/11049 [27:09<1:25:57,  1.63it/s]
                                                      
{'loss': 0.2744, 'grad_norm': 0.5562335848808289, 'learning_rate': 9.42643279982925e-06, 'epoch': 0.72}

 24%|██▍       | 2636/11049 [27:09<1:25:57,  1.63it/s]
 24%|██▍       | 2637/11049 [27:10<1:25:57,  1.63it/s]
                                                      
{'loss': 0.2661, 'grad_norm': 0.5563253164291382, 'learning_rate': 9.425697972722476e-06, 'epoch': 0.72}

 24%|██▍       | 2637/11049 [27:10<1:25:57,  1.63it/s]
 24%|██▍       | 2638/11049 [27:10<1:25:57,  1.63it/s]
                                                      
{'loss': 0.2605, 'grad_norm': 0.5757325291633606, 'learning_rate': 9.424962703883274e-06, 'epoch': 0.72}

 24%|██▍       | 2638/11049 [27:10<1:25:57,  1.63it/s]
 24%|██▍       | 2639/11049 [27:11<1:25:56,  1.63it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.7261170148849487, 'learning_rate': 9.424226993385031e-06, 'epoch': 0.72}

 24%|██▍       | 2639/11049 [27:11<1:25:56,  1.63it/s]
 24%|██▍       | 2640/11049 [27:11<1:25:59,  1.63it/s]
                                                      
{'loss': 0.275, 'grad_norm': 0.6259568333625793, 'learning_rate': 9.42349084130118e-06, 'epoch': 0.72}

 24%|██▍       | 2640/11049 [27:12<1:25:59,  1.63it/s]
 24%|██▍       | 2641/11049 [27:12<1:25:58,  1.63it/s]
                                                      
{'loss': 0.3469, 'grad_norm': 0.5866311192512512, 'learning_rate': 9.422754247705192e-06, 'epoch': 0.72}

 24%|██▍       | 2641/11049 [27:12<1:25:58,  1.63it/s]
 24%|██▍       | 2642/11049 [27:13<1:25:59,  1.63it/s]
                                                      
{'loss': 0.2912, 'grad_norm': 0.6882055401802063, 'learning_rate': 9.422017212670593e-06, 'epoch': 0.72}

 24%|██▍       | 2642/11049 [27:13<1:25:59,  1.63it/s]
 24%|██▍       | 2643/11049 [27:13<1:25:59,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.5253540873527527, 'learning_rate': 9.421279736270946e-06, 'epoch': 0.72}

 24%|██▍       | 2643/11049 [27:13<1:25:59,  1.63it/s]
 24%|██▍       | 2644/11049 [27:14<1:25:57,  1.63it/s]
                                                      
{'loss': 0.2484, 'grad_norm': 0.6026542782783508, 'learning_rate': 9.420541818579856e-06, 'epoch': 0.72}

 24%|██▍       | 2644/11049 [27:14<1:25:57,  1.63it/s]
 24%|██▍       | 2645/11049 [27:14<1:25:55,  1.63it/s]
                                                      
{'loss': 0.3363, 'grad_norm': 0.6734102368354797, 'learning_rate': 9.41980345967098e-06, 'epoch': 0.72}

 24%|██▍       | 2645/11049 [27:15<1:25:55,  1.63it/s]
 24%|██▍       | 2646/11049 [27:15<1:25:52,  1.63it/s]
                                                      
{'loss': 0.3447, 'grad_norm': 0.5628655552864075, 'learning_rate': 9.41906465961801e-06, 'epoch': 0.72}

 24%|██▍       | 2646/11049 [27:15<1:25:52,  1.63it/s]
 24%|██▍       | 2647/11049 [27:16<1:25:50,  1.63it/s]
                                                      
{'loss': 0.3392, 'grad_norm': 0.6257317066192627, 'learning_rate': 9.418325418494686e-06, 'epoch': 0.72}

 24%|██▍       | 2647/11049 [27:16<1:25:50,  1.63it/s]
 24%|██▍       | 2648/11049 [27:16<1:25:51,  1.63it/s]
                                                      
{'loss': 0.2596, 'grad_norm': 0.6171160936355591, 'learning_rate': 9.417585736374793e-06, 'epoch': 0.72}

 24%|██▍       | 2648/11049 [27:16<1:25:51,  1.63it/s]
 24%|██▍       | 2649/11049 [27:17<1:25:49,  1.63it/s]
                                                      
{'loss': 0.3787, 'grad_norm': 0.6387768387794495, 'learning_rate': 9.416845613332162e-06, 'epoch': 0.72}

 24%|██▍       | 2649/11049 [27:17<1:25:49,  1.63it/s]
 24%|██▍       | 2650/11049 [27:18<1:25:48,  1.63it/s]
                                                      
{'loss': 0.2604, 'grad_norm': 0.5549197793006897, 'learning_rate': 9.416105049440662e-06, 'epoch': 0.72}

 24%|██▍       | 2650/11049 [27:18<1:25:48,  1.63it/s]
 24%|██▍       | 2651/11049 [27:18<1:25:48,  1.63it/s]
                                                      
{'loss': 0.2568, 'grad_norm': 0.551728367805481, 'learning_rate': 9.415364044774214e-06, 'epoch': 0.72}

 24%|██▍       | 2651/11049 [27:18<1:25:48,  1.63it/s]
 24%|██▍       | 2652/11049 [27:19<1:25:47,  1.63it/s]
                                                      
{'loss': 0.2912, 'grad_norm': 0.5965609550476074, 'learning_rate': 9.414622599406771e-06, 'epoch': 0.72}

 24%|██▍       | 2652/11049 [27:19<1:25:47,  1.63it/s]
 24%|██▍       | 2653/11049 [27:19<1:25:45,  1.63it/s]
                                                      
{'loss': 0.2933, 'grad_norm': 0.501474142074585, 'learning_rate': 9.413880713412343e-06, 'epoch': 0.72}

 24%|██▍       | 2653/11049 [27:19<1:25:45,  1.63it/s]
 24%|██▍       | 2654/11049 [27:20<1:25:45,  1.63it/s]
                                                      
{'loss': 0.2849, 'grad_norm': 0.6244889497756958, 'learning_rate': 9.413138386864975e-06, 'epoch': 0.72}

 24%|██▍       | 2654/11049 [27:20<1:25:45,  1.63it/s]
 24%|██▍       | 2655/11049 [27:21<1:25:47,  1.63it/s]
                                                      
{'loss': 0.2516, 'grad_norm': 0.5521546602249146, 'learning_rate': 9.412395619838761e-06, 'epoch': 0.72}

 24%|██▍       | 2655/11049 [27:21<1:25:47,  1.63it/s]
 24%|██▍       | 2656/11049 [27:21<1:25:48,  1.63it/s]
                                                      
{'loss': 0.2986, 'grad_norm': 0.5842263102531433, 'learning_rate': 9.411652412407837e-06, 'epoch': 0.72}

 24%|██▍       | 2656/11049 [27:21<1:25:48,  1.63it/s]
 24%|██▍       | 2657/11049 [27:22<1:25:50,  1.63it/s]
                                                      
{'loss': 0.2624, 'grad_norm': 0.5029577016830444, 'learning_rate': 9.410908764646383e-06, 'epoch': 0.72}

 24%|██▍       | 2657/11049 [27:22<1:25:50,  1.63it/s]
 24%|██▍       | 2658/11049 [27:22<1:25:48,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.5111050605773926, 'learning_rate': 9.41016467662862e-06, 'epoch': 0.72}

 24%|██▍       | 2658/11049 [27:23<1:25:48,  1.63it/s]
 24%|██▍       | 2659/11049 [27:23<1:25:47,  1.63it/s]
                                                      
{'loss': 0.3409, 'grad_norm': 0.6666949391365051, 'learning_rate': 9.409420148428822e-06, 'epoch': 0.72}

 24%|██▍       | 2659/11049 [27:23<1:25:47,  1.63it/s]
 24%|██▍       | 2660/11049 [27:24<1:25:47,  1.63it/s]
                                                      
{'loss': 0.2594, 'grad_norm': 0.5301002264022827, 'learning_rate': 9.408675180121299e-06, 'epoch': 0.72}

 24%|██▍       | 2660/11049 [27:24<1:25:47,  1.63it/s]
 24%|██▍       | 2661/11049 [27:24<1:25:46,  1.63it/s]
                                                      
{'loss': 0.2646, 'grad_norm': 0.5619376301765442, 'learning_rate': 9.407929771780403e-06, 'epoch': 0.72}

 24%|██▍       | 2661/11049 [27:24<1:25:46,  1.63it/s]
 24%|██▍       | 2662/11049 [27:25<1:25:43,  1.63it/s]
                                                      
{'loss': 0.2589, 'grad_norm': 0.5211963057518005, 'learning_rate': 9.407183923480538e-06, 'epoch': 0.72}

 24%|██▍       | 2662/11049 [27:25<1:25:43,  1.63it/s]
 24%|██▍       | 2663/11049 [27:25<1:25:42,  1.63it/s]
                                                      
{'loss': 0.2448, 'grad_norm': 0.4754638075828552, 'learning_rate': 9.406437635296147e-06, 'epoch': 0.72}

 24%|██▍       | 2663/11049 [27:26<1:25:42,  1.63it/s]
 24%|██▍       | 2664/11049 [27:26<1:25:43,  1.63it/s]
                                                      
{'loss': 0.2943, 'grad_norm': 0.517787516117096, 'learning_rate': 9.405690907301715e-06, 'epoch': 0.72}

 24%|██▍       | 2664/11049 [27:26<1:25:43,  1.63it/s]
 24%|██▍       | 2665/11049 [27:27<1:25:43,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.4695231020450592, 'learning_rate': 9.404943739571774e-06, 'epoch': 0.72}

 24%|██▍       | 2665/11049 [27:27<1:25:43,  1.63it/s]
 24%|██▍       | 2666/11049 [27:27<1:25:41,  1.63it/s]
                                                      
{'loss': 0.3626, 'grad_norm': 0.6130706071853638, 'learning_rate': 9.404196132180902e-06, 'epoch': 0.72}

 24%|██▍       | 2666/11049 [27:27<1:25:41,  1.63it/s]
 24%|██▍       | 2667/11049 [27:28<1:25:42,  1.63it/s]
                                                      
{'loss': 0.2353, 'grad_norm': 0.5001600980758667, 'learning_rate': 9.403448085203718e-06, 'epoch': 0.72}

 24%|██▍       | 2667/11049 [27:28<1:25:42,  1.63it/s]
 24%|██▍       | 2668/11049 [27:29<1:25:42,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.49433431029319763, 'learning_rate': 9.402699598714886e-06, 'epoch': 0.72}

 24%|██▍       | 2668/11049 [27:29<1:25:42,  1.63it/s]
 24%|██▍       | 2669/11049 [27:29<1:25:40,  1.63it/s]
                                                      
{'loss': 0.3172, 'grad_norm': 0.6309660077095032, 'learning_rate': 9.40195067278911e-06, 'epoch': 0.72}

 24%|██▍       | 2669/11049 [27:29<1:25:40,  1.63it/s]
 24%|██▍       | 2670/11049 [27:30<1:25:40,  1.63it/s]
                                                      
{'loss': 0.2298, 'grad_norm': 0.5001065731048584, 'learning_rate': 9.401201307501139e-06, 'epoch': 0.72}

 24%|██▍       | 2670/11049 [27:30<1:25:40,  1.63it/s]
 24%|██▍       | 2671/11049 [27:30<1:25:38,  1.63it/s]
                                                      
{'loss': 0.2436, 'grad_norm': 0.5794171094894409, 'learning_rate': 9.400451502925774e-06, 'epoch': 0.73}

 24%|██▍       | 2671/11049 [27:31<1:25:38,  1.63it/s]
 24%|██▍       | 2672/11049 [27:31<1:25:35,  1.63it/s]
                                                      
{'loss': 0.3077, 'grad_norm': 0.5878884196281433, 'learning_rate': 9.399701259137848e-06, 'epoch': 0.73}

 24%|██▍       | 2672/11049 [27:31<1:25:35,  1.63it/s]
 24%|██▍       | 2673/11049 [27:32<1:25:35,  1.63it/s]
                                                      
{'loss': 0.3565, 'grad_norm': 0.7602641582489014, 'learning_rate': 9.398950576212249e-06, 'epoch': 0.73}

 24%|██▍       | 2673/11049 [27:32<1:25:35,  1.63it/s]
 24%|██▍       | 2674/11049 [27:32<1:25:32,  1.63it/s]
                                                      
{'loss': 0.2964, 'grad_norm': 0.6774587631225586, 'learning_rate': 9.398199454223898e-06, 'epoch': 0.73}

 24%|██▍       | 2674/11049 [27:32<1:25:32,  1.63it/s]
 24%|██▍       | 2675/11049 [27:33<1:25:33,  1.63it/s]
                                                      
{'loss': 0.3225, 'grad_norm': 0.6585409641265869, 'learning_rate': 9.397447893247767e-06, 'epoch': 0.73}

 24%|██▍       | 2675/11049 [27:33<1:25:33,  1.63it/s]
 24%|██▍       | 2676/11049 [27:33<1:25:33,  1.63it/s]
                                                      
{'loss': 0.276, 'grad_norm': 0.5995032787322998, 'learning_rate': 9.396695893358872e-06, 'epoch': 0.73}

 24%|██▍       | 2676/11049 [27:34<1:25:33,  1.63it/s]
 24%|██▍       | 2677/11049 [27:34<1:25:36,  1.63it/s]
                                                      
{'loss': 0.2307, 'grad_norm': 0.4990790784358978, 'learning_rate': 9.395943454632266e-06, 'epoch': 0.73}

 24%|██▍       | 2677/11049 [27:34<1:25:36,  1.63it/s]
 24%|██▍       | 2678/11049 [27:35<1:25:34,  1.63it/s]
                                                      
{'loss': 0.3358, 'grad_norm': 0.6570923924446106, 'learning_rate': 9.395190577143057e-06, 'epoch': 0.73}

 24%|██▍       | 2678/11049 [27:35<1:25:34,  1.63it/s]
 24%|██▍       | 2679/11049 [27:35<1:25:33,  1.63it/s]
                                                      
{'loss': 0.3296, 'grad_norm': 0.6054537892341614, 'learning_rate': 9.394437260966384e-06, 'epoch': 0.73}

 24%|██▍       | 2679/11049 [27:35<1:25:33,  1.63it/s]
 24%|██▍       | 2680/11049 [27:36<1:25:32,  1.63it/s]
                                                      
{'loss': 0.2375, 'grad_norm': 0.49141746759414673, 'learning_rate': 9.39368350617744e-06, 'epoch': 0.73}

 24%|██▍       | 2680/11049 [27:36<1:25:32,  1.63it/s]
 24%|██▍       | 2681/11049 [27:37<1:25:31,  1.63it/s]
                                                      
{'loss': 0.3523, 'grad_norm': 0.6049128174781799, 'learning_rate': 9.392929312851455e-06, 'epoch': 0.73}

 24%|██▍       | 2681/11049 [27:37<1:25:31,  1.63it/s]
 24%|██▍       | 2682/11049 [27:37<1:25:31,  1.63it/s]
                                                      
{'loss': 0.3227, 'grad_norm': 0.6784299612045288, 'learning_rate': 9.392174681063707e-06, 'epoch': 0.73}

 24%|██▍       | 2682/11049 [27:37<1:25:31,  1.63it/s]
 24%|██▍       | 2683/11049 [27:38<1:25:31,  1.63it/s]
                                                      
{'loss': 0.2269, 'grad_norm': 0.5455925464630127, 'learning_rate': 9.39141961088952e-06, 'epoch': 0.73}

 24%|██▍       | 2683/11049 [27:38<1:25:31,  1.63it/s]
 24%|██▍       | 2684/11049 [27:38<1:25:33,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.5908352136611938, 'learning_rate': 9.390664102404252e-06, 'epoch': 0.73}

 24%|██▍       | 2684/11049 [27:38<1:25:33,  1.63it/s]
 24%|██▍       | 2685/11049 [27:39<1:25:31,  1.63it/s]
                                                      
{'loss': 0.2816, 'grad_norm': 0.5715567469596863, 'learning_rate': 9.389908155683316e-06, 'epoch': 0.73}

 24%|██▍       | 2685/11049 [27:39<1:25:31,  1.63it/s]
 24%|██▍       | 2686/11049 [27:40<1:25:30,  1.63it/s]
                                                      
{'loss': 0.2916, 'grad_norm': 0.5787238478660583, 'learning_rate': 9.389151770802158e-06, 'epoch': 0.73}

 24%|██▍       | 2686/11049 [27:40<1:25:30,  1.63it/s]
 24%|██▍       | 2687/11049 [27:40<1:25:29,  1.63it/s]
                                                      
{'loss': 0.4065, 'grad_norm': 0.7116842865943909, 'learning_rate': 9.388394947836278e-06, 'epoch': 0.73}

 24%|██▍       | 2687/11049 [27:40<1:25:29,  1.63it/s]
 24%|██▍       | 2688/11049 [27:41<1:25:28,  1.63it/s]
                                                      
{'loss': 0.3984, 'grad_norm': 0.6184194087982178, 'learning_rate': 9.387637686861215e-06, 'epoch': 0.73}

 24%|██▍       | 2688/11049 [27:41<1:25:28,  1.63it/s]
 24%|██▍       | 2689/11049 [27:41<1:25:26,  1.63it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.5255861878395081, 'learning_rate': 9.386879987952549e-06, 'epoch': 0.73}

 24%|██▍       | 2689/11049 [27:42<1:25:26,  1.63it/s]
 24%|██▍       | 2690/11049 [27:42<1:25:26,  1.63it/s]
                                                      
{'loss': 0.2689, 'grad_norm': 0.5819289088249207, 'learning_rate': 9.38612185118591e-06, 'epoch': 0.73}

 24%|██▍       | 2690/11049 [27:42<1:25:26,  1.63it/s]
 24%|██▍       | 2691/11049 [27:43<1:25:26,  1.63it/s]
                                                      
{'loss': 0.298, 'grad_norm': 0.7312042117118835, 'learning_rate': 9.385363276636965e-06, 'epoch': 0.73}

 24%|██▍       | 2691/11049 [27:43<1:25:26,  1.63it/s]
 24%|██▍       | 2692/11049 [27:43<1:25:24,  1.63it/s]
                                                      
{'loss': 0.2886, 'grad_norm': 0.70022052526474, 'learning_rate': 9.38460426438143e-06, 'epoch': 0.73}

 24%|██▍       | 2692/11049 [27:43<1:25:24,  1.63it/s]
 24%|██▍       | 2693/11049 [27:44<1:25:21,  1.63it/s]
                                                      
{'loss': 0.2824, 'grad_norm': 0.5725165605545044, 'learning_rate': 9.383844814495061e-06, 'epoch': 0.73}

 24%|██▍       | 2693/11049 [27:44<1:25:21,  1.63it/s]
 24%|██▍       | 2694/11049 [27:44<1:25:20,  1.63it/s]
                                                      
{'loss': 0.2671, 'grad_norm': 0.5510283708572388, 'learning_rate': 9.38308492705366e-06, 'epoch': 0.73}

 24%|██▍       | 2694/11049 [27:45<1:25:20,  1.63it/s]
 24%|██▍       | 2695/11049 [27:45<1:25:21,  1.63it/s]
                                                      
{'loss': 0.2485, 'grad_norm': 0.5285258889198303, 'learning_rate': 9.382324602133075e-06, 'epoch': 0.73}

 24%|██▍       | 2695/11049 [27:45<1:25:21,  1.63it/s]
 24%|██▍       | 2696/11049 [27:46<1:25:20,  1.63it/s]
                                                      
{'loss': 0.2334, 'grad_norm': 0.5204214453697205, 'learning_rate': 9.381563839809188e-06, 'epoch': 0.73}

 24%|██▍       | 2696/11049 [27:46<1:25:20,  1.63it/s]
 24%|██▍       | 2697/11049 [27:46<1:25:21,  1.63it/s]
                                                      
{'loss': 0.3019, 'grad_norm': 0.5408973693847656, 'learning_rate': 9.380802640157937e-06, 'epoch': 0.73}

 24%|██▍       | 2697/11049 [27:46<1:25:21,  1.63it/s]
 24%|██▍       | 2698/11049 [27:47<1:25:19,  1.63it/s]
                                                      
{'loss': 0.3218, 'grad_norm': 0.5755184888839722, 'learning_rate': 9.380041003255297e-06, 'epoch': 0.73}

 24%|██▍       | 2698/11049 [27:47<1:25:19,  1.63it/s]
 24%|██▍       | 2699/11049 [27:48<1:25:18,  1.63it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.5483183860778809, 'learning_rate': 9.379278929177286e-06, 'epoch': 0.73}

 24%|██▍       | 2699/11049 [27:48<1:25:18,  1.63it/s]
 24%|██▍       | 2700/11049 [27:48<1:25:19,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.5419290065765381, 'learning_rate': 9.378516417999967e-06, 'epoch': 0.73}

 24%|██▍       | 2700/11049 [27:48<1:25:19,  1.63it/s]
 24%|██▍       | 2701/11049 [27:49<1:25:20,  1.63it/s]
                                                      
{'loss': 0.3463, 'grad_norm': 0.5722891092300415, 'learning_rate': 9.377753469799448e-06, 'epoch': 0.73}

 24%|██▍       | 2701/11049 [27:49<1:25:20,  1.63it/s]
 24%|██▍       | 2702/11049 [27:49<1:25:18,  1.63it/s]
                                                      
{'loss': 0.2832, 'grad_norm': 0.5020983219146729, 'learning_rate': 9.37699008465188e-06, 'epoch': 0.73}

 24%|██▍       | 2702/11049 [27:50<1:25:18,  1.63it/s]
 24%|██▍       | 2703/11049 [27:50<1:25:16,  1.63it/s]
                                                      
{'loss': 0.2659, 'grad_norm': 0.49697819352149963, 'learning_rate': 9.376226262633454e-06, 'epoch': 0.73}

 24%|██▍       | 2703/11049 [27:50<1:25:16,  1.63it/s]
 24%|██▍       | 2704/11049 [27:51<1:25:17,  1.63it/s]
                                                      
{'loss': 0.2833, 'grad_norm': 0.5454530715942383, 'learning_rate': 9.375462003820413e-06, 'epoch': 0.73}

 24%|██▍       | 2704/11049 [27:51<1:25:17,  1.63it/s]
 24%|██▍       | 2705/11049 [27:51<1:25:21,  1.63it/s]
                                                      
{'loss': 0.3038, 'grad_norm': 0.6110944151878357, 'learning_rate': 9.374697308289034e-06, 'epoch': 0.73}

 24%|██▍       | 2705/11049 [27:51<1:25:21,  1.63it/s]
 24%|██▍       | 2706/11049 [27:52<1:25:14,  1.63it/s]
                                                      
{'loss': 0.2671, 'grad_norm': 0.5683179497718811, 'learning_rate': 9.373932176115642e-06, 'epoch': 0.73}

 24%|██▍       | 2706/11049 [27:52<1:25:14,  1.63it/s]
 24%|██▍       | 2707/11049 [27:52<1:25:14,  1.63it/s]
                                                      
{'loss': 0.3308, 'grad_norm': 0.5740083456039429, 'learning_rate': 9.373166607376607e-06, 'epoch': 0.73}

 24%|██▍       | 2707/11049 [27:53<1:25:14,  1.63it/s]
 25%|██▍       | 2708/11049 [27:53<1:25:14,  1.63it/s]
                                                      
{'loss': 0.2425, 'grad_norm': 0.5142415165901184, 'learning_rate': 9.372400602148341e-06, 'epoch': 0.74}

 25%|██▍       | 2708/11049 [27:53<1:25:14,  1.63it/s]
 25%|██▍       | 2709/11049 [27:54<1:25:13,  1.63it/s]
                                                      
{'loss': 0.2546, 'grad_norm': 0.4903361201286316, 'learning_rate': 9.371634160507299e-06, 'epoch': 0.74}

 25%|██▍       | 2709/11049 [27:54<1:25:13,  1.63it/s]
 25%|██▍       | 2710/11049 [27:54<1:25:11,  1.63it/s]
                                                      
{'loss': 0.2577, 'grad_norm': 0.575657069683075, 'learning_rate': 9.370867282529981e-06, 'epoch': 0.74}

 25%|██▍       | 2710/11049 [27:54<1:25:11,  1.63it/s]
 25%|██▍       | 2711/11049 [27:55<1:25:12,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.567251980304718, 'learning_rate': 9.370099968292928e-06, 'epoch': 0.74}

 25%|██▍       | 2711/11049 [27:55<1:25:12,  1.63it/s]
 25%|██▍       | 2712/11049 [27:56<1:25:12,  1.63it/s]
                                                      
{'loss': 0.2673, 'grad_norm': 0.5740077495574951, 'learning_rate': 9.369332217872728e-06, 'epoch': 0.74}

 25%|██▍       | 2712/11049 [27:56<1:25:12,  1.63it/s]
 25%|██▍       | 2713/11049 [27:56<1:25:11,  1.63it/s]
                                                      
{'loss': 0.2992, 'grad_norm': 0.6159865856170654, 'learning_rate': 9.36856403134601e-06, 'epoch': 0.74}

 25%|██▍       | 2713/11049 [27:56<1:25:11,  1.63it/s]
 25%|██▍       | 2714/11049 [27:57<1:25:08,  1.63it/s]
                                                      
{'loss': 0.3426, 'grad_norm': 0.646051824092865, 'learning_rate': 9.367795408789445e-06, 'epoch': 0.74}

 25%|██▍       | 2714/11049 [27:57<1:25:08,  1.63it/s]
 25%|██▍       | 2715/11049 [27:57<1:25:07,  1.63it/s]
                                                      
{'loss': 0.2937, 'grad_norm': 0.5563687682151794, 'learning_rate': 9.367026350279755e-06, 'epoch': 0.74}

 25%|██▍       | 2715/11049 [27:58<1:25:07,  1.63it/s]
 25%|██▍       | 2716/11049 [27:58<1:25:07,  1.63it/s]
                                                      
{'loss': 0.2725, 'grad_norm': 0.4966529607772827, 'learning_rate': 9.366256855893696e-06, 'epoch': 0.74}

 25%|██▍       | 2716/11049 [27:58<1:25:07,  1.63it/s]
 25%|██▍       | 2717/11049 [27:59<1:25:04,  1.63it/s]
                                                      
{'loss': 0.2307, 'grad_norm': 0.5217003226280212, 'learning_rate': 9.365486925708073e-06, 'epoch': 0.74}

 25%|██▍       | 2717/11049 [27:59<1:25:04,  1.63it/s]
 25%|██▍       | 2718/11049 [27:59<1:25:06,  1.63it/s]
                                                      
{'loss': 0.3072, 'grad_norm': 0.6365013718605042, 'learning_rate': 9.364716559799735e-06, 'epoch': 0.74}

 25%|██▍       | 2718/11049 [27:59<1:25:06,  1.63it/s]
 25%|██▍       | 2719/11049 [28:00<1:25:06,  1.63it/s]
                                                      
{'loss': 0.2927, 'grad_norm': 0.6540323495864868, 'learning_rate': 9.363945758245571e-06, 'epoch': 0.74}

 25%|██▍       | 2719/11049 [28:00<1:25:06,  1.63it/s]
 25%|██▍       | 2720/11049 [28:00<1:25:03,  1.63it/s]
                                                      
{'loss': 0.2182, 'grad_norm': 0.5028513669967651, 'learning_rate': 9.363174521122517e-06, 'epoch': 0.74}

 25%|██▍       | 2720/11049 [28:01<1:25:03,  1.63it/s]
 25%|██▍       | 2721/11049 [28:01<1:25:15,  1.63it/s]
                                                      
{'loss': 0.2268, 'grad_norm': 0.5161272287368774, 'learning_rate': 9.362402848507548e-06, 'epoch': 0.74}

 25%|██▍       | 2721/11049 [28:01<1:25:15,  1.63it/s]
 25%|██▍       | 2722/11049 [28:02<1:25:10,  1.63it/s]
                                                      
{'loss': 0.2517, 'grad_norm': 0.5321325063705444, 'learning_rate': 9.361630740477687e-06, 'epoch': 0.74}

 25%|██▍       | 2722/11049 [28:02<1:25:10,  1.63it/s]
 25%|██▍       | 2723/11049 [28:02<1:25:06,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.594239354133606, 'learning_rate': 9.360858197109999e-06, 'epoch': 0.74}

 25%|██▍       | 2723/11049 [28:02<1:25:06,  1.63it/s]
 25%|██▍       | 2724/11049 [28:03<1:25:07,  1.63it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.5691704750061035, 'learning_rate': 9.360085218481592e-06, 'epoch': 0.74}

 25%|██▍       | 2724/11049 [28:03<1:25:07,  1.63it/s]
 25%|██▍       | 2725/11049 [28:04<1:25:05,  1.63it/s]
                                                      
{'loss': 0.3082, 'grad_norm': 0.6756023168563843, 'learning_rate': 9.359311804669618e-06, 'epoch': 0.74}

 25%|██▍       | 2725/11049 [28:04<1:25:05,  1.63it/s]
 25%|██▍       | 2726/11049 [28:04<1:25:04,  1.63it/s]
                                                      
{'loss': 0.2794, 'grad_norm': 0.6161409020423889, 'learning_rate': 9.35853795575127e-06, 'epoch': 0.74}

 25%|██▍       | 2726/11049 [28:04<1:25:04,  1.63it/s]
 25%|██▍       | 2727/11049 [28:05<1:25:05,  1.63it/s]
                                                      
{'loss': 0.3033, 'grad_norm': 0.5524181723594666, 'learning_rate': 9.357763671803788e-06, 'epoch': 0.74}

 25%|██▍       | 2727/11049 [28:05<1:25:05,  1.63it/s]
 25%|██▍       | 2728/11049 [28:05<1:25:06,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.526543915271759, 'learning_rate': 9.356988952904455e-06, 'epoch': 0.74}

 25%|██▍       | 2728/11049 [28:05<1:25:06,  1.63it/s]
 25%|██▍       | 2729/11049 [28:06<1:25:04,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.5504108667373657, 'learning_rate': 9.356213799130594e-06, 'epoch': 0.74}

 25%|██▍       | 2729/11049 [28:06<1:25:04,  1.63it/s]
 25%|██▍       | 2730/11049 [28:07<1:25:01,  1.63it/s]
                                                      
{'loss': 0.2546, 'grad_norm': 0.5431928038597107, 'learning_rate': 9.355438210559574e-06, 'epoch': 0.74}

 25%|██▍       | 2730/11049 [28:07<1:25:01,  1.63it/s]
 25%|██▍       | 2731/11049 [28:07<1:25:04,  1.63it/s]
                                                      
{'loss': 0.2825, 'grad_norm': 0.5689612627029419, 'learning_rate': 9.35466218726881e-06, 'epoch': 0.74}

 25%|██▍       | 2731/11049 [28:07<1:25:04,  1.63it/s]
 25%|██▍       | 2732/11049 [28:08<1:25:01,  1.63it/s]
                                                      
{'loss': 0.2392, 'grad_norm': 0.535398006439209, 'learning_rate': 9.353885729335755e-06, 'epoch': 0.74}

 25%|██▍       | 2732/11049 [28:08<1:25:01,  1.63it/s]
 25%|██▍       | 2733/11049 [28:08<1:25:01,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.502781331539154, 'learning_rate': 9.353108836837907e-06, 'epoch': 0.74}

 25%|██▍       | 2733/11049 [28:09<1:25:01,  1.63it/s]
 25%|██▍       | 2734/11049 [28:09<1:25:02,  1.63it/s]
                                                      
{'loss': 0.2476, 'grad_norm': 0.653900146484375, 'learning_rate': 9.35233150985281e-06, 'epoch': 0.74}

 25%|██▍       | 2734/11049 [28:09<1:25:02,  1.63it/s]
 25%|██▍       | 2735/11049 [28:10<1:25:01,  1.63it/s]
                                                      
{'loss': 0.3079, 'grad_norm': 0.6434110403060913, 'learning_rate': 9.351553748458048e-06, 'epoch': 0.74}

 25%|██▍       | 2735/11049 [28:10<1:25:01,  1.63it/s]
 25%|██▍       | 2736/11049 [28:10<1:24:59,  1.63it/s]
                                                      
{'loss': 0.2518, 'grad_norm': 0.5353779196739197, 'learning_rate': 9.350775552731253e-06, 'epoch': 0.74}

 25%|██▍       | 2736/11049 [28:10<1:24:59,  1.63it/s]
 25%|██▍       | 2737/11049 [28:11<1:24:56,  1.63it/s]
                                                      
{'loss': 0.2424, 'grad_norm': 0.5439348220825195, 'learning_rate': 9.349996922750096e-06, 'epoch': 0.74}

 25%|██▍       | 2737/11049 [28:11<1:24:56,  1.63it/s]
 25%|██▍       | 2738/11049 [28:11<1:24:55,  1.63it/s]
                                                      
{'loss': 0.2841, 'grad_norm': 0.6486012935638428, 'learning_rate': 9.34921785859229e-06, 'epoch': 0.74}

 25%|██▍       | 2738/11049 [28:12<1:24:55,  1.63it/s]
 25%|██▍       | 2739/11049 [28:12<1:24:54,  1.63it/s]
                                                      
{'loss': 0.2418, 'grad_norm': 0.5678467154502869, 'learning_rate': 9.348438360335599e-06, 'epoch': 0.74}

 25%|██▍       | 2739/11049 [28:12<1:24:54,  1.63it/s]
 25%|██▍       | 2740/11049 [28:13<1:24:54,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.48761260509490967, 'learning_rate': 9.34765842805782e-06, 'epoch': 0.74}

 25%|██▍       | 2740/11049 [28:13<1:24:54,  1.63it/s]
 25%|██▍       | 2741/11049 [28:13<1:24:54,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.6111693978309631, 'learning_rate': 9.346878061836802e-06, 'epoch': 0.74}

 25%|██▍       | 2741/11049 [28:13<1:24:54,  1.63it/s]
 25%|██▍       | 2742/11049 [28:14<1:24:53,  1.63it/s]
                                                      
{'loss': 0.2743, 'grad_norm': 0.615494966506958, 'learning_rate': 9.346097261750433e-06, 'epoch': 0.74}

 25%|██▍       | 2742/11049 [28:14<1:24:53,  1.63it/s]
 25%|██▍       | 2743/11049 [28:15<1:24:52,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.4838593602180481, 'learning_rate': 9.345316027876646e-06, 'epoch': 0.74}

 25%|██▍       | 2743/11049 [28:15<1:24:52,  1.63it/s]
 25%|██▍       | 2744/11049 [28:15<1:24:49,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.5661407709121704, 'learning_rate': 9.344534360293416e-06, 'epoch': 0.75}

 25%|██▍       | 2744/11049 [28:15<1:24:49,  1.63it/s]
 25%|██▍       | 2745/11049 [28:16<1:24:50,  1.63it/s]
                                                      
{'loss': 0.2498, 'grad_norm': 0.5370941162109375, 'learning_rate': 9.343752259078761e-06, 'epoch': 0.75}

 25%|██▍       | 2745/11049 [28:16<1:24:50,  1.63it/s]
 25%|██▍       | 2746/11049 [28:16<1:24:47,  1.63it/s]
                                                      
{'loss': 0.3215, 'grad_norm': 0.6543923616409302, 'learning_rate': 9.342969724310743e-06, 'epoch': 0.75}

 25%|██▍       | 2746/11049 [28:17<1:24:47,  1.63it/s]
 25%|██▍       | 2747/11049 [28:17<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2597, 'grad_norm': 0.5445228219032288, 'learning_rate': 9.342186756067472e-06, 'epoch': 0.75}

 25%|██▍       | 2747/11049 [28:17<1:24:46,  1.63it/s]
 25%|██▍       | 2748/11049 [28:18<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2275, 'grad_norm': 0.5329383611679077, 'learning_rate': 9.341403354427091e-06, 'epoch': 0.75}

 25%|██▍       | 2748/11049 [28:18<1:24:46,  1.63it/s]
 25%|██▍       | 2749/11049 [28:18<1:24:48,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.5544622540473938, 'learning_rate': 9.340619519467794e-06, 'epoch': 0.75}

 25%|██▍       | 2749/11049 [28:18<1:24:48,  1.63it/s]
 25%|██▍       | 2750/11049 [28:19<1:24:47,  1.63it/s]
                                                      
{'loss': 0.3042, 'grad_norm': 0.5304780006408691, 'learning_rate': 9.339835251267817e-06, 'epoch': 0.75}

 25%|██▍       | 2750/11049 [28:19<1:24:47,  1.63it/s]
 25%|██▍       | 2751/11049 [28:19<1:24:47,  1.63it/s]
                                                      
{'loss': 0.3024, 'grad_norm': 0.5847428441047668, 'learning_rate': 9.339050549905436e-06, 'epoch': 0.75}

 25%|██▍       | 2751/11049 [28:20<1:24:47,  1.63it/s]
 25%|██▍       | 2752/11049 [28:20<1:24:47,  1.63it/s]
                                                      
{'loss': 0.2737, 'grad_norm': 0.6004115343093872, 'learning_rate': 9.338265415458975e-06, 'epoch': 0.75}

 25%|██▍       | 2752/11049 [28:20<1:24:47,  1.63it/s]
 25%|██▍       | 2753/11049 [28:21<1:24:48,  1.63it/s]
                                                      
{'loss': 0.2373, 'grad_norm': 0.48393821716308594, 'learning_rate': 9.337479848006799e-06, 'epoch': 0.75}

 25%|██▍       | 2753/11049 [28:21<1:24:48,  1.63it/s]
 25%|██▍       | 2754/11049 [28:21<1:24:47,  1.63it/s]
                                                      
{'loss': 0.2538, 'grad_norm': 0.48098066449165344, 'learning_rate': 9.336693847627314e-06, 'epoch': 0.75}

 25%|██▍       | 2754/11049 [28:21<1:24:47,  1.63it/s]
 25%|██▍       | 2755/11049 [28:22<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2742, 'grad_norm': 0.48730388283729553, 'learning_rate': 9.335907414398974e-06, 'epoch': 0.75}

 25%|██▍       | 2755/11049 [28:22<1:24:46,  1.63it/s]
 25%|██▍       | 2756/11049 [28:23<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.5795302987098694, 'learning_rate': 9.335120548400273e-06, 'epoch': 0.75}

 25%|██▍       | 2756/11049 [28:23<1:24:46,  1.63it/s]
 25%|██▍       | 2757/11049 [28:23<1:24:45,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.5295122861862183, 'learning_rate': 9.334333249709746e-06, 'epoch': 0.75}

 25%|██▍       | 2757/11049 [28:23<1:24:45,  1.63it/s]
 25%|██▍       | 2758/11049 [28:24<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.5425337553024292, 'learning_rate': 9.333545518405978e-06, 'epoch': 0.75}

 25%|██▍       | 2758/11049 [28:24<1:24:46,  1.63it/s]
 25%|██▍       | 2759/11049 [28:24<1:24:49,  1.63it/s]
                                                      
{'loss': 0.2596, 'grad_norm': 0.5709627866744995, 'learning_rate': 9.332757354567589e-06, 'epoch': 0.75}

 25%|██▍       | 2759/11049 [28:24<1:24:49,  1.63it/s]
 25%|██▍       | 2760/11049 [28:25<1:24:47,  1.63it/s]
                                                      
{'loss': 0.2542, 'grad_norm': 0.5542930960655212, 'learning_rate': 9.33196875827325e-06, 'epoch': 0.75}

 25%|██▍       | 2760/11049 [28:25<1:24:47,  1.63it/s]
 25%|██▍       | 2761/11049 [28:26<1:24:46,  1.63it/s]
                                                      
{'loss': 0.2004, 'grad_norm': 0.5503854751586914, 'learning_rate': 9.331179729601665e-06, 'epoch': 0.75}

 25%|██▍       | 2761/11049 [28:26<1:24:46,  1.63it/s]
 25%|██▍       | 2762/11049 [28:26<1:24:47,  1.63it/s]
                                                      
{'loss': 0.2591, 'grad_norm': 0.4938308894634247, 'learning_rate': 9.330390268631597e-06, 'epoch': 0.75}

 25%|██▍       | 2762/11049 [28:26<1:24:47,  1.63it/s]
 25%|██▌       | 2763/11049 [28:27<1:24:47,  1.63it/s]
                                                      
{'loss': 0.2463, 'grad_norm': 0.49350789189338684, 'learning_rate': 9.329600375441836e-06, 'epoch': 0.75}

 25%|██▌       | 2763/11049 [28:27<1:24:47,  1.63it/s]
 25%|██▌       | 2764/11049 [28:27<1:24:44,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5017063021659851, 'learning_rate': 9.328810050111223e-06, 'epoch': 0.75}

 25%|██▌       | 2764/11049 [28:28<1:24:44,  1.63it/s]
 25%|██▌       | 2765/11049 [28:28<1:24:41,  1.63it/s]
                                                      
{'loss': 0.3396, 'grad_norm': 0.6825904250144958, 'learning_rate': 9.328019292718643e-06, 'epoch': 0.75}

 25%|██▌       | 2765/11049 [28:28<1:24:41,  1.63it/s]
 25%|██▌       | 2766/11049 [28:29<1:24:38,  1.63it/s]
                                                      
{'loss': 0.2552, 'grad_norm': 0.5432225465774536, 'learning_rate': 9.327228103343021e-06, 'epoch': 0.75}

 25%|██▌       | 2766/11049 [28:29<1:24:38,  1.63it/s]
 25%|██▌       | 2767/11049 [28:29<1:24:39,  1.63it/s]
                                                      
{'loss': 0.2666, 'grad_norm': 0.6413257718086243, 'learning_rate': 9.326436482063326e-06, 'epoch': 0.75}

 25%|██▌       | 2767/11049 [28:29<1:24:39,  1.63it/s]
 25%|██▌       | 2768/11049 [28:30<1:24:41,  1.63it/s]
                                                      
{'loss': 0.3086, 'grad_norm': 0.6029298305511475, 'learning_rate': 9.32564442895857e-06, 'epoch': 0.75}

 25%|██▌       | 2768/11049 [28:30<1:24:41,  1.63it/s]
 25%|██▌       | 2769/11049 [28:30<1:24:39,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.42160364985466003, 'learning_rate': 9.324851944107809e-06, 'epoch': 0.75}

 25%|██▌       | 2769/11049 [28:31<1:24:39,  1.63it/s]
 25%|██▌       | 2770/11049 [28:31<1:24:40,  1.63it/s]
                                                      
{'loss': 0.316, 'grad_norm': 0.658757209777832, 'learning_rate': 9.324059027590142e-06, 'epoch': 0.75}

 25%|██▌       | 2770/11049 [28:31<1:24:40,  1.63it/s]
 25%|██▌       | 2771/11049 [28:32<1:25:01,  1.62it/s]
                                                      
{'loss': 0.2882, 'grad_norm': 0.6038272380828857, 'learning_rate': 9.32326567948471e-06, 'epoch': 0.75}

 25%|██▌       | 2771/11049 [28:32<1:25:01,  1.62it/s]
 25%|██▌       | 2772/11049 [28:32<1:24:50,  1.63it/s]
                                                      
{'loss': 0.2339, 'grad_norm': 0.5147886276245117, 'learning_rate': 9.322471899870696e-06, 'epoch': 0.75}

 25%|██▌       | 2772/11049 [28:32<1:24:50,  1.63it/s]
 25%|██▌       | 2773/11049 [28:33<1:24:48,  1.63it/s]
                                                      
{'loss': 0.2952, 'grad_norm': 0.7051891684532166, 'learning_rate': 9.321677688827331e-06, 'epoch': 0.75}

 25%|██▌       | 2773/11049 [28:33<1:24:48,  1.63it/s]
 25%|██▌       | 2774/11049 [28:34<1:24:43,  1.63it/s]
                                                      
{'loss': 0.3115, 'grad_norm': 0.6386806964874268, 'learning_rate': 9.320883046433885e-06, 'epoch': 0.75}

 25%|██▌       | 2774/11049 [28:34<1:24:43,  1.63it/s]
 25%|██▌       | 2775/11049 [28:34<1:24:39,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.5845814347267151, 'learning_rate': 9.32008797276967e-06, 'epoch': 0.75}

 25%|██▌       | 2775/11049 [28:34<1:24:39,  1.63it/s]
 25%|██▌       | 2776/11049 [28:35<1:24:38,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.47567418217658997, 'learning_rate': 9.319292467914045e-06, 'epoch': 0.75}

 25%|██▌       | 2776/11049 [28:35<1:24:38,  1.63it/s]
 25%|██▌       | 2777/11049 [28:35<1:24:34,  1.63it/s]
                                                      
{'loss': 0.3501, 'grad_norm': 0.6466846466064453, 'learning_rate': 9.318496531946411e-06, 'epoch': 0.75}

 25%|██▌       | 2777/11049 [28:36<1:24:34,  1.63it/s]
 25%|██▌       | 2778/11049 [28:36<1:24:32,  1.63it/s]
                                                      
{'loss': 0.2084, 'grad_norm': 0.45189061760902405, 'learning_rate': 9.317700164946206e-06, 'epoch': 0.75}

 25%|██▌       | 2778/11049 [28:36<1:24:32,  1.63it/s]
 25%|██▌       | 2779/11049 [28:37<1:24:32,  1.63it/s]
                                                      
{'loss': 0.2526, 'grad_norm': 0.5526188611984253, 'learning_rate': 9.31690336699292e-06, 'epoch': 0.75}

 25%|██▌       | 2779/11049 [28:37<1:24:32,  1.63it/s]
 25%|██▌       | 2780/11049 [28:37<1:24:32,  1.63it/s]
                                                      
{'loss': 0.2237, 'grad_norm': 0.48253899812698364, 'learning_rate': 9.316106138166082e-06, 'epoch': 0.75}

 25%|██▌       | 2780/11049 [28:37<1:24:32,  1.63it/s]
 25%|██▌       | 2781/11049 [28:38<1:24:35,  1.63it/s]
                                                      
{'loss': 0.2533, 'grad_norm': 0.5121059417724609, 'learning_rate': 9.315308478545262e-06, 'epoch': 0.76}

 25%|██▌       | 2781/11049 [28:38<1:24:35,  1.63it/s]
 25%|██▌       | 2782/11049 [28:38<1:24:30,  1.63it/s]
                                                      
{'loss': 0.2471, 'grad_norm': 0.5627279281616211, 'learning_rate': 9.314510388210078e-06, 'epoch': 0.76}

 25%|██▌       | 2782/11049 [28:39<1:24:30,  1.63it/s]
 25%|██▌       | 2783/11049 [28:39<1:24:28,  1.63it/s]
                                                      
{'loss': 0.2715, 'grad_norm': 0.5409272313117981, 'learning_rate': 9.313711867240186e-06, 'epoch': 0.76}

 25%|██▌       | 2783/11049 [28:39<1:24:28,  1.63it/s]
 25%|██▌       | 2784/11049 [28:40<1:24:27,  1.63it/s]
                                                      
{'loss': 0.2479, 'grad_norm': 0.4943999946117401, 'learning_rate': 9.312912915715286e-06, 'epoch': 0.76}

 25%|██▌       | 2784/11049 [28:40<1:24:27,  1.63it/s]
 25%|██▌       | 2785/11049 [28:40<1:24:26,  1.63it/s]
                                                      
{'loss': 0.287, 'grad_norm': 0.6056954264640808, 'learning_rate': 9.312113533715125e-06, 'epoch': 0.76}

 25%|██▌       | 2785/11049 [28:40<1:24:26,  1.63it/s]
 25%|██▌       | 2786/11049 [28:41<1:24:33,  1.63it/s]
                                                      
{'loss': 0.3246, 'grad_norm': 0.7816122174263, 'learning_rate': 9.311313721319488e-06, 'epoch': 0.76}

 25%|██▌       | 2786/11049 [28:41<1:24:33,  1.63it/s]
 25%|██▌       | 2787/11049 [28:42<1:24:31,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.5449225306510925, 'learning_rate': 9.310513478608205e-06, 'epoch': 0.76}

 25%|██▌       | 2787/11049 [28:42<1:24:31,  1.63it/s]
 25%|██▌       | 2788/11049 [28:42<1:24:29,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5627555847167969, 'learning_rate': 9.30971280566115e-06, 'epoch': 0.76}

 25%|██▌       | 2788/11049 [28:42<1:24:29,  1.63it/s]
 25%|██▌       | 2789/11049 [28:43<1:24:29,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.5461562275886536, 'learning_rate': 9.308911702558237e-06, 'epoch': 0.76}

 25%|██▌       | 2789/11049 [28:43<1:24:29,  1.63it/s]
 25%|██▌       | 2790/11049 [28:43<1:24:27,  1.63it/s]
                                                      
{'loss': 0.3068, 'grad_norm': 0.5697759985923767, 'learning_rate': 9.308110169379426e-06, 'epoch': 0.76}

 25%|██▌       | 2790/11049 [28:44<1:24:27,  1.63it/s]
 25%|██▌       | 2791/11049 [28:44<1:24:28,  1.63it/s]
                                                      
{'loss': 0.2999, 'grad_norm': 0.5663160085678101, 'learning_rate': 9.307308206204718e-06, 'epoch': 0.76}

 25%|██▌       | 2791/11049 [28:44<1:24:28,  1.63it/s]
 25%|██▌       | 2792/11049 [28:45<1:24:26,  1.63it/s]
                                                      
{'loss': 0.244, 'grad_norm': 0.552530825138092, 'learning_rate': 9.306505813114157e-06, 'epoch': 0.76}

 25%|██▌       | 2792/11049 [28:45<1:24:26,  1.63it/s]
 25%|██▌       | 2793/11049 [28:45<1:24:23,  1.63it/s]
                                                      
{'loss': 0.2233, 'grad_norm': 0.4874538779258728, 'learning_rate': 9.305702990187831e-06, 'epoch': 0.76}

 25%|██▌       | 2793/11049 [28:45<1:24:23,  1.63it/s]
 25%|██▌       | 2794/11049 [28:46<1:24:21,  1.63it/s]
                                                      
{'loss': 0.2578, 'grad_norm': 0.5206875205039978, 'learning_rate': 9.304899737505873e-06, 'epoch': 0.76}

 25%|██▌       | 2794/11049 [28:46<1:24:21,  1.63it/s]
 25%|██▌       | 2795/11049 [28:46<1:24:20,  1.63it/s]
                                                      
{'loss': 0.2301, 'grad_norm': 0.5474026203155518, 'learning_rate': 9.304096055148452e-06, 'epoch': 0.76}

 25%|██▌       | 2795/11049 [28:47<1:24:20,  1.63it/s]
 25%|██▌       | 2796/11049 [28:47<1:24:18,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.5730057954788208, 'learning_rate': 9.303291943195786e-06, 'epoch': 0.76}

 25%|██▌       | 2796/11049 [28:47<1:24:18,  1.63it/s]
 25%|██▌       | 2797/11049 [28:48<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2124, 'grad_norm': 0.4570538103580475, 'learning_rate': 9.302487401728136e-06, 'epoch': 0.76}

 25%|██▌       | 2797/11049 [28:48<1:24:19,  1.63it/s]
 25%|██▌       | 2798/11049 [28:48<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2708, 'grad_norm': 0.5350309610366821, 'learning_rate': 9.301682430825802e-06, 'epoch': 0.76}

 25%|██▌       | 2798/11049 [28:48<1:24:19,  1.63it/s]
 25%|██▌       | 2799/11049 [28:49<1:24:18,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.5843362808227539, 'learning_rate': 9.300877030569129e-06, 'epoch': 0.76}

 25%|██▌       | 2799/11049 [28:49<1:24:18,  1.63it/s]
 25%|██▌       | 2800/11049 [28:50<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.5340670943260193, 'learning_rate': 9.300071201038503e-06, 'epoch': 0.76}

 25%|██▌       | 2800/11049 [28:50<1:24:19,  1.63it/s]
 25%|██▌       | 2801/11049 [28:50<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.4826301038265228, 'learning_rate': 9.299264942314358e-06, 'epoch': 0.76}

 25%|██▌       | 2801/11049 [28:50<1:24:19,  1.63it/s]
 25%|██▌       | 2802/11049 [28:51<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2542, 'grad_norm': 0.48946747183799744, 'learning_rate': 9.298458254477165e-06, 'epoch': 0.76}

 25%|██▌       | 2802/11049 [28:51<1:24:19,  1.63it/s]
 25%|██▌       | 2803/11049 [28:51<1:24:19,  1.63it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.46720072627067566, 'learning_rate': 9.29765113760744e-06, 'epoch': 0.76}

 25%|██▌       | 2803/11049 [28:51<1:24:19,  1.63it/s]
 25%|██▌       | 2804/11049 [28:52<1:24:17,  1.63it/s]
                                                      
{'loss': 0.2328, 'grad_norm': 0.5429391264915466, 'learning_rate': 9.296843591785743e-06, 'epoch': 0.76}

 25%|██▌       | 2804/11049 [28:52<1:24:17,  1.63it/s]
 25%|██▌       | 2805/11049 [28:53<1:24:17,  1.63it/s]
                                                      
{'loss': 0.2835, 'grad_norm': 0.6070536971092224, 'learning_rate': 9.296035617092673e-06, 'epoch': 0.76}

 25%|██▌       | 2805/11049 [28:53<1:24:17,  1.63it/s]
 25%|██▌       | 2806/11049 [28:53<1:24:15,  1.63it/s]
                                                      
{'loss': 0.237, 'grad_norm': 0.5220380425453186, 'learning_rate': 9.29522721360888e-06, 'epoch': 0.76}

 25%|██▌       | 2806/11049 [28:53<1:24:15,  1.63it/s]
 25%|██▌       | 2807/11049 [28:54<1:24:13,  1.63it/s]
                                                      
{'loss': 0.3149, 'grad_norm': 0.6149123311042786, 'learning_rate': 9.294418381415048e-06, 'epoch': 0.76}

 25%|██▌       | 2807/11049 [28:54<1:24:13,  1.63it/s]
 25%|██▌       | 2808/11049 [28:54<1:24:14,  1.63it/s]
                                                      
{'loss': 0.2216, 'grad_norm': 0.5442031025886536, 'learning_rate': 9.293609120591906e-06, 'epoch': 0.76}

 25%|██▌       | 2808/11049 [28:55<1:24:14,  1.63it/s]
 25%|██▌       | 2809/11049 [28:55<1:24:13,  1.63it/s]
                                                      
{'loss': 0.2526, 'grad_norm': 0.5364403128623962, 'learning_rate': 9.292799431220229e-06, 'epoch': 0.76}

 25%|██▌       | 2809/11049 [28:55<1:24:13,  1.63it/s]
 25%|██▌       | 2810/11049 [28:56<1:24:12,  1.63it/s]
                                                      
{'loss': 0.3516, 'grad_norm': 0.5341078639030457, 'learning_rate': 9.291989313380833e-06, 'epoch': 0.76}

 25%|██▌       | 2810/11049 [28:56<1:24:12,  1.63it/s]
 25%|██▌       | 2811/11049 [28:56<1:24:11,  1.63it/s]
                                                      
{'loss': 0.2791, 'grad_norm': 0.6160504221916199, 'learning_rate': 9.291178767154576e-06, 'epoch': 0.76}

 25%|██▌       | 2811/11049 [28:56<1:24:11,  1.63it/s]
 25%|██▌       | 2812/11049 [28:57<1:24:14,  1.63it/s]
                                                      
{'loss': 0.2762, 'grad_norm': 0.5887852311134338, 'learning_rate': 9.290367792622358e-06, 'epoch': 0.76}

 25%|██▌       | 2812/11049 [28:57<1:24:14,  1.63it/s]
 25%|██▌       | 2813/11049 [28:57<1:24:11,  1.63it/s]
                                                      
{'loss': 0.3058, 'grad_norm': 0.590791642665863, 'learning_rate': 9.289556389865125e-06, 'epoch': 0.76}

 25%|██▌       | 2813/11049 [28:58<1:24:11,  1.63it/s]
 25%|██▌       | 2814/11049 [28:58<1:24:13,  1.63it/s]
                                                      
{'loss': 0.2622, 'grad_norm': 0.5826518535614014, 'learning_rate': 9.28874455896386e-06, 'epoch': 0.76}

 25%|██▌       | 2814/11049 [28:58<1:24:13,  1.63it/s]
 25%|██▌       | 2815/11049 [28:59<1:24:12,  1.63it/s]
                                                      
{'loss': 0.254, 'grad_norm': 0.5350574254989624, 'learning_rate': 9.287932299999599e-06, 'epoch': 0.76}

 25%|██▌       | 2815/11049 [28:59<1:24:12,  1.63it/s]
 25%|██▌       | 2816/11049 [28:59<1:24:11,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.5674676299095154, 'learning_rate': 9.287119613053407e-06, 'epoch': 0.76}

 25%|██▌       | 2816/11049 [28:59<1:24:11,  1.63it/s]
 25%|██▌       | 2817/11049 [29:00<1:24:10,  1.63it/s]
                                                      
{'loss': 0.2349, 'grad_norm': 0.5692254900932312, 'learning_rate': 9.286306498206405e-06, 'epoch': 0.76}

 25%|██▌       | 2817/11049 [29:00<1:24:10,  1.63it/s]
 26%|██▌       | 2818/11049 [29:01<1:24:08,  1.63it/s]
                                                      
{'loss': 0.2837, 'grad_norm': 0.5408798456192017, 'learning_rate': 9.285492955539747e-06, 'epoch': 0.77}

 26%|██▌       | 2818/11049 [29:01<1:24:08,  1.63it/s]
 26%|██▌       | 2819/11049 [29:01<1:24:07,  1.63it/s]
                                                      
{'loss': 0.2303, 'grad_norm': 0.5260449051856995, 'learning_rate': 9.284678985134635e-06, 'epoch': 0.77}

 26%|██▌       | 2819/11049 [29:01<1:24:07,  1.63it/s]
 26%|██▌       | 2820/11049 [29:02<1:24:06,  1.63it/s]
                                                      
{'loss': 0.2624, 'grad_norm': 0.49430468678474426, 'learning_rate': 9.283864587072311e-06, 'epoch': 0.77}

 26%|██▌       | 2820/11049 [29:02<1:24:06,  1.63it/s]
 26%|██▌       | 2821/11049 [29:02<1:24:07,  1.63it/s]
                                                      
{'loss': 0.2407, 'grad_norm': 0.5301417708396912, 'learning_rate': 9.283049761434059e-06, 'epoch': 0.77}

 26%|██▌       | 2821/11049 [29:03<1:24:07,  1.63it/s]
 26%|██▌       | 2822/11049 [29:03<1:24:06,  1.63it/s]
                                                      
{'loss': 0.261, 'grad_norm': 0.5269660949707031, 'learning_rate': 9.282234508301213e-06, 'epoch': 0.77}

 26%|██▌       | 2822/11049 [29:03<1:24:06,  1.63it/s]
 26%|██▌       | 2823/11049 [29:04<1:24:07,  1.63it/s]
                                                      
{'loss': 0.2913, 'grad_norm': 0.5935447216033936, 'learning_rate': 9.281418827755138e-06, 'epoch': 0.77}

 26%|██▌       | 2823/11049 [29:04<1:24:07,  1.63it/s]
 26%|██▌       | 2824/11049 [29:04<1:24:06,  1.63it/s]
                                                      
{'loss': 0.2345, 'grad_norm': 0.5105451941490173, 'learning_rate': 9.280602719877252e-06, 'epoch': 0.77}

 26%|██▌       | 2824/11049 [29:04<1:24:06,  1.63it/s]
 26%|██▌       | 2825/11049 [29:05<1:24:05,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.5473642945289612, 'learning_rate': 9.27978618474901e-06, 'epoch': 0.77}

 26%|██▌       | 2825/11049 [29:05<1:24:05,  1.63it/s]
 26%|██▌       | 2826/11049 [29:05<1:24:05,  1.63it/s]
                                                      
{'loss': 0.2553, 'grad_norm': 0.5797144174575806, 'learning_rate': 9.278969222451908e-06, 'epoch': 0.77}

 26%|██▌       | 2826/11049 [29:06<1:24:05,  1.63it/s]
 26%|██▌       | 2827/11049 [29:06<1:24:04,  1.63it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.6858102679252625, 'learning_rate': 9.278151833067493e-06, 'epoch': 0.77}

 26%|██▌       | 2827/11049 [29:06<1:24:04,  1.63it/s]
 26%|██▌       | 2828/11049 [29:07<1:24:01,  1.63it/s]
                                                      
{'loss': 0.272, 'grad_norm': 0.5936856865882874, 'learning_rate': 9.277334016677343e-06, 'epoch': 0.77}

 26%|██▌       | 2828/11049 [29:07<1:24:01,  1.63it/s]
 26%|██▌       | 2829/11049 [29:07<1:24:00,  1.63it/s]
                                                      
{'loss': 0.2806, 'grad_norm': 0.545828104019165, 'learning_rate': 9.276515773363093e-06, 'epoch': 0.77}

 26%|██▌       | 2829/11049 [29:07<1:24:00,  1.63it/s]
 26%|██▌       | 2830/11049 [29:08<1:23:59,  1.63it/s]
                                                      
{'loss': 0.3005, 'grad_norm': 0.6452248096466064, 'learning_rate': 9.275697103206406e-06, 'epoch': 0.77}

 26%|██▌       | 2830/11049 [29:08<1:23:59,  1.63it/s]
 26%|██▌       | 2831/11049 [29:09<1:23:59,  1.63it/s]
                                                      
{'loss': 0.3185, 'grad_norm': 0.6262524724006653, 'learning_rate': 9.274878006288996e-06, 'epoch': 0.77}

 26%|██▌       | 2831/11049 [29:09<1:23:59,  1.63it/s]
 26%|██▌       | 2832/11049 [29:09<1:23:59,  1.63it/s]
                                                      
{'loss': 0.2255, 'grad_norm': 0.5523805618286133, 'learning_rate': 9.274058482692618e-06, 'epoch': 0.77}

 26%|██▌       | 2832/11049 [29:09<1:23:59,  1.63it/s]
 26%|██▌       | 2833/11049 [29:10<1:23:58,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.5245212316513062, 'learning_rate': 9.273238532499068e-06, 'epoch': 0.77}

 26%|██▌       | 2833/11049 [29:10<1:23:58,  1.63it/s]
 26%|██▌       | 2834/11049 [29:10<1:23:55,  1.63it/s]
                                                      
{'loss': 0.4369, 'grad_norm': 0.6846539378166199, 'learning_rate': 9.27241815579019e-06, 'epoch': 0.77}

 26%|██▌       | 2834/11049 [29:11<1:23:55,  1.63it/s]
 26%|██▌       | 2835/11049 [29:11<1:23:54,  1.63it/s]
                                                      
{'loss': 0.2339, 'grad_norm': 0.5234231948852539, 'learning_rate': 9.271597352647862e-06, 'epoch': 0.77}

 26%|██▌       | 2835/11049 [29:11<1:23:54,  1.63it/s]
 26%|██▌       | 2836/11049 [29:12<1:23:55,  1.63it/s]
                                                      
{'loss': 0.3456, 'grad_norm': 0.5918924808502197, 'learning_rate': 9.27077612315401e-06, 'epoch': 0.77}

 26%|██▌       | 2836/11049 [29:12<1:23:55,  1.63it/s]
 26%|██▌       | 2837/11049 [29:12<1:23:54,  1.63it/s]
                                                      
{'loss': 0.2756, 'grad_norm': 0.5793101787567139, 'learning_rate': 9.269954467390604e-06, 'epoch': 0.77}

 26%|██▌       | 2837/11049 [29:12<1:23:54,  1.63it/s]
 26%|██▌       | 2838/11049 [29:13<1:23:55,  1.63it/s]
                                                      
{'loss': 0.2426, 'grad_norm': 0.5586805939674377, 'learning_rate': 9.269132385439649e-06, 'epoch': 0.77}

 26%|██▌       | 2838/11049 [29:13<1:23:55,  1.63it/s]
 26%|██▌       | 2839/11049 [29:13<1:23:55,  1.63it/s]
                                                      
{'loss': 0.323, 'grad_norm': 0.5706126093864441, 'learning_rate': 9.268309877383202e-06, 'epoch': 0.77}

 26%|██▌       | 2839/11049 [29:14<1:23:55,  1.63it/s]
 26%|██▌       | 2840/11049 [29:14<1:23:54,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.49457842111587524, 'learning_rate': 9.267486943303358e-06, 'epoch': 0.77}

 26%|██▌       | 2840/11049 [29:14<1:23:54,  1.63it/s]
 26%|██▌       | 2841/11049 [29:15<1:23:54,  1.63it/s]
                                                      
{'loss': 0.2617, 'grad_norm': 0.5219296813011169, 'learning_rate': 9.266663583282254e-06, 'epoch': 0.77}

 26%|██▌       | 2841/11049 [29:15<1:23:54,  1.63it/s]
 26%|██▌       | 2842/11049 [29:15<1:23:53,  1.63it/s]
                                                      
{'loss': 0.3006, 'grad_norm': 0.6040313243865967, 'learning_rate': 9.265839797402068e-06, 'epoch': 0.77}

 26%|██▌       | 2842/11049 [29:15<1:23:53,  1.63it/s]
 26%|██▌       | 2843/11049 [29:16<1:23:50,  1.63it/s]
                                                      
{'loss': 0.2347, 'grad_norm': 0.497732937335968, 'learning_rate': 9.265015585745028e-06, 'epoch': 0.77}

 26%|██▌       | 2843/11049 [29:16<1:23:50,  1.63it/s]
 26%|██▌       | 2844/11049 [29:17<1:23:49,  1.63it/s]
                                                      
{'loss': 0.2896, 'grad_norm': 0.540136456489563, 'learning_rate': 9.264190948393392e-06, 'epoch': 0.77}

 26%|██▌       | 2844/11049 [29:17<1:23:49,  1.63it/s]
 26%|██▌       | 2845/11049 [29:17<1:23:49,  1.63it/s]
                                                      
{'loss': 0.3795, 'grad_norm': 0.6428734660148621, 'learning_rate': 9.263365885429474e-06, 'epoch': 0.77}

 26%|██▌       | 2845/11049 [29:17<1:23:49,  1.63it/s]
 26%|██▌       | 2846/11049 [29:18<1:23:49,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.5098751783370972, 'learning_rate': 9.26254039693562e-06, 'epoch': 0.77}

 26%|██▌       | 2846/11049 [29:18<1:23:49,  1.63it/s]
 26%|██▌       | 2847/11049 [29:18<1:23:48,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.5343321561813354, 'learning_rate': 9.261714482994226e-06, 'epoch': 0.77}

 26%|██▌       | 2847/11049 [29:18<1:23:48,  1.63it/s]
 26%|██▌       | 2848/11049 [29:19<1:23:47,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5150352120399475, 'learning_rate': 9.260888143687725e-06, 'epoch': 0.77}

 26%|██▌       | 2848/11049 [29:19<1:23:47,  1.63it/s]
 26%|██▌       | 2849/11049 [29:20<1:23:46,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5262842178344727, 'learning_rate': 9.260061379098596e-06, 'epoch': 0.77}

 26%|██▌       | 2849/11049 [29:20<1:23:46,  1.63it/s]
 26%|██▌       | 2850/11049 [29:20<1:23:44,  1.63it/s]
                                                      
{'loss': 0.2445, 'grad_norm': 0.5470294952392578, 'learning_rate': 9.259234189309359e-06, 'epoch': 0.77}

 26%|██▌       | 2850/11049 [29:20<1:23:44,  1.63it/s]
 26%|██▌       | 2851/11049 [29:21<1:23:45,  1.63it/s]
                                                      
{'loss': 0.2183, 'grad_norm': 0.5023685097694397, 'learning_rate': 9.258406574402573e-06, 'epoch': 0.77}

 26%|██▌       | 2851/11049 [29:21<1:23:45,  1.63it/s]
 26%|██▌       | 2852/11049 [29:21<1:23:45,  1.63it/s]
                                                      
{'loss': 0.2371, 'grad_norm': 0.5880459547042847, 'learning_rate': 9.257578534460846e-06, 'epoch': 0.77}

 26%|██▌       | 2852/11049 [29:22<1:23:45,  1.63it/s]
 26%|██▌       | 2853/11049 [29:22<1:23:42,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.4707866609096527, 'learning_rate': 9.256750069566827e-06, 'epoch': 0.77}

 26%|██▌       | 2853/11049 [29:22<1:23:42,  1.63it/s]
 26%|██▌       | 2854/11049 [29:23<1:23:41,  1.63it/s]
                                                      
{'loss': 0.2377, 'grad_norm': 0.599362850189209, 'learning_rate': 9.255921179803202e-06, 'epoch': 0.77}

 26%|██▌       | 2854/11049 [29:23<1:23:41,  1.63it/s]
 26%|██▌       | 2855/11049 [29:23<1:23:44,  1.63it/s]
                                                      
{'loss': 0.2866, 'grad_norm': 0.6589441895484924, 'learning_rate': 9.255091865252705e-06, 'epoch': 0.78}

 26%|██▌       | 2855/11049 [29:23<1:23:44,  1.63it/s]
 26%|██▌       | 2856/11049 [29:24<1:23:44,  1.63it/s]
                                                      
{'loss': 0.2617, 'grad_norm': 0.5500658750534058, 'learning_rate': 9.25426212599811e-06, 'epoch': 0.78}

 26%|██▌       | 2856/11049 [29:24<1:23:44,  1.63it/s]
 26%|██▌       | 2857/11049 [29:24<1:23:46,  1.63it/s]
                                                      
{'loss': 0.2357, 'grad_norm': 0.5575253963470459, 'learning_rate': 9.253431962122234e-06, 'epoch': 0.78}

 26%|██▌       | 2857/11049 [29:25<1:23:46,  1.63it/s]
 26%|██▌       | 2858/11049 [29:25<1:23:46,  1.63it/s]
                                                      
{'loss': 0.3705, 'grad_norm': 0.6275530457496643, 'learning_rate': 9.252601373707937e-06, 'epoch': 0.78}

 26%|██▌       | 2858/11049 [29:25<1:23:46,  1.63it/s]
 26%|██▌       | 2859/11049 [29:26<1:23:41,  1.63it/s]
                                                      
{'loss': 0.252, 'grad_norm': 0.5745367407798767, 'learning_rate': 9.251770360838122e-06, 'epoch': 0.78}

 26%|██▌       | 2859/11049 [29:26<1:23:41,  1.63it/s]
 26%|██▌       | 2860/11049 [29:26<1:23:43,  1.63it/s]
                                                      
{'loss': 0.3088, 'grad_norm': 0.5868473649024963, 'learning_rate': 9.250938923595729e-06, 'epoch': 0.78}

 26%|██▌       | 2860/11049 [29:26<1:23:43,  1.63it/s]
 26%|██▌       | 2861/11049 [29:27<1:23:40,  1.63it/s]
                                                      
{'loss': 0.1705, 'grad_norm': 0.4364475607872009, 'learning_rate': 9.250107062063748e-06, 'epoch': 0.78}

 26%|██▌       | 2861/11049 [29:27<1:23:40,  1.63it/s]
 26%|██▌       | 2862/11049 [29:28<1:23:37,  1.63it/s]
                                                      
{'loss': 0.2752, 'grad_norm': 0.5962104797363281, 'learning_rate': 9.249274776325205e-06, 'epoch': 0.78}

 26%|██▌       | 2862/11049 [29:28<1:23:37,  1.63it/s]
 26%|██▌       | 2863/11049 [29:28<1:23:39,  1.63it/s]
                                                      
{'loss': 0.3105, 'grad_norm': 0.662752628326416, 'learning_rate': 9.248442066463175e-06, 'epoch': 0.78}

 26%|██▌       | 2863/11049 [29:28<1:23:39,  1.63it/s]
 26%|██▌       | 2864/11049 [29:29<1:23:40,  1.63it/s]
                                                      
{'loss': 0.3229, 'grad_norm': 0.6145214438438416, 'learning_rate': 9.247608932560767e-06, 'epoch': 0.78}

 26%|██▌       | 2864/11049 [29:29<1:23:40,  1.63it/s]
 26%|██▌       | 2865/11049 [29:29<1:23:39,  1.63it/s]
                                                      
{'loss': 0.2601, 'grad_norm': 0.5623196363449097, 'learning_rate': 9.246775374701139e-06, 'epoch': 0.78}

 26%|██▌       | 2865/11049 [29:30<1:23:39,  1.63it/s]
 26%|██▌       | 2866/11049 [29:30<1:23:38,  1.63it/s]
                                                      
{'loss': 0.2554, 'grad_norm': 0.5184954404830933, 'learning_rate': 9.24594139296749e-06, 'epoch': 0.78}

 26%|██▌       | 2866/11049 [29:30<1:23:38,  1.63it/s]
 26%|██▌       | 2867/11049 [29:31<1:23:40,  1.63it/s]
                                                      
{'loss': 0.3891, 'grad_norm': 0.6054102778434753, 'learning_rate': 9.245106987443058e-06, 'epoch': 0.78}

 26%|██▌       | 2867/11049 [29:31<1:23:40,  1.63it/s]
 26%|██▌       | 2868/11049 [29:31<1:23:39,  1.63it/s]
                                                      
{'loss': 0.2726, 'grad_norm': 0.5295130610466003, 'learning_rate': 9.244272158211127e-06, 'epoch': 0.78}

 26%|██▌       | 2868/11049 [29:31<1:23:39,  1.63it/s]
 26%|██▌       | 2869/11049 [29:32<1:23:37,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.5547171235084534, 'learning_rate': 9.243436905355022e-06, 'epoch': 0.78}

 26%|██▌       | 2869/11049 [29:32<1:23:37,  1.63it/s]
 26%|██▌       | 2870/11049 [29:32<1:23:39,  1.63it/s]
                                                      
{'loss': 0.2572, 'grad_norm': 0.5671428442001343, 'learning_rate': 9.24260122895811e-06, 'epoch': 0.78}

 26%|██▌       | 2870/11049 [29:33<1:23:39,  1.63it/s]
 26%|██▌       | 2871/11049 [29:33<1:23:36,  1.63it/s]
                                                      
{'loss': 0.2845, 'grad_norm': 0.5566624402999878, 'learning_rate': 9.2417651291038e-06, 'epoch': 0.78}

 26%|██▌       | 2871/11049 [29:33<1:23:36,  1.63it/s]
 26%|██▌       | 2872/11049 [29:34<1:23:37,  1.63it/s]
                                                      
{'loss': 0.2135, 'grad_norm': 0.5044978857040405, 'learning_rate': 9.240928605875547e-06, 'epoch': 0.78}

 26%|██▌       | 2872/11049 [29:34<1:23:37,  1.63it/s]
 26%|██▌       | 2873/11049 [29:34<1:23:35,  1.63it/s]
                                                      
{'loss': 0.2375, 'grad_norm': 0.5100244283676147, 'learning_rate': 9.24009165935684e-06, 'epoch': 0.78}

 26%|██▌       | 2873/11049 [29:34<1:23:35,  1.63it/s]
 26%|██▌       | 2874/11049 [29:35<1:23:34,  1.63it/s]
                                                      
{'loss': 0.3129, 'grad_norm': 0.6428341269493103, 'learning_rate': 9.23925428963122e-06, 'epoch': 0.78}

 26%|██▌       | 2874/11049 [29:35<1:23:34,  1.63it/s]
 26%|██▌       | 2875/11049 [29:36<1:23:34,  1.63it/s]
                                                      
{'loss': 0.2947, 'grad_norm': 0.5318441390991211, 'learning_rate': 9.23841649678226e-06, 'epoch': 0.78}

 26%|██▌       | 2875/11049 [29:36<1:23:34,  1.63it/s]
 26%|██▌       | 2876/11049 [29:36<1:23:34,  1.63it/s]
                                                      
{'loss': 0.3105, 'grad_norm': 0.6486194133758545, 'learning_rate': 9.237578280893587e-06, 'epoch': 0.78}

 26%|██▌       | 2876/11049 [29:36<1:23:34,  1.63it/s]
 26%|██▌       | 2877/11049 [29:37<1:23:32,  1.63it/s]
                                                      
{'loss': 0.2647, 'grad_norm': 0.5503734946250916, 'learning_rate': 9.236739642048859e-06, 'epoch': 0.78}

 26%|██▌       | 2877/11049 [29:37<1:23:32,  1.63it/s]
 26%|██▌       | 2878/11049 [29:37<1:23:29,  1.63it/s]
                                                      
{'loss': 0.2188, 'grad_norm': 0.4754781424999237, 'learning_rate': 9.235900580331785e-06, 'epoch': 0.78}

 26%|██▌       | 2878/11049 [29:37<1:23:29,  1.63it/s]
 26%|██▌       | 2879/11049 [29:38<1:23:27,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.5499008297920227, 'learning_rate': 9.23506109582611e-06, 'epoch': 0.78}

 26%|██▌       | 2879/11049 [29:38<1:23:27,  1.63it/s]
 26%|██▌       | 2880/11049 [29:39<1:23:27,  1.63it/s]
                                                      
{'loss': 0.3411, 'grad_norm': 0.7244999408721924, 'learning_rate': 9.234221188615624e-06, 'epoch': 0.78}

 26%|██▌       | 2880/11049 [29:39<1:23:27,  1.63it/s]
 26%|██▌       | 2881/11049 [29:39<1:23:27,  1.63it/s]
                                                      
{'loss': 0.29, 'grad_norm': 0.5392559766769409, 'learning_rate': 9.23338085878416e-06, 'epoch': 0.78}

 26%|██▌       | 2881/11049 [29:39<1:23:27,  1.63it/s]
 26%|██▌       | 2882/11049 [29:40<1:23:28,  1.63it/s]
                                                      
{'loss': 0.3393, 'grad_norm': 0.6206395030021667, 'learning_rate': 9.232540106415591e-06, 'epoch': 0.78}

 26%|██▌       | 2882/11049 [29:40<1:23:28,  1.63it/s]
 26%|██▌       | 2883/11049 [29:40<1:23:28,  1.63it/s]
                                                      
{'loss': 0.306, 'grad_norm': 0.6568324565887451, 'learning_rate': 9.231698931593833e-06, 'epoch': 0.78}

 26%|██▌       | 2883/11049 [29:41<1:23:28,  1.63it/s]
 26%|██▌       | 2884/11049 [29:41<1:23:27,  1.63it/s]
                                                      
{'loss': 0.2137, 'grad_norm': 0.48001110553741455, 'learning_rate': 9.230857334402845e-06, 'epoch': 0.78}

 26%|██▌       | 2884/11049 [29:41<1:23:27,  1.63it/s]
 26%|██▌       | 2885/11049 [29:42<1:23:27,  1.63it/s]
                                                      
{'loss': 0.317, 'grad_norm': 0.6291239857673645, 'learning_rate': 9.230015314926625e-06, 'epoch': 0.78}

 26%|██▌       | 2885/11049 [29:42<1:23:27,  1.63it/s]
 26%|██▌       | 2886/11049 [29:42<1:23:25,  1.63it/s]
                                                      
{'loss': 0.2549, 'grad_norm': 0.5374317169189453, 'learning_rate': 9.22917287324922e-06, 'epoch': 0.78}

 26%|██▌       | 2886/11049 [29:42<1:23:25,  1.63it/s]
 26%|██▌       | 2887/11049 [29:43<1:23:25,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.5200601816177368, 'learning_rate': 9.228330009454712e-06, 'epoch': 0.78}

 26%|██▌       | 2887/11049 [29:43<1:23:25,  1.63it/s]
 26%|██▌       | 2888/11049 [29:43<1:23:23,  1.63it/s]
                                                      
{'loss': 0.3156, 'grad_norm': 0.6599538922309875, 'learning_rate': 9.227486723627227e-06, 'epoch': 0.78}

 26%|██▌       | 2888/11049 [29:44<1:23:23,  1.63it/s]
 26%|██▌       | 2889/11049 [29:44<1:23:21,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.5667682886123657, 'learning_rate': 9.226643015850938e-06, 'epoch': 0.78}

 26%|██▌       | 2889/11049 [29:44<1:23:21,  1.63it/s]
 26%|██▌       | 2890/11049 [29:45<1:23:20,  1.63it/s]
                                                      
{'loss': 0.302, 'grad_norm': 0.6193268299102783, 'learning_rate': 9.225798886210053e-06, 'epoch': 0.78}

 26%|██▌       | 2890/11049 [29:45<1:23:20,  1.63it/s]
 26%|██▌       | 2891/11049 [29:45<1:23:21,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.4147490859031677, 'learning_rate': 9.224954334788825e-06, 'epoch': 0.78}

 26%|██▌       | 2891/11049 [29:45<1:23:21,  1.63it/s]
 26%|██▌       | 2892/11049 [29:46<1:23:21,  1.63it/s]
                                                      
{'loss': 0.2728, 'grad_norm': 0.5601871609687805, 'learning_rate': 9.224109361671549e-06, 'epoch': 0.79}

 26%|██▌       | 2892/11049 [29:46<1:23:21,  1.63it/s]
 26%|██▌       | 2893/11049 [29:47<1:23:22,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.48218590021133423, 'learning_rate': 9.223263966942566e-06, 'epoch': 0.79}

 26%|██▌       | 2893/11049 [29:47<1:23:22,  1.63it/s]
 26%|██▌       | 2894/11049 [29:47<1:23:20,  1.63it/s]
                                                      
{'loss': 0.2604, 'grad_norm': 0.5121328830718994, 'learning_rate': 9.22241815068625e-06, 'epoch': 0.79}

 26%|██▌       | 2894/11049 [29:47<1:23:20,  1.63it/s]
 26%|██▌       | 2895/11049 [29:48<1:23:22,  1.63it/s]
                                                      
{'loss': 0.2832, 'grad_norm': 0.618471086025238, 'learning_rate': 9.221571912987028e-06, 'epoch': 0.79}

 26%|██▌       | 2895/11049 [29:48<1:23:22,  1.63it/s]
 26%|██▌       | 2896/11049 [29:48<1:23:19,  1.63it/s]
                                                      
{'loss': 0.3142, 'grad_norm': 0.5993690490722656, 'learning_rate': 9.22072525392936e-06, 'epoch': 0.79}

 26%|██▌       | 2896/11049 [29:49<1:23:19,  1.63it/s]
 26%|██▌       | 2897/11049 [29:49<1:23:17,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.5067384243011475, 'learning_rate': 9.219878173597755e-06, 'epoch': 0.79}

 26%|██▌       | 2897/11049 [29:49<1:23:17,  1.63it/s]
 26%|██▌       | 2898/11049 [29:50<1:23:20,  1.63it/s]
                                                      
{'loss': 0.2593, 'grad_norm': 0.5828992128372192, 'learning_rate': 9.219030672076759e-06, 'epoch': 0.79}

 26%|██▌       | 2898/11049 [29:50<1:23:20,  1.63it/s]
 26%|██▌       | 2899/11049 [29:50<1:23:21,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.544247567653656, 'learning_rate': 9.218182749450959e-06, 'epoch': 0.79}

 26%|██▌       | 2899/11049 [29:50<1:23:21,  1.63it/s]
 26%|██▌       | 2900/11049 [29:51<1:23:22,  1.63it/s]
                                                      
{'loss': 0.3507, 'grad_norm': 0.5946164727210999, 'learning_rate': 9.217334405804991e-06, 'epoch': 0.79}

 26%|██▌       | 2900/11049 [29:51<1:23:22,  1.63it/s]
 26%|██▋       | 2901/11049 [29:51<1:23:21,  1.63it/s]
                                                      
{'loss': 0.238, 'grad_norm': 0.49873077869415283, 'learning_rate': 9.216485641223527e-06, 'epoch': 0.79}

 26%|██▋       | 2901/11049 [29:52<1:23:21,  1.63it/s]
 26%|██▋       | 2902/11049 [29:52<1:23:18,  1.63it/s]
                                                      
{'loss': 0.2341, 'grad_norm': 0.531603991985321, 'learning_rate': 9.215636455791284e-06, 'epoch': 0.79}

 26%|██▋       | 2902/11049 [29:52<1:23:18,  1.63it/s]
 26%|██▋       | 2903/11049 [29:53<1:23:18,  1.63it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.5035243630409241, 'learning_rate': 9.214786849593018e-06, 'epoch': 0.79}

 26%|██▋       | 2903/11049 [29:53<1:23:18,  1.63it/s]
 26%|██▋       | 2904/11049 [29:53<1:23:18,  1.63it/s]
                                                      
{'loss': 0.2939, 'grad_norm': 0.5920828580856323, 'learning_rate': 9.213936822713532e-06, 'epoch': 0.79}

 26%|██▋       | 2904/11049 [29:53<1:23:18,  1.63it/s]
 26%|██▋       | 2905/11049 [29:54<1:23:15,  1.63it/s]
                                                      
{'loss': 0.2947, 'grad_norm': 0.6153913140296936, 'learning_rate': 9.213086375237662e-06, 'epoch': 0.79}

 26%|██▋       | 2905/11049 [29:54<1:23:15,  1.63it/s]
 26%|██▋       | 2906/11049 [29:55<1:23:16,  1.63it/s]
                                                      
{'loss': 0.2356, 'grad_norm': 0.48183122277259827, 'learning_rate': 9.2122355072503e-06, 'epoch': 0.79}

 26%|██▋       | 2906/11049 [29:55<1:23:16,  1.63it/s]
 26%|██▋       | 2907/11049 [29:55<1:23:13,  1.63it/s]
                                                      
{'loss': 0.2746, 'grad_norm': 0.5817398428916931, 'learning_rate': 9.211384218836365e-06, 'epoch': 0.79}

 26%|██▋       | 2907/11049 [29:55<1:23:13,  1.63it/s]
 26%|██▋       | 2908/11049 [29:56<1:23:11,  1.63it/s]
                                                      
{'loss': 0.2082, 'grad_norm': 0.4900316894054413, 'learning_rate': 9.210532510080827e-06, 'epoch': 0.79}

 26%|██▋       | 2908/11049 [29:56<1:23:11,  1.63it/s]
 26%|██▋       | 2909/11049 [29:56<1:23:10,  1.63it/s]
                                                      
{'loss': 0.2664, 'grad_norm': 0.6475486159324646, 'learning_rate': 9.209680381068698e-06, 'epoch': 0.79}

 26%|██▋       | 2909/11049 [29:56<1:23:10,  1.63it/s]
 26%|██▋       | 2910/11049 [29:57<1:23:12,  1.63it/s]
                                                      
{'loss': 0.5458, 'grad_norm': 0.8245497941970825, 'learning_rate': 9.208827831885026e-06, 'epoch': 0.79}

 26%|██▋       | 2910/11049 [29:57<1:23:12,  1.63it/s]
 26%|██▋       | 2911/11049 [29:58<1:23:11,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.5481191277503967, 'learning_rate': 9.207974862614906e-06, 'epoch': 0.79}

 26%|██▋       | 2911/11049 [29:58<1:23:11,  1.63it/s]
 26%|██▋       | 2912/11049 [29:58<1:23:08,  1.63it/s]
                                                      
{'loss': 0.2226, 'grad_norm': 0.49175792932510376, 'learning_rate': 9.207121473343472e-06, 'epoch': 0.79}

 26%|██▋       | 2912/11049 [29:58<1:23:08,  1.63it/s]
 26%|██▋       | 2913/11049 [29:59<1:23:09,  1.63it/s]
                                                      
{'loss': 0.2653, 'grad_norm': 0.6392480731010437, 'learning_rate': 9.206267664155906e-06, 'epoch': 0.79}

 26%|██▋       | 2913/11049 [29:59<1:23:09,  1.63it/s]
 26%|██▋       | 2914/11049 [29:59<1:23:09,  1.63it/s]
                                                      
{'loss': 0.2376, 'grad_norm': 0.5195857286453247, 'learning_rate': 9.205413435137424e-06, 'epoch': 0.79}

 26%|██▋       | 2914/11049 [30:00<1:23:09,  1.63it/s]
 26%|██▋       | 2915/11049 [30:00<1:23:07,  1.63it/s]
                                                      
{'loss': 0.2347, 'grad_norm': 0.5132607221603394, 'learning_rate': 9.204558786373288e-06, 'epoch': 0.79}

 26%|██▋       | 2915/11049 [30:00<1:23:07,  1.63it/s]
 26%|██▋       | 2916/11049 [30:01<1:23:06,  1.63it/s]
                                                      
{'loss': 0.2431, 'grad_norm': 0.5775930285453796, 'learning_rate': 9.203703717948802e-06, 'epoch': 0.79}

 26%|██▋       | 2916/11049 [30:01<1:23:06,  1.63it/s]
 26%|██▋       | 2917/11049 [30:01<1:23:07,  1.63it/s]
                                                      
{'loss': 0.2851, 'grad_norm': 0.5671985745429993, 'learning_rate': 9.202848229949309e-06, 'epoch': 0.79}

 26%|██▋       | 2917/11049 [30:01<1:23:07,  1.63it/s]
 26%|██▋       | 2918/11049 [30:02<1:23:07,  1.63it/s]
                                                      
{'loss': 0.2763, 'grad_norm': 0.504474401473999, 'learning_rate': 9.201992322460196e-06, 'epoch': 0.79}

 26%|██▋       | 2918/11049 [30:02<1:23:07,  1.63it/s]
 26%|██▋       | 2919/11049 [30:03<1:23:05,  1.63it/s]
                                                      
{'loss': 0.2807, 'grad_norm': 0.5671513080596924, 'learning_rate': 9.201135995566895e-06, 'epoch': 0.79}

 26%|██▋       | 2919/11049 [30:03<1:23:05,  1.63it/s]
 26%|██▋       | 2920/11049 [30:03<1:23:06,  1.63it/s]
                                                      
{'loss': 0.2331, 'grad_norm': 0.4660123288631439, 'learning_rate': 9.200279249354871e-06, 'epoch': 0.79}

 26%|██▋       | 2920/11049 [30:03<1:23:06,  1.63it/s]
 26%|██▋       | 2921/11049 [30:04<1:23:04,  1.63it/s]
                                                      
{'loss': 0.2091, 'grad_norm': 0.47913551330566406, 'learning_rate': 9.199422083909644e-06, 'epoch': 0.79}

 26%|██▋       | 2921/11049 [30:04<1:23:04,  1.63it/s]
 26%|██▋       | 2922/11049 [30:04<1:23:01,  1.63it/s]
                                                      
{'loss': 0.2672, 'grad_norm': 0.5026220679283142, 'learning_rate': 9.198564499316763e-06, 'epoch': 0.79}

 26%|██▋       | 2922/11049 [30:04<1:23:01,  1.63it/s]
 26%|██▋       | 2923/11049 [30:05<1:23:01,  1.63it/s]
                                                      
{'loss': 0.2435, 'grad_norm': 0.5323084592819214, 'learning_rate': 9.197706495661824e-06, 'epoch': 0.79}

 26%|██▋       | 2923/11049 [30:05<1:23:01,  1.63it/s]
 26%|██▋       | 2924/11049 [30:06<1:22:59,  1.63it/s]
                                                      
{'loss': 0.2191, 'grad_norm': 0.5053925514221191, 'learning_rate': 9.196848073030469e-06, 'epoch': 0.79}

 26%|██▋       | 2924/11049 [30:06<1:22:59,  1.63it/s]
 26%|██▋       | 2925/11049 [30:06<1:22:57,  1.63it/s]
                                                      
{'loss': 0.225, 'grad_norm': 0.5034657716751099, 'learning_rate': 9.195989231508373e-06, 'epoch': 0.79}

 26%|██▋       | 2925/11049 [30:06<1:22:57,  1.63it/s]
 26%|██▋       | 2926/11049 [30:07<1:22:58,  1.63it/s]
                                                      
{'loss': 0.2197, 'grad_norm': 0.46313369274139404, 'learning_rate': 9.195129971181262e-06, 'epoch': 0.79}

 26%|██▋       | 2926/11049 [30:07<1:22:58,  1.63it/s]
 26%|██▋       | 2927/11049 [30:07<1:22:58,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.4606930911540985, 'learning_rate': 9.194270292134896e-06, 'epoch': 0.79}

 26%|██▋       | 2927/11049 [30:08<1:22:58,  1.63it/s]
 27%|██▋       | 2928/11049 [30:08<1:23:00,  1.63it/s]
                                                      
{'loss': 0.2875, 'grad_norm': 0.6516931056976318, 'learning_rate': 9.193410194455083e-06, 'epoch': 0.8}

 27%|██▋       | 2928/11049 [30:08<1:23:00,  1.63it/s]
 27%|██▋       | 2929/11049 [30:09<1:22:59,  1.63it/s]
                                                      
{'loss': 0.2655, 'grad_norm': 0.5325556397438049, 'learning_rate': 9.19254967822767e-06, 'epoch': 0.8}

 27%|██▋       | 2929/11049 [30:09<1:22:59,  1.63it/s]
 27%|██▋       | 2930/11049 [30:09<1:22:58,  1.63it/s]
                                                      
{'loss': 0.2597, 'grad_norm': 0.5872979164123535, 'learning_rate': 9.191688743538543e-06, 'epoch': 0.8}

 27%|██▋       | 2930/11049 [30:09<1:22:58,  1.63it/s]
 27%|██▋       | 2931/11049 [30:10<1:22:58,  1.63it/s]
                                                      
{'loss': 0.2972, 'grad_norm': 0.5584726333618164, 'learning_rate': 9.190827390473636e-06, 'epoch': 0.8}

 27%|██▋       | 2931/11049 [30:10<1:22:58,  1.63it/s]
 27%|██▋       | 2932/11049 [30:10<1:22:57,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.45896056294441223, 'learning_rate': 9.189965619118917e-06, 'epoch': 0.8}

 27%|██▋       | 2932/11049 [30:11<1:22:57,  1.63it/s]
 27%|██▋       | 2933/11049 [30:11<1:23:02,  1.63it/s]
                                                      
{'loss': 0.2412, 'grad_norm': 0.5699114799499512, 'learning_rate': 9.189103429560404e-06, 'epoch': 0.8}

 27%|██▋       | 2933/11049 [30:11<1:23:02,  1.63it/s]
 27%|██▋       | 2934/11049 [30:12<1:23:01,  1.63it/s]
                                                      
{'loss': 0.3228, 'grad_norm': 0.5878074765205383, 'learning_rate': 9.188240821884152e-06, 'epoch': 0.8}

 27%|██▋       | 2934/11049 [30:12<1:23:01,  1.63it/s]
 27%|██▋       | 2935/11049 [30:12<1:22:58,  1.63it/s]
                                                      
{'loss': 0.2075, 'grad_norm': 0.49306365847587585, 'learning_rate': 9.187377796176257e-06, 'epoch': 0.8}

 27%|██▋       | 2935/11049 [30:12<1:22:58,  1.63it/s]
 27%|██▋       | 2936/11049 [30:13<1:22:56,  1.63it/s]
                                                      
{'loss': 0.2692, 'grad_norm': 0.5224838852882385, 'learning_rate': 9.18651435252286e-06, 'epoch': 0.8}

 27%|██▋       | 2936/11049 [30:13<1:22:56,  1.63it/s]
 27%|██▋       | 2937/11049 [30:14<1:22:53,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.4962301254272461, 'learning_rate': 9.18565049101014e-06, 'epoch': 0.8}

 27%|██▋       | 2937/11049 [30:14<1:22:53,  1.63it/s]
 27%|██▋       | 2938/11049 [30:14<1:22:51,  1.63it/s]
                                                      
{'loss': 0.2865, 'grad_norm': 0.5814841389656067, 'learning_rate': 9.184786211724322e-06, 'epoch': 0.8}

 27%|██▋       | 2938/11049 [30:14<1:22:51,  1.63it/s]
 27%|██▋       | 2939/11049 [30:15<1:22:51,  1.63it/s]
                                                      
{'loss': 0.3238, 'grad_norm': 0.6277447938919067, 'learning_rate': 9.18392151475167e-06, 'epoch': 0.8}

 27%|██▋       | 2939/11049 [30:15<1:22:51,  1.63it/s]
 27%|██▋       | 2940/11049 [30:15<1:22:52,  1.63it/s]
                                                      
{'loss': 0.2923, 'grad_norm': 0.5620284080505371, 'learning_rate': 9.18305640017849e-06, 'epoch': 0.8}

 27%|██▋       | 2940/11049 [30:16<1:22:52,  1.63it/s]
 27%|██▋       | 2941/11049 [30:16<1:22:53,  1.63it/s]
                                                      
{'loss': 0.2627, 'grad_norm': 0.5458700060844421, 'learning_rate': 9.182190868091127e-06, 'epoch': 0.8}

 27%|██▋       | 2941/11049 [30:16<1:22:53,  1.63it/s]
 27%|██▋       | 2942/11049 [30:17<1:22:52,  1.63it/s]
                                                      
{'loss': 0.2028, 'grad_norm': 0.47444477677345276, 'learning_rate': 9.181324918575974e-06, 'epoch': 0.8}

 27%|██▋       | 2942/11049 [30:17<1:22:52,  1.63it/s]
 27%|██▋       | 2943/11049 [30:17<1:22:54,  1.63it/s]
                                                      
{'loss': 0.326, 'grad_norm': 0.5932430028915405, 'learning_rate': 9.180458551719462e-06, 'epoch': 0.8}

 27%|██▋       | 2943/11049 [30:17<1:22:54,  1.63it/s]
 27%|██▋       | 2944/11049 [30:18<1:22:55,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.5783661603927612, 'learning_rate': 9.17959176760806e-06, 'epoch': 0.8}

 27%|██▋       | 2944/11049 [30:18<1:22:55,  1.63it/s]
 27%|██▋       | 2945/11049 [30:18<1:22:54,  1.63it/s]
                                                      
{'loss': 0.2487, 'grad_norm': 0.5980322360992432, 'learning_rate': 9.178724566328288e-06, 'epoch': 0.8}

 27%|██▋       | 2945/11049 [30:19<1:22:54,  1.63it/s]
 27%|██▋       | 2946/11049 [30:19<1:22:55,  1.63it/s]
                                                      
{'loss': 0.2585, 'grad_norm': 0.5032166838645935, 'learning_rate': 9.177856947966696e-06, 'epoch': 0.8}

 27%|██▋       | 2946/11049 [30:19<1:22:55,  1.63it/s]
 27%|██▋       | 2947/11049 [30:20<1:22:53,  1.63it/s]
                                                      
{'loss': 0.3967, 'grad_norm': 0.5694003105163574, 'learning_rate': 9.176988912609887e-06, 'epoch': 0.8}

 27%|██▋       | 2947/11049 [30:20<1:22:53,  1.63it/s]
 27%|██▋       | 2948/11049 [30:20<1:22:56,  1.63it/s]
                                                      
{'loss': 0.1949, 'grad_norm': 0.48655936121940613, 'learning_rate': 9.176120460344497e-06, 'epoch': 0.8}

 27%|██▋       | 2948/11049 [30:20<1:22:56,  1.63it/s]
 27%|██▋       | 2949/11049 [30:21<1:22:50,  1.63it/s]
                                                      
{'loss': 0.3084, 'grad_norm': 0.7223348617553711, 'learning_rate': 9.175251591257208e-06, 'epoch': 0.8}

 27%|██▋       | 2949/11049 [30:21<1:22:50,  1.63it/s]
 27%|██▋       | 2950/11049 [30:22<1:22:49,  1.63it/s]
                                                      
{'loss': 0.231, 'grad_norm': 0.5008009076118469, 'learning_rate': 9.174382305434743e-06, 'epoch': 0.8}

 27%|██▋       | 2950/11049 [30:22<1:22:49,  1.63it/s]
 27%|██▋       | 2951/11049 [30:22<1:22:48,  1.63it/s]
                                                      
{'loss': 0.2323, 'grad_norm': 0.535399317741394, 'learning_rate': 9.173512602963865e-06, 'epoch': 0.8}

 27%|██▋       | 2951/11049 [30:22<1:22:48,  1.63it/s]
 27%|██▋       | 2952/11049 [30:23<1:22:44,  1.63it/s]
                                                      
{'loss': 0.2786, 'grad_norm': 0.6119415760040283, 'learning_rate': 9.17264248393138e-06, 'epoch': 0.8}

 27%|██▋       | 2952/11049 [30:23<1:22:44,  1.63it/s]
 27%|██▋       | 2953/11049 [30:23<1:22:44,  1.63it/s]
                                                      
{'loss': 0.2743, 'grad_norm': 0.5351152420043945, 'learning_rate': 9.171771948424138e-06, 'epoch': 0.8}

 27%|██▋       | 2953/11049 [30:23<1:22:44,  1.63it/s]
 27%|██▋       | 2954/11049 [30:24<1:22:44,  1.63it/s]
                                                      
{'loss': 0.2318, 'grad_norm': 0.48824918270111084, 'learning_rate': 9.170900996529022e-06, 'epoch': 0.8}

 27%|██▋       | 2954/11049 [30:24<1:22:44,  1.63it/s]
 27%|██▋       | 2955/11049 [30:25<1:22:43,  1.63it/s]
                                                      
{'loss': 0.3595, 'grad_norm': 0.6039796471595764, 'learning_rate': 9.170029628332967e-06, 'epoch': 0.8}

 27%|██▋       | 2955/11049 [30:25<1:22:43,  1.63it/s]
 27%|██▋       | 2956/11049 [30:25<1:22:41,  1.63it/s]
                                                      
{'loss': 0.3504, 'grad_norm': 0.7328358888626099, 'learning_rate': 9.169157843922945e-06, 'epoch': 0.8}

 27%|██▋       | 2956/11049 [30:25<1:22:41,  1.63it/s]
 27%|██▋       | 2957/11049 [30:26<1:22:41,  1.63it/s]
                                                      
{'loss': 0.2477, 'grad_norm': 0.596412181854248, 'learning_rate': 9.168285643385966e-06, 'epoch': 0.8}

 27%|██▋       | 2957/11049 [30:26<1:22:41,  1.63it/s]
 27%|██▋       | 2958/11049 [30:26<1:22:41,  1.63it/s]
                                                      
{'loss': 0.2529, 'grad_norm': 0.5673456192016602, 'learning_rate': 9.16741302680909e-06, 'epoch': 0.8}

 27%|██▋       | 2958/11049 [30:27<1:22:41,  1.63it/s]
 27%|██▋       | 2959/11049 [30:27<1:22:42,  1.63it/s]
                                                      
{'loss': 0.2772, 'grad_norm': 0.5442975759506226, 'learning_rate': 9.166539994279408e-06, 'epoch': 0.8}

 27%|██▋       | 2959/11049 [30:27<1:22:42,  1.63it/s]
 27%|██▋       | 2960/11049 [30:28<1:22:40,  1.63it/s]
                                                      
{'loss': 0.2658, 'grad_norm': 0.5222334861755371, 'learning_rate': 9.165666545884062e-06, 'epoch': 0.8}

 27%|██▋       | 2960/11049 [30:28<1:22:40,  1.63it/s]
 27%|██▋       | 2961/11049 [30:28<1:22:40,  1.63it/s]
                                                      
{'loss': 0.2632, 'grad_norm': 0.5411548018455505, 'learning_rate': 9.164792681710231e-06, 'epoch': 0.8}

 27%|██▋       | 2961/11049 [30:28<1:22:40,  1.63it/s]
 27%|██▋       | 2962/11049 [30:29<1:22:40,  1.63it/s]
                                                      
{'loss': 0.2791, 'grad_norm': 0.5447543263435364, 'learning_rate': 9.163918401845134e-06, 'epoch': 0.8}

 27%|██▋       | 2962/11049 [30:29<1:22:40,  1.63it/s]
 27%|██▋       | 2963/11049 [30:29<1:22:40,  1.63it/s]
                                                      
{'loss': 0.269, 'grad_norm': 0.5652259588241577, 'learning_rate': 9.163043706376036e-06, 'epoch': 0.8}

 27%|██▋       | 2963/11049 [30:30<1:22:40,  1.63it/s]
 27%|██▋       | 2964/11049 [30:30<1:22:38,  1.63it/s]
                                                      
{'loss': 0.2514, 'grad_norm': 0.5049667358398438, 'learning_rate': 9.16216859539024e-06, 'epoch': 0.8}

 27%|██▋       | 2964/11049 [30:30<1:22:38,  1.63it/s]
 27%|██▋       | 2965/11049 [30:31<1:22:37,  1.63it/s]
                                                      
{'loss': 0.3493, 'grad_norm': 0.7131497859954834, 'learning_rate': 9.161293068975093e-06, 'epoch': 0.81}

 27%|██▋       | 2965/11049 [30:31<1:22:37,  1.63it/s]
 27%|██▋       | 2966/11049 [30:31<1:22:36,  1.63it/s]
                                                      
{'loss': 0.3637, 'grad_norm': 0.5716216564178467, 'learning_rate': 9.16041712721798e-06, 'epoch': 0.81}

 27%|██▋       | 2966/11049 [30:31<1:22:36,  1.63it/s]
 27%|██▋       | 2967/11049 [30:32<1:22:34,  1.63it/s]
                                                      
{'loss': 0.2958, 'grad_norm': 0.5404268503189087, 'learning_rate': 9.15954077020633e-06, 'epoch': 0.81}

 27%|██▋       | 2967/11049 [30:32<1:22:34,  1.63it/s]
 27%|██▋       | 2968/11049 [30:33<1:22:35,  1.63it/s]
                                                      
{'loss': 0.2885, 'grad_norm': 0.5888487696647644, 'learning_rate': 9.15866399802761e-06, 'epoch': 0.81}

 27%|██▋       | 2968/11049 [30:33<1:22:35,  1.63it/s]
 27%|██▋       | 2969/11049 [30:33<1:22:33,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.5354373455047607, 'learning_rate': 9.157786810769338e-06, 'epoch': 0.81}

 27%|██▋       | 2969/11049 [30:33<1:22:33,  1.63it/s]
 27%|██▋       | 2970/11049 [30:34<1:22:34,  1.63it/s]
                                                      
{'loss': 0.3164, 'grad_norm': 0.5772321820259094, 'learning_rate': 9.156909208519063e-06, 'epoch': 0.81}

 27%|██▋       | 2970/11049 [30:34<1:22:34,  1.63it/s]
 27%|██▋       | 2971/11049 [30:34<1:22:33,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.5721261501312256, 'learning_rate': 9.156031191364379e-06, 'epoch': 0.81}

 27%|██▋       | 2971/11049 [30:35<1:22:33,  1.63it/s]
 27%|██▋       | 2972/11049 [30:35<1:22:34,  1.63it/s]
                                                      
{'loss': 0.2268, 'grad_norm': 0.4539025127887726, 'learning_rate': 9.15515275939292e-06, 'epoch': 0.81}

 27%|██▋       | 2972/11049 [30:35<1:22:34,  1.63it/s]
 27%|██▋       | 2973/11049 [30:36<1:22:34,  1.63it/s]
                                                      
{'loss': 0.2698, 'grad_norm': 0.5473107099533081, 'learning_rate': 9.154273912692366e-06, 'epoch': 0.81}

 27%|██▋       | 2973/11049 [30:36<1:22:34,  1.63it/s]
 27%|██▋       | 2974/11049 [30:36<1:22:32,  1.63it/s]
                                                      
{'loss': 0.2858, 'grad_norm': 0.6036420464515686, 'learning_rate': 9.153394651350433e-06, 'epoch': 0.81}

 27%|██▋       | 2974/11049 [30:36<1:22:32,  1.63it/s]
 27%|██▋       | 2975/11049 [30:37<1:22:30,  1.63it/s]
                                                      
{'loss': 0.2707, 'grad_norm': 0.5143504738807678, 'learning_rate': 9.152514975454884e-06, 'epoch': 0.81}

 27%|██▋       | 2975/11049 [30:37<1:22:30,  1.63it/s]
 27%|██▋       | 2976/11049 [30:37<1:22:31,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.49495550990104675, 'learning_rate': 9.151634885093516e-06, 'epoch': 0.81}

 27%|██▋       | 2976/11049 [30:38<1:22:31,  1.63it/s]
 27%|██▋       | 2977/11049 [30:38<1:22:31,  1.63it/s]
                                                      
{'loss': 0.2878, 'grad_norm': 0.5679409503936768, 'learning_rate': 9.150754380354176e-06, 'epoch': 0.81}

 27%|██▋       | 2977/11049 [30:38<1:22:31,  1.63it/s]
 27%|██▋       | 2978/11049 [30:39<1:22:29,  1.63it/s]
                                                      
{'loss': 0.2507, 'grad_norm': 0.5442737936973572, 'learning_rate': 9.149873461324744e-06, 'epoch': 0.81}

 27%|██▋       | 2978/11049 [30:39<1:22:29,  1.63it/s]
 27%|██▋       | 2979/11049 [30:39<1:22:27,  1.63it/s]
                                                      
{'loss': 0.3026, 'grad_norm': 0.61247318983078, 'learning_rate': 9.148992128093148e-06, 'epoch': 0.81}

 27%|██▋       | 2979/11049 [30:39<1:22:27,  1.63it/s]
 27%|██▋       | 2980/11049 [30:40<1:22:26,  1.63it/s]
                                                      
{'loss': 0.2397, 'grad_norm': 0.49734339118003845, 'learning_rate': 9.148110380747353e-06, 'epoch': 0.81}

 27%|██▋       | 2980/11049 [30:40<1:22:26,  1.63it/s]
 27%|██▋       | 2981/11049 [30:41<1:22:26,  1.63it/s]
                                                      
{'loss': 0.2964, 'grad_norm': 0.5721781849861145, 'learning_rate': 9.147228219375366e-06, 'epoch': 0.81}

 27%|██▋       | 2981/11049 [30:41<1:22:26,  1.63it/s]
 27%|██▋       | 2982/11049 [30:41<1:22:23,  1.63it/s]
                                                      
{'loss': 0.2417, 'grad_norm': 0.46776238083839417, 'learning_rate': 9.146345644065238e-06, 'epoch': 0.81}

 27%|██▋       | 2982/11049 [30:41<1:22:23,  1.63it/s]
 27%|██▋       | 2983/11049 [30:42<1:22:24,  1.63it/s]
                                                      
{'loss': 0.3888, 'grad_norm': 0.7425457835197449, 'learning_rate': 9.14546265490506e-06, 'epoch': 0.81}

 27%|██▋       | 2983/11049 [30:42<1:22:24,  1.63it/s]
 27%|██▋       | 2984/11049 [30:42<1:22:25,  1.63it/s]
                                                      
{'loss': 0.2729, 'grad_norm': 0.5331917405128479, 'learning_rate': 9.14457925198296e-06, 'epoch': 0.81}

 27%|██▋       | 2984/11049 [30:42<1:22:25,  1.63it/s]
 27%|██▋       | 2985/11049 [30:43<1:22:25,  1.63it/s]
                                                      
{'loss': 0.2844, 'grad_norm': 0.5692643523216248, 'learning_rate': 9.143695435387117e-06, 'epoch': 0.81}

 27%|██▋       | 2985/11049 [30:43<1:22:25,  1.63it/s]
 27%|██▋       | 2986/11049 [30:44<1:22:27,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.471362441778183, 'learning_rate': 9.142811205205742e-06, 'epoch': 0.81}

 27%|██▋       | 2986/11049 [30:44<1:22:27,  1.63it/s]
 27%|██▋       | 2987/11049 [30:44<1:22:25,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.46832275390625, 'learning_rate': 9.14192656152709e-06, 'epoch': 0.81}

 27%|██▋       | 2987/11049 [30:44<1:22:25,  1.63it/s]
 27%|██▋       | 2988/11049 [30:45<1:22:25,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.48003092408180237, 'learning_rate': 9.14104150443946e-06, 'epoch': 0.81}

 27%|██▋       | 2988/11049 [30:45<1:22:25,  1.63it/s]
 27%|██▋       | 2989/11049 [30:45<1:22:23,  1.63it/s]
                                                      
{'loss': 0.33, 'grad_norm': 0.6566108465194702, 'learning_rate': 9.14015603403119e-06, 'epoch': 0.81}

 27%|██▋       | 2989/11049 [30:46<1:22:23,  1.63it/s]
 27%|██▋       | 2990/11049 [30:46<1:22:25,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.483894944190979, 'learning_rate': 9.139270150390658e-06, 'epoch': 0.81}

 27%|██▋       | 2990/11049 [30:46<1:22:25,  1.63it/s]
 27%|██▋       | 2991/11049 [30:47<1:22:23,  1.63it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.4900050163269043, 'learning_rate': 9.138383853606284e-06, 'epoch': 0.81}

 27%|██▋       | 2991/11049 [30:47<1:22:23,  1.63it/s]
 27%|██▋       | 2992/11049 [30:47<1:22:23,  1.63it/s]
                                                      
{'loss': 0.2718, 'grad_norm': 0.6019620895385742, 'learning_rate': 9.137497143766533e-06, 'epoch': 0.81}

 27%|██▋       | 2992/11049 [30:47<1:22:23,  1.63it/s]
 27%|██▋       | 2993/11049 [30:48<1:22:22,  1.63it/s]
                                                      
{'loss': 0.2596, 'grad_norm': 0.5162638425827026, 'learning_rate': 9.136610020959909e-06, 'epoch': 0.81}

 27%|██▋       | 2993/11049 [30:48<1:22:22,  1.63it/s]
 27%|██▋       | 2994/11049 [30:48<1:22:17,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.5165950655937195, 'learning_rate': 9.135722485274952e-06, 'epoch': 0.81}

 27%|██▋       | 2994/11049 [30:49<1:22:17,  1.63it/s]
 27%|██▋       | 2995/11049 [30:49<1:22:17,  1.63it/s]
                                                      
{'loss': 0.3296, 'grad_norm': 0.5551308393478394, 'learning_rate': 9.13483453680025e-06, 'epoch': 0.81}

 27%|██▋       | 2995/11049 [30:49<1:22:17,  1.63it/s]
 27%|██▋       | 2996/11049 [30:50<1:22:18,  1.63it/s]
                                                      
{'loss': 0.3596, 'grad_norm': 0.609698474407196, 'learning_rate': 9.133946175624431e-06, 'epoch': 0.81}

 27%|██▋       | 2996/11049 [30:50<1:22:18,  1.63it/s]
 27%|██▋       | 2997/11049 [30:50<1:22:15,  1.63it/s]
                                                      
{'loss': 0.4185, 'grad_norm': 0.6524827480316162, 'learning_rate': 9.13305740183616e-06, 'epoch': 0.81}

 27%|██▋       | 2997/11049 [30:50<1:22:15,  1.63it/s]
 27%|██▋       | 2998/11049 [30:51<1:22:17,  1.63it/s]
                                                      
{'loss': 0.2967, 'grad_norm': 0.6518735885620117, 'learning_rate': 9.132168215524148e-06, 'epoch': 0.81}

 27%|██▋       | 2998/11049 [30:51<1:22:17,  1.63it/s]
 27%|██▋       | 2999/11049 [30:52<1:22:15,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5622614622116089, 'learning_rate': 9.131278616777146e-06, 'epoch': 0.81}

 27%|██▋       | 2999/11049 [30:52<1:22:15,  1.63it/s]
 27%|██▋       | 3000/11049 [30:52<1:22:14,  1.63it/s]
                                                      
{'loss': 0.2385, 'grad_norm': 0.5222718119621277, 'learning_rate': 9.130388605683947e-06, 'epoch': 0.81}

 27%|██▋       | 3000/11049 [30:52<1:22:14,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.35it/s]

 31%|███       | 4/13 [00:00<00:01,  8.38it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.78it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.41it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.90it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.6533305644989014, 'eval_runtime': 1.9541, 'eval_samples_per_second': 102.349, 'eval_steps_per_second': 6.653, 'epoch': 0.81}

 27%|██▋       | 3000/11049 [30:54<1:22:14,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 27%|██▋       | 3001/11049 [30:55<2:41:08,  1.20s/it]
                                                      
{'loss': 0.276, 'grad_norm': 0.5991222858428955, 'learning_rate': 9.129498182333379e-06, 'epoch': 0.81}

 27%|██▋       | 3001/11049 [30:55<2:41:08,  1.20s/it]
 27%|██▋       | 3002/11049 [30:55<2:17:26,  1.02s/it]
                                                      
{'loss': 0.2559, 'grad_norm': 0.617608368396759, 'learning_rate': 9.12860734681432e-06, 'epoch': 0.82}

 27%|██▋       | 3002/11049 [30:55<2:17:26,  1.02s/it]
 27%|██▋       | 3003/11049 [30:56<2:00:52,  1.11it/s]
                                                      
{'loss': 0.228, 'grad_norm': 0.5296226143836975, 'learning_rate': 9.127716099215682e-06, 'epoch': 0.82}

 27%|██▋       | 3003/11049 [30:56<2:00:52,  1.11it/s]
 27%|██▋       | 3004/11049 [30:57<1:49:17,  1.23it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.5330901145935059, 'learning_rate': 9.126824439626423e-06, 'epoch': 0.82}

 27%|██▋       | 3004/11049 [30:57<1:49:17,  1.23it/s]
 27%|██▋       | 3005/11049 [30:57<1:41:07,  1.33it/s]
                                                      
{'loss': 0.2462, 'grad_norm': 0.5307673811912537, 'learning_rate': 9.125932368135541e-06, 'epoch': 0.82}

 27%|██▋       | 3005/11049 [30:57<1:41:07,  1.33it/s]
 27%|██▋       | 3006/11049 [30:58<1:35:24,  1.40it/s]
                                                      
{'loss': 0.2884, 'grad_norm': 0.5709237456321716, 'learning_rate': 9.125039884832074e-06, 'epoch': 0.82}

 27%|██▋       | 3006/11049 [30:58<1:35:24,  1.40it/s]
 27%|██▋       | 3007/11049 [30:58<1:31:26,  1.47it/s]
                                                      
{'loss': 0.2691, 'grad_norm': 0.5260385274887085, 'learning_rate': 9.124146989805098e-06, 'epoch': 0.82}

 27%|██▋       | 3007/11049 [30:59<1:31:26,  1.47it/s]
 27%|██▋       | 3008/11049 [30:59<1:28:38,  1.51it/s]
                                                      
{'loss': 0.2476, 'grad_norm': 0.5933914184570312, 'learning_rate': 9.123253683143738e-06, 'epoch': 0.82}

 27%|██▋       | 3008/11049 [30:59<1:28:38,  1.51it/s]
 27%|██▋       | 3009/11049 [31:00<1:26:41,  1.55it/s]
                                                      
{'loss': 0.3323, 'grad_norm': 0.6685596704483032, 'learning_rate': 9.122359964937154e-06, 'epoch': 0.82}

 27%|██▋       | 3009/11049 [31:00<1:26:41,  1.55it/s]
 27%|██▋       | 3010/11049 [31:00<1:25:18,  1.57it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.4804605543613434, 'learning_rate': 9.12146583527455e-06, 'epoch': 0.82}

 27%|██▋       | 3010/11049 [31:00<1:25:18,  1.57it/s]
 27%|██▋       | 3011/11049 [31:01<1:24:23,  1.59it/s]
                                                      
{'loss': 0.3017, 'grad_norm': 0.670196533203125, 'learning_rate': 9.120571294245166e-06, 'epoch': 0.82}

 27%|██▋       | 3011/11049 [31:01<1:24:23,  1.59it/s]
 27%|██▋       | 3012/11049 [31:01<1:23:43,  1.60it/s]
                                                      
{'loss': 0.2769, 'grad_norm': 0.506750762462616, 'learning_rate': 9.119676341938291e-06, 'epoch': 0.82}

 27%|██▋       | 3012/11049 [31:02<1:23:43,  1.60it/s]
 27%|██▋       | 3013/11049 [31:02<1:23:16,  1.61it/s]
                                                      
{'loss': 0.2788, 'grad_norm': 0.5586596727371216, 'learning_rate': 9.118780978443248e-06, 'epoch': 0.82}

 27%|██▋       | 3013/11049 [31:02<1:23:16,  1.61it/s]
 27%|██▋       | 3014/11049 [31:03<1:22:55,  1.62it/s]
                                                      
{'loss': 0.2433, 'grad_norm': 0.5279209613800049, 'learning_rate': 9.117885203849406e-06, 'epoch': 0.82}

 27%|██▋       | 3014/11049 [31:03<1:22:55,  1.62it/s]
 27%|██▋       | 3015/11049 [31:03<1:22:41,  1.62it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.6524311900138855, 'learning_rate': 9.116989018246171e-06, 'epoch': 0.82}

 27%|██▋       | 3015/11049 [31:03<1:22:41,  1.62it/s]
 27%|██▋       | 3016/11049 [31:04<1:22:31,  1.62it/s]
                                                      
{'loss': 0.2457, 'grad_norm': 0.4893263876438141, 'learning_rate': 9.116092421722995e-06, 'epoch': 0.82}

 27%|██▋       | 3016/11049 [31:04<1:22:31,  1.62it/s]
 27%|██▋       | 3017/11049 [31:05<1:22:22,  1.62it/s]
                                                      
{'loss': 0.3635, 'grad_norm': 0.5498889684677124, 'learning_rate': 9.115195414369365e-06, 'epoch': 0.82}

 27%|██▋       | 3017/11049 [31:05<1:22:22,  1.62it/s]
 27%|██▋       | 3018/11049 [31:05<1:22:16,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.461572527885437, 'learning_rate': 9.114297996274813e-06, 'epoch': 0.82}

 27%|██▋       | 3018/11049 [31:05<1:22:16,  1.63it/s]
 27%|██▋       | 3019/11049 [31:06<1:22:12,  1.63it/s]
                                                      
{'loss': 0.261, 'grad_norm': 0.5769771337509155, 'learning_rate': 9.11340016752891e-06, 'epoch': 0.82}

 27%|██▋       | 3019/11049 [31:06<1:22:12,  1.63it/s]
 27%|██▋       | 3020/11049 [31:06<1:22:09,  1.63it/s]
                                                      
{'loss': 0.2606, 'grad_norm': 0.5124031901359558, 'learning_rate': 9.112501928221273e-06, 'epoch': 0.82}

 27%|██▋       | 3020/11049 [31:07<1:22:09,  1.63it/s]
 27%|██▋       | 3021/11049 [31:07<1:22:07,  1.63it/s]
                                                      
{'loss': 0.2359, 'grad_norm': 0.5189303159713745, 'learning_rate': 9.111603278441552e-06, 'epoch': 0.82}

 27%|██▋       | 3021/11049 [31:07<1:22:07,  1.63it/s]
 27%|██▋       | 3022/11049 [31:08<1:22:07,  1.63it/s]
                                                      
{'loss': 0.306, 'grad_norm': 0.7121113538742065, 'learning_rate': 9.110704218279442e-06, 'epoch': 0.82}

 27%|██▋       | 3022/11049 [31:08<1:22:07,  1.63it/s]
 27%|██▋       | 3023/11049 [31:08<1:22:05,  1.63it/s]
                                                      
{'loss': 0.2472, 'grad_norm': 0.5959295034408569, 'learning_rate': 9.10980474782468e-06, 'epoch': 0.82}

 27%|██▋       | 3023/11049 [31:08<1:22:05,  1.63it/s]
 27%|██▋       | 3024/11049 [31:09<1:22:04,  1.63it/s]
                                                      
{'loss': 0.2696, 'grad_norm': 0.5478172302246094, 'learning_rate': 9.108904867167045e-06, 'epoch': 0.82}

 27%|██▋       | 3024/11049 [31:09<1:22:04,  1.63it/s]
 27%|██▋       | 3025/11049 [31:09<1:22:05,  1.63it/s]
                                                      
{'loss': 0.1999, 'grad_norm': 0.4227873980998993, 'learning_rate': 9.108004576396352e-06, 'epoch': 0.82}

 27%|██▋       | 3025/11049 [31:10<1:22:05,  1.63it/s]
 27%|██▋       | 3026/11049 [31:10<1:22:06,  1.63it/s]
                                                      
{'loss': 0.2673, 'grad_norm': 0.5165743827819824, 'learning_rate': 9.107103875602458e-06, 'epoch': 0.82}

 27%|██▋       | 3026/11049 [31:10<1:22:06,  1.63it/s]
 27%|██▋       | 3027/11049 [31:11<1:22:02,  1.63it/s]
                                                      
{'loss': 0.2302, 'grad_norm': 0.4834555387496948, 'learning_rate': 9.106202764875268e-06, 'epoch': 0.82}

 27%|██▋       | 3027/11049 [31:11<1:22:02,  1.63it/s]
 27%|██▋       | 3028/11049 [31:11<1:22:01,  1.63it/s]
                                                      
{'loss': 0.2658, 'grad_norm': 0.543668270111084, 'learning_rate': 9.105301244304719e-06, 'epoch': 0.82}

 27%|██▋       | 3028/11049 [31:11<1:22:01,  1.63it/s]
 27%|██▋       | 3029/11049 [31:12<1:22:02,  1.63it/s]
                                                      
{'loss': 0.3696, 'grad_norm': 0.5829740762710571, 'learning_rate': 9.104399313980791e-06, 'epoch': 0.82}

 27%|██▋       | 3029/11049 [31:12<1:22:02,  1.63it/s]
 27%|██▋       | 3030/11049 [31:13<1:22:01,  1.63it/s]
                                                      
{'loss': 0.2152, 'grad_norm': 0.4504658579826355, 'learning_rate': 9.10349697399351e-06, 'epoch': 0.82}

 27%|██▋       | 3030/11049 [31:13<1:22:01,  1.63it/s]
 27%|██▋       | 3031/11049 [31:13<1:22:01,  1.63it/s]
                                                      
{'loss': 0.2042, 'grad_norm': 0.4669228792190552, 'learning_rate': 9.10259422443294e-06, 'epoch': 0.82}

 27%|██▋       | 3031/11049 [31:13<1:22:01,  1.63it/s]
 27%|██▋       | 3032/11049 [31:14<1:21:59,  1.63it/s]
                                                      
{'loss': 0.273, 'grad_norm': 0.5203955769538879, 'learning_rate': 9.10169106538918e-06, 'epoch': 0.82}

 27%|██▋       | 3032/11049 [31:14<1:21:59,  1.63it/s]
 27%|██▋       | 3033/11049 [31:14<1:21:59,  1.63it/s]
                                                      
{'loss': 0.2217, 'grad_norm': 0.4620436728000641, 'learning_rate': 9.100787496952377e-06, 'epoch': 0.82}

 27%|██▋       | 3033/11049 [31:15<1:21:59,  1.63it/s]
 27%|██▋       | 3034/11049 [31:15<1:21:55,  1.63it/s]
                                                      
{'loss': 0.2881, 'grad_norm': 0.6080252528190613, 'learning_rate': 9.09988351921272e-06, 'epoch': 0.82}

 27%|██▋       | 3034/11049 [31:15<1:21:55,  1.63it/s]
 27%|██▋       | 3035/11049 [31:16<1:21:55,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.5027981400489807, 'learning_rate': 9.098979132260435e-06, 'epoch': 0.82}

 27%|██▋       | 3035/11049 [31:16<1:21:55,  1.63it/s]
 27%|██▋       | 3036/11049 [31:16<1:21:56,  1.63it/s]
                                                      
{'loss': 0.3127, 'grad_norm': 0.602142870426178, 'learning_rate': 9.098074336185785e-06, 'epoch': 0.82}

 27%|██▋       | 3036/11049 [31:16<1:21:56,  1.63it/s]
 27%|██▋       | 3037/11049 [31:17<1:21:54,  1.63it/s]
                                                      
{'loss': 0.3228, 'grad_norm': 0.5819582343101501, 'learning_rate': 9.097169131079084e-06, 'epoch': 0.82}

 27%|██▋       | 3037/11049 [31:17<1:21:54,  1.63it/s]
 27%|██▋       | 3038/11049 [31:17<1:21:54,  1.63it/s]
                                                      
{'loss': 0.2654, 'grad_norm': 0.5134459137916565, 'learning_rate': 9.096263517030676e-06, 'epoch': 0.82}

 27%|██▋       | 3038/11049 [31:18<1:21:54,  1.63it/s]
 28%|██▊       | 3039/11049 [31:18<1:21:53,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.5134193301200867, 'learning_rate': 9.095357494130956e-06, 'epoch': 0.83}

 28%|██▊       | 3039/11049 [31:18<1:21:53,  1.63it/s]
 28%|██▊       | 3040/11049 [31:19<1:21:50,  1.63it/s]
                                                      
{'loss': 0.302, 'grad_norm': 0.6054293513298035, 'learning_rate': 9.094451062470354e-06, 'epoch': 0.83}

 28%|██▊       | 3040/11049 [31:19<1:21:50,  1.63it/s]
 28%|██▊       | 3041/11049 [31:19<1:21:48,  1.63it/s]
                                                      
{'loss': 0.249, 'grad_norm': 0.5587366819381714, 'learning_rate': 9.093544222139338e-06, 'epoch': 0.83}

 28%|██▊       | 3041/11049 [31:19<1:21:48,  1.63it/s]
 28%|██▊       | 3042/11049 [31:20<1:21:47,  1.63it/s]
                                                      
{'loss': 0.2985, 'grad_norm': 0.5350639820098877, 'learning_rate': 9.092636973228424e-06, 'epoch': 0.83}

 28%|██▊       | 3042/11049 [31:20<1:21:47,  1.63it/s]
 28%|██▊       | 3043/11049 [31:21<1:21:47,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.537530779838562, 'learning_rate': 9.091729315828163e-06, 'epoch': 0.83}

 28%|██▊       | 3043/11049 [31:21<1:21:47,  1.63it/s]
 28%|██▊       | 3044/11049 [31:21<1:21:47,  1.63it/s]
                                                      
{'loss': 0.2633, 'grad_norm': 0.5713449120521545, 'learning_rate': 9.09082125002915e-06, 'epoch': 0.83}

 28%|██▊       | 3044/11049 [31:21<1:21:47,  1.63it/s]
 28%|██▊       | 3045/11049 [31:22<1:21:49,  1.63it/s]
                                                      
{'loss': 0.2692, 'grad_norm': 0.5087925791740417, 'learning_rate': 9.089912775922021e-06, 'epoch': 0.83}

 28%|██▊       | 3045/11049 [31:22<1:21:49,  1.63it/s]
 28%|██▊       | 3046/11049 [31:22<1:21:45,  1.63it/s]
                                                      
{'loss': 0.2859, 'grad_norm': 0.5503950715065002, 'learning_rate': 9.08900389359745e-06, 'epoch': 0.83}

 28%|██▊       | 3046/11049 [31:22<1:21:45,  1.63it/s]
 28%|██▊       | 3047/11049 [31:23<1:21:45,  1.63it/s]
                                                      
{'loss': 0.1915, 'grad_norm': 0.5328508615493774, 'learning_rate': 9.088094603146153e-06, 'epoch': 0.83}

 28%|██▊       | 3047/11049 [31:23<1:21:45,  1.63it/s]
 28%|██▊       | 3048/11049 [31:24<1:21:46,  1.63it/s]
                                                      
{'loss': 0.272, 'grad_norm': 0.5622098445892334, 'learning_rate': 9.087184904658889e-06, 'epoch': 0.83}

 28%|██▊       | 3048/11049 [31:24<1:21:46,  1.63it/s]
 28%|██▊       | 3049/11049 [31:24<1:21:42,  1.63it/s]
                                                      
{'loss': 0.3147, 'grad_norm': 0.634396493434906, 'learning_rate': 9.086274798226453e-06, 'epoch': 0.83}

 28%|██▊       | 3049/11049 [31:24<1:21:42,  1.63it/s]
 28%|██▊       | 3050/11049 [31:25<1:23:56,  1.59it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.5691657662391663, 'learning_rate': 9.085364283939685e-06, 'epoch': 0.83}

 28%|██▊       | 3050/11049 [31:25<1:23:56,  1.59it/s]
 28%|██▊       | 3051/11049 [31:25<1:23:22,  1.60it/s]
                                                      
{'loss': 0.2848, 'grad_norm': 0.6040052175521851, 'learning_rate': 9.084453361889466e-06, 'epoch': 0.83}

 28%|██▊       | 3051/11049 [31:26<1:23:22,  1.60it/s]
 28%|██▊       | 3052/11049 [31:26<1:22:49,  1.61it/s]
                                                      
{'loss': 0.2716, 'grad_norm': 0.5010097026824951, 'learning_rate': 9.083542032166712e-06, 'epoch': 0.83}

 28%|██▊       | 3052/11049 [31:26<1:22:49,  1.61it/s]
 28%|██▊       | 3053/11049 [31:27<1:22:29,  1.62it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.524519145488739, 'learning_rate': 9.082630294862385e-06, 'epoch': 0.83}

 28%|██▊       | 3053/11049 [31:27<1:22:29,  1.62it/s]
 28%|██▊       | 3054/11049 [31:27<1:22:16,  1.62it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.49069565534591675, 'learning_rate': 9.081718150067488e-06, 'epoch': 0.83}

 28%|██▊       | 3054/11049 [31:27<1:22:16,  1.62it/s]
 28%|██▊       | 3055/11049 [31:28<1:22:11,  1.62it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.6053792238235474, 'learning_rate': 9.08080559787306e-06, 'epoch': 0.83}

 28%|██▊       | 3055/11049 [31:28<1:22:11,  1.62it/s]
 28%|██▊       | 3056/11049 [31:29<1:22:07,  1.62it/s]
                                                      
{'loss': 0.2472, 'grad_norm': 0.6122397780418396, 'learning_rate': 9.079892638370186e-06, 'epoch': 0.83}

 28%|██▊       | 3056/11049 [31:29<1:22:07,  1.62it/s]
 28%|██▊       | 3057/11049 [31:29<1:21:59,  1.62it/s]
                                                      
{'loss': 0.2876, 'grad_norm': 0.6850965023040771, 'learning_rate': 9.078979271649988e-06, 'epoch': 0.83}

 28%|██▊       | 3057/11049 [31:29<1:21:59,  1.62it/s]
 28%|██▊       | 3058/11049 [31:30<1:21:53,  1.63it/s]
                                                      
{'loss': 0.2288, 'grad_norm': 0.5337337255477905, 'learning_rate': 9.07806549780363e-06, 'epoch': 0.83}

 28%|██▊       | 3058/11049 [31:30<1:21:53,  1.63it/s]
 28%|██▊       | 3059/11049 [31:30<1:21:49,  1.63it/s]
                                                      
{'loss': 0.3038, 'grad_norm': 0.5226705074310303, 'learning_rate': 9.077151316922316e-06, 'epoch': 0.83}

 28%|██▊       | 3059/11049 [31:31<1:21:49,  1.63it/s]
 28%|██▊       | 3060/11049 [31:31<1:21:47,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.47478169202804565, 'learning_rate': 9.076236729097294e-06, 'epoch': 0.83}

 28%|██▊       | 3060/11049 [31:31<1:21:47,  1.63it/s]
 28%|██▊       | 3061/11049 [31:32<1:21:43,  1.63it/s]
                                                      
{'loss': 0.2294, 'grad_norm': 0.45254307985305786, 'learning_rate': 9.075321734419846e-06, 'epoch': 0.83}

 28%|██▊       | 3061/11049 [31:32<1:21:43,  1.63it/s]
 28%|██▊       | 3062/11049 [31:32<1:21:42,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.5452519655227661, 'learning_rate': 9.0744063329813e-06, 'epoch': 0.83}

 28%|██▊       | 3062/11049 [31:32<1:21:42,  1.63it/s]
 28%|██▊       | 3063/11049 [31:33<1:21:41,  1.63it/s]
                                                      
{'loss': 0.305, 'grad_norm': 0.582425057888031, 'learning_rate': 9.07349052487302e-06, 'epoch': 0.83}

 28%|██▊       | 3063/11049 [31:33<1:21:41,  1.63it/s]
 28%|██▊       | 3064/11049 [31:33<1:21:39,  1.63it/s]
                                                      
{'loss': 0.2033, 'grad_norm': 0.4844130575656891, 'learning_rate': 9.07257431018642e-06, 'epoch': 0.83}

 28%|██▊       | 3064/11049 [31:34<1:21:39,  1.63it/s]
 28%|██▊       | 3065/11049 [31:34<1:21:42,  1.63it/s]
                                                      
{'loss': 0.3422, 'grad_norm': 0.6574908494949341, 'learning_rate': 9.071657689012944e-06, 'epoch': 0.83}

 28%|██▊       | 3065/11049 [31:34<1:21:42,  1.63it/s]
 28%|██▊       | 3066/11049 [31:35<1:21:41,  1.63it/s]
                                                      
{'loss': 0.2842, 'grad_norm': 0.5921939611434937, 'learning_rate': 9.07074066144408e-06, 'epoch': 0.83}

 28%|██▊       | 3066/11049 [31:35<1:21:41,  1.63it/s]
 28%|██▊       | 3067/11049 [31:35<1:21:40,  1.63it/s]
                                                      
{'loss': 0.293, 'grad_norm': 0.5766980648040771, 'learning_rate': 9.06982322757136e-06, 'epoch': 0.83}

 28%|██▊       | 3067/11049 [31:35<1:21:40,  1.63it/s]
 28%|██▊       | 3068/11049 [31:36<1:21:37,  1.63it/s]
                                                      
{'loss': 0.2819, 'grad_norm': 0.5535796284675598, 'learning_rate': 9.06890538748635e-06, 'epoch': 0.83}

 28%|██▊       | 3068/11049 [31:36<1:21:37,  1.63it/s]
 28%|██▊       | 3069/11049 [31:37<1:21:37,  1.63it/s]
                                                      
{'loss': 0.349, 'grad_norm': 0.5471112132072449, 'learning_rate': 9.067987141280664e-06, 'epoch': 0.83}

 28%|██▊       | 3069/11049 [31:37<1:21:37,  1.63it/s]
 28%|██▊       | 3070/11049 [31:37<1:21:42,  1.63it/s]
                                                      
{'loss': 0.2547, 'grad_norm': 0.519823431968689, 'learning_rate': 9.067068489045948e-06, 'epoch': 0.83}

 28%|██▊       | 3070/11049 [31:37<1:21:42,  1.63it/s]
 28%|██▊       | 3071/11049 [31:38<1:21:37,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.5143705010414124, 'learning_rate': 9.0661494308739e-06, 'epoch': 0.83}

 28%|██▊       | 3071/11049 [31:38<1:21:37,  1.63it/s]
 28%|██▊       | 3072/11049 [31:38<1:21:34,  1.63it/s]
                                                      
{'loss': 0.2505, 'grad_norm': 0.5066847205162048, 'learning_rate': 9.06522996685625e-06, 'epoch': 0.83}

 28%|██▊       | 3072/11049 [31:38<1:21:34,  1.63it/s]
 28%|██▊       | 3073/11049 [31:39<1:21:34,  1.63it/s]
                                                      
{'loss': 0.2311, 'grad_norm': 0.52382493019104, 'learning_rate': 9.064310097084766e-06, 'epoch': 0.83}

 28%|██▊       | 3073/11049 [31:39<1:21:34,  1.63it/s]
 28%|██▊       | 3074/11049 [31:40<1:21:32,  1.63it/s]
                                                      
{'loss': 0.2675, 'grad_norm': 0.5065636038780212, 'learning_rate': 9.063389821651265e-06, 'epoch': 0.83}

 28%|██▊       | 3074/11049 [31:40<1:21:32,  1.63it/s]
 28%|██▊       | 3075/11049 [31:40<1:21:40,  1.63it/s]
                                                      
{'loss': 0.2644, 'grad_norm': 0.6125264763832092, 'learning_rate': 9.0624691406476e-06, 'epoch': 0.83}

 28%|██▊       | 3075/11049 [31:40<1:21:40,  1.63it/s]
 28%|██▊       | 3076/11049 [31:41<1:21:37,  1.63it/s]
                                                      
{'loss': 0.3458, 'grad_norm': 0.5945441126823425, 'learning_rate': 9.061548054165666e-06, 'epoch': 0.84}

 28%|██▊       | 3076/11049 [31:41<1:21:37,  1.63it/s]
 28%|██▊       | 3077/11049 [31:41<1:21:33,  1.63it/s]
                                                      
{'loss': 0.2323, 'grad_norm': 0.564500629901886, 'learning_rate': 9.060626562297393e-06, 'epoch': 0.84}

 28%|██▊       | 3077/11049 [31:42<1:21:33,  1.63it/s]
 28%|██▊       | 3078/11049 [31:42<1:21:34,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.5554257035255432, 'learning_rate': 9.05970466513476e-06, 'epoch': 0.84}

 28%|██▊       | 3078/11049 [31:42<1:21:34,  1.63it/s]
 28%|██▊       | 3079/11049 [31:43<1:21:30,  1.63it/s]
                                                      
{'loss': 0.2653, 'grad_norm': 0.6034070253372192, 'learning_rate': 9.05878236276978e-06, 'epoch': 0.84}

 28%|██▊       | 3079/11049 [31:43<1:21:30,  1.63it/s]
 28%|██▊       | 3080/11049 [31:43<1:21:33,  1.63it/s]
                                                      
{'loss': 0.3209, 'grad_norm': 0.629846453666687, 'learning_rate': 9.057859655294512e-06, 'epoch': 0.84}

 28%|██▊       | 3080/11049 [31:43<1:21:33,  1.63it/s]
 28%|██▊       | 3081/11049 [31:44<1:21:30,  1.63it/s]
                                                      
{'loss': 0.2252, 'grad_norm': 0.46698227524757385, 'learning_rate': 9.056936542801047e-06, 'epoch': 0.84}

 28%|██▊       | 3081/11049 [31:44<1:21:30,  1.63it/s]
 28%|██▊       | 3082/11049 [31:45<1:21:28,  1.63it/s]
                                                      
{'loss': 0.2083, 'grad_norm': 0.5095937848091125, 'learning_rate': 9.056013025381525e-06, 'epoch': 0.84}

 28%|██▊       | 3082/11049 [31:45<1:21:28,  1.63it/s]
 28%|██▊       | 3083/11049 [31:45<1:21:27,  1.63it/s]
                                                      
{'loss': 0.2974, 'grad_norm': 0.5159487724304199, 'learning_rate': 9.055089103128124e-06, 'epoch': 0.84}

 28%|██▊       | 3083/11049 [31:45<1:21:27,  1.63it/s]
 28%|██▊       | 3084/11049 [31:46<1:21:25,  1.63it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.48658621311187744, 'learning_rate': 9.05416477613306e-06, 'epoch': 0.84}

 28%|██▊       | 3084/11049 [31:46<1:21:25,  1.63it/s]
 28%|██▊       | 3085/11049 [31:46<1:21:53,  1.62it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.433547705411911, 'learning_rate': 9.053240044488587e-06, 'epoch': 0.84}

 28%|██▊       | 3085/11049 [31:46<1:21:53,  1.62it/s]
 28%|██▊       | 3086/11049 [31:47<1:21:42,  1.62it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.6176028251647949, 'learning_rate': 9.05231490828701e-06, 'epoch': 0.84}

 28%|██▊       | 3086/11049 [31:47<1:21:42,  1.62it/s]
 28%|██▊       | 3087/11049 [31:48<1:21:36,  1.63it/s]
                                                      
{'loss': 0.2833, 'grad_norm': 0.6182001829147339, 'learning_rate': 9.051389367620662e-06, 'epoch': 0.84}

 28%|██▊       | 3087/11049 [31:48<1:21:36,  1.63it/s]
 28%|██▊       | 3088/11049 [31:48<1:21:30,  1.63it/s]
                                                      
{'loss': 0.2152, 'grad_norm': 0.48946335911750793, 'learning_rate': 9.050463422581927e-06, 'epoch': 0.84}

 28%|██▊       | 3088/11049 [31:48<1:21:30,  1.63it/s]
 28%|██▊       | 3089/11049 [31:49<1:21:24,  1.63it/s]
                                                      
{'loss': 0.3632, 'grad_norm': 0.6371704936027527, 'learning_rate': 9.049537073263218e-06, 'epoch': 0.84}

 28%|██▊       | 3089/11049 [31:49<1:21:24,  1.63it/s]
 28%|██▊       | 3090/11049 [31:49<1:21:33,  1.63it/s]
                                                      
{'loss': 0.3033, 'grad_norm': 0.6224336624145508, 'learning_rate': 9.048610319757003e-06, 'epoch': 0.84}

 28%|██▊       | 3090/11049 [31:50<1:21:33,  1.63it/s]
 28%|██▊       | 3091/11049 [31:50<1:21:30,  1.63it/s]
                                                      
{'loss': 0.3323, 'grad_norm': 0.6329724192619324, 'learning_rate': 9.047683162155776e-06, 'epoch': 0.84}

 28%|██▊       | 3091/11049 [31:50<1:21:30,  1.63it/s]
 28%|██▊       | 3092/11049 [31:51<1:21:26,  1.63it/s]
                                                      
{'loss': 0.2728, 'grad_norm': 0.5252481698989868, 'learning_rate': 9.046755600552077e-06, 'epoch': 0.84}

 28%|██▊       | 3092/11049 [31:51<1:21:26,  1.63it/s]
 28%|██▊       | 3093/11049 [31:51<1:21:23,  1.63it/s]
                                                      
{'loss': 0.2262, 'grad_norm': 0.5576104521751404, 'learning_rate': 9.04582763503849e-06, 'epoch': 0.84}

 28%|██▊       | 3093/11049 [31:51<1:21:23,  1.63it/s]
 28%|██▊       | 3094/11049 [31:52<1:21:21,  1.63it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.48376771807670593, 'learning_rate': 9.044899265707631e-06, 'epoch': 0.84}

 28%|██▊       | 3094/11049 [31:52<1:21:21,  1.63it/s]
 28%|██▊       | 3095/11049 [31:52<1:21:24,  1.63it/s]
                                                      
{'loss': 0.3931, 'grad_norm': 0.6981244087219238, 'learning_rate': 9.043970492652168e-06, 'epoch': 0.84}

 28%|██▊       | 3095/11049 [31:53<1:21:24,  1.63it/s]
 28%|██▊       | 3096/11049 [31:53<1:21:28,  1.63it/s]
                                                      
{'loss': 0.2944, 'grad_norm': 0.6473460793495178, 'learning_rate': 9.043041315964797e-06, 'epoch': 0.84}

 28%|██▊       | 3096/11049 [31:53<1:21:28,  1.63it/s]
 28%|██▊       | 3097/11049 [31:54<1:21:23,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.5130559802055359, 'learning_rate': 9.042111735738266e-06, 'epoch': 0.84}

 28%|██▊       | 3097/11049 [31:54<1:21:23,  1.63it/s]
 28%|██▊       | 3098/11049 [31:54<1:21:21,  1.63it/s]
                                                      
{'loss': 0.3759, 'grad_norm': 0.6990196704864502, 'learning_rate': 9.041181752065348e-06, 'epoch': 0.84}

 28%|██▊       | 3098/11049 [31:54<1:21:21,  1.63it/s]
 28%|██▊       | 3099/11049 [31:55<1:21:18,  1.63it/s]
                                                      
{'loss': 0.2295, 'grad_norm': 0.5762230157852173, 'learning_rate': 9.040251365038874e-06, 'epoch': 0.84}

 28%|██▊       | 3099/11049 [31:55<1:21:18,  1.63it/s]
 28%|██▊       | 3100/11049 [31:56<1:21:20,  1.63it/s]
                                                      
{'loss': 0.2347, 'grad_norm': 0.516550600528717, 'learning_rate': 9.039320574751702e-06, 'epoch': 0.84}

 28%|██▊       | 3100/11049 [31:56<1:21:20,  1.63it/s]
 28%|██▊       | 3101/11049 [31:56<1:21:44,  1.62it/s]
                                                      
{'loss': 0.294, 'grad_norm': 0.5434774160385132, 'learning_rate': 9.038389381296734e-06, 'epoch': 0.84}

 28%|██▊       | 3101/11049 [31:56<1:21:44,  1.62it/s]
 28%|██▊       | 3102/11049 [31:57<1:21:35,  1.62it/s]
                                                      
{'loss': 0.2953, 'grad_norm': 0.5708303451538086, 'learning_rate': 9.037457784766918e-06, 'epoch': 0.84}

 28%|██▊       | 3102/11049 [31:57<1:21:35,  1.62it/s]
 28%|██▊       | 3103/11049 [31:57<1:21:33,  1.62it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.5462540984153748, 'learning_rate': 9.036525785255235e-06, 'epoch': 0.84}

 28%|██▊       | 3103/11049 [31:58<1:21:33,  1.62it/s]
 28%|██▊       | 3104/11049 [31:58<1:21:23,  1.63it/s]
                                                      
{'loss': 0.2545, 'grad_norm': 0.5058376789093018, 'learning_rate': 9.035593382854709e-06, 'epoch': 0.84}

 28%|██▊       | 3104/11049 [31:58<1:21:23,  1.63it/s]
 28%|██▊       | 3105/11049 [31:59<1:21:29,  1.62it/s]
                                                      
{'loss': 0.2368, 'grad_norm': 0.5129460692405701, 'learning_rate': 9.0346605776584e-06, 'epoch': 0.84}

 28%|██▊       | 3105/11049 [31:59<1:21:29,  1.62it/s]
 28%|██▊       | 3106/11049 [31:59<1:21:27,  1.63it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.5722136497497559, 'learning_rate': 9.033727369759418e-06, 'epoch': 0.84}

 28%|██▊       | 3106/11049 [31:59<1:21:27,  1.63it/s]
 28%|██▊       | 3107/11049 [32:00<1:21:23,  1.63it/s]
                                                      
{'loss': 0.3134, 'grad_norm': 0.585061252117157, 'learning_rate': 9.032793759250903e-06, 'epoch': 0.84}

 28%|██▊       | 3107/11049 [32:00<1:21:23,  1.63it/s]
 28%|██▊       | 3108/11049 [32:00<1:21:19,  1.63it/s]
                                                      
{'loss': 0.3422, 'grad_norm': 0.6193361878395081, 'learning_rate': 9.031859746226042e-06, 'epoch': 0.84}

 28%|██▊       | 3108/11049 [32:01<1:21:19,  1.63it/s]
 28%|██▊       | 3109/11049 [32:01<1:21:16,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5154826641082764, 'learning_rate': 9.030925330778057e-06, 'epoch': 0.84}

 28%|██▊       | 3109/11049 [32:01<1:21:16,  1.63it/s]
 28%|██▊       | 3110/11049 [32:02<1:21:24,  1.63it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.5409181118011475, 'learning_rate': 9.029990513000213e-06, 'epoch': 0.84}

 28%|██▊       | 3110/11049 [32:02<1:21:24,  1.63it/s]
 28%|██▊       | 3111/11049 [32:02<1:21:22,  1.63it/s]
                                                      
{'loss': 0.3453, 'grad_norm': 0.5605629682540894, 'learning_rate': 9.029055292985818e-06, 'epoch': 0.84}

 28%|██▊       | 3111/11049 [32:02<1:21:22,  1.63it/s]
 28%|██▊       | 3112/11049 [32:03<1:21:17,  1.63it/s]
                                                      
{'loss': 0.3093, 'grad_norm': 0.6128770112991333, 'learning_rate': 9.028119670828215e-06, 'epoch': 0.84}

 28%|██▊       | 3112/11049 [32:03<1:21:17,  1.63it/s]
 28%|██▊       | 3113/11049 [32:04<1:21:14,  1.63it/s]
                                                      
{'loss': 0.4785, 'grad_norm': 0.589718759059906, 'learning_rate': 9.027183646620789e-06, 'epoch': 0.85}

 28%|██▊       | 3113/11049 [32:04<1:21:14,  1.63it/s]
 28%|██▊       | 3114/11049 [32:04<1:21:10,  1.63it/s]
                                                      
{'loss': 0.2663, 'grad_norm': 0.6100016832351685, 'learning_rate': 9.026247220456966e-06, 'epoch': 0.85}

 28%|██▊       | 3114/11049 [32:04<1:21:10,  1.63it/s]
 28%|██▊       | 3115/11049 [32:05<1:21:22,  1.63it/s]
                                                      
{'loss': 0.3667, 'grad_norm': 0.6484625935554504, 'learning_rate': 9.025310392430209e-06, 'epoch': 0.85}

 28%|██▊       | 3115/11049 [32:05<1:21:22,  1.63it/s]
 28%|██▊       | 3116/11049 [32:05<1:21:15,  1.63it/s]
                                                      
{'loss': 0.2392, 'grad_norm': 0.4399063289165497, 'learning_rate': 9.024373162634026e-06, 'epoch': 0.85}

 28%|██▊       | 3116/11049 [32:06<1:21:15,  1.63it/s]
 28%|██▊       | 3117/11049 [32:06<1:21:12,  1.63it/s]
                                                      
{'loss': 0.2565, 'grad_norm': 0.49581173062324524, 'learning_rate': 9.023435531161966e-06, 'epoch': 0.85}

 28%|██▊       | 3117/11049 [32:06<1:21:12,  1.63it/s]
 28%|██▊       | 3118/11049 [32:07<1:21:07,  1.63it/s]
                                                      
{'loss': 0.2813, 'grad_norm': 0.56334388256073, 'learning_rate': 9.022497498107607e-06, 'epoch': 0.85}

 28%|██▊       | 3118/11049 [32:07<1:21:07,  1.63it/s]
 28%|██▊       | 3119/11049 [32:07<1:21:04,  1.63it/s]
                                                      
{'loss': 0.2966, 'grad_norm': 0.6171733140945435, 'learning_rate': 9.02155906356458e-06, 'epoch': 0.85}

 28%|██▊       | 3119/11049 [32:07<1:21:04,  1.63it/s]
 28%|██▊       | 3120/11049 [32:08<1:21:11,  1.63it/s]
                                                      
{'loss': 0.3408, 'grad_norm': 0.72560054063797, 'learning_rate': 9.020620227626548e-06, 'epoch': 0.85}

 28%|██▊       | 3120/11049 [32:08<1:21:11,  1.63it/s]
 28%|██▊       | 3121/11049 [32:08<1:21:07,  1.63it/s]
                                                      
{'loss': 0.2331, 'grad_norm': 0.573980450630188, 'learning_rate': 9.01968099038722e-06, 'epoch': 0.85}

 28%|██▊       | 3121/11049 [32:09<1:21:07,  1.63it/s]
 28%|██▊       | 3122/11049 [32:09<1:21:04,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.6183021068572998, 'learning_rate': 9.018741351940344e-06, 'epoch': 0.85}

 28%|██▊       | 3122/11049 [32:09<1:21:04,  1.63it/s]
 28%|██▊       | 3123/11049 [32:10<1:21:05,  1.63it/s]
                                                      
{'loss': 0.2225, 'grad_norm': 0.5229114294052124, 'learning_rate': 9.017801312379698e-06, 'epoch': 0.85}

 28%|██▊       | 3123/11049 [32:10<1:21:05,  1.63it/s]
 28%|██▊       | 3124/11049 [32:10<1:21:02,  1.63it/s]
                                                      
{'loss': 0.3246, 'grad_norm': 0.49098509550094604, 'learning_rate': 9.016860871799114e-06, 'epoch': 0.85}

 28%|██▊       | 3124/11049 [32:10<1:21:02,  1.63it/s]
 28%|██▊       | 3125/11049 [32:11<1:21:23,  1.62it/s]
                                                      
{'loss': 0.2325, 'grad_norm': 0.564439058303833, 'learning_rate': 9.015920030292457e-06, 'epoch': 0.85}

 28%|██▊       | 3125/11049 [32:11<1:21:23,  1.62it/s]
 28%|██▊       | 3126/11049 [32:12<1:21:20,  1.62it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.4938804805278778, 'learning_rate': 9.014978787953635e-06, 'epoch': 0.85}

 28%|██▊       | 3126/11049 [32:12<1:21:20,  1.62it/s]
 28%|██▊       | 3127/11049 [32:12<1:23:07,  1.59it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.46802788972854614, 'learning_rate': 9.01403714487659e-06, 'epoch': 0.85}

 28%|██▊       | 3127/11049 [32:12<1:23:07,  1.59it/s]
 28%|██▊       | 3128/11049 [32:13<1:22:47,  1.59it/s]
                                                      
{'loss': 0.205, 'grad_norm': 0.515315592288971, 'learning_rate': 9.013095101155312e-06, 'epoch': 0.85}

 28%|██▊       | 3128/11049 [32:13<1:22:47,  1.59it/s]
 28%|██▊       | 3129/11049 [32:13<1:22:13,  1.61it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.522332489490509, 'learning_rate': 9.012152656883824e-06, 'epoch': 0.85}

 28%|██▊       | 3129/11049 [32:14<1:22:13,  1.61it/s]
 28%|██▊       | 3130/11049 [32:14<1:21:57,  1.61it/s]
                                                      
{'loss': 0.2908, 'grad_norm': 0.5622111558914185, 'learning_rate': 9.011209812156194e-06, 'epoch': 0.85}

 28%|██▊       | 3130/11049 [32:14<1:21:57,  1.61it/s]
 28%|██▊       | 3131/11049 [32:15<1:21:43,  1.61it/s]
                                                      
{'loss': 0.2447, 'grad_norm': 0.5981248021125793, 'learning_rate': 9.010266567066528e-06, 'epoch': 0.85}

 28%|██▊       | 3131/11049 [32:15<1:21:43,  1.61it/s]
 28%|██▊       | 3132/11049 [32:15<1:21:29,  1.62it/s]
                                                      
{'loss': 0.2988, 'grad_norm': 0.5261070132255554, 'learning_rate': 9.009322921708972e-06, 'epoch': 0.85}

 28%|██▊       | 3132/11049 [32:15<1:21:29,  1.62it/s]
 28%|██▊       | 3133/11049 [32:16<1:21:16,  1.62it/s]
                                                      
{'loss': 0.2799, 'grad_norm': 0.5468725562095642, 'learning_rate': 9.008378876177711e-06, 'epoch': 0.85}

 28%|██▊       | 3133/11049 [32:16<1:21:16,  1.62it/s]
 28%|██▊       | 3134/11049 [32:17<1:21:08,  1.63it/s]
                                                      
{'loss': 0.2445, 'grad_norm': 0.513475775718689, 'learning_rate': 9.00743443056697e-06, 'epoch': 0.85}

 28%|██▊       | 3134/11049 [32:17<1:21:08,  1.63it/s]
 28%|██▊       | 3135/11049 [32:17<1:21:08,  1.63it/s]
                                                      
{'loss': 0.2947, 'grad_norm': 0.604830265045166, 'learning_rate': 9.00648958497102e-06, 'epoch': 0.85}

 28%|██▊       | 3135/11049 [32:17<1:21:08,  1.63it/s]
 28%|██▊       | 3136/11049 [32:18<1:21:00,  1.63it/s]
                                                      
{'loss': 0.2759, 'grad_norm': 0.6191610097885132, 'learning_rate': 9.005544339484162e-06, 'epoch': 0.85}

 28%|██▊       | 3136/11049 [32:18<1:21:00,  1.63it/s]
 28%|██▊       | 3137/11049 [32:18<1:20:57,  1.63it/s]
                                                      
{'loss': 0.2652, 'grad_norm': 0.6193252205848694, 'learning_rate': 9.00459869420074e-06, 'epoch': 0.85}

 28%|██▊       | 3137/11049 [32:18<1:20:57,  1.63it/s]
 28%|██▊       | 3138/11049 [32:19<1:20:57,  1.63it/s]
                                                      
{'loss': 0.2521, 'grad_norm': 0.5733416080474854, 'learning_rate': 9.003652649215147e-06, 'epoch': 0.85}

 28%|██▊       | 3138/11049 [32:19<1:20:57,  1.63it/s]
 28%|██▊       | 3139/11049 [32:20<1:23:25,  1.58it/s]
                                                      
{'loss': 0.2503, 'grad_norm': 0.5023913383483887, 'learning_rate': 9.002706204621802e-06, 'epoch': 0.85}

 28%|██▊       | 3139/11049 [32:20<1:23:25,  1.58it/s]
 28%|██▊       | 3140/11049 [32:20<1:23:05,  1.59it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.6310118436813354, 'learning_rate': 9.001759360515175e-06, 'epoch': 0.85}

 28%|██▊       | 3140/11049 [32:20<1:23:05,  1.59it/s]
 28%|██▊       | 3141/11049 [32:21<1:22:29,  1.60it/s]
                                                      
{'loss': 0.2894, 'grad_norm': 0.58380526304245, 'learning_rate': 9.000812116989766e-06, 'epoch': 0.85}

 28%|██▊       | 3141/11049 [32:21<1:22:29,  1.60it/s]
 28%|██▊       | 3142/11049 [32:22<1:21:56,  1.61it/s]
                                                      
{'loss': 0.2528, 'grad_norm': 0.505679190158844, 'learning_rate': 8.999864474140123e-06, 'epoch': 0.85}

 28%|██▊       | 3142/11049 [32:22<1:21:56,  1.61it/s]
 28%|██▊       | 3143/11049 [32:22<1:21:36,  1.61it/s]
                                                      
{'loss': 0.2552, 'grad_norm': 0.5693373084068298, 'learning_rate': 8.998916432060832e-06, 'epoch': 0.85}

 28%|██▊       | 3143/11049 [32:22<1:21:36,  1.61it/s]
 28%|██▊       | 3144/11049 [32:23<1:21:20,  1.62it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.475026398897171, 'learning_rate': 8.997967990846515e-06, 'epoch': 0.85}

 28%|██▊       | 3144/11049 [32:23<1:21:20,  1.62it/s]
 28%|██▊       | 3145/11049 [32:23<1:21:16,  1.62it/s]
                                                      
{'loss': 0.1764, 'grad_norm': 0.5038782954216003, 'learning_rate': 8.99701915059184e-06, 'epoch': 0.85}

 28%|██▊       | 3145/11049 [32:23<1:21:16,  1.62it/s]
 28%|██▊       | 3146/11049 [32:24<1:21:07,  1.62it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.4787914454936981, 'learning_rate': 8.996069911391509e-06, 'epoch': 0.85}

 28%|██▊       | 3146/11049 [32:24<1:21:07,  1.62it/s]
 28%|██▊       | 3147/11049 [32:25<1:21:02,  1.63it/s]
                                                      
{'loss': 0.2444, 'grad_norm': 0.5453789830207825, 'learning_rate': 8.995120273340267e-06, 'epoch': 0.85}

 28%|██▊       | 3147/11049 [32:25<1:21:02,  1.63it/s]
 28%|██▊       | 3148/11049 [32:25<1:20:55,  1.63it/s]
                                                      
{'loss': 0.25, 'grad_norm': 0.4911533296108246, 'learning_rate': 8.9941702365329e-06, 'epoch': 0.85}

 28%|██▊       | 3148/11049 [32:25<1:20:55,  1.63it/s]
 29%|██▊       | 3149/11049 [32:26<1:20:50,  1.63it/s]
                                                      
{'loss': 0.197, 'grad_norm': 0.4666121304035187, 'learning_rate': 8.99321980106423e-06, 'epoch': 0.86}

 29%|██▊       | 3149/11049 [32:26<1:20:50,  1.63it/s]
 29%|██▊       | 3150/11049 [32:26<1:20:54,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.48495519161224365, 'learning_rate': 8.992268967029121e-06, 'epoch': 0.86}

 29%|██▊       | 3150/11049 [32:27<1:20:54,  1.63it/s]
 29%|██▊       | 3151/11049 [32:27<1:20:49,  1.63it/s]
                                                      
{'loss': 0.2612, 'grad_norm': 0.6180881857872009, 'learning_rate': 8.991317734522475e-06, 'epoch': 0.86}

 29%|██▊       | 3151/11049 [32:27<1:20:49,  1.63it/s]
 29%|██▊       | 3152/11049 [32:28<1:20:46,  1.63it/s]
                                                      
{'loss': 0.3138, 'grad_norm': 0.8664863705635071, 'learning_rate': 8.990366103639236e-06, 'epoch': 0.86}

 29%|██▊       | 3152/11049 [32:28<1:20:46,  1.63it/s]
 29%|██▊       | 3153/11049 [32:28<1:20:47,  1.63it/s]
                                                      
{'loss': 0.2304, 'grad_norm': 0.4893815219402313, 'learning_rate': 8.98941407447439e-06, 'epoch': 0.86}

 29%|██▊       | 3153/11049 [32:28<1:20:47,  1.63it/s]
 29%|██▊       | 3154/11049 [32:29<1:20:46,  1.63it/s]
                                                      
{'loss': 0.299, 'grad_norm': 0.6317098736763, 'learning_rate': 8.988461647122957e-06, 'epoch': 0.86}

 29%|██▊       | 3154/11049 [32:29<1:20:46,  1.63it/s]
 29%|██▊       | 3155/11049 [32:29<1:20:50,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.4596730172634125, 'learning_rate': 8.98750882168e-06, 'epoch': 0.86}

 29%|██▊       | 3155/11049 [32:30<1:20:50,  1.63it/s]
 29%|██▊       | 3156/11049 [32:30<1:20:47,  1.63it/s]
                                                      
{'loss': 0.304, 'grad_norm': 0.5691874623298645, 'learning_rate': 8.98655559824062e-06, 'epoch': 0.86}

 29%|██▊       | 3156/11049 [32:30<1:20:47,  1.63it/s]
 29%|██▊       | 3157/11049 [32:31<1:20:42,  1.63it/s]
                                                      
{'loss': 0.2655, 'grad_norm': 0.5568708777427673, 'learning_rate': 8.985601976899963e-06, 'epoch': 0.86}

 29%|██▊       | 3157/11049 [32:31<1:20:42,  1.63it/s]
 29%|██▊       | 3158/11049 [32:31<1:20:43,  1.63it/s]
                                                      
{'loss': 0.32, 'grad_norm': 0.5637968182563782, 'learning_rate': 8.984647957753207e-06, 'epoch': 0.86}

 29%|██▊       | 3158/11049 [32:31<1:20:43,  1.63it/s]
 29%|██▊       | 3159/11049 [32:32<1:20:39,  1.63it/s]
                                                      
{'loss': 0.3102, 'grad_norm': 0.5765385627746582, 'learning_rate': 8.983693540895573e-06, 'epoch': 0.86}

 29%|██▊       | 3159/11049 [32:32<1:20:39,  1.63it/s]
 29%|██▊       | 3160/11049 [32:33<1:20:46,  1.63it/s]
                                                      
{'loss': 0.2628, 'grad_norm': 0.5225914716720581, 'learning_rate': 8.982738726422325e-06, 'epoch': 0.86}

 29%|██▊       | 3160/11049 [32:33<1:20:46,  1.63it/s]
 29%|██▊       | 3161/11049 [32:33<1:20:41,  1.63it/s]
                                                      
{'loss': 0.4865, 'grad_norm': 0.8171103000640869, 'learning_rate': 8.981783514428762e-06, 'epoch': 0.86}

 29%|██▊       | 3161/11049 [32:33<1:20:41,  1.63it/s]
 29%|██▊       | 3162/11049 [32:34<1:20:37,  1.63it/s]
                                                      
{'loss': 0.2757, 'grad_norm': 0.5589965581893921, 'learning_rate': 8.980827905010226e-06, 'epoch': 0.86}

 29%|██▊       | 3162/11049 [32:34<1:20:37,  1.63it/s]
 29%|██▊       | 3163/11049 [32:34<1:20:35,  1.63it/s]
                                                      
{'loss': 0.2071, 'grad_norm': 0.5592706203460693, 'learning_rate': 8.979871898262094e-06, 'epoch': 0.86}

 29%|██▊       | 3163/11049 [32:35<1:20:35,  1.63it/s]
 29%|██▊       | 3164/11049 [32:35<1:20:36,  1.63it/s]
                                                      
{'loss': 0.2278, 'grad_norm': 0.5034472942352295, 'learning_rate': 8.978915494279789e-06, 'epoch': 0.86}

 29%|██▊       | 3164/11049 [32:35<1:20:36,  1.63it/s]
 29%|██▊       | 3165/11049 [32:36<1:20:37,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.5251673460006714, 'learning_rate': 8.977958693158768e-06, 'epoch': 0.86}

 29%|██▊       | 3165/11049 [32:36<1:20:37,  1.63it/s]
 29%|██▊       | 3166/11049 [32:36<1:20:37,  1.63it/s]
                                                      
{'loss': 0.2872, 'grad_norm': 0.5792470574378967, 'learning_rate': 8.977001494994533e-06, 'epoch': 0.86}

 29%|██▊       | 3166/11049 [32:36<1:20:37,  1.63it/s]
 29%|██▊       | 3167/11049 [32:37<1:20:37,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.4699166417121887, 'learning_rate': 8.976043899882619e-06, 'epoch': 0.86}

 29%|██▊       | 3167/11049 [32:37<1:20:37,  1.63it/s]
 29%|██▊       | 3168/11049 [32:37<1:20:34,  1.63it/s]
                                                      
{'loss': 0.2888, 'grad_norm': 0.5585111379623413, 'learning_rate': 8.975085907918608e-06, 'epoch': 0.86}

 29%|██▊       | 3168/11049 [32:38<1:20:34,  1.63it/s]
 29%|██▊       | 3169/11049 [32:38<1:20:34,  1.63it/s]
                                                      
{'loss': 0.3629, 'grad_norm': 0.6103668212890625, 'learning_rate': 8.974127519198115e-06, 'epoch': 0.86}

 29%|██▊       | 3169/11049 [32:38<1:20:34,  1.63it/s]
 29%|██▊       | 3170/11049 [32:39<1:20:39,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.4925527274608612, 'learning_rate': 8.973168733816799e-06, 'epoch': 0.86}

 29%|██▊       | 3170/11049 [32:39<1:20:39,  1.63it/s]
 29%|██▊       | 3171/11049 [32:39<1:20:34,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5113573670387268, 'learning_rate': 8.972209551870356e-06, 'epoch': 0.86}

 29%|██▊       | 3171/11049 [32:39<1:20:34,  1.63it/s]
 29%|██▊       | 3172/11049 [32:40<1:20:33,  1.63it/s]
                                                      
{'loss': 0.2237, 'grad_norm': 0.4962720274925232, 'learning_rate': 8.971249973454526e-06, 'epoch': 0.86}

 29%|██▊       | 3172/11049 [32:40<1:20:33,  1.63it/s]
 29%|██▊       | 3173/11049 [32:41<1:20:31,  1.63it/s]
                                                      
{'loss': 0.2367, 'grad_norm': 0.46002432703971863, 'learning_rate': 8.970289998665083e-06, 'epoch': 0.86}

 29%|██▊       | 3173/11049 [32:41<1:20:31,  1.63it/s]
 29%|██▊       | 3174/11049 [32:41<1:20:30,  1.63it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.44138649106025696, 'learning_rate': 8.96932962759784e-06, 'epoch': 0.86}

 29%|██▊       | 3174/11049 [32:41<1:20:30,  1.63it/s]
 29%|██▊       | 3175/11049 [32:42<1:20:37,  1.63it/s]
                                                      
{'loss': 0.1943, 'grad_norm': 0.42423102259635925, 'learning_rate': 8.968368860348657e-06, 'epoch': 0.86}

 29%|██▊       | 3175/11049 [32:42<1:20:37,  1.63it/s]
 29%|██▊       | 3176/11049 [32:42<1:20:32,  1.63it/s]
                                                      
{'loss': 0.311, 'grad_norm': 0.5298765897750854, 'learning_rate': 8.967407697013427e-06, 'epoch': 0.86}

 29%|██▊       | 3176/11049 [32:43<1:20:32,  1.63it/s]
 29%|██▉       | 3177/11049 [32:43<1:20:29,  1.63it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.4916505217552185, 'learning_rate': 8.966446137688086e-06, 'epoch': 0.86}

 29%|██▉       | 3177/11049 [32:43<1:20:29,  1.63it/s]
 29%|██▉       | 3178/11049 [32:44<1:20:30,  1.63it/s]
                                                      
{'loss': 0.3036, 'grad_norm': 0.6004370450973511, 'learning_rate': 8.965484182468605e-06, 'epoch': 0.86}

 29%|██▉       | 3178/11049 [32:44<1:20:30,  1.63it/s]
 29%|██▉       | 3179/11049 [32:44<1:20:25,  1.63it/s]
                                                      
{'loss': 0.2551, 'grad_norm': 0.5163597464561462, 'learning_rate': 8.964521831450998e-06, 'epoch': 0.86}

 29%|██▉       | 3179/11049 [32:44<1:20:25,  1.63it/s]
 29%|██▉       | 3180/11049 [32:45<1:20:31,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.45107099413871765, 'learning_rate': 8.96355908473132e-06, 'epoch': 0.86}

 29%|██▉       | 3180/11049 [32:45<1:20:31,  1.63it/s]
 29%|██▉       | 3181/11049 [32:45<1:20:30,  1.63it/s]
                                                      
{'loss': 0.298, 'grad_norm': 0.5925386548042297, 'learning_rate': 8.962595942405663e-06, 'epoch': 0.86}

 29%|██▉       | 3181/11049 [32:46<1:20:30,  1.63it/s]
 29%|██▉       | 3182/11049 [32:46<1:20:29,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.4975306987762451, 'learning_rate': 8.961632404570157e-06, 'epoch': 0.86}

 29%|██▉       | 3182/11049 [32:46<1:20:29,  1.63it/s]
 29%|██▉       | 3183/11049 [32:47<1:20:29,  1.63it/s]
                                                      
{'loss': 0.3117, 'grad_norm': 0.671320378780365, 'learning_rate': 8.960668471320976e-06, 'epoch': 0.86}

 29%|██▉       | 3183/11049 [32:47<1:20:29,  1.63it/s]
 29%|██▉       | 3184/11049 [32:47<1:20:27,  1.63it/s]
                                                      
{'loss': 0.2971, 'grad_norm': 0.5457367300987244, 'learning_rate': 8.959704142754331e-06, 'epoch': 0.86}

 29%|██▉       | 3184/11049 [32:47<1:20:27,  1.63it/s]
 29%|██▉       | 3185/11049 [32:48<1:20:30,  1.63it/s]
                                                      
{'loss': 0.2421, 'grad_norm': 0.5141822695732117, 'learning_rate': 8.958739418966473e-06, 'epoch': 0.86}

 29%|██▉       | 3185/11049 [32:48<1:20:30,  1.63it/s]
 29%|██▉       | 3186/11049 [32:49<1:20:27,  1.63it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.5240009427070618, 'learning_rate': 8.957774300053688e-06, 'epoch': 0.87}

 29%|██▉       | 3186/11049 [32:49<1:20:27,  1.63it/s]
 29%|██▉       | 3187/11049 [32:49<1:20:24,  1.63it/s]
                                                      
{'loss': 0.2592, 'grad_norm': 0.6538779139518738, 'learning_rate': 8.956808786112307e-06, 'epoch': 0.87}

 29%|██▉       | 3187/11049 [32:49<1:20:24,  1.63it/s]
 29%|██▉       | 3188/11049 [32:50<1:20:21,  1.63it/s]
                                                      
{'loss': 0.2267, 'grad_norm': 0.5425788164138794, 'learning_rate': 8.955842877238701e-06, 'epoch': 0.87}

 29%|██▉       | 3188/11049 [32:50<1:20:21,  1.63it/s]
 29%|██▉       | 3189/11049 [32:50<1:20:22,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.5141534209251404, 'learning_rate': 8.954876573529274e-06, 'epoch': 0.87}

 29%|██▉       | 3189/11049 [32:50<1:20:22,  1.63it/s]
 29%|██▉       | 3190/11049 [32:51<1:20:28,  1.63it/s]
                                                      
{'loss': 0.374, 'grad_norm': 0.6752094626426697, 'learning_rate': 8.953909875080477e-06, 'epoch': 0.87}

 29%|██▉       | 3190/11049 [32:51<1:20:28,  1.63it/s]
 29%|██▉       | 3191/11049 [32:52<1:20:25,  1.63it/s]
                                                      
{'loss': 0.2874, 'grad_norm': 0.592160701751709, 'learning_rate': 8.952942781988798e-06, 'epoch': 0.87}

 29%|██▉       | 3191/11049 [32:52<1:20:25,  1.63it/s]
 29%|██▉       | 3192/11049 [32:52<1:20:22,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.5465096235275269, 'learning_rate': 8.95197529435076e-06, 'epoch': 0.87}

 29%|██▉       | 3192/11049 [32:52<1:20:22,  1.63it/s]
 29%|██▉       | 3193/11049 [32:53<1:20:18,  1.63it/s]
                                                      
{'loss': 0.2664, 'grad_norm': 0.535366952419281, 'learning_rate': 8.951007412262928e-06, 'epoch': 0.87}

 29%|██▉       | 3193/11049 [32:53<1:20:18,  1.63it/s]
 29%|██▉       | 3194/11049 [32:53<1:20:16,  1.63it/s]
                                                      
{'loss': 0.2799, 'grad_norm': 0.5432676076889038, 'learning_rate': 8.95003913582191e-06, 'epoch': 0.87}

 29%|██▉       | 3194/11049 [32:54<1:20:16,  1.63it/s]
 29%|██▉       | 3195/11049 [32:54<1:20:22,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.4480403661727905, 'learning_rate': 8.949070465124352e-06, 'epoch': 0.87}

 29%|██▉       | 3195/11049 [32:54<1:20:22,  1.63it/s]
 29%|██▉       | 3196/11049 [32:55<1:20:20,  1.63it/s]
                                                      
{'loss': 0.2745, 'grad_norm': 0.5374113917350769, 'learning_rate': 8.948101400266933e-06, 'epoch': 0.87}

 29%|██▉       | 3196/11049 [32:55<1:20:20,  1.63it/s]
 29%|██▉       | 3197/11049 [32:55<1:20:16,  1.63it/s]
                                                      
{'loss': 0.2854, 'grad_norm': 0.6834888458251953, 'learning_rate': 8.947131941346379e-06, 'epoch': 0.87}

 29%|██▉       | 3197/11049 [32:55<1:20:16,  1.63it/s]
 29%|██▉       | 3198/11049 [32:56<1:20:15,  1.63it/s]
                                                      
{'loss': 0.3532, 'grad_norm': 0.6340357661247253, 'learning_rate': 8.94616208845945e-06, 'epoch': 0.87}

 29%|██▉       | 3198/11049 [32:56<1:20:15,  1.63it/s]
 29%|██▉       | 3199/11049 [32:56<1:20:15,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.49864575266838074, 'learning_rate': 8.94519184170295e-06, 'epoch': 0.87}

 29%|██▉       | 3199/11049 [32:57<1:20:15,  1.63it/s]
 29%|██▉       | 3200/11049 [32:57<1:20:25,  1.63it/s]
                                                      
{'loss': 0.2337, 'grad_norm': 0.44043347239494324, 'learning_rate': 8.944221201173722e-06, 'epoch': 0.87}

 29%|██▉       | 3200/11049 [32:57<1:20:25,  1.63it/s]
 29%|██▉       | 3201/11049 [32:58<1:20:21,  1.63it/s]
                                                      
{'loss': 0.259, 'grad_norm': 0.5057851672172546, 'learning_rate': 8.943250166968645e-06, 'epoch': 0.87}

 29%|██▉       | 3201/11049 [32:58<1:20:21,  1.63it/s]
 29%|██▉       | 3202/11049 [32:58<1:20:19,  1.63it/s]
                                                      
{'loss': 0.2408, 'grad_norm': 0.5121611952781677, 'learning_rate': 8.942278739184634e-06, 'epoch': 0.87}

 29%|██▉       | 3202/11049 [32:58<1:20:19,  1.63it/s]
 29%|██▉       | 3203/11049 [32:59<1:20:16,  1.63it/s]
                                                      
{'loss': 0.2543, 'grad_norm': 0.5658891797065735, 'learning_rate': 8.941306917918655e-06, 'epoch': 0.87}

 29%|██▉       | 3203/11049 [32:59<1:20:16,  1.63it/s]
 29%|██▉       | 3204/11049 [33:00<1:20:14,  1.63it/s]
                                                      
{'loss': 0.353, 'grad_norm': 0.5544394254684448, 'learning_rate': 8.940334703267701e-06, 'epoch': 0.87}

 29%|██▉       | 3204/11049 [33:00<1:20:14,  1.63it/s]
 29%|██▉       | 3205/11049 [33:00<1:20:17,  1.63it/s]
                                                      
{'loss': 0.2949, 'grad_norm': 0.6466728448867798, 'learning_rate': 8.939362095328812e-06, 'epoch': 0.87}

 29%|██▉       | 3205/11049 [33:00<1:20:17,  1.63it/s]
 29%|██▉       | 3206/11049 [33:01<1:20:14,  1.63it/s]
                                                      
{'loss': 0.3231, 'grad_norm': 0.6671004891395569, 'learning_rate': 8.938389094199065e-06, 'epoch': 0.87}

 29%|██▉       | 3206/11049 [33:01<1:20:14,  1.63it/s]
 29%|██▉       | 3207/11049 [33:01<1:20:10,  1.63it/s]
                                                      
{'loss': 0.2556, 'grad_norm': 0.5085009932518005, 'learning_rate': 8.937415699975574e-06, 'epoch': 0.87}

 29%|██▉       | 3207/11049 [33:02<1:20:10,  1.63it/s]
 29%|██▉       | 3208/11049 [33:02<1:20:11,  1.63it/s]
                                                      
{'loss': 0.2225, 'grad_norm': 0.5390075445175171, 'learning_rate': 8.936441912755498e-06, 'epoch': 0.87}

 29%|██▉       | 3208/11049 [33:02<1:20:11,  1.63it/s]
 29%|██▉       | 3209/11049 [33:03<1:20:12,  1.63it/s]
                                                      
{'loss': 0.2651, 'grad_norm': 0.6140137910842896, 'learning_rate': 8.935467732636027e-06, 'epoch': 0.87}

 29%|██▉       | 3209/11049 [33:03<1:20:12,  1.63it/s]
 29%|██▉       | 3210/11049 [33:03<1:20:18,  1.63it/s]
                                                      
{'loss': 0.235, 'grad_norm': 0.49400031566619873, 'learning_rate': 8.934493159714396e-06, 'epoch': 0.87}

 29%|██▉       | 3210/11049 [33:03<1:20:18,  1.63it/s]
 29%|██▉       | 3211/11049 [33:04<1:20:15,  1.63it/s]
                                                      
{'loss': 0.3578, 'grad_norm': 0.5664538145065308, 'learning_rate': 8.933518194087882e-06, 'epoch': 0.87}

 29%|██▉       | 3211/11049 [33:04<1:20:15,  1.63it/s]
 29%|██▉       | 3212/11049 [33:04<1:20:12,  1.63it/s]
                                                      
{'loss': 0.2608, 'grad_norm': 0.5504376292228699, 'learning_rate': 8.932542835853792e-06, 'epoch': 0.87}

 29%|██▉       | 3212/11049 [33:05<1:20:12,  1.63it/s]
 29%|██▉       | 3213/11049 [33:05<1:20:11,  1.63it/s]
                                                      
{'loss': 0.2872, 'grad_norm': 0.5227755308151245, 'learning_rate': 8.931567085109478e-06, 'epoch': 0.87}

 29%|██▉       | 3213/11049 [33:05<1:20:11,  1.63it/s]
 29%|██▉       | 3214/11049 [33:06<1:20:09,  1.63it/s]
                                                      
{'loss': 0.3857, 'grad_norm': 0.6006105542182922, 'learning_rate': 8.930590941952333e-06, 'epoch': 0.87}

 29%|██▉       | 3214/11049 [33:06<1:20:09,  1.63it/s]
 29%|██▉       | 3215/11049 [33:06<1:20:11,  1.63it/s]
                                                      
{'loss': 0.2705, 'grad_norm': 0.5207566618919373, 'learning_rate': 8.929614406479785e-06, 'epoch': 0.87}

 29%|██▉       | 3215/11049 [33:06<1:20:11,  1.63it/s]
 29%|██▉       | 3216/11049 [33:07<1:20:08,  1.63it/s]
                                                      
{'loss': 0.2801, 'grad_norm': 0.5754474401473999, 'learning_rate': 8.928637478789301e-06, 'epoch': 0.87}

 29%|██▉       | 3216/11049 [33:07<1:20:08,  1.63it/s]
 29%|██▉       | 3217/11049 [33:08<1:20:03,  1.63it/s]
                                                      
{'loss': 0.3183, 'grad_norm': 0.6005431413650513, 'learning_rate': 8.927660158978392e-06, 'epoch': 0.87}

 29%|██▉       | 3217/11049 [33:08<1:20:03,  1.63it/s]
 29%|██▉       | 3218/11049 [33:08<1:20:03,  1.63it/s]
                                                      
{'loss': 0.227, 'grad_norm': 0.4684552550315857, 'learning_rate': 8.926682447144606e-06, 'epoch': 0.87}

 29%|██▉       | 3218/11049 [33:08<1:20:03,  1.63it/s]
 29%|██▉       | 3219/11049 [33:09<1:20:01,  1.63it/s]
                                                      
{'loss': 0.2128, 'grad_norm': 0.48627689480781555, 'learning_rate': 8.925704343385525e-06, 'epoch': 0.87}

 29%|██▉       | 3219/11049 [33:09<1:20:01,  1.63it/s]
 29%|██▉       | 3220/11049 [33:09<1:20:06,  1.63it/s]
                                                      
{'loss': 0.2926, 'grad_norm': 0.5855036377906799, 'learning_rate': 8.924725847798776e-06, 'epoch': 0.87}

 29%|██▉       | 3220/11049 [33:10<1:20:06,  1.63it/s]
 29%|██▉       | 3221/11049 [33:10<1:20:06,  1.63it/s]
                                                      
{'loss': 0.2211, 'grad_norm': 0.4244453012943268, 'learning_rate': 8.923746960482026e-06, 'epoch': 0.87}

 29%|██▉       | 3221/11049 [33:10<1:20:06,  1.63it/s]
 29%|██▉       | 3222/11049 [33:11<1:20:05,  1.63it/s]
                                                      
{'loss': 0.2638, 'grad_norm': 0.476360946893692, 'learning_rate': 8.922767681532974e-06, 'epoch': 0.87}

 29%|██▉       | 3222/11049 [33:11<1:20:05,  1.63it/s]
 29%|██▉       | 3223/11049 [33:11<1:20:02,  1.63it/s]
                                                      
{'loss': 0.357, 'grad_norm': 0.7097747921943665, 'learning_rate': 8.921788011049366e-06, 'epoch': 0.88}

 29%|██▉       | 3223/11049 [33:11<1:20:02,  1.63it/s]
 29%|██▉       | 3224/11049 [33:12<1:20:00,  1.63it/s]
                                                      
{'loss': 0.2446, 'grad_norm': 0.5552461743354797, 'learning_rate': 8.920807949128983e-06, 'epoch': 0.88}

 29%|██▉       | 3224/11049 [33:12<1:20:00,  1.63it/s]
 29%|██▉       | 3225/11049 [33:12<1:20:05,  1.63it/s]
                                                      
{'loss': 0.2181, 'grad_norm': 0.5908838510513306, 'learning_rate': 8.919827495869645e-06, 'epoch': 0.88}

 29%|██▉       | 3225/11049 [33:13<1:20:05,  1.63it/s]
 29%|██▉       | 3226/11049 [33:13<1:20:03,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.5070303082466125, 'learning_rate': 8.918846651369213e-06, 'epoch': 0.88}

 29%|██▉       | 3226/11049 [33:13<1:20:03,  1.63it/s]
 29%|██▉       | 3227/11049 [33:14<1:20:04,  1.63it/s]
                                                      
{'loss': 0.251, 'grad_norm': 0.5347567796707153, 'learning_rate': 8.917865415725584e-06, 'epoch': 0.88}

 29%|██▉       | 3227/11049 [33:14<1:20:04,  1.63it/s]
 29%|██▉       | 3228/11049 [33:14<1:20:01,  1.63it/s]
                                                      
{'loss': 0.237, 'grad_norm': 0.49879559874534607, 'learning_rate': 8.916883789036697e-06, 'epoch': 0.88}

 29%|██▉       | 3228/11049 [33:14<1:20:01,  1.63it/s]
 29%|██▉       | 3229/11049 [33:15<1:19:59,  1.63it/s]
                                                      
{'loss': 0.2838, 'grad_norm': 0.5333061814308167, 'learning_rate': 8.91590177140053e-06, 'epoch': 0.88}

 29%|██▉       | 3229/11049 [33:15<1:19:59,  1.63it/s]
 29%|██▉       | 3230/11049 [33:16<1:20:31,  1.62it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.4810737073421478, 'learning_rate': 8.914919362915097e-06, 'epoch': 0.88}

 29%|██▉       | 3230/11049 [33:16<1:20:31,  1.62it/s]
 29%|██▉       | 3231/11049 [33:16<1:20:24,  1.62it/s]
                                                      
{'loss': 0.2251, 'grad_norm': 0.5196725726127625, 'learning_rate': 8.913936563678454e-06, 'epoch': 0.88}

 29%|██▉       | 3231/11049 [33:16<1:20:24,  1.62it/s]
 29%|██▉       | 3232/11049 [33:17<1:20:13,  1.62it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.555117130279541, 'learning_rate': 8.912953373788695e-06, 'epoch': 0.88}

 29%|██▉       | 3232/11049 [33:17<1:20:13,  1.62it/s]
 29%|██▉       | 3233/11049 [33:17<1:20:08,  1.63it/s]
                                                      
{'loss': 0.2405, 'grad_norm': 0.5874281525611877, 'learning_rate': 8.911969793343953e-06, 'epoch': 0.88}

 29%|██▉       | 3233/11049 [33:18<1:20:08,  1.63it/s]
 29%|██▉       | 3234/11049 [33:18<1:20:02,  1.63it/s]
                                                      
{'loss': 0.2589, 'grad_norm': 0.4964430332183838, 'learning_rate': 8.910985822442399e-06, 'epoch': 0.88}

 29%|██▉       | 3234/11049 [33:18<1:20:02,  1.63it/s]
 29%|██▉       | 3235/11049 [33:19<1:20:06,  1.63it/s]
                                                      
{'loss': 0.2668, 'grad_norm': 0.5938148498535156, 'learning_rate': 8.910001461182245e-06, 'epoch': 0.88}

 29%|██▉       | 3235/11049 [33:19<1:20:06,  1.63it/s]
 29%|██▉       | 3236/11049 [33:19<1:20:03,  1.63it/s]
                                                      
{'loss': 0.3008, 'grad_norm': 0.5205157995223999, 'learning_rate': 8.90901670966174e-06, 'epoch': 0.88}

 29%|██▉       | 3236/11049 [33:19<1:20:03,  1.63it/s]
 29%|██▉       | 3237/11049 [33:20<1:20:01,  1.63it/s]
                                                      
{'loss': 0.2196, 'grad_norm': 0.4441067576408386, 'learning_rate': 8.908031567979174e-06, 'epoch': 0.88}

 29%|██▉       | 3237/11049 [33:20<1:20:01,  1.63it/s]
 29%|██▉       | 3238/11049 [33:20<1:19:56,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5223871469497681, 'learning_rate': 8.907046036232875e-06, 'epoch': 0.88}

 29%|██▉       | 3238/11049 [33:21<1:19:56,  1.63it/s]
 29%|██▉       | 3239/11049 [33:21<1:19:58,  1.63it/s]
                                                      
{'loss': 0.2595, 'grad_norm': 0.5367526412010193, 'learning_rate': 8.906060114521207e-06, 'epoch': 0.88}

 29%|██▉       | 3239/11049 [33:21<1:19:58,  1.63it/s]
 29%|██▉       | 3240/11049 [33:22<1:19:55,  1.63it/s]
                                                      
{'loss': 0.3003, 'grad_norm': 0.48893219232559204, 'learning_rate': 8.905073802942578e-06, 'epoch': 0.88}

 29%|██▉       | 3240/11049 [33:22<1:19:55,  1.63it/s]
 29%|██▉       | 3241/11049 [33:22<1:19:54,  1.63it/s]
                                                      
{'loss': 0.2641, 'grad_norm': 0.5255751013755798, 'learning_rate': 8.904087101595435e-06, 'epoch': 0.88}

 29%|██▉       | 3241/11049 [33:22<1:19:54,  1.63it/s]
 29%|██▉       | 3242/11049 [33:23<1:19:52,  1.63it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.5529153347015381, 'learning_rate': 8.903100010578255e-06, 'epoch': 0.88}

 29%|██▉       | 3242/11049 [33:23<1:19:52,  1.63it/s]
 29%|██▉       | 3243/11049 [33:24<1:19:49,  1.63it/s]
                                                      
{'loss': 0.1995, 'grad_norm': 0.4611334502696991, 'learning_rate': 8.902112529989566e-06, 'epoch': 0.88}

 29%|██▉       | 3243/11049 [33:24<1:19:49,  1.63it/s]
 29%|██▉       | 3244/11049 [33:24<1:19:46,  1.63it/s]
                                                      
{'loss': 0.306, 'grad_norm': 0.6442522406578064, 'learning_rate': 8.901124659927924e-06, 'epoch': 0.88}

 29%|██▉       | 3244/11049 [33:24<1:19:46,  1.63it/s]
 29%|██▉       | 3245/11049 [33:25<1:19:51,  1.63it/s]
                                                      
{'loss': 0.2526, 'grad_norm': 0.5276541709899902, 'learning_rate': 8.900136400491934e-06, 'epoch': 0.88}

 29%|██▉       | 3245/11049 [33:25<1:19:51,  1.63it/s]
 29%|██▉       | 3246/11049 [33:25<1:19:49,  1.63it/s]
                                                      
{'loss': 0.3095, 'grad_norm': 0.5870727300643921, 'learning_rate': 8.899147751780234e-06, 'epoch': 0.88}

 29%|██▉       | 3246/11049 [33:25<1:19:49,  1.63it/s]
 29%|██▉       | 3247/11049 [33:26<1:19:46,  1.63it/s]
                                                      
{'loss': 0.3125, 'grad_norm': 0.660136878490448, 'learning_rate': 8.8981587138915e-06, 'epoch': 0.88}

 29%|██▉       | 3247/11049 [33:26<1:19:46,  1.63it/s]
 29%|██▉       | 3248/11049 [33:27<1:19:45,  1.63it/s]
                                                      
{'loss': 0.2762, 'grad_norm': 0.681869626045227, 'learning_rate': 8.897169286924449e-06, 'epoch': 0.88}

 29%|██▉       | 3248/11049 [33:27<1:19:45,  1.63it/s]
 29%|██▉       | 3249/11049 [33:27<1:19:43,  1.63it/s]
                                                      
{'loss': 0.2486, 'grad_norm': 0.5120459198951721, 'learning_rate': 8.89617947097784e-06, 'epoch': 0.88}

 29%|██▉       | 3249/11049 [33:27<1:19:43,  1.63it/s]
 29%|██▉       | 3250/11049 [33:28<1:19:49,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.46190959215164185, 'learning_rate': 8.895189266150462e-06, 'epoch': 0.88}

 29%|██▉       | 3250/11049 [33:28<1:19:49,  1.63it/s]
 29%|██▉       | 3251/11049 [33:28<1:19:45,  1.63it/s]
                                                      
{'loss': 0.2582, 'grad_norm': 0.5283393263816833, 'learning_rate': 8.89419867254115e-06, 'epoch': 0.88}

 29%|██▉       | 3251/11049 [33:29<1:19:45,  1.63it/s]
 29%|██▉       | 3252/11049 [33:29<1:19:45,  1.63it/s]
                                                      
{'loss': 0.2283, 'grad_norm': 0.4935806691646576, 'learning_rate': 8.893207690248776e-06, 'epoch': 0.88}

 29%|██▉       | 3252/11049 [33:29<1:19:45,  1.63it/s]
 29%|██▉       | 3253/11049 [33:30<1:19:44,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.4759421944618225, 'learning_rate': 8.892216319372253e-06, 'epoch': 0.88}

 29%|██▉       | 3253/11049 [33:30<1:19:44,  1.63it/s]
 29%|██▉       | 3254/11049 [33:30<1:19:42,  1.63it/s]
                                                      
{'loss': 0.2806, 'grad_norm': 0.5490677952766418, 'learning_rate': 8.891224560010527e-06, 'epoch': 0.88}

 29%|██▉       | 3254/11049 [33:30<1:19:42,  1.63it/s]
 29%|██▉       | 3255/11049 [33:31<1:19:48,  1.63it/s]
                                                      
{'loss': 0.274, 'grad_norm': 0.5817415714263916, 'learning_rate': 8.89023241226259e-06, 'epoch': 0.88}

 29%|██▉       | 3255/11049 [33:31<1:19:48,  1.63it/s]
 29%|██▉       | 3256/11049 [33:31<1:19:45,  1.63it/s]
                                                      
{'loss': 0.2479, 'grad_norm': 0.5707547664642334, 'learning_rate': 8.889239876227465e-06, 'epoch': 0.88}

 29%|██▉       | 3256/11049 [33:32<1:19:45,  1.63it/s]
 29%|██▉       | 3257/11049 [33:32<1:19:42,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.4751620888710022, 'learning_rate': 8.88824695200422e-06, 'epoch': 0.88}

 29%|██▉       | 3257/11049 [33:32<1:19:42,  1.63it/s]
 29%|██▉       | 3258/11049 [33:33<1:19:40,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.5374278426170349, 'learning_rate': 8.887253639691962e-06, 'epoch': 0.88}

 29%|██▉       | 3258/11049 [33:33<1:19:40,  1.63it/s]
 29%|██▉       | 3259/11049 [33:33<1:19:41,  1.63it/s]
                                                      
{'loss': 0.2792, 'grad_norm': 0.5969232320785522, 'learning_rate': 8.88625993938983e-06, 'epoch': 0.88}

 29%|██▉       | 3259/11049 [33:33<1:19:41,  1.63it/s]
 30%|██▉       | 3260/11049 [33:34<1:19:44,  1.63it/s]
                                                      
{'loss': 0.2192, 'grad_norm': 0.5119197368621826, 'learning_rate': 8.885265851197007e-06, 'epoch': 0.89}

 30%|██▉       | 3260/11049 [33:34<1:19:44,  1.63it/s]
 30%|██▉       | 3261/11049 [33:35<1:19:41,  1.63it/s]
                                                      
{'loss': 0.343, 'grad_norm': 0.6320716142654419, 'learning_rate': 8.884271375212714e-06, 'epoch': 0.89}

 30%|██▉       | 3261/11049 [33:35<1:19:41,  1.63it/s]
 30%|██▉       | 3262/11049 [33:35<1:19:37,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.5024158954620361, 'learning_rate': 8.883276511536212e-06, 'epoch': 0.89}

 30%|██▉       | 3262/11049 [33:35<1:19:37,  1.63it/s]
 30%|██▉       | 3263/11049 [33:36<1:19:36,  1.63it/s]
                                                      
{'loss': 0.2639, 'grad_norm': 0.5297675728797913, 'learning_rate': 8.882281260266798e-06, 'epoch': 0.89}

 30%|██▉       | 3263/11049 [33:36<1:19:36,  1.63it/s]
 30%|██▉       | 3264/11049 [33:36<1:19:33,  1.63it/s]
                                                      
{'loss': 0.276, 'grad_norm': 0.6490938067436218, 'learning_rate': 8.881285621503808e-06, 'epoch': 0.89}

 30%|██▉       | 3264/11049 [33:37<1:19:33,  1.63it/s]
 30%|██▉       | 3265/11049 [33:37<1:19:38,  1.63it/s]
                                                      
{'loss': 0.2736, 'grad_norm': 0.5417760610580444, 'learning_rate': 8.88028959534662e-06, 'epoch': 0.89}

 30%|██▉       | 3265/11049 [33:37<1:19:38,  1.63it/s]
 30%|██▉       | 3266/11049 [33:38<1:19:35,  1.63it/s]
                                                      
{'loss': 0.3072, 'grad_norm': 0.5883227586746216, 'learning_rate': 8.879293181894644e-06, 'epoch': 0.89}

 30%|██▉       | 3266/11049 [33:38<1:19:35,  1.63it/s]
 30%|██▉       | 3267/11049 [33:38<1:19:33,  1.63it/s]
                                                      
{'loss': 0.3247, 'grad_norm': 0.5779033303260803, 'learning_rate': 8.878296381247338e-06, 'epoch': 0.89}

 30%|██▉       | 3267/11049 [33:38<1:19:33,  1.63it/s]
 30%|██▉       | 3268/11049 [33:39<1:19:34,  1.63it/s]
                                                      
{'loss': 0.2356, 'grad_norm': 0.4592856764793396, 'learning_rate': 8.87729919350419e-06, 'epoch': 0.89}

 30%|██▉       | 3268/11049 [33:39<1:19:34,  1.63it/s]
 30%|██▉       | 3269/11049 [33:39<1:19:33,  1.63it/s]
                                                      
{'loss': 0.2736, 'grad_norm': 0.6165792346000671, 'learning_rate': 8.876301618764728e-06, 'epoch': 0.89}

 30%|██▉       | 3269/11049 [33:40<1:19:33,  1.63it/s]
 30%|██▉       | 3270/11049 [33:40<1:19:41,  1.63it/s]
                                                      
{'loss': 0.2723, 'grad_norm': 0.5050949454307556, 'learning_rate': 8.875303657128528e-06, 'epoch': 0.89}

 30%|██▉       | 3270/11049 [33:40<1:19:41,  1.63it/s]
 30%|██▉       | 3271/11049 [33:41<1:19:38,  1.63it/s]
                                                      
{'loss': 0.3223, 'grad_norm': 0.5604285001754761, 'learning_rate': 8.87430530869519e-06, 'epoch': 0.89}

 30%|██▉       | 3271/11049 [33:41<1:19:38,  1.63it/s]
 30%|██▉       | 3272/11049 [33:41<1:19:35,  1.63it/s]
                                                      
{'loss': 0.2794, 'grad_norm': 0.48475414514541626, 'learning_rate': 8.873306573564364e-06, 'epoch': 0.89}

 30%|██▉       | 3272/11049 [33:41<1:19:35,  1.63it/s]
 30%|██▉       | 3273/11049 [33:42<1:19:32,  1.63it/s]
                                                      
{'loss': 0.2286, 'grad_norm': 0.5374259352684021, 'learning_rate': 8.872307451835733e-06, 'epoch': 0.89}

 30%|██▉       | 3273/11049 [33:42<1:19:32,  1.63it/s]
 30%|██▉       | 3274/11049 [33:43<1:19:29,  1.63it/s]
                                                      
{'loss': 0.2864, 'grad_norm': 0.6137953400611877, 'learning_rate': 8.87130794360902e-06, 'epoch': 0.89}

 30%|██▉       | 3274/11049 [33:43<1:19:29,  1.63it/s]
 30%|██▉       | 3275/11049 [33:43<1:19:33,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.5013123750686646, 'learning_rate': 8.870308048983989e-06, 'epoch': 0.89}

 30%|██▉       | 3275/11049 [33:43<1:19:33,  1.63it/s]
 30%|██▉       | 3276/11049 [33:44<1:19:32,  1.63it/s]
                                                      
{'loss': 0.248, 'grad_norm': 0.5526270866394043, 'learning_rate': 8.869307768060436e-06, 'epoch': 0.89}

 30%|██▉       | 3276/11049 [33:44<1:19:32,  1.63it/s]
 30%|██▉       | 3277/11049 [33:44<1:19:30,  1.63it/s]
                                                      
{'loss': 0.246, 'grad_norm': 0.4273954927921295, 'learning_rate': 8.868307100938204e-06, 'epoch': 0.89}

 30%|██▉       | 3277/11049 [33:45<1:19:30,  1.63it/s]
 30%|██▉       | 3278/11049 [33:45<1:19:29,  1.63it/s]
                                                      
{'loss': 0.2647, 'grad_norm': 0.5397429466247559, 'learning_rate': 8.86730604771717e-06, 'epoch': 0.89}

 30%|██▉       | 3278/11049 [33:45<1:19:29,  1.63it/s]
 30%|██▉       | 3279/11049 [33:46<1:19:25,  1.63it/s]
                                                      
{'loss': 0.3078, 'grad_norm': 0.6023154258728027, 'learning_rate': 8.866304608497246e-06, 'epoch': 0.89}

 30%|██▉       | 3279/11049 [33:46<1:19:25,  1.63it/s]
 30%|██▉       | 3280/11049 [33:46<1:19:33,  1.63it/s]
                                                      
{'loss': 0.2883, 'grad_norm': 0.6570078730583191, 'learning_rate': 8.865302783378391e-06, 'epoch': 0.89}

 30%|██▉       | 3280/11049 [33:46<1:19:33,  1.63it/s]
 30%|██▉       | 3281/11049 [33:47<1:19:29,  1.63it/s]
                                                      
{'loss': 0.2919, 'grad_norm': 0.5599597096443176, 'learning_rate': 8.864300572460596e-06, 'epoch': 0.89}

 30%|██▉       | 3281/11049 [33:47<1:19:29,  1.63it/s]
 30%|██▉       | 3282/11049 [33:47<1:19:26,  1.63it/s]
                                                      
{'loss': 0.3039, 'grad_norm': 0.6889373064041138, 'learning_rate': 8.863297975843892e-06, 'epoch': 0.89}

 30%|██▉       | 3282/11049 [33:48<1:19:26,  1.63it/s]
 30%|██▉       | 3283/11049 [33:48<1:19:24,  1.63it/s]
                                                      
{'loss': 0.2832, 'grad_norm': 0.6885778903961182, 'learning_rate': 8.862294993628348e-06, 'epoch': 0.89}

 30%|██▉       | 3283/11049 [33:48<1:19:24,  1.63it/s]
 30%|██▉       | 3284/11049 [33:49<1:19:24,  1.63it/s]
                                                      
{'loss': 0.3056, 'grad_norm': 0.5898870229721069, 'learning_rate': 8.861291625914076e-06, 'epoch': 0.89}

 30%|██▉       | 3284/11049 [33:49<1:19:24,  1.63it/s]
 30%|██▉       | 3285/11049 [33:49<1:19:27,  1.63it/s]
                                                      
{'loss': 0.3188, 'grad_norm': 0.5574707388877869, 'learning_rate': 8.860287872801221e-06, 'epoch': 0.89}

 30%|██▉       | 3285/11049 [33:49<1:19:27,  1.63it/s]
 30%|██▉       | 3286/11049 [33:50<1:19:24,  1.63it/s]
                                                      
{'loss': 0.336, 'grad_norm': 0.7394499182701111, 'learning_rate': 8.859283734389968e-06, 'epoch': 0.89}

 30%|██▉       | 3286/11049 [33:50<1:19:24,  1.63it/s]
 30%|██▉       | 3287/11049 [33:51<1:19:22,  1.63it/s]
                                                      
{'loss': 0.2372, 'grad_norm': 0.5431360602378845, 'learning_rate': 8.858279210780541e-06, 'epoch': 0.89}

 30%|██▉       | 3287/11049 [33:51<1:19:22,  1.63it/s]
 30%|██▉       | 3288/11049 [33:51<1:19:21,  1.63it/s]
                                                      
{'loss': 0.2965, 'grad_norm': 0.6282467842102051, 'learning_rate': 8.8572743020732e-06, 'epoch': 0.89}

 30%|██▉       | 3288/11049 [33:51<1:19:21,  1.63it/s]
 30%|██▉       | 3289/11049 [33:52<1:19:20,  1.63it/s]
                                                      
{'loss': 0.286, 'grad_norm': 0.6176217198371887, 'learning_rate': 8.85626900836825e-06, 'epoch': 0.89}

 30%|██▉       | 3289/11049 [33:52<1:19:20,  1.63it/s]
 30%|██▉       | 3290/11049 [33:52<1:19:45,  1.62it/s]
                                                      
{'loss': 0.3514, 'grad_norm': 0.611737072467804, 'learning_rate': 8.85526332976603e-06, 'epoch': 0.89}

 30%|██▉       | 3290/11049 [33:52<1:19:45,  1.62it/s]
 30%|██▉       | 3291/11049 [33:53<1:19:37,  1.62it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.5373409986495972, 'learning_rate': 8.854257266366915e-06, 'epoch': 0.89}

 30%|██▉       | 3291/11049 [33:53<1:19:37,  1.62it/s]
 30%|██▉       | 3292/11049 [33:54<1:19:29,  1.63it/s]
                                                      
{'loss': 0.2566, 'grad_norm': 0.5338895916938782, 'learning_rate': 8.853250818271322e-06, 'epoch': 0.89}

 30%|██▉       | 3292/11049 [33:54<1:19:29,  1.63it/s]
 30%|██▉       | 3293/11049 [33:54<1:19:24,  1.63it/s]
                                                      
{'loss': 0.3314, 'grad_norm': 0.4936041533946991, 'learning_rate': 8.852243985579705e-06, 'epoch': 0.89}

 30%|██▉       | 3293/11049 [33:54<1:19:24,  1.63it/s]
 30%|██▉       | 3294/11049 [33:55<1:19:20,  1.63it/s]
                                                      
{'loss': 0.2347, 'grad_norm': 0.48682814836502075, 'learning_rate': 8.851236768392556e-06, 'epoch': 0.89}

 30%|██▉       | 3294/11049 [33:55<1:19:20,  1.63it/s]
 30%|██▉       | 3295/11049 [33:55<1:19:26,  1.63it/s]
                                                      
{'loss': 0.2377, 'grad_norm': 0.5105080604553223, 'learning_rate': 8.850229166810408e-06, 'epoch': 0.89}

 30%|██▉       | 3295/11049 [33:56<1:19:26,  1.63it/s]
 30%|██▉       | 3296/11049 [33:56<1:19:22,  1.63it/s]
                                                      
{'loss': 0.3021, 'grad_norm': 0.5971073508262634, 'learning_rate': 8.84922118093383e-06, 'epoch': 0.89}

 30%|██▉       | 3296/11049 [33:56<1:19:22,  1.63it/s]
 30%|██▉       | 3297/11049 [33:57<1:19:21,  1.63it/s]
                                                      
{'loss': 0.2793, 'grad_norm': 0.5284576416015625, 'learning_rate': 8.84821281086343e-06, 'epoch': 0.9}

 30%|██▉       | 3297/11049 [33:57<1:19:21,  1.63it/s]
 30%|██▉       | 3298/11049 [33:57<1:19:18,  1.63it/s]
                                                      
{'loss': 0.2892, 'grad_norm': 0.6055347323417664, 'learning_rate': 8.847204056699852e-06, 'epoch': 0.9}

 30%|██▉       | 3298/11049 [33:57<1:19:18,  1.63it/s]
 30%|██▉       | 3299/11049 [33:58<1:19:15,  1.63it/s]
                                                      
{'loss': 0.2535, 'grad_norm': 0.5310148000717163, 'learning_rate': 8.846194918543784e-06, 'epoch': 0.9}

 30%|██▉       | 3299/11049 [33:58<1:19:15,  1.63it/s]
 30%|██▉       | 3300/11049 [33:59<1:19:14,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.5306816697120667, 'learning_rate': 8.845185396495947e-06, 'epoch': 0.9}

 30%|██▉       | 3300/11049 [33:59<1:19:14,  1.63it/s]
 30%|██▉       | 3301/11049 [33:59<1:19:14,  1.63it/s]
                                                      
{'loss': 0.3198, 'grad_norm': 0.557796061038971, 'learning_rate': 8.844175490657102e-06, 'epoch': 0.9}

 30%|██▉       | 3301/11049 [33:59<1:19:14,  1.63it/s]
 30%|██▉       | 3302/11049 [34:00<1:19:13,  1.63it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.5657920837402344, 'learning_rate': 8.843165201128049e-06, 'epoch': 0.9}

 30%|██▉       | 3302/11049 [34:00<1:19:13,  1.63it/s]
 30%|██▉       | 3303/11049 [34:00<1:19:12,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.5990712642669678, 'learning_rate': 8.842154528009625e-06, 'epoch': 0.9}

 30%|██▉       | 3303/11049 [34:00<1:19:12,  1.63it/s]
 30%|██▉       | 3304/11049 [34:01<1:19:09,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.45679977536201477, 'learning_rate': 8.841143471402709e-06, 'epoch': 0.9}

 30%|██▉       | 3304/11049 [34:01<1:19:09,  1.63it/s]
 30%|██▉       | 3305/11049 [34:02<1:19:08,  1.63it/s]
                                                      
{'loss': 0.3893, 'grad_norm': 0.7012634873390198, 'learning_rate': 8.84013203140821e-06, 'epoch': 0.9}

 30%|██▉       | 3305/11049 [34:02<1:19:08,  1.63it/s]
 30%|██▉       | 3306/11049 [34:02<1:19:08,  1.63it/s]
                                                      
{'loss': 0.26, 'grad_norm': 0.5829764604568481, 'learning_rate': 8.839120208127087e-06, 'epoch': 0.9}

 30%|██▉       | 3306/11049 [34:02<1:19:08,  1.63it/s]
 30%|██▉       | 3307/11049 [34:03<1:19:05,  1.63it/s]
                                                      
{'loss': 0.2513, 'grad_norm': 0.4782126247882843, 'learning_rate': 8.838108001660326e-06, 'epoch': 0.9}

 30%|██▉       | 3307/11049 [34:03<1:19:05,  1.63it/s]
 30%|██▉       | 3308/11049 [34:03<1:19:06,  1.63it/s]
                                                      
{'loss': 0.2783, 'grad_norm': 0.5169582962989807, 'learning_rate': 8.837095412108958e-06, 'epoch': 0.9}

 30%|██▉       | 3308/11049 [34:04<1:19:06,  1.63it/s]
 30%|██▉       | 3309/11049 [34:04<1:19:05,  1.63it/s]
                                                      
{'loss': 0.237, 'grad_norm': 0.5430456399917603, 'learning_rate': 8.836082439574052e-06, 'epoch': 0.9}

 30%|██▉       | 3309/11049 [34:04<1:19:05,  1.63it/s]
 30%|██▉       | 3310/11049 [34:05<1:19:05,  1.63it/s]
                                                      
{'loss': 0.2385, 'grad_norm': 0.5311900973320007, 'learning_rate': 8.835069084156709e-06, 'epoch': 0.9}

 30%|██▉       | 3310/11049 [34:05<1:19:05,  1.63it/s]
 30%|██▉       | 3311/11049 [34:05<1:19:05,  1.63it/s]
                                                      
{'loss': 0.311, 'grad_norm': 0.5451242327690125, 'learning_rate': 8.834055345958077e-06, 'epoch': 0.9}

 30%|██▉       | 3311/11049 [34:05<1:19:05,  1.63it/s]
 30%|██▉       | 3312/11049 [34:06<1:19:04,  1.63it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.5655009150505066, 'learning_rate': 8.833041225079338e-06, 'epoch': 0.9}

 30%|██▉       | 3312/11049 [34:06<1:19:04,  1.63it/s]
 30%|██▉       | 3313/11049 [34:06<1:19:04,  1.63it/s]
                                                      
{'loss': 0.2233, 'grad_norm': 0.46549153327941895, 'learning_rate': 8.832026721621709e-06, 'epoch': 0.9}

 30%|██▉       | 3313/11049 [34:07<1:19:04,  1.63it/s]
 30%|██▉       | 3314/11049 [34:07<1:19:03,  1.63it/s]
                                                      
{'loss': 0.3012, 'grad_norm': 0.529693067073822, 'learning_rate': 8.831011835686449e-06, 'epoch': 0.9}

 30%|██▉       | 3314/11049 [34:07<1:19:03,  1.63it/s]
 30%|███       | 3315/11049 [34:08<1:19:02,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.5434845089912415, 'learning_rate': 8.829996567374858e-06, 'epoch': 0.9}

 30%|███       | 3315/11049 [34:08<1:19:02,  1.63it/s]
 30%|███       | 3316/11049 [34:08<1:19:00,  1.63it/s]
                                                      
{'loss': 0.2223, 'grad_norm': 0.437402606010437, 'learning_rate': 8.828980916788269e-06, 'epoch': 0.9}

 30%|███       | 3316/11049 [34:08<1:19:00,  1.63it/s]
 30%|███       | 3317/11049 [34:09<1:19:00,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.42175358533859253, 'learning_rate': 8.827964884028052e-06, 'epoch': 0.9}

 30%|███       | 3317/11049 [34:09<1:19:00,  1.63it/s]
 30%|███       | 3318/11049 [34:10<1:19:01,  1.63it/s]
                                                      
{'loss': 0.2213, 'grad_norm': 0.529743492603302, 'learning_rate': 8.826948469195622e-06, 'epoch': 0.9}

 30%|███       | 3318/11049 [34:10<1:19:01,  1.63it/s]
 30%|███       | 3319/11049 [34:10<1:19:01,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.49452823400497437, 'learning_rate': 8.825931672392425e-06, 'epoch': 0.9}

 30%|███       | 3319/11049 [34:10<1:19:01,  1.63it/s]
 30%|███       | 3320/11049 [34:11<1:19:00,  1.63it/s]
                                                      
{'loss': 0.2698, 'grad_norm': 0.5584027171134949, 'learning_rate': 8.82491449371995e-06, 'epoch': 0.9}

 30%|███       | 3320/11049 [34:11<1:19:00,  1.63it/s]
 30%|███       | 3321/11049 [34:11<1:18:58,  1.63it/s]
                                                      
{'loss': 0.2421, 'grad_norm': 0.5406363606452942, 'learning_rate': 8.823896933279725e-06, 'epoch': 0.9}

 30%|███       | 3321/11049 [34:12<1:18:58,  1.63it/s]
 30%|███       | 3322/11049 [34:12<1:18:56,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.49790650606155396, 'learning_rate': 8.822878991173311e-06, 'epoch': 0.9}

 30%|███       | 3322/11049 [34:12<1:18:56,  1.63it/s]
 30%|███       | 3323/11049 [34:13<1:18:56,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.49559590220451355, 'learning_rate': 8.821860667502307e-06, 'epoch': 0.9}

 30%|███       | 3323/11049 [34:13<1:18:56,  1.63it/s]
 30%|███       | 3324/11049 [34:13<1:18:57,  1.63it/s]
                                                      
{'loss': 0.2598, 'grad_norm': 0.4821520447731018, 'learning_rate': 8.820841962368356e-06, 'epoch': 0.9}

 30%|███       | 3324/11049 [34:13<1:18:57,  1.63it/s]
 30%|███       | 3325/11049 [34:14<1:18:57,  1.63it/s]
                                                      
{'loss': 0.2568, 'grad_norm': 0.5342684388160706, 'learning_rate': 8.819822875873137e-06, 'epoch': 0.9}

 30%|███       | 3325/11049 [34:14<1:18:57,  1.63it/s]
 30%|███       | 3326/11049 [34:14<1:19:03,  1.63it/s]
                                                      
{'loss': 0.3063, 'grad_norm': 0.6281461715698242, 'learning_rate': 8.818803408118359e-06, 'epoch': 0.9}

 30%|███       | 3326/11049 [34:15<1:19:03,  1.63it/s]
 30%|███       | 3327/11049 [34:15<1:19:02,  1.63it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.45094698667526245, 'learning_rate': 8.817783559205784e-06, 'epoch': 0.9}

 30%|███       | 3327/11049 [34:15<1:19:02,  1.63it/s]
 30%|███       | 3328/11049 [34:16<1:19:00,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.44016310572624207, 'learning_rate': 8.816763329237201e-06, 'epoch': 0.9}

 30%|███       | 3328/11049 [34:16<1:19:00,  1.63it/s]
 30%|███       | 3329/11049 [34:16<1:18:58,  1.63it/s]
                                                      
{'loss': 0.237, 'grad_norm': 0.48235997557640076, 'learning_rate': 8.815742718314438e-06, 'epoch': 0.9}

 30%|███       | 3329/11049 [34:16<1:18:58,  1.63it/s]
 30%|███       | 3330/11049 [34:17<1:18:54,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.6116754412651062, 'learning_rate': 8.814721726539366e-06, 'epoch': 0.9}

 30%|███       | 3330/11049 [34:17<1:18:54,  1.63it/s]
 30%|███       | 3331/11049 [34:18<1:18:54,  1.63it/s]
                                                      
{'loss': 0.2668, 'grad_norm': 0.5180506110191345, 'learning_rate': 8.813700354013888e-06, 'epoch': 0.9}

 30%|███       | 3331/11049 [34:18<1:18:54,  1.63it/s]
 30%|███       | 3332/11049 [34:18<1:18:52,  1.63it/s]
                                                      
{'loss': 0.1982, 'grad_norm': 0.45798879861831665, 'learning_rate': 8.81267860083995e-06, 'epoch': 0.9}

 30%|███       | 3332/11049 [34:18<1:18:52,  1.63it/s]
 30%|███       | 3333/11049 [34:19<1:18:53,  1.63it/s]
                                                      
{'loss': 0.273, 'grad_norm': 0.46395227313041687, 'learning_rate': 8.811656467119533e-06, 'epoch': 0.9}

 30%|███       | 3333/11049 [34:19<1:18:53,  1.63it/s]
 30%|███       | 3334/11049 [34:19<1:18:54,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5730985999107361, 'learning_rate': 8.81063395295466e-06, 'epoch': 0.91}

 30%|███       | 3334/11049 [34:19<1:18:54,  1.63it/s]
 30%|███       | 3335/11049 [34:20<1:18:52,  1.63it/s]
                                                      
{'loss': 0.2012, 'grad_norm': 0.48616161942481995, 'learning_rate': 8.809611058447382e-06, 'epoch': 0.91}

 30%|███       | 3335/11049 [34:20<1:18:52,  1.63it/s]
 30%|███       | 3336/11049 [34:21<1:18:50,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.4696037173271179, 'learning_rate': 8.808587783699803e-06, 'epoch': 0.91}

 30%|███       | 3336/11049 [34:21<1:18:50,  1.63it/s]
 30%|███       | 3337/11049 [34:21<1:18:50,  1.63it/s]
                                                      
{'loss': 0.3103, 'grad_norm': 0.6765048503875732, 'learning_rate': 8.807564128814052e-06, 'epoch': 0.91}

 30%|███       | 3337/11049 [34:21<1:18:50,  1.63it/s]
 30%|███       | 3338/11049 [34:22<1:18:48,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.5371318459510803, 'learning_rate': 8.806540093892302e-06, 'epoch': 0.91}

 30%|███       | 3338/11049 [34:22<1:18:48,  1.63it/s]
 30%|███       | 3339/11049 [34:22<1:18:48,  1.63it/s]
                                                      
{'loss': 0.3387, 'grad_norm': 0.6029345989227295, 'learning_rate': 8.805515679036763e-06, 'epoch': 0.91}

 30%|███       | 3339/11049 [34:23<1:18:48,  1.63it/s]
 30%|███       | 3340/11049 [34:23<1:18:47,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.5393816232681274, 'learning_rate': 8.804490884349683e-06, 'epoch': 0.91}

 30%|███       | 3340/11049 [34:23<1:18:47,  1.63it/s]
 30%|███       | 3341/11049 [34:24<1:18:45,  1.63it/s]
                                                      
{'loss': 0.3191, 'grad_norm': 0.6101729273796082, 'learning_rate': 8.803465709933345e-06, 'epoch': 0.91}

 30%|███       | 3341/11049 [34:24<1:18:45,  1.63it/s]
 30%|███       | 3342/11049 [34:24<1:18:46,  1.63it/s]
                                                      
{'loss': 0.2863, 'grad_norm': 0.6262728571891785, 'learning_rate': 8.802440155890078e-06, 'epoch': 0.91}

 30%|███       | 3342/11049 [34:24<1:18:46,  1.63it/s]
 30%|███       | 3343/11049 [34:25<1:19:04,  1.62it/s]
                                                      
{'loss': 0.3087, 'grad_norm': 0.6610632538795471, 'learning_rate': 8.801414222322237e-06, 'epoch': 0.91}

 30%|███       | 3343/11049 [34:25<1:19:04,  1.62it/s]
 30%|███       | 3344/11049 [34:25<1:18:55,  1.63it/s]
                                                      
{'loss': 0.2428, 'grad_norm': 0.5522148609161377, 'learning_rate': 8.800387909332225e-06, 'epoch': 0.91}

 30%|███       | 3344/11049 [34:26<1:18:55,  1.63it/s]
 30%|███       | 3345/11049 [34:26<1:18:51,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.5122602581977844, 'learning_rate': 8.799361217022478e-06, 'epoch': 0.91}

 30%|███       | 3345/11049 [34:26<1:18:51,  1.63it/s]
 30%|███       | 3346/11049 [34:27<1:18:50,  1.63it/s]
                                                      
{'loss': 0.2097, 'grad_norm': 0.4897584915161133, 'learning_rate': 8.798334145495471e-06, 'epoch': 0.91}

 30%|███       | 3346/11049 [34:27<1:18:50,  1.63it/s]
 30%|███       | 3347/11049 [34:27<1:18:49,  1.63it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.5898615717887878, 'learning_rate': 8.797306694853716e-06, 'epoch': 0.91}

 30%|███       | 3347/11049 [34:27<1:18:49,  1.63it/s]
 30%|███       | 3348/11049 [34:28<1:18:47,  1.63it/s]
                                                      
{'loss': 0.3058, 'grad_norm': 0.553392231464386, 'learning_rate': 8.796278865199765e-06, 'epoch': 0.91}

 30%|███       | 3348/11049 [34:28<1:18:47,  1.63it/s]
 30%|███       | 3349/11049 [34:29<1:18:46,  1.63it/s]
                                                      
{'loss': 0.2728, 'grad_norm': 0.5315625071525574, 'learning_rate': 8.795250656636207e-06, 'epoch': 0.91}

 30%|███       | 3349/11049 [34:29<1:18:46,  1.63it/s]
 30%|███       | 3350/11049 [34:29<1:18:46,  1.63it/s]
                                                      
{'loss': 0.2952, 'grad_norm': 0.47143471240997314, 'learning_rate': 8.794222069265668e-06, 'epoch': 0.91}

 30%|███       | 3350/11049 [34:29<1:18:46,  1.63it/s]
 30%|███       | 3351/11049 [34:30<1:18:44,  1.63it/s]
                                                      
{'loss': 0.2611, 'grad_norm': 0.5510914921760559, 'learning_rate': 8.793193103190812e-06, 'epoch': 0.91}

 30%|███       | 3351/11049 [34:30<1:18:44,  1.63it/s]
 30%|███       | 3352/11049 [34:30<1:18:43,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.5916420817375183, 'learning_rate': 8.792163758514339e-06, 'epoch': 0.91}

 30%|███       | 3352/11049 [34:31<1:18:43,  1.63it/s]
 30%|███       | 3353/11049 [34:31<1:18:40,  1.63it/s]
                                                      
{'loss': 0.2513, 'grad_norm': 0.5045745968818665, 'learning_rate': 8.791134035338991e-06, 'epoch': 0.91}

 30%|███       | 3353/11049 [34:31<1:18:40,  1.63it/s]
 30%|███       | 3354/11049 [34:32<1:18:38,  1.63it/s]
                                                      
{'loss': 0.3023, 'grad_norm': 0.5025117993354797, 'learning_rate': 8.790103933767545e-06, 'epoch': 0.91}

 30%|███       | 3354/11049 [34:32<1:18:38,  1.63it/s]
 30%|███       | 3355/11049 [34:32<1:18:39,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.6079874038696289, 'learning_rate': 8.789073453902815e-06, 'epoch': 0.91}

 30%|███       | 3355/11049 [34:32<1:18:39,  1.63it/s]
 30%|███       | 3356/11049 [34:33<1:18:40,  1.63it/s]
                                                      
{'loss': 0.2742, 'grad_norm': 0.5131996870040894, 'learning_rate': 8.788042595847656e-06, 'epoch': 0.91}

 30%|███       | 3356/11049 [34:33<1:18:40,  1.63it/s]
 30%|███       | 3357/11049 [34:33<1:18:37,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.4763445258140564, 'learning_rate': 8.787011359704956e-06, 'epoch': 0.91}

 30%|███       | 3357/11049 [34:34<1:18:37,  1.63it/s]
 30%|███       | 3358/11049 [34:34<1:18:38,  1.63it/s]
                                                      
{'loss': 0.2859, 'grad_norm': 0.5083800554275513, 'learning_rate': 8.785979745577646e-06, 'epoch': 0.91}

 30%|███       | 3358/11049 [34:34<1:18:38,  1.63it/s]
 30%|███       | 3359/11049 [34:35<1:18:36,  1.63it/s]
                                                      
{'loss': 0.2525, 'grad_norm': 0.5758336782455444, 'learning_rate': 8.784947753568694e-06, 'epoch': 0.91}

 30%|███       | 3359/11049 [34:35<1:18:36,  1.63it/s]
 30%|███       | 3360/11049 [34:35<1:18:37,  1.63it/s]
                                                      
{'loss': 0.3674, 'grad_norm': 0.6277015209197998, 'learning_rate': 8.7839153837811e-06, 'epoch': 0.91}

 30%|███       | 3360/11049 [34:35<1:18:37,  1.63it/s]
 30%|███       | 3361/11049 [34:36<1:18:36,  1.63it/s]
                                                      
{'loss': 0.1942, 'grad_norm': 0.41612282395362854, 'learning_rate': 8.782882636317904e-06, 'epoch': 0.91}

 30%|███       | 3361/11049 [34:36<1:18:36,  1.63it/s]
 30%|███       | 3362/11049 [34:37<1:18:33,  1.63it/s]
                                                      
{'loss': 0.2846, 'grad_norm': 0.6069758534431458, 'learning_rate': 8.78184951128219e-06, 'epoch': 0.91}

 30%|███       | 3362/11049 [34:37<1:18:33,  1.63it/s]
 30%|███       | 3363/11049 [34:37<1:18:32,  1.63it/s]
                                                      
{'loss': 0.2673, 'grad_norm': 0.5177463889122009, 'learning_rate': 8.780816008777075e-06, 'epoch': 0.91}

 30%|███       | 3363/11049 [34:37<1:18:32,  1.63it/s]
 30%|███       | 3364/11049 [34:38<1:18:30,  1.63it/s]
                                                      
{'loss': 0.2065, 'grad_norm': 0.4713684022426605, 'learning_rate': 8.779782128905712e-06, 'epoch': 0.91}

 30%|███       | 3364/11049 [34:38<1:18:30,  1.63it/s]
 30%|███       | 3365/11049 [34:38<1:18:30,  1.63it/s]
                                                      
{'loss': 0.2196, 'grad_norm': 0.5565057992935181, 'learning_rate': 8.778747871771293e-06, 'epoch': 0.91}

 30%|███       | 3365/11049 [34:39<1:18:30,  1.63it/s]
 30%|███       | 3366/11049 [34:39<1:18:29,  1.63it/s]
                                                      
{'loss': 0.2666, 'grad_norm': 0.5100617408752441, 'learning_rate': 8.777713237477048e-06, 'epoch': 0.91}

 30%|███       | 3366/11049 [34:39<1:18:29,  1.63it/s]
 30%|███       | 3367/11049 [34:40<1:18:29,  1.63it/s]
                                                      
{'loss': 0.2811, 'grad_norm': 0.5494892597198486, 'learning_rate': 8.776678226126245e-06, 'epoch': 0.91}

 30%|███       | 3367/11049 [34:40<1:18:29,  1.63it/s]
 30%|███       | 3368/11049 [34:40<1:18:30,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.5594162344932556, 'learning_rate': 8.77564283782219e-06, 'epoch': 0.91}

 30%|███       | 3368/11049 [34:40<1:18:30,  1.63it/s]
 30%|███       | 3369/11049 [34:41<1:18:30,  1.63it/s]
                                                      
{'loss': 0.2257, 'grad_norm': 0.5351305603981018, 'learning_rate': 8.774607072668225e-06, 'epoch': 0.91}

 30%|███       | 3369/11049 [34:41<1:18:30,  1.63it/s]
 31%|███       | 3370/11049 [34:41<1:18:31,  1.63it/s]
                                                      
{'loss': 0.2784, 'grad_norm': 0.5822980403900146, 'learning_rate': 8.773570930767732e-06, 'epoch': 0.92}

 31%|███       | 3370/11049 [34:42<1:18:31,  1.63it/s]
 31%|███       | 3371/11049 [34:42<1:18:32,  1.63it/s]
                                                      
{'loss': 0.2847, 'grad_norm': 0.540100634098053, 'learning_rate': 8.772534412224128e-06, 'epoch': 0.92}

 31%|███       | 3371/11049 [34:42<1:18:32,  1.63it/s]
 31%|███       | 3372/11049 [34:43<1:18:30,  1.63it/s]
                                                      
{'loss': 0.2328, 'grad_norm': 0.513400137424469, 'learning_rate': 8.771497517140868e-06, 'epoch': 0.92}

 31%|███       | 3372/11049 [34:43<1:18:30,  1.63it/s]
 31%|███       | 3373/11049 [34:43<1:18:31,  1.63it/s]
                                                      
{'loss': 0.2581, 'grad_norm': 0.5768933296203613, 'learning_rate': 8.770460245621446e-06, 'epoch': 0.92}

 31%|███       | 3373/11049 [34:43<1:18:31,  1.63it/s]
 31%|███       | 3374/11049 [34:44<1:18:29,  1.63it/s]
                                                      
{'loss': 0.2762, 'grad_norm': 0.5770443081855774, 'learning_rate': 8.769422597769396e-06, 'epoch': 0.92}

 31%|███       | 3374/11049 [34:44<1:18:29,  1.63it/s]
 31%|███       | 3375/11049 [34:45<1:18:26,  1.63it/s]
                                                      
{'loss': 0.3512, 'grad_norm': 0.7093203067779541, 'learning_rate': 8.76838457368828e-06, 'epoch': 0.92}

 31%|███       | 3375/11049 [34:45<1:18:26,  1.63it/s]
 31%|███       | 3376/11049 [34:45<1:18:24,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.5615256428718567, 'learning_rate': 8.767346173481708e-06, 'epoch': 0.92}

 31%|███       | 3376/11049 [34:45<1:18:24,  1.63it/s]
 31%|███       | 3377/11049 [34:46<1:18:22,  1.63it/s]
                                                      
{'loss': 0.3907, 'grad_norm': 0.7175682187080383, 'learning_rate': 8.766307397253325e-06, 'epoch': 0.92}

 31%|███       | 3377/11049 [34:46<1:18:22,  1.63it/s]
 31%|███       | 3378/11049 [34:46<1:18:22,  1.63it/s]
                                                      
{'loss': 0.2693, 'grad_norm': 0.5074103474617004, 'learning_rate': 8.765268245106808e-06, 'epoch': 0.92}

 31%|███       | 3378/11049 [34:46<1:18:22,  1.63it/s]
 31%|███       | 3379/11049 [34:47<1:18:23,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.6429075598716736, 'learning_rate': 8.76422871714588e-06, 'epoch': 0.92}

 31%|███       | 3379/11049 [34:47<1:18:23,  1.63it/s]
 31%|███       | 3380/11049 [34:48<1:18:22,  1.63it/s]
                                                      
{'loss': 0.2676, 'grad_norm': 0.5842979550361633, 'learning_rate': 8.763188813474293e-06, 'epoch': 0.92}

 31%|███       | 3380/11049 [34:48<1:18:22,  1.63it/s]
 31%|███       | 3381/11049 [34:48<1:18:23,  1.63it/s]
                                                      
{'loss': 0.2751, 'grad_norm': 0.5873875021934509, 'learning_rate': 8.762148534195843e-06, 'epoch': 0.92}

 31%|███       | 3381/11049 [34:48<1:18:23,  1.63it/s]
 31%|███       | 3382/11049 [34:49<1:18:22,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.4552611708641052, 'learning_rate': 8.761107879414362e-06, 'epoch': 0.92}

 31%|███       | 3382/11049 [34:49<1:18:22,  1.63it/s]
 31%|███       | 3383/11049 [34:49<1:18:21,  1.63it/s]
                                                      
{'loss': 0.2826, 'grad_norm': 0.5690803527832031, 'learning_rate': 8.760066849233715e-06, 'epoch': 0.92}

 31%|███       | 3383/11049 [34:50<1:18:21,  1.63it/s]
 31%|███       | 3384/11049 [34:50<1:18:22,  1.63it/s]
                                                      
{'loss': 0.2231, 'grad_norm': 0.4843570291996002, 'learning_rate': 8.75902544375781e-06, 'epoch': 0.92}

 31%|███       | 3384/11049 [34:50<1:18:22,  1.63it/s]
 31%|███       | 3385/11049 [34:51<1:18:19,  1.63it/s]
                                                      
{'loss': 0.2727, 'grad_norm': 0.6002342700958252, 'learning_rate': 8.757983663090593e-06, 'epoch': 0.92}

 31%|███       | 3385/11049 [34:51<1:18:19,  1.63it/s]
 31%|███       | 3386/11049 [34:51<1:18:21,  1.63it/s]
                                                      
{'loss': 0.2437, 'grad_norm': 0.45524880290031433, 'learning_rate': 8.756941507336042e-06, 'epoch': 0.92}

 31%|███       | 3386/11049 [34:51<1:18:21,  1.63it/s]
 31%|███       | 3387/11049 [34:52<1:18:18,  1.63it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.5365269184112549, 'learning_rate': 8.755898976598175e-06, 'epoch': 0.92}

 31%|███       | 3387/11049 [34:52<1:18:18,  1.63it/s]
 31%|███       | 3388/11049 [34:52<1:18:18,  1.63it/s]
                                                      
{'loss': 0.2846, 'grad_norm': 0.5301093459129333, 'learning_rate': 8.754856070981049e-06, 'epoch': 0.92}

 31%|███       | 3388/11049 [34:53<1:18:18,  1.63it/s]
 31%|███       | 3389/11049 [34:53<1:18:18,  1.63it/s]
                                                      
{'loss': 0.3613, 'grad_norm': 0.700477659702301, 'learning_rate': 8.753812790588759e-06, 'epoch': 0.92}

 31%|███       | 3389/11049 [34:53<1:18:18,  1.63it/s]
 31%|███       | 3390/11049 [34:54<1:18:19,  1.63it/s]
                                                      
{'loss': 0.1803, 'grad_norm': 0.4546058177947998, 'learning_rate': 8.752769135525431e-06, 'epoch': 0.92}

 31%|███       | 3390/11049 [34:54<1:18:19,  1.63it/s]
 31%|███       | 3391/11049 [34:54<1:18:17,  1.63it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.5658736228942871, 'learning_rate': 8.751725105895237e-06, 'epoch': 0.92}

 31%|███       | 3391/11049 [34:54<1:18:17,  1.63it/s]
 31%|███       | 3392/11049 [34:55<1:18:17,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.547345757484436, 'learning_rate': 8.750680701802383e-06, 'epoch': 0.92}

 31%|███       | 3392/11049 [34:55<1:18:17,  1.63it/s]
 31%|███       | 3393/11049 [34:56<1:18:19,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5636675357818604, 'learning_rate': 8.749635923351108e-06, 'epoch': 0.92}

 31%|███       | 3393/11049 [34:56<1:18:19,  1.63it/s]
 31%|███       | 3394/11049 [34:56<1:18:16,  1.63it/s]
                                                      
{'loss': 0.2396, 'grad_norm': 0.4739367365837097, 'learning_rate': 8.748590770645695e-06, 'epoch': 0.92}

 31%|███       | 3394/11049 [34:56<1:18:16,  1.63it/s]
 31%|███       | 3395/11049 [34:57<1:18:16,  1.63it/s]
                                                      
{'loss': 0.2558, 'grad_norm': 0.4765406548976898, 'learning_rate': 8.74754524379046e-06, 'epoch': 0.92}

 31%|███       | 3395/11049 [34:57<1:18:16,  1.63it/s]
 31%|███       | 3396/11049 [34:57<1:18:14,  1.63it/s]
                                                      
{'loss': 0.3161, 'grad_norm': 0.5889214277267456, 'learning_rate': 8.74649934288976e-06, 'epoch': 0.92}

 31%|███       | 3396/11049 [34:58<1:18:14,  1.63it/s]
 31%|███       | 3397/11049 [34:58<1:18:12,  1.63it/s]
                                                      
{'loss': 0.1787, 'grad_norm': 0.39052820205688477, 'learning_rate': 8.745453068047984e-06, 'epoch': 0.92}

 31%|███       | 3397/11049 [34:58<1:18:12,  1.63it/s]
 31%|███       | 3398/11049 [34:59<1:18:11,  1.63it/s]
                                                      
{'loss': 0.3691, 'grad_norm': 0.6628642678260803, 'learning_rate': 8.744406419369565e-06, 'epoch': 0.92}

 31%|███       | 3398/11049 [34:59<1:18:11,  1.63it/s]
 31%|███       | 3399/11049 [34:59<1:18:11,  1.63it/s]
                                                      
{'loss': 0.2649, 'grad_norm': 0.6629934310913086, 'learning_rate': 8.743359396958966e-06, 'epoch': 0.92}

 31%|███       | 3399/11049 [34:59<1:18:11,  1.63it/s]
 31%|███       | 3400/11049 [35:00<1:18:10,  1.63it/s]
                                                      
{'loss': 0.2059, 'grad_norm': 0.4845848083496094, 'learning_rate': 8.742312000920696e-06, 'epoch': 0.92}

 31%|███       | 3400/11049 [35:00<1:18:10,  1.63it/s]
 31%|███       | 3401/11049 [35:00<1:18:11,  1.63it/s]
                                                      
{'loss': 0.2019, 'grad_norm': 0.5159844160079956, 'learning_rate': 8.741264231359293e-06, 'epoch': 0.92}

 31%|███       | 3401/11049 [35:01<1:18:11,  1.63it/s]
 31%|███       | 3402/11049 [35:01<1:18:10,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.5202776193618774, 'learning_rate': 8.740216088379335e-06, 'epoch': 0.92}

 31%|███       | 3402/11049 [35:01<1:18:10,  1.63it/s]
 31%|███       | 3403/11049 [35:02<1:18:09,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5443356037139893, 'learning_rate': 8.73916757208544e-06, 'epoch': 0.92}

 31%|███       | 3403/11049 [35:02<1:18:09,  1.63it/s]
 31%|███       | 3404/11049 [35:02<1:18:10,  1.63it/s]
                                                      
{'loss': 0.2224, 'grad_norm': 0.5500664114952087, 'learning_rate': 8.738118682582262e-06, 'epoch': 0.92}

 31%|███       | 3404/11049 [35:02<1:18:10,  1.63it/s]
 31%|███       | 3405/11049 [35:03<1:18:07,  1.63it/s]
                                                      
{'loss': 0.3132, 'grad_norm': 0.611966609954834, 'learning_rate': 8.737069419974488e-06, 'epoch': 0.92}

 31%|███       | 3405/11049 [35:03<1:18:07,  1.63it/s]
 31%|███       | 3406/11049 [35:04<1:18:06,  1.63it/s]
                                                      
{'loss': 0.1911, 'grad_norm': 0.4397388696670532, 'learning_rate': 8.736019784366849e-06, 'epoch': 0.92}

 31%|███       | 3406/11049 [35:04<1:18:06,  1.63it/s]
 31%|███       | 3407/11049 [35:04<1:18:04,  1.63it/s]
                                                      
{'loss': 0.2789, 'grad_norm': 0.5372395515441895, 'learning_rate': 8.73496977586411e-06, 'epoch': 0.93}

 31%|███       | 3407/11049 [35:04<1:18:04,  1.63it/s]
 31%|███       | 3408/11049 [35:05<1:18:05,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.5964475274085999, 'learning_rate': 8.73391939457107e-06, 'epoch': 0.93}

 31%|███       | 3408/11049 [35:05<1:18:05,  1.63it/s]
 31%|███       | 3409/11049 [35:05<1:18:05,  1.63it/s]
                                                      
{'loss': 0.2719, 'grad_norm': 0.6272433400154114, 'learning_rate': 8.732868640592573e-06, 'epoch': 0.93}

 31%|███       | 3409/11049 [35:05<1:18:05,  1.63it/s]
 31%|███       | 3410/11049 [35:06<1:18:09,  1.63it/s]
                                                      
{'loss': 0.2888, 'grad_norm': 0.5127263069152832, 'learning_rate': 8.73181751403349e-06, 'epoch': 0.93}

 31%|███       | 3410/11049 [35:06<1:18:09,  1.63it/s]
 31%|███       | 3411/11049 [35:07<1:18:07,  1.63it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.5648372769355774, 'learning_rate': 8.73076601499874e-06, 'epoch': 0.93}

 31%|███       | 3411/11049 [35:07<1:18:07,  1.63it/s]
 31%|███       | 3412/11049 [35:07<1:18:05,  1.63it/s]
                                                      
{'loss': 0.2133, 'grad_norm': 0.44032973051071167, 'learning_rate': 8.729714143593271e-06, 'epoch': 0.93}

 31%|███       | 3412/11049 [35:07<1:18:05,  1.63it/s]
 31%|███       | 3413/11049 [35:08<1:18:04,  1.63it/s]
                                                      
{'loss': 0.2688, 'grad_norm': 0.5740689039230347, 'learning_rate': 8.728661899922072e-06, 'epoch': 0.93}

 31%|███       | 3413/11049 [35:08<1:18:04,  1.63it/s]
 31%|███       | 3414/11049 [35:08<1:18:06,  1.63it/s]
                                                      
{'loss': 0.3569, 'grad_norm': 0.5942481756210327, 'learning_rate': 8.727609284090167e-06, 'epoch': 0.93}

 31%|███       | 3414/11049 [35:09<1:18:06,  1.63it/s]
 31%|███       | 3415/11049 [35:09<1:18:05,  1.63it/s]
                                                      
{'loss': 0.2792, 'grad_norm': 0.5444521307945251, 'learning_rate': 8.726556296202622e-06, 'epoch': 0.93}

 31%|███       | 3415/11049 [35:09<1:18:05,  1.63it/s]
 31%|███       | 3416/11049 [35:10<1:18:03,  1.63it/s]
                                                      
{'loss': 0.3117, 'grad_norm': 0.6447073221206665, 'learning_rate': 8.725502936364532e-06, 'epoch': 0.93}

 31%|███       | 3416/11049 [35:10<1:18:03,  1.63it/s]
 31%|███       | 3417/11049 [35:10<1:18:00,  1.63it/s]
                                                      
{'loss': 0.2321, 'grad_norm': 0.5061256289482117, 'learning_rate': 8.724449204681036e-06, 'epoch': 0.93}

 31%|███       | 3417/11049 [35:10<1:18:00,  1.63it/s]
 31%|███       | 3418/11049 [35:11<1:18:00,  1.63it/s]
                                                      
{'loss': 0.3748, 'grad_norm': 0.6336988210678101, 'learning_rate': 8.723395101257308e-06, 'epoch': 0.93}

 31%|███       | 3418/11049 [35:11<1:18:00,  1.63it/s]
 31%|███       | 3419/11049 [35:12<1:17:59,  1.63it/s]
                                                      
{'loss': 0.2508, 'grad_norm': 0.5905237793922424, 'learning_rate': 8.72234062619856e-06, 'epoch': 0.93}

 31%|███       | 3419/11049 [35:12<1:17:59,  1.63it/s]
 31%|███       | 3420/11049 [35:12<1:18:00,  1.63it/s]
                                                      
{'loss': 0.365, 'grad_norm': 0.6163025498390198, 'learning_rate': 8.721285779610036e-06, 'epoch': 0.93}

 31%|███       | 3420/11049 [35:12<1:18:00,  1.63it/s]
 31%|███       | 3421/11049 [35:13<1:17:59,  1.63it/s]
                                                      
{'loss': 0.2835, 'grad_norm': 0.5133692026138306, 'learning_rate': 8.720230561597025e-06, 'epoch': 0.93}

 31%|███       | 3421/11049 [35:13<1:17:59,  1.63it/s]
 31%|███       | 3422/11049 [35:13<1:17:56,  1.63it/s]
                                                      
{'loss': 0.2392, 'grad_norm': 0.5438109636306763, 'learning_rate': 8.719174972264847e-06, 'epoch': 0.93}

 31%|███       | 3422/11049 [35:13<1:17:56,  1.63it/s]
 31%|███       | 3423/11049 [35:14<1:17:56,  1.63it/s]
                                                      
{'loss': 0.2669, 'grad_norm': 0.4920324683189392, 'learning_rate': 8.718119011718863e-06, 'epoch': 0.93}

 31%|███       | 3423/11049 [35:14<1:17:56,  1.63it/s]
 31%|███       | 3424/11049 [35:15<1:17:56,  1.63it/s]
                                                      
{'loss': 0.2581, 'grad_norm': 0.5942758917808533, 'learning_rate': 8.717062680064467e-06, 'epoch': 0.93}

 31%|███       | 3424/11049 [35:15<1:17:56,  1.63it/s]
 31%|███       | 3425/11049 [35:15<1:17:55,  1.63it/s]
                                                      
{'loss': 0.2106, 'grad_norm': 0.4998747408390045, 'learning_rate': 8.716005977407094e-06, 'epoch': 0.93}

 31%|███       | 3425/11049 [35:15<1:17:55,  1.63it/s]
 31%|███       | 3426/11049 [35:16<1:17:54,  1.63it/s]
                                                      
{'loss': 0.173, 'grad_norm': 0.3697258234024048, 'learning_rate': 8.714948903852214e-06, 'epoch': 0.93}

 31%|███       | 3426/11049 [35:16<1:17:54,  1.63it/s]
 31%|███       | 3427/11049 [35:16<1:17:54,  1.63it/s]
                                                      
{'loss': 0.234, 'grad_norm': 0.4687865376472473, 'learning_rate': 8.713891459505335e-06, 'epoch': 0.93}

 31%|███       | 3427/11049 [35:17<1:17:54,  1.63it/s]
 31%|███       | 3428/11049 [35:17<1:17:53,  1.63it/s]
                                                      
{'loss': 0.2723, 'grad_norm': 0.5619974136352539, 'learning_rate': 8.712833644471998e-06, 'epoch': 0.93}

 31%|███       | 3428/11049 [35:17<1:17:53,  1.63it/s]
 31%|███       | 3429/11049 [35:18<1:17:52,  1.63it/s]
                                                      
{'loss': 0.3133, 'grad_norm': 1.1848547458648682, 'learning_rate': 8.71177545885779e-06, 'epoch': 0.93}

 31%|███       | 3429/11049 [35:18<1:17:52,  1.63it/s]
 31%|███       | 3430/11049 [35:18<1:17:51,  1.63it/s]
                                                      
{'loss': 0.2965, 'grad_norm': 0.5377612709999084, 'learning_rate': 8.710716902768323e-06, 'epoch': 0.93}

 31%|███       | 3430/11049 [35:18<1:17:51,  1.63it/s]
 31%|███       | 3431/11049 [35:19<1:17:49,  1.63it/s]
                                                      
{'loss': 0.2547, 'grad_norm': 0.5006964206695557, 'learning_rate': 8.709657976309258e-06, 'epoch': 0.93}

 31%|███       | 3431/11049 [35:19<1:17:49,  1.63it/s]
 31%|███       | 3432/11049 [35:19<1:17:49,  1.63it/s]
                                                      
{'loss': 0.2812, 'grad_norm': 0.5159085988998413, 'learning_rate': 8.708598679586285e-06, 'epoch': 0.93}

 31%|███       | 3432/11049 [35:20<1:17:49,  1.63it/s]
 31%|███       | 3433/11049 [35:20<1:17:52,  1.63it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.5017852783203125, 'learning_rate': 8.707539012705133e-06, 'epoch': 0.93}

 31%|███       | 3433/11049 [35:20<1:17:52,  1.63it/s]
 31%|███       | 3434/11049 [35:21<1:17:53,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.5992295742034912, 'learning_rate': 8.706478975771566e-06, 'epoch': 0.93}

 31%|███       | 3434/11049 [35:21<1:17:53,  1.63it/s]
 31%|███       | 3435/11049 [35:21<1:17:55,  1.63it/s]
                                                      
{'loss': 0.3406, 'grad_norm': 0.6243144273757935, 'learning_rate': 8.70541856889139e-06, 'epoch': 0.93}

 31%|███       | 3435/11049 [35:21<1:17:55,  1.63it/s]
 31%|███       | 3436/11049 [35:22<1:17:53,  1.63it/s]
                                                      
{'loss': 0.2857, 'grad_norm': 0.5871747732162476, 'learning_rate': 8.704357792170445e-06, 'epoch': 0.93}

 31%|███       | 3436/11049 [35:22<1:17:53,  1.63it/s]
 31%|███       | 3437/11049 [35:23<1:17:50,  1.63it/s]
                                                      
{'loss': 0.2864, 'grad_norm': 0.5818986296653748, 'learning_rate': 8.70329664571461e-06, 'epoch': 0.93}

 31%|███       | 3437/11049 [35:23<1:17:50,  1.63it/s]
 31%|███       | 3438/11049 [35:23<1:17:50,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.4227556586265564, 'learning_rate': 8.702235129629794e-06, 'epoch': 0.93}

 31%|███       | 3438/11049 [35:23<1:17:50,  1.63it/s]
 31%|███       | 3439/11049 [35:24<1:17:48,  1.63it/s]
                                                      
{'loss': 0.242, 'grad_norm': 0.5336202383041382, 'learning_rate': 8.70117324402195e-06, 'epoch': 0.93}

 31%|███       | 3439/11049 [35:24<1:17:48,  1.63it/s]
 31%|███       | 3440/11049 [35:24<1:17:46,  1.63it/s]
                                                      
{'loss': 0.2906, 'grad_norm': 0.5786550641059875, 'learning_rate': 8.700110988997066e-06, 'epoch': 0.93}

 31%|███       | 3440/11049 [35:25<1:17:46,  1.63it/s]
 31%|███       | 3441/11049 [35:25<1:17:45,  1.63it/s]
                                                      
{'loss': 0.239, 'grad_norm': 0.4856235980987549, 'learning_rate': 8.699048364661167e-06, 'epoch': 0.93}

 31%|███       | 3441/11049 [35:25<1:17:45,  1.63it/s]
 31%|███       | 3442/11049 [35:26<1:17:44,  1.63it/s]
                                                      
{'loss': 0.3268, 'grad_norm': 0.6781840324401855, 'learning_rate': 8.697985371120313e-06, 'epoch': 0.93}

 31%|███       | 3442/11049 [35:26<1:17:44,  1.63it/s]
 31%|███       | 3443/11049 [35:26<1:17:43,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.635546088218689, 'learning_rate': 8.696922008480602e-06, 'epoch': 0.93}

 31%|███       | 3443/11049 [35:26<1:17:43,  1.63it/s]
 31%|███       | 3444/11049 [35:27<1:17:42,  1.63it/s]
                                                      
{'loss': 0.3348, 'grad_norm': 0.6105071902275085, 'learning_rate': 8.69585827684817e-06, 'epoch': 0.94}

 31%|███       | 3444/11049 [35:27<1:17:42,  1.63it/s]
 31%|███       | 3445/11049 [35:27<1:17:42,  1.63it/s]
                                                      
{'loss': 0.3212, 'grad_norm': 0.6560532450675964, 'learning_rate': 8.69479417632919e-06, 'epoch': 0.94}

 31%|███       | 3445/11049 [35:28<1:17:42,  1.63it/s]
 31%|███       | 3446/11049 [35:28<1:17:42,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.6724179983139038, 'learning_rate': 8.693729707029869e-06, 'epoch': 0.94}

 31%|███       | 3446/11049 [35:28<1:17:42,  1.63it/s]
 31%|███       | 3447/11049 [35:29<1:17:39,  1.63it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.5337513089179993, 'learning_rate': 8.692664869056453e-06, 'epoch': 0.94}

 31%|███       | 3447/11049 [35:29<1:17:39,  1.63it/s]
 31%|███       | 3448/11049 [35:29<1:17:39,  1.63it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.5837531089782715, 'learning_rate': 8.691599662515224e-06, 'epoch': 0.94}

 31%|███       | 3448/11049 [35:29<1:17:39,  1.63it/s]
 31%|███       | 3449/11049 [35:30<1:17:38,  1.63it/s]
                                                      
{'loss': 0.4037, 'grad_norm': 0.6646715998649597, 'learning_rate': 8.690534087512502e-06, 'epoch': 0.94}

 31%|███       | 3449/11049 [35:30<1:17:38,  1.63it/s]
 31%|███       | 3450/11049 [35:31<1:17:37,  1.63it/s]
                                                      
{'loss': 0.3517, 'grad_norm': 0.6264489889144897, 'learning_rate': 8.689468144154643e-06, 'epoch': 0.94}

 31%|███       | 3450/11049 [35:31<1:17:37,  1.63it/s]
 31%|███       | 3451/11049 [35:31<1:17:38,  1.63it/s]
                                                      
{'loss': 0.2362, 'grad_norm': 0.5110631585121155, 'learning_rate': 8.688401832548037e-06, 'epoch': 0.94}

 31%|███       | 3451/11049 [35:31<1:17:38,  1.63it/s]
 31%|███       | 3452/11049 [35:32<1:17:37,  1.63it/s]
                                                      
{'loss': 0.2176, 'grad_norm': 0.5013009309768677, 'learning_rate': 8.687335152799117e-06, 'epoch': 0.94}

 31%|███       | 3452/11049 [35:32<1:17:37,  1.63it/s]
 31%|███▏      | 3453/11049 [35:32<1:17:37,  1.63it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.49743813276290894, 'learning_rate': 8.686268105014348e-06, 'epoch': 0.94}

 31%|███▏      | 3453/11049 [35:32<1:17:37,  1.63it/s]
 31%|███▏      | 3454/11049 [35:33<1:17:38,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.448919415473938, 'learning_rate': 8.685200689300231e-06, 'epoch': 0.94}

 31%|███▏      | 3454/11049 [35:33<1:17:38,  1.63it/s]
 31%|███▏      | 3455/11049 [35:34<1:17:39,  1.63it/s]
                                                      
{'loss': 0.2255, 'grad_norm': 0.5489384531974792, 'learning_rate': 8.68413290576331e-06, 'epoch': 0.94}

 31%|███▏      | 3455/11049 [35:34<1:17:39,  1.63it/s]
 31%|███▏      | 3456/11049 [35:34<1:17:40,  1.63it/s]
                                                      
{'loss': 0.2597, 'grad_norm': 0.560533344745636, 'learning_rate': 8.683064754510156e-06, 'epoch': 0.94}

 31%|███▏      | 3456/11049 [35:34<1:17:40,  1.63it/s]
 31%|███▏      | 3457/11049 [35:35<1:17:39,  1.63it/s]
                                                      
{'loss': 0.2726, 'grad_norm': 0.6099877953529358, 'learning_rate': 8.681996235647385e-06, 'epoch': 0.94}

 31%|███▏      | 3457/11049 [35:35<1:17:39,  1.63it/s]
 31%|███▏      | 3458/11049 [35:35<1:17:38,  1.63it/s]
                                                      
{'loss': 0.2689, 'grad_norm': 0.5438134074211121, 'learning_rate': 8.680927349281645e-06, 'epoch': 0.94}

 31%|███▏      | 3458/11049 [35:36<1:17:38,  1.63it/s]
 31%|███▏      | 3459/11049 [35:36<1:17:38,  1.63it/s]
                                                      
{'loss': 0.2544, 'grad_norm': 0.5046934485435486, 'learning_rate': 8.679858095519624e-06, 'epoch': 0.94}

 31%|███▏      | 3459/11049 [35:36<1:17:38,  1.63it/s]
 31%|███▏      | 3460/11049 [35:37<1:17:34,  1.63it/s]
                                                      
{'loss': 0.2435, 'grad_norm': 0.49863237142562866, 'learning_rate': 8.678788474468044e-06, 'epoch': 0.94}

 31%|███▏      | 3460/11049 [35:37<1:17:34,  1.63it/s]
 31%|███▏      | 3461/11049 [35:37<1:17:36,  1.63it/s]
                                                      
{'loss': 0.2804, 'grad_norm': 0.5901271104812622, 'learning_rate': 8.677718486233669e-06, 'epoch': 0.94}

 31%|███▏      | 3461/11049 [35:37<1:17:36,  1.63it/s]
 31%|███▏      | 3462/11049 [35:38<1:17:35,  1.63it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.5160835981369019, 'learning_rate': 8.676648130923288e-06, 'epoch': 0.94}

 31%|███▏      | 3462/11049 [35:38<1:17:35,  1.63it/s]
 31%|███▏      | 3463/11049 [35:38<1:17:33,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.4916277229785919, 'learning_rate': 8.675577408643738e-06, 'epoch': 0.94}

 31%|███▏      | 3463/11049 [35:39<1:17:33,  1.63it/s]
 31%|███▏      | 3464/11049 [35:39<1:17:32,  1.63it/s]
                                                      
{'loss': 0.2294, 'grad_norm': 0.5046831369400024, 'learning_rate': 8.67450631950189e-06, 'epoch': 0.94}

 31%|███▏      | 3464/11049 [35:39<1:17:32,  1.63it/s]
 31%|███▏      | 3465/11049 [35:40<1:17:30,  1.63it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.5709047317504883, 'learning_rate': 8.67343486360465e-06, 'epoch': 0.94}

 31%|███▏      | 3465/11049 [35:40<1:17:30,  1.63it/s]
 31%|███▏      | 3466/11049 [35:40<1:17:29,  1.63it/s]
                                                      
{'loss': 0.2873, 'grad_norm': 0.5083459615707397, 'learning_rate': 8.672363041058955e-06, 'epoch': 0.94}

 31%|███▏      | 3466/11049 [35:40<1:17:29,  1.63it/s]
 31%|███▏      | 3467/11049 [35:41<1:17:30,  1.63it/s]
                                                      
{'loss': 0.2201, 'grad_norm': 0.5411668419837952, 'learning_rate': 8.671290851971792e-06, 'epoch': 0.94}

 31%|███▏      | 3467/11049 [35:41<1:17:30,  1.63it/s]
 31%|███▏      | 3468/11049 [35:42<1:17:31,  1.63it/s]
                                                      
{'loss': 0.246, 'grad_norm': 0.5287266969680786, 'learning_rate': 8.670218296450172e-06, 'epoch': 0.94}

 31%|███▏      | 3468/11049 [35:42<1:17:31,  1.63it/s]
 31%|███▏      | 3469/11049 [35:42<1:17:31,  1.63it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.6104708313941956, 'learning_rate': 8.66914537460115e-06, 'epoch': 0.94}

 31%|███▏      | 3469/11049 [35:42<1:17:31,  1.63it/s]
 31%|███▏      | 3470/11049 [35:43<1:17:29,  1.63it/s]
                                                      
{'loss': 0.2672, 'grad_norm': 0.5579060912132263, 'learning_rate': 8.668072086531818e-06, 'epoch': 0.94}

 31%|███▏      | 3470/11049 [35:43<1:17:29,  1.63it/s]
 31%|███▏      | 3471/11049 [35:43<1:17:26,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.48962485790252686, 'learning_rate': 8.666998432349296e-06, 'epoch': 0.94}

 31%|███▏      | 3471/11049 [35:44<1:17:26,  1.63it/s]
 31%|███▏      | 3472/11049 [35:44<1:17:27,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.4744560122489929, 'learning_rate': 8.665924412160749e-06, 'epoch': 0.94}

 31%|███▏      | 3472/11049 [35:44<1:17:27,  1.63it/s]
 31%|███▏      | 3473/11049 [35:45<1:17:28,  1.63it/s]
                                                      
{'loss': 0.3301, 'grad_norm': 0.6285012364387512, 'learning_rate': 8.664850026073376e-06, 'epoch': 0.94}

 31%|███▏      | 3473/11049 [35:45<1:17:28,  1.63it/s]
 31%|███▏      | 3474/11049 [35:45<1:17:25,  1.63it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.5473739504814148, 'learning_rate': 8.66377527419441e-06, 'epoch': 0.94}

 31%|███▏      | 3474/11049 [35:45<1:17:25,  1.63it/s]
 31%|███▏      | 3475/11049 [35:46<1:17:23,  1.63it/s]
                                                      
{'loss': 0.2904, 'grad_norm': 0.5820268988609314, 'learning_rate': 8.662700156631128e-06, 'epoch': 0.94}

 31%|███▏      | 3475/11049 [35:46<1:17:23,  1.63it/s]
 31%|███▏      | 3476/11049 [35:46<1:17:23,  1.63it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.4667697846889496, 'learning_rate': 8.661624673490834e-06, 'epoch': 0.94}

 31%|███▏      | 3476/11049 [35:47<1:17:23,  1.63it/s]
 31%|███▏      | 3477/11049 [35:47<1:17:24,  1.63it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.5673524141311646, 'learning_rate': 8.660548824880871e-06, 'epoch': 0.94}

 31%|███▏      | 3477/11049 [35:47<1:17:24,  1.63it/s]
 31%|███▏      | 3478/11049 [35:48<1:17:23,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5558443069458008, 'learning_rate': 8.659472610908628e-06, 'epoch': 0.94}

 31%|███▏      | 3478/11049 [35:48<1:17:23,  1.63it/s]
 31%|███▏      | 3479/11049 [35:48<1:17:23,  1.63it/s]
                                                      
{'loss': 0.231, 'grad_norm': 0.49369052052497864, 'learning_rate': 8.658396031681515e-06, 'epoch': 0.94}

 31%|███▏      | 3479/11049 [35:48<1:17:23,  1.63it/s]
 31%|███▏      | 3480/11049 [35:49<1:17:22,  1.63it/s]
                                                      
{'loss': 0.257, 'grad_norm': 0.5524793267250061, 'learning_rate': 8.65731908730699e-06, 'epoch': 0.94}

 31%|███▏      | 3480/11049 [35:49<1:17:22,  1.63it/s]
 32%|███▏      | 3481/11049 [35:50<1:17:21,  1.63it/s]
                                                      
{'loss': 0.2349, 'grad_norm': 0.5005389451980591, 'learning_rate': 8.656241777892544e-06, 'epoch': 0.95}

 32%|███▏      | 3481/11049 [35:50<1:17:21,  1.63it/s]
 32%|███▏      | 3482/11049 [35:50<1:17:20,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.5988596081733704, 'learning_rate': 8.655164103545701e-06, 'epoch': 0.95}

 32%|███▏      | 3482/11049 [35:50<1:17:20,  1.63it/s]
 32%|███▏      | 3483/11049 [35:51<1:17:22,  1.63it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.45953795313835144, 'learning_rate': 8.654086064374027e-06, 'epoch': 0.95}

 32%|███▏      | 3483/11049 [35:51<1:17:22,  1.63it/s]
 32%|███▏      | 3484/11049 [35:51<1:17:24,  1.63it/s]
                                                      
{'loss': 0.2621, 'grad_norm': 0.5431115031242371, 'learning_rate': 8.653007660485124e-06, 'epoch': 0.95}

 32%|███▏      | 3484/11049 [35:52<1:17:24,  1.63it/s]
 32%|███▏      | 3485/11049 [35:52<1:17:21,  1.63it/s]
                                                      
{'loss': 0.2795, 'grad_norm': 0.5258959531784058, 'learning_rate': 8.651928891986623e-06, 'epoch': 0.95}

 32%|███▏      | 3485/11049 [35:52<1:17:21,  1.63it/s]
 32%|███▏      | 3486/11049 [35:53<1:17:18,  1.63it/s]
                                                      
{'loss': 0.198, 'grad_norm': 0.4995421767234802, 'learning_rate': 8.650849758986201e-06, 'epoch': 0.95}

 32%|███▏      | 3486/11049 [35:53<1:17:18,  1.63it/s]
 32%|███▏      | 3487/11049 [35:53<1:17:19,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.5507078170776367, 'learning_rate': 8.649770261591566e-06, 'epoch': 0.95}

 32%|███▏      | 3487/11049 [35:53<1:17:19,  1.63it/s]
 32%|███▏      | 3488/11049 [35:54<1:17:18,  1.63it/s]
                                                      
{'loss': 0.3208, 'grad_norm': 0.6275352239608765, 'learning_rate': 8.648690399910462e-06, 'epoch': 0.95}

 32%|███▏      | 3488/11049 [35:54<1:17:18,  1.63it/s]
 32%|███▏      | 3489/11049 [35:54<1:17:17,  1.63it/s]
                                                      
{'loss': 0.294, 'grad_norm': 0.5796368718147278, 'learning_rate': 8.647610174050672e-06, 'epoch': 0.95}

 32%|███▏      | 3489/11049 [35:55<1:17:17,  1.63it/s]
 32%|███▏      | 3490/11049 [35:55<1:17:17,  1.63it/s]
                                                      
{'loss': 0.2326, 'grad_norm': 0.5237781405448914, 'learning_rate': 8.646529584120014e-06, 'epoch': 0.95}

 32%|███▏      | 3490/11049 [35:55<1:17:17,  1.63it/s]
 32%|███▏      | 3491/11049 [35:56<1:17:17,  1.63it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.4382031559944153, 'learning_rate': 8.645448630226345e-06, 'epoch': 0.95}

 32%|███▏      | 3491/11049 [35:56<1:17:17,  1.63it/s]
 32%|███▏      | 3492/11049 [35:56<1:17:15,  1.63it/s]
                                                      
{'loss': 0.4986, 'grad_norm': 0.7518407106399536, 'learning_rate': 8.644367312477552e-06, 'epoch': 0.95}

 32%|███▏      | 3492/11049 [35:56<1:17:15,  1.63it/s]
 32%|███▏      | 3493/11049 [35:57<1:17:16,  1.63it/s]
                                                      
{'loss': 0.3075, 'grad_norm': 0.569557249546051, 'learning_rate': 8.643285630981564e-06, 'epoch': 0.95}

 32%|███▏      | 3493/11049 [35:57<1:17:16,  1.63it/s]
 32%|███▏      | 3494/11049 [35:58<1:17:13,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.5592289566993713, 'learning_rate': 8.642203585846345e-06, 'epoch': 0.95}

 32%|███▏      | 3494/11049 [35:58<1:17:13,  1.63it/s]
 32%|███▏      | 3495/11049 [35:58<1:17:12,  1.63it/s]
                                                      
{'loss': 0.2803, 'grad_norm': 0.5656803250312805, 'learning_rate': 8.641121177179894e-06, 'epoch': 0.95}

 32%|███▏      | 3495/11049 [35:58<1:17:12,  1.63it/s]
 32%|███▏      | 3496/11049 [35:59<1:17:13,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.5086499452590942, 'learning_rate': 8.640038405090245e-06, 'epoch': 0.95}

 32%|███▏      | 3496/11049 [35:59<1:17:13,  1.63it/s]
 32%|███▏      | 3497/11049 [35:59<1:17:12,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.41725119948387146, 'learning_rate': 8.638955269685475e-06, 'epoch': 0.95}

 32%|███▏      | 3497/11049 [35:59<1:17:12,  1.63it/s]
 32%|███▏      | 3498/11049 [36:00<1:17:13,  1.63it/s]
                                                      
{'loss': 0.2378, 'grad_norm': 0.5101343989372253, 'learning_rate': 8.637871771073689e-06, 'epoch': 0.95}

 32%|███▏      | 3498/11049 [36:00<1:17:13,  1.63it/s]
 32%|███▏      | 3499/11049 [36:01<1:17:13,  1.63it/s]
                                                      
{'loss': 0.2244, 'grad_norm': 0.5152515172958374, 'learning_rate': 8.636787909363033e-06, 'epoch': 0.95}

 32%|███▏      | 3499/11049 [36:01<1:17:13,  1.63it/s]
 32%|███▏      | 3500/11049 [36:01<1:17:14,  1.63it/s]
                                                      
{'loss': 0.291, 'grad_norm': 0.5498272180557251, 'learning_rate': 8.635703684661689e-06, 'epoch': 0.95}

 32%|███▏      | 3500/11049 [36:01<1:17:14,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.36it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.6391236186027527, 'eval_runtime': 1.9533, 'eval_samples_per_second': 102.391, 'eval_steps_per_second': 6.655, 'epoch': 0.95}

 32%|███▏      | 3500/11049 [36:03<1:17:14,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 32%|███▏      | 3501/11049 [36:04<2:31:09,  1.20s/it]
                                                      
{'loss': 0.2176, 'grad_norm': 0.5127741098403931, 'learning_rate': 8.634619097077874e-06, 'epoch': 0.95}

 32%|███▏      | 3501/11049 [36:04<2:31:09,  1.20s/it]
 32%|███▏      | 3502/11049 [36:04<2:08:56,  1.03s/it]
                                                      
{'loss': 0.3112, 'grad_norm': 0.6187566518783569, 'learning_rate': 8.63353414671984e-06, 'epoch': 0.95}

 32%|███▏      | 3502/11049 [36:05<2:08:56,  1.03s/it]
 32%|███▏      | 3503/11049 [36:05<1:53:25,  1.11it/s]
                                                      
{'loss': 0.195, 'grad_norm': 0.5692431330680847, 'learning_rate': 8.632448833695878e-06, 'epoch': 0.95}

 32%|███▏      | 3503/11049 [36:05<1:53:25,  1.11it/s]
 32%|███▏      | 3504/11049 [36:06<1:42:32,  1.23it/s]
                                                      
{'loss': 0.3433, 'grad_norm': 0.6037026047706604, 'learning_rate': 8.631363158114313e-06, 'epoch': 0.95}

 32%|███▏      | 3504/11049 [36:06<1:42:32,  1.23it/s]
 32%|███▏      | 3505/11049 [36:06<1:34:54,  1.32it/s]
                                                      
{'loss': 0.3993, 'grad_norm': 0.6849314570426941, 'learning_rate': 8.630277120083508e-06, 'epoch': 0.95}

 32%|███▏      | 3505/11049 [36:06<1:34:54,  1.32it/s]
 32%|███▏      | 3506/11049 [36:07<1:29:34,  1.40it/s]
                                                      
{'loss': 0.3083, 'grad_norm': 0.617542564868927, 'learning_rate': 8.629190719711862e-06, 'epoch': 0.95}

 32%|███▏      | 3506/11049 [36:07<1:29:34,  1.40it/s]
 32%|███▏      | 3507/11049 [36:07<1:25:50,  1.46it/s]
                                                      
{'loss': 0.2349, 'grad_norm': 0.5331887006759644, 'learning_rate': 8.628103957107807e-06, 'epoch': 0.95}

 32%|███▏      | 3507/11049 [36:08<1:25:50,  1.46it/s]
 32%|███▏      | 3508/11049 [36:08<1:23:15,  1.51it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.5134209394454956, 'learning_rate': 8.627016832379817e-06, 'epoch': 0.95}

 32%|███▏      | 3508/11049 [36:08<1:23:15,  1.51it/s]
 32%|███▏      | 3509/11049 [36:09<1:21:23,  1.54it/s]
                                                      
{'loss': 0.2762, 'grad_norm': 0.5972358584403992, 'learning_rate': 8.625929345636396e-06, 'epoch': 0.95}

 32%|███▏      | 3509/11049 [36:09<1:21:23,  1.54it/s]
 32%|███▏      | 3510/11049 [36:09<1:20:04,  1.57it/s]
                                                      
{'loss': 0.2397, 'grad_norm': 0.6439677476882935, 'learning_rate': 8.62484149698609e-06, 'epoch': 0.95}

 32%|███▏      | 3510/11049 [36:09<1:20:04,  1.57it/s]
 32%|███▏      | 3511/11049 [36:10<1:19:11,  1.59it/s]
                                                      
{'loss': 0.3135, 'grad_norm': 0.5049836039543152, 'learning_rate': 8.623753286537473e-06, 'epoch': 0.95}

 32%|███▏      | 3511/11049 [36:10<1:19:11,  1.59it/s]
 32%|███▏      | 3512/11049 [36:11<1:18:30,  1.60it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.556323230266571, 'learning_rate': 8.622664714399164e-06, 'epoch': 0.95}

 32%|███▏      | 3512/11049 [36:11<1:18:30,  1.60it/s]
 32%|███▏      | 3513/11049 [36:11<1:18:05,  1.61it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.5570929646492004, 'learning_rate': 8.621575780679814e-06, 'epoch': 0.95}

 32%|███▏      | 3513/11049 [36:11<1:18:05,  1.61it/s]
 32%|███▏      | 3514/11049 [36:12<1:17:46,  1.61it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.4650264382362366, 'learning_rate': 8.62048648548811e-06, 'epoch': 0.95}

 32%|███▏      | 3514/11049 [36:12<1:17:46,  1.61it/s]
 32%|███▏      | 3515/11049 [36:12<1:17:31,  1.62it/s]
                                                      
{'loss': 0.3149, 'grad_norm': 0.5748697519302368, 'learning_rate': 8.619396828932775e-06, 'epoch': 0.95}

 32%|███▏      | 3515/11049 [36:12<1:17:31,  1.62it/s]
 32%|███▏      | 3516/11049 [36:13<1:17:21,  1.62it/s]
                                                      
{'loss': 0.1946, 'grad_norm': 0.4660196006298065, 'learning_rate': 8.618306811122567e-06, 'epoch': 0.95}

 32%|███▏      | 3516/11049 [36:13<1:17:21,  1.62it/s]
 32%|███▏      | 3517/11049 [36:14<1:17:15,  1.62it/s]
                                                      
{'loss': 0.2619, 'grad_norm': 0.49353185296058655, 'learning_rate': 8.617216432166286e-06, 'epoch': 0.95}

 32%|███▏      | 3517/11049 [36:14<1:17:15,  1.62it/s]
 32%|███▏      | 3518/11049 [36:14<1:17:09,  1.63it/s]
                                                      
{'loss': 0.222, 'grad_norm': 0.58623868227005, 'learning_rate': 8.616125692172758e-06, 'epoch': 0.96}

 32%|███▏      | 3518/11049 [36:14<1:17:09,  1.63it/s]
 32%|███▏      | 3519/11049 [36:15<1:17:04,  1.63it/s]
                                                      
{'loss': 0.2417, 'grad_norm': 0.5186980366706848, 'learning_rate': 8.615034591250855e-06, 'epoch': 0.96}

 32%|███▏      | 3519/11049 [36:15<1:17:04,  1.63it/s]
 32%|███▏      | 3520/11049 [36:15<1:17:01,  1.63it/s]
                                                      
{'loss': 0.2877, 'grad_norm': 0.5239824652671814, 'learning_rate': 8.61394312950948e-06, 'epoch': 0.96}

 32%|███▏      | 3520/11049 [36:16<1:17:01,  1.63it/s]
 32%|███▏      | 3521/11049 [36:16<1:16:58,  1.63it/s]
                                                      
{'loss': 0.2975, 'grad_norm': 0.5722673535346985, 'learning_rate': 8.612851307057571e-06, 'epoch': 0.96}

 32%|███▏      | 3521/11049 [36:16<1:16:58,  1.63it/s]
 32%|███▏      | 3522/11049 [36:17<1:16:57,  1.63it/s]
                                                      
{'loss': 0.1736, 'grad_norm': 0.4515869617462158, 'learning_rate': 8.611759124004103e-06, 'epoch': 0.96}

 32%|███▏      | 3522/11049 [36:17<1:16:57,  1.63it/s]
 32%|███▏      | 3523/11049 [36:17<1:17:00,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.4347032308578491, 'learning_rate': 8.61066658045809e-06, 'epoch': 0.96}

 32%|███▏      | 3523/11049 [36:17<1:17:00,  1.63it/s]
 32%|███▏      | 3524/11049 [36:18<1:16:59,  1.63it/s]
                                                      
{'loss': 0.2306, 'grad_norm': 0.5287150740623474, 'learning_rate': 8.609573676528577e-06, 'epoch': 0.96}

 32%|███▏      | 3524/11049 [36:18<1:16:59,  1.63it/s]
 32%|███▏      | 3525/11049 [36:18<1:16:56,  1.63it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.5858558416366577, 'learning_rate': 8.608480412324652e-06, 'epoch': 0.96}

 32%|███▏      | 3525/11049 [36:19<1:16:56,  1.63it/s]
 32%|███▏      | 3526/11049 [36:19<1:16:56,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.5181500911712646, 'learning_rate': 8.60738678795543e-06, 'epoch': 0.96}

 32%|███▏      | 3526/11049 [36:19<1:16:56,  1.63it/s]
 32%|███▏      | 3527/11049 [36:20<1:16:55,  1.63it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.4729761481285095, 'learning_rate': 8.60629280353007e-06, 'epoch': 0.96}

 32%|███▏      | 3527/11049 [36:20<1:16:55,  1.63it/s]
 32%|███▏      | 3528/11049 [36:20<1:16:55,  1.63it/s]
                                                      
{'loss': 0.2982, 'grad_norm': 0.6678786873817444, 'learning_rate': 8.605198459157761e-06, 'epoch': 0.96}

 32%|███▏      | 3528/11049 [36:20<1:16:55,  1.63it/s]
 32%|███▏      | 3529/11049 [36:21<1:16:53,  1.63it/s]
                                                      
{'loss': 0.2185, 'grad_norm': 0.49952632188796997, 'learning_rate': 8.604103754947731e-06, 'epoch': 0.96}

 32%|███▏      | 3529/11049 [36:21<1:16:53,  1.63it/s]
 32%|███▏      | 3530/11049 [36:22<1:16:52,  1.63it/s]
                                                      
{'loss': 0.3179, 'grad_norm': 0.6600842475891113, 'learning_rate': 8.603008691009244e-06, 'epoch': 0.96}

 32%|███▏      | 3530/11049 [36:22<1:16:52,  1.63it/s]
 32%|███▏      | 3531/11049 [36:22<1:16:52,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.4257453680038452, 'learning_rate': 8.601913267451599e-06, 'epoch': 0.96}

 32%|███▏      | 3531/11049 [36:22<1:16:52,  1.63it/s]
 32%|███▏      | 3532/11049 [36:23<1:16:48,  1.63it/s]
                                                      
{'loss': 0.2328, 'grad_norm': 0.49568232893943787, 'learning_rate': 8.60081748438413e-06, 'epoch': 0.96}

 32%|███▏      | 3532/11049 [36:23<1:16:48,  1.63it/s]
 32%|███▏      | 3533/11049 [36:23<1:16:50,  1.63it/s]
                                                      
{'loss': 0.3097, 'grad_norm': 0.5796485543251038, 'learning_rate': 8.599721341916207e-06, 'epoch': 0.96}

 32%|███▏      | 3533/11049 [36:24<1:16:50,  1.63it/s]
 32%|███▏      | 3534/11049 [36:24<1:16:50,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.4992508888244629, 'learning_rate': 8.598624840157242e-06, 'epoch': 0.96}

 32%|███▏      | 3534/11049 [36:24<1:16:50,  1.63it/s]
 32%|███▏      | 3535/11049 [36:25<1:16:48,  1.63it/s]
                                                      
{'loss': 0.3045, 'grad_norm': 0.6634001731872559, 'learning_rate': 8.597527979216673e-06, 'epoch': 0.96}

 32%|███▏      | 3535/11049 [36:25<1:16:48,  1.63it/s]
 32%|███▏      | 3536/11049 [36:25<1:16:49,  1.63it/s]
                                                      
{'loss': 0.2773, 'grad_norm': 0.5883621573448181, 'learning_rate': 8.596430759203979e-06, 'epoch': 0.96}

 32%|███▏      | 3536/11049 [36:25<1:16:49,  1.63it/s]
 32%|███▏      | 3537/11049 [36:26<1:16:50,  1.63it/s]
                                                      
{'loss': 0.266, 'grad_norm': 0.5284984707832336, 'learning_rate': 8.595333180228676e-06, 'epoch': 0.96}

 32%|███▏      | 3537/11049 [36:26<1:16:50,  1.63it/s]
 32%|███▏      | 3538/11049 [36:26<1:16:51,  1.63it/s]
                                                      
{'loss': 0.2996, 'grad_norm': 0.6030096411705017, 'learning_rate': 8.594235242400313e-06, 'epoch': 0.96}

 32%|███▏      | 3538/11049 [36:27<1:16:51,  1.63it/s]
 32%|███▏      | 3539/11049 [36:27<1:16:52,  1.63it/s]
                                                      
{'loss': 0.2618, 'grad_norm': 0.573339581489563, 'learning_rate': 8.593136945828477e-06, 'epoch': 0.96}

 32%|███▏      | 3539/11049 [36:27<1:16:52,  1.63it/s]
 32%|███▏      | 3540/11049 [36:28<1:16:51,  1.63it/s]
                                                      
{'loss': 0.344, 'grad_norm': 0.6669358015060425, 'learning_rate': 8.59203829062279e-06, 'epoch': 0.96}

 32%|███▏      | 3540/11049 [36:28<1:16:51,  1.63it/s]
 32%|███▏      | 3541/11049 [36:28<1:16:48,  1.63it/s]
                                                      
{'loss': 0.3073, 'grad_norm': 0.6306860446929932, 'learning_rate': 8.590939276892908e-06, 'epoch': 0.96}

 32%|███▏      | 3541/11049 [36:28<1:16:48,  1.63it/s]
 32%|███▏      | 3542/11049 [36:29<1:16:46,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.49816909432411194, 'learning_rate': 8.589839904748527e-06, 'epoch': 0.96}

 32%|███▏      | 3542/11049 [36:29<1:16:46,  1.63it/s]
 32%|███▏      | 3543/11049 [36:30<1:16:45,  1.63it/s]
                                                      
{'loss': 0.2242, 'grad_norm': 0.4905760586261749, 'learning_rate': 8.588740174299374e-06, 'epoch': 0.96}

 32%|███▏      | 3543/11049 [36:30<1:16:45,  1.63it/s]
 32%|███▏      | 3544/11049 [36:30<1:16:43,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.43588387966156006, 'learning_rate': 8.587640085655214e-06, 'epoch': 0.96}

 32%|███▏      | 3544/11049 [36:30<1:16:43,  1.63it/s]
 32%|███▏      | 3545/11049 [36:31<1:16:43,  1.63it/s]
                                                      
{'loss': 0.2291, 'grad_norm': 0.47037822008132935, 'learning_rate': 8.586539638925851e-06, 'epoch': 0.96}

 32%|███▏      | 3545/11049 [36:31<1:16:43,  1.63it/s]
 32%|███▏      | 3546/11049 [36:31<1:16:42,  1.63it/s]
                                                      
{'loss': 0.286, 'grad_norm': 0.5293459296226501, 'learning_rate': 8.585438834221116e-06, 'epoch': 0.96}

 32%|███▏      | 3546/11049 [36:31<1:16:42,  1.63it/s]
 32%|███▏      | 3547/11049 [36:32<1:16:40,  1.63it/s]
                                                      
{'loss': 0.2791, 'grad_norm': 0.5782621502876282, 'learning_rate': 8.584337671650884e-06, 'epoch': 0.96}

 32%|███▏      | 3547/11049 [36:32<1:16:40,  1.63it/s]
 32%|███▏      | 3548/11049 [36:33<1:16:42,  1.63it/s]
                                                      
{'loss': 0.2911, 'grad_norm': 0.5985076427459717, 'learning_rate': 8.583236151325065e-06, 'epoch': 0.96}

 32%|███▏      | 3548/11049 [36:33<1:16:42,  1.63it/s]
 32%|███▏      | 3549/11049 [36:33<1:16:42,  1.63it/s]
                                                      
{'loss': 0.2095, 'grad_norm': 0.5146608948707581, 'learning_rate': 8.582134273353599e-06, 'epoch': 0.96}

 32%|███▏      | 3549/11049 [36:33<1:16:42,  1.63it/s]
 32%|███▏      | 3550/11049 [36:34<1:16:40,  1.63it/s]
                                                      
{'loss': 0.2449, 'grad_norm': 0.47297924757003784, 'learning_rate': 8.581032037846466e-06, 'epoch': 0.96}

 32%|███▏      | 3550/11049 [36:34<1:16:40,  1.63it/s]
 32%|███▏      | 3551/11049 [36:34<1:16:39,  1.63it/s]
                                                      
{'loss': 0.1766, 'grad_norm': 0.42192065715789795, 'learning_rate': 8.579929444913685e-06, 'epoch': 0.96}

 32%|███▏      | 3551/11049 [36:35<1:16:39,  1.63it/s]
 32%|███▏      | 3552/11049 [36:35<1:16:37,  1.63it/s]
                                                      
{'loss': 0.2383, 'grad_norm': 0.48237764835357666, 'learning_rate': 8.578826494665301e-06, 'epoch': 0.96}

 32%|███▏      | 3552/11049 [36:35<1:16:37,  1.63it/s]
 32%|███▏      | 3553/11049 [36:36<1:16:39,  1.63it/s]
                                                      
{'loss': 0.3891, 'grad_norm': 0.6283953785896301, 'learning_rate': 8.577723187211404e-06, 'epoch': 0.96}

 32%|███▏      | 3553/11049 [36:36<1:16:39,  1.63it/s]
 32%|███▏      | 3554/11049 [36:36<1:16:38,  1.63it/s]
                                                      
{'loss': 0.2552, 'grad_norm': 0.5646305680274963, 'learning_rate': 8.576619522662116e-06, 'epoch': 0.96}

 32%|███▏      | 3554/11049 [36:36<1:16:38,  1.63it/s]
 32%|███▏      | 3555/11049 [36:37<1:16:39,  1.63it/s]
                                                      
{'loss': 0.2083, 'grad_norm': 0.5202475786209106, 'learning_rate': 8.57551550112759e-06, 'epoch': 0.97}

 32%|███▏      | 3555/11049 [36:37<1:16:39,  1.63it/s]
 32%|███▏      | 3556/11049 [36:38<1:16:37,  1.63it/s]
                                                      
{'loss': 0.2579, 'grad_norm': 0.5395569801330566, 'learning_rate': 8.574411122718026e-06, 'epoch': 0.97}

 32%|███▏      | 3556/11049 [36:38<1:16:37,  1.63it/s]
 32%|███▏      | 3557/11049 [36:38<1:16:34,  1.63it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.4653801918029785, 'learning_rate': 8.573306387543648e-06, 'epoch': 0.97}

 32%|███▏      | 3557/11049 [36:38<1:16:34,  1.63it/s]
 32%|███▏      | 3558/11049 [36:39<1:16:37,  1.63it/s]
                                                      
{'loss': 0.2422, 'grad_norm': 0.5376675128936768, 'learning_rate': 8.572201295714723e-06, 'epoch': 0.97}

 32%|███▏      | 3558/11049 [36:39<1:16:37,  1.63it/s]
 32%|███▏      | 3559/11049 [36:39<1:16:35,  1.63it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.5062199831008911, 'learning_rate': 8.571095847341551e-06, 'epoch': 0.97}

 32%|███▏      | 3559/11049 [36:39<1:16:35,  1.63it/s]
 32%|███▏      | 3560/11049 [36:40<1:16:35,  1.63it/s]
                                                      
{'loss': 0.2874, 'grad_norm': 0.5748723149299622, 'learning_rate': 8.569990042534466e-06, 'epoch': 0.97}

 32%|███▏      | 3560/11049 [36:40<1:16:35,  1.63it/s]
 32%|███▏      | 3561/11049 [36:41<1:16:34,  1.63it/s]
                                                      
{'loss': 0.2562, 'grad_norm': 0.5146275758743286, 'learning_rate': 8.56888388140384e-06, 'epoch': 0.97}

 32%|███▏      | 3561/11049 [36:41<1:16:34,  1.63it/s]
 32%|███▏      | 3562/11049 [36:41<1:16:34,  1.63it/s]
                                                      
{'loss': 0.3214, 'grad_norm': 0.673193633556366, 'learning_rate': 8.567777364060082e-06, 'epoch': 0.97}

 32%|███▏      | 3562/11049 [36:41<1:16:34,  1.63it/s]
 32%|███▏      | 3563/11049 [36:42<1:16:34,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.4028131663799286, 'learning_rate': 8.56667049061363e-06, 'epoch': 0.97}

 32%|███▏      | 3563/11049 [36:42<1:16:34,  1.63it/s]
 32%|███▏      | 3564/11049 [36:42<1:16:32,  1.63it/s]
                                                      
{'loss': 0.2633, 'grad_norm': 0.536080002784729, 'learning_rate': 8.565563261174966e-06, 'epoch': 0.97}

 32%|███▏      | 3564/11049 [36:43<1:16:32,  1.63it/s]
 32%|███▏      | 3565/11049 [36:43<1:16:32,  1.63it/s]
                                                      
{'loss': 0.3519, 'grad_norm': 0.535284698009491, 'learning_rate': 8.5644556758546e-06, 'epoch': 0.97}

 32%|███▏      | 3565/11049 [36:43<1:16:32,  1.63it/s]
 32%|███▏      | 3566/11049 [36:44<1:16:30,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.4734404981136322, 'learning_rate': 8.563347734763084e-06, 'epoch': 0.97}

 32%|███▏      | 3566/11049 [36:44<1:16:30,  1.63it/s]
 32%|███▏      | 3567/11049 [36:44<1:16:28,  1.63it/s]
                                                      
{'loss': 0.2412, 'grad_norm': 0.48544976115226746, 'learning_rate': 8.562239438011e-06, 'epoch': 0.97}

 32%|███▏      | 3567/11049 [36:44<1:16:28,  1.63it/s]
 32%|███▏      | 3568/11049 [36:45<1:16:27,  1.63it/s]
                                                      
{'loss': 0.3091, 'grad_norm': 0.5896084904670715, 'learning_rate': 8.56113078570897e-06, 'epoch': 0.97}

 32%|███▏      | 3568/11049 [36:45<1:16:27,  1.63it/s]
 32%|███▏      | 3569/11049 [36:45<1:16:26,  1.63it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.576060950756073, 'learning_rate': 8.56002177796765e-06, 'epoch': 0.97}

 32%|███▏      | 3569/11049 [36:46<1:16:26,  1.63it/s]
 32%|███▏      | 3570/11049 [36:46<1:16:26,  1.63it/s]
                                                      
{'loss': 0.2388, 'grad_norm': 0.522060215473175, 'learning_rate': 8.558912414897729e-06, 'epoch': 0.97}

 32%|███▏      | 3570/11049 [36:46<1:16:26,  1.63it/s]
 32%|███▏      | 3571/11049 [36:47<1:16:25,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5157772302627563, 'learning_rate': 8.557802696609933e-06, 'epoch': 0.97}

 32%|███▏      | 3571/11049 [36:47<1:16:25,  1.63it/s]
 32%|███▏      | 3572/11049 [36:47<1:16:22,  1.63it/s]
                                                      
{'loss': 0.234, 'grad_norm': 0.4630019962787628, 'learning_rate': 8.556692623215027e-06, 'epoch': 0.97}

 32%|███▏      | 3572/11049 [36:47<1:16:22,  1.63it/s]
 32%|███▏      | 3573/11049 [36:48<1:16:22,  1.63it/s]
                                                      
{'loss': 0.2855, 'grad_norm': 0.5398181080818176, 'learning_rate': 8.555582194823803e-06, 'epoch': 0.97}

 32%|███▏      | 3573/11049 [36:48<1:16:22,  1.63it/s]
 32%|███▏      | 3574/11049 [36:49<1:16:23,  1.63it/s]
                                                      
{'loss': 0.2145, 'grad_norm': 0.4666074514389038, 'learning_rate': 8.554471411547098e-06, 'epoch': 0.97}

 32%|███▏      | 3574/11049 [36:49<1:16:23,  1.63it/s]
 32%|███▏      | 3575/11049 [36:49<1:16:22,  1.63it/s]
                                                      
{'loss': 0.267, 'grad_norm': 0.5614029169082642, 'learning_rate': 8.55336027349578e-06, 'epoch': 0.97}

 32%|███▏      | 3575/11049 [36:49<1:16:22,  1.63it/s]
 32%|███▏      | 3576/11049 [36:50<1:16:24,  1.63it/s]
                                                      
{'loss': 0.3397, 'grad_norm': 0.6111317873001099, 'learning_rate': 8.552248780780751e-06, 'epoch': 0.97}

 32%|███▏      | 3576/11049 [36:50<1:16:24,  1.63it/s]
 32%|███▏      | 3577/11049 [36:50<1:16:24,  1.63it/s]
                                                      
{'loss': 0.3017, 'grad_norm': 0.5453211665153503, 'learning_rate': 8.551136933512952e-06, 'epoch': 0.97}

 32%|███▏      | 3577/11049 [36:51<1:16:24,  1.63it/s]
 32%|███▏      | 3578/11049 [36:51<1:16:23,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.5038185715675354, 'learning_rate': 8.550024731803354e-06, 'epoch': 0.97}

 32%|███▏      | 3578/11049 [36:51<1:16:23,  1.63it/s]
 32%|███▏      | 3579/11049 [36:52<1:16:24,  1.63it/s]
                                                      
{'loss': 0.2411, 'grad_norm': 0.5042933225631714, 'learning_rate': 8.548912175762972e-06, 'epoch': 0.97}

 32%|███▏      | 3579/11049 [36:52<1:16:24,  1.63it/s]
 32%|███▏      | 3580/11049 [36:52<1:16:25,  1.63it/s]
                                                      
{'loss': 0.213, 'grad_norm': 0.4476329982280731, 'learning_rate': 8.547799265502844e-06, 'epoch': 0.97}

 32%|███▏      | 3580/11049 [36:52<1:16:25,  1.63it/s]
 32%|███▏      | 3581/11049 [36:53<1:16:23,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.4679493010044098, 'learning_rate': 8.546686001134056e-06, 'epoch': 0.97}

 32%|███▏      | 3581/11049 [36:53<1:16:23,  1.63it/s]
 32%|███▏      | 3582/11049 [36:53<1:16:23,  1.63it/s]
                                                      
{'loss': 0.321, 'grad_norm': 0.586818516254425, 'learning_rate': 8.545572382767721e-06, 'epoch': 0.97}

 32%|███▏      | 3582/11049 [36:54<1:16:23,  1.63it/s]
 32%|███▏      | 3583/11049 [36:54<1:16:24,  1.63it/s]
                                                      
{'loss': 0.2344, 'grad_norm': 0.5594596862792969, 'learning_rate': 8.544458410514993e-06, 'epoch': 0.97}

 32%|███▏      | 3583/11049 [36:54<1:16:24,  1.63it/s]
 32%|███▏      | 3584/11049 [36:55<1:16:20,  1.63it/s]
                                                      
{'loss': 0.206, 'grad_norm': 0.4239213764667511, 'learning_rate': 8.543344084487054e-06, 'epoch': 0.97}

 32%|███▏      | 3584/11049 [36:55<1:16:20,  1.63it/s]
 32%|███▏      | 3585/11049 [36:55<1:16:21,  1.63it/s]
                                                      
{'loss': 0.2743, 'grad_norm': 0.5406923890113831, 'learning_rate': 8.542229404795133e-06, 'epoch': 0.97}

 32%|███▏      | 3585/11049 [36:55<1:16:21,  1.63it/s]
 32%|███▏      | 3586/11049 [36:56<1:16:20,  1.63it/s]
                                                      
{'loss': 0.2648, 'grad_norm': 0.5886712074279785, 'learning_rate': 8.541114371550479e-06, 'epoch': 0.97}

 32%|███▏      | 3586/11049 [36:56<1:16:20,  1.63it/s]
 32%|███▏      | 3587/11049 [36:57<1:16:18,  1.63it/s]
                                                      
{'loss': 0.2911, 'grad_norm': 0.5314550995826721, 'learning_rate': 8.539998984864389e-06, 'epoch': 0.97}

 32%|███▏      | 3587/11049 [36:57<1:16:18,  1.63it/s]
 32%|███▏      | 3588/11049 [36:57<1:16:36,  1.62it/s]
                                                      
{'loss': 0.2805, 'grad_norm': 0.557549238204956, 'learning_rate': 8.53888324484819e-06, 'epoch': 0.97}

 32%|███▏      | 3588/11049 [36:57<1:16:36,  1.62it/s]
 32%|███▏      | 3589/11049 [36:58<1:16:28,  1.63it/s]
                                                      
{'loss': 0.349, 'grad_norm': 0.6718666553497314, 'learning_rate': 8.537767151613244e-06, 'epoch': 0.97}

 32%|███▏      | 3589/11049 [36:58<1:16:28,  1.63it/s]
 32%|███▏      | 3590/11049 [36:58<1:16:24,  1.63it/s]
                                                      
{'loss': 0.2652, 'grad_norm': 0.5155680179595947, 'learning_rate': 8.536650705270947e-06, 'epoch': 0.97}

 32%|███▏      | 3590/11049 [36:59<1:16:24,  1.63it/s]
 33%|███▎      | 3591/11049 [36:59<1:16:20,  1.63it/s]
                                                      
{'loss': 0.3183, 'grad_norm': 0.5516424775123596, 'learning_rate': 8.535533905932739e-06, 'epoch': 0.98}

 33%|███▎      | 3591/11049 [36:59<1:16:20,  1.63it/s]
 33%|███▎      | 3592/11049 [37:00<1:16:17,  1.63it/s]
                                                      
{'loss': 0.2146, 'grad_norm': 0.4563275873661041, 'learning_rate': 8.534416753710082e-06, 'epoch': 0.98}

 33%|███▎      | 3592/11049 [37:00<1:16:17,  1.63it/s]
 33%|███▎      | 3593/11049 [37:00<1:16:15,  1.63it/s]
                                                      
{'loss': 0.285, 'grad_norm': 0.5555058121681213, 'learning_rate': 8.533299248714483e-06, 'epoch': 0.98}

 33%|███▎      | 3593/11049 [37:00<1:16:15,  1.63it/s]
 33%|███▎      | 3594/11049 [37:01<1:16:14,  1.63it/s]
                                                      
{'loss': 0.2839, 'grad_norm': 0.5084424614906311, 'learning_rate': 8.53218139105748e-06, 'epoch': 0.98}

 33%|███▎      | 3594/11049 [37:01<1:16:14,  1.63it/s]
 33%|███▎      | 3595/11049 [37:01<1:16:15,  1.63it/s]
                                                      
{'loss': 0.26, 'grad_norm': 0.6057531237602234, 'learning_rate': 8.531063180850649e-06, 'epoch': 0.98}

 33%|███▎      | 3595/11049 [37:02<1:16:15,  1.63it/s]
 33%|███▎      | 3596/11049 [37:02<1:16:13,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.4653835594654083, 'learning_rate': 8.529944618205599e-06, 'epoch': 0.98}

 33%|███▎      | 3596/11049 [37:02<1:16:13,  1.63it/s]
 33%|███▎      | 3597/11049 [37:03<1:16:12,  1.63it/s]
                                                      
{'loss': 0.2439, 'grad_norm': 0.5586748123168945, 'learning_rate': 8.528825703233972e-06, 'epoch': 0.98}

 33%|███▎      | 3597/11049 [37:03<1:16:12,  1.63it/s]
 33%|███▎      | 3598/11049 [37:03<1:16:15,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.474781334400177, 'learning_rate': 8.52770643604745e-06, 'epoch': 0.98}

 33%|███▎      | 3598/11049 [37:03<1:16:15,  1.63it/s]
 33%|███▎      | 3599/11049 [37:04<1:16:13,  1.63it/s]
                                                      
{'loss': 0.2622, 'grad_norm': 0.6702006459236145, 'learning_rate': 8.526586816757747e-06, 'epoch': 0.98}

 33%|███▎      | 3599/11049 [37:04<1:16:13,  1.63it/s]
 33%|███▎      | 3600/11049 [37:05<1:16:12,  1.63it/s]
                                                      
{'loss': 0.2564, 'grad_norm': 0.5789533853530884, 'learning_rate': 8.525466845476616e-06, 'epoch': 0.98}

 33%|███▎      | 3600/11049 [37:05<1:16:12,  1.63it/s]
 33%|███▎      | 3601/11049 [37:05<1:16:11,  1.63it/s]
                                                      
{'loss': 0.2581, 'grad_norm': 0.49143561720848083, 'learning_rate': 8.524346522315836e-06, 'epoch': 0.98}

 33%|███▎      | 3601/11049 [37:05<1:16:11,  1.63it/s]
 33%|███▎      | 3602/11049 [37:06<1:16:08,  1.63it/s]
                                                      
{'loss': 0.2996, 'grad_norm': 0.49406689405441284, 'learning_rate': 8.523225847387234e-06, 'epoch': 0.98}

 33%|███▎      | 3602/11049 [37:06<1:16:08,  1.63it/s]
 33%|███▎      | 3603/11049 [37:06<1:16:08,  1.63it/s]
                                                      
{'loss': 0.2328, 'grad_norm': 0.48843613266944885, 'learning_rate': 8.522104820802661e-06, 'epoch': 0.98}

 33%|███▎      | 3603/11049 [37:06<1:16:08,  1.63it/s]
 33%|███▎      | 3604/11049 [37:07<1:16:09,  1.63it/s]
                                                      
{'loss': 0.2758, 'grad_norm': 0.5569291114807129, 'learning_rate': 8.520983442674011e-06, 'epoch': 0.98}

 33%|███▎      | 3604/11049 [37:07<1:16:09,  1.63it/s]
 33%|███▎      | 3605/11049 [37:08<1:16:08,  1.63it/s]
                                                      
{'loss': 0.2974, 'grad_norm': 0.5644853115081787, 'learning_rate': 8.519861713113206e-06, 'epoch': 0.98}

 33%|███▎      | 3605/11049 [37:08<1:16:08,  1.63it/s]
 33%|███▎      | 3606/11049 [37:08<1:16:07,  1.63it/s]
                                                      
{'loss': 0.235, 'grad_norm': 0.5371484756469727, 'learning_rate': 8.51873963223221e-06, 'epoch': 0.98}

 33%|███▎      | 3606/11049 [37:08<1:16:07,  1.63it/s]
 33%|███▎      | 3607/11049 [37:09<1:16:05,  1.63it/s]
                                                      
{'loss': 0.2628, 'grad_norm': 0.5832164287567139, 'learning_rate': 8.517617200143017e-06, 'epoch': 0.98}

 33%|███▎      | 3607/11049 [37:09<1:16:05,  1.63it/s]
 33%|███▎      | 3608/11049 [37:09<1:16:05,  1.63it/s]
                                                      
{'loss': 0.2501, 'grad_norm': 0.549917995929718, 'learning_rate': 8.51649441695766e-06, 'epoch': 0.98}

 33%|███▎      | 3608/11049 [37:10<1:16:05,  1.63it/s]
 33%|███▎      | 3609/11049 [37:10<1:16:06,  1.63it/s]
                                                      
{'loss': 0.2512, 'grad_norm': 0.564657986164093, 'learning_rate': 8.515371282788201e-06, 'epoch': 0.98}

 33%|███▎      | 3609/11049 [37:10<1:16:06,  1.63it/s]
 33%|███▎      | 3610/11049 [37:11<1:16:04,  1.63it/s]
                                                      
{'loss': 0.2741, 'grad_norm': 0.5861483216285706, 'learning_rate': 8.514247797746744e-06, 'epoch': 0.98}

 33%|███▎      | 3610/11049 [37:11<1:16:04,  1.63it/s]
 33%|███▎      | 3611/11049 [37:11<1:16:04,  1.63it/s]
                                                      
{'loss': 0.2736, 'grad_norm': 0.5776111483573914, 'learning_rate': 8.513123961945422e-06, 'epoch': 0.98}

 33%|███▎      | 3611/11049 [37:11<1:16:04,  1.63it/s]
 33%|███▎      | 3612/11049 [37:12<1:16:01,  1.63it/s]
                                                      
{'loss': 0.2612, 'grad_norm': 0.575389564037323, 'learning_rate': 8.51199977549641e-06, 'epoch': 0.98}

 33%|███▎      | 3612/11049 [37:12<1:16:01,  1.63it/s]
 33%|███▎      | 3613/11049 [37:12<1:16:02,  1.63it/s]
                                                      
{'loss': 0.2554, 'grad_norm': 0.5752915740013123, 'learning_rate': 8.510875238511911e-06, 'epoch': 0.98}

 33%|███▎      | 3613/11049 [37:13<1:16:02,  1.63it/s]
 33%|███▎      | 3614/11049 [37:13<1:16:02,  1.63it/s]
                                                      
{'loss': 0.3154, 'grad_norm': 0.6874792575836182, 'learning_rate': 8.509750351104167e-06, 'epoch': 0.98}

 33%|███▎      | 3614/11049 [37:13<1:16:02,  1.63it/s]
 33%|███▎      | 3615/11049 [37:14<1:15:59,  1.63it/s]
                                                      
{'loss': 0.2992, 'grad_norm': 0.5836483240127563, 'learning_rate': 8.508625113385453e-06, 'epoch': 0.98}

 33%|███▎      | 3615/11049 [37:14<1:15:59,  1.63it/s]
 33%|███▎      | 3616/11049 [37:14<1:15:57,  1.63it/s]
                                                      
{'loss': 0.2764, 'grad_norm': 0.5852304100990295, 'learning_rate': 8.507499525468082e-06, 'epoch': 0.98}

 33%|███▎      | 3616/11049 [37:14<1:15:57,  1.63it/s]
 33%|███▎      | 3617/11049 [37:15<1:15:58,  1.63it/s]
                                                      
{'loss': 0.3007, 'grad_norm': 0.5923779010772705, 'learning_rate': 8.506373587464396e-06, 'epoch': 0.98}

 33%|███▎      | 3617/11049 [37:15<1:15:58,  1.63it/s]
 33%|███▎      | 3618/11049 [37:16<1:15:57,  1.63it/s]
                                                      
{'loss': 0.3056, 'grad_norm': 0.5651495456695557, 'learning_rate': 8.50524729948678e-06, 'epoch': 0.98}

 33%|███▎      | 3618/11049 [37:16<1:15:57,  1.63it/s]
 33%|███▎      | 3619/11049 [37:16<1:15:57,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.5405736565589905, 'learning_rate': 8.504120661647647e-06, 'epoch': 0.98}

 33%|███▎      | 3619/11049 [37:16<1:15:57,  1.63it/s]
 33%|███▎      | 3620/11049 [37:17<1:15:56,  1.63it/s]
                                                      
{'loss': 0.2609, 'grad_norm': 0.49908390641212463, 'learning_rate': 8.502993674059448e-06, 'epoch': 0.98}

 33%|███▎      | 3620/11049 [37:17<1:15:56,  1.63it/s]
 33%|███▎      | 3621/11049 [37:17<1:15:55,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.4892077147960663, 'learning_rate': 8.50186633683467e-06, 'epoch': 0.98}

 33%|███▎      | 3621/11049 [37:18<1:15:55,  1.63it/s]
 33%|███▎      | 3622/11049 [37:18<1:15:55,  1.63it/s]
                                                      
{'loss': 0.2157, 'grad_norm': 0.47780686616897583, 'learning_rate': 8.500738650085832e-06, 'epoch': 0.98}

 33%|███▎      | 3622/11049 [37:18<1:15:55,  1.63it/s]
 33%|███▎      | 3623/11049 [37:19<1:15:59,  1.63it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.5318220257759094, 'learning_rate': 8.49961061392549e-06, 'epoch': 0.98}

 33%|███▎      | 3623/11049 [37:19<1:15:59,  1.63it/s]
 33%|███▎      | 3624/11049 [37:19<1:15:58,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.47387880086898804, 'learning_rate': 8.498482228466234e-06, 'epoch': 0.98}

 33%|███▎      | 3624/11049 [37:19<1:15:58,  1.63it/s]
 33%|███▎      | 3625/11049 [37:20<1:16:11,  1.62it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.5045461058616638, 'learning_rate': 8.497353493820688e-06, 'epoch': 0.98}

 33%|███▎      | 3625/11049 [37:20<1:16:11,  1.62it/s]
 33%|███▎      | 3626/11049 [37:20<1:16:14,  1.62it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.517227053642273, 'learning_rate': 8.496224410101514e-06, 'epoch': 0.98}

 33%|███▎      | 3626/11049 [37:21<1:16:14,  1.62it/s]
 33%|███▎      | 3627/11049 [37:21<1:16:09,  1.62it/s]
                                                      
{'loss': 0.3026, 'grad_norm': 0.5352108478546143, 'learning_rate': 8.495094977421404e-06, 'epoch': 0.98}

 33%|███▎      | 3627/11049 [37:21<1:16:09,  1.62it/s]
 33%|███▎      | 3628/11049 [37:22<1:16:03,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.45142662525177, 'learning_rate': 8.49396519589309e-06, 'epoch': 0.99}

 33%|███▎      | 3628/11049 [37:22<1:16:03,  1.63it/s]
 33%|███▎      | 3629/11049 [37:22<1:15:57,  1.63it/s]
                                                      
{'loss': 0.2907, 'grad_norm': 0.6547054052352905, 'learning_rate': 8.492835065629336e-06, 'epoch': 0.99}

 33%|███▎      | 3629/11049 [37:22<1:15:57,  1.63it/s]
 33%|███▎      | 3630/11049 [37:23<1:16:01,  1.63it/s]
                                                      
{'loss': 0.3352, 'grad_norm': 0.6408435702323914, 'learning_rate': 8.491704586742941e-06, 'epoch': 0.99}

 33%|███▎      | 3630/11049 [37:23<1:16:01,  1.63it/s]
 33%|███▎      | 3631/11049 [37:24<1:16:02,  1.63it/s]
                                                      
{'loss': 0.2384, 'grad_norm': 0.5839542150497437, 'learning_rate': 8.490573759346737e-06, 'epoch': 0.99}

 33%|███▎      | 3631/11049 [37:24<1:16:02,  1.63it/s]
 33%|███▎      | 3632/11049 [37:24<1:15:59,  1.63it/s]
                                                      
{'loss': 0.2207, 'grad_norm': 0.4532255530357361, 'learning_rate': 8.489442583553595e-06, 'epoch': 0.99}

 33%|███▎      | 3632/11049 [37:24<1:15:59,  1.63it/s]
 33%|███▎      | 3633/11049 [37:25<1:15:55,  1.63it/s]
                                                      
{'loss': 0.2556, 'grad_norm': 0.5809543132781982, 'learning_rate': 8.488311059476419e-06, 'epoch': 0.99}

 33%|███▎      | 3633/11049 [37:25<1:15:55,  1.63it/s]
 33%|███▎      | 3634/11049 [37:25<1:15:52,  1.63it/s]
                                                      
{'loss': 0.2364, 'grad_norm': 0.5072102546691895, 'learning_rate': 8.487179187228147e-06, 'epoch': 0.99}

 33%|███▎      | 3634/11049 [37:26<1:15:52,  1.63it/s]
 33%|███▎      | 3635/11049 [37:26<1:15:55,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.440633624792099, 'learning_rate': 8.48604696692175e-06, 'epoch': 0.99}

 33%|███▎      | 3635/11049 [37:26<1:15:55,  1.63it/s]
 33%|███▎      | 3636/11049 [37:27<1:15:57,  1.63it/s]
                                                      
{'loss': 0.195, 'grad_norm': 0.44977694749832153, 'learning_rate': 8.484914398670238e-06, 'epoch': 0.99}

 33%|███▎      | 3636/11049 [37:27<1:15:57,  1.63it/s]
 33%|███▎      | 3637/11049 [37:27<1:15:54,  1.63it/s]
                                                      
{'loss': 0.2273, 'grad_norm': 0.5145326256752014, 'learning_rate': 8.483781482586652e-06, 'epoch': 0.99}

 33%|███▎      | 3637/11049 [37:27<1:15:54,  1.63it/s]
 33%|███▎      | 3638/11049 [37:28<1:15:53,  1.63it/s]
                                                      
{'loss': 0.3908, 'grad_norm': 0.5889715552330017, 'learning_rate': 8.48264821878407e-06, 'epoch': 0.99}

 33%|███▎      | 3638/11049 [37:28<1:15:53,  1.63it/s]
 33%|███▎      | 3639/11049 [37:28<1:15:50,  1.63it/s]
                                                      
{'loss': 0.2345, 'grad_norm': 0.5352454781532288, 'learning_rate': 8.481514607375605e-06, 'epoch': 0.99}

 33%|███▎      | 3639/11049 [37:29<1:15:50,  1.63it/s]
 33%|███▎      | 3640/11049 [37:29<1:15:56,  1.63it/s]
                                                      
{'loss': 0.2501, 'grad_norm': 0.5161590576171875, 'learning_rate': 8.480380648474402e-06, 'epoch': 0.99}

 33%|███▎      | 3640/11049 [37:29<1:15:56,  1.63it/s]
 33%|███▎      | 3641/11049 [37:30<1:15:54,  1.63it/s]
                                                      
{'loss': 0.3183, 'grad_norm': 0.6451944708824158, 'learning_rate': 8.479246342193643e-06, 'epoch': 0.99}

 33%|███▎      | 3641/11049 [37:30<1:15:54,  1.63it/s]
 33%|███▎      | 3642/11049 [37:30<1:15:51,  1.63it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.43792247772216797, 'learning_rate': 8.478111688646544e-06, 'epoch': 0.99}

 33%|███▎      | 3642/11049 [37:30<1:15:51,  1.63it/s]
 33%|███▎      | 3643/11049 [37:31<1:15:47,  1.63it/s]
                                                      
{'loss': 0.2453, 'grad_norm': 0.5202172994613647, 'learning_rate': 8.476976687946356e-06, 'epoch': 0.99}

 33%|███▎      | 3643/11049 [37:31<1:15:47,  1.63it/s]
 33%|███▎      | 3644/11049 [37:32<1:15:45,  1.63it/s]
                                                      
{'loss': 0.2752, 'grad_norm': 0.585598886013031, 'learning_rate': 8.475841340206363e-06, 'epoch': 0.99}

 33%|███▎      | 3644/11049 [37:32<1:15:45,  1.63it/s]
 33%|███▎      | 3645/11049 [37:32<1:15:51,  1.63it/s]
                                                      
{'loss': 0.2764, 'grad_norm': 0.519818127155304, 'learning_rate': 8.474705645539886e-06, 'epoch': 0.99}

 33%|███▎      | 3645/11049 [37:32<1:15:51,  1.63it/s]
 33%|███▎      | 3646/11049 [37:33<1:15:52,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.41314706206321716, 'learning_rate': 8.473569604060282e-06, 'epoch': 0.99}

 33%|███▎      | 3646/11049 [37:33<1:15:52,  1.63it/s]
 33%|███▎      | 3647/11049 [37:33<1:15:48,  1.63it/s]
                                                      
{'loss': 0.2437, 'grad_norm': 0.5198962688446045, 'learning_rate': 8.472433215880935e-06, 'epoch': 0.99}

 33%|███▎      | 3647/11049 [37:34<1:15:48,  1.63it/s]
 33%|███▎      | 3648/11049 [37:34<1:15:51,  1.63it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.5399183034896851, 'learning_rate': 8.471296481115274e-06, 'epoch': 0.99}

 33%|███▎      | 3648/11049 [37:34<1:15:51,  1.63it/s]
 33%|███▎      | 3649/11049 [37:35<1:15:41,  1.63it/s]
                                                      
{'loss': 0.2375, 'grad_norm': 0.5619630813598633, 'learning_rate': 8.470159399876753e-06, 'epoch': 0.99}

 33%|███▎      | 3649/11049 [37:35<1:15:41,  1.63it/s]
 33%|███▎      | 3650/11049 [37:35<1:15:38,  1.63it/s]
                                                      
{'loss': 0.2581, 'grad_norm': 0.5153424739837646, 'learning_rate': 8.469021972278868e-06, 'epoch': 0.99}

 33%|███▎      | 3650/11049 [37:35<1:15:38,  1.63it/s]
 33%|███▎      | 3651/11049 [37:36<1:15:45,  1.63it/s]
                                                      
{'loss': 0.2771, 'grad_norm': 0.5733432173728943, 'learning_rate': 8.467884198435146e-06, 'epoch': 0.99}

 33%|███▎      | 3651/11049 [37:36<1:15:45,  1.63it/s]
 33%|███▎      | 3652/11049 [37:36<1:15:41,  1.63it/s]
                                                      
{'loss': 0.253, 'grad_norm': 0.5218234658241272, 'learning_rate': 8.466746078459146e-06, 'epoch': 0.99}

 33%|███▎      | 3652/11049 [37:37<1:15:41,  1.63it/s]
 33%|███▎      | 3653/11049 [37:37<1:15:40,  1.63it/s]
                                                      
{'loss': 0.2768, 'grad_norm': 0.485206663608551, 'learning_rate': 8.465607612464469e-06, 'epoch': 0.99}

 33%|███▎      | 3653/11049 [37:37<1:15:40,  1.63it/s]
 33%|███▎      | 3654/11049 [37:38<1:15:39,  1.63it/s]
                                                      
{'loss': 0.2755, 'grad_norm': 0.5596632957458496, 'learning_rate': 8.464468800564744e-06, 'epoch': 0.99}

 33%|███▎      | 3654/11049 [37:38<1:15:39,  1.63it/s]
 33%|███▎      | 3655/11049 [37:38<1:15:36,  1.63it/s]
                                                      
{'loss': 0.2153, 'grad_norm': 0.4794473350048065, 'learning_rate': 8.463329642873638e-06, 'epoch': 0.99}

 33%|███▎      | 3655/11049 [37:38<1:15:36,  1.63it/s]
 33%|███▎      | 3656/11049 [37:39<1:15:36,  1.63it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.45566725730895996, 'learning_rate': 8.462190139504852e-06, 'epoch': 0.99}

 33%|███▎      | 3656/11049 [37:39<1:15:36,  1.63it/s]
 33%|███▎      | 3657/11049 [37:40<1:15:35,  1.63it/s]
                                                      
{'loss': 0.2611, 'grad_norm': 0.565804660320282, 'learning_rate': 8.461050290572114e-06, 'epoch': 0.99}

 33%|███▎      | 3657/11049 [37:40<1:15:35,  1.63it/s]
 33%|███▎      | 3658/11049 [37:40<1:15:34,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.524167001247406, 'learning_rate': 8.459910096189203e-06, 'epoch': 0.99}

 33%|███▎      | 3658/11049 [37:40<1:15:34,  1.63it/s]
 33%|███▎      | 3659/11049 [37:41<1:15:32,  1.63it/s]
                                                      
{'loss': 0.258, 'grad_norm': 0.5083448886871338, 'learning_rate': 8.458769556469916e-06, 'epoch': 0.99}

 33%|███▎      | 3659/11049 [37:41<1:15:32,  1.63it/s]
 33%|███▎      | 3660/11049 [37:41<1:15:30,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.5500363707542419, 'learning_rate': 8.457628671528095e-06, 'epoch': 0.99}

 33%|███▎      | 3660/11049 [37:41<1:15:30,  1.63it/s]
 33%|███▎      | 3661/11049 [37:42<1:15:31,  1.63it/s]
                                                      
{'loss': 0.2763, 'grad_norm': 0.6528973579406738, 'learning_rate': 8.456487441477608e-06, 'epoch': 0.99}

 33%|███▎      | 3661/11049 [37:42<1:15:31,  1.63it/s]
 33%|███▎      | 3662/11049 [37:43<1:15:30,  1.63it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.5240822434425354, 'learning_rate': 8.455345866432367e-06, 'epoch': 0.99}

 33%|███▎      | 3662/11049 [37:43<1:15:30,  1.63it/s]
 33%|███▎      | 3663/11049 [37:43<1:15:29,  1.63it/s]
                                                      
{'loss': 0.2732, 'grad_norm': 0.5235533118247986, 'learning_rate': 8.45420394650631e-06, 'epoch': 0.99}

 33%|███▎      | 3663/11049 [37:43<1:15:29,  1.63it/s]
 33%|███▎      | 3664/11049 [37:44<1:15:29,  1.63it/s]
                                                      
{'loss': 0.3125, 'grad_norm': 0.5603296160697937, 'learning_rate': 8.453061681813417e-06, 'epoch': 0.99}

 33%|███▎      | 3664/11049 [37:44<1:15:29,  1.63it/s]
 33%|███▎      | 3665/11049 [37:44<1:15:28,  1.63it/s]
                                                      
{'loss': 0.1925, 'grad_norm': 0.49605265259742737, 'learning_rate': 8.451919072467694e-06, 'epoch': 1.0}

 33%|███▎      | 3665/11049 [37:45<1:15:28,  1.63it/s]
 33%|███▎      | 3666/11049 [37:45<1:15:32,  1.63it/s]
                                                      
{'loss': 0.2119, 'grad_norm': 0.5009632110595703, 'learning_rate': 8.450776118583188e-06, 'epoch': 1.0}

 33%|███▎      | 3666/11049 [37:45<1:15:32,  1.63it/s]
 33%|███▎      | 3667/11049 [37:46<1:15:41,  1.63it/s]
                                                      
{'loss': 0.268, 'grad_norm': 0.5092679262161255, 'learning_rate': 8.449632820273976e-06, 'epoch': 1.0}

 33%|███▎      | 3667/11049 [37:46<1:15:41,  1.63it/s]
 33%|███▎      | 3668/11049 [37:46<1:15:38,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.49943608045578003, 'learning_rate': 8.448489177654175e-06, 'epoch': 1.0}

 33%|███▎      | 3668/11049 [37:46<1:15:38,  1.63it/s]
 33%|███▎      | 3669/11049 [37:47<1:15:37,  1.63it/s]
                                                      
{'loss': 0.3069, 'grad_norm': 0.5143594145774841, 'learning_rate': 8.44734519083793e-06, 'epoch': 1.0}

 33%|███▎      | 3669/11049 [37:47<1:15:37,  1.63it/s]
 33%|███▎      | 3670/11049 [37:47<1:15:32,  1.63it/s]
                                                      
{'loss': 0.3083, 'grad_norm': 0.6112968325614929, 'learning_rate': 8.446200859939426e-06, 'epoch': 1.0}

 33%|███▎      | 3670/11049 [37:48<1:15:32,  1.63it/s]
 33%|███▎      | 3671/11049 [37:48<1:15:29,  1.63it/s]
                                                      
{'loss': 0.3228, 'grad_norm': 0.715545117855072, 'learning_rate': 8.445056185072875e-06, 'epoch': 1.0}

 33%|███▎      | 3671/11049 [37:48<1:15:29,  1.63it/s]
 33%|███▎      | 3672/11049 [37:49<1:15:27,  1.63it/s]
                                                      
{'loss': 0.2657, 'grad_norm': 0.645847499370575, 'learning_rate': 8.443911166352533e-06, 'epoch': 1.0}

 33%|███▎      | 3672/11049 [37:49<1:15:27,  1.63it/s]
 33%|███▎      | 3673/11049 [37:49<1:15:28,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.4784010946750641, 'learning_rate': 8.442765803892683e-06, 'epoch': 1.0}

 33%|███▎      | 3673/11049 [37:49<1:15:28,  1.63it/s]
 33%|███▎      | 3674/11049 [37:50<1:15:25,  1.63it/s]
                                                      
{'loss': 0.2288, 'grad_norm': 0.5082918405532837, 'learning_rate': 8.441620097807644e-06, 'epoch': 1.0}

 33%|███▎      | 3674/11049 [37:50<1:15:25,  1.63it/s]
 33%|███▎      | 3675/11049 [37:51<1:15:23,  1.63it/s]
                                                      
{'loss': 0.2133, 'grad_norm': 0.4322420358657837, 'learning_rate': 8.440474048211769e-06, 'epoch': 1.0}

 33%|███▎      | 3675/11049 [37:51<1:15:23,  1.63it/s]
 33%|███▎      | 3676/11049 [37:51<1:15:22,  1.63it/s]
                                                      
{'loss': 0.2843, 'grad_norm': 0.592129647731781, 'learning_rate': 8.43932765521945e-06, 'epoch': 1.0}

 33%|███▎      | 3676/11049 [37:51<1:15:22,  1.63it/s]
 33%|███▎      | 3677/11049 [37:52<1:15:19,  1.63it/s]
                                                      
{'loss': 0.1998, 'grad_norm': 0.462189644575119, 'learning_rate': 8.438180918945105e-06, 'epoch': 1.0}

 33%|███▎      | 3677/11049 [37:52<1:15:19,  1.63it/s]
 33%|███▎      | 3678/11049 [37:52<1:15:19,  1.63it/s]
                                                      
{'loss': 0.28, 'grad_norm': 0.5270537734031677, 'learning_rate': 8.437033839503193e-06, 'epoch': 1.0}

 33%|███▎      | 3678/11049 [37:53<1:15:19,  1.63it/s]
 33%|███▎      | 3679/11049 [37:53<1:15:19,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.46800488233566284, 'learning_rate': 8.435886417008203e-06, 'epoch': 1.0}

 33%|███▎      | 3679/11049 [37:53<1:15:19,  1.63it/s]
 33%|███▎      | 3680/11049 [37:54<1:15:19,  1.63it/s]
                                                      
{'loss': 0.298, 'grad_norm': 0.7322067022323608, 'learning_rate': 8.434738651574663e-06, 'epoch': 1.0}

 33%|███▎      | 3680/11049 [37:54<1:15:19,  1.63it/s]
 33%|███▎      | 3681/11049 [37:54<1:15:20,  1.63it/s]
                                                      
{'loss': 0.2226, 'grad_norm': 0.4593193829059601, 'learning_rate': 8.433590543317132e-06, 'epoch': 1.0}

 33%|███▎      | 3681/11049 [37:54<1:15:20,  1.63it/s]
 33%|███▎      | 3682/11049 [37:55<1:15:24,  1.63it/s]
                                                      
{'loss': 0.1944, 'grad_norm': 0.4898357391357422, 'learning_rate': 8.4324420923502e-06, 'epoch': 1.0}

 33%|███▎      | 3682/11049 [37:55<1:15:24,  1.63it/s]
 33%|███▎      | 3683/11049 [37:55<1:15:16,  1.63it/s]
                                                      
{'loss': 0.1941, 'grad_norm': 0.44665291905403137, 'learning_rate': 8.431293298788498e-06, 'epoch': 1.0}

 33%|███▎      | 3683/11049 [37:56<1:15:16,  1.63it/s]
 33%|███▎      | 3684/11049 [37:56<1:15:25,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.5124627947807312, 'learning_rate': 8.430144162746689e-06, 'epoch': 1.0}

 33%|███▎      | 3684/11049 [37:56<1:15:25,  1.63it/s]
 33%|███▎      | 3685/11049 [37:57<1:15:21,  1.63it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.4947524070739746, 'learning_rate': 8.428994684339467e-06, 'epoch': 1.0}

 33%|███▎      | 3685/11049 [37:57<1:15:21,  1.63it/s]
 33%|███▎      | 3686/11049 [37:57<1:15:20,  1.63it/s]
                                                      
{'loss': 0.2041, 'grad_norm': 0.4415915906429291, 'learning_rate': 8.427844863681562e-06, 'epoch': 1.0}

 33%|███▎      | 3686/11049 [37:57<1:15:20,  1.63it/s]
 33%|███▎      | 3687/11049 [37:58<1:15:19,  1.63it/s]
                                                      
{'loss': 0.2559, 'grad_norm': 0.48224937915802, 'learning_rate': 8.426694700887741e-06, 'epoch': 1.0}

 33%|███▎      | 3687/11049 [37:58<1:15:19,  1.63it/s]
 33%|███▎      | 3688/11049 [37:59<1:15:21,  1.63it/s]
                                                      
{'loss': 0.2131, 'grad_norm': 0.4689065217971802, 'learning_rate': 8.425544196072799e-06, 'epoch': 1.0}

 33%|███▎      | 3688/11049 [37:59<1:15:21,  1.63it/s]
 33%|███▎      | 3689/11049 [37:59<1:15:15,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.5525676608085632, 'learning_rate': 8.424393349351573e-06, 'epoch': 1.0}

 33%|███▎      | 3689/11049 [37:59<1:15:15,  1.63it/s]
 33%|███▎      | 3690/11049 [38:00<1:15:18,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.494827538728714, 'learning_rate': 8.423242160838927e-06, 'epoch': 1.0}

 33%|███▎      | 3690/11049 [38:00<1:15:18,  1.63it/s]
 33%|███▎      | 3691/11049 [38:00<1:15:15,  1.63it/s]
                                                      
{'loss': 0.2554, 'grad_norm': 0.5429678559303284, 'learning_rate': 8.422090630649761e-06, 'epoch': 1.0}

 33%|███▎      | 3691/11049 [38:01<1:15:15,  1.63it/s]
 33%|███▎      | 3692/11049 [38:01<1:15:14,  1.63it/s]
                                                      
{'loss': 0.2408, 'grad_norm': 0.5441988706588745, 'learning_rate': 8.420938758899013e-06, 'epoch': 1.0}

 33%|███▎      | 3692/11049 [38:01<1:15:14,  1.63it/s]
 33%|███▎      | 3693/11049 [38:02<1:15:13,  1.63it/s]
                                                      
{'loss': 0.2254, 'grad_norm': 0.5277983546257019, 'learning_rate': 8.41978654570165e-06, 'epoch': 1.0}

 33%|███▎      | 3693/11049 [38:02<1:15:13,  1.63it/s]
 33%|███▎      | 3694/11049 [38:02<1:15:11,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.5011592507362366, 'learning_rate': 8.41863399117268e-06, 'epoch': 1.0}

 33%|███▎      | 3694/11049 [38:02<1:15:11,  1.63it/s]
 33%|███▎      | 3695/11049 [38:03<1:15:09,  1.63it/s]
                                                      
{'loss': 0.2603, 'grad_norm': 0.5321496725082397, 'learning_rate': 8.417481095427135e-06, 'epoch': 1.0}

 33%|███▎      | 3695/11049 [38:03<1:15:09,  1.63it/s]
 33%|███▎      | 3696/11049 [38:03<1:15:07,  1.63it/s]
                                                      
{'loss': 0.2557, 'grad_norm': 0.5280864238739014, 'learning_rate': 8.416327858580088e-06, 'epoch': 1.0}

 33%|███▎      | 3696/11049 [38:04<1:15:07,  1.63it/s]
 33%|███▎      | 3697/11049 [38:04<1:15:08,  1.63it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.4241650104522705, 'learning_rate': 8.415174280746645e-06, 'epoch': 1.0}

 33%|███▎      | 3697/11049 [38:04<1:15:08,  1.63it/s]
 33%|███▎      | 3698/11049 [38:05<1:15:09,  1.63it/s]
                                                      
{'loss': 0.2011, 'grad_norm': 0.5037194490432739, 'learning_rate': 8.414020362041945e-06, 'epoch': 1.0}

 33%|███▎      | 3698/11049 [38:05<1:15:09,  1.63it/s]
 33%|███▎      | 3699/11049 [38:05<1:15:07,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5002504587173462, 'learning_rate': 8.412866102581162e-06, 'epoch': 1.0}

 33%|███▎      | 3699/11049 [38:05<1:15:07,  1.63it/s]
 33%|███▎      | 3700/11049 [38:06<1:15:07,  1.63it/s]
                                                      
{'loss': 0.1979, 'grad_norm': 0.513039231300354, 'learning_rate': 8.411711502479505e-06, 'epoch': 1.0}

 33%|███▎      | 3700/11049 [38:06<1:15:07,  1.63it/s]
 33%|███▎      | 3701/11049 [38:07<1:15:08,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.485217809677124, 'learning_rate': 8.410556561852212e-06, 'epoch': 1.0}

 33%|███▎      | 3701/11049 [38:07<1:15:08,  1.63it/s]
 34%|███▎      | 3702/11049 [38:07<1:15:07,  1.63it/s]
                                                      
{'loss': 0.1433, 'grad_norm': 0.3735661208629608, 'learning_rate': 8.409401280814562e-06, 'epoch': 1.01}

 34%|███▎      | 3702/11049 [38:07<1:15:07,  1.63it/s]
 34%|███▎      | 3703/11049 [38:08<1:15:06,  1.63it/s]
                                                      
{'loss': 0.2011, 'grad_norm': 0.5267066359519958, 'learning_rate': 8.408245659481862e-06, 'epoch': 1.01}

 34%|███▎      | 3703/11049 [38:08<1:15:06,  1.63it/s]
 34%|███▎      | 3704/11049 [38:08<1:15:06,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.5340003371238708, 'learning_rate': 8.407089697969458e-06, 'epoch': 1.01}

 34%|███▎      | 3704/11049 [38:08<1:15:06,  1.63it/s]
 34%|███▎      | 3705/11049 [38:09<1:15:03,  1.63it/s]
                                                      
{'loss': 0.194, 'grad_norm': 0.5085642337799072, 'learning_rate': 8.405933396392722e-06, 'epoch': 1.01}

 34%|███▎      | 3705/11049 [38:09<1:15:03,  1.63it/s]
 34%|███▎      | 3706/11049 [38:10<1:15:02,  1.63it/s]
                                                      
{'loss': 0.2154, 'grad_norm': 0.5664507150650024, 'learning_rate': 8.404776754867073e-06, 'epoch': 1.01}

 34%|███▎      | 3706/11049 [38:10<1:15:02,  1.63it/s]
 34%|███▎      | 3707/11049 [38:10<1:15:01,  1.63it/s]
                                                      
{'loss': 0.2329, 'grad_norm': 0.6834886074066162, 'learning_rate': 8.403619773507952e-06, 'epoch': 1.01}

 34%|███▎      | 3707/11049 [38:10<1:15:01,  1.63it/s]
 34%|███▎      | 3708/11049 [38:11<1:15:01,  1.63it/s]
                                                      
{'loss': 0.285, 'grad_norm': 0.6014043688774109, 'learning_rate': 8.402462452430838e-06, 'epoch': 1.01}

 34%|███▎      | 3708/11049 [38:11<1:15:01,  1.63it/s]
 34%|███▎      | 3709/11049 [38:11<1:15:04,  1.63it/s]
                                                      
{'loss': 0.1777, 'grad_norm': 0.5154229998588562, 'learning_rate': 8.401304791751245e-06, 'epoch': 1.01}

 34%|███▎      | 3709/11049 [38:12<1:15:04,  1.63it/s]
 34%|███▎      | 3710/11049 [38:12<1:15:02,  1.63it/s]
                                                      
{'loss': 0.2155, 'grad_norm': 0.5791863203048706, 'learning_rate': 8.400146791584722e-06, 'epoch': 1.01}

 34%|███▎      | 3710/11049 [38:12<1:15:02,  1.63it/s]
 34%|███▎      | 3711/11049 [38:13<1:15:00,  1.63it/s]
                                                      
{'loss': 0.1725, 'grad_norm': 0.4278537929058075, 'learning_rate': 8.398988452046846e-06, 'epoch': 1.01}

 34%|███▎      | 3711/11049 [38:13<1:15:00,  1.63it/s]
 34%|███▎      | 3712/11049 [38:13<1:15:00,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.5581585168838501, 'learning_rate': 8.397829773253234e-06, 'epoch': 1.01}

 34%|███▎      | 3712/11049 [38:13<1:15:00,  1.63it/s]
 34%|███▎      | 3713/11049 [38:14<1:15:02,  1.63it/s]
                                                      
{'loss': 0.1649, 'grad_norm': 0.42332932353019714, 'learning_rate': 8.396670755319537e-06, 'epoch': 1.01}

 34%|███▎      | 3713/11049 [38:14<1:15:02,  1.63it/s]
 34%|███▎      | 3714/11049 [38:14<1:14:59,  1.63it/s]
                                                      
{'loss': 0.1977, 'grad_norm': 0.5611159801483154, 'learning_rate': 8.395511398361431e-06, 'epoch': 1.01}

 34%|███▎      | 3714/11049 [38:15<1:14:59,  1.63it/s]
 34%|███▎      | 3715/11049 [38:15<1:14:58,  1.63it/s]
                                                      
{'loss': 0.2247, 'grad_norm': 0.6018033027648926, 'learning_rate': 8.394351702494637e-06, 'epoch': 1.01}

 34%|███▎      | 3715/11049 [38:15<1:14:58,  1.63it/s]
 34%|███▎      | 3716/11049 [38:16<1:14:58,  1.63it/s]
                                                      
{'loss': 0.1766, 'grad_norm': 0.4646185040473938, 'learning_rate': 8.393191667834906e-06, 'epoch': 1.01}

 34%|███▎      | 3716/11049 [38:16<1:14:58,  1.63it/s]
 34%|███▎      | 3717/11049 [38:16<1:14:57,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.5688503980636597, 'learning_rate': 8.39203129449802e-06, 'epoch': 1.01}

 34%|███▎      | 3717/11049 [38:16<1:14:57,  1.63it/s]
 34%|███▎      | 3718/11049 [38:17<1:14:57,  1.63it/s]
                                                      
{'loss': 0.2098, 'grad_norm': 0.5595378279685974, 'learning_rate': 8.390870582599797e-06, 'epoch': 1.01}

 34%|███▎      | 3718/11049 [38:17<1:14:57,  1.63it/s]
 34%|███▎      | 3719/11049 [38:18<1:14:57,  1.63it/s]
                                                      
{'loss': 0.2443, 'grad_norm': 0.6052324175834656, 'learning_rate': 8.389709532256088e-06, 'epoch': 1.01}

 34%|███▎      | 3719/11049 [38:18<1:14:57,  1.63it/s]
 34%|███▎      | 3720/11049 [38:18<1:14:55,  1.63it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.4622548520565033, 'learning_rate': 8.38854814358278e-06, 'epoch': 1.01}

 34%|███▎      | 3720/11049 [38:18<1:14:55,  1.63it/s]
 34%|███▎      | 3721/11049 [38:19<1:14:54,  1.63it/s]
                                                      
{'loss': 0.2653, 'grad_norm': 0.6904841065406799, 'learning_rate': 8.38738641669579e-06, 'epoch': 1.01}

 34%|███▎      | 3721/11049 [38:19<1:14:54,  1.63it/s]
 34%|███▎      | 3722/11049 [38:19<1:14:53,  1.63it/s]
                                                      
{'loss': 0.2194, 'grad_norm': 0.4453721344470978, 'learning_rate': 8.386224351711073e-06, 'epoch': 1.01}

 34%|███▎      | 3722/11049 [38:20<1:14:53,  1.63it/s]
 34%|███▎      | 3723/11049 [38:20<1:14:54,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5637810230255127, 'learning_rate': 8.385061948744615e-06, 'epoch': 1.01}

 34%|███▎      | 3723/11049 [38:20<1:14:54,  1.63it/s]
 34%|███▎      | 3724/11049 [38:21<1:14:53,  1.63it/s]
                                                      
{'loss': 0.1839, 'grad_norm': 0.5488370656967163, 'learning_rate': 8.383899207912436e-06, 'epoch': 1.01}

 34%|███▎      | 3724/11049 [38:21<1:14:53,  1.63it/s]
 34%|███▎      | 3725/11049 [38:21<1:14:54,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.44273051619529724, 'learning_rate': 8.382736129330591e-06, 'epoch': 1.01}

 34%|███▎      | 3725/11049 [38:21<1:14:54,  1.63it/s]
 34%|███▎      | 3726/11049 [38:22<1:14:51,  1.63it/s]
                                                      
{'loss': 0.2094, 'grad_norm': 0.5811493992805481, 'learning_rate': 8.381572713115166e-06, 'epoch': 1.01}

 34%|███▎      | 3726/11049 [38:22<1:14:51,  1.63it/s]
 34%|███▎      | 3727/11049 [38:22<1:14:49,  1.63it/s]
                                                      
{'loss': 0.2299, 'grad_norm': 0.6551514267921448, 'learning_rate': 8.380408959382283e-06, 'epoch': 1.01}

 34%|███▎      | 3727/11049 [38:23<1:14:49,  1.63it/s]
 34%|███▎      | 3728/11049 [38:23<1:14:53,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.4970076084136963, 'learning_rate': 8.379244868248098e-06, 'epoch': 1.01}

 34%|███▎      | 3728/11049 [38:23<1:14:53,  1.63it/s]
 34%|███▎      | 3729/11049 [38:24<1:14:50,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.4787733554840088, 'learning_rate': 8.378080439828799e-06, 'epoch': 1.01}

 34%|███▎      | 3729/11049 [38:24<1:14:50,  1.63it/s]
 34%|███▍      | 3730/11049 [38:24<1:14:48,  1.63it/s]
                                                      
{'loss': 0.1785, 'grad_norm': 0.4640003740787506, 'learning_rate': 8.376915674240612e-06, 'epoch': 1.01}

 34%|███▍      | 3730/11049 [38:24<1:14:48,  1.63it/s]
 34%|███▍      | 3731/11049 [38:25<1:14:48,  1.63it/s]
                                                      
{'loss': 0.2604, 'grad_norm': 0.5620005130767822, 'learning_rate': 8.375750571599786e-06, 'epoch': 1.01}

 34%|███▍      | 3731/11049 [38:25<1:14:48,  1.63it/s]
 34%|███▍      | 3732/11049 [38:26<1:14:47,  1.63it/s]
                                                      
{'loss': 0.2628, 'grad_norm': 0.6603268384933472, 'learning_rate': 8.374585132022618e-06, 'epoch': 1.01}

 34%|███▍      | 3732/11049 [38:26<1:14:47,  1.63it/s]
 34%|███▍      | 3733/11049 [38:26<1:14:48,  1.63it/s]
                                                      
{'loss': 0.2336, 'grad_norm': 0.5441046357154846, 'learning_rate': 8.373419355625428e-06, 'epoch': 1.01}

 34%|███▍      | 3733/11049 [38:26<1:14:48,  1.63it/s]
 34%|███▍      | 3734/11049 [38:27<1:14:48,  1.63it/s]
                                                      
{'loss': 0.2324, 'grad_norm': 0.547775387763977, 'learning_rate': 8.372253242524573e-06, 'epoch': 1.01}

 34%|███▍      | 3734/11049 [38:27<1:14:48,  1.63it/s]
 34%|███▍      | 3735/11049 [38:27<1:14:47,  1.63it/s]
                                                      
{'loss': 0.2236, 'grad_norm': 0.5219342112541199, 'learning_rate': 8.371086792836444e-06, 'epoch': 1.01}

 34%|███▍      | 3735/11049 [38:27<1:14:47,  1.63it/s]
 34%|███▍      | 3736/11049 [38:28<1:14:47,  1.63it/s]
                                                      
{'loss': 0.1998, 'grad_norm': 0.5141241550445557, 'learning_rate': 8.369920006677466e-06, 'epoch': 1.01}

 34%|███▍      | 3736/11049 [38:28<1:14:47,  1.63it/s]
 34%|███▍      | 3737/11049 [38:29<1:14:45,  1.63it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.5741154551506042, 'learning_rate': 8.368752884164096e-06, 'epoch': 1.01}

 34%|███▍      | 3737/11049 [38:29<1:14:45,  1.63it/s]
 34%|███▍      | 3738/11049 [38:29<1:15:03,  1.62it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.57229083776474, 'learning_rate': 8.367585425412824e-06, 'epoch': 1.01}

 34%|███▍      | 3738/11049 [38:29<1:15:03,  1.62it/s]
 34%|███▍      | 3739/11049 [38:30<1:14:56,  1.63it/s]
                                                      
{'loss': 0.2477, 'grad_norm': 0.5221478939056396, 'learning_rate': 8.36641763054018e-06, 'epoch': 1.02}

 34%|███▍      | 3739/11049 [38:30<1:14:56,  1.63it/s]
 34%|███▍      | 3740/11049 [38:30<1:14:49,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.6057082414627075, 'learning_rate': 8.36524949966272e-06, 'epoch': 1.02}

 34%|███▍      | 3740/11049 [38:31<1:14:49,  1.63it/s]
 34%|███▍      | 3741/11049 [38:31<1:14:46,  1.63it/s]
                                                      
{'loss': 0.2322, 'grad_norm': 0.6493475437164307, 'learning_rate': 8.364081032897032e-06, 'epoch': 1.02}

 34%|███▍      | 3741/11049 [38:31<1:14:46,  1.63it/s]
 34%|███▍      | 3742/11049 [38:32<1:14:44,  1.63it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.5369968414306641, 'learning_rate': 8.362912230359746e-06, 'epoch': 1.02}

 34%|███▍      | 3742/11049 [38:32<1:14:44,  1.63it/s]
 34%|███▍      | 3743/11049 [38:32<1:14:43,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.5731528401374817, 'learning_rate': 8.361743092167521e-06, 'epoch': 1.02}

 34%|███▍      | 3743/11049 [38:32<1:14:43,  1.63it/s]
 34%|███▍      | 3744/11049 [38:33<1:14:42,  1.63it/s]
                                                      
{'loss': 0.2072, 'grad_norm': 0.4896131455898285, 'learning_rate': 8.36057361843705e-06, 'epoch': 1.02}

 34%|███▍      | 3744/11049 [38:33<1:14:42,  1.63it/s]
 34%|███▍      | 3745/11049 [38:34<1:16:45,  1.59it/s]
                                                      
{'loss': 0.3221, 'grad_norm': 0.6184864044189453, 'learning_rate': 8.359403809285054e-06, 'epoch': 1.02}

 34%|███▍      | 3745/11049 [38:34<1:16:45,  1.59it/s]
 34%|███▍      | 3746/11049 [38:34<1:16:11,  1.60it/s]
                                                      
{'loss': 0.2603, 'grad_norm': 0.6021305918693542, 'learning_rate': 8.358233664828299e-06, 'epoch': 1.02}

 34%|███▍      | 3746/11049 [38:34<1:16:11,  1.60it/s]
 34%|███▍      | 3747/11049 [38:35<1:15:44,  1.61it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5404431223869324, 'learning_rate': 8.357063185183573e-06, 'epoch': 1.02}

 34%|███▍      | 3747/11049 [38:35<1:15:44,  1.61it/s]
 34%|███▍      | 3748/11049 [38:35<1:15:24,  1.61it/s]
                                                      
{'loss': 0.2857, 'grad_norm': 0.6202669739723206, 'learning_rate': 8.355892370467709e-06, 'epoch': 1.02}

 34%|███▍      | 3748/11049 [38:36<1:15:24,  1.61it/s]
 34%|███▍      | 3749/11049 [38:36<1:15:09,  1.62it/s]
                                                      
{'loss': 0.2432, 'grad_norm': 0.5716479420661926, 'learning_rate': 8.35472122079756e-06, 'epoch': 1.02}

 34%|███▍      | 3749/11049 [38:36<1:15:09,  1.62it/s]
 34%|███▍      | 3750/11049 [38:37<1:15:05,  1.62it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.5574418306350708, 'learning_rate': 8.353549736290023e-06, 'epoch': 1.02}

 34%|███▍      | 3750/11049 [38:37<1:15:05,  1.62it/s]
 34%|███▍      | 3751/11049 [38:37<1:14:54,  1.62it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.6017050743103027, 'learning_rate': 8.352377917062022e-06, 'epoch': 1.02}

 34%|███▍      | 3751/11049 [38:37<1:14:54,  1.62it/s]
 34%|███▍      | 3752/11049 [38:38<1:14:50,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.5164394378662109, 'learning_rate': 8.351205763230522e-06, 'epoch': 1.02}

 34%|███▍      | 3752/11049 [38:38<1:14:50,  1.63it/s]
 34%|███▍      | 3753/11049 [38:38<1:14:45,  1.63it/s]
                                                      
{'loss': 0.2069, 'grad_norm': 0.4542447626590729, 'learning_rate': 8.350033274912512e-06, 'epoch': 1.02}

 34%|███▍      | 3753/11049 [38:39<1:14:45,  1.63it/s]
 34%|███▍      | 3754/11049 [38:39<1:14:42,  1.63it/s]
                                                      
{'loss': 0.1672, 'grad_norm': 0.4758796989917755, 'learning_rate': 8.348860452225024e-06, 'epoch': 1.02}

 34%|███▍      | 3754/11049 [38:39<1:14:42,  1.63it/s]
 34%|███▍      | 3755/11049 [38:40<1:14:48,  1.63it/s]
                                                      
{'loss': 0.2213, 'grad_norm': 0.5374028086662292, 'learning_rate': 8.347687295285112e-06, 'epoch': 1.02}

 34%|███▍      | 3755/11049 [38:40<1:14:48,  1.63it/s]
 34%|███▍      | 3756/11049 [38:40<1:14:47,  1.63it/s]
                                                      
{'loss': 0.1753, 'grad_norm': 0.4883255958557129, 'learning_rate': 8.346513804209873e-06, 'epoch': 1.02}

 34%|███▍      | 3756/11049 [38:40<1:14:47,  1.63it/s]
 34%|███▍      | 3757/11049 [38:41<1:14:41,  1.63it/s]
                                                      
{'loss': 0.2248, 'grad_norm': 0.5580336451530457, 'learning_rate': 8.345339979116436e-06, 'epoch': 1.02}

 34%|███▍      | 3757/11049 [38:41<1:14:41,  1.63it/s]
 34%|███▍      | 3758/11049 [38:42<1:14:38,  1.63it/s]
                                                      
{'loss': 0.211, 'grad_norm': 0.5520685315132141, 'learning_rate': 8.344165820121958e-06, 'epoch': 1.02}

 34%|███▍      | 3758/11049 [38:42<1:14:38,  1.63it/s]
 34%|███▍      | 3759/11049 [38:42<1:14:34,  1.63it/s]
                                                      
{'loss': 0.2278, 'grad_norm': 0.7374787330627441, 'learning_rate': 8.342991327343634e-06, 'epoch': 1.02}

 34%|███▍      | 3759/11049 [38:42<1:14:34,  1.63it/s]
 34%|███▍      | 3760/11049 [38:43<1:14:30,  1.63it/s]
                                                      
{'loss': 0.2102, 'grad_norm': 0.7044220566749573, 'learning_rate': 8.341816500898692e-06, 'epoch': 1.02}

 34%|███▍      | 3760/11049 [38:43<1:14:30,  1.63it/s]
 34%|███▍      | 3761/11049 [38:43<1:14:28,  1.63it/s]
                                                      
{'loss': 0.2089, 'grad_norm': 0.506436824798584, 'learning_rate': 8.340641340904391e-06, 'epoch': 1.02}

 34%|███▍      | 3761/11049 [38:44<1:14:28,  1.63it/s]
 34%|███▍      | 3762/11049 [38:44<1:14:26,  1.63it/s]
                                                      
{'loss': 0.2518, 'grad_norm': 0.5652508735656738, 'learning_rate': 8.339465847478027e-06, 'epoch': 1.02}

 34%|███▍      | 3762/11049 [38:44<1:14:26,  1.63it/s]
 34%|███▍      | 3763/11049 [38:45<1:14:26,  1.63it/s]
                                                      
{'loss': 0.2103, 'grad_norm': 0.52773118019104, 'learning_rate': 8.338290020736924e-06, 'epoch': 1.02}

 34%|███▍      | 3763/11049 [38:45<1:14:26,  1.63it/s]
 34%|███▍      | 3764/11049 [38:45<1:14:25,  1.63it/s]
                                                      
{'loss': 0.2062, 'grad_norm': 0.45335498452186584, 'learning_rate': 8.337113860798443e-06, 'epoch': 1.02}

 34%|███▍      | 3764/11049 [38:45<1:14:25,  1.63it/s]
 34%|███▍      | 3765/11049 [38:46<1:14:25,  1.63it/s]
                                                      
{'loss': 0.25, 'grad_norm': 0.532325804233551, 'learning_rate': 8.335937367779977e-06, 'epoch': 1.02}

 34%|███▍      | 3765/11049 [38:46<1:14:25,  1.63it/s]
 34%|███▍      | 3766/11049 [38:46<1:14:25,  1.63it/s]
                                                      
{'loss': 0.213, 'grad_norm': 0.5515214204788208, 'learning_rate': 8.334760541798955e-06, 'epoch': 1.02}

 34%|███▍      | 3766/11049 [38:47<1:14:25,  1.63it/s]
 34%|███▍      | 3767/11049 [38:47<1:14:24,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.5525938868522644, 'learning_rate': 8.333583382972834e-06, 'epoch': 1.02}

 34%|███▍      | 3767/11049 [38:47<1:14:24,  1.63it/s]
 34%|███▍      | 3768/11049 [38:48<1:14:26,  1.63it/s]
                                                      
{'loss': 0.1741, 'grad_norm': 0.5296584963798523, 'learning_rate': 8.33240589141911e-06, 'epoch': 1.02}

 34%|███▍      | 3768/11049 [38:48<1:14:26,  1.63it/s]
 34%|███▍      | 3769/11049 [38:48<1:14:25,  1.63it/s]
                                                      
{'loss': 0.218, 'grad_norm': 0.4981723427772522, 'learning_rate': 8.33122806725531e-06, 'epoch': 1.02}

 34%|███▍      | 3769/11049 [38:48<1:14:25,  1.63it/s]
 34%|███▍      | 3770/11049 [38:49<1:14:24,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.49341413378715515, 'learning_rate': 8.330049910598988e-06, 'epoch': 1.02}

 34%|███▍      | 3770/11049 [38:49<1:14:24,  1.63it/s]
 34%|███▍      | 3771/11049 [38:50<1:14:24,  1.63it/s]
                                                      
{'loss': 0.1657, 'grad_norm': 0.4383242130279541, 'learning_rate': 8.328871421567742e-06, 'epoch': 1.02}

 34%|███▍      | 3771/11049 [38:50<1:14:24,  1.63it/s]
 34%|███▍      | 3772/11049 [38:50<1:14:24,  1.63it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.6260617971420288, 'learning_rate': 8.327692600279195e-06, 'epoch': 1.02}

 34%|███▍      | 3772/11049 [38:50<1:14:24,  1.63it/s]
 34%|███▍      | 3773/11049 [38:51<1:14:24,  1.63it/s]
                                                      
{'loss': 0.239, 'grad_norm': 0.5764990448951721, 'learning_rate': 8.326513446851008e-06, 'epoch': 1.02}

 34%|███▍      | 3773/11049 [38:51<1:14:24,  1.63it/s]
 34%|███▍      | 3774/11049 [38:51<1:14:22,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.47090378403663635, 'learning_rate': 8.325333961400872e-06, 'epoch': 1.02}

 34%|███▍      | 3774/11049 [38:51<1:14:22,  1.63it/s]
 34%|███▍      | 3775/11049 [38:52<1:14:22,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.5100668668746948, 'learning_rate': 8.324154144046514e-06, 'epoch': 1.02}

 34%|███▍      | 3775/11049 [38:52<1:14:22,  1.63it/s]
 34%|███▍      | 3776/11049 [38:53<1:14:20,  1.63it/s]
                                                      
{'loss': 0.1915, 'grad_norm': 0.5431836247444153, 'learning_rate': 8.322973994905692e-06, 'epoch': 1.03}

 34%|███▍      | 3776/11049 [38:53<1:14:20,  1.63it/s]
 34%|███▍      | 3777/11049 [38:53<1:14:19,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.49522823095321655, 'learning_rate': 8.321793514096195e-06, 'epoch': 1.03}

 34%|███▍      | 3777/11049 [38:53<1:14:19,  1.63it/s]
 34%|███▍      | 3778/11049 [38:54<1:14:22,  1.63it/s]
                                                      
{'loss': 0.2145, 'grad_norm': 0.58518385887146, 'learning_rate': 8.32061270173585e-06, 'epoch': 1.03}

 34%|███▍      | 3778/11049 [38:54<1:14:22,  1.63it/s]
 34%|███▍      | 3779/11049 [38:54<1:14:18,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.5680171251296997, 'learning_rate': 8.319431557942517e-06, 'epoch': 1.03}

 34%|███▍      | 3779/11049 [38:55<1:14:18,  1.63it/s]
 34%|███▍      | 3780/11049 [38:55<1:14:16,  1.63it/s]
                                                      
{'loss': 0.2317, 'grad_norm': 0.6954836845397949, 'learning_rate': 8.318250082834082e-06, 'epoch': 1.03}

 34%|███▍      | 3780/11049 [38:55<1:14:16,  1.63it/s]
 34%|███▍      | 3781/11049 [38:56<1:14:17,  1.63it/s]
                                                      
{'loss': 0.2494, 'grad_norm': 0.520221471786499, 'learning_rate': 8.317068276528474e-06, 'epoch': 1.03}

 34%|███▍      | 3781/11049 [38:56<1:14:17,  1.63it/s]
 34%|███▍      | 3782/11049 [38:56<1:14:14,  1.63it/s]
                                                      
{'loss': 0.311, 'grad_norm': 0.6392768025398254, 'learning_rate': 8.315886139143645e-06, 'epoch': 1.03}

 34%|███▍      | 3782/11049 [38:56<1:14:14,  1.63it/s]
 34%|███▍      | 3783/11049 [38:57<1:14:16,  1.63it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.5421724319458008, 'learning_rate': 8.314703670797588e-06, 'epoch': 1.03}

 34%|███▍      | 3783/11049 [38:57<1:14:16,  1.63it/s]
 34%|███▍      | 3784/11049 [38:57<1:14:16,  1.63it/s]
                                                      
{'loss': 0.1785, 'grad_norm': 0.4592559337615967, 'learning_rate': 8.313520871608326e-06, 'epoch': 1.03}

 34%|███▍      | 3784/11049 [38:58<1:14:16,  1.63it/s]
 34%|███▍      | 3785/11049 [38:58<1:14:14,  1.63it/s]
                                                      
{'loss': 0.3128, 'grad_norm': 0.5422403216362, 'learning_rate': 8.312337741693917e-06, 'epoch': 1.03}

 34%|███▍      | 3785/11049 [38:58<1:14:14,  1.63it/s]
 34%|███▍      | 3786/11049 [38:59<1:14:13,  1.63it/s]
                                                      
{'loss': 0.2399, 'grad_norm': 0.6799138784408569, 'learning_rate': 8.311154281172445e-06, 'epoch': 1.03}

 34%|███▍      | 3786/11049 [38:59<1:14:13,  1.63it/s]
 34%|███▍      | 3787/11049 [38:59<1:14:12,  1.63it/s]
                                                      
{'loss': 0.2088, 'grad_norm': 0.5394612550735474, 'learning_rate': 8.309970490162037e-06, 'epoch': 1.03}

 34%|███▍      | 3787/11049 [38:59<1:14:12,  1.63it/s]
 34%|███▍      | 3788/11049 [39:00<1:14:14,  1.63it/s]
                                                      
{'loss': 0.1764, 'grad_norm': 0.5038447976112366, 'learning_rate': 8.308786368780846e-06, 'epoch': 1.03}

 34%|███▍      | 3788/11049 [39:00<1:14:14,  1.63it/s]
 34%|███▍      | 3789/11049 [39:01<1:14:12,  1.63it/s]
                                                      
{'loss': 0.2164, 'grad_norm': 0.5131555795669556, 'learning_rate': 8.30760191714706e-06, 'epoch': 1.03}

 34%|███▍      | 3789/11049 [39:01<1:14:12,  1.63it/s]
 34%|███▍      | 3790/11049 [39:01<1:14:14,  1.63it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.5205449461936951, 'learning_rate': 8.3064171353789e-06, 'epoch': 1.03}

 34%|███▍      | 3790/11049 [39:01<1:14:14,  1.63it/s]
 34%|███▍      | 3791/11049 [39:02<1:14:11,  1.63it/s]
                                                      
{'loss': 0.2612, 'grad_norm': 0.5552629232406616, 'learning_rate': 8.30523202359462e-06, 'epoch': 1.03}

 34%|███▍      | 3791/11049 [39:02<1:14:11,  1.63it/s]
 34%|███▍      | 3792/11049 [39:02<1:14:10,  1.63it/s]
                                                      
{'loss': 0.2823, 'grad_norm': 0.5521525740623474, 'learning_rate': 8.304046581912507e-06, 'epoch': 1.03}

 34%|███▍      | 3792/11049 [39:03<1:14:10,  1.63it/s]
 34%|███▍      | 3793/11049 [39:03<1:14:13,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.6132155060768127, 'learning_rate': 8.30286081045088e-06, 'epoch': 1.03}

 34%|███▍      | 3793/11049 [39:03<1:14:13,  1.63it/s]
 34%|███▍      | 3794/11049 [39:04<1:14:10,  1.63it/s]
                                                      
{'loss': 0.1943, 'grad_norm': 0.5783649682998657, 'learning_rate': 8.301674709328097e-06, 'epoch': 1.03}

 34%|███▍      | 3794/11049 [39:04<1:14:10,  1.63it/s]
 34%|███▍      | 3795/11049 [39:04<1:14:15,  1.63it/s]
                                                      
{'loss': 0.1871, 'grad_norm': 0.4846532940864563, 'learning_rate': 8.300488278662537e-06, 'epoch': 1.03}

 34%|███▍      | 3795/11049 [39:04<1:14:15,  1.63it/s]
 34%|███▍      | 3796/11049 [39:05<1:14:12,  1.63it/s]
                                                      
{'loss': 0.2113, 'grad_norm': 0.5398671627044678, 'learning_rate': 8.299301518572621e-06, 'epoch': 1.03}

 34%|███▍      | 3796/11049 [39:05<1:14:12,  1.63it/s]
 34%|███▍      | 3797/11049 [39:05<1:14:12,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.5121869444847107, 'learning_rate': 8.298114429176803e-06, 'epoch': 1.03}

 34%|███▍      | 3797/11049 [39:06<1:14:12,  1.63it/s]
 34%|███▍      | 3798/11049 [39:06<1:14:11,  1.63it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.5640364289283752, 'learning_rate': 8.296927010593562e-06, 'epoch': 1.03}

 34%|███▍      | 3798/11049 [39:06<1:14:11,  1.63it/s]
 34%|███▍      | 3799/11049 [39:07<1:14:10,  1.63it/s]
                                                      
{'loss': 0.2009, 'grad_norm': 0.5771523118019104, 'learning_rate': 8.29573926294142e-06, 'epoch': 1.03}

 34%|███▍      | 3799/11049 [39:07<1:14:10,  1.63it/s]
 34%|███▍      | 3800/11049 [39:07<1:14:08,  1.63it/s]
                                                      
{'loss': 0.2091, 'grad_norm': 0.5544072985649109, 'learning_rate': 8.294551186338927e-06, 'epoch': 1.03}

 34%|███▍      | 3800/11049 [39:07<1:14:08,  1.63it/s]
 34%|███▍      | 3801/11049 [39:08<1:14:06,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5612289309501648, 'learning_rate': 8.293362780904662e-06, 'epoch': 1.03}

 34%|███▍      | 3801/11049 [39:08<1:14:06,  1.63it/s]
 34%|███▍      | 3802/11049 [39:09<1:14:04,  1.63it/s]
                                                      
{'loss': 0.2663, 'grad_norm': 0.5429729223251343, 'learning_rate': 8.292174046757242e-06, 'epoch': 1.03}

 34%|███▍      | 3802/11049 [39:09<1:14:04,  1.63it/s]
 34%|███▍      | 3803/11049 [39:09<1:14:04,  1.63it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.601961612701416, 'learning_rate': 8.290984984015317e-06, 'epoch': 1.03}

 34%|███▍      | 3803/11049 [39:09<1:14:04,  1.63it/s]
 34%|███▍      | 3804/11049 [39:10<1:14:05,  1.63it/s]
                                                      
{'loss': 0.2089, 'grad_norm': 0.5627413988113403, 'learning_rate': 8.28979559279757e-06, 'epoch': 1.03}

 34%|███▍      | 3804/11049 [39:10<1:14:05,  1.63it/s]
 34%|███▍      | 3805/11049 [39:10<1:14:07,  1.63it/s]
                                                      
{'loss': 0.2178, 'grad_norm': 0.5346537232398987, 'learning_rate': 8.28860587322271e-06, 'epoch': 1.03}

 34%|███▍      | 3805/11049 [39:11<1:14:07,  1.63it/s]
 34%|███▍      | 3806/11049 [39:11<1:14:07,  1.63it/s]
                                                      
{'loss': 0.177, 'grad_norm': 0.48152345418930054, 'learning_rate': 8.287415825409488e-06, 'epoch': 1.03}

 34%|███▍      | 3806/11049 [39:11<1:14:07,  1.63it/s]
 34%|███▍      | 3807/11049 [39:12<1:14:04,  1.63it/s]
                                                      
{'loss': 0.2406, 'grad_norm': 0.5757775902748108, 'learning_rate': 8.286225449476682e-06, 'epoch': 1.03}

 34%|███▍      | 3807/11049 [39:12<1:14:04,  1.63it/s]
 34%|███▍      | 3808/11049 [39:12<1:14:02,  1.63it/s]
                                                      
{'loss': 0.2567, 'grad_norm': 0.6320180296897888, 'learning_rate': 8.285034745543104e-06, 'epoch': 1.03}

 34%|███▍      | 3808/11049 [39:12<1:14:02,  1.63it/s]
 34%|███▍      | 3809/11049 [39:13<1:14:00,  1.63it/s]
                                                      
{'loss': 0.2147, 'grad_norm': 0.4974822700023651, 'learning_rate': 8.2838437137276e-06, 'epoch': 1.03}

 34%|███▍      | 3809/11049 [39:13<1:14:00,  1.63it/s]
 34%|███▍      | 3810/11049 [39:13<1:13:59,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.5525543093681335, 'learning_rate': 8.282652354149047e-06, 'epoch': 1.03}

 34%|███▍      | 3810/11049 [39:14<1:13:59,  1.63it/s]
 34%|███▍      | 3811/11049 [39:14<1:13:58,  1.63it/s]
                                                      
{'loss': 0.1921, 'grad_norm': 0.5061799883842468, 'learning_rate': 8.281460666926357e-06, 'epoch': 1.03}

 34%|███▍      | 3811/11049 [39:14<1:13:58,  1.63it/s]
 35%|███▍      | 3812/11049 [39:15<1:13:59,  1.63it/s]
                                                      
{'loss': 0.1671, 'grad_norm': 0.4599715769290924, 'learning_rate': 8.280268652178471e-06, 'epoch': 1.04}

 35%|███▍      | 3812/11049 [39:15<1:13:59,  1.63it/s]
 35%|███▍      | 3813/11049 [39:15<1:13:59,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.4962109327316284, 'learning_rate': 8.279076310024368e-06, 'epoch': 1.04}

 35%|███▍      | 3813/11049 [39:15<1:13:59,  1.63it/s]
 35%|███▍      | 3814/11049 [39:16<1:13:57,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.3984593152999878, 'learning_rate': 8.277883640583053e-06, 'epoch': 1.04}

 35%|███▍      | 3814/11049 [39:16<1:13:57,  1.63it/s]
 35%|███▍      | 3815/11049 [39:17<1:13:56,  1.63it/s]
                                                      
{'loss': 0.2223, 'grad_norm': 0.659078061580658, 'learning_rate': 8.27669064397357e-06, 'epoch': 1.04}

 35%|███▍      | 3815/11049 [39:17<1:13:56,  1.63it/s]
 35%|███▍      | 3816/11049 [39:17<1:15:39,  1.59it/s]
                                                      
{'loss': 0.1456, 'grad_norm': 0.4286343455314636, 'learning_rate': 8.275497320314993e-06, 'epoch': 1.04}

 35%|███▍      | 3816/11049 [39:17<1:15:39,  1.59it/s]
 35%|███▍      | 3817/11049 [39:18<1:15:26,  1.60it/s]
                                                      
{'loss': 0.2224, 'grad_norm': 0.6279721856117249, 'learning_rate': 8.274303669726427e-06, 'epoch': 1.04}

 35%|███▍      | 3817/11049 [39:18<1:15:26,  1.60it/s]
 35%|███▍      | 3818/11049 [39:18<1:14:57,  1.61it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.6301792860031128, 'learning_rate': 8.273109692327011e-06, 'epoch': 1.04}

 35%|███▍      | 3818/11049 [39:19<1:14:57,  1.61it/s]
 35%|███▍      | 3819/11049 [39:19<1:14:37,  1.61it/s]
                                                      
{'loss': 0.2417, 'grad_norm': 0.5519531965255737, 'learning_rate': 8.271915388235919e-06, 'epoch': 1.04}

 35%|███▍      | 3819/11049 [39:19<1:14:37,  1.61it/s]
 35%|███▍      | 3820/11049 [39:20<1:14:25,  1.62it/s]
                                                      
{'loss': 0.2245, 'grad_norm': 0.5763177275657654, 'learning_rate': 8.270720757572353e-06, 'epoch': 1.04}

 35%|███▍      | 3820/11049 [39:20<1:14:25,  1.62it/s]
 35%|███▍      | 3821/11049 [39:20<1:14:20,  1.62it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.5330359935760498, 'learning_rate': 8.269525800455552e-06, 'epoch': 1.04}

 35%|███▍      | 3821/11049 [39:20<1:14:20,  1.62it/s]
 35%|███▍      | 3822/11049 [39:21<1:14:10,  1.62it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.59487384557724, 'learning_rate': 8.268330517004783e-06, 'epoch': 1.04}

 35%|███▍      | 3822/11049 [39:21<1:14:10,  1.62it/s]
 35%|███▍      | 3823/11049 [39:21<1:14:07,  1.62it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.47821176052093506, 'learning_rate': 8.267134907339352e-06, 'epoch': 1.04}

 35%|███▍      | 3823/11049 [39:22<1:14:07,  1.62it/s]
 35%|███▍      | 3824/11049 [39:22<1:14:01,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.47893425822257996, 'learning_rate': 8.26593897157859e-06, 'epoch': 1.04}

 35%|███▍      | 3824/11049 [39:22<1:14:01,  1.63it/s]
 35%|███▍      | 3825/11049 [39:23<1:13:56,  1.63it/s]
                                                      
{'loss': 0.2815, 'grad_norm': 0.5789238214492798, 'learning_rate': 8.264742709841869e-06, 'epoch': 1.04}

 35%|███▍      | 3825/11049 [39:23<1:13:56,  1.63it/s]
 35%|███▍      | 3826/11049 [39:23<1:13:58,  1.63it/s]
                                                      
{'loss': 0.2157, 'grad_norm': 0.5286065936088562, 'learning_rate': 8.263546122248583e-06, 'epoch': 1.04}

 35%|███▍      | 3826/11049 [39:23<1:13:58,  1.63it/s]
 35%|███▍      | 3827/11049 [39:24<1:13:55,  1.63it/s]
                                                      
{'loss': 0.1938, 'grad_norm': 0.48232901096343994, 'learning_rate': 8.26234920891817e-06, 'epoch': 1.04}

 35%|███▍      | 3827/11049 [39:24<1:13:55,  1.63it/s]
 35%|███▍      | 3828/11049 [39:25<1:15:34,  1.59it/s]
                                                      
{'loss': 0.2325, 'grad_norm': 0.5674772262573242, 'learning_rate': 8.261151969970089e-06, 'epoch': 1.04}

 35%|███▍      | 3828/11049 [39:25<1:15:34,  1.59it/s]
 35%|███▍      | 3829/11049 [39:25<1:15:23,  1.60it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.5186365842819214, 'learning_rate': 8.259954405523842e-06, 'epoch': 1.04}

 35%|███▍      | 3829/11049 [39:25<1:15:23,  1.60it/s]
 35%|███▍      | 3830/11049 [39:26<1:15:01,  1.60it/s]
                                                      
{'loss': 0.2933, 'grad_norm': 0.7149515748023987, 'learning_rate': 8.258756515698958e-06, 'epoch': 1.04}

 35%|███▍      | 3830/11049 [39:26<1:15:01,  1.60it/s]
 35%|███▍      | 3831/11049 [39:26<1:15:02,  1.60it/s]
                                                      
{'loss': 0.1745, 'grad_norm': 0.6464442610740662, 'learning_rate': 8.257558300614999e-06, 'epoch': 1.04}

 35%|███▍      | 3831/11049 [39:27<1:15:02,  1.60it/s]
 35%|███▍      | 3832/11049 [39:27<1:14:39,  1.61it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.5688668489456177, 'learning_rate': 8.256359760391557e-06, 'epoch': 1.04}

 35%|███▍      | 3832/11049 [39:27<1:14:39,  1.61it/s]
 35%|███▍      | 3833/11049 [39:28<1:14:22,  1.62it/s]
                                                      
{'loss': 0.19, 'grad_norm': 0.5838456153869629, 'learning_rate': 8.255160895148263e-06, 'epoch': 1.04}

 35%|███▍      | 3833/11049 [39:28<1:14:22,  1.62it/s]
 35%|███▍      | 3834/11049 [39:28<1:14:10,  1.62it/s]
                                                      
{'loss': 0.1842, 'grad_norm': 0.495938241481781, 'learning_rate': 8.253961705004776e-06, 'epoch': 1.04}

 35%|███▍      | 3834/11049 [39:28<1:14:10,  1.62it/s]
 35%|███▍      | 3835/11049 [39:29<1:14:08,  1.62it/s]
                                                      
{'loss': 0.2844, 'grad_norm': 0.6744456887245178, 'learning_rate': 8.252762190080788e-06, 'epoch': 1.04}

 35%|███▍      | 3835/11049 [39:29<1:14:08,  1.62it/s]
 35%|███▍      | 3836/11049 [39:30<1:14:05,  1.62it/s]
                                                      
{'loss': 0.225, 'grad_norm': 0.565762460231781, 'learning_rate': 8.251562350496022e-06, 'epoch': 1.04}

 35%|███▍      | 3836/11049 [39:30<1:14:05,  1.62it/s]
 35%|███▍      | 3837/11049 [39:30<1:13:57,  1.63it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.43098026514053345, 'learning_rate': 8.250362186370236e-06, 'epoch': 1.04}

 35%|███▍      | 3837/11049 [39:30<1:13:57,  1.63it/s]
 35%|███▍      | 3838/11049 [39:31<1:13:55,  1.63it/s]
                                                      
{'loss': 0.1887, 'grad_norm': 0.5794416666030884, 'learning_rate': 8.249161697823219e-06, 'epoch': 1.04}

 35%|███▍      | 3838/11049 [39:31<1:13:55,  1.63it/s]
 35%|███▍      | 3839/11049 [39:31<1:13:52,  1.63it/s]
                                                      
{'loss': 0.2921, 'grad_norm': 0.6538153290748596, 'learning_rate': 8.247960884974792e-06, 'epoch': 1.04}

 35%|███▍      | 3839/11049 [39:32<1:13:52,  1.63it/s]
 35%|███▍      | 3840/11049 [39:32<1:13:48,  1.63it/s]
                                                      
{'loss': 0.2196, 'grad_norm': 0.5408886075019836, 'learning_rate': 8.246759747944812e-06, 'epoch': 1.04}

 35%|███▍      | 3840/11049 [39:32<1:13:48,  1.63it/s]
 35%|███▍      | 3841/11049 [39:33<1:13:46,  1.63it/s]
                                                      
{'loss': 0.1784, 'grad_norm': 0.4664262533187866, 'learning_rate': 8.245558286853164e-06, 'epoch': 1.04}

 35%|███▍      | 3841/11049 [39:33<1:13:46,  1.63it/s]
 35%|███▍      | 3842/11049 [39:33<1:13:45,  1.63it/s]
                                                      
{'loss': 0.2067, 'grad_norm': 0.5322570204734802, 'learning_rate': 8.244356501819765e-06, 'epoch': 1.04}

 35%|███▍      | 3842/11049 [39:33<1:13:45,  1.63it/s]
 35%|███▍      | 3843/11049 [39:34<1:13:40,  1.63it/s]
                                                      
{'loss': 0.2188, 'grad_norm': 0.6082958579063416, 'learning_rate': 8.243154392964568e-06, 'epoch': 1.04}

 35%|███▍      | 3843/11049 [39:34<1:13:40,  1.63it/s]
 35%|███▍      | 3844/11049 [39:34<1:13:37,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.5053126811981201, 'learning_rate': 8.241951960407556e-06, 'epoch': 1.04}

 35%|███▍      | 3844/11049 [39:35<1:13:37,  1.63it/s]
 35%|███▍      | 3845/11049 [39:35<1:13:39,  1.63it/s]
                                                      
{'loss': 0.2408, 'grad_norm': 0.5601046085357666, 'learning_rate': 8.240749204268746e-06, 'epoch': 1.04}

 35%|███▍      | 3845/11049 [39:35<1:13:39,  1.63it/s]
 35%|███▍      | 3846/11049 [39:36<1:13:39,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.49082356691360474, 'learning_rate': 8.239546124668182e-06, 'epoch': 1.04}

 35%|███▍      | 3846/11049 [39:36<1:13:39,  1.63it/s]
 35%|███▍      | 3847/11049 [39:36<1:13:37,  1.63it/s]
                                                      
{'loss': 0.2113, 'grad_norm': 0.5486394762992859, 'learning_rate': 8.23834272172595e-06, 'epoch': 1.04}

 35%|███▍      | 3847/11049 [39:36<1:13:37,  1.63it/s]
 35%|███▍      | 3848/11049 [39:37<1:13:37,  1.63it/s]
                                                      
{'loss': 0.2019, 'grad_norm': 0.5219545364379883, 'learning_rate': 8.237138995562157e-06, 'epoch': 1.04}

 35%|███▍      | 3848/11049 [39:37<1:13:37,  1.63it/s]
 35%|███▍      | 3849/11049 [39:38<1:13:37,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.4969678819179535, 'learning_rate': 8.23593494629695e-06, 'epoch': 1.05}

 35%|███▍      | 3849/11049 [39:38<1:13:37,  1.63it/s]
 35%|███▍      | 3850/11049 [39:38<1:13:35,  1.63it/s]
                                                      
{'loss': 0.2857, 'grad_norm': 0.6617693901062012, 'learning_rate': 8.23473057405051e-06, 'epoch': 1.05}

 35%|███▍      | 3850/11049 [39:38<1:13:35,  1.63it/s]
 35%|███▍      | 3851/11049 [39:39<1:13:36,  1.63it/s]
                                                      
{'loss': 0.1986, 'grad_norm': 0.5751774311065674, 'learning_rate': 8.23352587894304e-06, 'epoch': 1.05}

 35%|███▍      | 3851/11049 [39:39<1:13:36,  1.63it/s]
 35%|███▍      | 3852/11049 [39:39<1:13:36,  1.63it/s]
                                                      
{'loss': 0.2769, 'grad_norm': 0.5895156860351562, 'learning_rate': 8.232320861094786e-06, 'epoch': 1.05}

 35%|███▍      | 3852/11049 [39:39<1:13:36,  1.63it/s]
 35%|███▍      | 3853/11049 [39:40<1:13:35,  1.63it/s]
                                                      
{'loss': 0.2282, 'grad_norm': 0.5747441053390503, 'learning_rate': 8.23111552062602e-06, 'epoch': 1.05}

 35%|███▍      | 3853/11049 [39:40<1:13:35,  1.63it/s]
 35%|███▍      | 3854/11049 [39:41<1:13:35,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.49282416701316833, 'learning_rate': 8.229909857657048e-06, 'epoch': 1.05}

 35%|███▍      | 3854/11049 [39:41<1:13:35,  1.63it/s]
 35%|███▍      | 3855/11049 [39:41<1:13:33,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5444933772087097, 'learning_rate': 8.228703872308208e-06, 'epoch': 1.05}

 35%|███▍      | 3855/11049 [39:41<1:13:33,  1.63it/s]
 35%|███▍      | 3856/11049 [39:42<1:13:32,  1.63it/s]
                                                      
{'loss': 0.1535, 'grad_norm': 0.45046427845954895, 'learning_rate': 8.227497564699873e-06, 'epoch': 1.05}

 35%|███▍      | 3856/11049 [39:42<1:13:32,  1.63it/s]
 35%|███▍      | 3857/11049 [39:42<1:13:31,  1.63it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.7003841996192932, 'learning_rate': 8.226290934952442e-06, 'epoch': 1.05}

 35%|███▍      | 3857/11049 [39:43<1:13:31,  1.63it/s]
 35%|███▍      | 3858/11049 [39:43<1:13:29,  1.63it/s]
                                                      
{'loss': 0.214, 'grad_norm': 0.5304203629493713, 'learning_rate': 8.22508398318635e-06, 'epoch': 1.05}

 35%|███▍      | 3858/11049 [39:43<1:13:29,  1.63it/s]
 35%|███▍      | 3859/11049 [39:44<1:13:29,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.5381557941436768, 'learning_rate': 8.223876709522066e-06, 'epoch': 1.05}

 35%|███▍      | 3859/11049 [39:44<1:13:29,  1.63it/s]
 35%|███▍      | 3860/11049 [39:44<1:13:28,  1.63it/s]
                                                      
{'loss': 0.2214, 'grad_norm': 0.5529245734214783, 'learning_rate': 8.222669114080088e-06, 'epoch': 1.05}

 35%|███▍      | 3860/11049 [39:44<1:13:28,  1.63it/s]
 35%|███▍      | 3861/11049 [39:45<1:13:26,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.49174246191978455, 'learning_rate': 8.221461196980948e-06, 'epoch': 1.05}

 35%|███▍      | 3861/11049 [39:45<1:13:26,  1.63it/s]
 35%|███▍      | 3862/11049 [39:45<1:13:26,  1.63it/s]
                                                      
{'loss': 0.2269, 'grad_norm': 0.553589940071106, 'learning_rate': 8.220252958345205e-06, 'epoch': 1.05}

 35%|███▍      | 3862/11049 [39:46<1:13:26,  1.63it/s]
 35%|███▍      | 3863/11049 [39:46<1:13:26,  1.63it/s]
                                                      
{'loss': 0.2043, 'grad_norm': 0.5251292586326599, 'learning_rate': 8.219044398293461e-06, 'epoch': 1.05}

 35%|███▍      | 3863/11049 [39:46<1:13:26,  1.63it/s]
 35%|███▍      | 3864/11049 [39:47<1:13:28,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5337144732475281, 'learning_rate': 8.217835516946336e-06, 'epoch': 1.05}

 35%|███▍      | 3864/11049 [39:47<1:13:28,  1.63it/s]
 35%|███▍      | 3865/11049 [39:47<1:13:25,  1.63it/s]
                                                      
{'loss': 0.1754, 'grad_norm': 0.4931608736515045, 'learning_rate': 8.216626314424496e-06, 'epoch': 1.05}

 35%|███▍      | 3865/11049 [39:47<1:13:25,  1.63it/s]
 35%|███▍      | 3866/11049 [39:48<1:13:25,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.4619370102882385, 'learning_rate': 8.215416790848626e-06, 'epoch': 1.05}

 35%|███▍      | 3866/11049 [39:48<1:13:25,  1.63it/s]
 35%|███▍      | 3867/11049 [39:49<1:13:26,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.5871415734291077, 'learning_rate': 8.214206946339457e-06, 'epoch': 1.05}

 35%|███▍      | 3867/11049 [39:49<1:13:26,  1.63it/s]
 35%|███▌      | 3868/11049 [39:49<1:13:26,  1.63it/s]
                                                      
{'loss': 0.2632, 'grad_norm': 0.5708915591239929, 'learning_rate': 8.212996781017739e-06, 'epoch': 1.05}

 35%|███▌      | 3868/11049 [39:49<1:13:26,  1.63it/s]
 35%|███▌      | 3869/11049 [39:50<1:13:27,  1.63it/s]
                                                      
{'loss': 0.227, 'grad_norm': 0.5226832628250122, 'learning_rate': 8.21178629500426e-06, 'epoch': 1.05}

 35%|███▌      | 3869/11049 [39:50<1:13:27,  1.63it/s]
 35%|███▌      | 3870/11049 [39:50<1:13:24,  1.63it/s]
                                                      
{'loss': 0.2317, 'grad_norm': 0.5052257776260376, 'learning_rate': 8.210575488419842e-06, 'epoch': 1.05}

 35%|███▌      | 3870/11049 [39:51<1:13:24,  1.63it/s]
 35%|███▌      | 3871/11049 [39:51<1:13:24,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.47256743907928467, 'learning_rate': 8.209364361385334e-06, 'epoch': 1.05}

 35%|███▌      | 3871/11049 [39:51<1:13:24,  1.63it/s]
 35%|███▌      | 3872/11049 [39:52<1:13:23,  1.63it/s]
                                                      
{'loss': 0.1738, 'grad_norm': 0.42229145765304565, 'learning_rate': 8.208152914021623e-06, 'epoch': 1.05}

 35%|███▌      | 3872/11049 [39:52<1:13:23,  1.63it/s]
 35%|███▌      | 3873/11049 [39:52<1:13:21,  1.63it/s]
                                                      
{'loss': 0.2062, 'grad_norm': 0.5518165230751038, 'learning_rate': 8.206941146449621e-06, 'epoch': 1.05}

 35%|███▌      | 3873/11049 [39:52<1:13:21,  1.63it/s]
 35%|███▌      | 3874/11049 [39:53<1:13:22,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.5902495980262756, 'learning_rate': 8.205729058790276e-06, 'epoch': 1.05}

 35%|███▌      | 3874/11049 [39:53<1:13:22,  1.63it/s]
 35%|███▌      | 3875/11049 [39:53<1:13:19,  1.63it/s]
                                                      
{'loss': 0.1728, 'grad_norm': 0.46327099204063416, 'learning_rate': 8.204516651164569e-06, 'epoch': 1.05}

 35%|███▌      | 3875/11049 [39:54<1:13:19,  1.63it/s]
 35%|███▌      | 3876/11049 [39:54<1:13:19,  1.63it/s]
                                                      
{'loss': 0.2054, 'grad_norm': 0.557691752910614, 'learning_rate': 8.203303923693511e-06, 'epoch': 1.05}

 35%|███▌      | 3876/11049 [39:54<1:13:19,  1.63it/s]
 35%|███▌      | 3877/11049 [39:55<1:13:18,  1.63it/s]
                                                      
{'loss': 0.2708, 'grad_norm': 0.61887127161026, 'learning_rate': 8.202090876498144e-06, 'epoch': 1.05}

 35%|███▌      | 3877/11049 [39:55<1:13:18,  1.63it/s]
 35%|███▌      | 3878/11049 [39:55<1:13:17,  1.63it/s]
                                                      
{'loss': 0.1934, 'grad_norm': 0.4692709445953369, 'learning_rate': 8.200877509699545e-06, 'epoch': 1.05}

 35%|███▌      | 3878/11049 [39:55<1:13:17,  1.63it/s]
 35%|███▌      | 3879/11049 [39:56<1:13:17,  1.63it/s]
                                                      
{'loss': 0.2307, 'grad_norm': 0.5617967844009399, 'learning_rate': 8.19966382341882e-06, 'epoch': 1.05}

 35%|███▌      | 3879/11049 [39:56<1:13:17,  1.63it/s]
 35%|███▌      | 3880/11049 [39:57<1:13:15,  1.63it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.5330842137336731, 'learning_rate': 8.198449817777107e-06, 'epoch': 1.05}

 35%|███▌      | 3880/11049 [39:57<1:13:15,  1.63it/s]
 35%|███▌      | 3881/11049 [39:57<1:13:15,  1.63it/s]
                                                      
{'loss': 0.1725, 'grad_norm': 0.44757571816444397, 'learning_rate': 8.19723549289558e-06, 'epoch': 1.05}

 35%|███▌      | 3881/11049 [39:57<1:13:15,  1.63it/s]
 35%|███▌      | 3882/11049 [39:58<1:13:16,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.5784847736358643, 'learning_rate': 8.196020848895438e-06, 'epoch': 1.05}

 35%|███▌      | 3882/11049 [39:58<1:13:16,  1.63it/s]
 35%|███▌      | 3883/11049 [39:58<1:13:17,  1.63it/s]
                                                      
{'loss': 0.2333, 'grad_norm': 0.6006826162338257, 'learning_rate': 8.19480588589792e-06, 'epoch': 1.05}

 35%|███▌      | 3883/11049 [39:58<1:13:17,  1.63it/s]
 35%|███▌      | 3884/11049 [39:59<1:13:15,  1.63it/s]
                                                      
{'loss': 0.1929, 'grad_norm': 0.4957709312438965, 'learning_rate': 8.193590604024287e-06, 'epoch': 1.05}

 35%|███▌      | 3884/11049 [39:59<1:13:15,  1.63it/s]
 35%|███▌      | 3885/11049 [40:00<1:13:14,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.5294464230537415, 'learning_rate': 8.192375003395841e-06, 'epoch': 1.05}

 35%|███▌      | 3885/11049 [40:00<1:13:14,  1.63it/s]
 35%|███▌      | 3886/11049 [40:00<1:13:13,  1.63it/s]
                                                      
{'loss': 0.17, 'grad_norm': 0.5023072361946106, 'learning_rate': 8.19115908413391e-06, 'epoch': 1.06}

 35%|███▌      | 3886/11049 [40:00<1:13:13,  1.63it/s]
 35%|███▌      | 3887/11049 [40:01<1:13:11,  1.63it/s]
                                                      
{'loss': 0.2401, 'grad_norm': 0.5934834480285645, 'learning_rate': 8.18994284635986e-06, 'epoch': 1.06}

 35%|███▌      | 3887/11049 [40:01<1:13:11,  1.63it/s]
 35%|███▌      | 3888/11049 [40:01<1:13:12,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.5553513765335083, 'learning_rate': 8.18872629019508e-06, 'epoch': 1.06}

 35%|███▌      | 3888/11049 [40:02<1:13:12,  1.63it/s]
 35%|███▌      | 3889/11049 [40:02<1:13:11,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.5228055119514465, 'learning_rate': 8.187509415760996e-06, 'epoch': 1.06}

 35%|███▌      | 3889/11049 [40:02<1:13:11,  1.63it/s]
 35%|███▌      | 3890/11049 [40:03<1:13:09,  1.63it/s]
                                                      
{'loss': 0.2476, 'grad_norm': 0.6525494456291199, 'learning_rate': 8.186292223179066e-06, 'epoch': 1.06}

 35%|███▌      | 3890/11049 [40:03<1:13:09,  1.63it/s]
 35%|███▌      | 3891/11049 [40:03<1:13:09,  1.63it/s]
                                                      
{'loss': 0.2606, 'grad_norm': 0.5698671936988831, 'learning_rate': 8.185074712570781e-06, 'epoch': 1.06}

 35%|███▌      | 3891/11049 [40:03<1:13:09,  1.63it/s]
 35%|███▌      | 3892/11049 [40:04<1:13:07,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.5365572571754456, 'learning_rate': 8.18385688405766e-06, 'epoch': 1.06}

 35%|███▌      | 3892/11049 [40:04<1:13:07,  1.63it/s]
 35%|███▌      | 3893/11049 [40:04<1:13:07,  1.63it/s]
                                                      
{'loss': 0.2398, 'grad_norm': 0.5361999869346619, 'learning_rate': 8.182638737761254e-06, 'epoch': 1.06}

 35%|███▌      | 3893/11049 [40:05<1:13:07,  1.63it/s]
 35%|███▌      | 3894/11049 [40:05<1:13:06,  1.63it/s]
                                                      
{'loss': 0.215, 'grad_norm': 0.5473328828811646, 'learning_rate': 8.18142027380315e-06, 'epoch': 1.06}

 35%|███▌      | 3894/11049 [40:05<1:13:06,  1.63it/s]
 35%|███▌      | 3895/11049 [40:06<1:13:07,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.49383312463760376, 'learning_rate': 8.180201492304962e-06, 'epoch': 1.06}

 35%|███▌      | 3895/11049 [40:06<1:13:07,  1.63it/s]
 35%|███▌      | 3896/11049 [40:06<1:13:06,  1.63it/s]
                                                      
{'loss': 0.2222, 'grad_norm': 0.5783153772354126, 'learning_rate': 8.178982393388337e-06, 'epoch': 1.06}

 35%|███▌      | 3896/11049 [40:06<1:13:06,  1.63it/s]
 35%|███▌      | 3897/11049 [40:07<1:13:05,  1.63it/s]
                                                      
{'loss': 0.274, 'grad_norm': 0.6270684599876404, 'learning_rate': 8.177762977174956e-06, 'epoch': 1.06}

 35%|███▌      | 3897/11049 [40:07<1:13:05,  1.63it/s]
 35%|███▌      | 3898/11049 [40:08<1:13:06,  1.63it/s]
                                                      
{'loss': 0.2945, 'grad_norm': 0.6123790740966797, 'learning_rate': 8.176543243786528e-06, 'epoch': 1.06}

 35%|███▌      | 3898/11049 [40:08<1:13:06,  1.63it/s]
 35%|███▌      | 3899/11049 [40:08<1:13:05,  1.63it/s]
                                                      
{'loss': 0.2813, 'grad_norm': 0.7619476318359375, 'learning_rate': 8.175323193344797e-06, 'epoch': 1.06}

 35%|███▌      | 3899/11049 [40:08<1:13:05,  1.63it/s]
 35%|███▌      | 3900/11049 [40:09<1:13:05,  1.63it/s]
                                                      
{'loss': 0.2835, 'grad_norm': 0.6285965442657471, 'learning_rate': 8.174102825971536e-06, 'epoch': 1.06}

 35%|███▌      | 3900/11049 [40:09<1:13:05,  1.63it/s]
 35%|███▌      | 3901/11049 [40:09<1:13:05,  1.63it/s]
                                                      
{'loss': 0.1816, 'grad_norm': 0.4672119617462158, 'learning_rate': 8.172882141788555e-06, 'epoch': 1.06}

 35%|███▌      | 3901/11049 [40:10<1:13:05,  1.63it/s]
 35%|███▌      | 3902/11049 [40:10<1:13:03,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.5059184432029724, 'learning_rate': 8.171661140917687e-06, 'epoch': 1.06}

 35%|███▌      | 3902/11049 [40:10<1:13:03,  1.63it/s]
 35%|███▌      | 3903/11049 [40:11<1:13:01,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.5443946719169617, 'learning_rate': 8.1704398234808e-06, 'epoch': 1.06}

 35%|███▌      | 3903/11049 [40:11<1:13:01,  1.63it/s]
 35%|███▌      | 3904/11049 [40:11<1:13:02,  1.63it/s]
                                                      
{'loss': 0.2381, 'grad_norm': 0.5855535864830017, 'learning_rate': 8.169218189599796e-06, 'epoch': 1.06}

 35%|███▌      | 3904/11049 [40:11<1:13:02,  1.63it/s]
 35%|███▌      | 3905/11049 [40:12<1:13:01,  1.63it/s]
                                                      
{'loss': 0.2098, 'grad_norm': 0.5109496712684631, 'learning_rate': 8.167996239396611e-06, 'epoch': 1.06}

 35%|███▌      | 3905/11049 [40:12<1:13:01,  1.63it/s]
 35%|███▌      | 3906/11049 [40:12<1:13:00,  1.63it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.6756105422973633, 'learning_rate': 8.166773972993205e-06, 'epoch': 1.06}

 35%|███▌      | 3906/11049 [40:13<1:13:00,  1.63it/s]
 35%|███▌      | 3907/11049 [40:13<1:13:01,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.5261663198471069, 'learning_rate': 8.165551390511575e-06, 'epoch': 1.06}

 35%|███▌      | 3907/11049 [40:13<1:13:01,  1.63it/s]
 35%|███▌      | 3908/11049 [40:14<1:13:00,  1.63it/s]
                                                      
{'loss': 0.1957, 'grad_norm': 0.4919576644897461, 'learning_rate': 8.164328492073747e-06, 'epoch': 1.06}

 35%|███▌      | 3908/11049 [40:14<1:13:00,  1.63it/s]
 35%|███▌      | 3909/11049 [40:14<1:12:58,  1.63it/s]
                                                      
{'loss': 0.2388, 'grad_norm': 0.534209132194519, 'learning_rate': 8.163105277801779e-06, 'epoch': 1.06}

 35%|███▌      | 3909/11049 [40:14<1:12:58,  1.63it/s]
 35%|███▌      | 3910/11049 [40:15<1:12:59,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.46443936228752136, 'learning_rate': 8.161881747817761e-06, 'epoch': 1.06}

 35%|███▌      | 3910/11049 [40:15<1:12:59,  1.63it/s]
 35%|███▌      | 3911/11049 [40:16<1:12:58,  1.63it/s]
                                                      
{'loss': 0.2285, 'grad_norm': 0.5814083218574524, 'learning_rate': 8.160657902243816e-06, 'epoch': 1.06}

 35%|███▌      | 3911/11049 [40:16<1:12:58,  1.63it/s]
 35%|███▌      | 3912/11049 [40:16<1:12:56,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.6018733382225037, 'learning_rate': 8.159433741202097e-06, 'epoch': 1.06}

 35%|███▌      | 3912/11049 [40:16<1:12:56,  1.63it/s]
 35%|███▌      | 3913/11049 [40:17<1:12:58,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.49193283915519714, 'learning_rate': 8.158209264814785e-06, 'epoch': 1.06}

 35%|███▌      | 3913/11049 [40:17<1:12:58,  1.63it/s]
 35%|███▌      | 3914/11049 [40:17<1:12:57,  1.63it/s]
                                                      
{'loss': 0.2125, 'grad_norm': 0.5082650184631348, 'learning_rate': 8.156984473204102e-06, 'epoch': 1.06}

 35%|███▌      | 3914/11049 [40:18<1:12:57,  1.63it/s]
 35%|███▌      | 3915/11049 [40:18<1:12:54,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.49014586210250854, 'learning_rate': 8.15575936649229e-06, 'epoch': 1.06}

 35%|███▌      | 3915/11049 [40:18<1:12:54,  1.63it/s]
 35%|███▌      | 3916/11049 [40:19<1:12:59,  1.63it/s]
                                                      
{'loss': 0.2027, 'grad_norm': 0.5410618782043457, 'learning_rate': 8.15453394480163e-06, 'epoch': 1.06}

 35%|███▌      | 3916/11049 [40:19<1:12:59,  1.63it/s]
 35%|███▌      | 3917/11049 [40:19<1:12:57,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.5712039470672607, 'learning_rate': 8.153308208254433e-06, 'epoch': 1.06}

 35%|███▌      | 3917/11049 [40:19<1:12:57,  1.63it/s]
 35%|███▌      | 3918/11049 [40:20<1:12:56,  1.63it/s]
                                                      
{'loss': 0.206, 'grad_norm': 0.5464208722114563, 'learning_rate': 8.152082156973039e-06, 'epoch': 1.06}

 35%|███▌      | 3918/11049 [40:20<1:12:56,  1.63it/s]
 35%|███▌      | 3919/11049 [40:20<1:12:54,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.5184344053268433, 'learning_rate': 8.150855791079823e-06, 'epoch': 1.06}

 35%|███▌      | 3919/11049 [40:21<1:12:54,  1.63it/s]
 35%|███▌      | 3920/11049 [40:21<1:12:53,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.5388162136077881, 'learning_rate': 8.149629110697188e-06, 'epoch': 1.06}

 35%|███▌      | 3920/11049 [40:21<1:12:53,  1.63it/s]
 35%|███▌      | 3921/11049 [40:22<1:12:52,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.5462492108345032, 'learning_rate': 8.14840211594757e-06, 'epoch': 1.06}

 35%|███▌      | 3921/11049 [40:22<1:12:52,  1.63it/s]
 35%|███▌      | 3922/11049 [40:22<1:12:49,  1.63it/s]
                                                      
{'loss': 0.2239, 'grad_norm': 0.5695928335189819, 'learning_rate': 8.147174806953438e-06, 'epoch': 1.06}

 35%|███▌      | 3922/11049 [40:22<1:12:49,  1.63it/s]
 36%|███▌      | 3923/11049 [40:23<1:12:47,  1.63it/s]
                                                      
{'loss': 0.2144, 'grad_norm': 0.49741238355636597, 'learning_rate': 8.14594718383729e-06, 'epoch': 1.07}

 36%|███▌      | 3923/11049 [40:23<1:12:47,  1.63it/s]
 36%|███▌      | 3924/11049 [40:24<1:12:48,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5381712913513184, 'learning_rate': 8.144719246721653e-06, 'epoch': 1.07}

 36%|███▌      | 3924/11049 [40:24<1:12:48,  1.63it/s]
 36%|███▌      | 3925/11049 [40:24<1:12:47,  1.63it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.5632294416427612, 'learning_rate': 8.143490995729095e-06, 'epoch': 1.07}

 36%|███▌      | 3925/11049 [40:24<1:12:47,  1.63it/s]
 36%|███▌      | 3926/11049 [40:25<1:12:50,  1.63it/s]
                                                      
{'loss': 0.2119, 'grad_norm': 0.5530961155891418, 'learning_rate': 8.142262430982201e-06, 'epoch': 1.07}

 36%|███▌      | 3926/11049 [40:25<1:12:50,  1.63it/s]
 36%|███▌      | 3927/11049 [40:25<1:12:49,  1.63it/s]
                                                      
{'loss': 0.1691, 'grad_norm': 0.5133421421051025, 'learning_rate': 8.141033552603601e-06, 'epoch': 1.07}

 36%|███▌      | 3927/11049 [40:25<1:12:49,  1.63it/s]
 36%|███▌      | 3928/11049 [40:26<1:12:48,  1.63it/s]
                                                      
{'loss': 0.2998, 'grad_norm': 0.7877829074859619, 'learning_rate': 8.139804360715949e-06, 'epoch': 1.07}

 36%|███▌      | 3928/11049 [40:26<1:12:48,  1.63it/s]
 36%|███▌      | 3929/11049 [40:27<1:12:46,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5738486051559448, 'learning_rate': 8.138574855441929e-06, 'epoch': 1.07}

 36%|███▌      | 3929/11049 [40:27<1:12:46,  1.63it/s]
 36%|███▌      | 3930/11049 [40:27<1:12:44,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.5348180532455444, 'learning_rate': 8.13734503690426e-06, 'epoch': 1.07}

 36%|███▌      | 3930/11049 [40:27<1:12:44,  1.63it/s]
 36%|███▌      | 3931/11049 [40:28<1:12:43,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.562485933303833, 'learning_rate': 8.136114905225695e-06, 'epoch': 1.07}

 36%|███▌      | 3931/11049 [40:28<1:12:43,  1.63it/s]
 36%|███▌      | 3932/11049 [40:28<1:12:43,  1.63it/s]
                                                      
{'loss': 0.2032, 'grad_norm': 0.5014843344688416, 'learning_rate': 8.134884460529007e-06, 'epoch': 1.07}

 36%|███▌      | 3932/11049 [40:29<1:12:43,  1.63it/s]
 36%|███▌      | 3933/11049 [40:29<1:12:42,  1.63it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.6391622424125671, 'learning_rate': 8.133653702937015e-06, 'epoch': 1.07}

 36%|███▌      | 3933/11049 [40:29<1:12:42,  1.63it/s]
 36%|███▌      | 3934/11049 [40:30<1:12:42,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.4512256979942322, 'learning_rate': 8.132422632572557e-06, 'epoch': 1.07}

 36%|███▌      | 3934/11049 [40:30<1:12:42,  1.63it/s]
 36%|███▌      | 3935/11049 [40:30<1:12:40,  1.63it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.6181452870368958, 'learning_rate': 8.131191249558508e-06, 'epoch': 1.07}

 36%|███▌      | 3935/11049 [40:30<1:12:40,  1.63it/s]
 36%|███▌      | 3936/11049 [40:31<1:12:39,  1.63it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.4146749675273895, 'learning_rate': 8.129959554017776e-06, 'epoch': 1.07}

 36%|███▌      | 3936/11049 [40:31<1:12:39,  1.63it/s]
 36%|███▌      | 3937/11049 [40:31<1:12:39,  1.63it/s]
                                                      
{'loss': 0.26, 'grad_norm': 0.5505205392837524, 'learning_rate': 8.128727546073296e-06, 'epoch': 1.07}

 36%|███▌      | 3937/11049 [40:32<1:12:39,  1.63it/s]
 36%|███▌      | 3938/11049 [40:32<1:12:39,  1.63it/s]
                                                      
{'loss': 0.2291, 'grad_norm': 0.6803049445152283, 'learning_rate': 8.127495225848033e-06, 'epoch': 1.07}

 36%|███▌      | 3938/11049 [40:32<1:12:39,  1.63it/s]
 36%|███▌      | 3939/11049 [40:33<1:12:40,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5423387885093689, 'learning_rate': 8.126262593464991e-06, 'epoch': 1.07}

 36%|███▌      | 3939/11049 [40:33<1:12:40,  1.63it/s]
 36%|███▌      | 3940/11049 [40:33<1:12:38,  1.63it/s]
                                                      
{'loss': 0.2647, 'grad_norm': 0.6159102916717529, 'learning_rate': 8.125029649047195e-06, 'epoch': 1.07}

 36%|███▌      | 3940/11049 [40:33<1:12:38,  1.63it/s]
 36%|███▌      | 3941/11049 [40:34<1:12:41,  1.63it/s]
                                                      
{'loss': 0.2421, 'grad_norm': 0.6130172610282898, 'learning_rate': 8.12379639271771e-06, 'epoch': 1.07}

 36%|███▌      | 3941/11049 [40:34<1:12:41,  1.63it/s]
 36%|███▌      | 3942/11049 [40:35<1:12:39,  1.63it/s]
                                                      
{'loss': 0.1748, 'grad_norm': 0.4768829047679901, 'learning_rate': 8.122562824599625e-06, 'epoch': 1.07}

 36%|███▌      | 3942/11049 [40:35<1:12:39,  1.63it/s]
 36%|███▌      | 3943/11049 [40:35<1:12:39,  1.63it/s]
                                                      
{'loss': 0.2493, 'grad_norm': 0.6435706615447998, 'learning_rate': 8.121328944816067e-06, 'epoch': 1.07}

 36%|███▌      | 3943/11049 [40:35<1:12:39,  1.63it/s]
 36%|███▌      | 3944/11049 [40:36<1:12:38,  1.63it/s]
                                                      
{'loss': 0.2203, 'grad_norm': 0.5113046765327454, 'learning_rate': 8.120094753490187e-06, 'epoch': 1.07}

 36%|███▌      | 3944/11049 [40:36<1:12:38,  1.63it/s]
 36%|███▌      | 3945/11049 [40:36<1:12:36,  1.63it/s]
                                                      
{'loss': 0.2133, 'grad_norm': 0.5357491970062256, 'learning_rate': 8.118860250745173e-06, 'epoch': 1.07}

 36%|███▌      | 3945/11049 [40:37<1:12:36,  1.63it/s]
 36%|███▌      | 3946/11049 [40:37<1:12:35,  1.63it/s]
                                                      
{'loss': 0.2798, 'grad_norm': 0.58245849609375, 'learning_rate': 8.117625436704241e-06, 'epoch': 1.07}

 36%|███▌      | 3946/11049 [40:37<1:12:35,  1.63it/s]
 36%|███▌      | 3947/11049 [40:38<1:12:33,  1.63it/s]
                                                      
{'loss': 0.2394, 'grad_norm': 0.6558365225791931, 'learning_rate': 8.116390311490639e-06, 'epoch': 1.07}

 36%|███▌      | 3947/11049 [40:38<1:12:33,  1.63it/s]
 36%|███▌      | 3948/11049 [40:38<1:12:35,  1.63it/s]
                                                      
{'loss': 0.2512, 'grad_norm': 0.6301965117454529, 'learning_rate': 8.115154875227646e-06, 'epoch': 1.07}

 36%|███▌      | 3948/11049 [40:38<1:12:35,  1.63it/s]
 36%|███▌      | 3949/11049 [40:39<1:12:33,  1.63it/s]
                                                      
{'loss': 0.1838, 'grad_norm': 0.42223063111305237, 'learning_rate': 8.11391912803857e-06, 'epoch': 1.07}

 36%|███▌      | 3949/11049 [40:39<1:12:33,  1.63it/s]
 36%|███▌      | 3950/11049 [40:39<1:12:33,  1.63it/s]
                                                      
{'loss': 0.2131, 'grad_norm': 0.6127928495407104, 'learning_rate': 8.112683070046755e-06, 'epoch': 1.07}

 36%|███▌      | 3950/11049 [40:40<1:12:33,  1.63it/s]
 36%|███▌      | 3951/11049 [40:40<1:12:33,  1.63it/s]
                                                      
{'loss': 0.1895, 'grad_norm': 0.47839850187301636, 'learning_rate': 8.11144670137557e-06, 'epoch': 1.07}

 36%|███▌      | 3951/11049 [40:40<1:12:33,  1.63it/s]
 36%|███▌      | 3952/11049 [40:41<1:12:33,  1.63it/s]
                                                      
{'loss': 0.2332, 'grad_norm': 0.5043655633926392, 'learning_rate': 8.110210022148419e-06, 'epoch': 1.07}

 36%|███▌      | 3952/11049 [40:41<1:12:33,  1.63it/s]
 36%|███▌      | 3953/11049 [40:41<1:12:31,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.5642533302307129, 'learning_rate': 8.108973032488736e-06, 'epoch': 1.07}

 36%|███▌      | 3953/11049 [40:41<1:12:31,  1.63it/s]
 36%|███▌      | 3954/11049 [40:42<1:12:31,  1.63it/s]
                                                      
{'loss': 0.1798, 'grad_norm': 0.4422932267189026, 'learning_rate': 8.107735732519988e-06, 'epoch': 1.07}

 36%|███▌      | 3954/11049 [40:42<1:12:31,  1.63it/s]
 36%|███▌      | 3955/11049 [40:43<1:12:32,  1.63it/s]
                                                      
{'loss': 0.1831, 'grad_norm': 0.4916854798793793, 'learning_rate': 8.106498122365667e-06, 'epoch': 1.07}

 36%|███▌      | 3955/11049 [40:43<1:12:32,  1.63it/s]
 36%|███▌      | 3956/11049 [40:43<1:12:31,  1.63it/s]
                                                      
{'loss': 0.1933, 'grad_norm': 0.556963324546814, 'learning_rate': 8.105260202149303e-06, 'epoch': 1.07}

 36%|███▌      | 3956/11049 [40:43<1:12:31,  1.63it/s]
 36%|███▌      | 3957/11049 [40:44<1:12:28,  1.63it/s]
                                                      
{'loss': 0.2479, 'grad_norm': 0.6115797758102417, 'learning_rate': 8.10402197199445e-06, 'epoch': 1.07}

 36%|███▌      | 3957/11049 [40:44<1:12:28,  1.63it/s]
 36%|███▌      | 3958/11049 [40:44<1:12:26,  1.63it/s]
                                                      
{'loss': 0.2044, 'grad_norm': 0.5140659213066101, 'learning_rate': 8.102783432024703e-06, 'epoch': 1.07}

 36%|███▌      | 3958/11049 [40:44<1:12:26,  1.63it/s]
 36%|███▌      | 3959/11049 [40:45<1:12:26,  1.63it/s]
                                                      
{'loss': 0.2291, 'grad_norm': 0.5923206806182861, 'learning_rate': 8.101544582363675e-06, 'epoch': 1.07}

 36%|███▌      | 3959/11049 [40:45<1:12:26,  1.63it/s]
 36%|███▌      | 3960/11049 [40:46<1:12:25,  1.63it/s]
                                                      
{'loss': 0.232, 'grad_norm': 0.6192508339881897, 'learning_rate': 8.100305423135022e-06, 'epoch': 1.08}

 36%|███▌      | 3960/11049 [40:46<1:12:25,  1.63it/s]
 36%|███▌      | 3961/11049 [40:46<1:12:25,  1.63it/s]
                                                      
{'loss': 0.206, 'grad_norm': 0.6105901598930359, 'learning_rate': 8.099065954462422e-06, 'epoch': 1.08}

 36%|███▌      | 3961/11049 [40:46<1:12:25,  1.63it/s]
 36%|███▌      | 3962/11049 [40:47<1:12:24,  1.63it/s]
                                                      
{'loss': 0.2573, 'grad_norm': 0.6333308219909668, 'learning_rate': 8.097826176469587e-06, 'epoch': 1.08}

 36%|███▌      | 3962/11049 [40:47<1:12:24,  1.63it/s]
 36%|███▌      | 3963/11049 [40:47<1:12:22,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.4974914491176605, 'learning_rate': 8.096586089280262e-06, 'epoch': 1.08}

 36%|███▌      | 3963/11049 [40:48<1:12:22,  1.63it/s]
 36%|███▌      | 3964/11049 [40:48<1:12:23,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.6711651086807251, 'learning_rate': 8.095345693018222e-06, 'epoch': 1.08}

 36%|███▌      | 3964/11049 [40:48<1:12:23,  1.63it/s]
 36%|███▌      | 3965/11049 [40:49<1:12:24,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.5976823568344116, 'learning_rate': 8.09410498780727e-06, 'epoch': 1.08}

 36%|███▌      | 3965/11049 [40:49<1:12:24,  1.63it/s]
 36%|███▌      | 3966/11049 [40:49<1:12:24,  1.63it/s]
                                                      
{'loss': 0.1712, 'grad_norm': 0.5198234915733337, 'learning_rate': 8.092863973771244e-06, 'epoch': 1.08}

 36%|███▌      | 3966/11049 [40:49<1:12:24,  1.63it/s]
 36%|███▌      | 3967/11049 [40:50<1:12:24,  1.63it/s]
                                                      
{'loss': 0.2285, 'grad_norm': 0.5932958722114563, 'learning_rate': 8.091622651034007e-06, 'epoch': 1.08}

 36%|███▌      | 3967/11049 [40:50<1:12:24,  1.63it/s]
 36%|███▌      | 3968/11049 [40:50<1:12:26,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.4969005882740021, 'learning_rate': 8.090381019719458e-06, 'epoch': 1.08}

 36%|███▌      | 3968/11049 [40:51<1:12:26,  1.63it/s]
 36%|███▌      | 3969/11049 [40:51<1:12:26,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.5501145720481873, 'learning_rate': 8.089139079951526e-06, 'epoch': 1.08}

 36%|███▌      | 3969/11049 [40:51<1:12:26,  1.63it/s]
 36%|███▌      | 3970/11049 [40:52<1:12:24,  1.63it/s]
                                                      
{'loss': 0.2491, 'grad_norm': 0.5836180448532104, 'learning_rate': 8.087896831854171e-06, 'epoch': 1.08}

 36%|███▌      | 3970/11049 [40:52<1:12:24,  1.63it/s]
 36%|███▌      | 3971/11049 [40:52<1:12:21,  1.63it/s]
                                                      
{'loss': 0.215, 'grad_norm': 0.5379636883735657, 'learning_rate': 8.08665427555138e-06, 'epoch': 1.08}

 36%|███▌      | 3971/11049 [40:52<1:12:21,  1.63it/s]
 36%|███▌      | 3972/11049 [40:53<1:12:20,  1.63it/s]
                                                      
{'loss': 0.2239, 'grad_norm': 0.5515251159667969, 'learning_rate': 8.085411411167176e-06, 'epoch': 1.08}

 36%|███▌      | 3972/11049 [40:53<1:12:20,  1.63it/s]
 36%|███▌      | 3973/11049 [40:54<1:12:20,  1.63it/s]
                                                      
{'loss': 0.1912, 'grad_norm': 0.5000298619270325, 'learning_rate': 8.084168238825609e-06, 'epoch': 1.08}

 36%|███▌      | 3973/11049 [40:54<1:12:20,  1.63it/s]
 36%|███▌      | 3974/11049 [40:54<1:12:17,  1.63it/s]
                                                      
{'loss': 0.311, 'grad_norm': 0.593317985534668, 'learning_rate': 8.08292475865076e-06, 'epoch': 1.08}

 36%|███▌      | 3974/11049 [40:54<1:12:17,  1.63it/s]
 36%|███▌      | 3975/11049 [40:55<1:12:17,  1.63it/s]
                                                      
{'loss': 0.1333, 'grad_norm': 0.40185219049453735, 'learning_rate': 8.081680970766746e-06, 'epoch': 1.08}

 36%|███▌      | 3975/11049 [40:55<1:12:17,  1.63it/s]
 36%|███▌      | 3976/11049 [40:55<1:12:16,  1.63it/s]
                                                      
{'loss': 0.2166, 'grad_norm': 0.592860758304596, 'learning_rate': 8.080436875297703e-06, 'epoch': 1.08}

 36%|███▌      | 3976/11049 [40:56<1:12:16,  1.63it/s]
 36%|███▌      | 3977/11049 [40:56<1:12:16,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.6031535267829895, 'learning_rate': 8.079192472367812e-06, 'epoch': 1.08}

 36%|███▌      | 3977/11049 [40:56<1:12:16,  1.63it/s]
 36%|███▌      | 3978/11049 [40:57<1:12:14,  1.63it/s]
                                                      
{'loss': 0.2252, 'grad_norm': 0.49478858709335327, 'learning_rate': 8.077947762101275e-06, 'epoch': 1.08}

 36%|███▌      | 3978/11049 [40:57<1:12:14,  1.63it/s]
 36%|███▌      | 3979/11049 [40:57<1:12:14,  1.63it/s]
                                                      
{'loss': 0.2109, 'grad_norm': 0.5240341424942017, 'learning_rate': 8.07670274462233e-06, 'epoch': 1.08}

 36%|███▌      | 3979/11049 [40:57<1:12:14,  1.63it/s]
 36%|███▌      | 3980/11049 [40:58<1:12:15,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.5079753994941711, 'learning_rate': 8.075457420055238e-06, 'epoch': 1.08}

 36%|███▌      | 3980/11049 [40:58<1:12:15,  1.63it/s]
 36%|███▌      | 3981/11049 [40:58<1:12:14,  1.63it/s]
                                                      
{'loss': 0.2005, 'grad_norm': 0.47612011432647705, 'learning_rate': 8.0742117885243e-06, 'epoch': 1.08}

 36%|███▌      | 3981/11049 [40:59<1:12:14,  1.63it/s]
 36%|███▌      | 3982/11049 [40:59<1:12:13,  1.63it/s]
                                                      
{'loss': 0.2454, 'grad_norm': 0.6569260358810425, 'learning_rate': 8.072965850153842e-06, 'epoch': 1.08}

 36%|███▌      | 3982/11049 [40:59<1:12:13,  1.63it/s]
 36%|███▌      | 3983/11049 [41:00<1:12:15,  1.63it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.5560287237167358, 'learning_rate': 8.071719605068223e-06, 'epoch': 1.08}

 36%|███▌      | 3983/11049 [41:00<1:12:15,  1.63it/s]
 36%|███▌      | 3984/11049 [41:00<1:12:12,  1.63it/s]
                                                      
{'loss': 0.1984, 'grad_norm': 0.5102803111076355, 'learning_rate': 8.070473053391832e-06, 'epoch': 1.08}

 36%|███▌      | 3984/11049 [41:00<1:12:12,  1.63it/s]
 36%|███▌      | 3985/11049 [41:01<1:12:13,  1.63it/s]
                                                      
{'loss': 0.1905, 'grad_norm': 0.539221465587616, 'learning_rate': 8.069226195249087e-06, 'epoch': 1.08}

 36%|███▌      | 3985/11049 [41:01<1:12:13,  1.63it/s]
 36%|███▌      | 3986/11049 [41:02<1:12:11,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.6074050664901733, 'learning_rate': 8.067979030764437e-06, 'epoch': 1.08}

 36%|███▌      | 3986/11049 [41:02<1:12:11,  1.63it/s]
 36%|███▌      | 3987/11049 [41:02<1:12:10,  1.63it/s]
                                                      
{'loss': 0.1637, 'grad_norm': 0.43587201833724976, 'learning_rate': 8.066731560062366e-06, 'epoch': 1.08}

 36%|███▌      | 3987/11049 [41:02<1:12:10,  1.63it/s]
 36%|███▌      | 3988/11049 [41:03<1:12:11,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.4976940453052521, 'learning_rate': 8.065483783267383e-06, 'epoch': 1.08}

 36%|███▌      | 3988/11049 [41:03<1:12:11,  1.63it/s]
 36%|███▌      | 3989/11049 [41:03<1:12:08,  1.63it/s]
                                                      
{'loss': 0.2155, 'grad_norm': 0.5365398526191711, 'learning_rate': 8.064235700504027e-06, 'epoch': 1.08}

 36%|███▌      | 3989/11049 [41:04<1:12:08,  1.63it/s]
 36%|███▌      | 3990/11049 [41:04<1:12:08,  1.63it/s]
                                                      
{'loss': 0.1916, 'grad_norm': 0.5101129412651062, 'learning_rate': 8.062987311896876e-06, 'epoch': 1.08}

 36%|███▌      | 3990/11049 [41:04<1:12:08,  1.63it/s]
 36%|███▌      | 3991/11049 [41:05<1:12:13,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.5195302367210388, 'learning_rate': 8.061738617570528e-06, 'epoch': 1.08}

 36%|███▌      | 3991/11049 [41:05<1:12:13,  1.63it/s]
 36%|███▌      | 3992/11049 [41:05<1:12:11,  1.63it/s]
                                                      
{'loss': 0.1785, 'grad_norm': 0.4507909119129181, 'learning_rate': 8.060489617649617e-06, 'epoch': 1.08}

 36%|███▌      | 3992/11049 [41:05<1:12:11,  1.63it/s]
 36%|███▌      | 3993/11049 [41:06<1:12:08,  1.63it/s]
                                                      
{'loss': 0.2637, 'grad_norm': 0.713388204574585, 'learning_rate': 8.059240312258806e-06, 'epoch': 1.08}

 36%|███▌      | 3993/11049 [41:06<1:12:08,  1.63it/s]
 36%|███▌      | 3994/11049 [41:06<1:12:07,  1.63it/s]
                                                      
{'loss': 0.2234, 'grad_norm': 0.5497822165489197, 'learning_rate': 8.057990701522793e-06, 'epoch': 1.08}

 36%|███▌      | 3994/11049 [41:07<1:12:07,  1.63it/s]
 36%|███▌      | 3995/11049 [41:07<1:12:06,  1.63it/s]
                                                      
{'loss': 0.1648, 'grad_norm': 0.4990593492984772, 'learning_rate': 8.056740785566297e-06, 'epoch': 1.08}

 36%|███▌      | 3995/11049 [41:07<1:12:06,  1.63it/s]
 36%|███▌      | 3996/11049 [41:08<1:12:05,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.6164199709892273, 'learning_rate': 8.05549056451408e-06, 'epoch': 1.08}

 36%|███▌      | 3996/11049 [41:08<1:12:05,  1.63it/s]
 36%|███▌      | 3997/11049 [41:08<1:12:05,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.5102066993713379, 'learning_rate': 8.05424003849092e-06, 'epoch': 1.09}

 36%|███▌      | 3997/11049 [41:08<1:12:05,  1.63it/s]
 36%|███▌      | 3998/11049 [41:09<1:12:06,  1.63it/s]
                                                      
{'loss': 0.1834, 'grad_norm': 0.46488744020462036, 'learning_rate': 8.052989207621637e-06, 'epoch': 1.09}

 36%|███▌      | 3998/11049 [41:09<1:12:06,  1.63it/s]
 36%|███▌      | 3999/11049 [41:10<1:12:03,  1.63it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.5995939373970032, 'learning_rate': 8.051738072031079e-06, 'epoch': 1.09}

 36%|███▌      | 3999/11049 [41:10<1:12:03,  1.63it/s]
 36%|███▌      | 4000/11049 [41:10<1:12:03,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.6148159503936768, 'learning_rate': 8.050486631844119e-06, 'epoch': 1.09}

 36%|███▌      | 4000/11049 [41:10<1:12:03,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.37it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.43it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.84it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.79it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.6313892006874084, 'eval_runtime': 1.9519, 'eval_samples_per_second': 102.466, 'eval_steps_per_second': 6.66, 'epoch': 1.09}

 36%|███▌      | 4000/11049 [41:12<1:12:03,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 36%|███▌      | 4001/11049 [41:13<2:21:03,  1.20s/it]
                                                      
{'loss': 0.177, 'grad_norm': 0.4873945415019989, 'learning_rate': 8.049234887185667e-06, 'epoch': 1.09}

 36%|███▌      | 4001/11049 [41:13<2:21:03,  1.20s/it]
 36%|███▌      | 4002/11049 [41:13<2:00:20,  1.02s/it]
                                                      
{'loss': 0.1898, 'grad_norm': 0.46737948060035706, 'learning_rate': 8.04798283818066e-06, 'epoch': 1.09}

 36%|███▌      | 4002/11049 [41:13<2:00:20,  1.02s/it]
 36%|███▌      | 4003/11049 [41:14<1:45:49,  1.11it/s]
                                                      
{'loss': 0.2689, 'grad_norm': 0.6460821628570557, 'learning_rate': 8.046730484954066e-06, 'epoch': 1.09}

 36%|███▌      | 4003/11049 [41:14<1:45:49,  1.11it/s]
 36%|███▌      | 4004/11049 [41:15<1:35:39,  1.23it/s]
                                                      
{'loss': 0.1534, 'grad_norm': 0.4335096478462219, 'learning_rate': 8.045477827630883e-06, 'epoch': 1.09}

 36%|███▌      | 4004/11049 [41:15<1:35:39,  1.23it/s]
 36%|███▌      | 4005/11049 [41:15<1:28:31,  1.33it/s]
                                                      
{'loss': 0.1639, 'grad_norm': 0.42241114377975464, 'learning_rate': 8.04422486633614e-06, 'epoch': 1.09}

 36%|███▌      | 4005/11049 [41:15<1:28:31,  1.33it/s]
 36%|███▋      | 4006/11049 [41:16<1:23:34,  1.40it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.4768737852573395, 'learning_rate': 8.042971601194895e-06, 'epoch': 1.09}

 36%|███▋      | 4006/11049 [41:16<1:23:34,  1.40it/s]
 36%|███▋      | 4007/11049 [41:16<1:20:06,  1.47it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.5731251835823059, 'learning_rate': 8.041718032332239e-06, 'epoch': 1.09}

 36%|███▋      | 4007/11049 [41:16<1:20:06,  1.47it/s]
 36%|███▋      | 4008/11049 [41:17<1:17:39,  1.51it/s]
                                                      
{'loss': 0.2477, 'grad_norm': 0.6677194833755493, 'learning_rate': 8.040464159873291e-06, 'epoch': 1.09}

 36%|███▋      | 4008/11049 [41:17<1:17:39,  1.51it/s]
 36%|███▋      | 4009/11049 [41:18<1:15:59,  1.54it/s]
                                                      
{'loss': 0.2214, 'grad_norm': 0.5323375463485718, 'learning_rate': 8.039209983943201e-06, 'epoch': 1.09}

 36%|███▋      | 4009/11049 [41:18<1:15:59,  1.54it/s]
 36%|███▋      | 4010/11049 [41:18<1:14:45,  1.57it/s]
                                                      
{'loss': 0.1722, 'grad_norm': 0.4770418107509613, 'learning_rate': 8.03795550466715e-06, 'epoch': 1.09}

 36%|███▋      | 4010/11049 [41:18<1:14:45,  1.57it/s]
 36%|███▋      | 4011/11049 [41:19<1:13:54,  1.59it/s]
                                                      
{'loss': 0.2968, 'grad_norm': 0.7453283667564392, 'learning_rate': 8.036700722170347e-06, 'epoch': 1.09}

 36%|███▋      | 4011/11049 [41:19<1:13:54,  1.59it/s]
 36%|███▋      | 4012/11049 [41:19<1:13:16,  1.60it/s]
                                                      
{'loss': 0.2009, 'grad_norm': 0.5163771510124207, 'learning_rate': 8.035445636578034e-06, 'epoch': 1.09}

 36%|███▋      | 4012/11049 [41:20<1:13:16,  1.60it/s]
 36%|███▋      | 4013/11049 [41:20<1:12:53,  1.61it/s]
                                                      
{'loss': 0.197, 'grad_norm': 0.5021932125091553, 'learning_rate': 8.034190248015482e-06, 'epoch': 1.09}

 36%|███▋      | 4013/11049 [41:20<1:12:53,  1.61it/s]
 36%|███▋      | 4014/11049 [41:21<1:12:35,  1.62it/s]
                                                      
{'loss': 0.1762, 'grad_norm': 0.469955176115036, 'learning_rate': 8.032934556607991e-06, 'epoch': 1.09}

 36%|███▋      | 4014/11049 [41:21<1:12:35,  1.62it/s]
 36%|███▋      | 4015/11049 [41:21<1:12:22,  1.62it/s]
                                                      
{'loss': 0.202, 'grad_norm': 0.48404791951179504, 'learning_rate': 8.031678562480895e-06, 'epoch': 1.09}

 36%|███▋      | 4015/11049 [41:21<1:12:22,  1.62it/s]
 36%|███▋      | 4016/11049 [41:22<1:12:16,  1.62it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.5206038951873779, 'learning_rate': 8.030422265759554e-06, 'epoch': 1.09}

 36%|███▋      | 4016/11049 [41:22<1:12:16,  1.62it/s]
 36%|███▋      | 4017/11049 [41:23<1:12:07,  1.62it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.5512242913246155, 'learning_rate': 8.029165666569361e-06, 'epoch': 1.09}

 36%|███▋      | 4017/11049 [41:23<1:12:07,  1.62it/s]
 36%|███▋      | 4018/11049 [41:23<1:12:00,  1.63it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.5720522999763489, 'learning_rate': 8.027908765035736e-06, 'epoch': 1.09}

 36%|███▋      | 4018/11049 [41:23<1:12:00,  1.63it/s]
 36%|███▋      | 4019/11049 [41:24<1:11:59,  1.63it/s]
                                                      
{'loss': 0.2395, 'grad_norm': 0.5835632085800171, 'learning_rate': 8.026651561284134e-06, 'epoch': 1.09}

 36%|███▋      | 4019/11049 [41:24<1:11:59,  1.63it/s]
 36%|███▋      | 4020/11049 [41:24<1:11:56,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.5549721121788025, 'learning_rate': 8.025394055440037e-06, 'epoch': 1.09}

 36%|███▋      | 4020/11049 [41:24<1:11:56,  1.63it/s]
 36%|███▋      | 4021/11049 [41:25<1:11:54,  1.63it/s]
                                                      
{'loss': 0.2029, 'grad_norm': 0.5715253353118896, 'learning_rate': 8.024136247628956e-06, 'epoch': 1.09}

 36%|███▋      | 4021/11049 [41:25<1:11:54,  1.63it/s]
 36%|███▋      | 4022/11049 [41:26<1:11:52,  1.63it/s]
                                                      
{'loss': 0.2196, 'grad_norm': 0.5446873307228088, 'learning_rate': 8.022878137976436e-06, 'epoch': 1.09}

 36%|███▋      | 4022/11049 [41:26<1:11:52,  1.63it/s]
 36%|███▋      | 4023/11049 [41:26<1:11:52,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.42335477471351624, 'learning_rate': 8.021619726608049e-06, 'epoch': 1.09}

 36%|███▋      | 4023/11049 [41:26<1:11:52,  1.63it/s]
 36%|███▋      | 4024/11049 [41:27<1:11:50,  1.63it/s]
                                                      
{'loss': 0.2295, 'grad_norm': 0.5698508620262146, 'learning_rate': 8.020361013649398e-06, 'epoch': 1.09}

 36%|███▋      | 4024/11049 [41:27<1:11:50,  1.63it/s]
 36%|███▋      | 4025/11049 [41:27<1:11:47,  1.63it/s]
                                                      
{'loss': 0.1754, 'grad_norm': 0.5184751152992249, 'learning_rate': 8.019101999226115e-06, 'epoch': 1.09}

 36%|███▋      | 4025/11049 [41:28<1:11:47,  1.63it/s]
 36%|███▋      | 4026/11049 [41:28<1:11:46,  1.63it/s]
                                                      
{'loss': 0.2221, 'grad_norm': 0.531968355178833, 'learning_rate': 8.017842683463863e-06, 'epoch': 1.09}

 36%|███▋      | 4026/11049 [41:28<1:11:46,  1.63it/s]
 36%|███▋      | 4027/11049 [41:29<1:11:44,  1.63it/s]
                                                      
{'loss': 0.2188, 'grad_norm': 0.5238024592399597, 'learning_rate': 8.01658306648834e-06, 'epoch': 1.09}

 36%|███▋      | 4027/11049 [41:29<1:11:44,  1.63it/s]
 36%|███▋      | 4028/11049 [41:29<1:11:45,  1.63it/s]
                                                      
{'loss': 0.228, 'grad_norm': 0.5810483694076538, 'learning_rate': 8.015323148425262e-06, 'epoch': 1.09}

 36%|███▋      | 4028/11049 [41:29<1:11:45,  1.63it/s]
 36%|███▋      | 4029/11049 [41:30<1:11:46,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.48860129714012146, 'learning_rate': 8.014062929400389e-06, 'epoch': 1.09}

 36%|███▋      | 4029/11049 [41:30<1:11:46,  1.63it/s]
 36%|███▋      | 4030/11049 [41:30<1:11:43,  1.63it/s]
                                                      
{'loss': 0.2004, 'grad_norm': 0.5101656913757324, 'learning_rate': 8.012802409539501e-06, 'epoch': 1.09}

 36%|███▋      | 4030/11049 [41:31<1:11:43,  1.63it/s]
 36%|███▋      | 4031/11049 [41:31<1:11:42,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.47944605350494385, 'learning_rate': 8.011541588968412e-06, 'epoch': 1.09}

 36%|███▋      | 4031/11049 [41:31<1:11:42,  1.63it/s]
 36%|███▋      | 4032/11049 [41:32<1:11:42,  1.63it/s]
                                                      
{'loss': 0.1876, 'grad_norm': 0.5085148215293884, 'learning_rate': 8.010280467812967e-06, 'epoch': 1.09}

 36%|███▋      | 4032/11049 [41:32<1:11:42,  1.63it/s]
 37%|███▋      | 4033/11049 [41:32<1:11:42,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5058340430259705, 'learning_rate': 8.009019046199036e-06, 'epoch': 1.1}

 37%|███▋      | 4033/11049 [41:32<1:11:42,  1.63it/s]
 37%|███▋      | 4034/11049 [41:33<1:11:42,  1.63it/s]
                                                      
{'loss': 0.2228, 'grad_norm': 0.5780200958251953, 'learning_rate': 8.007757324252527e-06, 'epoch': 1.1}

 37%|███▋      | 4034/11049 [41:33<1:11:42,  1.63it/s]
 37%|███▋      | 4035/11049 [41:34<1:11:41,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.5702621936798096, 'learning_rate': 8.006495302099371e-06, 'epoch': 1.1}

 37%|███▋      | 4035/11049 [41:34<1:11:41,  1.63it/s]
 37%|███▋      | 4036/11049 [41:34<1:11:39,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.5316498279571533, 'learning_rate': 8.005232979865532e-06, 'epoch': 1.1}

 37%|███▋      | 4036/11049 [41:34<1:11:39,  1.63it/s]
 37%|███▋      | 4037/11049 [41:35<1:11:39,  1.63it/s]
                                                      
{'loss': 0.1957, 'grad_norm': 0.5441046357154846, 'learning_rate': 8.003970357677002e-06, 'epoch': 1.1}

 37%|███▋      | 4037/11049 [41:35<1:11:39,  1.63it/s]
 37%|███▋      | 4038/11049 [41:35<1:11:41,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.5318925380706787, 'learning_rate': 8.002707435659805e-06, 'epoch': 1.1}

 37%|███▋      | 4038/11049 [41:36<1:11:41,  1.63it/s]
 37%|███▋      | 4039/11049 [41:36<1:11:39,  1.63it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.46534812450408936, 'learning_rate': 8.001444213939995e-06, 'epoch': 1.1}

 37%|███▋      | 4039/11049 [41:36<1:11:39,  1.63it/s]
 37%|███▋      | 4040/11049 [41:37<1:11:38,  1.63it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.5474920868873596, 'learning_rate': 8.000180692643656e-06, 'epoch': 1.1}

 37%|███▋      | 4040/11049 [41:37<1:11:38,  1.63it/s]
 37%|███▋      | 4041/11049 [41:37<1:11:37,  1.63it/s]
                                                      
{'loss': 0.1978, 'grad_norm': 0.5190809965133667, 'learning_rate': 7.998916871896899e-06, 'epoch': 1.1}

 37%|███▋      | 4041/11049 [41:37<1:11:37,  1.63it/s]
 37%|███▋      | 4042/11049 [41:38<1:11:35,  1.63it/s]
                                                      
{'loss': 0.3031, 'grad_norm': 0.7397844195365906, 'learning_rate': 7.997652751825868e-06, 'epoch': 1.1}

 37%|███▋      | 4042/11049 [41:38<1:11:35,  1.63it/s]
 37%|███▋      | 4043/11049 [41:38<1:11:36,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.626187801361084, 'learning_rate': 7.996388332556735e-06, 'epoch': 1.1}

 37%|███▋      | 4043/11049 [41:39<1:11:36,  1.63it/s]
 37%|███▋      | 4044/11049 [41:39<1:11:34,  1.63it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.5156187415122986, 'learning_rate': 7.995123614215705e-06, 'epoch': 1.1}

 37%|███▋      | 4044/11049 [41:39<1:11:34,  1.63it/s]
 37%|███▋      | 4045/11049 [41:40<1:11:34,  1.63it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.5667465329170227, 'learning_rate': 7.993858596929007e-06, 'epoch': 1.1}

 37%|███▋      | 4045/11049 [41:40<1:11:34,  1.63it/s]
 37%|███▋      | 4046/11049 [41:40<1:11:33,  1.63it/s]
                                                      
{'loss': 0.1817, 'grad_norm': 0.494148850440979, 'learning_rate': 7.992593280822907e-06, 'epoch': 1.1}

 37%|███▋      | 4046/11049 [41:40<1:11:33,  1.63it/s]
 37%|███▋      | 4047/11049 [41:41<1:11:33,  1.63it/s]
                                                      
{'loss': 0.2264, 'grad_norm': 0.5646196603775024, 'learning_rate': 7.991327666023693e-06, 'epoch': 1.1}

 37%|███▋      | 4047/11049 [41:41<1:11:33,  1.63it/s]
 37%|███▋      | 4048/11049 [41:42<1:11:32,  1.63it/s]
                                                      
{'loss': 0.1785, 'grad_norm': 0.5167226195335388, 'learning_rate': 7.990061752657692e-06, 'epoch': 1.1}

 37%|███▋      | 4048/11049 [41:42<1:11:32,  1.63it/s]
 37%|███▋      | 4049/11049 [41:42<1:11:31,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.5104475021362305, 'learning_rate': 7.988795540851252e-06, 'epoch': 1.1}

 37%|███▋      | 4049/11049 [41:42<1:11:31,  1.63it/s]
 37%|███▋      | 4050/11049 [41:43<1:11:35,  1.63it/s]
                                                      
{'loss': 0.2514, 'grad_norm': 0.6915777921676636, 'learning_rate': 7.987529030730755e-06, 'epoch': 1.1}

 37%|███▋      | 4050/11049 [41:43<1:11:35,  1.63it/s]
 37%|███▋      | 4051/11049 [41:43<1:11:35,  1.63it/s]
                                                      
{'loss': 0.1982, 'grad_norm': 0.5233009457588196, 'learning_rate': 7.986262222422615e-06, 'epoch': 1.1}

 37%|███▋      | 4051/11049 [41:43<1:11:35,  1.63it/s]
 37%|███▋      | 4052/11049 [41:44<1:11:34,  1.63it/s]
                                                      
{'loss': 0.2193, 'grad_norm': 0.5478124022483826, 'learning_rate': 7.984995116053272e-06, 'epoch': 1.1}

 37%|███▋      | 4052/11049 [41:44<1:11:34,  1.63it/s]
 37%|███▋      | 4053/11049 [41:45<1:11:34,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5610362887382507, 'learning_rate': 7.983727711749194e-06, 'epoch': 1.1}

 37%|███▋      | 4053/11049 [41:45<1:11:34,  1.63it/s]
 37%|███▋      | 4054/11049 [41:45<1:11:31,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.5804436802864075, 'learning_rate': 7.982460009636886e-06, 'epoch': 1.1}

 37%|███▋      | 4054/11049 [41:45<1:11:31,  1.63it/s]
 37%|███▋      | 4055/11049 [41:46<1:11:29,  1.63it/s]
                                                      
{'loss': 0.2301, 'grad_norm': 0.5550426244735718, 'learning_rate': 7.981192009842876e-06, 'epoch': 1.1}

 37%|███▋      | 4055/11049 [41:46<1:11:29,  1.63it/s]
 37%|███▋      | 4056/11049 [41:46<1:11:29,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5183318853378296, 'learning_rate': 7.979923712493723e-06, 'epoch': 1.1}

 37%|███▋      | 4056/11049 [41:47<1:11:29,  1.63it/s]
 37%|███▋      | 4057/11049 [41:47<1:11:28,  1.63it/s]
                                                      
{'loss': 0.3301, 'grad_norm': 0.7160739302635193, 'learning_rate': 7.978655117716018e-06, 'epoch': 1.1}

 37%|███▋      | 4057/11049 [41:47<1:11:28,  1.63it/s]
 37%|███▋      | 4058/11049 [41:48<1:11:29,  1.63it/s]
                                                      
{'loss': 0.1716, 'grad_norm': 0.4585403501987457, 'learning_rate': 7.977386225636383e-06, 'epoch': 1.1}

 37%|███▋      | 4058/11049 [41:48<1:11:29,  1.63it/s]
 37%|███▋      | 4059/11049 [41:48<1:11:30,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.5044940114021301, 'learning_rate': 7.976117036381464e-06, 'epoch': 1.1}

 37%|███▋      | 4059/11049 [41:48<1:11:30,  1.63it/s]
 37%|███▋      | 4060/11049 [41:49<1:11:30,  1.63it/s]
                                                      
{'loss': 0.2799, 'grad_norm': 0.6531610488891602, 'learning_rate': 7.97484755007794e-06, 'epoch': 1.1}

 37%|███▋      | 4060/11049 [41:49<1:11:30,  1.63it/s]
 37%|███▋      | 4061/11049 [41:49<1:11:30,  1.63it/s]
                                                      
{'loss': 0.2386, 'grad_norm': 0.5751449465751648, 'learning_rate': 7.973577766852519e-06, 'epoch': 1.1}

 37%|███▋      | 4061/11049 [41:50<1:11:30,  1.63it/s]
 37%|███▋      | 4062/11049 [41:50<1:11:28,  1.63it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.5369335412979126, 'learning_rate': 7.972307686831941e-06, 'epoch': 1.1}

 37%|███▋      | 4062/11049 [41:50<1:11:28,  1.63it/s]
 37%|███▋      | 4063/11049 [41:51<1:11:26,  1.63it/s]
                                                      
{'loss': 0.2168, 'grad_norm': 0.5471685528755188, 'learning_rate': 7.971037310142972e-06, 'epoch': 1.1}

 37%|███▋      | 4063/11049 [41:51<1:11:26,  1.63it/s]
 37%|███▋      | 4064/11049 [41:51<1:11:30,  1.63it/s]
                                                      
{'loss': 0.2222, 'grad_norm': 0.5690329074859619, 'learning_rate': 7.969766636912411e-06, 'epoch': 1.1}

 37%|███▋      | 4064/11049 [41:51<1:11:30,  1.63it/s]
 37%|███▋      | 4065/11049 [41:52<1:11:28,  1.63it/s]
                                                      
{'loss': 0.2077, 'grad_norm': 0.5636941194534302, 'learning_rate': 7.968495667267084e-06, 'epoch': 1.1}

 37%|███▋      | 4065/11049 [41:52<1:11:28,  1.63it/s]
 37%|███▋      | 4066/11049 [41:53<1:11:26,  1.63it/s]
                                                      
{'loss': 0.2441, 'grad_norm': 0.6321203708648682, 'learning_rate': 7.967224401333847e-06, 'epoch': 1.1}

 37%|███▋      | 4066/11049 [41:53<1:11:26,  1.63it/s]
 37%|███▋      | 4067/11049 [41:53<1:11:22,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.4924132823944092, 'learning_rate': 7.965952839239587e-06, 'epoch': 1.1}

 37%|███▋      | 4067/11049 [41:53<1:11:22,  1.63it/s]
 37%|███▋      | 4068/11049 [41:54<1:11:22,  1.63it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.5766312479972839, 'learning_rate': 7.96468098111122e-06, 'epoch': 1.1}

 37%|███▋      | 4068/11049 [41:54<1:11:22,  1.63it/s]
 37%|███▋      | 4069/11049 [41:54<1:11:20,  1.63it/s]
                                                      
{'loss': 0.2104, 'grad_norm': 0.5794766545295715, 'learning_rate': 7.963408827075686e-06, 'epoch': 1.1}

 37%|███▋      | 4069/11049 [41:55<1:11:20,  1.63it/s]
 37%|███▋      | 4070/11049 [41:55<1:11:19,  1.63it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.5001587271690369, 'learning_rate': 7.962136377259968e-06, 'epoch': 1.11}

 37%|███▋      | 4070/11049 [41:55<1:11:19,  1.63it/s]
 37%|███▋      | 4071/11049 [41:56<1:11:21,  1.63it/s]
                                                      
{'loss': 0.2383, 'grad_norm': 0.5847023129463196, 'learning_rate': 7.960863631791065e-06, 'epoch': 1.11}

 37%|███▋      | 4071/11049 [41:56<1:11:21,  1.63it/s]
 37%|███▋      | 4072/11049 [41:56<1:11:19,  1.63it/s]
                                                      
{'loss': 0.1664, 'grad_norm': 0.43753036856651306, 'learning_rate': 7.959590590796011e-06, 'epoch': 1.11}

 37%|███▋      | 4072/11049 [41:56<1:11:19,  1.63it/s]
 37%|███▋      | 4073/11049 [41:57<1:11:19,  1.63it/s]
                                                      
{'loss': 0.2095, 'grad_norm': 0.6282163858413696, 'learning_rate': 7.958317254401871e-06, 'epoch': 1.11}

 37%|███▋      | 4073/11049 [41:57<1:11:19,  1.63it/s]
 37%|███▋      | 4074/11049 [41:57<1:11:17,  1.63it/s]
                                                      
{'loss': 0.2032, 'grad_norm': 0.5132289528846741, 'learning_rate': 7.957043622735739e-06, 'epoch': 1.11}

 37%|███▋      | 4074/11049 [41:58<1:11:17,  1.63it/s]
 37%|███▋      | 4075/11049 [41:58<1:11:19,  1.63it/s]
                                                      
{'loss': 0.1585, 'grad_norm': 0.6336126923561096, 'learning_rate': 7.95576969592473e-06, 'epoch': 1.11}

 37%|███▋      | 4075/11049 [41:58<1:11:19,  1.63it/s]
 37%|███▋      | 4076/11049 [41:59<1:11:19,  1.63it/s]
                                                      
{'loss': 0.2922, 'grad_norm': 0.7162563800811768, 'learning_rate': 7.954495474096005e-06, 'epoch': 1.11}

 37%|███▋      | 4076/11049 [41:59<1:11:19,  1.63it/s]
 37%|███▋      | 4077/11049 [41:59<1:11:15,  1.63it/s]
                                                      
{'loss': 0.2482, 'grad_norm': 0.5758898258209229, 'learning_rate': 7.953220957376739e-06, 'epoch': 1.11}

 37%|███▋      | 4077/11049 [41:59<1:11:15,  1.63it/s]
 37%|███▋      | 4078/11049 [42:00<1:11:15,  1.63it/s]
                                                      
{'loss': 0.271, 'grad_norm': 0.5769398212432861, 'learning_rate': 7.951946145894146e-06, 'epoch': 1.11}

 37%|███▋      | 4078/11049 [42:00<1:11:15,  1.63it/s]
 37%|███▋      | 4079/11049 [42:01<1:11:15,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.5244784951210022, 'learning_rate': 7.950671039775463e-06, 'epoch': 1.11}

 37%|███▋      | 4079/11049 [42:01<1:11:15,  1.63it/s]
 37%|███▋      | 4080/11049 [42:01<1:11:14,  1.63it/s]
                                                      
{'loss': 0.2318, 'grad_norm': 0.5837079882621765, 'learning_rate': 7.94939563914796e-06, 'epoch': 1.11}

 37%|███▋      | 4080/11049 [42:01<1:11:14,  1.63it/s]
 37%|███▋      | 4081/11049 [42:02<1:11:14,  1.63it/s]
                                                      
{'loss': 0.1894, 'grad_norm': 0.5410863161087036, 'learning_rate': 7.948119944138939e-06, 'epoch': 1.11}

 37%|███▋      | 4081/11049 [42:02<1:11:14,  1.63it/s]
 37%|███▋      | 4082/11049 [42:02<1:11:12,  1.63it/s]
                                                      
{'loss': 0.2896, 'grad_norm': 0.5228490233421326, 'learning_rate': 7.946843954875723e-06, 'epoch': 1.11}

 37%|███▋      | 4082/11049 [42:03<1:11:12,  1.63it/s]
 37%|███▋      | 4083/11049 [42:03<1:11:09,  1.63it/s]
                                                      
{'loss': 0.2247, 'grad_norm': 0.6156127452850342, 'learning_rate': 7.945567671485673e-06, 'epoch': 1.11}

 37%|███▋      | 4083/11049 [42:03<1:11:09,  1.63it/s]
 37%|███▋      | 4084/11049 [42:04<1:11:10,  1.63it/s]
                                                      
{'loss': 0.1625, 'grad_norm': 0.46683618426322937, 'learning_rate': 7.944291094096175e-06, 'epoch': 1.11}

 37%|███▋      | 4084/11049 [42:04<1:11:10,  1.63it/s]
 37%|███▋      | 4085/11049 [42:04<1:11:10,  1.63it/s]
                                                      
{'loss': 0.1511, 'grad_norm': 0.430111289024353, 'learning_rate': 7.943014222834644e-06, 'epoch': 1.11}

 37%|███▋      | 4085/11049 [42:04<1:11:10,  1.63it/s]
 37%|███▋      | 4086/11049 [42:05<1:11:09,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.4938106834888458, 'learning_rate': 7.941737057828528e-06, 'epoch': 1.11}

 37%|███▋      | 4086/11049 [42:05<1:11:09,  1.63it/s]
 37%|███▋      | 4087/11049 [42:05<1:11:08,  1.63it/s]
                                                      
{'loss': 0.19, 'grad_norm': 0.4497546851634979, 'learning_rate': 7.940459599205299e-06, 'epoch': 1.11}

 37%|███▋      | 4087/11049 [42:06<1:11:08,  1.63it/s]
 37%|███▋      | 4088/11049 [42:06<1:11:09,  1.63it/s]
                                                      
{'loss': 0.214, 'grad_norm': 0.5006755590438843, 'learning_rate': 7.939181847092465e-06, 'epoch': 1.11}

 37%|███▋      | 4088/11049 [42:06<1:11:09,  1.63it/s]
 37%|███▋      | 4089/11049 [42:07<1:11:11,  1.63it/s]
                                                      
{'loss': 0.2279, 'grad_norm': 0.6068453192710876, 'learning_rate': 7.937903801617555e-06, 'epoch': 1.11}

 37%|███▋      | 4089/11049 [42:07<1:11:11,  1.63it/s]
 37%|███▋      | 4090/11049 [42:07<1:11:10,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.5795993804931641, 'learning_rate': 7.936625462908133e-06, 'epoch': 1.11}

 37%|███▋      | 4090/11049 [42:07<1:11:10,  1.63it/s]
 37%|███▋      | 4091/11049 [42:08<1:11:11,  1.63it/s]
                                                      
{'loss': 0.2046, 'grad_norm': 0.5757996439933777, 'learning_rate': 7.935346831091793e-06, 'epoch': 1.11}

 37%|███▋      | 4091/11049 [42:08<1:11:11,  1.63it/s]
 37%|███▋      | 4092/11049 [42:09<1:11:08,  1.63it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.507143497467041, 'learning_rate': 7.934067906296157e-06, 'epoch': 1.11}

 37%|███▋      | 4092/11049 [42:09<1:11:08,  1.63it/s]
 37%|███▋      | 4093/11049 [42:09<1:11:07,  1.63it/s]
                                                      
{'loss': 0.276, 'grad_norm': 0.6007986664772034, 'learning_rate': 7.93278868864887e-06, 'epoch': 1.11}

 37%|███▋      | 4093/11049 [42:09<1:11:07,  1.63it/s]
 37%|███▋      | 4094/11049 [42:10<1:11:07,  1.63it/s]
                                                      
{'loss': 0.2451, 'grad_norm': 0.614022970199585, 'learning_rate': 7.93150917827762e-06, 'epoch': 1.11}

 37%|███▋      | 4094/11049 [42:10<1:11:07,  1.63it/s]
 37%|███▋      | 4095/11049 [42:10<1:11:06,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.46814000606536865, 'learning_rate': 7.930229375310106e-06, 'epoch': 1.11}

 37%|███▋      | 4095/11049 [42:10<1:11:06,  1.63it/s]
 37%|███▋      | 4096/11049 [42:11<1:11:06,  1.63it/s]
                                                      
{'loss': 0.17, 'grad_norm': 0.4737400412559509, 'learning_rate': 7.928949279874074e-06, 'epoch': 1.11}

 37%|███▋      | 4096/11049 [42:11<1:11:06,  1.63it/s]
 37%|███▋      | 4097/11049 [42:12<1:11:06,  1.63it/s]
                                                      
{'loss': 0.2079, 'grad_norm': 0.5388848185539246, 'learning_rate': 7.927668892097288e-06, 'epoch': 1.11}

 37%|███▋      | 4097/11049 [42:12<1:11:06,  1.63it/s]
 37%|███▋      | 4098/11049 [42:12<1:11:04,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5629487037658691, 'learning_rate': 7.926388212107548e-06, 'epoch': 1.11}

 37%|███▋      | 4098/11049 [42:12<1:11:04,  1.63it/s]
 37%|███▋      | 4099/11049 [42:13<1:11:04,  1.63it/s]
                                                      
{'loss': 0.2474, 'grad_norm': 0.6021623015403748, 'learning_rate': 7.925107240032673e-06, 'epoch': 1.11}

 37%|███▋      | 4099/11049 [42:13<1:11:04,  1.63it/s]
 37%|███▋      | 4100/11049 [42:13<1:11:03,  1.63it/s]
                                                      
{'loss': 0.2106, 'grad_norm': 0.5472289323806763, 'learning_rate': 7.923825976000524e-06, 'epoch': 1.11}

 37%|███▋      | 4100/11049 [42:14<1:11:03,  1.63it/s]
 37%|███▋      | 4101/11049 [42:14<1:11:01,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.5351089239120483, 'learning_rate': 7.922544420138982e-06, 'epoch': 1.11}

 37%|███▋      | 4101/11049 [42:14<1:11:01,  1.63it/s]
 37%|███▋      | 4102/11049 [42:15<1:11:00,  1.63it/s]
                                                      
{'loss': 0.2665, 'grad_norm': 0.6119901537895203, 'learning_rate': 7.921262572575962e-06, 'epoch': 1.11}

 37%|███▋      | 4102/11049 [42:15<1:11:00,  1.63it/s]
 37%|███▋      | 4103/11049 [42:15<1:11:01,  1.63it/s]
                                                      
{'loss': 0.2097, 'grad_norm': 0.5726449489593506, 'learning_rate': 7.919980433439404e-06, 'epoch': 1.11}

 37%|███▋      | 4103/11049 [42:15<1:11:01,  1.63it/s]
 37%|███▋      | 4104/11049 [42:16<1:10:59,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.5817456841468811, 'learning_rate': 7.918698002857281e-06, 'epoch': 1.11}

 37%|███▋      | 4104/11049 [42:16<1:10:59,  1.63it/s]
 37%|███▋      | 4105/11049 [42:16<1:10:57,  1.63it/s]
                                                      
{'loss': 0.2181, 'grad_norm': 0.5132996439933777, 'learning_rate': 7.917415280957592e-06, 'epoch': 1.11}

 37%|███▋      | 4105/11049 [42:17<1:10:57,  1.63it/s]
 37%|███▋      | 4106/11049 [42:17<1:10:57,  1.63it/s]
                                                      
{'loss': 0.2273, 'grad_norm': 0.5574422478675842, 'learning_rate': 7.916132267868369e-06, 'epoch': 1.11}

 37%|███▋      | 4106/11049 [42:17<1:10:57,  1.63it/s]
 37%|███▋      | 4107/11049 [42:18<1:10:56,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.5055847764015198, 'learning_rate': 7.914848963717665e-06, 'epoch': 1.12}

 37%|███▋      | 4107/11049 [42:18<1:10:56,  1.63it/s]
 37%|███▋      | 4108/11049 [42:18<1:10:54,  1.63it/s]
                                                      
{'loss': 0.2013, 'grad_norm': 0.5187641978263855, 'learning_rate': 7.913565368633576e-06, 'epoch': 1.12}

 37%|███▋      | 4108/11049 [42:18<1:10:54,  1.63it/s]
 37%|███▋      | 4109/11049 [42:19<1:10:55,  1.63it/s]
                                                      
{'loss': 0.1942, 'grad_norm': 0.4847823977470398, 'learning_rate': 7.912281482744212e-06, 'epoch': 1.12}

 37%|███▋      | 4109/11049 [42:19<1:10:55,  1.63it/s]
 37%|███▋      | 4110/11049 [42:20<1:10:55,  1.63it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.5916857123374939, 'learning_rate': 7.91099730617772e-06, 'epoch': 1.12}

 37%|███▋      | 4110/11049 [42:20<1:10:55,  1.63it/s]
 37%|███▋      | 4111/11049 [42:20<1:10:54,  1.63it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.4860604703426361, 'learning_rate': 7.909712839062278e-06, 'epoch': 1.12}

 37%|███▋      | 4111/11049 [42:20<1:10:54,  1.63it/s]
 37%|███▋      | 4112/11049 [42:21<1:10:53,  1.63it/s]
                                                      
{'loss': 0.2877, 'grad_norm': 0.5902852416038513, 'learning_rate': 7.908428081526086e-06, 'epoch': 1.12}

 37%|███▋      | 4112/11049 [42:21<1:10:53,  1.63it/s]
 37%|███▋      | 4113/11049 [42:21<1:10:52,  1.63it/s]
                                                      
{'loss': 0.2553, 'grad_norm': 0.5590687394142151, 'learning_rate': 7.907143033697378e-06, 'epoch': 1.12}

 37%|███▋      | 4113/11049 [42:22<1:10:52,  1.63it/s]
 37%|███▋      | 4114/11049 [42:22<1:10:51,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5648751258850098, 'learning_rate': 7.905857695704415e-06, 'epoch': 1.12}

 37%|███▋      | 4114/11049 [42:22<1:10:51,  1.63it/s]
 37%|███▋      | 4115/11049 [42:23<1:10:49,  1.63it/s]
                                                      
{'loss': 0.2764, 'grad_norm': 0.7262636423110962, 'learning_rate': 7.904572067675489e-06, 'epoch': 1.12}

 37%|███▋      | 4115/11049 [42:23<1:10:49,  1.63it/s]
 37%|███▋      | 4116/11049 [42:23<1:10:49,  1.63it/s]
                                                      
{'loss': 0.1961, 'grad_norm': 0.5695598721504211, 'learning_rate': 7.903286149738917e-06, 'epoch': 1.12}

 37%|███▋      | 4116/11049 [42:23<1:10:49,  1.63it/s]
 37%|███▋      | 4117/11049 [42:24<1:10:48,  1.63it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.48758262395858765, 'learning_rate': 7.90199994202305e-06, 'epoch': 1.12}

 37%|███▋      | 4117/11049 [42:24<1:10:48,  1.63it/s]
 37%|███▋      | 4118/11049 [42:24<1:10:47,  1.63it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.5568153262138367, 'learning_rate': 7.900713444656266e-06, 'epoch': 1.12}

 37%|███▋      | 4118/11049 [42:25<1:10:47,  1.63it/s]
 37%|███▋      | 4119/11049 [42:25<1:10:47,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5519320368766785, 'learning_rate': 7.899426657766966e-06, 'epoch': 1.12}

 37%|███▋      | 4119/11049 [42:25<1:10:47,  1.63it/s]
 37%|███▋      | 4120/11049 [42:26<1:10:47,  1.63it/s]
                                                      
{'loss': 0.2266, 'grad_norm': 0.5547245144844055, 'learning_rate': 7.898139581483593e-06, 'epoch': 1.12}

 37%|███▋      | 4120/11049 [42:26<1:10:47,  1.63it/s]
 37%|███▋      | 4121/11049 [42:26<1:10:49,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5570766925811768, 'learning_rate': 7.896852215934605e-06, 'epoch': 1.12}

 37%|███▋      | 4121/11049 [42:26<1:10:49,  1.63it/s]
 37%|███▋      | 4122/11049 [42:27<1:10:46,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.8391842842102051, 'learning_rate': 7.895564561248499e-06, 'epoch': 1.12}

 37%|███▋      | 4122/11049 [42:27<1:10:46,  1.63it/s]
 37%|███▋      | 4123/11049 [42:28<1:10:44,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5090688467025757, 'learning_rate': 7.894276617553793e-06, 'epoch': 1.12}

 37%|███▋      | 4123/11049 [42:28<1:10:44,  1.63it/s]
 37%|███▋      | 4124/11049 [42:28<1:10:46,  1.63it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.622983992099762, 'learning_rate': 7.89298838497904e-06, 'epoch': 1.12}

 37%|███▋      | 4124/11049 [42:28<1:10:46,  1.63it/s]
 37%|███▋      | 4125/11049 [42:29<1:10:46,  1.63it/s]
                                                      
{'loss': 0.2046, 'grad_norm': 0.5131652355194092, 'learning_rate': 7.891699863652821e-06, 'epoch': 1.12}

 37%|███▋      | 4125/11049 [42:29<1:10:46,  1.63it/s]
 37%|███▋      | 4126/11049 [42:29<1:10:44,  1.63it/s]
                                                      
{'loss': 0.2444, 'grad_norm': 0.5607050657272339, 'learning_rate': 7.890411053703742e-06, 'epoch': 1.12}

 37%|███▋      | 4126/11049 [42:29<1:10:44,  1.63it/s]
 37%|███▋      | 4127/11049 [42:30<1:10:43,  1.63it/s]
                                                      
{'loss': 0.2768, 'grad_norm': 0.6072763204574585, 'learning_rate': 7.88912195526044e-06, 'epoch': 1.12}

 37%|███▋      | 4127/11049 [42:30<1:10:43,  1.63it/s]
 37%|███▋      | 4128/11049 [42:31<1:10:44,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.47902172803878784, 'learning_rate': 7.887832568451582e-06, 'epoch': 1.12}

 37%|███▋      | 4128/11049 [42:31<1:10:44,  1.63it/s]
 37%|███▋      | 4129/11049 [42:31<1:10:44,  1.63it/s]
                                                      
{'loss': 0.1542, 'grad_norm': 0.39679446816444397, 'learning_rate': 7.886542893405861e-06, 'epoch': 1.12}

 37%|███▋      | 4129/11049 [42:31<1:10:44,  1.63it/s]
 37%|███▋      | 4130/11049 [42:32<1:10:44,  1.63it/s]
                                                      
{'loss': 0.2017, 'grad_norm': 0.5222554206848145, 'learning_rate': 7.885252930252002e-06, 'epoch': 1.12}

 37%|███▋      | 4130/11049 [42:32<1:10:44,  1.63it/s]
 37%|███▋      | 4131/11049 [42:32<1:10:43,  1.63it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.553691029548645, 'learning_rate': 7.88396267911876e-06, 'epoch': 1.12}

 37%|███▋      | 4131/11049 [42:33<1:10:43,  1.63it/s]
 37%|███▋      | 4132/11049 [42:33<1:10:42,  1.63it/s]
                                                      
{'loss': 0.2989, 'grad_norm': 0.6569275856018066, 'learning_rate': 7.882672140134911e-06, 'epoch': 1.12}

 37%|███▋      | 4132/11049 [42:33<1:10:42,  1.63it/s]
 37%|███▋      | 4133/11049 [42:34<1:10:44,  1.63it/s]
                                                      
{'loss': 0.1724, 'grad_norm': 0.5727788805961609, 'learning_rate': 7.881381313429267e-06, 'epoch': 1.12}

 37%|███▋      | 4133/11049 [42:34<1:10:44,  1.63it/s]
 37%|███▋      | 4134/11049 [42:34<1:10:41,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.5426327586174011, 'learning_rate': 7.880090199130665e-06, 'epoch': 1.12}

 37%|███▋      | 4134/11049 [42:34<1:10:41,  1.63it/s]
 37%|███▋      | 4135/11049 [42:35<1:10:39,  1.63it/s]
                                                      
{'loss': 0.2543, 'grad_norm': 0.6612212657928467, 'learning_rate': 7.878798797367976e-06, 'epoch': 1.12}

 37%|███▋      | 4135/11049 [42:35<1:10:39,  1.63it/s]
 37%|███▋      | 4136/11049 [42:35<1:10:41,  1.63it/s]
                                                      
{'loss': 0.1883, 'grad_norm': 0.49020156264305115, 'learning_rate': 7.877507108270092e-06, 'epoch': 1.12}

 37%|███▋      | 4136/11049 [42:36<1:10:41,  1.63it/s]
 37%|███▋      | 4137/11049 [42:36<1:10:39,  1.63it/s]
                                                      
{'loss': 0.1441, 'grad_norm': 0.43082353472709656, 'learning_rate': 7.876215131965938e-06, 'epoch': 1.12}

 37%|███▋      | 4137/11049 [42:36<1:10:39,  1.63it/s]
 37%|███▋      | 4138/11049 [42:37<1:10:43,  1.63it/s]
                                                      
{'loss': 0.2473, 'grad_norm': 0.669913649559021, 'learning_rate': 7.874922868584469e-06, 'epoch': 1.12}

 37%|███▋      | 4138/11049 [42:37<1:10:43,  1.63it/s]
 37%|███▋      | 4139/11049 [42:37<1:10:43,  1.63it/s]
                                                      
{'loss': 0.226, 'grad_norm': 0.621271014213562, 'learning_rate': 7.873630318254665e-06, 'epoch': 1.12}

 37%|███▋      | 4139/11049 [42:37<1:10:43,  1.63it/s]
 37%|███▋      | 4140/11049 [42:38<1:10:46,  1.63it/s]
                                                      
{'loss': 0.2406, 'grad_norm': 0.5421900749206543, 'learning_rate': 7.872337481105536e-06, 'epoch': 1.12}

 37%|███▋      | 4140/11049 [42:38<1:10:46,  1.63it/s]
 37%|███▋      | 4141/11049 [42:39<1:10:44,  1.63it/s]
                                                      
{'loss': 0.2402, 'grad_norm': 0.6048886775970459, 'learning_rate': 7.871044357266124e-06, 'epoch': 1.12}

 37%|███▋      | 4141/11049 [42:39<1:10:44,  1.63it/s]
 37%|███▋      | 4142/11049 [42:39<1:10:41,  1.63it/s]
                                                      
{'loss': 0.1631, 'grad_norm': 0.4452611207962036, 'learning_rate': 7.869750946865496e-06, 'epoch': 1.12}

 37%|███▋      | 4142/11049 [42:39<1:10:41,  1.63it/s]
 37%|███▋      | 4143/11049 [42:40<1:10:38,  1.63it/s]
                                                      
{'loss': 0.2178, 'grad_norm': 0.5250183939933777, 'learning_rate': 7.868457250032745e-06, 'epoch': 1.12}

 37%|███▋      | 4143/11049 [42:40<1:10:38,  1.63it/s]
 38%|███▊      | 4144/11049 [42:40<1:10:35,  1.63it/s]
                                                      
{'loss': 0.2308, 'grad_norm': 0.5952259302139282, 'learning_rate': 7.867163266897e-06, 'epoch': 1.13}

 38%|███▊      | 4144/11049 [42:41<1:10:35,  1.63it/s]
 38%|███▊      | 4145/11049 [42:41<1:10:34,  1.63it/s]
                                                      
{'loss': 0.1778, 'grad_norm': 0.5010719299316406, 'learning_rate': 7.865868997587414e-06, 'epoch': 1.13}

 38%|███▊      | 4145/11049 [42:41<1:10:34,  1.63it/s]
 38%|███▊      | 4146/11049 [42:42<1:10:33,  1.63it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.5875265598297119, 'learning_rate': 7.864574442233164e-06, 'epoch': 1.13}

 38%|███▊      | 4146/11049 [42:42<1:10:33,  1.63it/s]
 38%|███▊      | 4147/11049 [42:42<1:10:31,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.5384807586669922, 'learning_rate': 7.863279600963466e-06, 'epoch': 1.13}

 38%|███▊      | 4147/11049 [42:42<1:10:31,  1.63it/s]
 38%|███▊      | 4148/11049 [42:43<1:10:29,  1.63it/s]
                                                      
{'loss': 0.1861, 'grad_norm': 0.5566697716712952, 'learning_rate': 7.861984473907558e-06, 'epoch': 1.13}

 38%|███▊      | 4148/11049 [42:43<1:10:29,  1.63it/s]
 38%|███▊      | 4149/11049 [42:43<1:10:28,  1.63it/s]
                                                      
{'loss': 0.2042, 'grad_norm': 0.5026905536651611, 'learning_rate': 7.86068906119471e-06, 'epoch': 1.13}

 38%|███▊      | 4149/11049 [42:44<1:10:28,  1.63it/s]
 38%|███▊      | 4150/11049 [42:44<1:10:28,  1.63it/s]
                                                      
{'loss': 0.1778, 'grad_norm': 0.6427159905433655, 'learning_rate': 7.859393362954211e-06, 'epoch': 1.13}

 38%|███▊      | 4150/11049 [42:44<1:10:28,  1.63it/s]
 38%|███▊      | 4151/11049 [42:45<1:10:30,  1.63it/s]
                                                      
{'loss': 0.1935, 'grad_norm': 0.5123088359832764, 'learning_rate': 7.858097379315391e-06, 'epoch': 1.13}

 38%|███▊      | 4151/11049 [42:45<1:10:30,  1.63it/s]
 38%|███▊      | 4152/11049 [42:45<1:10:30,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5473306179046631, 'learning_rate': 7.856801110407602e-06, 'epoch': 1.13}

 38%|███▊      | 4152/11049 [42:45<1:10:30,  1.63it/s]
 38%|███▊      | 4153/11049 [42:46<1:10:29,  1.63it/s]
                                                      
{'loss': 0.2308, 'grad_norm': 0.550100564956665, 'learning_rate': 7.855504556360227e-06, 'epoch': 1.13}

 38%|███▊      | 4153/11049 [42:46<1:10:29,  1.63it/s]
 38%|███▊      | 4154/11049 [42:47<1:10:27,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.6275472640991211, 'learning_rate': 7.854207717302675e-06, 'epoch': 1.13}

 38%|███▊      | 4154/11049 [42:47<1:10:27,  1.63it/s]
 38%|███▊      | 4155/11049 [42:47<1:10:26,  1.63it/s]
                                                      
{'loss': 0.2372, 'grad_norm': 0.4983854591846466, 'learning_rate': 7.852910593364384e-06, 'epoch': 1.13}

 38%|███▊      | 4155/11049 [42:47<1:10:26,  1.63it/s]
 38%|███▊      | 4156/11049 [42:48<1:10:25,  1.63it/s]
                                                      
{'loss': 0.2196, 'grad_norm': 0.5855586528778076, 'learning_rate': 7.851613184674821e-06, 'epoch': 1.13}

 38%|███▊      | 4156/11049 [42:48<1:10:25,  1.63it/s]
 38%|███▊      | 4157/11049 [42:48<1:10:24,  1.63it/s]
                                                      
{'loss': 0.2194, 'grad_norm': 0.547519862651825, 'learning_rate': 7.850315491363483e-06, 'epoch': 1.13}

 38%|███▊      | 4157/11049 [42:49<1:10:24,  1.63it/s]
 38%|███▊      | 4158/11049 [42:49<1:10:27,  1.63it/s]
                                                      
{'loss': 0.2297, 'grad_norm': 0.556166410446167, 'learning_rate': 7.849017513559891e-06, 'epoch': 1.13}

 38%|███▊      | 4158/11049 [42:49<1:10:27,  1.63it/s]
 38%|███▊      | 4159/11049 [42:50<1:10:25,  1.63it/s]
                                                      
{'loss': 0.208, 'grad_norm': 0.5852401852607727, 'learning_rate': 7.8477192513936e-06, 'epoch': 1.13}

 38%|███▊      | 4159/11049 [42:50<1:10:25,  1.63it/s]
 38%|███▊      | 4160/11049 [42:50<1:10:22,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.5123106837272644, 'learning_rate': 7.846420704994189e-06, 'epoch': 1.13}

 38%|███▊      | 4160/11049 [42:50<1:10:22,  1.63it/s]
 38%|███▊      | 4161/11049 [42:51<1:10:23,  1.63it/s]
                                                      
{'loss': 0.2398, 'grad_norm': 0.5885952711105347, 'learning_rate': 7.845121874491266e-06, 'epoch': 1.13}

 38%|███▊      | 4161/11049 [42:51<1:10:23,  1.63it/s]
 38%|███▊      | 4162/11049 [42:51<1:10:23,  1.63it/s]
                                                      
{'loss': 0.2242, 'grad_norm': 0.6407769322395325, 'learning_rate': 7.843822760014472e-06, 'epoch': 1.13}

 38%|███▊      | 4162/11049 [42:52<1:10:23,  1.63it/s]
 38%|███▊      | 4163/11049 [42:52<1:10:22,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.5586841702461243, 'learning_rate': 7.84252336169347e-06, 'epoch': 1.13}

 38%|███▊      | 4163/11049 [42:52<1:10:22,  1.63it/s]
 38%|███▊      | 4164/11049 [42:53<1:10:21,  1.63it/s]
                                                      
{'loss': 0.2709, 'grad_norm': 0.800011157989502, 'learning_rate': 7.841223679657953e-06, 'epoch': 1.13}

 38%|███▊      | 4164/11049 [42:53<1:10:21,  1.63it/s]
 38%|███▊      | 4165/11049 [42:53<1:10:21,  1.63it/s]
                                                      
{'loss': 0.1905, 'grad_norm': 0.4878856837749481, 'learning_rate': 7.839923714037645e-06, 'epoch': 1.13}

 38%|███▊      | 4165/11049 [42:53<1:10:21,  1.63it/s]
 38%|███▊      | 4166/11049 [42:54<1:10:20,  1.63it/s]
                                                      
{'loss': 0.206, 'grad_norm': 0.5766891241073608, 'learning_rate': 7.838623464962297e-06, 'epoch': 1.13}

 38%|███▊      | 4166/11049 [42:54<1:10:20,  1.63it/s]
 38%|███▊      | 4167/11049 [42:55<1:10:21,  1.63it/s]
                                                      
{'loss': 0.1751, 'grad_norm': 0.4716041684150696, 'learning_rate': 7.837322932561685e-06, 'epoch': 1.13}

 38%|███▊      | 4167/11049 [42:55<1:10:21,  1.63it/s]
 38%|███▊      | 4168/11049 [42:55<1:10:18,  1.63it/s]
                                                      
{'loss': 0.2099, 'grad_norm': 0.5634603500366211, 'learning_rate': 7.836022116965619e-06, 'epoch': 1.13}

 38%|███▊      | 4168/11049 [42:55<1:10:18,  1.63it/s]
 38%|███▊      | 4169/11049 [42:56<1:10:16,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5533691644668579, 'learning_rate': 7.834721018303935e-06, 'epoch': 1.13}

 38%|███▊      | 4169/11049 [42:56<1:10:16,  1.63it/s]
 38%|███▊      | 4170/11049 [42:56<1:10:16,  1.63it/s]
                                                      
{'loss': 0.1728, 'grad_norm': 0.5327173471450806, 'learning_rate': 7.833419636706495e-06, 'epoch': 1.13}

 38%|███▊      | 4170/11049 [42:56<1:10:16,  1.63it/s]
 38%|███▊      | 4171/11049 [42:57<1:10:16,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.6594310402870178, 'learning_rate': 7.83211797230319e-06, 'epoch': 1.13}

 38%|███▊      | 4171/11049 [42:57<1:10:16,  1.63it/s]
 38%|███▊      | 4172/11049 [42:58<1:10:15,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.5514994859695435, 'learning_rate': 7.830816025223942e-06, 'epoch': 1.13}

 38%|███▊      | 4172/11049 [42:58<1:10:15,  1.63it/s]
 38%|███▊      | 4173/11049 [42:58<1:10:14,  1.63it/s]
                                                      
{'loss': 0.2838, 'grad_norm': 0.6791422963142395, 'learning_rate': 7.829513795598698e-06, 'epoch': 1.13}

 38%|███▊      | 4173/11049 [42:58<1:10:14,  1.63it/s]
 38%|███▊      | 4174/11049 [42:59<1:10:16,  1.63it/s]
                                                      
{'loss': 0.214, 'grad_norm': 0.5557559132575989, 'learning_rate': 7.828211283557436e-06, 'epoch': 1.13}

 38%|███▊      | 4174/11049 [42:59<1:10:16,  1.63it/s]
 38%|███▊      | 4175/11049 [42:59<1:10:15,  1.63it/s]
                                                      
{'loss': 0.1643, 'grad_norm': 0.472308486700058, 'learning_rate': 7.826908489230162e-06, 'epoch': 1.13}

 38%|███▊      | 4175/11049 [43:00<1:10:15,  1.63it/s]
 38%|███▊      | 4176/11049 [43:00<1:10:16,  1.63it/s]
                                                      
{'loss': 0.1862, 'grad_norm': 0.49330130219459534, 'learning_rate': 7.825605412746904e-06, 'epoch': 1.13}

 38%|███▊      | 4176/11049 [43:00<1:10:16,  1.63it/s]
 38%|███▊      | 4177/11049 [43:01<1:10:13,  1.63it/s]
                                                      
{'loss': 0.2917, 'grad_norm': 0.5339146852493286, 'learning_rate': 7.82430205423773e-06, 'epoch': 1.13}

 38%|███▊      | 4177/11049 [43:01<1:10:13,  1.63it/s]
 38%|███▊      | 4178/11049 [43:01<1:10:12,  1.63it/s]
                                                      
{'loss': 0.1693, 'grad_norm': 0.606707751750946, 'learning_rate': 7.822998413832723e-06, 'epoch': 1.13}

 38%|███▊      | 4178/11049 [43:01<1:10:12,  1.63it/s]
 38%|███▊      | 4179/11049 [43:02<1:10:13,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.5067262053489685, 'learning_rate': 7.821694491662002e-06, 'epoch': 1.13}

 38%|███▊      | 4179/11049 [43:02<1:10:13,  1.63it/s]
 38%|███▊      | 4180/11049 [43:02<1:10:14,  1.63it/s]
                                                      
{'loss': 0.1764, 'grad_norm': 0.4405318796634674, 'learning_rate': 7.820390287855714e-06, 'epoch': 1.13}

 38%|███▊      | 4180/11049 [43:03<1:10:14,  1.63it/s]
 38%|███▊      | 4181/11049 [43:03<1:10:15,  1.63it/s]
                                                      
{'loss': 0.1526, 'grad_norm': 0.3985312879085541, 'learning_rate': 7.819085802544033e-06, 'epoch': 1.14}

 38%|███▊      | 4181/11049 [43:03<1:10:15,  1.63it/s]
 38%|███▊      | 4182/11049 [43:04<1:10:17,  1.63it/s]
                                                      
{'loss': 0.1608, 'grad_norm': 0.42136672139167786, 'learning_rate': 7.817781035857157e-06, 'epoch': 1.14}

 38%|███▊      | 4182/11049 [43:04<1:10:17,  1.63it/s]
 38%|███▊      | 4183/11049 [43:04<1:10:14,  1.63it/s]
                                                      
{'loss': 0.2207, 'grad_norm': 0.7051638960838318, 'learning_rate': 7.816475987925322e-06, 'epoch': 1.14}

 38%|███▊      | 4183/11049 [43:04<1:10:14,  1.63it/s]
 38%|███▊      | 4184/11049 [43:05<1:10:12,  1.63it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.6380760669708252, 'learning_rate': 7.815170658878778e-06, 'epoch': 1.14}

 38%|███▊      | 4184/11049 [43:05<1:10:12,  1.63it/s]
 38%|███▊      | 4185/11049 [43:06<1:10:10,  1.63it/s]
                                                      
{'loss': 0.1577, 'grad_norm': 0.44844964146614075, 'learning_rate': 7.81386504884782e-06, 'epoch': 1.14}

 38%|███▊      | 4185/11049 [43:06<1:10:10,  1.63it/s]
 38%|███▊      | 4186/11049 [43:06<1:10:12,  1.63it/s]
                                                      
{'loss': 0.2183, 'grad_norm': 0.5467883944511414, 'learning_rate': 7.812559157962754e-06, 'epoch': 1.14}

 38%|███▊      | 4186/11049 [43:06<1:10:12,  1.63it/s]
 38%|███▊      | 4187/11049 [43:07<1:10:10,  1.63it/s]
                                                      
{'loss': 0.182, 'grad_norm': 0.4992738366127014, 'learning_rate': 7.811252986353927e-06, 'epoch': 1.14}

 38%|███▊      | 4187/11049 [43:07<1:10:10,  1.63it/s]
 38%|███▊      | 4188/11049 [43:07<1:10:08,  1.63it/s]
                                                      
{'loss': 0.3543, 'grad_norm': 0.6252284646034241, 'learning_rate': 7.809946534151706e-06, 'epoch': 1.14}

 38%|███▊      | 4188/11049 [43:08<1:10:08,  1.63it/s]
 38%|███▊      | 4189/11049 [43:08<1:10:08,  1.63it/s]
                                                      
{'loss': 0.275, 'grad_norm': 0.6016337275505066, 'learning_rate': 7.808639801486492e-06, 'epoch': 1.14}

 38%|███▊      | 4189/11049 [43:08<1:10:08,  1.63it/s]
 38%|███▊      | 4190/11049 [43:09<1:10:08,  1.63it/s]
                                                      
{'loss': 0.2608, 'grad_norm': 0.6376258134841919, 'learning_rate': 7.807332788488708e-06, 'epoch': 1.14}

 38%|███▊      | 4190/11049 [43:09<1:10:08,  1.63it/s]
 38%|███▊      | 4191/11049 [43:09<1:10:06,  1.63it/s]
                                                      
{'loss': 0.1781, 'grad_norm': 0.5152924656867981, 'learning_rate': 7.806025495288809e-06, 'epoch': 1.14}

 38%|███▊      | 4191/11049 [43:09<1:10:06,  1.63it/s]
 38%|███▊      | 4192/11049 [43:10<1:10:05,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.7045952677726746, 'learning_rate': 7.804717922017277e-06, 'epoch': 1.14}

 38%|███▊      | 4192/11049 [43:10<1:10:05,  1.63it/s]
 38%|███▊      | 4193/11049 [43:10<1:10:05,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.515927255153656, 'learning_rate': 7.803410068804625e-06, 'epoch': 1.14}

 38%|███▊      | 4193/11049 [43:11<1:10:05,  1.63it/s]
 38%|███▊      | 4194/11049 [43:11<1:10:04,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.5913029909133911, 'learning_rate': 7.802101935781386e-06, 'epoch': 1.14}

 38%|███▊      | 4194/11049 [43:11<1:10:04,  1.63it/s]
 38%|███▊      | 4195/11049 [43:12<1:10:03,  1.63it/s]
                                                      
{'loss': 0.2533, 'grad_norm': 0.6631430387496948, 'learning_rate': 7.800793523078128e-06, 'epoch': 1.14}

 38%|███▊      | 4195/11049 [43:12<1:10:03,  1.63it/s]
 38%|███▊      | 4196/11049 [43:12<1:10:02,  1.63it/s]
                                                      
{'loss': 0.1506, 'grad_norm': 0.4242105484008789, 'learning_rate': 7.799484830825443e-06, 'epoch': 1.14}

 38%|███▊      | 4196/11049 [43:12<1:10:02,  1.63it/s]
 38%|███▊      | 4197/11049 [43:13<1:10:02,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.6318507790565491, 'learning_rate': 7.798175859153956e-06, 'epoch': 1.14}

 38%|███▊      | 4197/11049 [43:13<1:10:02,  1.63it/s]
 38%|███▊      | 4198/11049 [43:14<1:10:01,  1.63it/s]
                                                      
{'loss': 0.1846, 'grad_norm': 0.4918878674507141, 'learning_rate': 7.796866608194315e-06, 'epoch': 1.14}

 38%|███▊      | 4198/11049 [43:14<1:10:01,  1.63it/s]
 38%|███▊      | 4199/11049 [43:14<1:10:00,  1.63it/s]
                                                      
{'loss': 0.2559, 'grad_norm': 0.6238930225372314, 'learning_rate': 7.795557078077196e-06, 'epoch': 1.14}

 38%|███▊      | 4199/11049 [43:14<1:10:00,  1.63it/s]
 38%|███▊      | 4200/11049 [43:15<1:10:01,  1.63it/s]
                                                      
{'loss': 0.1535, 'grad_norm': 0.474161297082901, 'learning_rate': 7.794247268933306e-06, 'epoch': 1.14}

 38%|███▊      | 4200/11049 [43:15<1:10:01,  1.63it/s]
 38%|███▊      | 4201/11049 [43:15<1:10:01,  1.63it/s]
                                                      
{'loss': 0.2688, 'grad_norm': 0.6238594651222229, 'learning_rate': 7.792937180893377e-06, 'epoch': 1.14}

 38%|███▊      | 4201/11049 [43:15<1:10:01,  1.63it/s]
 38%|███▊      | 4202/11049 [43:16<1:09:58,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5504001975059509, 'learning_rate': 7.791626814088171e-06, 'epoch': 1.14}

 38%|███▊      | 4202/11049 [43:16<1:09:58,  1.63it/s]
 38%|███▊      | 4203/11049 [43:17<1:09:59,  1.63it/s]
                                                      
{'loss': 0.207, 'grad_norm': 0.47874826192855835, 'learning_rate': 7.790316168648476e-06, 'epoch': 1.14}

 38%|███▊      | 4203/11049 [43:17<1:09:59,  1.63it/s]
 38%|███▊      | 4204/11049 [43:17<1:09:57,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.49305459856987, 'learning_rate': 7.789005244705108e-06, 'epoch': 1.14}

 38%|███▊      | 4204/11049 [43:17<1:09:57,  1.63it/s]
 38%|███▊      | 4205/11049 [43:18<1:09:57,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.5696189403533936, 'learning_rate': 7.787694042388912e-06, 'epoch': 1.14}

 38%|███▊      | 4205/11049 [43:18<1:09:57,  1.63it/s]
 38%|███▊      | 4206/11049 [43:18<1:09:55,  1.63it/s]
                                                      
{'loss': 0.2557, 'grad_norm': 0.6211194396018982, 'learning_rate': 7.786382561830762e-06, 'epoch': 1.14}

 38%|███▊      | 4206/11049 [43:19<1:09:55,  1.63it/s]
 38%|███▊      | 4207/11049 [43:19<1:09:54,  1.63it/s]
                                                      
{'loss': 0.1549, 'grad_norm': 0.4368799924850464, 'learning_rate': 7.785070803161552e-06, 'epoch': 1.14}

 38%|███▊      | 4207/11049 [43:19<1:09:54,  1.63it/s]
 38%|███▊      | 4208/11049 [43:20<1:09:55,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.6505682468414307, 'learning_rate': 7.783758766512217e-06, 'epoch': 1.14}

 38%|███▊      | 4208/11049 [43:20<1:09:55,  1.63it/s]
 38%|███▊      | 4209/11049 [43:20<1:09:55,  1.63it/s]
                                                      
{'loss': 0.187, 'grad_norm': 0.48824527859687805, 'learning_rate': 7.782446452013709e-06, 'epoch': 1.14}

 38%|███▊      | 4209/11049 [43:20<1:09:55,  1.63it/s]
 38%|███▊      | 4210/11049 [43:21<1:09:56,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5471769571304321, 'learning_rate': 7.78113385979701e-06, 'epoch': 1.14}

 38%|███▊      | 4210/11049 [43:21<1:09:56,  1.63it/s]
 38%|███▊      | 4211/11049 [43:21<1:09:55,  1.63it/s]
                                                      
{'loss': 0.1833, 'grad_norm': 0.5058301687240601, 'learning_rate': 7.779820989993133e-06, 'epoch': 1.14}

 38%|███▊      | 4211/11049 [43:22<1:09:55,  1.63it/s]
 38%|███▊      | 4212/11049 [43:22<1:09:54,  1.63it/s]
                                                      
{'loss': 0.2228, 'grad_norm': 0.6266112327575684, 'learning_rate': 7.778507842733116e-06, 'epoch': 1.14}

 38%|███▊      | 4212/11049 [43:22<1:09:54,  1.63it/s]
 38%|███▊      | 4213/11049 [43:23<1:09:54,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.4750837981700897, 'learning_rate': 7.777194418148024e-06, 'epoch': 1.14}

 38%|███▊      | 4213/11049 [43:23<1:09:54,  1.63it/s]
 38%|███▊      | 4214/11049 [43:23<1:09:53,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.5124920010566711, 'learning_rate': 7.775880716368953e-06, 'epoch': 1.14}

 38%|███▊      | 4214/11049 [43:23<1:09:53,  1.63it/s]
 38%|███▊      | 4215/11049 [43:24<1:09:52,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.49999696016311646, 'learning_rate': 7.774566737527024e-06, 'epoch': 1.14}

 38%|███▊      | 4215/11049 [43:24<1:09:52,  1.63it/s]
 38%|███▊      | 4216/11049 [43:25<1:09:51,  1.63it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.5712756514549255, 'learning_rate': 7.773252481753385e-06, 'epoch': 1.14}

 38%|███▊      | 4216/11049 [43:25<1:09:51,  1.63it/s]
 38%|███▊      | 4217/11049 [43:25<1:09:48,  1.63it/s]
                                                      
{'loss': 0.1826, 'grad_norm': 0.46025392413139343, 'learning_rate': 7.771937949179214e-06, 'epoch': 1.14}

 38%|███▊      | 4217/11049 [43:25<1:09:48,  1.63it/s]
 38%|███▊      | 4218/11049 [43:26<1:09:48,  1.63it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.5462285876274109, 'learning_rate': 7.770623139935716e-06, 'epoch': 1.15}

 38%|███▊      | 4218/11049 [43:26<1:09:48,  1.63it/s]
 38%|███▊      | 4219/11049 [43:26<1:09:47,  1.63it/s]
                                                      
{'loss': 0.2105, 'grad_norm': 0.49693167209625244, 'learning_rate': 7.76930805415412e-06, 'epoch': 1.15}

 38%|███▊      | 4219/11049 [43:27<1:09:47,  1.63it/s]
 38%|███▊      | 4220/11049 [43:27<1:09:48,  1.63it/s]
                                                      
{'loss': 0.2061, 'grad_norm': 0.49240055680274963, 'learning_rate': 7.767992691965691e-06, 'epoch': 1.15}

 38%|███▊      | 4220/11049 [43:27<1:09:48,  1.63it/s]
 38%|███▊      | 4221/11049 [43:28<1:09:48,  1.63it/s]
                                                      
{'loss': 0.2388, 'grad_norm': 0.6048077940940857, 'learning_rate': 7.766677053501713e-06, 'epoch': 1.15}

 38%|███▊      | 4221/11049 [43:28<1:09:48,  1.63it/s]
 38%|███▊      | 4222/11049 [43:28<1:09:48,  1.63it/s]
                                                      
{'loss': 0.3241, 'grad_norm': 0.6627095937728882, 'learning_rate': 7.765361138893502e-06, 'epoch': 1.15}

 38%|███▊      | 4222/11049 [43:28<1:09:48,  1.63it/s]
 38%|███▊      | 4223/11049 [43:29<1:09:51,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.49261337518692017, 'learning_rate': 7.764044948272398e-06, 'epoch': 1.15}

 38%|███▊      | 4223/11049 [43:29<1:09:51,  1.63it/s]
 38%|███▊      | 4224/11049 [43:29<1:09:51,  1.63it/s]
                                                      
{'loss': 0.2521, 'grad_norm': 0.5300250053405762, 'learning_rate': 7.762728481769775e-06, 'epoch': 1.15}

 38%|███▊      | 4224/11049 [43:30<1:09:51,  1.63it/s]
 38%|███▊      | 4225/11049 [43:30<1:09:50,  1.63it/s]
                                                      
{'loss': 0.2981, 'grad_norm': 0.5998297929763794, 'learning_rate': 7.761411739517026e-06, 'epoch': 1.15}

 38%|███▊      | 4225/11049 [43:30<1:09:50,  1.63it/s]
 38%|███▊      | 4226/11049 [43:31<1:09:48,  1.63it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.5943161249160767, 'learning_rate': 7.760094721645582e-06, 'epoch': 1.15}

 38%|███▊      | 4226/11049 [43:31<1:09:48,  1.63it/s]
 38%|███▊      | 4227/11049 [43:31<1:09:45,  1.63it/s]
                                                      
{'loss': 0.2541, 'grad_norm': 0.6225095391273499, 'learning_rate': 7.75877742828689e-06, 'epoch': 1.15}

 38%|███▊      | 4227/11049 [43:31<1:09:45,  1.63it/s]
 38%|███▊      | 4228/11049 [43:32<1:09:46,  1.63it/s]
                                                      
{'loss': 0.2948, 'grad_norm': 0.6544599533081055, 'learning_rate': 7.757459859572433e-06, 'epoch': 1.15}

 38%|███▊      | 4228/11049 [43:32<1:09:46,  1.63it/s]
 38%|███▊      | 4229/11049 [43:33<1:09:44,  1.63it/s]
                                                      
{'loss': 0.1309, 'grad_norm': 0.41431674361228943, 'learning_rate': 7.75614201563372e-06, 'epoch': 1.15}

 38%|███▊      | 4229/11049 [43:33<1:09:44,  1.63it/s]
 38%|███▊      | 4230/11049 [43:33<1:09:44,  1.63it/s]
                                                      
{'loss': 0.2485, 'grad_norm': 0.5225262641906738, 'learning_rate': 7.75482389660228e-06, 'epoch': 1.15}

 38%|███▊      | 4230/11049 [43:33<1:09:44,  1.63it/s]
 38%|███▊      | 4231/11049 [43:34<1:09:43,  1.63it/s]
                                                      
{'loss': 0.1599, 'grad_norm': 0.43537965416908264, 'learning_rate': 7.753505502609681e-06, 'epoch': 1.15}

 38%|███▊      | 4231/11049 [43:34<1:09:43,  1.63it/s]
 38%|███▊      | 4232/11049 [43:34<1:09:42,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.5364809632301331, 'learning_rate': 7.752186833787512e-06, 'epoch': 1.15}

 38%|███▊      | 4232/11049 [43:35<1:09:42,  1.63it/s]
 38%|███▊      | 4233/11049 [43:35<1:09:40,  1.63it/s]
                                                      
{'loss': 0.198, 'grad_norm': 0.48895078897476196, 'learning_rate': 7.750867890267391e-06, 'epoch': 1.15}

 38%|███▊      | 4233/11049 [43:35<1:09:40,  1.63it/s]
 38%|███▊      | 4234/11049 [43:36<1:09:37,  1.63it/s]
                                                      
{'loss': 0.3514, 'grad_norm': 0.7168381810188293, 'learning_rate': 7.74954867218096e-06, 'epoch': 1.15}

 38%|███▊      | 4234/11049 [43:36<1:09:37,  1.63it/s]
 38%|███▊      | 4235/11049 [43:36<1:09:38,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.5651026964187622, 'learning_rate': 7.748229179659894e-06, 'epoch': 1.15}

 38%|███▊      | 4235/11049 [43:36<1:09:38,  1.63it/s]
 38%|███▊      | 4236/11049 [43:37<1:09:37,  1.63it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.63946533203125, 'learning_rate': 7.74690941283589e-06, 'epoch': 1.15}

 38%|███▊      | 4236/11049 [43:37<1:09:37,  1.63it/s]
 38%|███▊      | 4237/11049 [43:37<1:09:36,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.6180020570755005, 'learning_rate': 7.745589371840676e-06, 'epoch': 1.15}

 38%|███▊      | 4237/11049 [43:38<1:09:36,  1.63it/s]
 38%|███▊      | 4238/11049 [43:38<1:09:36,  1.63it/s]
                                                      
{'loss': 0.2146, 'grad_norm': 0.5286150574684143, 'learning_rate': 7.744269056806009e-06, 'epoch': 1.15}

 38%|███▊      | 4238/11049 [43:38<1:09:36,  1.63it/s]
 38%|███▊      | 4239/11049 [43:39<1:09:34,  1.63it/s]
                                                      
{'loss': 0.2108, 'grad_norm': 0.5243269205093384, 'learning_rate': 7.742948467863668e-06, 'epoch': 1.15}

 38%|███▊      | 4239/11049 [43:39<1:09:34,  1.63it/s]
 38%|███▊      | 4240/11049 [43:39<1:09:34,  1.63it/s]
                                                      
{'loss': 0.1921, 'grad_norm': 0.5336330533027649, 'learning_rate': 7.74162760514546e-06, 'epoch': 1.15}

 38%|███▊      | 4240/11049 [43:39<1:09:34,  1.63it/s]
 38%|███▊      | 4241/11049 [43:40<1:09:36,  1.63it/s]
                                                      
{'loss': 0.2084, 'grad_norm': 0.5630667805671692, 'learning_rate': 7.740306468783226e-06, 'epoch': 1.15}

 38%|███▊      | 4241/11049 [43:40<1:09:36,  1.63it/s]
 38%|███▊      | 4242/11049 [43:41<1:09:35,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.5551477670669556, 'learning_rate': 7.738985058908826e-06, 'epoch': 1.15}

 38%|███▊      | 4242/11049 [43:41<1:09:35,  1.63it/s]
 38%|███▊      | 4243/11049 [43:41<1:09:33,  1.63it/s]
                                                      
{'loss': 0.1848, 'grad_norm': 0.5668731331825256, 'learning_rate': 7.737663375654155e-06, 'epoch': 1.15}

 38%|███▊      | 4243/11049 [43:41<1:09:33,  1.63it/s]
 38%|███▊      | 4244/11049 [43:42<1:09:33,  1.63it/s]
                                                      
{'loss': 0.2449, 'grad_norm': 0.5486409664154053, 'learning_rate': 7.736341419151126e-06, 'epoch': 1.15}

 38%|███▊      | 4244/11049 [43:42<1:09:33,  1.63it/s]
 38%|███▊      | 4245/11049 [43:42<1:09:32,  1.63it/s]
                                                      
{'loss': 0.2004, 'grad_norm': 0.4944727122783661, 'learning_rate': 7.735019189531689e-06, 'epoch': 1.15}

 38%|███▊      | 4245/11049 [43:42<1:09:32,  1.63it/s]
 38%|███▊      | 4246/11049 [43:43<1:09:32,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.4972652196884155, 'learning_rate': 7.733696686927814e-06, 'epoch': 1.15}

 38%|███▊      | 4246/11049 [43:43<1:09:32,  1.63it/s]
 38%|███▊      | 4247/11049 [43:44<1:09:29,  1.63it/s]
                                                      
{'loss': 0.1622, 'grad_norm': 0.4978783130645752, 'learning_rate': 7.732373911471504e-06, 'epoch': 1.15}

 38%|███▊      | 4247/11049 [43:44<1:09:29,  1.63it/s]
 38%|███▊      | 4248/11049 [43:44<1:09:29,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.539028525352478, 'learning_rate': 7.731050863294782e-06, 'epoch': 1.15}

 38%|███▊      | 4248/11049 [43:44<1:09:29,  1.63it/s]
 38%|███▊      | 4249/11049 [43:45<1:09:27,  1.63it/s]
                                                      
{'loss': 0.184, 'grad_norm': 0.47125643491744995, 'learning_rate': 7.729727542529707e-06, 'epoch': 1.15}

 38%|███▊      | 4249/11049 [43:45<1:09:27,  1.63it/s]
 38%|███▊      | 4250/11049 [43:45<1:09:26,  1.63it/s]
                                                      
{'loss': 0.2364, 'grad_norm': 0.5814908742904663, 'learning_rate': 7.728403949308356e-06, 'epoch': 1.15}

 38%|███▊      | 4250/11049 [43:46<1:09:26,  1.63it/s]
 38%|███▊      | 4251/11049 [43:46<1:09:39,  1.63it/s]
                                                      
{'loss': 0.2126, 'grad_norm': 0.6158855557441711, 'learning_rate': 7.727080083762844e-06, 'epoch': 1.15}

 38%|███▊      | 4251/11049 [43:46<1:09:39,  1.63it/s]
 38%|███▊      | 4252/11049 [43:47<1:09:36,  1.63it/s]
                                                      
{'loss': 0.269, 'grad_norm': 0.6344090104103088, 'learning_rate': 7.7257559460253e-06, 'epoch': 1.15}

 38%|███▊      | 4252/11049 [43:47<1:09:36,  1.63it/s]
 38%|███▊      | 4253/11049 [43:47<1:09:35,  1.63it/s]
                                                      
{'loss': 0.1614, 'grad_norm': 0.48586907982826233, 'learning_rate': 7.724431536227892e-06, 'epoch': 1.15}

 38%|███▊      | 4253/11049 [43:47<1:09:35,  1.63it/s]
 39%|███▊      | 4254/11049 [43:48<1:09:32,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.6269173622131348, 'learning_rate': 7.72310685450281e-06, 'epoch': 1.16}

 39%|███▊      | 4254/11049 [43:48<1:09:32,  1.63it/s]
 39%|███▊      | 4255/11049 [43:48<1:09:29,  1.63it/s]
                                                      
{'loss': 0.1499, 'grad_norm': 0.4570375978946686, 'learning_rate': 7.721781900982269e-06, 'epoch': 1.16}

 39%|███▊      | 4255/11049 [43:49<1:09:29,  1.63it/s]
 39%|███▊      | 4256/11049 [43:49<1:09:26,  1.63it/s]
                                                      
{'loss': 0.2457, 'grad_norm': 0.6054773330688477, 'learning_rate': 7.720456675798516e-06, 'epoch': 1.16}

 39%|███▊      | 4256/11049 [43:49<1:09:26,  1.63it/s]
 39%|███▊      | 4257/11049 [43:50<1:09:28,  1.63it/s]
                                                      
{'loss': 0.2358, 'grad_norm': 0.7983733415603638, 'learning_rate': 7.719131179083822e-06, 'epoch': 1.16}

 39%|███▊      | 4257/11049 [43:50<1:09:28,  1.63it/s]
 39%|███▊      | 4258/11049 [43:50<1:09:26,  1.63it/s]
                                                      
{'loss': 0.2276, 'grad_norm': 0.6083002686500549, 'learning_rate': 7.717805410970487e-06, 'epoch': 1.16}

 39%|███▊      | 4258/11049 [43:50<1:09:26,  1.63it/s]
 39%|███▊      | 4259/11049 [43:51<1:09:24,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.47636327147483826, 'learning_rate': 7.716479371590836e-06, 'epoch': 1.16}

 39%|███▊      | 4259/11049 [43:51<1:09:24,  1.63it/s]
 39%|███▊      | 4260/11049 [43:52<1:09:24,  1.63it/s]
                                                      
{'loss': 0.2061, 'grad_norm': 0.5565845966339111, 'learning_rate': 7.71515306107722e-06, 'epoch': 1.16}

 39%|███▊      | 4260/11049 [43:52<1:09:24,  1.63it/s]
 39%|███▊      | 4261/11049 [43:52<1:09:22,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.6390625834465027, 'learning_rate': 7.713826479562021e-06, 'epoch': 1.16}

 39%|███▊      | 4261/11049 [43:52<1:09:22,  1.63it/s]
 39%|███▊      | 4262/11049 [43:53<1:09:21,  1.63it/s]
                                                      
{'loss': 0.2525, 'grad_norm': 0.5980818271636963, 'learning_rate': 7.712499627177648e-06, 'epoch': 1.16}

 39%|███▊      | 4262/11049 [43:53<1:09:21,  1.63it/s]
 39%|███▊      | 4263/11049 [43:53<1:09:22,  1.63it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.5382553339004517, 'learning_rate': 7.711172504056534e-06, 'epoch': 1.16}

 39%|███▊      | 4263/11049 [43:54<1:09:22,  1.63it/s]
 39%|███▊      | 4264/11049 [43:54<1:09:22,  1.63it/s]
                                                      
{'loss': 0.2306, 'grad_norm': 0.5790070295333862, 'learning_rate': 7.709845110331137e-06, 'epoch': 1.16}

 39%|███▊      | 4264/11049 [43:54<1:09:22,  1.63it/s]
 39%|███▊      | 4265/11049 [43:55<1:09:25,  1.63it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.4835973083972931, 'learning_rate': 7.708517446133951e-06, 'epoch': 1.16}

 39%|███▊      | 4265/11049 [43:55<1:09:25,  1.63it/s]
 39%|███▊      | 4266/11049 [43:55<1:09:24,  1.63it/s]
                                                      
{'loss': 0.207, 'grad_norm': 0.4970509707927704, 'learning_rate': 7.707189511597486e-06, 'epoch': 1.16}

 39%|███▊      | 4266/11049 [43:55<1:09:24,  1.63it/s]
 39%|███▊      | 4267/11049 [43:56<1:09:22,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.48821961879730225, 'learning_rate': 7.705861306854287e-06, 'epoch': 1.16}

 39%|███▊      | 4267/11049 [43:56<1:09:22,  1.63it/s]
 39%|███▊      | 4268/11049 [43:56<1:09:22,  1.63it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.6023091673851013, 'learning_rate': 7.704532832036923e-06, 'epoch': 1.16}

 39%|███▊      | 4268/11049 [43:57<1:09:22,  1.63it/s]
 39%|███▊      | 4269/11049 [43:57<1:09:20,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.6111170649528503, 'learning_rate': 7.703204087277989e-06, 'epoch': 1.16}

 39%|███▊      | 4269/11049 [43:57<1:09:20,  1.63it/s]
 39%|███▊      | 4270/11049 [43:58<1:09:18,  1.63it/s]
                                                      
{'loss': 0.2531, 'grad_norm': 0.6566867828369141, 'learning_rate': 7.701875072710108e-06, 'epoch': 1.16}

 39%|███▊      | 4270/11049 [43:58<1:09:18,  1.63it/s]
 39%|███▊      | 4271/11049 [43:58<1:09:16,  1.63it/s]
                                                      
{'loss': 0.1876, 'grad_norm': 0.5630134344100952, 'learning_rate': 7.700545788465932e-06, 'epoch': 1.16}

 39%|███▊      | 4271/11049 [43:58<1:09:16,  1.63it/s]
 39%|███▊      | 4272/11049 [43:59<1:09:15,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5006027817726135, 'learning_rate': 7.699216234678135e-06, 'epoch': 1.16}

 39%|███▊      | 4272/11049 [43:59<1:09:15,  1.63it/s]
 39%|███▊      | 4273/11049 [44:00<1:09:15,  1.63it/s]
                                                      
{'loss': 0.2367, 'grad_norm': 0.5781633853912354, 'learning_rate': 7.697886411479422e-06, 'epoch': 1.16}

 39%|███▊      | 4273/11049 [44:00<1:09:15,  1.63it/s]
 39%|███▊      | 4274/11049 [44:00<1:09:13,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5498040914535522, 'learning_rate': 7.696556319002526e-06, 'epoch': 1.16}

 39%|███▊      | 4274/11049 [44:00<1:09:13,  1.63it/s]
 39%|███▊      | 4275/11049 [44:01<1:09:12,  1.63it/s]
                                                      
{'loss': 0.2114, 'grad_norm': 0.4943978488445282, 'learning_rate': 7.695225957380204e-06, 'epoch': 1.16}

 39%|███▊      | 4275/11049 [44:01<1:09:12,  1.63it/s]
 39%|███▊      | 4276/11049 [44:01<1:09:12,  1.63it/s]
                                                      
{'loss': 0.2518, 'grad_norm': 0.6815373301506042, 'learning_rate': 7.693895326745235e-06, 'epoch': 1.16}

 39%|███▊      | 4276/11049 [44:01<1:09:12,  1.63it/s]
 39%|███▊      | 4277/11049 [44:02<1:09:11,  1.63it/s]
                                                      
{'loss': 0.2392, 'grad_norm': 0.5935258269309998, 'learning_rate': 7.692564427230438e-06, 'epoch': 1.16}

 39%|███▊      | 4277/11049 [44:02<1:09:11,  1.63it/s]
 39%|███▊      | 4278/11049 [44:03<1:09:10,  1.63it/s]
                                                      
{'loss': 0.181, 'grad_norm': 0.5141805410385132, 'learning_rate': 7.691233258968647e-06, 'epoch': 1.16}

 39%|███▊      | 4278/11049 [44:03<1:09:10,  1.63it/s]
 39%|███▊      | 4279/11049 [44:03<1:09:09,  1.63it/s]
                                                      
{'loss': 0.2092, 'grad_norm': 0.513318657875061, 'learning_rate': 7.689901822092726e-06, 'epoch': 1.16}

 39%|███▊      | 4279/11049 [44:03<1:09:09,  1.63it/s]
 39%|███▊      | 4280/11049 [44:04<1:09:10,  1.63it/s]
                                                      
{'loss': 0.1902, 'grad_norm': 0.5536207556724548, 'learning_rate': 7.688570116735568e-06, 'epoch': 1.16}

 39%|███▊      | 4280/11049 [44:04<1:09:10,  1.63it/s]
 39%|███▊      | 4281/11049 [44:04<1:09:10,  1.63it/s]
                                                      
{'loss': 0.1957, 'grad_norm': 0.4963573217391968, 'learning_rate': 7.687238143030094e-06, 'epoch': 1.16}

 39%|███▊      | 4281/11049 [44:05<1:09:10,  1.63it/s]
 39%|███▉      | 4282/11049 [44:05<1:09:10,  1.63it/s]
                                                      
{'loss': 0.2324, 'grad_norm': 0.5960896611213684, 'learning_rate': 7.685905901109246e-06, 'epoch': 1.16}

 39%|███▉      | 4282/11049 [44:05<1:09:10,  1.63it/s]
 39%|███▉      | 4283/11049 [44:06<1:09:09,  1.63it/s]
                                                      
{'loss': 0.271, 'grad_norm': 0.648073136806488, 'learning_rate': 7.684573391105998e-06, 'epoch': 1.16}

 39%|███▉      | 4283/11049 [44:06<1:09:09,  1.63it/s]
 39%|███▉      | 4284/11049 [44:06<1:09:10,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.4722329080104828, 'learning_rate': 7.683240613153346e-06, 'epoch': 1.16}

 39%|███▉      | 4284/11049 [44:06<1:09:10,  1.63it/s]
 39%|███▉      | 4285/11049 [44:07<1:09:07,  1.63it/s]
                                                      
{'loss': 0.2011, 'grad_norm': 0.5792984962463379, 'learning_rate': 7.681907567384321e-06, 'epoch': 1.16}

 39%|███▉      | 4285/11049 [44:07<1:09:07,  1.63it/s]
 39%|███▉      | 4286/11049 [44:08<1:09:05,  1.63it/s]
                                                      
{'loss': 0.2496, 'grad_norm': 0.5474792718887329, 'learning_rate': 7.68057425393197e-06, 'epoch': 1.16}

 39%|███▉      | 4286/11049 [44:08<1:09:05,  1.63it/s]
 39%|███▉      | 4287/11049 [44:08<1:09:04,  1.63it/s]
                                                      
{'loss': 0.1651, 'grad_norm': 0.47078222036361694, 'learning_rate': 7.679240672929376e-06, 'epoch': 1.16}

 39%|███▉      | 4287/11049 [44:08<1:09:04,  1.63it/s]
 39%|███▉      | 4288/11049 [44:09<1:09:06,  1.63it/s]
                                                      
{'loss': 0.2422, 'grad_norm': 0.5572673678398132, 'learning_rate': 7.677906824509643e-06, 'epoch': 1.16}

 39%|███▉      | 4288/11049 [44:09<1:09:06,  1.63it/s]
 39%|███▉      | 4289/11049 [44:09<1:09:07,  1.63it/s]
                                                      
{'loss': 0.1877, 'grad_norm': 0.45950019359588623, 'learning_rate': 7.676572708805902e-06, 'epoch': 1.16}

 39%|███▉      | 4289/11049 [44:09<1:09:07,  1.63it/s]
 39%|███▉      | 4290/11049 [44:10<1:09:07,  1.63it/s]
                                                      
{'loss': 0.271, 'grad_norm': 0.6619628667831421, 'learning_rate': 7.675238325951314e-06, 'epoch': 1.16}

 39%|███▉      | 4290/11049 [44:10<1:09:07,  1.63it/s]
 39%|███▉      | 4291/11049 [44:11<1:09:06,  1.63it/s]
                                                      
{'loss': 0.2069, 'grad_norm': 0.5098605155944824, 'learning_rate': 7.673903676079063e-06, 'epoch': 1.17}

 39%|███▉      | 4291/11049 [44:11<1:09:06,  1.63it/s]
 39%|███▉      | 4292/11049 [44:11<1:09:04,  1.63it/s]
                                                      
{'loss': 0.2559, 'grad_norm': 0.6017024517059326, 'learning_rate': 7.672568759322366e-06, 'epoch': 1.17}

 39%|███▉      | 4292/11049 [44:11<1:09:04,  1.63it/s]
 39%|███▉      | 4293/11049 [44:12<1:09:05,  1.63it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.6248812079429626, 'learning_rate': 7.671233575814458e-06, 'epoch': 1.17}

 39%|███▉      | 4293/11049 [44:12<1:09:05,  1.63it/s]
 39%|███▉      | 4294/11049 [44:12<1:09:02,  1.63it/s]
                                                      
{'loss': 0.2055, 'grad_norm': 0.5806245803833008, 'learning_rate': 7.669898125688606e-06, 'epoch': 1.17}

 39%|███▉      | 4294/11049 [44:13<1:09:02,  1.63it/s]
 39%|███▉      | 4295/11049 [44:13<1:09:03,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.6512317061424255, 'learning_rate': 7.668562409078102e-06, 'epoch': 1.17}

 39%|███▉      | 4295/11049 [44:13<1:09:03,  1.63it/s]
 39%|███▉      | 4296/11049 [44:14<1:09:02,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.5796682834625244, 'learning_rate': 7.667226426116266e-06, 'epoch': 1.17}

 39%|███▉      | 4296/11049 [44:14<1:09:02,  1.63it/s]
 39%|███▉      | 4297/11049 [44:14<1:09:03,  1.63it/s]
                                                      
{'loss': 0.2919, 'grad_norm': 0.7546318173408508, 'learning_rate': 7.665890176936441e-06, 'epoch': 1.17}

 39%|███▉      | 4297/11049 [44:14<1:09:03,  1.63it/s]
 39%|███▉      | 4298/11049 [44:15<1:09:03,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.48287224769592285, 'learning_rate': 7.664553661672e-06, 'epoch': 1.17}

 39%|███▉      | 4298/11049 [44:15<1:09:03,  1.63it/s]
 39%|███▉      | 4299/11049 [44:15<1:09:03,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.5246557593345642, 'learning_rate': 7.663216880456344e-06, 'epoch': 1.17}

 39%|███▉      | 4299/11049 [44:16<1:09:03,  1.63it/s]
 39%|███▉      | 4300/11049 [44:16<1:09:01,  1.63it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.5534176826477051, 'learning_rate': 7.661879833422896e-06, 'epoch': 1.17}

 39%|███▉      | 4300/11049 [44:16<1:09:01,  1.63it/s]
 39%|███▉      | 4301/11049 [44:17<1:09:00,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.5061852931976318, 'learning_rate': 7.660542520705109e-06, 'epoch': 1.17}

 39%|███▉      | 4301/11049 [44:17<1:09:00,  1.63it/s]
 39%|███▉      | 4302/11049 [44:17<1:08:58,  1.63it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.6126125454902649, 'learning_rate': 7.65920494243646e-06, 'epoch': 1.17}

 39%|███▉      | 4302/11049 [44:17<1:08:58,  1.63it/s]
 39%|███▉      | 4303/11049 [44:18<1:08:57,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.5137506127357483, 'learning_rate': 7.657867098750453e-06, 'epoch': 1.17}

 39%|███▉      | 4303/11049 [44:18<1:08:57,  1.63it/s]
 39%|███▉      | 4304/11049 [44:19<1:08:56,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.4762806296348572, 'learning_rate': 7.656528989780623e-06, 'epoch': 1.17}

 39%|███▉      | 4304/11049 [44:19<1:08:56,  1.63it/s]
 39%|███▉      | 4305/11049 [44:19<1:08:57,  1.63it/s]
                                                      
{'loss': 0.1945, 'grad_norm': 0.4987007975578308, 'learning_rate': 7.655190615660524e-06, 'epoch': 1.17}

 39%|███▉      | 4305/11049 [44:19<1:08:57,  1.63it/s]
 39%|███▉      | 4306/11049 [44:20<1:08:58,  1.63it/s]
                                                      
{'loss': 0.1745, 'grad_norm': 0.43523845076560974, 'learning_rate': 7.65385197652374e-06, 'epoch': 1.17}

 39%|███▉      | 4306/11049 [44:20<1:08:58,  1.63it/s]
 39%|███▉      | 4307/11049 [44:20<1:08:58,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5276294350624084, 'learning_rate': 7.652513072503885e-06, 'epoch': 1.17}

 39%|███▉      | 4307/11049 [44:21<1:08:58,  1.63it/s]
 39%|███▉      | 4308/11049 [44:21<1:08:56,  1.63it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.4667138159275055, 'learning_rate': 7.651173903734591e-06, 'epoch': 1.17}

 39%|███▉      | 4308/11049 [44:21<1:08:56,  1.63it/s]
 39%|███▉      | 4309/11049 [44:22<1:08:57,  1.63it/s]
                                                      
{'loss': 0.2825, 'grad_norm': 0.5650994777679443, 'learning_rate': 7.649834470349529e-06, 'epoch': 1.17}

 39%|███▉      | 4309/11049 [44:22<1:08:57,  1.63it/s]
 39%|███▉      | 4310/11049 [44:22<1:08:58,  1.63it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.5138174295425415, 'learning_rate': 7.648494772482383e-06, 'epoch': 1.17}

 39%|███▉      | 4310/11049 [44:22<1:08:58,  1.63it/s]
 39%|███▉      | 4311/11049 [44:23<1:08:57,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5308873057365417, 'learning_rate': 7.647154810266868e-06, 'epoch': 1.17}

 39%|███▉      | 4311/11049 [44:23<1:08:57,  1.63it/s]
 39%|███▉      | 4312/11049 [44:23<1:08:54,  1.63it/s]
                                                      
{'loss': 0.1792, 'grad_norm': 0.4842744469642639, 'learning_rate': 7.645814583836733e-06, 'epoch': 1.17}

 39%|███▉      | 4312/11049 [44:24<1:08:54,  1.63it/s]
 39%|███▉      | 4313/11049 [44:24<1:08:53,  1.63it/s]
                                                      
{'loss': 0.1851, 'grad_norm': 0.5372242331504822, 'learning_rate': 7.644474093325743e-06, 'epoch': 1.17}

 39%|███▉      | 4313/11049 [44:24<1:08:53,  1.63it/s]
 39%|███▉      | 4314/11049 [44:25<1:08:52,  1.63it/s]
                                                      
{'loss': 0.1765, 'grad_norm': 0.5252461433410645, 'learning_rate': 7.643133338867692e-06, 'epoch': 1.17}

 39%|███▉      | 4314/11049 [44:25<1:08:52,  1.63it/s]
 39%|███▉      | 4315/11049 [44:25<1:09:14,  1.62it/s]
                                                      
{'loss': 0.2726, 'grad_norm': 0.7742289304733276, 'learning_rate': 7.641792320596406e-06, 'epoch': 1.17}

 39%|███▉      | 4315/11049 [44:25<1:09:14,  1.62it/s]
 39%|███▉      | 4316/11049 [44:26<1:09:04,  1.62it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.5676321387290955, 'learning_rate': 7.64045103864573e-06, 'epoch': 1.17}

 39%|███▉      | 4316/11049 [44:26<1:09:04,  1.62it/s]
 39%|███▉      | 4317/11049 [44:27<1:08:59,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5093878507614136, 'learning_rate': 7.639109493149537e-06, 'epoch': 1.17}

 39%|███▉      | 4317/11049 [44:27<1:08:59,  1.63it/s]
 39%|███▉      | 4318/11049 [44:27<1:08:54,  1.63it/s]
                                                      
{'loss': 0.1942, 'grad_norm': 0.5161285400390625, 'learning_rate': 7.637767684241732e-06, 'epoch': 1.17}

 39%|███▉      | 4318/11049 [44:27<1:08:54,  1.63it/s]
 39%|███▉      | 4319/11049 [44:28<1:08:51,  1.63it/s]
                                                      
{'loss': 0.1869, 'grad_norm': 0.5489810109138489, 'learning_rate': 7.636425612056242e-06, 'epoch': 1.17}

 39%|███▉      | 4319/11049 [44:28<1:08:51,  1.63it/s]
 39%|███▉      | 4320/11049 [44:28<1:08:54,  1.63it/s]
                                                      
{'loss': 0.2223, 'grad_norm': 0.6075169444084167, 'learning_rate': 7.635083276727015e-06, 'epoch': 1.17}

 39%|███▉      | 4320/11049 [44:29<1:08:54,  1.63it/s]
 39%|███▉      | 4321/11049 [44:29<1:08:53,  1.63it/s]
                                                      
{'loss': 0.1962, 'grad_norm': 0.5483154654502869, 'learning_rate': 7.633740678388036e-06, 'epoch': 1.17}

 39%|███▉      | 4321/11049 [44:29<1:08:53,  1.63it/s]
 39%|███▉      | 4322/11049 [44:30<1:08:52,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.4442942142486572, 'learning_rate': 7.632397817173306e-06, 'epoch': 1.17}

 39%|███▉      | 4322/11049 [44:30<1:08:52,  1.63it/s]
 39%|███▉      | 4323/11049 [44:30<1:08:49,  1.63it/s]
                                                      
{'loss': 0.2666, 'grad_norm': 0.6941683888435364, 'learning_rate': 7.631054693216865e-06, 'epoch': 1.17}

 39%|███▉      | 4323/11049 [44:30<1:08:49,  1.63it/s]
 39%|███▉      | 4324/11049 [44:31<1:08:46,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.4977996051311493, 'learning_rate': 7.62971130665276e-06, 'epoch': 1.17}

 39%|███▉      | 4324/11049 [44:31<1:08:46,  1.63it/s]
 39%|███▉      | 4325/11049 [44:31<1:08:50,  1.63it/s]
                                                      
{'loss': 0.279, 'grad_norm': 0.6458525061607361, 'learning_rate': 7.628367657615084e-06, 'epoch': 1.17}

 39%|███▉      | 4325/11049 [44:32<1:08:50,  1.63it/s]
 39%|███▉      | 4326/11049 [44:32<1:08:46,  1.63it/s]
                                                      
{'loss': 0.2236, 'grad_norm': 0.5405907034873962, 'learning_rate': 7.627023746237946e-06, 'epoch': 1.17}

 39%|███▉      | 4326/11049 [44:32<1:08:46,  1.63it/s]
 39%|███▉      | 4327/11049 [44:33<1:08:44,  1.63it/s]
                                                      
{'loss': 0.1972, 'grad_norm': 0.5918470621109009, 'learning_rate': 7.62567957265548e-06, 'epoch': 1.17}

 39%|███▉      | 4327/11049 [44:33<1:08:44,  1.63it/s]
 39%|███▉      | 4328/11049 [44:33<1:08:43,  1.63it/s]
                                                      
{'loss': 0.192, 'grad_norm': 0.5656163692474365, 'learning_rate': 7.624335137001854e-06, 'epoch': 1.18}

 39%|███▉      | 4328/11049 [44:33<1:08:43,  1.63it/s]
 39%|███▉      | 4329/11049 [44:34<1:08:42,  1.63it/s]
                                                      
{'loss': 0.2236, 'grad_norm': 0.515961766242981, 'learning_rate': 7.622990439411251e-06, 'epoch': 1.18}

 39%|███▉      | 4329/11049 [44:34<1:08:42,  1.63it/s]
 39%|███▉      | 4330/11049 [44:35<1:08:47,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.6233136057853699, 'learning_rate': 7.621645480017892e-06, 'epoch': 1.18}

 39%|███▉      | 4330/11049 [44:35<1:08:47,  1.63it/s]
 39%|███▉      | 4331/11049 [44:35<1:08:43,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5622958540916443, 'learning_rate': 7.6203002589560135e-06, 'epoch': 1.18}

 39%|███▉      | 4331/11049 [44:35<1:08:43,  1.63it/s]
 39%|███▉      | 4332/11049 [44:36<1:08:42,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.4175697863101959, 'learning_rate': 7.618954776359888e-06, 'epoch': 1.18}

 39%|███▉      | 4332/11049 [44:36<1:08:42,  1.63it/s]
 39%|███▉      | 4333/11049 [44:36<1:08:41,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.4587661325931549, 'learning_rate': 7.617609032363806e-06, 'epoch': 1.18}

 39%|███▉      | 4333/11049 [44:36<1:08:41,  1.63it/s]
 39%|███▉      | 4334/11049 [44:37<1:08:37,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5377348065376282, 'learning_rate': 7.616263027102088e-06, 'epoch': 1.18}

 39%|███▉      | 4334/11049 [44:37<1:08:37,  1.63it/s]
 39%|███▉      | 4335/11049 [44:38<1:08:44,  1.63it/s]
                                                      
{'loss': 0.2516, 'grad_norm': 0.6148964166641235, 'learning_rate': 7.614916760709079e-06, 'epoch': 1.18}

 39%|███▉      | 4335/11049 [44:38<1:08:44,  1.63it/s]
 39%|███▉      | 4336/11049 [44:38<1:08:42,  1.63it/s]
                                                      
{'loss': 0.2342, 'grad_norm': 0.5678823590278625, 'learning_rate': 7.613570233319153e-06, 'epoch': 1.18}

 39%|███▉      | 4336/11049 [44:38<1:08:42,  1.63it/s]
 39%|███▉      | 4337/11049 [44:39<1:08:39,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.6506397724151611, 'learning_rate': 7.612223445066706e-06, 'epoch': 1.18}

 39%|███▉      | 4337/11049 [44:39<1:08:39,  1.63it/s]
 39%|███▉      | 4338/11049 [44:39<1:08:37,  1.63it/s]
                                                      
{'loss': 0.2331, 'grad_norm': 0.5340278744697571, 'learning_rate': 7.610876396086164e-06, 'epoch': 1.18}

 39%|███▉      | 4338/11049 [44:40<1:08:37,  1.63it/s]
 39%|███▉      | 4339/11049 [44:40<1:08:38,  1.63it/s]
                                                      
{'loss': 0.2224, 'grad_norm': 0.5980562567710876, 'learning_rate': 7.609529086511974e-06, 'epoch': 1.18}

 39%|███▉      | 4339/11049 [44:40<1:08:38,  1.63it/s]
 39%|███▉      | 4340/11049 [44:41<1:08:59,  1.62it/s]
                                                      
{'loss': 0.2378, 'grad_norm': 0.5628465414047241, 'learning_rate': 7.608181516478616e-06, 'epoch': 1.18}

 39%|███▉      | 4340/11049 [44:41<1:08:59,  1.62it/s]
 39%|███▉      | 4341/11049 [44:41<1:08:49,  1.62it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.6333364844322205, 'learning_rate': 7.606833686120588e-06, 'epoch': 1.18}

 39%|███▉      | 4341/11049 [44:41<1:08:49,  1.62it/s]
 39%|███▉      | 4342/11049 [44:42<1:08:44,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.5459972023963928, 'learning_rate': 7.605485595572421e-06, 'epoch': 1.18}

 39%|███▉      | 4342/11049 [44:42<1:08:44,  1.63it/s]
 39%|███▉      | 4343/11049 [44:42<1:08:39,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5009855628013611, 'learning_rate': 7.6041372449686675e-06, 'epoch': 1.18}

 39%|███▉      | 4343/11049 [44:43<1:08:39,  1.63it/s]
 39%|███▉      | 4344/11049 [44:43<1:08:36,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5980721712112427, 'learning_rate': 7.6027886344439075e-06, 'epoch': 1.18}

 39%|███▉      | 4344/11049 [44:43<1:08:36,  1.63it/s]
 39%|███▉      | 4345/11049 [44:44<1:08:40,  1.63it/s]
                                                      
{'loss': 0.2205, 'grad_norm': 0.5172220468521118, 'learning_rate': 7.6014397641327474e-06, 'epoch': 1.18}

 39%|███▉      | 4345/11049 [44:44<1:08:40,  1.63it/s]
 39%|███▉      | 4346/11049 [44:44<1:08:44,  1.63it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.5626100301742554, 'learning_rate': 7.600090634169821e-06, 'epoch': 1.18}

 39%|███▉      | 4346/11049 [44:44<1:08:44,  1.63it/s]
 39%|███▉      | 4347/11049 [44:45<1:08:38,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.6101366877555847, 'learning_rate': 7.59874124468978e-06, 'epoch': 1.18}

 39%|███▉      | 4347/11049 [44:45<1:08:38,  1.63it/s]
 39%|███▉      | 4348/11049 [44:46<1:08:34,  1.63it/s]
                                                      
{'loss': 0.2245, 'grad_norm': 0.5525906085968018, 'learning_rate': 7.5973915958273144e-06, 'epoch': 1.18}

 39%|███▉      | 4348/11049 [44:46<1:08:34,  1.63it/s]
 39%|███▉      | 4349/11049 [44:46<1:08:33,  1.63it/s]
                                                      
{'loss': 0.245, 'grad_norm': 0.599610447883606, 'learning_rate': 7.59604168771713e-06, 'epoch': 1.18}

 39%|███▉      | 4349/11049 [44:46<1:08:33,  1.63it/s]
 39%|███▉      | 4350/11049 [44:47<1:08:29,  1.63it/s]
                                                      
{'loss': 0.2402, 'grad_norm': 0.609758734703064, 'learning_rate': 7.594691520493965e-06, 'epoch': 1.18}

 39%|███▉      | 4350/11049 [44:47<1:08:29,  1.63it/s]
 39%|███▉      | 4351/11049 [44:47<1:08:30,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.5107961893081665, 'learning_rate': 7.593341094292579e-06, 'epoch': 1.18}

 39%|███▉      | 4351/11049 [44:48<1:08:30,  1.63it/s]
 39%|███▉      | 4352/11049 [44:48<1:08:29,  1.63it/s]
                                                      
{'loss': 0.1894, 'grad_norm': 0.5032781362533569, 'learning_rate': 7.591990409247758e-06, 'epoch': 1.18}

 39%|███▉      | 4352/11049 [44:48<1:08:29,  1.63it/s]
 39%|███▉      | 4353/11049 [44:49<1:08:28,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.5200033783912659, 'learning_rate': 7.590639465494316e-06, 'epoch': 1.18}

 39%|███▉      | 4353/11049 [44:49<1:08:28,  1.63it/s]
 39%|███▉      | 4354/11049 [44:49<1:08:27,  1.63it/s]
                                                      
{'loss': 0.2401, 'grad_norm': 0.6017165780067444, 'learning_rate': 7.589288263167094e-06, 'epoch': 1.18}

 39%|███▉      | 4354/11049 [44:49<1:08:27,  1.63it/s]
 39%|███▉      | 4355/11049 [44:50<1:08:26,  1.63it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.6570402383804321, 'learning_rate': 7.5879368024009525e-06, 'epoch': 1.18}

 39%|███▉      | 4355/11049 [44:50<1:08:26,  1.63it/s]
 39%|███▉      | 4356/11049 [44:50<1:08:24,  1.63it/s]
                                                      
{'loss': 0.2492, 'grad_norm': 0.6045525670051575, 'learning_rate': 7.5865850833307855e-06, 'epoch': 1.18}

 39%|███▉      | 4356/11049 [44:51<1:08:24,  1.63it/s]
 39%|███▉      | 4357/11049 [44:51<1:08:22,  1.63it/s]
                                                      
{'loss': 0.2042, 'grad_norm': 0.5748217701911926, 'learning_rate': 7.585233106091505e-06, 'epoch': 1.18}

 39%|███▉      | 4357/11049 [44:51<1:08:22,  1.63it/s]
 39%|███▉      | 4358/11049 [44:52<1:08:21,  1.63it/s]
                                                      
{'loss': 0.2382, 'grad_norm': 0.5561169981956482, 'learning_rate': 7.583880870818059e-06, 'epoch': 1.18}

 39%|███▉      | 4358/11049 [44:52<1:08:21,  1.63it/s]
 39%|███▉      | 4359/11049 [44:52<1:08:20,  1.63it/s]
                                                      
{'loss': 0.2059, 'grad_norm': 0.5085113048553467, 'learning_rate': 7.582528377645408e-06, 'epoch': 1.18}

 39%|███▉      | 4359/11049 [44:52<1:08:20,  1.63it/s]
 39%|███▉      | 4360/11049 [44:53<1:08:20,  1.63it/s]
                                                      
{'loss': 0.2428, 'grad_norm': 0.5380871891975403, 'learning_rate': 7.581175626708552e-06, 'epoch': 1.18}

 39%|███▉      | 4360/11049 [44:53<1:08:20,  1.63it/s]
 39%|███▉      | 4361/11049 [44:54<1:08:22,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.4160340428352356, 'learning_rate': 7.579822618142505e-06, 'epoch': 1.18}

 39%|███▉      | 4361/11049 [44:54<1:08:22,  1.63it/s]
 39%|███▉      | 4362/11049 [44:54<1:08:21,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.5245394110679626, 'learning_rate': 7.578469352082316e-06, 'epoch': 1.18}

 39%|███▉      | 4362/11049 [44:54<1:08:21,  1.63it/s]
 39%|███▉      | 4363/11049 [44:55<1:08:22,  1.63it/s]
                                                      
{'loss': 0.2071, 'grad_norm': 0.583280622959137, 'learning_rate': 7.5771158286630515e-06, 'epoch': 1.18}

 39%|███▉      | 4363/11049 [44:55<1:08:22,  1.63it/s]
 39%|███▉      | 4364/11049 [44:55<1:08:21,  1.63it/s]
                                                      
{'loss': 0.1611, 'grad_norm': 0.46728771924972534, 'learning_rate': 7.575762048019812e-06, 'epoch': 1.18}

 39%|███▉      | 4364/11049 [44:56<1:08:21,  1.63it/s]
 40%|███▉      | 4365/11049 [44:56<1:08:20,  1.63it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.5625926852226257, 'learning_rate': 7.574408010287716e-06, 'epoch': 1.19}

 40%|███▉      | 4365/11049 [44:56<1:08:20,  1.63it/s]
 40%|███▉      | 4366/11049 [44:57<1:08:18,  1.63it/s]
                                                      
{'loss': 0.1558, 'grad_norm': 0.46371322870254517, 'learning_rate': 7.573053715601912e-06, 'epoch': 1.19}

 40%|███▉      | 4366/11049 [44:57<1:08:18,  1.63it/s]
 40%|███▉      | 4367/11049 [44:57<1:08:18,  1.63it/s]
                                                      
{'loss': 0.2025, 'grad_norm': 0.5101370215415955, 'learning_rate': 7.571699164097575e-06, 'epoch': 1.19}

 40%|███▉      | 4367/11049 [44:57<1:08:18,  1.63it/s]
 40%|███▉      | 4368/11049 [44:58<1:08:18,  1.63it/s]
                                                      
{'loss': 0.2707, 'grad_norm': 0.6011476516723633, 'learning_rate': 7.5703443559099025e-06, 'epoch': 1.19}

 40%|███▉      | 4368/11049 [44:58<1:08:18,  1.63it/s]
 40%|███▉      | 4369/11049 [44:58<1:08:17,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5984127521514893, 'learning_rate': 7.568989291174118e-06, 'epoch': 1.19}

 40%|███▉      | 4369/11049 [44:59<1:08:17,  1.63it/s]
 40%|███▉      | 4370/11049 [44:59<1:08:18,  1.63it/s]
                                                      
{'loss': 0.2497, 'grad_norm': 0.5932952761650085, 'learning_rate': 7.567633970025473e-06, 'epoch': 1.19}

 40%|███▉      | 4370/11049 [44:59<1:08:18,  1.63it/s]
 40%|███▉      | 4371/11049 [45:00<1:08:14,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.48823976516723633, 'learning_rate': 7.566278392599242e-06, 'epoch': 1.19}

 40%|███▉      | 4371/11049 [45:00<1:08:14,  1.63it/s]
 40%|███▉      | 4372/11049 [45:00<1:08:14,  1.63it/s]
                                                      
{'loss': 0.3413, 'grad_norm': 0.6642655730247498, 'learning_rate': 7.564922559030727e-06, 'epoch': 1.19}

 40%|███▉      | 4372/11049 [45:00<1:08:14,  1.63it/s]
 40%|███▉      | 4373/11049 [45:01<1:08:14,  1.63it/s]
                                                      
{'loss': 0.2164, 'grad_norm': 0.5846046209335327, 'learning_rate': 7.563566469455256e-06, 'epoch': 1.19}

 40%|███▉      | 4373/11049 [45:01<1:08:14,  1.63it/s]
 40%|███▉      | 4374/11049 [45:02<1:08:14,  1.63it/s]
                                                      
{'loss': 0.1712, 'grad_norm': 0.439765065908432, 'learning_rate': 7.562210124008179e-06, 'epoch': 1.19}

 40%|███▉      | 4374/11049 [45:02<1:08:14,  1.63it/s]
 40%|███▉      | 4375/11049 [45:02<1:08:12,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.5799733996391296, 'learning_rate': 7.560853522824876e-06, 'epoch': 1.19}

 40%|███▉      | 4375/11049 [45:02<1:08:12,  1.63it/s]
 40%|███▉      | 4376/11049 [45:03<1:08:11,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.6935736536979675, 'learning_rate': 7.559496666040749e-06, 'epoch': 1.19}

 40%|███▉      | 4376/11049 [45:03<1:08:11,  1.63it/s]
 40%|███▉      | 4377/11049 [45:03<1:08:10,  1.63it/s]
                                                      
{'loss': 0.2551, 'grad_norm': 0.6539218425750732, 'learning_rate': 7.558139553791227e-06, 'epoch': 1.19}

 40%|███▉      | 4377/11049 [45:03<1:08:10,  1.63it/s]
 40%|███▉      | 4378/11049 [45:04<1:08:09,  1.63it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.6152686476707458, 'learning_rate': 7.5567821862117665e-06, 'epoch': 1.19}

 40%|███▉      | 4378/11049 [45:04<1:08:09,  1.63it/s]
 40%|███▉      | 4379/11049 [45:05<1:08:09,  1.63it/s]
                                                      
{'loss': 0.2515, 'grad_norm': 0.6155552864074707, 'learning_rate': 7.555424563437843e-06, 'epoch': 1.19}

 40%|███▉      | 4379/11049 [45:05<1:08:09,  1.63it/s]
 40%|███▉      | 4380/11049 [45:05<1:08:10,  1.63it/s]
                                                      
{'loss': 0.2183, 'grad_norm': 0.5040271282196045, 'learning_rate': 7.5540666856049674e-06, 'epoch': 1.19}

 40%|███▉      | 4380/11049 [45:05<1:08:10,  1.63it/s]
 40%|███▉      | 4381/11049 [45:06<1:08:08,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5378895998001099, 'learning_rate': 7.552708552848666e-06, 'epoch': 1.19}

 40%|███▉      | 4381/11049 [45:06<1:08:08,  1.63it/s]
 40%|███▉      | 4382/11049 [45:06<1:08:07,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.5408005118370056, 'learning_rate': 7.5513501653045e-06, 'epoch': 1.19}

 40%|███▉      | 4382/11049 [45:07<1:08:07,  1.63it/s]
 40%|███▉      | 4383/11049 [45:07<1:08:07,  1.63it/s]
                                                      
{'loss': 0.2624, 'grad_norm': 0.6137726902961731, 'learning_rate': 7.5499915231080445e-06, 'epoch': 1.19}

 40%|███▉      | 4383/11049 [45:07<1:08:07,  1.63it/s]
 40%|███▉      | 4384/11049 [45:08<1:08:06,  1.63it/s]
                                                      
{'loss': 0.1869, 'grad_norm': 0.4717967212200165, 'learning_rate': 7.548632626394913e-06, 'epoch': 1.19}

 40%|███▉      | 4384/11049 [45:08<1:08:06,  1.63it/s]
 40%|███▉      | 4385/11049 [45:08<1:08:06,  1.63it/s]
                                                      
{'loss': 0.196, 'grad_norm': 0.5257817506790161, 'learning_rate': 7.547273475300734e-06, 'epoch': 1.19}

 40%|███▉      | 4385/11049 [45:08<1:08:06,  1.63it/s]
 40%|███▉      | 4386/11049 [45:09<1:08:06,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.4995485544204712, 'learning_rate': 7.545914069961167e-06, 'epoch': 1.19}

 40%|███▉      | 4386/11049 [45:09<1:08:06,  1.63it/s]
 40%|███▉      | 4387/11049 [45:09<1:08:06,  1.63it/s]
                                                      
{'loss': 0.2012, 'grad_norm': 0.5310758948326111, 'learning_rate': 7.544554410511896e-06, 'epoch': 1.19}

 40%|███▉      | 4387/11049 [45:10<1:08:06,  1.63it/s]
 40%|███▉      | 4388/11049 [45:10<1:08:04,  1.63it/s]
                                                      
{'loss': 0.2302, 'grad_norm': 0.5363995432853699, 'learning_rate': 7.543194497088628e-06, 'epoch': 1.19}

 40%|███▉      | 4388/11049 [45:10<1:08:04,  1.63it/s]
 40%|███▉      | 4389/11049 [45:11<1:08:03,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.535687267780304, 'learning_rate': 7.541834329827099e-06, 'epoch': 1.19}

 40%|███▉      | 4389/11049 [45:11<1:08:03,  1.63it/s]
 40%|███▉      | 4390/11049 [45:11<1:08:02,  1.63it/s]
                                                      
{'loss': 0.2296, 'grad_norm': 0.5679467916488647, 'learning_rate': 7.540473908863066e-06, 'epoch': 1.19}

 40%|███▉      | 4390/11049 [45:11<1:08:02,  1.63it/s]
 40%|███▉      | 4391/11049 [45:12<1:08:01,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5570086240768433, 'learning_rate': 7.5391132343323155e-06, 'epoch': 1.19}

 40%|███▉      | 4391/11049 [45:12<1:08:01,  1.63it/s]
 40%|███▉      | 4392/11049 [45:13<1:08:02,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5987697243690491, 'learning_rate': 7.537752306370658e-06, 'epoch': 1.19}

 40%|███▉      | 4392/11049 [45:13<1:08:02,  1.63it/s]
 40%|███▉      | 4393/11049 [45:13<1:08:01,  1.63it/s]
                                                      
{'loss': 0.312, 'grad_norm': 0.5909941792488098, 'learning_rate': 7.536391125113926e-06, 'epoch': 1.19}

 40%|███▉      | 4393/11049 [45:13<1:08:01,  1.63it/s]
 40%|███▉      | 4394/11049 [45:14<1:08:00,  1.63it/s]
                                                      
{'loss': 0.2422, 'grad_norm': 0.6094859838485718, 'learning_rate': 7.535029690697984e-06, 'epoch': 1.19}

 40%|███▉      | 4394/11049 [45:14<1:08:00,  1.63it/s]
 40%|███▉      | 4395/11049 [45:14<1:08:00,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.5265172123908997, 'learning_rate': 7.533668003258714e-06, 'epoch': 1.19}

 40%|███▉      | 4395/11049 [45:15<1:08:00,  1.63it/s]
 40%|███▉      | 4396/11049 [45:15<1:08:01,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.5152238011360168, 'learning_rate': 7.53230606293203e-06, 'epoch': 1.19}

 40%|███▉      | 4396/11049 [45:15<1:08:01,  1.63it/s]
 40%|███▉      | 4397/11049 [45:16<1:08:02,  1.63it/s]
                                                      
{'loss': 0.1996, 'grad_norm': 0.514878511428833, 'learning_rate': 7.530943869853866e-06, 'epoch': 1.19}

 40%|███▉      | 4397/11049 [45:16<1:08:02,  1.63it/s]
 40%|███▉      | 4398/11049 [45:16<1:08:01,  1.63it/s]
                                                      
{'loss': 0.2293, 'grad_norm': 0.5413181185722351, 'learning_rate': 7.529581424160185e-06, 'epoch': 1.19}

 40%|███▉      | 4398/11049 [45:16<1:08:01,  1.63it/s]
 40%|███▉      | 4399/11049 [45:17<1:07:59,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.5837708115577698, 'learning_rate': 7.528218725986973e-06, 'epoch': 1.19}

 40%|███▉      | 4399/11049 [45:17<1:07:59,  1.63it/s]
 40%|███▉      | 4400/11049 [45:17<1:07:58,  1.63it/s]
                                                      
{'loss': 0.1839, 'grad_norm': 0.5390115976333618, 'learning_rate': 7.526855775470246e-06, 'epoch': 1.19}

 40%|███▉      | 4400/11049 [45:18<1:07:58,  1.63it/s]
 40%|███▉      | 4401/11049 [45:18<1:07:56,  1.63it/s]
                                                      
{'loss': 0.1944, 'grad_norm': 0.5349273085594177, 'learning_rate': 7.5254925727460335e-06, 'epoch': 1.19}

 40%|███▉      | 4401/11049 [45:18<1:07:56,  1.63it/s]
 40%|███▉      | 4402/11049 [45:19<1:07:58,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.542168915271759, 'learning_rate': 7.5241291179504025e-06, 'epoch': 1.2}

 40%|███▉      | 4402/11049 [45:19<1:07:58,  1.63it/s]
 40%|███▉      | 4403/11049 [45:19<1:07:55,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.6110386252403259, 'learning_rate': 7.522765411219442e-06, 'epoch': 1.2}

 40%|███▉      | 4403/11049 [45:19<1:07:55,  1.63it/s]
 40%|███▉      | 4404/11049 [45:20<1:07:56,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.5007200241088867, 'learning_rate': 7.521401452689261e-06, 'epoch': 1.2}

 40%|███▉      | 4404/11049 [45:20<1:07:56,  1.63it/s]
 40%|███▉      | 4405/11049 [45:21<1:07:55,  1.63it/s]
                                                      
{'loss': 0.1704, 'grad_norm': 0.4881649315357208, 'learning_rate': 7.520037242496e-06, 'epoch': 1.2}

 40%|███▉      | 4405/11049 [45:21<1:07:55,  1.63it/s]
 40%|███▉      | 4406/11049 [45:21<1:07:56,  1.63it/s]
                                                      
{'loss': 0.1675, 'grad_norm': 0.5097423791885376, 'learning_rate': 7.518672780775821e-06, 'epoch': 1.2}

 40%|███▉      | 4406/11049 [45:21<1:07:56,  1.63it/s]
 40%|███▉      | 4407/11049 [45:22<1:07:56,  1.63it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.547021210193634, 'learning_rate': 7.5173080676649104e-06, 'epoch': 1.2}

 40%|███▉      | 4407/11049 [45:22<1:07:56,  1.63it/s]
 40%|███▉      | 4408/11049 [45:22<1:07:56,  1.63it/s]
                                                      
{'loss': 0.2626, 'grad_norm': 0.6173093914985657, 'learning_rate': 7.515943103299483e-06, 'epoch': 1.2}

 40%|███▉      | 4408/11049 [45:23<1:07:56,  1.63it/s]
 40%|███▉      | 4409/11049 [45:23<1:07:55,  1.63it/s]
                                                      
{'loss': 0.2777, 'grad_norm': 0.5927453637123108, 'learning_rate': 7.514577887815779e-06, 'epoch': 1.2}

 40%|███▉      | 4409/11049 [45:23<1:07:55,  1.63it/s]
 40%|███▉      | 4410/11049 [45:24<1:07:54,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.527654767036438, 'learning_rate': 7.513212421350058e-06, 'epoch': 1.2}

 40%|███▉      | 4410/11049 [45:24<1:07:54,  1.63it/s]
 40%|███▉      | 4411/11049 [45:24<1:07:53,  1.63it/s]
                                                      
{'loss': 0.1942, 'grad_norm': 0.4467276930809021, 'learning_rate': 7.511846704038609e-06, 'epoch': 1.2}

 40%|███▉      | 4411/11049 [45:24<1:07:53,  1.63it/s]
 40%|███▉      | 4412/11049 [45:25<1:07:52,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5607865452766418, 'learning_rate': 7.510480736017747e-06, 'epoch': 1.2}

 40%|███▉      | 4412/11049 [45:25<1:07:52,  1.63it/s]
 40%|███▉      | 4413/11049 [45:25<1:07:49,  1.63it/s]
                                                      
{'loss': 0.3021, 'grad_norm': 0.6826962828636169, 'learning_rate': 7.50911451742381e-06, 'epoch': 1.2}

 40%|███▉      | 4413/11049 [45:26<1:07:49,  1.63it/s]
 40%|███▉      | 4414/11049 [45:26<1:07:48,  1.63it/s]
                                                      
{'loss': 0.2539, 'grad_norm': 0.6485752463340759, 'learning_rate': 7.50774804839316e-06, 'epoch': 1.2}

 40%|███▉      | 4414/11049 [45:26<1:07:48,  1.63it/s]
 40%|███▉      | 4415/11049 [45:27<1:07:48,  1.63it/s]
                                                      
{'loss': 0.199, 'grad_norm': 0.5146821737289429, 'learning_rate': 7.506381329062184e-06, 'epoch': 1.2}

 40%|███▉      | 4415/11049 [45:27<1:07:48,  1.63it/s]
 40%|███▉      | 4416/11049 [45:27<1:07:48,  1.63it/s]
                                                      
{'loss': 0.2567, 'grad_norm': 0.6878874897956848, 'learning_rate': 7.5050143595673e-06, 'epoch': 1.2}

 40%|███▉      | 4416/11049 [45:27<1:07:48,  1.63it/s]
 40%|███▉      | 4417/11049 [45:28<1:07:48,  1.63it/s]
                                                      
{'loss': 0.2752, 'grad_norm': 0.683401882648468, 'learning_rate': 7.503647140044943e-06, 'epoch': 1.2}

 40%|███▉      | 4417/11049 [45:28<1:07:48,  1.63it/s]
 40%|███▉      | 4418/11049 [45:29<1:07:46,  1.63it/s]
                                                      
{'loss': 0.2376, 'grad_norm': 0.6138255000114441, 'learning_rate': 7.502279670631578e-06, 'epoch': 1.2}

 40%|███▉      | 4418/11049 [45:29<1:07:46,  1.63it/s]
 40%|███▉      | 4419/11049 [45:29<1:07:46,  1.63it/s]
                                                      
{'loss': 0.2336, 'grad_norm': 0.5432754755020142, 'learning_rate': 7.50091195146369e-06, 'epoch': 1.2}

 40%|███▉      | 4419/11049 [45:29<1:07:46,  1.63it/s]
 40%|████      | 4420/11049 [45:30<1:07:46,  1.63it/s]
                                                      
{'loss': 0.1816, 'grad_norm': 0.5547500848770142, 'learning_rate': 7.499543982677796e-06, 'epoch': 1.2}

 40%|████      | 4420/11049 [45:30<1:07:46,  1.63it/s]
 40%|████      | 4421/11049 [45:30<1:07:44,  1.63it/s]
                                                      
{'loss': 0.1902, 'grad_norm': 0.47062861919403076, 'learning_rate': 7.498175764410432e-06, 'epoch': 1.2}

 40%|████      | 4421/11049 [45:30<1:07:44,  1.63it/s]
 40%|████      | 4422/11049 [45:31<1:07:42,  1.63it/s]
                                                      
{'loss': 0.2761, 'grad_norm': 0.6371079683303833, 'learning_rate': 7.496807296798161e-06, 'epoch': 1.2}

 40%|████      | 4422/11049 [45:31<1:07:42,  1.63it/s]
 40%|████      | 4423/11049 [45:32<1:07:41,  1.63it/s]
                                                      
{'loss': 0.199, 'grad_norm': 0.5130169987678528, 'learning_rate': 7.495438579977572e-06, 'epoch': 1.2}

 40%|████      | 4423/11049 [45:32<1:07:41,  1.63it/s]
 40%|████      | 4424/11049 [45:32<1:07:39,  1.63it/s]
                                                      
{'loss': 0.1944, 'grad_norm': 0.47199830412864685, 'learning_rate': 7.494069614085278e-06, 'epoch': 1.2}

 40%|████      | 4424/11049 [45:32<1:07:39,  1.63it/s]
 40%|████      | 4425/11049 [45:33<1:07:41,  1.63it/s]
                                                      
{'loss': 0.2289, 'grad_norm': 0.6169505715370178, 'learning_rate': 7.492700399257913e-06, 'epoch': 1.2}

 40%|████      | 4425/11049 [45:33<1:07:41,  1.63it/s]
 40%|████      | 4426/11049 [45:33<1:07:42,  1.63it/s]
                                                      
{'loss': 0.2304, 'grad_norm': 0.53836989402771, 'learning_rate': 7.491330935632143e-06, 'epoch': 1.2}

 40%|████      | 4426/11049 [45:34<1:07:42,  1.63it/s]
 40%|████      | 4427/11049 [45:34<1:07:40,  1.63it/s]
                                                      
{'loss': 0.2525, 'grad_norm': 0.6435695290565491, 'learning_rate': 7.489961223344654e-06, 'epoch': 1.2}

 40%|████      | 4427/11049 [45:34<1:07:40,  1.63it/s]
 40%|████      | 4428/11049 [45:35<1:07:38,  1.63it/s]
                                                      
{'loss': 0.2345, 'grad_norm': 0.6035232543945312, 'learning_rate': 7.488591262532159e-06, 'epoch': 1.2}

 40%|████      | 4428/11049 [45:35<1:07:38,  1.63it/s]
 40%|████      | 4429/11049 [45:35<1:07:39,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.5314497351646423, 'learning_rate': 7.4872210533313924e-06, 'epoch': 1.2}

 40%|████      | 4429/11049 [45:35<1:07:39,  1.63it/s]
 40%|████      | 4430/11049 [45:36<1:07:38,  1.63it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5711577534675598, 'learning_rate': 7.485850595879118e-06, 'epoch': 1.2}

 40%|████      | 4430/11049 [45:36<1:07:38,  1.63it/s]
 40%|████      | 4431/11049 [45:36<1:07:40,  1.63it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.4958314001560211, 'learning_rate': 7.484479890312124e-06, 'epoch': 1.2}

 40%|████      | 4431/11049 [45:37<1:07:40,  1.63it/s]
 40%|████      | 4432/11049 [45:37<1:07:39,  1.63it/s]
                                                      
{'loss': 0.165, 'grad_norm': 0.5094247460365295, 'learning_rate': 7.4831089367672185e-06, 'epoch': 1.2}

 40%|████      | 4432/11049 [45:37<1:07:39,  1.63it/s]
 40%|████      | 4433/11049 [45:38<1:07:38,  1.63it/s]
                                                      
{'loss': 0.1783, 'grad_norm': 0.45409682393074036, 'learning_rate': 7.481737735381236e-06, 'epoch': 1.2}

 40%|████      | 4433/11049 [45:38<1:07:38,  1.63it/s]
 40%|████      | 4434/11049 [45:38<1:07:36,  1.63it/s]
                                                      
{'loss': 0.2391, 'grad_norm': 0.759117066860199, 'learning_rate': 7.480366286291042e-06, 'epoch': 1.2}

 40%|████      | 4434/11049 [45:38<1:07:36,  1.63it/s]
 40%|████      | 4435/11049 [45:39<1:07:37,  1.63it/s]
                                                      
{'loss': 0.2905, 'grad_norm': 0.5647286772727966, 'learning_rate': 7.4789945896335184e-06, 'epoch': 1.2}

 40%|████      | 4435/11049 [45:39<1:07:37,  1.63it/s]
 40%|████      | 4436/11049 [45:40<1:07:37,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.5863451361656189, 'learning_rate': 7.477622645545578e-06, 'epoch': 1.2}

 40%|████      | 4436/11049 [45:40<1:07:37,  1.63it/s]
 40%|████      | 4437/11049 [45:40<1:07:37,  1.63it/s]
                                                      
{'loss': 0.2483, 'grad_norm': 0.6538995504379272, 'learning_rate': 7.476250454164152e-06, 'epoch': 1.2}

 40%|████      | 4437/11049 [45:40<1:07:37,  1.63it/s]
 40%|████      | 4438/11049 [45:41<1:07:40,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5596312284469604, 'learning_rate': 7.474878015626204e-06, 'epoch': 1.2}

 40%|████      | 4438/11049 [45:41<1:07:40,  1.63it/s]
 40%|████      | 4439/11049 [45:41<1:07:37,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5069068074226379, 'learning_rate': 7.473505330068713e-06, 'epoch': 1.21}

 40%|████      | 4439/11049 [45:42<1:07:37,  1.63it/s]
 40%|████      | 4440/11049 [45:42<1:09:28,  1.59it/s]
                                                      
{'loss': 0.2221, 'grad_norm': 0.5275925397872925, 'learning_rate': 7.472132397628694e-06, 'epoch': 1.21}

 40%|████      | 4440/11049 [45:42<1:09:28,  1.59it/s]
 40%|████      | 4441/11049 [45:43<1:08:58,  1.60it/s]
                                                      
{'loss': 0.2308, 'grad_norm': 0.6041600704193115, 'learning_rate': 7.470759218443177e-06, 'epoch': 1.21}

 40%|████      | 4441/11049 [45:43<1:08:58,  1.60it/s]
 40%|████      | 4442/11049 [45:43<1:08:32,  1.61it/s]
                                                      
{'loss': 0.2797, 'grad_norm': 0.652756929397583, 'learning_rate': 7.4693857926492196e-06, 'epoch': 1.21}

 40%|████      | 4442/11049 [45:43<1:08:32,  1.61it/s]
 40%|████      | 4443/11049 [45:44<1:08:14,  1.61it/s]
                                                      
{'loss': 0.2501, 'grad_norm': 0.5239297747612, 'learning_rate': 7.468012120383906e-06, 'epoch': 1.21}

 40%|████      | 4443/11049 [45:44<1:08:14,  1.61it/s]
 40%|████      | 4444/11049 [45:45<1:08:00,  1.62it/s]
                                                      
{'loss': 0.2761, 'grad_norm': 0.6237061619758606, 'learning_rate': 7.466638201784343e-06, 'epoch': 1.21}

 40%|████      | 4444/11049 [45:45<1:08:00,  1.62it/s]
 40%|████      | 4445/11049 [45:45<1:07:58,  1.62it/s]
                                                      
{'loss': 0.2477, 'grad_norm': 0.6311617493629456, 'learning_rate': 7.465264036987663e-06, 'epoch': 1.21}

 40%|████      | 4445/11049 [45:45<1:07:58,  1.62it/s]
 40%|████      | 4446/11049 [45:46<1:07:54,  1.62it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.5659747123718262, 'learning_rate': 7.4638896261310225e-06, 'epoch': 1.21}

 40%|████      | 4446/11049 [45:46<1:07:54,  1.62it/s]
 40%|████      | 4447/11049 [45:46<1:07:48,  1.62it/s]
                                                      
{'loss': 0.1826, 'grad_norm': 0.4873180389404297, 'learning_rate': 7.4625149693516e-06, 'epoch': 1.21}

 40%|████      | 4447/11049 [45:46<1:07:48,  1.62it/s]
 40%|████      | 4448/11049 [45:47<1:07:40,  1.63it/s]
                                                      
{'loss': 0.2398, 'grad_norm': 0.60821533203125, 'learning_rate': 7.4611400667866055e-06, 'epoch': 1.21}

 40%|████      | 4448/11049 [45:47<1:07:40,  1.63it/s]
 40%|████      | 4449/11049 [45:48<1:07:36,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5326410531997681, 'learning_rate': 7.459764918573264e-06, 'epoch': 1.21}

 40%|████      | 4449/11049 [45:48<1:07:36,  1.63it/s]
 40%|████      | 4450/11049 [45:48<1:07:38,  1.63it/s]
                                                      
{'loss': 0.1716, 'grad_norm': 0.5049738883972168, 'learning_rate': 7.458389524848836e-06, 'epoch': 1.21}

 40%|████      | 4450/11049 [45:48<1:07:38,  1.63it/s]
 40%|████      | 4451/11049 [45:49<1:07:39,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.5491450428962708, 'learning_rate': 7.457013885750595e-06, 'epoch': 1.21}

 40%|████      | 4451/11049 [45:49<1:07:39,  1.63it/s]
 40%|████      | 4452/11049 [45:49<1:07:34,  1.63it/s]
                                                      
{'loss': 0.261, 'grad_norm': 0.6072368025779724, 'learning_rate': 7.455638001415848e-06, 'epoch': 1.21}

 40%|████      | 4452/11049 [45:50<1:07:34,  1.63it/s]
 40%|████      | 4453/11049 [45:50<1:07:32,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.516501247882843, 'learning_rate': 7.454261871981922e-06, 'epoch': 1.21}

 40%|████      | 4453/11049 [45:50<1:07:32,  1.63it/s]
 40%|████      | 4454/11049 [45:51<1:07:28,  1.63it/s]
                                                      
{'loss': 0.2244, 'grad_norm': 0.6226367354393005, 'learning_rate': 7.452885497586172e-06, 'epoch': 1.21}

 40%|████      | 4454/11049 [45:51<1:07:28,  1.63it/s]
 40%|████      | 4455/11049 [45:51<1:07:32,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.5283982157707214, 'learning_rate': 7.451508878365971e-06, 'epoch': 1.21}

 40%|████      | 4455/11049 [45:51<1:07:32,  1.63it/s]
 40%|████      | 4456/11049 [45:52<1:07:32,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.5518779158592224, 'learning_rate': 7.450132014458722e-06, 'epoch': 1.21}

 40%|████      | 4456/11049 [45:52<1:07:32,  1.63it/s]
 40%|████      | 4457/11049 [45:53<1:07:29,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.46083158254623413, 'learning_rate': 7.44875490600185e-06, 'epoch': 1.21}

 40%|████      | 4457/11049 [45:53<1:07:29,  1.63it/s]
 40%|████      | 4458/11049 [45:53<1:07:25,  1.63it/s]
                                                      
{'loss': 0.2511, 'grad_norm': 0.656144917011261, 'learning_rate': 7.447377553132808e-06, 'epoch': 1.21}

 40%|████      | 4458/11049 [45:53<1:07:25,  1.63it/s]
 40%|████      | 4459/11049 [45:54<1:07:23,  1.63it/s]
                                                      
{'loss': 0.1611, 'grad_norm': 0.4487651288509369, 'learning_rate': 7.4459999559890705e-06, 'epoch': 1.21}

 40%|████      | 4459/11049 [45:54<1:07:23,  1.63it/s]
 40%|████      | 4460/11049 [45:54<1:07:26,  1.63it/s]
                                                      
{'loss': 0.2198, 'grad_norm': 0.5810855627059937, 'learning_rate': 7.444622114708134e-06, 'epoch': 1.21}

 40%|████      | 4460/11049 [45:54<1:07:26,  1.63it/s]
 40%|████      | 4461/11049 [45:55<1:07:24,  1.63it/s]
                                                      
{'loss': 0.2544, 'grad_norm': 0.5933366417884827, 'learning_rate': 7.4432440294275235e-06, 'epoch': 1.21}

 40%|████      | 4461/11049 [45:55<1:07:24,  1.63it/s]
 40%|████      | 4462/11049 [45:56<1:07:23,  1.63it/s]
                                                      
{'loss': 0.1669, 'grad_norm': 0.4984370172023773, 'learning_rate': 7.441865700284785e-06, 'epoch': 1.21}

 40%|████      | 4462/11049 [45:56<1:07:23,  1.63it/s]
 40%|████      | 4463/11049 [45:56<1:07:22,  1.63it/s]
                                                      
{'loss': 0.218, 'grad_norm': 0.5645896792411804, 'learning_rate': 7.440487127417494e-06, 'epoch': 1.21}

 40%|████      | 4463/11049 [45:56<1:07:22,  1.63it/s]
 40%|████      | 4464/11049 [45:57<1:07:19,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.4880199432373047, 'learning_rate': 7.4391083109632445e-06, 'epoch': 1.21}

 40%|████      | 4464/11049 [45:57<1:07:19,  1.63it/s]
 40%|████      | 4465/11049 [45:57<1:07:20,  1.63it/s]
                                                      
{'loss': 0.2216, 'grad_norm': 0.6465747952461243, 'learning_rate': 7.437729251059657e-06, 'epoch': 1.21}

 40%|████      | 4465/11049 [45:58<1:07:20,  1.63it/s]
 40%|████      | 4466/11049 [45:58<1:07:18,  1.63it/s]
                                                      
{'loss': 0.2127, 'grad_norm': 0.5632915496826172, 'learning_rate': 7.436349947844378e-06, 'epoch': 1.21}

 40%|████      | 4466/11049 [45:58<1:07:18,  1.63it/s]
 40%|████      | 4467/11049 [45:59<1:07:16,  1.63it/s]
                                                      
{'loss': 0.1642, 'grad_norm': 0.4020562469959259, 'learning_rate': 7.434970401455076e-06, 'epoch': 1.21}

 40%|████      | 4467/11049 [45:59<1:07:16,  1.63it/s]
 40%|████      | 4468/11049 [45:59<1:07:17,  1.63it/s]
                                                      
{'loss': 0.2061, 'grad_norm': 0.5559365749359131, 'learning_rate': 7.433590612029445e-06, 'epoch': 1.21}

 40%|████      | 4468/11049 [45:59<1:07:17,  1.63it/s]
 40%|████      | 4469/11049 [46:00<1:07:18,  1.63it/s]
                                                      
{'loss': 0.2495, 'grad_norm': 0.6216369867324829, 'learning_rate': 7.432210579705202e-06, 'epoch': 1.21}

 40%|████      | 4469/11049 [46:00<1:07:18,  1.63it/s]
 40%|████      | 4470/11049 [46:00<1:07:18,  1.63it/s]
                                                      
{'loss': 0.3282, 'grad_norm': 0.6987119317054749, 'learning_rate': 7.43083030462009e-06, 'epoch': 1.21}

 40%|████      | 4470/11049 [46:01<1:07:18,  1.63it/s]
 40%|████      | 4471/11049 [46:01<1:07:16,  1.63it/s]
                                                      
{'loss': 0.2213, 'grad_norm': 0.5225382447242737, 'learning_rate': 7.429449786911876e-06, 'epoch': 1.21}

 40%|████      | 4471/11049 [46:01<1:07:16,  1.63it/s]
 40%|████      | 4472/11049 [46:02<1:07:16,  1.63it/s]
                                                      
{'loss': 0.1524, 'grad_norm': 0.48848649859428406, 'learning_rate': 7.428069026718349e-06, 'epoch': 1.21}

 40%|████      | 4472/11049 [46:02<1:07:16,  1.63it/s]
 40%|████      | 4473/11049 [46:02<1:07:14,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.6028455495834351, 'learning_rate': 7.426688024177326e-06, 'epoch': 1.21}

 40%|████      | 4473/11049 [46:02<1:07:14,  1.63it/s]
 40%|████      | 4474/11049 [46:03<1:07:15,  1.63it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.7001181244850159, 'learning_rate': 7.425306779426642e-06, 'epoch': 1.21}

 40%|████      | 4474/11049 [46:03<1:07:15,  1.63it/s]
 41%|████      | 4475/11049 [46:04<1:07:11,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.5366731286048889, 'learning_rate': 7.423925292604164e-06, 'epoch': 1.22}

 41%|████      | 4475/11049 [46:04<1:07:11,  1.63it/s]
 41%|████      | 4476/11049 [46:04<1:07:11,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.5807802081108093, 'learning_rate': 7.4225435638477794e-06, 'epoch': 1.22}

 41%|████      | 4476/11049 [46:04<1:07:11,  1.63it/s]
 41%|████      | 4477/11049 [46:05<1:07:13,  1.63it/s]
                                                      
{'loss': 0.2768, 'grad_norm': 0.6964551210403442, 'learning_rate': 7.421161593295395e-06, 'epoch': 1.22}

 41%|████      | 4477/11049 [46:05<1:07:13,  1.63it/s]
 41%|████      | 4478/11049 [46:05<1:07:13,  1.63it/s]
                                                      
{'loss': 0.2229, 'grad_norm': 0.5842916369438171, 'learning_rate': 7.419779381084952e-06, 'epoch': 1.22}

 41%|████      | 4478/11049 [46:06<1:07:13,  1.63it/s]
 41%|████      | 4479/11049 [46:06<1:07:11,  1.63it/s]
                                                      
{'loss': 0.2338, 'grad_norm': 0.5443804860115051, 'learning_rate': 7.418396927354407e-06, 'epoch': 1.22}

 41%|████      | 4479/11049 [46:06<1:07:11,  1.63it/s]
 41%|████      | 4480/11049 [46:07<1:07:10,  1.63it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.5282374024391174, 'learning_rate': 7.417014232241743e-06, 'epoch': 1.22}

 41%|████      | 4480/11049 [46:07<1:07:10,  1.63it/s]
 41%|████      | 4481/11049 [46:07<1:07:10,  1.63it/s]
                                                      
{'loss': 0.2523, 'grad_norm': 0.6142305731773376, 'learning_rate': 7.415631295884972e-06, 'epoch': 1.22}

 41%|████      | 4481/11049 [46:07<1:07:10,  1.63it/s]
 41%|████      | 4482/11049 [46:08<1:07:07,  1.63it/s]
                                                      
{'loss': 0.1621, 'grad_norm': 0.43215087056159973, 'learning_rate': 7.41424811842212e-06, 'epoch': 1.22}

 41%|████      | 4482/11049 [46:08<1:07:07,  1.63it/s]
 41%|████      | 4483/11049 [46:08<1:07:10,  1.63it/s]
                                                      
{'loss': 0.2541, 'grad_norm': 0.5705758929252625, 'learning_rate': 7.412864699991249e-06, 'epoch': 1.22}

 41%|████      | 4483/11049 [46:09<1:07:10,  1.63it/s]
 41%|████      | 4484/11049 [46:09<1:07:10,  1.63it/s]
                                                      
{'loss': 0.2217, 'grad_norm': 0.5180515646934509, 'learning_rate': 7.4114810407304346e-06, 'epoch': 1.22}

 41%|████      | 4484/11049 [46:09<1:07:10,  1.63it/s]
 41%|████      | 4485/11049 [46:10<1:07:07,  1.63it/s]
                                                      
{'loss': 0.2031, 'grad_norm': 0.5195953845977783, 'learning_rate': 7.410097140777784e-06, 'epoch': 1.22}

 41%|████      | 4485/11049 [46:10<1:07:07,  1.63it/s]
 41%|████      | 4486/11049 [46:10<1:07:06,  1.63it/s]
                                                      
{'loss': 0.2355, 'grad_norm': 0.5718869566917419, 'learning_rate': 7.4087130002714246e-06, 'epoch': 1.22}

 41%|████      | 4486/11049 [46:10<1:07:06,  1.63it/s]
 41%|████      | 4487/11049 [46:11<1:07:04,  1.63it/s]
                                                      
{'loss': 0.2816, 'grad_norm': 0.6250342130661011, 'learning_rate': 7.407328619349508e-06, 'epoch': 1.22}

 41%|████      | 4487/11049 [46:11<1:07:04,  1.63it/s]
 41%|████      | 4488/11049 [46:12<1:07:03,  1.63it/s]
                                                      
{'loss': 0.1833, 'grad_norm': 0.5251005291938782, 'learning_rate': 7.405943998150209e-06, 'epoch': 1.22}

 41%|████      | 4488/11049 [46:12<1:07:03,  1.63it/s]
 41%|████      | 4489/11049 [46:12<1:07:01,  1.63it/s]
                                                      
{'loss': 0.1835, 'grad_norm': 0.5234332084655762, 'learning_rate': 7.40455913681173e-06, 'epoch': 1.22}

 41%|████      | 4489/11049 [46:12<1:07:01,  1.63it/s]
 41%|████      | 4490/11049 [46:13<1:07:03,  1.63it/s]
                                                      
{'loss': 0.1754, 'grad_norm': 0.5331973433494568, 'learning_rate': 7.403174035472295e-06, 'epoch': 1.22}

 41%|████      | 4490/11049 [46:13<1:07:03,  1.63it/s]
 41%|████      | 4491/11049 [46:13<1:07:02,  1.63it/s]
                                                      
{'loss': 0.1762, 'grad_norm': 0.4382523000240326, 'learning_rate': 7.401788694270151e-06, 'epoch': 1.22}

 41%|████      | 4491/11049 [46:13<1:07:02,  1.63it/s]
 41%|████      | 4492/11049 [46:14<1:07:02,  1.63it/s]
                                                      
{'loss': 0.2025, 'grad_norm': 0.5203881859779358, 'learning_rate': 7.4004031133435685e-06, 'epoch': 1.22}

 41%|████      | 4492/11049 [46:14<1:07:02,  1.63it/s]
 41%|████      | 4493/11049 [46:15<1:07:01,  1.63it/s]
                                                      
{'loss': 0.228, 'grad_norm': 0.6324178576469421, 'learning_rate': 7.399017292830848e-06, 'epoch': 1.22}

 41%|████      | 4493/11049 [46:15<1:07:01,  1.63it/s]
 41%|████      | 4494/11049 [46:15<1:07:00,  1.63it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.5590103268623352, 'learning_rate': 7.397631232870305e-06, 'epoch': 1.22}

 41%|████      | 4494/11049 [46:15<1:07:00,  1.63it/s]
 41%|████      | 4495/11049 [46:16<1:06:59,  1.63it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.5093761086463928, 'learning_rate': 7.396244933600285e-06, 'epoch': 1.22}

 41%|████      | 4495/11049 [46:16<1:06:59,  1.63it/s]
 41%|████      | 4496/11049 [46:16<1:07:00,  1.63it/s]
                                                      
{'loss': 0.248, 'grad_norm': 0.5762704610824585, 'learning_rate': 7.394858395159156e-06, 'epoch': 1.22}

 41%|████      | 4496/11049 [46:17<1:07:00,  1.63it/s]
 41%|████      | 4497/11049 [46:17<1:06:58,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.4978596568107605, 'learning_rate': 7.393471617685308e-06, 'epoch': 1.22}

 41%|████      | 4497/11049 [46:17<1:06:58,  1.63it/s]
 41%|████      | 4498/11049 [46:18<1:06:57,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.6062681078910828, 'learning_rate': 7.392084601317159e-06, 'epoch': 1.22}

 41%|████      | 4498/11049 [46:18<1:06:57,  1.63it/s]
 41%|████      | 4499/11049 [46:18<1:06:57,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.5023908615112305, 'learning_rate': 7.390697346193146e-06, 'epoch': 1.22}

 41%|████      | 4499/11049 [46:18<1:06:57,  1.63it/s]
 41%|████      | 4500/11049 [46:19<1:06:56,  1.63it/s]
                                                      
{'loss': 0.1817, 'grad_norm': 0.5594859719276428, 'learning_rate': 7.389309852451732e-06, 'epoch': 1.22}

 41%|████      | 4500/11049 [46:19<1:06:56,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.34it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.41it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.89it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.82it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.77it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]
                                                      

                                               
{'eval_loss': 0.6080986857414246, 'eval_runtime': 1.9549, 'eval_samples_per_second': 102.309, 'eval_steps_per_second': 6.65, 'epoch': 1.22}

 41%|████      | 4500/11049 [46:21<1:06:56,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]

                                               
 41%|████      | 4501/11049 [46:21<2:11:06,  1.20s/it]
                                                      
{'loss': 0.1966, 'grad_norm': 0.5101842284202576, 'learning_rate': 7.387922120231406e-06, 'epoch': 1.22}

 41%|████      | 4501/11049 [46:22<2:11:06,  1.20s/it]
 41%|████      | 4502/11049 [46:22<1:51:51,  1.03s/it]
                                                      
{'loss': 0.2421, 'grad_norm': 0.6968610882759094, 'learning_rate': 7.386534149670674e-06, 'epoch': 1.22}

 41%|████      | 4502/11049 [46:22<1:51:51,  1.03s/it]
 41%|████      | 4503/11049 [46:23<1:38:22,  1.11it/s]
                                                      
{'loss': 0.2961, 'grad_norm': 0.7434296607971191, 'learning_rate': 7.385145940908076e-06, 'epoch': 1.22}

 41%|████      | 4503/11049 [46:23<1:38:22,  1.11it/s]
 41%|████      | 4504/11049 [46:23<1:30:35,  1.20it/s]
                                                      
{'loss': 0.2265, 'grad_norm': 0.6240969300270081, 'learning_rate': 7.383757494082169e-06, 'epoch': 1.22}

 41%|████      | 4504/11049 [46:23<1:30:35,  1.20it/s]
 41%|████      | 4505/11049 [46:24<1:23:48,  1.30it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.49832335114479065, 'learning_rate': 7.382368809331533e-06, 'epoch': 1.22}

 41%|████      | 4505/11049 [46:24<1:23:48,  1.30it/s]
 41%|████      | 4506/11049 [46:25<1:18:47,  1.38it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.4891851246356964, 'learning_rate': 7.380979886794772e-06, 'epoch': 1.22}

 41%|████      | 4506/11049 [46:25<1:18:47,  1.38it/s]
 41%|████      | 4507/11049 [46:25<1:15:12,  1.45it/s]
                                                      
{'loss': 0.2795, 'grad_norm': 0.6180173754692078, 'learning_rate': 7.379590726610519e-06, 'epoch': 1.22}

 41%|████      | 4507/11049 [46:25<1:15:12,  1.45it/s]
 41%|████      | 4508/11049 [46:26<1:12:41,  1.50it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.4545511305332184, 'learning_rate': 7.378201328917428e-06, 'epoch': 1.22}

 41%|████      | 4508/11049 [46:26<1:12:41,  1.50it/s]
 41%|████      | 4509/11049 [46:26<1:10:56,  1.54it/s]
                                                      
{'loss': 0.2894, 'grad_norm': 0.6499155759811401, 'learning_rate': 7.376811693854174e-06, 'epoch': 1.22}

 41%|████      | 4509/11049 [46:27<1:10:56,  1.54it/s]
 41%|████      | 4510/11049 [46:27<1:09:41,  1.56it/s]
                                                      
{'loss': 0.2157, 'grad_norm': 0.5190981030464172, 'learning_rate': 7.375421821559455e-06, 'epoch': 1.22}

 41%|████      | 4510/11049 [46:27<1:09:41,  1.56it/s]
 41%|████      | 4511/11049 [46:28<1:08:54,  1.58it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.5137431025505066, 'learning_rate': 7.374031712171999e-06, 'epoch': 1.22}

 41%|████      | 4511/11049 [46:28<1:08:54,  1.58it/s]
 41%|████      | 4512/11049 [46:28<1:08:16,  1.60it/s]
                                                      
{'loss': 0.2706, 'grad_norm': 0.5435261726379395, 'learning_rate': 7.372641365830554e-06, 'epoch': 1.23}

 41%|████      | 4512/11049 [46:28<1:08:16,  1.60it/s]
 41%|████      | 4513/11049 [46:29<1:07:50,  1.61it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.5381114482879639, 'learning_rate': 7.37125078267389e-06, 'epoch': 1.23}

 41%|████      | 4513/11049 [46:29<1:07:50,  1.61it/s]
 41%|████      | 4514/11049 [46:29<1:07:31,  1.61it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.46444788575172424, 'learning_rate': 7.369859962840801e-06, 'epoch': 1.23}

 41%|████      | 4514/11049 [46:30<1:07:31,  1.61it/s]
 41%|████      | 4515/11049 [46:30<1:07:17,  1.62it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.4726245105266571, 'learning_rate': 7.368468906470109e-06, 'epoch': 1.23}

 41%|████      | 4515/11049 [46:30<1:07:17,  1.62it/s]
 41%|████      | 4516/11049 [46:31<1:08:52,  1.58it/s]
                                                      
{'loss': 0.2154, 'grad_norm': 0.588150143623352, 'learning_rate': 7.367077613700653e-06, 'epoch': 1.23}

 41%|████      | 4516/11049 [46:31<1:08:52,  1.58it/s]
 41%|████      | 4517/11049 [46:31<1:08:29,  1.59it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.5221309065818787, 'learning_rate': 7.3656860846713045e-06, 'epoch': 1.23}

 41%|████      | 4517/11049 [46:32<1:08:29,  1.59it/s]
 41%|████      | 4518/11049 [46:32<1:07:58,  1.60it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.5405989289283752, 'learning_rate': 7.364294319520946e-06, 'epoch': 1.23}

 41%|████      | 4518/11049 [46:32<1:07:58,  1.60it/s]
 41%|████      | 4519/11049 [46:33<1:07:35,  1.61it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.48271095752716064, 'learning_rate': 7.3629023183884955e-06, 'epoch': 1.23}

 41%|████      | 4519/11049 [46:33<1:07:35,  1.61it/s]
 41%|████      | 4520/11049 [46:33<1:07:21,  1.62it/s]
                                                      
{'loss': 0.2137, 'grad_norm': 0.48587217926979065, 'learning_rate': 7.361510081412887e-06, 'epoch': 1.23}

 41%|████      | 4520/11049 [46:33<1:07:21,  1.62it/s]
 41%|████      | 4521/11049 [46:34<1:07:17,  1.62it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5685554146766663, 'learning_rate': 7.360117608733084e-06, 'epoch': 1.23}

 41%|████      | 4521/11049 [46:34<1:07:17,  1.62it/s]
 41%|████      | 4522/11049 [46:34<1:07:07,  1.62it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.5457693338394165, 'learning_rate': 7.358724900488068e-06, 'epoch': 1.23}

 41%|████      | 4522/11049 [46:35<1:07:07,  1.62it/s]
 41%|████      | 4523/11049 [46:35<1:07:04,  1.62it/s]
                                                      
{'loss': 0.2872, 'grad_norm': 0.659317672252655, 'learning_rate': 7.3573319568168465e-06, 'epoch': 1.23}

 41%|████      | 4523/11049 [46:35<1:07:04,  1.62it/s]
 41%|████      | 4524/11049 [46:36<1:06:55,  1.62it/s]
                                                      
{'loss': 0.184, 'grad_norm': 0.4853517711162567, 'learning_rate': 7.3559387778584515e-06, 'epoch': 1.23}

 41%|████      | 4524/11049 [46:36<1:06:55,  1.62it/s]
 41%|████      | 4525/11049 [46:36<1:06:52,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.44417804479599, 'learning_rate': 7.354545363751935e-06, 'epoch': 1.23}

 41%|████      | 4525/11049 [46:36<1:06:52,  1.63it/s]
 41%|████      | 4526/11049 [46:37<1:06:52,  1.63it/s]
                                                      
{'loss': 0.2041, 'grad_norm': 0.554589569568634, 'learning_rate': 7.353151714636378e-06, 'epoch': 1.23}

 41%|████      | 4526/11049 [46:37<1:06:52,  1.63it/s]
 41%|████      | 4527/11049 [46:38<1:06:48,  1.63it/s]
                                                      
{'loss': 0.3128, 'grad_norm': 0.6195164918899536, 'learning_rate': 7.351757830650879e-06, 'epoch': 1.23}

 41%|████      | 4527/11049 [46:38<1:06:48,  1.63it/s]
 41%|████      | 4528/11049 [46:38<1:06:46,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5193265080451965, 'learning_rate': 7.350363711934563e-06, 'epoch': 1.23}

 41%|████      | 4528/11049 [46:38<1:06:46,  1.63it/s]
 41%|████      | 4529/11049 [46:39<1:06:44,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.6346864700317383, 'learning_rate': 7.3489693586265785e-06, 'epoch': 1.23}

 41%|████      | 4529/11049 [46:39<1:06:44,  1.63it/s]
 41%|████      | 4530/11049 [46:39<1:06:45,  1.63it/s]
                                                      
{'loss': 0.1625, 'grad_norm': 0.46211308240890503, 'learning_rate': 7.347574770866099e-06, 'epoch': 1.23}

 41%|████      | 4530/11049 [46:40<1:06:45,  1.63it/s]
 41%|████      | 4531/11049 [46:40<1:06:41,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.5054882168769836, 'learning_rate': 7.346179948792317e-06, 'epoch': 1.23}

 41%|████      | 4531/11049 [46:40<1:06:41,  1.63it/s]
 41%|████      | 4532/11049 [46:41<1:06:39,  1.63it/s]
                                                      
{'loss': 0.1784, 'grad_norm': 0.5135017037391663, 'learning_rate': 7.34478489254445e-06, 'epoch': 1.23}

 41%|████      | 4532/11049 [46:41<1:06:39,  1.63it/s]
 41%|████      | 4533/11049 [46:41<1:06:38,  1.63it/s]
                                                      
{'loss': 0.2376, 'grad_norm': 0.5605093836784363, 'learning_rate': 7.3433896022617425e-06, 'epoch': 1.23}

 41%|████      | 4533/11049 [46:41<1:06:38,  1.63it/s]
 41%|████      | 4534/11049 [46:42<1:06:37,  1.63it/s]
                                                      
{'loss': 0.2002, 'grad_norm': 0.559717059135437, 'learning_rate': 7.3419940780834565e-06, 'epoch': 1.23}

 41%|████      | 4534/11049 [46:42<1:06:37,  1.63it/s]
 41%|████      | 4535/11049 [46:42<1:06:36,  1.63it/s]
                                                      
{'loss': 0.1771, 'grad_norm': 0.44758695363998413, 'learning_rate': 7.340598320148884e-06, 'epoch': 1.23}

 41%|████      | 4535/11049 [46:43<1:06:36,  1.63it/s]
 41%|████      | 4536/11049 [46:43<1:06:35,  1.63it/s]
                                                      
{'loss': 0.1921, 'grad_norm': 0.5290126800537109, 'learning_rate': 7.3392023285973335e-06, 'epoch': 1.23}

 41%|████      | 4536/11049 [46:43<1:06:35,  1.63it/s]
 41%|████      | 4537/11049 [46:44<1:06:32,  1.63it/s]
                                                      
{'loss': 0.2754, 'grad_norm': 0.7689666152000427, 'learning_rate': 7.3378061035681415e-06, 'epoch': 1.23}

 41%|████      | 4537/11049 [46:44<1:06:32,  1.63it/s]
 41%|████      | 4538/11049 [46:44<1:06:31,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5102608799934387, 'learning_rate': 7.336409645200666e-06, 'epoch': 1.23}

 41%|████      | 4538/11049 [46:44<1:06:31,  1.63it/s]
 41%|████      | 4539/11049 [46:45<1:06:30,  1.63it/s]
                                                      
{'loss': 0.227, 'grad_norm': 0.5340653657913208, 'learning_rate': 7.335012953634289e-06, 'epoch': 1.23}

 41%|████      | 4539/11049 [46:45<1:06:30,  1.63it/s]
 41%|████      | 4540/11049 [46:46<1:06:31,  1.63it/s]
                                                      
{'loss': 0.1961, 'grad_norm': 0.4961850345134735, 'learning_rate': 7.333616029008414e-06, 'epoch': 1.23}

 41%|████      | 4540/11049 [46:46<1:06:31,  1.63it/s]
 41%|████      | 4541/11049 [46:46<1:06:33,  1.63it/s]
                                                      
{'loss': 0.186, 'grad_norm': 0.5787016749382019, 'learning_rate': 7.332218871462472e-06, 'epoch': 1.23}

 41%|████      | 4541/11049 [46:46<1:06:33,  1.63it/s]
 41%|████      | 4542/11049 [46:47<1:06:32,  1.63it/s]
                                                      
{'loss': 0.2667, 'grad_norm': 0.5685702562332153, 'learning_rate': 7.33082148113591e-06, 'epoch': 1.23}

 41%|████      | 4542/11049 [46:47<1:06:32,  1.63it/s]
 41%|████      | 4543/11049 [46:47<1:06:30,  1.63it/s]
                                                      
{'loss': 0.1802, 'grad_norm': 0.5186284184455872, 'learning_rate': 7.329423858168208e-06, 'epoch': 1.23}

 41%|████      | 4543/11049 [46:47<1:06:30,  1.63it/s]
 41%|████      | 4544/11049 [46:48<1:06:28,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.5182995796203613, 'learning_rate': 7.328026002698861e-06, 'epoch': 1.23}

 41%|████      | 4544/11049 [46:48<1:06:28,  1.63it/s]
 41%|████      | 4545/11049 [46:49<1:06:26,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.5742473006248474, 'learning_rate': 7.326627914867388e-06, 'epoch': 1.23}

 41%|████      | 4545/11049 [46:49<1:06:26,  1.63it/s]
 41%|████      | 4546/11049 [46:49<1:06:25,  1.63it/s]
                                                      
{'loss': 0.2433, 'grad_norm': 0.5837859511375427, 'learning_rate': 7.3252295948133365e-06, 'epoch': 1.23}

 41%|████      | 4546/11049 [46:49<1:06:25,  1.63it/s]
 41%|████      | 4547/11049 [46:50<1:06:26,  1.63it/s]
                                                      
{'loss': 0.1676, 'grad_norm': 0.48320746421813965, 'learning_rate': 7.323831042676273e-06, 'epoch': 1.23}

 41%|████      | 4547/11049 [46:50<1:06:26,  1.63it/s]
 41%|████      | 4548/11049 [46:50<1:06:28,  1.63it/s]
                                                      
{'loss': 0.2603, 'grad_norm': 0.548081636428833, 'learning_rate': 7.322432258595789e-06, 'epoch': 1.23}

 41%|████      | 4548/11049 [46:51<1:06:28,  1.63it/s]
 41%|████      | 4549/11049 [46:51<1:06:26,  1.63it/s]
                                                      
{'loss': 0.3099, 'grad_norm': 0.6645945310592651, 'learning_rate': 7.321033242711496e-06, 'epoch': 1.24}

 41%|████      | 4549/11049 [46:51<1:06:26,  1.63it/s]
 41%|████      | 4550/11049 [46:52<1:06:27,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.6363844871520996, 'learning_rate': 7.319633995163031e-06, 'epoch': 1.24}

 41%|████      | 4550/11049 [46:52<1:06:27,  1.63it/s]
 41%|████      | 4551/11049 [46:52<1:06:26,  1.63it/s]
                                                      
{'loss': 0.2211, 'grad_norm': 0.6549098491668701, 'learning_rate': 7.318234516090057e-06, 'epoch': 1.24}

 41%|████      | 4551/11049 [46:52<1:06:26,  1.63it/s]
 41%|████      | 4552/11049 [46:53<1:06:23,  1.63it/s]
                                                      
{'loss': 0.2834, 'grad_norm': 0.6384401321411133, 'learning_rate': 7.316834805632253e-06, 'epoch': 1.24}

 41%|████      | 4552/11049 [46:53<1:06:23,  1.63it/s]
 41%|████      | 4553/11049 [46:53<1:06:22,  1.63it/s]
                                                      
{'loss': 0.2106, 'grad_norm': 0.5804531574249268, 'learning_rate': 7.315434863929332e-06, 'epoch': 1.24}

 41%|████      | 4553/11049 [46:54<1:06:22,  1.63it/s]
 41%|████      | 4554/11049 [46:54<1:06:23,  1.63it/s]
                                                      
{'loss': 0.1854, 'grad_norm': 0.5079825520515442, 'learning_rate': 7.314034691121015e-06, 'epoch': 1.24}

 41%|████      | 4554/11049 [46:54<1:06:23,  1.63it/s]
 41%|████      | 4555/11049 [46:55<1:06:22,  1.63it/s]
                                                      
{'loss': 0.2031, 'grad_norm': 0.5396477580070496, 'learning_rate': 7.312634287347058e-06, 'epoch': 1.24}

 41%|████      | 4555/11049 [46:55<1:06:22,  1.63it/s]
 41%|████      | 4556/11049 [46:55<1:06:24,  1.63it/s]
                                                      
{'loss': 0.2297, 'grad_norm': 0.6331663727760315, 'learning_rate': 7.311233652747237e-06, 'epoch': 1.24}

 41%|████      | 4556/11049 [46:55<1:06:24,  1.63it/s]
 41%|████      | 4557/11049 [46:56<1:06:21,  1.63it/s]
                                                      
{'loss': 0.2226, 'grad_norm': 0.5674672722816467, 'learning_rate': 7.30983278746135e-06, 'epoch': 1.24}

 41%|████      | 4557/11049 [46:56<1:06:21,  1.63it/s]
 41%|████▏     | 4558/11049 [46:57<1:06:21,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.6886334419250488, 'learning_rate': 7.308431691629219e-06, 'epoch': 1.24}

 41%|████▏     | 4558/11049 [46:57<1:06:21,  1.63it/s]
 41%|████▏     | 4559/11049 [46:57<1:06:20,  1.63it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.5230036973953247, 'learning_rate': 7.3070303653906885e-06, 'epoch': 1.24}

 41%|████▏     | 4559/11049 [46:57<1:06:20,  1.63it/s]
 41%|████▏     | 4560/11049 [46:58<1:06:20,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.49683472514152527, 'learning_rate': 7.305628808885624e-06, 'epoch': 1.24}

 41%|████▏     | 4560/11049 [46:58<1:06:20,  1.63it/s]
 41%|████▏     | 4561/11049 [46:58<1:06:19,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.519791841506958, 'learning_rate': 7.304227022253918e-06, 'epoch': 1.24}

 41%|████▏     | 4561/11049 [46:59<1:06:19,  1.63it/s]
 41%|████▏     | 4562/11049 [46:59<1:06:17,  1.63it/s]
                                                      
{'loss': 0.2357, 'grad_norm': 0.6194198727607727, 'learning_rate': 7.3028250056354845e-06, 'epoch': 1.24}

 41%|████▏     | 4562/11049 [46:59<1:06:17,  1.63it/s]
 41%|████▏     | 4563/11049 [47:00<1:06:18,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.456267774105072, 'learning_rate': 7.301422759170258e-06, 'epoch': 1.24}

 41%|████▏     | 4563/11049 [47:00<1:06:18,  1.63it/s]
 41%|████▏     | 4564/11049 [47:00<1:06:17,  1.63it/s]
                                                      
{'loss': 0.2344, 'grad_norm': 0.5424749851226807, 'learning_rate': 7.300020282998197e-06, 'epoch': 1.24}

 41%|████▏     | 4564/11049 [47:00<1:06:17,  1.63it/s]
 41%|████▏     | 4565/11049 [47:01<1:06:18,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.4744739830493927, 'learning_rate': 7.298617577259286e-06, 'epoch': 1.24}

 41%|████▏     | 4565/11049 [47:01<1:06:18,  1.63it/s]
 41%|████▏     | 4566/11049 [47:01<1:06:19,  1.63it/s]
                                                      
{'loss': 0.2051, 'grad_norm': 0.5029618740081787, 'learning_rate': 7.297214642093531e-06, 'epoch': 1.24}

 41%|████▏     | 4566/11049 [47:02<1:06:19,  1.63it/s]
 41%|████▏     | 4567/11049 [47:02<1:06:17,  1.63it/s]
                                                      
{'loss': 0.239, 'grad_norm': 0.5778845548629761, 'learning_rate': 7.295811477640957e-06, 'epoch': 1.24}

 41%|████▏     | 4567/11049 [47:02<1:06:17,  1.63it/s]
 41%|████▏     | 4568/11049 [47:03<1:06:16,  1.63it/s]
                                                      
{'loss': 0.2528, 'grad_norm': 0.5385228395462036, 'learning_rate': 7.2944080840416165e-06, 'epoch': 1.24}

 41%|████▏     | 4568/11049 [47:03<1:06:16,  1.63it/s]
 41%|████▏     | 4569/11049 [47:03<1:06:15,  1.63it/s]
                                                      
{'loss': 0.192, 'grad_norm': 0.5332502126693726, 'learning_rate': 7.2930044614355844e-06, 'epoch': 1.24}

 41%|████▏     | 4569/11049 [47:03<1:06:15,  1.63it/s]
 41%|████▏     | 4570/11049 [47:04<1:06:13,  1.63it/s]
                                                      
{'loss': 0.2074, 'grad_norm': 0.536492645740509, 'learning_rate': 7.291600609962954e-06, 'epoch': 1.24}

 41%|████▏     | 4570/11049 [47:04<1:06:13,  1.63it/s]
 41%|████▏     | 4571/11049 [47:05<1:06:15,  1.63it/s]
                                                      
{'loss': 0.2316, 'grad_norm': 0.6173723340034485, 'learning_rate': 7.2901965297638515e-06, 'epoch': 1.24}

 41%|████▏     | 4571/11049 [47:05<1:06:15,  1.63it/s]
 41%|████▏     | 4572/11049 [47:05<1:06:16,  1.63it/s]
                                                      
{'loss': 0.288, 'grad_norm': 0.6036096215248108, 'learning_rate': 7.28879222097841e-06, 'epoch': 1.24}

 41%|████▏     | 4572/11049 [47:05<1:06:16,  1.63it/s]
 41%|████▏     | 4573/11049 [47:06<1:06:12,  1.63it/s]
                                                      
{'loss': 0.23, 'grad_norm': 0.5892199277877808, 'learning_rate': 7.287387683746803e-06, 'epoch': 1.24}

 41%|████▏     | 4573/11049 [47:06<1:06:12,  1.63it/s]
 41%|████▏     | 4574/11049 [47:06<1:06:11,  1.63it/s]
                                                      
{'loss': 0.3044, 'grad_norm': 0.7041106820106506, 'learning_rate': 7.285982918209212e-06, 'epoch': 1.24}

 41%|████▏     | 4574/11049 [47:06<1:06:11,  1.63it/s]
 41%|████▏     | 4575/11049 [47:07<1:06:13,  1.63it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.4821462631225586, 'learning_rate': 7.284577924505854e-06, 'epoch': 1.24}

 41%|████▏     | 4575/11049 [47:07<1:06:13,  1.63it/s]
 41%|████▏     | 4576/11049 [47:08<1:06:10,  1.63it/s]
                                                      
{'loss': 0.2188, 'grad_norm': 0.5644552707672119, 'learning_rate': 7.283172702776958e-06, 'epoch': 1.24}

 41%|████▏     | 4576/11049 [47:08<1:06:10,  1.63it/s]
 41%|████▏     | 4577/11049 [47:08<1:06:09,  1.63it/s]
                                                      
{'loss': 0.1877, 'grad_norm': 0.5197551846504211, 'learning_rate': 7.281767253162781e-06, 'epoch': 1.24}

 41%|████▏     | 4577/11049 [47:08<1:06:09,  1.63it/s]
 41%|████▏     | 4578/11049 [47:09<1:06:08,  1.63it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.5961931347846985, 'learning_rate': 7.280361575803604e-06, 'epoch': 1.24}

 41%|████▏     | 4578/11049 [47:09<1:06:08,  1.63it/s]
 41%|████▏     | 4579/11049 [47:09<1:06:07,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.47429314255714417, 'learning_rate': 7.278955670839727e-06, 'epoch': 1.24}

 41%|████▏     | 4579/11049 [47:10<1:06:07,  1.63it/s]
 41%|████▏     | 4580/11049 [47:10<1:06:08,  1.63it/s]
                                                      
{'loss': 0.2029, 'grad_norm': 0.5706098675727844, 'learning_rate': 7.277549538411474e-06, 'epoch': 1.24}

 41%|████▏     | 4580/11049 [47:10<1:06:08,  1.63it/s]
 41%|████▏     | 4581/11049 [47:11<1:06:08,  1.63it/s]
                                                      
{'loss': 0.3422, 'grad_norm': 0.8342635035514832, 'learning_rate': 7.276143178659195e-06, 'epoch': 1.24}

 41%|████▏     | 4581/11049 [47:11<1:06:08,  1.63it/s]
 41%|████▏     | 4582/11049 [47:11<1:06:06,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5716354250907898, 'learning_rate': 7.274736591723257e-06, 'epoch': 1.24}

 41%|████▏     | 4582/11049 [47:11<1:06:06,  1.63it/s]
 41%|████▏     | 4583/11049 [47:12<1:06:06,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.5127363204956055, 'learning_rate': 7.2733297777440534e-06, 'epoch': 1.24}

 41%|████▏     | 4583/11049 [47:12<1:06:06,  1.63it/s]
 41%|████▏     | 4584/11049 [47:13<1:06:07,  1.63it/s]
                                                      
{'loss': 0.2247, 'grad_norm': 0.619616687297821, 'learning_rate': 7.271922736862e-06, 'epoch': 1.24}

 41%|████▏     | 4584/11049 [47:13<1:06:07,  1.63it/s]
 41%|████▏     | 4585/11049 [47:13<1:06:05,  1.63it/s]
                                                      
{'loss': 0.2425, 'grad_norm': 0.566917359828949, 'learning_rate': 7.2705154692175335e-06, 'epoch': 1.24}

 41%|████▏     | 4585/11049 [47:13<1:06:05,  1.63it/s]
 42%|████▏     | 4586/11049 [47:14<1:06:05,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.6128536462783813, 'learning_rate': 7.269107974951116e-06, 'epoch': 1.25}

 42%|████▏     | 4586/11049 [47:14<1:06:05,  1.63it/s]
 42%|████▏     | 4587/11049 [47:14<1:06:03,  1.63it/s]
                                                      
{'loss': 0.2571, 'grad_norm': 0.5782426595687866, 'learning_rate': 7.2677002542032305e-06, 'epoch': 1.25}

 42%|████▏     | 4587/11049 [47:14<1:06:03,  1.63it/s]
 42%|████▏     | 4588/11049 [47:15<1:06:02,  1.63it/s]
                                                      
{'loss': 0.2096, 'grad_norm': 0.48936405777931213, 'learning_rate': 7.2662923071143795e-06, 'epoch': 1.25}

 42%|████▏     | 4588/11049 [47:15<1:06:02,  1.63it/s]
 42%|████▏     | 4589/11049 [47:16<1:06:01,  1.63it/s]
                                                      
{'loss': 0.1429, 'grad_norm': 0.4303365647792816, 'learning_rate': 7.264884133825098e-06, 'epoch': 1.25}

 42%|████▏     | 4589/11049 [47:16<1:06:01,  1.63it/s]
 42%|████▏     | 4590/11049 [47:16<1:06:00,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.5819830298423767, 'learning_rate': 7.263475734475929e-06, 'epoch': 1.25}

 42%|████▏     | 4590/11049 [47:16<1:06:00,  1.63it/s]
 42%|████▏     | 4591/11049 [47:17<1:05:59,  1.63it/s]
                                                      
{'loss': 0.2283, 'grad_norm': 0.5596053600311279, 'learning_rate': 7.262067109207451e-06, 'epoch': 1.25}

 42%|████▏     | 4591/11049 [47:17<1:05:59,  1.63it/s]
 42%|████▏     | 4592/11049 [47:17<1:05:59,  1.63it/s]
                                                      
{'loss': 0.158, 'grad_norm': 0.4886259436607361, 'learning_rate': 7.260658258160258e-06, 'epoch': 1.25}

 42%|████▏     | 4592/11049 [47:18<1:05:59,  1.63it/s]
 42%|████▏     | 4593/11049 [47:18<1:05:59,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.5074151158332825, 'learning_rate': 7.25924918147497e-06, 'epoch': 1.25}

 42%|████▏     | 4593/11049 [47:18<1:05:59,  1.63it/s]
 42%|████▏     | 4594/11049 [47:19<1:05:58,  1.63it/s]
                                                      
{'loss': 0.1797, 'grad_norm': 0.5280094146728516, 'learning_rate': 7.257839879292228e-06, 'epoch': 1.25}

 42%|████▏     | 4594/11049 [47:19<1:05:58,  1.63it/s]
 42%|████▏     | 4595/11049 [47:19<1:05:56,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.5907701253890991, 'learning_rate': 7.256430351752695e-06, 'epoch': 1.25}

 42%|████▏     | 4595/11049 [47:19<1:05:56,  1.63it/s]
 42%|████▏     | 4596/11049 [47:20<1:06:01,  1.63it/s]
                                                      
{'loss': 0.2185, 'grad_norm': 0.48473888635635376, 'learning_rate': 7.2550205989970556e-06, 'epoch': 1.25}

 42%|████▏     | 4596/11049 [47:20<1:06:01,  1.63it/s]
 42%|████▏     | 4597/11049 [47:20<1:06:02,  1.63it/s]
                                                      
{'loss': 0.2873, 'grad_norm': 0.6829701066017151, 'learning_rate': 7.25361062116602e-06, 'epoch': 1.25}

 42%|████▏     | 4597/11049 [47:21<1:06:02,  1.63it/s]
 42%|████▏     | 4598/11049 [47:21<1:06:01,  1.63it/s]
                                                      
{'loss': 0.2553, 'grad_norm': 0.6939176917076111, 'learning_rate': 7.252200418400319e-06, 'epoch': 1.25}

 42%|████▏     | 4598/11049 [47:21<1:06:01,  1.63it/s]
 42%|████▏     | 4599/11049 [47:22<1:05:57,  1.63it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.4885557293891907, 'learning_rate': 7.250789990840706e-06, 'epoch': 1.25}

 42%|████▏     | 4599/11049 [47:22<1:05:57,  1.63it/s]
 42%|████▏     | 4600/11049 [47:22<1:05:56,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5578957796096802, 'learning_rate': 7.249379338627956e-06, 'epoch': 1.25}

 42%|████▏     | 4600/11049 [47:22<1:05:56,  1.63it/s]
 42%|████▏     | 4601/11049 [47:23<1:05:55,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.5683695077896118, 'learning_rate': 7.24796846190287e-06, 'epoch': 1.25}

 42%|████▏     | 4601/11049 [47:23<1:05:55,  1.63it/s]
 42%|████▏     | 4602/11049 [47:24<1:05:54,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5698198080062866, 'learning_rate': 7.246557360806267e-06, 'epoch': 1.25}

 42%|████▏     | 4602/11049 [47:24<1:05:54,  1.63it/s]
 42%|████▏     | 4603/11049 [47:24<1:05:52,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5069187879562378, 'learning_rate': 7.245146035478989e-06, 'epoch': 1.25}

 42%|████▏     | 4603/11049 [47:24<1:05:52,  1.63it/s]
 42%|████▏     | 4604/11049 [47:25<1:05:52,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.6291337013244629, 'learning_rate': 7.243734486061902e-06, 'epoch': 1.25}

 42%|████▏     | 4604/11049 [47:25<1:05:52,  1.63it/s]
 42%|████▏     | 4605/11049 [47:25<1:05:54,  1.63it/s]
                                                      
{'loss': 0.2397, 'grad_norm': 0.6313735246658325, 'learning_rate': 7.242322712695895e-06, 'epoch': 1.25}

 42%|████▏     | 4605/11049 [47:26<1:05:54,  1.63it/s]
 42%|████▏     | 4606/11049 [47:26<1:05:53,  1.63it/s]
                                                      
{'loss': 0.3397, 'grad_norm': 0.5920049548149109, 'learning_rate': 7.240910715521876e-06, 'epoch': 1.25}

 42%|████▏     | 4606/11049 [47:26<1:05:53,  1.63it/s]
 42%|████▏     | 4607/11049 [47:27<1:05:53,  1.63it/s]
                                                      
{'loss': 0.2099, 'grad_norm': 0.5602432489395142, 'learning_rate': 7.239498494680782e-06, 'epoch': 1.25}

 42%|████▏     | 4607/11049 [47:27<1:05:53,  1.63it/s]
 42%|████▏     | 4608/11049 [47:27<1:05:51,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.45347413420677185, 'learning_rate': 7.238086050313563e-06, 'epoch': 1.25}

 42%|████▏     | 4608/11049 [47:27<1:05:51,  1.63it/s]
 42%|████▏     | 4609/11049 [47:28<1:05:50,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.5905593633651733, 'learning_rate': 7.236673382561199e-06, 'epoch': 1.25}

 42%|████▏     | 4609/11049 [47:28<1:05:50,  1.63it/s]
 42%|████▏     | 4610/11049 [47:28<1:05:50,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.5131399035453796, 'learning_rate': 7.235260491564689e-06, 'epoch': 1.25}

 42%|████▏     | 4610/11049 [47:29<1:05:50,  1.63it/s]
 42%|████▏     | 4611/11049 [47:29<1:05:51,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.4558643102645874, 'learning_rate': 7.2338473774650544e-06, 'epoch': 1.25}

 42%|████▏     | 4611/11049 [47:29<1:05:51,  1.63it/s]
 42%|████▏     | 4612/11049 [47:30<1:05:53,  1.63it/s]
                                                      
{'loss': 0.2373, 'grad_norm': 0.646149218082428, 'learning_rate': 7.232434040403339e-06, 'epoch': 1.25}

 42%|████▏     | 4612/11049 [47:30<1:05:53,  1.63it/s]
 42%|████▏     | 4613/11049 [47:30<1:05:51,  1.63it/s]
                                                      
{'loss': 0.2345, 'grad_norm': 0.6645445823669434, 'learning_rate': 7.23102048052061e-06, 'epoch': 1.25}

 42%|████▏     | 4613/11049 [47:30<1:05:51,  1.63it/s]
 42%|████▏     | 4614/11049 [47:31<1:05:49,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.49746227264404297, 'learning_rate': 7.229606697957954e-06, 'epoch': 1.25}

 42%|████▏     | 4614/11049 [47:31<1:05:49,  1.63it/s]
 42%|████▏     | 4615/11049 [47:32<1:05:48,  1.63it/s]
                                                      
{'loss': 0.1797, 'grad_norm': 0.5211661458015442, 'learning_rate': 7.228192692856484e-06, 'epoch': 1.25}

 42%|████▏     | 4615/11049 [47:32<1:05:48,  1.63it/s]
 42%|████▏     | 4616/11049 [47:32<1:05:46,  1.63it/s]
                                                      
{'loss': 0.2395, 'grad_norm': 0.5641416311264038, 'learning_rate': 7.226778465357333e-06, 'epoch': 1.25}

 42%|████▏     | 4616/11049 [47:32<1:05:46,  1.63it/s]
 42%|████▏     | 4617/11049 [47:33<1:05:44,  1.63it/s]
                                                      
{'loss': 0.3272, 'grad_norm': 0.6232919692993164, 'learning_rate': 7.225364015601655e-06, 'epoch': 1.25}

 42%|████▏     | 4617/11049 [47:33<1:05:44,  1.63it/s]
 42%|████▏     | 4618/11049 [47:33<1:05:43,  1.63it/s]
                                                      
{'loss': 0.214, 'grad_norm': 0.6133518218994141, 'learning_rate': 7.223949343730626e-06, 'epoch': 1.25}

 42%|████▏     | 4618/11049 [47:33<1:05:43,  1.63it/s]
 42%|████▏     | 4619/11049 [47:34<1:05:41,  1.63it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.5726110339164734, 'learning_rate': 7.222534449885447e-06, 'epoch': 1.25}

 42%|████▏     | 4619/11049 [47:34<1:05:41,  1.63it/s]
 42%|████▏     | 4620/11049 [47:35<1:05:42,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5356442928314209, 'learning_rate': 7.221119334207343e-06, 'epoch': 1.25}

 42%|████▏     | 4620/11049 [47:35<1:05:42,  1.63it/s]
 42%|████▏     | 4621/11049 [47:35<1:05:43,  1.63it/s]
                                                      
{'loss': 0.2326, 'grad_norm': 0.5883350372314453, 'learning_rate': 7.219703996837552e-06, 'epoch': 1.25}

 42%|████▏     | 4621/11049 [47:35<1:05:43,  1.63it/s]
 42%|████▏     | 4622/11049 [47:36<1:05:41,  1.63it/s]
                                                      
{'loss': 0.2653, 'grad_norm': 0.5790131688117981, 'learning_rate': 7.218288437917344e-06, 'epoch': 1.25}

 42%|████▏     | 4622/11049 [47:36<1:05:41,  1.63it/s]
 42%|████▏     | 4623/11049 [47:36<1:05:41,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.5436123609542847, 'learning_rate': 7.216872657588004e-06, 'epoch': 1.26}

 42%|████▏     | 4623/11049 [47:37<1:05:41,  1.63it/s]
 42%|████▏     | 4624/11049 [47:37<1:05:39,  1.63it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.6046703457832336, 'learning_rate': 7.2154566559908445e-06, 'epoch': 1.26}

 42%|████▏     | 4624/11049 [47:37<1:05:39,  1.63it/s]
 42%|████▏     | 4625/11049 [47:38<1:05:38,  1.63it/s]
                                                      
{'loss': 0.2318, 'grad_norm': 0.620478093624115, 'learning_rate': 7.2140404332671986e-06, 'epoch': 1.26}

 42%|████▏     | 4625/11049 [47:38<1:05:38,  1.63it/s]
 42%|████▏     | 4626/11049 [47:38<1:05:37,  1.63it/s]
                                                      
{'loss': 0.2058, 'grad_norm': 0.5616418123245239, 'learning_rate': 7.212623989558417e-06, 'epoch': 1.26}

 42%|████▏     | 4626/11049 [47:38<1:05:37,  1.63it/s]
 42%|████▏     | 4627/11049 [47:39<1:05:36,  1.63it/s]
                                                      
{'loss': 0.1823, 'grad_norm': 0.5042847990989685, 'learning_rate': 7.211207325005879e-06, 'epoch': 1.26}

 42%|████▏     | 4627/11049 [47:39<1:05:36,  1.63it/s]
 42%|████▏     | 4628/11049 [47:39<1:05:36,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.41195595264434814, 'learning_rate': 7.209790439750981e-06, 'epoch': 1.26}

 42%|████▏     | 4628/11049 [47:40<1:05:36,  1.63it/s]
 42%|████▏     | 4629/11049 [47:40<1:05:36,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.536491870880127, 'learning_rate': 7.208373333935147e-06, 'epoch': 1.26}

 42%|████▏     | 4629/11049 [47:40<1:05:36,  1.63it/s]
 42%|████▏     | 4630/11049 [47:41<1:05:34,  1.63it/s]
                                                      
{'loss': 0.2572, 'grad_norm': 0.6140702366828918, 'learning_rate': 7.206956007699816e-06, 'epoch': 1.26}

 42%|████▏     | 4630/11049 [47:41<1:05:34,  1.63it/s]
 42%|████▏     | 4631/11049 [47:41<1:05:35,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.5224387049674988, 'learning_rate': 7.2055384611864535e-06, 'epoch': 1.26}

 42%|████▏     | 4631/11049 [47:41<1:05:35,  1.63it/s]
 42%|████▏     | 4632/11049 [47:42<1:05:36,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.44014087319374084, 'learning_rate': 7.204120694536545e-06, 'epoch': 1.26}

 42%|████▏     | 4632/11049 [47:42<1:05:36,  1.63it/s]
 42%|████▏     | 4633/11049 [47:43<1:05:35,  1.63it/s]
                                                      
{'loss': 0.1763, 'grad_norm': 0.48588183522224426, 'learning_rate': 7.2027027078916e-06, 'epoch': 1.26}

 42%|████▏     | 4633/11049 [47:43<1:05:35,  1.63it/s]
 42%|████▏     | 4634/11049 [47:43<1:05:33,  1.63it/s]
                                                      
{'loss': 0.1323, 'grad_norm': 0.45585209131240845, 'learning_rate': 7.20128450139315e-06, 'epoch': 1.26}

 42%|████▏     | 4634/11049 [47:43<1:05:33,  1.63it/s]
 42%|████▏     | 4635/11049 [47:44<1:05:33,  1.63it/s]
                                                      
{'loss': 0.1905, 'grad_norm': 0.5047506093978882, 'learning_rate': 7.199866075182745e-06, 'epoch': 1.26}

 42%|████▏     | 4635/11049 [47:44<1:05:33,  1.63it/s]
 42%|████▏     | 4636/11049 [47:44<1:05:32,  1.63it/s]
                                                      
{'loss': 0.1648, 'grad_norm': 0.4266566336154938, 'learning_rate': 7.19844742940196e-06, 'epoch': 1.26}

 42%|████▏     | 4636/11049 [47:45<1:05:32,  1.63it/s]
 42%|████▏     | 4637/11049 [47:45<1:05:31,  1.63it/s]
                                                      
{'loss': 0.1903, 'grad_norm': 0.5482882261276245, 'learning_rate': 7.197028564192393e-06, 'epoch': 1.26}

 42%|████▏     | 4637/11049 [47:45<1:05:31,  1.63it/s]
 42%|████▏     | 4638/11049 [47:46<1:05:30,  1.63it/s]
                                                      
{'loss': 0.2153, 'grad_norm': 0.5658442974090576, 'learning_rate': 7.19560947969566e-06, 'epoch': 1.26}

 42%|████▏     | 4638/11049 [47:46<1:05:30,  1.63it/s]
 42%|████▏     | 4639/11049 [47:46<1:05:30,  1.63it/s]
                                                      
{'loss': 0.1567, 'grad_norm': 0.44048377871513367, 'learning_rate': 7.194190176053402e-06, 'epoch': 1.26}

 42%|████▏     | 4639/11049 [47:46<1:05:30,  1.63it/s]
 42%|████▏     | 4640/11049 [47:47<1:05:28,  1.63it/s]
                                                      
{'loss': 0.2015, 'grad_norm': 0.5533556342124939, 'learning_rate': 7.192770653407278e-06, 'epoch': 1.26}

 42%|████▏     | 4640/11049 [47:47<1:05:28,  1.63it/s]
 42%|████▏     | 4641/11049 [47:47<1:05:28,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.4769097566604614, 'learning_rate': 7.191350911898975e-06, 'epoch': 1.26}

 42%|████▏     | 4641/11049 [47:48<1:05:28,  1.63it/s]
 42%|████▏     | 4642/11049 [47:48<1:05:27,  1.63it/s]
                                                      
{'loss': 0.2662, 'grad_norm': 0.6381403207778931, 'learning_rate': 7.1899309516701984e-06, 'epoch': 1.26}

 42%|████▏     | 4642/11049 [47:48<1:05:27,  1.63it/s]
 42%|████▏     | 4643/11049 [47:49<1:05:25,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5697143077850342, 'learning_rate': 7.1885107728626755e-06, 'epoch': 1.26}

 42%|████▏     | 4643/11049 [47:49<1:05:25,  1.63it/s]
 42%|████▏     | 4644/11049 [47:49<1:05:25,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.6396663784980774, 'learning_rate': 7.187090375618153e-06, 'epoch': 1.26}

 42%|████▏     | 4644/11049 [47:49<1:05:25,  1.63it/s]
 42%|████▏     | 4645/11049 [47:50<1:05:26,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.49725887179374695, 'learning_rate': 7.185669760078404e-06, 'epoch': 1.26}

 42%|████▏     | 4645/11049 [47:50<1:05:26,  1.63it/s]
 42%|████▏     | 4646/11049 [47:51<1:05:27,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.4672998785972595, 'learning_rate': 7.18424892638522e-06, 'epoch': 1.26}

 42%|████▏     | 4646/11049 [47:51<1:05:27,  1.63it/s]
 42%|████▏     | 4647/11049 [47:51<1:05:26,  1.63it/s]
                                                      
{'loss': 0.14, 'grad_norm': 0.4141799509525299, 'learning_rate': 7.182827874680417e-06, 'epoch': 1.26}

 42%|████▏     | 4647/11049 [47:51<1:05:26,  1.63it/s]
 42%|████▏     | 4648/11049 [47:52<1:05:25,  1.63it/s]
                                                      
{'loss': 0.2578, 'grad_norm': 0.5853084325790405, 'learning_rate': 7.1814066051058305e-06, 'epoch': 1.26}

 42%|████▏     | 4648/11049 [47:52<1:05:25,  1.63it/s]
 42%|████▏     | 4649/11049 [47:52<1:05:24,  1.63it/s]
                                                      
{'loss': 0.236, 'grad_norm': 0.6335649490356445, 'learning_rate': 7.17998511780332e-06, 'epoch': 1.26}

 42%|████▏     | 4649/11049 [47:53<1:05:24,  1.63it/s]
 42%|████▏     | 4650/11049 [47:53<1:05:24,  1.63it/s]
                                                      
{'loss': 0.2229, 'grad_norm': 0.5740398168563843, 'learning_rate': 7.178563412914762e-06, 'epoch': 1.26}

 42%|████▏     | 4650/11049 [47:53<1:05:24,  1.63it/s]
 42%|████▏     | 4651/11049 [47:54<1:05:25,  1.63it/s]
                                                      
{'loss': 0.2538, 'grad_norm': 0.5724152326583862, 'learning_rate': 7.1771414905820605e-06, 'epoch': 1.26}

 42%|████▏     | 4651/11049 [47:54<1:05:25,  1.63it/s]
 42%|████▏     | 4652/11049 [47:54<1:05:22,  1.63it/s]
                                                      
{'loss': 0.2611, 'grad_norm': 0.663630485534668, 'learning_rate': 7.175719350947139e-06, 'epoch': 1.26}

 42%|████▏     | 4652/11049 [47:54<1:05:22,  1.63it/s]
 42%|████▏     | 4653/11049 [47:55<1:05:22,  1.63it/s]
                                                      
{'loss': 0.158, 'grad_norm': 0.44116029143333435, 'learning_rate': 7.174296994151942e-06, 'epoch': 1.26}

 42%|████▏     | 4653/11049 [47:55<1:05:22,  1.63it/s]
 42%|████▏     | 4654/11049 [47:55<1:05:22,  1.63it/s]
                                                      
{'loss': 0.2388, 'grad_norm': 0.5862175226211548, 'learning_rate': 7.172874420338432e-06, 'epoch': 1.26}

 42%|████▏     | 4654/11049 [47:56<1:05:22,  1.63it/s]
 42%|████▏     | 4655/11049 [47:56<1:05:21,  1.63it/s]
                                                      
{'loss': 0.2545, 'grad_norm': 0.6608795523643494, 'learning_rate': 7.171451629648605e-06, 'epoch': 1.26}

 42%|████▏     | 4655/11049 [47:56<1:05:21,  1.63it/s]
 42%|████▏     | 4656/11049 [47:57<1:05:22,  1.63it/s]
                                                      
{'loss': 0.1583, 'grad_norm': 0.4286808669567108, 'learning_rate': 7.170028622224464e-06, 'epoch': 1.26}

 42%|████▏     | 4656/11049 [47:57<1:05:22,  1.63it/s]
 42%|████▏     | 4657/11049 [47:57<1:05:21,  1.63it/s]
                                                      
{'loss': 0.1916, 'grad_norm': 0.4762780964374542, 'learning_rate': 7.1686053982080454e-06, 'epoch': 1.26}

 42%|████▏     | 4657/11049 [47:57<1:05:21,  1.63it/s]
 42%|████▏     | 4658/11049 [47:58<1:05:20,  1.63it/s]
                                                      
{'loss': 0.1796, 'grad_norm': 0.4919593930244446, 'learning_rate': 7.167181957741398e-06, 'epoch': 1.26}

 42%|████▏     | 4658/11049 [47:58<1:05:20,  1.63it/s]
 42%|████▏     | 4659/11049 [47:59<1:05:19,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.5789428949356079, 'learning_rate': 7.165758300966598e-06, 'epoch': 1.27}

 42%|████▏     | 4659/11049 [47:59<1:05:19,  1.63it/s]
 42%|████▏     | 4660/11049 [47:59<1:05:18,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.4989633858203888, 'learning_rate': 7.164334428025746e-06, 'epoch': 1.27}

 42%|████▏     | 4660/11049 [47:59<1:05:18,  1.63it/s]
 42%|████▏     | 4661/11049 [48:00<1:05:17,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.6164021492004395, 'learning_rate': 7.162910339060953e-06, 'epoch': 1.27}

 42%|████▏     | 4661/11049 [48:00<1:05:17,  1.63it/s]
 42%|████▏     | 4662/11049 [48:00<1:05:15,  1.63it/s]
                                                      
{'loss': 0.1791, 'grad_norm': 0.47984468936920166, 'learning_rate': 7.161486034214364e-06, 'epoch': 1.27}

 42%|████▏     | 4662/11049 [48:00<1:05:15,  1.63it/s]
 42%|████▏     | 4663/11049 [48:01<1:05:30,  1.62it/s]
                                                      
{'loss': 0.1676, 'grad_norm': 0.5115903615951538, 'learning_rate': 7.160061513628135e-06, 'epoch': 1.27}

 42%|████▏     | 4663/11049 [48:01<1:05:30,  1.62it/s]
 42%|████▏     | 4664/11049 [48:02<1:05:26,  1.63it/s]
                                                      
{'loss': 0.2551, 'grad_norm': 0.6018791198730469, 'learning_rate': 7.158636777444453e-06, 'epoch': 1.27}

 42%|████▏     | 4664/11049 [48:02<1:05:26,  1.63it/s]
 42%|████▏     | 4665/11049 [48:02<1:05:22,  1.63it/s]
                                                      
{'loss': 0.2457, 'grad_norm': 0.5684438347816467, 'learning_rate': 7.157211825805519e-06, 'epoch': 1.27}

 42%|████▏     | 4665/11049 [48:02<1:05:22,  1.63it/s]
 42%|████▏     | 4666/11049 [48:03<1:05:21,  1.63it/s]
                                                      
{'loss': 0.1619, 'grad_norm': 0.4402773380279541, 'learning_rate': 7.155786658853562e-06, 'epoch': 1.27}

 42%|████▏     | 4666/11049 [48:03<1:05:21,  1.63it/s]
 42%|████▏     | 4667/11049 [48:03<1:05:18,  1.63it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.6543629765510559, 'learning_rate': 7.1543612767308245e-06, 'epoch': 1.27}

 42%|████▏     | 4667/11049 [48:04<1:05:18,  1.63it/s]
 42%|████▏     | 4668/11049 [48:04<1:05:16,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5229619145393372, 'learning_rate': 7.152935679579579e-06, 'epoch': 1.27}

 42%|████▏     | 4668/11049 [48:04<1:05:16,  1.63it/s]
 42%|████▏     | 4669/11049 [48:05<1:05:14,  1.63it/s]
                                                      
{'loss': 0.1741, 'grad_norm': 0.5207884907722473, 'learning_rate': 7.1515098675421125e-06, 'epoch': 1.27}

 42%|████▏     | 4669/11049 [48:05<1:05:14,  1.63it/s]
 42%|████▏     | 4670/11049 [48:05<1:05:20,  1.63it/s]
                                                      
{'loss': 0.2669, 'grad_norm': 0.6528804302215576, 'learning_rate': 7.150083840760738e-06, 'epoch': 1.27}

 42%|████▏     | 4670/11049 [48:05<1:05:20,  1.63it/s]
 42%|████▏     | 4671/11049 [48:06<1:05:21,  1.63it/s]
                                                      
{'loss': 0.2192, 'grad_norm': 0.5738148093223572, 'learning_rate': 7.148657599377789e-06, 'epoch': 1.27}

 42%|████▏     | 4671/11049 [48:06<1:05:21,  1.63it/s]
 42%|████▏     | 4672/11049 [48:06<1:05:18,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5049803256988525, 'learning_rate': 7.147231143535619e-06, 'epoch': 1.27}

 42%|████▏     | 4672/11049 [48:07<1:05:18,  1.63it/s]
 42%|████▏     | 4673/11049 [48:07<1:05:14,  1.63it/s]
                                                      
{'loss': 0.2705, 'grad_norm': 0.5542808771133423, 'learning_rate': 7.1458044733766026e-06, 'epoch': 1.27}

 42%|████▏     | 4673/11049 [48:07<1:05:14,  1.63it/s]
 42%|████▏     | 4674/11049 [48:08<1:05:12,  1.63it/s]
                                                      
{'loss': 0.2095, 'grad_norm': 0.5147750377655029, 'learning_rate': 7.144377589043139e-06, 'epoch': 1.27}

 42%|████▏     | 4674/11049 [48:08<1:05:12,  1.63it/s]
 42%|████▏     | 4675/11049 [48:08<1:05:11,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.5254802703857422, 'learning_rate': 7.142950490677645e-06, 'epoch': 1.27}

 42%|████▏     | 4675/11049 [48:08<1:05:11,  1.63it/s]
 42%|████▏     | 4676/11049 [48:09<1:05:12,  1.63it/s]
                                                      
{'loss': 0.177, 'grad_norm': 0.5158929228782654, 'learning_rate': 7.141523178422561e-06, 'epoch': 1.27}

 42%|████▏     | 4676/11049 [48:09<1:05:12,  1.63it/s]
 42%|████▏     | 4677/11049 [48:10<1:05:11,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5798036456108093, 'learning_rate': 7.140095652420348e-06, 'epoch': 1.27}

 42%|████▏     | 4677/11049 [48:10<1:05:11,  1.63it/s]
 42%|████▏     | 4678/11049 [48:10<1:05:10,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.6096295118331909, 'learning_rate': 7.138667912813489e-06, 'epoch': 1.27}

 42%|████▏     | 4678/11049 [48:10<1:05:10,  1.63it/s]
 42%|████▏     | 4679/11049 [48:11<1:05:07,  1.63it/s]
                                                      
{'loss': 0.1614, 'grad_norm': 0.49882668256759644, 'learning_rate': 7.137239959744488e-06, 'epoch': 1.27}

 42%|████▏     | 4679/11049 [48:11<1:05:07,  1.63it/s]
 42%|████▏     | 4680/11049 [48:11<1:05:05,  1.63it/s]
                                                      
{'loss': 0.227, 'grad_norm': 0.6640221476554871, 'learning_rate': 7.135811793355869e-06, 'epoch': 1.27}

 42%|████▏     | 4680/11049 [48:12<1:05:05,  1.63it/s]
 42%|████▏     | 4681/11049 [48:12<1:05:08,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.48968935012817383, 'learning_rate': 7.134383413790178e-06, 'epoch': 1.27}

 42%|████▏     | 4681/11049 [48:12<1:05:08,  1.63it/s]
 42%|████▏     | 4682/11049 [48:13<1:05:06,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5396154522895813, 'learning_rate': 7.132954821189986e-06, 'epoch': 1.27}

 42%|████▏     | 4682/11049 [48:13<1:05:06,  1.63it/s]
 42%|████▏     | 4683/11049 [48:13<1:05:06,  1.63it/s]
                                                      
{'loss': 0.2496, 'grad_norm': 0.6122333407402039, 'learning_rate': 7.1315260156978775e-06, 'epoch': 1.27}

 42%|████▏     | 4683/11049 [48:13<1:05:06,  1.63it/s]
 42%|████▏     | 4684/11049 [48:14<1:05:05,  1.63it/s]
                                                      
{'loss': 0.2137, 'grad_norm': 0.6200014352798462, 'learning_rate': 7.130096997456466e-06, 'epoch': 1.27}

 42%|████▏     | 4684/11049 [48:14<1:05:05,  1.63it/s]
 42%|████▏     | 4685/11049 [48:14<1:05:04,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5675703883171082, 'learning_rate': 7.128667766608382e-06, 'epoch': 1.27}

 42%|████▏     | 4685/11049 [48:15<1:05:04,  1.63it/s]
 42%|████▏     | 4686/11049 [48:15<1:05:06,  1.63it/s]
                                                      
{'loss': 0.1974, 'grad_norm': 0.49164578318595886, 'learning_rate': 7.127238323296277e-06, 'epoch': 1.27}

 42%|████▏     | 4686/11049 [48:15<1:05:06,  1.63it/s]
 42%|████▏     | 4687/11049 [48:16<1:05:03,  1.63it/s]
                                                      
{'loss': 0.1681, 'grad_norm': 0.4858565330505371, 'learning_rate': 7.125808667662826e-06, 'epoch': 1.27}

 42%|████▏     | 4687/11049 [48:16<1:05:03,  1.63it/s]
 42%|████▏     | 4688/11049 [48:16<1:05:01,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5357088446617126, 'learning_rate': 7.124378799850725e-06, 'epoch': 1.27}

 42%|████▏     | 4688/11049 [48:16<1:05:01,  1.63it/s]
 42%|████▏     | 4689/11049 [48:17<1:05:01,  1.63it/s]
                                                      
{'loss': 0.1775, 'grad_norm': 0.48967358469963074, 'learning_rate': 7.122948720002689e-06, 'epoch': 1.27}

 42%|████▏     | 4689/11049 [48:17<1:05:01,  1.63it/s]
 42%|████▏     | 4690/11049 [48:18<1:05:00,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.49372366070747375, 'learning_rate': 7.121518428261456e-06, 'epoch': 1.27}

 42%|████▏     | 4690/11049 [48:18<1:05:00,  1.63it/s]
 42%|████▏     | 4691/11049 [48:18<1:05:03,  1.63it/s]
                                                      
{'loss': 0.2763, 'grad_norm': 0.6104577779769897, 'learning_rate': 7.120087924769783e-06, 'epoch': 1.27}

 42%|████▏     | 4691/11049 [48:18<1:05:03,  1.63it/s]
 42%|████▏     | 4692/11049 [48:19<1:05:02,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.5169108510017395, 'learning_rate': 7.1186572096704505e-06, 'epoch': 1.27}

 42%|████▏     | 4692/11049 [48:19<1:05:02,  1.63it/s]
 42%|████▏     | 4693/11049 [48:19<1:05:02,  1.63it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.5109142065048218, 'learning_rate': 7.117226283106261e-06, 'epoch': 1.27}

 42%|████▏     | 4693/11049 [48:20<1:05:02,  1.63it/s]
 42%|████▏     | 4694/11049 [48:20<1:05:00,  1.63it/s]
                                                      
{'loss': 0.2607, 'grad_norm': 0.5161202549934387, 'learning_rate': 7.115795145220035e-06, 'epoch': 1.27}

 42%|████▏     | 4694/11049 [48:20<1:05:00,  1.63it/s]
 42%|████▏     | 4695/11049 [48:21<1:04:58,  1.63it/s]
                                                      
{'loss': 0.1904, 'grad_norm': 0.5326066613197327, 'learning_rate': 7.114363796154615e-06, 'epoch': 1.27}

 42%|████▏     | 4695/11049 [48:21<1:04:58,  1.63it/s]
 43%|████▎     | 4696/11049 [48:21<1:05:02,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.42831850051879883, 'learning_rate': 7.112932236052866e-06, 'epoch': 1.28}

 43%|████▎     | 4696/11049 [48:21<1:05:02,  1.63it/s]
 43%|████▎     | 4697/11049 [48:22<1:04:59,  1.63it/s]
                                                      
{'loss': 0.1897, 'grad_norm': 0.4912678599357605, 'learning_rate': 7.111500465057673e-06, 'epoch': 1.28}

 43%|████▎     | 4697/11049 [48:22<1:04:59,  1.63it/s]
 43%|████▎     | 4698/11049 [48:22<1:04:57,  1.63it/s]
                                                      
{'loss': 0.2028, 'grad_norm': 0.4935404658317566, 'learning_rate': 7.110068483311942e-06, 'epoch': 1.28}

 43%|████▎     | 4698/11049 [48:23<1:04:57,  1.63it/s]
 43%|████▎     | 4699/11049 [48:23<1:04:59,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5729981064796448, 'learning_rate': 7.108636290958599e-06, 'epoch': 1.28}

 43%|████▎     | 4699/11049 [48:23<1:04:59,  1.63it/s]
 43%|████▎     | 4700/11049 [48:24<1:04:58,  1.63it/s]
                                                      
{'loss': 0.246, 'grad_norm': 0.6205300688743591, 'learning_rate': 7.107203888140595e-06, 'epoch': 1.28}

 43%|████▎     | 4700/11049 [48:24<1:04:58,  1.63it/s]
 43%|████▎     | 4701/11049 [48:24<1:05:00,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.5091855525970459, 'learning_rate': 7.105771275000895e-06, 'epoch': 1.28}

 43%|████▎     | 4701/11049 [48:24<1:05:00,  1.63it/s]
 43%|████▎     | 4702/11049 [48:25<1:04:57,  1.63it/s]
                                                      
{'loss': 0.1753, 'grad_norm': 0.48038196563720703, 'learning_rate': 7.1043384516824965e-06, 'epoch': 1.28}

 43%|████▎     | 4702/11049 [48:25<1:04:57,  1.63it/s]
 43%|████▎     | 4703/11049 [48:26<1:04:55,  1.63it/s]
                                                      
{'loss': 0.1837, 'grad_norm': 0.47323426604270935, 'learning_rate': 7.102905418328403e-06, 'epoch': 1.28}

 43%|████▎     | 4703/11049 [48:26<1:04:55,  1.63it/s]
 43%|████▎     | 4704/11049 [48:26<1:04:52,  1.63it/s]
                                                      
{'loss': 0.202, 'grad_norm': 0.5332029461860657, 'learning_rate': 7.1014721750816515e-06, 'epoch': 1.28}

 43%|████▎     | 4704/11049 [48:26<1:04:52,  1.63it/s]
 43%|████▎     | 4705/11049 [48:27<1:04:51,  1.63it/s]
                                                      
{'loss': 0.1671, 'grad_norm': 0.45077160000801086, 'learning_rate': 7.100038722085291e-06, 'epoch': 1.28}

 43%|████▎     | 4705/11049 [48:27<1:04:51,  1.63it/s]
 43%|████▎     | 4706/11049 [48:27<1:04:55,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.5116531252861023, 'learning_rate': 7.098605059482402e-06, 'epoch': 1.28}

 43%|████▎     | 4706/11049 [48:27<1:04:55,  1.63it/s]
 43%|████▎     | 4707/11049 [48:28<1:04:52,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.44450995326042175, 'learning_rate': 7.097171187416075e-06, 'epoch': 1.28}

 43%|████▎     | 4707/11049 [48:28<1:04:52,  1.63it/s]
 43%|████▎     | 4708/11049 [48:29<1:04:51,  1.63it/s]
                                                      
{'loss': 0.1885, 'grad_norm': 0.5609542727470398, 'learning_rate': 7.0957371060294245e-06, 'epoch': 1.28}

 43%|████▎     | 4708/11049 [48:29<1:04:51,  1.63it/s]
 43%|████▎     | 4709/11049 [48:29<1:04:52,  1.63it/s]
                                                      
{'loss': 0.2152, 'grad_norm': 0.5622610449790955, 'learning_rate': 7.094302815465589e-06, 'epoch': 1.28}

 43%|████▎     | 4709/11049 [48:29<1:04:52,  1.63it/s]
 43%|████▎     | 4710/11049 [48:30<1:04:51,  1.63it/s]
                                                      
{'loss': 0.1865, 'grad_norm': 0.46229323744773865, 'learning_rate': 7.092868315867729e-06, 'epoch': 1.28}

 43%|████▎     | 4710/11049 [48:30<1:04:51,  1.63it/s]
 43%|████▎     | 4711/11049 [48:30<1:04:58,  1.63it/s]
                                                      
{'loss': 0.2127, 'grad_norm': 0.5397927761077881, 'learning_rate': 7.091433607379019e-06, 'epoch': 1.28}

 43%|████▎     | 4711/11049 [48:31<1:04:58,  1.63it/s]
 43%|████▎     | 4712/11049 [48:31<1:04:55,  1.63it/s]
                                                      
{'loss': 0.2387, 'grad_norm': 0.581931471824646, 'learning_rate': 7.089998690142661e-06, 'epoch': 1.28}

 43%|████▎     | 4712/11049 [48:31<1:04:55,  1.63it/s]
 43%|████▎     | 4713/11049 [48:32<1:04:51,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.49685361981391907, 'learning_rate': 7.088563564301874e-06, 'epoch': 1.28}

 43%|████▎     | 4713/11049 [48:32<1:04:51,  1.63it/s]
 43%|████▎     | 4714/11049 [48:32<1:04:50,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5449318289756775, 'learning_rate': 7.087128229999899e-06, 'epoch': 1.28}

 43%|████▎     | 4714/11049 [48:32<1:04:50,  1.63it/s]
 43%|████▎     | 4715/11049 [48:33<1:04:50,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.47755393385887146, 'learning_rate': 7.085692687379998e-06, 'epoch': 1.28}

 43%|████▎     | 4715/11049 [48:33<1:04:50,  1.63it/s]
 43%|████▎     | 4716/11049 [48:33<1:04:47,  1.63it/s]
                                                      
{'loss': 0.1916, 'grad_norm': 0.5542322397232056, 'learning_rate': 7.0842569365854545e-06, 'epoch': 1.28}

 43%|████▎     | 4716/11049 [48:34<1:04:47,  1.63it/s]
 43%|████▎     | 4717/11049 [48:34<1:04:46,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5294020771980286, 'learning_rate': 7.08282097775957e-06, 'epoch': 1.28}

 43%|████▎     | 4717/11049 [48:34<1:04:46,  1.63it/s]
 43%|████▎     | 4718/11049 [48:35<1:04:44,  1.63it/s]
                                                      
{'loss': 0.3306, 'grad_norm': 0.7488822340965271, 'learning_rate': 7.081384811045671e-06, 'epoch': 1.28}

 43%|████▎     | 4718/11049 [48:35<1:04:44,  1.63it/s]
 43%|████▎     | 4719/11049 [48:35<1:04:43,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.5554578304290771, 'learning_rate': 7.079948436587102e-06, 'epoch': 1.28}

 43%|████▎     | 4719/11049 [48:35<1:04:43,  1.63it/s]
 43%|████▎     | 4720/11049 [48:36<1:04:43,  1.63it/s]
                                                      
{'loss': 0.1929, 'grad_norm': 0.5243895053863525, 'learning_rate': 7.078511854527227e-06, 'epoch': 1.28}

 43%|████▎     | 4720/11049 [48:36<1:04:43,  1.63it/s]
 43%|████▎     | 4721/11049 [48:37<1:04:43,  1.63it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.5797778964042664, 'learning_rate': 7.0770750650094335e-06, 'epoch': 1.28}

 43%|████▎     | 4721/11049 [48:37<1:04:43,  1.63it/s]
 43%|████▎     | 4722/11049 [48:37<1:04:41,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5456773638725281, 'learning_rate': 7.075638068177128e-06, 'epoch': 1.28}

 43%|████▎     | 4722/11049 [48:37<1:04:41,  1.63it/s]
 43%|████▎     | 4723/11049 [48:38<1:04:42,  1.63it/s]
                                                      
{'loss': 0.1459, 'grad_norm': 0.41989338397979736, 'learning_rate': 7.074200864173739e-06, 'epoch': 1.28}

 43%|████▎     | 4723/11049 [48:38<1:04:42,  1.63it/s]
 43%|████▎     | 4724/11049 [48:38<1:04:41,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.5559402108192444, 'learning_rate': 7.0727634531427155e-06, 'epoch': 1.28}

 43%|████▎     | 4724/11049 [48:39<1:04:41,  1.63it/s]
 43%|████▎     | 4725/11049 [48:39<1:04:40,  1.63it/s]
                                                      
{'loss': 0.2219, 'grad_norm': 0.5979130268096924, 'learning_rate': 7.071325835227526e-06, 'epoch': 1.28}

 43%|████▎     | 4725/11049 [48:39<1:04:40,  1.63it/s]
 43%|████▎     | 4726/11049 [48:40<1:04:39,  1.63it/s]
                                                      
{'loss': 0.1902, 'grad_norm': 0.517915666103363, 'learning_rate': 7.069888010571659e-06, 'epoch': 1.28}

 43%|████▎     | 4726/11049 [48:40<1:04:39,  1.63it/s]
 43%|████▎     | 4727/11049 [48:40<1:04:41,  1.63it/s]
                                                      
{'loss': 0.2029, 'grad_norm': 0.4866320788860321, 'learning_rate': 7.068449979318627e-06, 'epoch': 1.28}

 43%|████▎     | 4727/11049 [48:40<1:04:41,  1.63it/s]
 43%|████▎     | 4728/11049 [48:41<1:04:39,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.5520447492599487, 'learning_rate': 7.06701174161196e-06, 'epoch': 1.28}

 43%|████▎     | 4728/11049 [48:41<1:04:39,  1.63it/s]
 43%|████▎     | 4729/11049 [48:41<1:04:38,  1.63it/s]
                                                      
{'loss': 0.2476, 'grad_norm': 0.5877320766448975, 'learning_rate': 7.065573297595211e-06, 'epoch': 1.28}

 43%|████▎     | 4729/11049 [48:42<1:04:38,  1.63it/s]
 43%|████▎     | 4730/11049 [48:42<1:04:39,  1.63it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.4877263009548187, 'learning_rate': 7.06413464741195e-06, 'epoch': 1.28}

 43%|████▎     | 4730/11049 [48:42<1:04:39,  1.63it/s]
 43%|████▎     | 4731/11049 [48:43<1:04:37,  1.63it/s]
                                                      
{'loss': 0.2703, 'grad_norm': 0.5548197031021118, 'learning_rate': 7.06269579120577e-06, 'epoch': 1.28}

 43%|████▎     | 4731/11049 [48:43<1:04:37,  1.63it/s]
 43%|████▎     | 4732/11049 [48:43<1:04:36,  1.63it/s]
                                                      
{'loss': 0.1961, 'grad_norm': 0.5122336745262146, 'learning_rate': 7.061256729120287e-06, 'epoch': 1.28}

 43%|████▎     | 4732/11049 [48:43<1:04:36,  1.63it/s]
 43%|████▎     | 4733/11049 [48:44<1:04:35,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.4472793936729431, 'learning_rate': 7.0598174612991325e-06, 'epoch': 1.29}

 43%|████▎     | 4733/11049 [48:44<1:04:35,  1.63it/s]
 43%|████▎     | 4734/11049 [48:45<1:04:33,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.4883841872215271, 'learning_rate': 7.058377987885962e-06, 'epoch': 1.29}

 43%|████▎     | 4734/11049 [48:45<1:04:33,  1.63it/s]
 43%|████▎     | 4735/11049 [48:45<1:04:33,  1.63it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5528733730316162, 'learning_rate': 7.056938309024448e-06, 'epoch': 1.29}

 43%|████▎     | 4735/11049 [48:45<1:04:33,  1.63it/s]
 43%|████▎     | 4736/11049 [48:46<1:04:33,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.5364716053009033, 'learning_rate': 7.055498424858291e-06, 'epoch': 1.29}

 43%|████▎     | 4736/11049 [48:46<1:04:33,  1.63it/s]
 43%|████▎     | 4737/11049 [48:46<1:04:33,  1.63it/s]
                                                      
{'loss': 0.2416, 'grad_norm': 0.5918809771537781, 'learning_rate': 7.054058335531203e-06, 'epoch': 1.29}

 43%|████▎     | 4737/11049 [48:47<1:04:33,  1.63it/s]
 43%|████▎     | 4738/11049 [48:47<1:04:33,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.5011526942253113, 'learning_rate': 7.052618041186921e-06, 'epoch': 1.29}

 43%|████▎     | 4738/11049 [48:47<1:04:33,  1.63it/s]
 43%|████▎     | 4739/11049 [48:48<1:04:32,  1.63it/s]
                                                      
{'loss': 0.1924, 'grad_norm': 0.48718568682670593, 'learning_rate': 7.051177541969203e-06, 'epoch': 1.29}

 43%|████▎     | 4739/11049 [48:48<1:04:32,  1.63it/s]
 43%|████▎     | 4740/11049 [48:48<1:04:29,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.4760110080242157, 'learning_rate': 7.049736838021826e-06, 'epoch': 1.29}

 43%|████▎     | 4740/11049 [48:48<1:04:29,  1.63it/s]
 43%|████▎     | 4741/11049 [48:49<1:04:28,  1.63it/s]
                                                      
{'loss': 0.2151, 'grad_norm': 0.5909498333930969, 'learning_rate': 7.048295929488586e-06, 'epoch': 1.29}

 43%|████▎     | 4741/11049 [48:49<1:04:28,  1.63it/s]
 43%|████▎     | 4742/11049 [48:49<1:04:28,  1.63it/s]
                                                      
{'loss': 0.2355, 'grad_norm': 0.5814022421836853, 'learning_rate': 7.046854816513307e-06, 'epoch': 1.29}

 43%|████▎     | 4742/11049 [48:50<1:04:28,  1.63it/s]
 43%|████▎     | 4743/11049 [48:50<1:04:28,  1.63it/s]
                                                      
{'loss': 0.1596, 'grad_norm': 0.46819087862968445, 'learning_rate': 7.045413499239819e-06, 'epoch': 1.29}

 43%|████▎     | 4743/11049 [48:50<1:04:28,  1.63it/s]
 43%|████▎     | 4744/11049 [48:51<1:04:29,  1.63it/s]
                                                      
{'loss': 0.2179, 'grad_norm': 0.5358622670173645, 'learning_rate': 7.043971977811989e-06, 'epoch': 1.29}

 43%|████▎     | 4744/11049 [48:51<1:04:29,  1.63it/s]
 43%|████▎     | 4745/11049 [48:51<1:04:28,  1.63it/s]
                                                      
{'loss': 0.2175, 'grad_norm': 0.5096713304519653, 'learning_rate': 7.0425302523736906e-06, 'epoch': 1.29}

 43%|████▎     | 4745/11049 [48:51<1:04:28,  1.63it/s]
 43%|████▎     | 4746/11049 [48:52<1:04:26,  1.63it/s]
                                                      
{'loss': 0.312, 'grad_norm': 0.7766284942626953, 'learning_rate': 7.041088323068827e-06, 'epoch': 1.29}

 43%|████▎     | 4746/11049 [48:52<1:04:26,  1.63it/s]
 43%|████▎     | 4747/11049 [48:53<1:04:25,  1.63it/s]
                                                      
{'loss': 0.2457, 'grad_norm': 0.562502384185791, 'learning_rate': 7.039646190041317e-06, 'epoch': 1.29}

 43%|████▎     | 4747/11049 [48:53<1:04:25,  1.63it/s]
 43%|████▎     | 4748/11049 [48:53<1:04:24,  1.63it/s]
                                                      
{'loss': 0.1977, 'grad_norm': 0.5556446313858032, 'learning_rate': 7.0382038534351015e-06, 'epoch': 1.29}

 43%|████▎     | 4748/11049 [48:53<1:04:24,  1.63it/s]
 43%|████▎     | 4749/11049 [48:54<1:04:22,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.4162636995315552, 'learning_rate': 7.03676131339414e-06, 'epoch': 1.29}

 43%|████▎     | 4749/11049 [48:54<1:04:22,  1.63it/s]
 43%|████▎     | 4750/11049 [48:54<1:04:23,  1.63it/s]
                                                      
{'loss': 0.2344, 'grad_norm': 0.6408532857894897, 'learning_rate': 7.035318570062416e-06, 'epoch': 1.29}

 43%|████▎     | 4750/11049 [48:54<1:04:23,  1.63it/s]
 43%|████▎     | 4751/11049 [48:55<1:04:25,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.5560809373855591, 'learning_rate': 7.033875623583929e-06, 'epoch': 1.29}

 43%|████▎     | 4751/11049 [48:55<1:04:25,  1.63it/s]
 43%|████▎     | 4752/11049 [48:56<1:04:21,  1.63it/s]
                                                      
{'loss': 0.2583, 'grad_norm': 0.6489850282669067, 'learning_rate': 7.0324324741027015e-06, 'epoch': 1.29}

 43%|████▎     | 4752/11049 [48:56<1:04:21,  1.63it/s]
 43%|████▎     | 4753/11049 [48:56<1:04:22,  1.63it/s]
                                                      
{'loss': 0.2471, 'grad_norm': 0.5774222016334534, 'learning_rate': 7.030989121762773e-06, 'epoch': 1.29}

 43%|████▎     | 4753/11049 [48:56<1:04:22,  1.63it/s]
 43%|████▎     | 4754/11049 [48:57<1:04:20,  1.63it/s]
                                                      
{'loss': 0.1824, 'grad_norm': 0.46866440773010254, 'learning_rate': 7.029545566708209e-06, 'epoch': 1.29}

 43%|████▎     | 4754/11049 [48:57<1:04:20,  1.63it/s]
 43%|████▎     | 4755/11049 [48:57<1:04:21,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.5741530656814575, 'learning_rate': 7.028101809083091e-06, 'epoch': 1.29}

 43%|████▎     | 4755/11049 [48:58<1:04:21,  1.63it/s]
 43%|████▎     | 4756/11049 [48:58<1:04:21,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.5232309103012085, 'learning_rate': 7.0266578490315205e-06, 'epoch': 1.29}

 43%|████▎     | 4756/11049 [48:58<1:04:21,  1.63it/s]
 43%|████▎     | 4757/11049 [48:59<1:04:20,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.5899201035499573, 'learning_rate': 7.0252136866976205e-06, 'epoch': 1.29}

 43%|████▎     | 4757/11049 [48:59<1:04:20,  1.63it/s]
 43%|████▎     | 4758/11049 [48:59<1:04:20,  1.63it/s]
                                                      
{'loss': 0.1933, 'grad_norm': 0.5930355787277222, 'learning_rate': 7.023769322225535e-06, 'epoch': 1.29}

 43%|████▎     | 4758/11049 [48:59<1:04:20,  1.63it/s]
 43%|████▎     | 4759/11049 [49:00<1:04:20,  1.63it/s]
                                                      
{'loss': 0.2458, 'grad_norm': 0.631470263004303, 'learning_rate': 7.022324755759427e-06, 'epoch': 1.29}

 43%|████▎     | 4759/11049 [49:00<1:04:20,  1.63it/s]
 43%|████▎     | 4760/11049 [49:00<1:04:18,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.49796929955482483, 'learning_rate': 7.020879987443479e-06, 'epoch': 1.29}

 43%|████▎     | 4760/11049 [49:01<1:04:18,  1.63it/s]
 43%|████▎     | 4761/11049 [49:01<1:04:16,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.5542773008346558, 'learning_rate': 7.019435017421894e-06, 'epoch': 1.29}

 43%|████▎     | 4761/11049 [49:01<1:04:16,  1.63it/s]
 43%|████▎     | 4762/11049 [49:02<1:04:15,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.518100380897522, 'learning_rate': 7.017989845838897e-06, 'epoch': 1.29}

 43%|████▎     | 4762/11049 [49:02<1:04:15,  1.63it/s]
 43%|████▎     | 4763/11049 [49:02<1:04:15,  1.63it/s]
                                                      
{'loss': 0.1668, 'grad_norm': 0.4464030861854553, 'learning_rate': 7.016544472838731e-06, 'epoch': 1.29}

 43%|████▎     | 4763/11049 [49:02<1:04:15,  1.63it/s]
 43%|████▎     | 4764/11049 [49:03<1:04:13,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.6044167876243591, 'learning_rate': 7.01509889856566e-06, 'epoch': 1.29}

 43%|████▎     | 4764/11049 [49:03<1:04:13,  1.63it/s]
 43%|████▎     | 4765/11049 [49:04<1:04:12,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.5388491749763489, 'learning_rate': 7.013653123163968e-06, 'epoch': 1.29}

 43%|████▎     | 4765/11049 [49:04<1:04:12,  1.63it/s]
 43%|████▎     | 4766/11049 [49:04<1:04:13,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.5399492979049683, 'learning_rate': 7.01220714677796e-06, 'epoch': 1.29}

 43%|████▎     | 4766/11049 [49:04<1:04:13,  1.63it/s]
 43%|████▎     | 4767/11049 [49:05<1:04:12,  1.63it/s]
                                                      
{'loss': 0.2668, 'grad_norm': 0.5518444776535034, 'learning_rate': 7.010760969551957e-06, 'epoch': 1.29}

 43%|████▎     | 4767/11049 [49:05<1:04:12,  1.63it/s]
 43%|████▎     | 4768/11049 [49:05<1:04:10,  1.63it/s]
                                                      
{'loss': 0.2184, 'grad_norm': 0.672767162322998, 'learning_rate': 7.009314591630306e-06, 'epoch': 1.29}

 43%|████▎     | 4768/11049 [49:06<1:04:10,  1.63it/s]
 43%|████▎     | 4769/11049 [49:06<1:04:11,  1.63it/s]
                                                      
{'loss': 0.2217, 'grad_norm': 0.6261075139045715, 'learning_rate': 7.0078680131573704e-06, 'epoch': 1.29}

 43%|████▎     | 4769/11049 [49:06<1:04:11,  1.63it/s]
 43%|████▎     | 4770/11049 [49:07<1:04:10,  1.63it/s]
                                                      
{'loss': 0.1635, 'grad_norm': 0.48484620451927185, 'learning_rate': 7.006421234277535e-06, 'epoch': 1.3}

 43%|████▎     | 4770/11049 [49:07<1:04:10,  1.63it/s]
 43%|████▎     | 4771/11049 [49:07<1:04:08,  1.63it/s]
                                                      
{'loss': 0.1613, 'grad_norm': 0.4889867305755615, 'learning_rate': 7.004974255135201e-06, 'epoch': 1.3}

 43%|████▎     | 4771/11049 [49:07<1:04:08,  1.63it/s]
 43%|████▎     | 4772/11049 [49:08<1:04:07,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5585346221923828, 'learning_rate': 7.003527075874796e-06, 'epoch': 1.3}

 43%|████▎     | 4772/11049 [49:08<1:04:07,  1.63it/s]
 43%|████▎     | 4773/11049 [49:08<1:04:08,  1.63it/s]
                                                      
{'loss': 0.3034, 'grad_norm': 0.6331030130386353, 'learning_rate': 7.002079696640762e-06, 'epoch': 1.3}

 43%|████▎     | 4773/11049 [49:09<1:04:08,  1.63it/s]
 43%|████▎     | 4774/11049 [49:09<1:04:06,  1.63it/s]
                                                      
{'loss': 0.2088, 'grad_norm': 0.5384357571601868, 'learning_rate': 7.0006321175775645e-06, 'epoch': 1.3}

 43%|████▎     | 4774/11049 [49:09<1:04:06,  1.63it/s]
 43%|████▎     | 4775/11049 [49:10<1:04:05,  1.63it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.5495900511741638, 'learning_rate': 6.999184338829685e-06, 'epoch': 1.3}

 43%|████▎     | 4775/11049 [49:10<1:04:05,  1.63it/s]
 43%|████▎     | 4776/11049 [49:10<1:04:22,  1.62it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.5085257291793823, 'learning_rate': 6.9977363605416315e-06, 'epoch': 1.3}

 43%|████▎     | 4776/11049 [49:10<1:04:22,  1.62it/s]
 43%|████▎     | 4777/11049 [49:11<1:04:17,  1.63it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.5041742920875549, 'learning_rate': 6.996288182857924e-06, 'epoch': 1.3}

 43%|████▎     | 4777/11049 [49:11<1:04:17,  1.63it/s]
 43%|████▎     | 4778/11049 [49:12<1:04:15,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.551737368106842, 'learning_rate': 6.994839805923111e-06, 'epoch': 1.3}

 43%|████▎     | 4778/11049 [49:12<1:04:15,  1.63it/s]
 43%|████▎     | 4779/11049 [49:12<1:04:14,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.49221986532211304, 'learning_rate': 6.9933912298817495e-06, 'epoch': 1.3}

 43%|████▎     | 4779/11049 [49:12<1:04:14,  1.63it/s]
 43%|████▎     | 4780/11049 [49:13<1:04:15,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.4733031988143921, 'learning_rate': 6.991942454878429e-06, 'epoch': 1.3}

 43%|████▎     | 4780/11049 [49:13<1:04:15,  1.63it/s]
 43%|████▎     | 4781/11049 [49:13<1:04:16,  1.63it/s]
                                                      
{'loss': 0.1577, 'grad_norm': 0.4624043405056, 'learning_rate': 6.990493481057747e-06, 'epoch': 1.3}

 43%|████▎     | 4781/11049 [49:14<1:04:16,  1.63it/s]
 43%|████▎     | 4782/11049 [49:14<1:04:11,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5297869443893433, 'learning_rate': 6.989044308564334e-06, 'epoch': 1.3}

 43%|████▎     | 4782/11049 [49:14<1:04:11,  1.63it/s]
 43%|████▎     | 4783/11049 [49:15<1:04:06,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.5956019163131714, 'learning_rate': 6.987594937542827e-06, 'epoch': 1.3}

 43%|████▎     | 4783/11049 [49:15<1:04:06,  1.63it/s]
 43%|████▎     | 4784/11049 [49:15<1:04:05,  1.63it/s]
                                                      
{'loss': 0.2747, 'grad_norm': 0.7970921993255615, 'learning_rate': 6.986145368137892e-06, 'epoch': 1.3}

 43%|████▎     | 4784/11049 [49:15<1:04:05,  1.63it/s]
 43%|████▎     | 4785/11049 [49:16<1:04:10,  1.63it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.57075434923172, 'learning_rate': 6.98469560049421e-06, 'epoch': 1.3}

 43%|████▎     | 4785/11049 [49:16<1:04:10,  1.63it/s]
 43%|████▎     | 4786/11049 [49:16<1:04:10,  1.63it/s]
                                                      
{'loss': 0.2459, 'grad_norm': 0.6514935493469238, 'learning_rate': 6.983245634756485e-06, 'epoch': 1.3}

 43%|████▎     | 4786/11049 [49:17<1:04:10,  1.63it/s]
 43%|████▎     | 4787/11049 [49:17<1:04:06,  1.63it/s]
                                                      
{'loss': 0.319, 'grad_norm': 0.6443817019462585, 'learning_rate': 6.981795471069439e-06, 'epoch': 1.3}

 43%|████▎     | 4787/11049 [49:17<1:04:06,  1.63it/s]
 43%|████▎     | 4788/11049 [49:18<1:04:02,  1.63it/s]
                                                      
{'loss': 0.2918, 'grad_norm': 0.7613065242767334, 'learning_rate': 6.980345109577813e-06, 'epoch': 1.3}

 43%|████▎     | 4788/11049 [49:18<1:04:02,  1.63it/s]
 43%|████▎     | 4789/11049 [49:18<1:04:02,  1.63it/s]
                                                      
{'loss': 0.2698, 'grad_norm': 0.8036392331123352, 'learning_rate': 6.978894550426367e-06, 'epoch': 1.3}

 43%|████▎     | 4789/11049 [49:18<1:04:02,  1.63it/s]
 43%|████▎     | 4790/11049 [49:19<1:04:07,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5830223560333252, 'learning_rate': 6.977443793759887e-06, 'epoch': 1.3}

 43%|████▎     | 4790/11049 [49:19<1:04:07,  1.63it/s]
 43%|████▎     | 4791/11049 [49:20<1:04:09,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.51220703125, 'learning_rate': 6.975992839723171e-06, 'epoch': 1.3}

 43%|████▎     | 4791/11049 [49:20<1:04:09,  1.63it/s]
 43%|████▎     | 4792/11049 [49:20<1:04:05,  1.63it/s]
                                                      
{'loss': 0.2204, 'grad_norm': 0.5895398855209351, 'learning_rate': 6.974541688461043e-06, 'epoch': 1.3}

 43%|████▎     | 4792/11049 [49:20<1:04:05,  1.63it/s]
 43%|████▎     | 4793/11049 [49:21<1:04:02,  1.63it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.6149721145629883, 'learning_rate': 6.9730903401183384e-06, 'epoch': 1.3}

 43%|████▎     | 4793/11049 [49:21<1:04:02,  1.63it/s]
 43%|████▎     | 4794/11049 [49:21<1:04:00,  1.63it/s]
                                                      
{'loss': 0.2025, 'grad_norm': 0.5343292951583862, 'learning_rate': 6.9716387948399215e-06, 'epoch': 1.3}

 43%|████▎     | 4794/11049 [49:22<1:04:00,  1.63it/s]
 43%|████▎     | 4795/11049 [49:22<1:04:04,  1.63it/s]
                                                      
{'loss': 0.2301, 'grad_norm': 0.5368140935897827, 'learning_rate': 6.970187052770669e-06, 'epoch': 1.3}

 43%|████▎     | 4795/11049 [49:22<1:04:04,  1.63it/s]
 43%|████▎     | 4796/11049 [49:23<1:04:21,  1.62it/s]
                                                      
{'loss': 0.223, 'grad_norm': 0.5565067529678345, 'learning_rate': 6.968735114055486e-06, 'epoch': 1.3}

 43%|████▎     | 4796/11049 [49:23<1:04:21,  1.62it/s]
 43%|████▎     | 4797/11049 [49:23<1:04:14,  1.62it/s]
                                                      
{'loss': 0.3009, 'grad_norm': 0.661718487739563, 'learning_rate': 6.967282978839285e-06, 'epoch': 1.3}

 43%|████▎     | 4797/11049 [49:23<1:04:14,  1.62it/s]
 43%|████▎     | 4798/11049 [49:24<1:04:08,  1.62it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.613359272480011, 'learning_rate': 6.965830647267009e-06, 'epoch': 1.3}

 43%|████▎     | 4798/11049 [49:24<1:04:08,  1.62it/s]
 43%|████▎     | 4799/11049 [49:24<1:04:03,  1.63it/s]
                                                      
{'loss': 0.2594, 'grad_norm': 0.4944392144680023, 'learning_rate': 6.964378119483615e-06, 'epoch': 1.3}

 43%|████▎     | 4799/11049 [49:25<1:04:03,  1.63it/s]
 43%|████▎     | 4800/11049 [49:25<1:04:05,  1.62it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5072950124740601, 'learning_rate': 6.962925395634082e-06, 'epoch': 1.3}

 43%|████▎     | 4800/11049 [49:25<1:04:05,  1.62it/s]
 43%|████▎     | 4801/11049 [49:26<1:04:04,  1.62it/s]
                                                      
{'loss': 0.2178, 'grad_norm': 0.575508177280426, 'learning_rate': 6.961472475863406e-06, 'epoch': 1.3}

 43%|████▎     | 4801/11049 [49:26<1:04:04,  1.62it/s]
 43%|████▎     | 4802/11049 [49:26<1:04:00,  1.63it/s]
                                                      
{'loss': 0.2467, 'grad_norm': 0.5773147344589233, 'learning_rate': 6.960019360316604e-06, 'epoch': 1.3}

 43%|████▎     | 4802/11049 [49:26<1:04:00,  1.63it/s]
 43%|████▎     | 4803/11049 [49:27<1:03:56,  1.63it/s]
                                                      
{'loss': 0.2131, 'grad_norm': 0.5695807337760925, 'learning_rate': 6.958566049138713e-06, 'epoch': 1.3}

 43%|████▎     | 4803/11049 [49:27<1:03:56,  1.63it/s]
 43%|████▎     | 4804/11049 [49:28<1:03:55,  1.63it/s]
                                                      
{'loss': 0.1732, 'grad_norm': 0.46025291085243225, 'learning_rate': 6.957112542474791e-06, 'epoch': 1.3}

 43%|████▎     | 4804/11049 [49:28<1:03:55,  1.63it/s]
 43%|████▎     | 4805/11049 [49:28<1:03:59,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.5833271145820618, 'learning_rate': 6.955658840469912e-06, 'epoch': 1.3}

 43%|████▎     | 4805/11049 [49:28<1:03:59,  1.63it/s]
 43%|████▎     | 4806/11049 [49:29<1:04:01,  1.63it/s]
                                                      
{'loss': 0.2721, 'grad_norm': 0.5716451406478882, 'learning_rate': 6.954204943269172e-06, 'epoch': 1.3}

 43%|████▎     | 4806/11049 [49:29<1:04:01,  1.63it/s]
 44%|████▎     | 4807/11049 [49:29<1:03:58,  1.63it/s]
                                                      
{'loss': 0.2494, 'grad_norm': 0.6358305215835571, 'learning_rate': 6.952750851017682e-06, 'epoch': 1.31}

 44%|████▎     | 4807/11049 [49:30<1:03:58,  1.63it/s]
 44%|████▎     | 4808/11049 [49:30<1:03:56,  1.63it/s]
                                                      
{'loss': 0.1755, 'grad_norm': 0.5508009195327759, 'learning_rate': 6.951296563860582e-06, 'epoch': 1.31}

 44%|████▎     | 4808/11049 [49:30<1:03:56,  1.63it/s]
 44%|████▎     | 4809/11049 [49:31<1:03:53,  1.63it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.46221819519996643, 'learning_rate': 6.949842081943021e-06, 'epoch': 1.31}

 44%|████▎     | 4809/11049 [49:31<1:03:53,  1.63it/s]
 44%|████▎     | 4810/11049 [49:31<1:03:54,  1.63it/s]
                                                      
{'loss': 0.1653, 'grad_norm': 0.5047316551208496, 'learning_rate': 6.948387405410175e-06, 'epoch': 1.31}

 44%|████▎     | 4810/11049 [49:31<1:03:54,  1.63it/s]
 44%|████▎     | 4811/11049 [49:32<1:03:55,  1.63it/s]
                                                      
{'loss': 0.2775, 'grad_norm': 0.6359925866127014, 'learning_rate': 6.946932534407234e-06, 'epoch': 1.31}

 44%|████▎     | 4811/11049 [49:32<1:03:55,  1.63it/s]
 44%|████▎     | 4812/11049 [49:32<1:03:52,  1.63it/s]
                                                      
{'loss': 0.2151, 'grad_norm': 0.588638424873352, 'learning_rate': 6.945477469079411e-06, 'epoch': 1.31}

 44%|████▎     | 4812/11049 [49:33<1:03:52,  1.63it/s]
 44%|████▎     | 4813/11049 [49:33<1:03:51,  1.63it/s]
                                                      
{'loss': 0.1672, 'grad_norm': 0.4631381332874298, 'learning_rate': 6.9440222095719365e-06, 'epoch': 1.31}

 44%|████▎     | 4813/11049 [49:33<1:03:51,  1.63it/s]
 44%|████▎     | 4814/11049 [49:34<1:03:48,  1.63it/s]
                                                      
{'loss': 0.1963, 'grad_norm': 0.5314608812332153, 'learning_rate': 6.942566756030063e-06, 'epoch': 1.31}

 44%|████▎     | 4814/11049 [49:34<1:03:48,  1.63it/s]
 44%|████▎     | 4815/11049 [49:34<1:03:46,  1.63it/s]
                                                      
{'loss': 0.228, 'grad_norm': 0.6161239147186279, 'learning_rate': 6.941111108599058e-06, 'epoch': 1.31}

 44%|████▎     | 4815/11049 [49:34<1:03:46,  1.63it/s]
 44%|████▎     | 4816/11049 [49:35<1:03:48,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.4383270740509033, 'learning_rate': 6.939655267424212e-06, 'epoch': 1.31}

 44%|████▎     | 4816/11049 [49:35<1:03:48,  1.63it/s]
 44%|████▎     | 4817/11049 [49:36<1:03:46,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.5104497671127319, 'learning_rate': 6.938199232650834e-06, 'epoch': 1.31}

 44%|████▎     | 4817/11049 [49:36<1:03:46,  1.63it/s]
 44%|████▎     | 4818/11049 [49:36<1:03:44,  1.63it/s]
                                                      
{'loss': 0.2362, 'grad_norm': 0.6188327074050903, 'learning_rate': 6.936743004424252e-06, 'epoch': 1.31}

 44%|████▎     | 4818/11049 [49:36<1:03:44,  1.63it/s]
 44%|████▎     | 4819/11049 [49:37<1:03:43,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.5584740042686462, 'learning_rate': 6.935286582889813e-06, 'epoch': 1.31}

 44%|████▎     | 4819/11049 [49:37<1:03:43,  1.63it/s]
 44%|████▎     | 4820/11049 [49:37<1:03:42,  1.63it/s]
                                                      
{'loss': 0.2513, 'grad_norm': 0.5642015337944031, 'learning_rate': 6.933829968192884e-06, 'epoch': 1.31}

 44%|████▎     | 4820/11049 [49:37<1:03:42,  1.63it/s]
 44%|████▎     | 4821/11049 [49:38<1:03:47,  1.63it/s]
                                                      
{'loss': 0.2405, 'grad_norm': 0.5224436521530151, 'learning_rate': 6.932373160478848e-06, 'epoch': 1.31}

 44%|████▎     | 4821/11049 [49:38<1:03:47,  1.63it/s]
 44%|████▎     | 4822/11049 [49:39<1:03:45,  1.63it/s]
                                                      
{'loss': 0.2246, 'grad_norm': 0.5395783185958862, 'learning_rate': 6.930916159893114e-06, 'epoch': 1.31}

 44%|████▎     | 4822/11049 [49:39<1:03:45,  1.63it/s]
 44%|████▎     | 4823/11049 [49:39<1:03:44,  1.63it/s]
                                                      
{'loss': 0.1664, 'grad_norm': 0.43834173679351807, 'learning_rate': 6.929458966581106e-06, 'epoch': 1.31}

 44%|████▎     | 4823/11049 [49:39<1:03:44,  1.63it/s]
 44%|████▎     | 4824/11049 [49:40<1:03:45,  1.63it/s]
                                                      
{'loss': 0.2406, 'grad_norm': 0.6092565059661865, 'learning_rate': 6.928001580688265e-06, 'epoch': 1.31}

 44%|████▎     | 4824/11049 [49:40<1:03:45,  1.63it/s]
 44%|████▎     | 4825/11049 [49:40<1:03:41,  1.63it/s]
                                                      
{'loss': 0.2153, 'grad_norm': 0.49528032541275024, 'learning_rate': 6.926544002360055e-06, 'epoch': 1.31}

 44%|████▎     | 4825/11049 [49:41<1:03:41,  1.63it/s]
 44%|████▎     | 4826/11049 [49:41<1:03:44,  1.63it/s]
                                                      
{'loss': 0.1844, 'grad_norm': 0.5124089121818542, 'learning_rate': 6.92508623174196e-06, 'epoch': 1.31}

 44%|████▎     | 4826/11049 [49:41<1:03:44,  1.63it/s]
 44%|████▎     | 4827/11049 [49:42<1:03:40,  1.63it/s]
                                                      
{'loss': 0.2008, 'grad_norm': 0.5329359173774719, 'learning_rate': 6.923628268979479e-06, 'epoch': 1.31}

 44%|████▎     | 4827/11049 [49:42<1:03:40,  1.63it/s]
 44%|████▎     | 4828/11049 [49:42<1:03:38,  1.63it/s]
                                                      
{'loss': 0.2023, 'grad_norm': 0.5031766295433044, 'learning_rate': 6.922170114218133e-06, 'epoch': 1.31}

 44%|████▎     | 4828/11049 [49:42<1:03:38,  1.63it/s]
 44%|████▎     | 4829/11049 [49:43<1:03:37,  1.63it/s]
                                                      
{'loss': 0.1719, 'grad_norm': 0.5860121846199036, 'learning_rate': 6.920711767603461e-06, 'epoch': 1.31}

 44%|████▎     | 4829/11049 [49:43<1:03:37,  1.63it/s]
 44%|████▎     | 4830/11049 [49:43<1:03:36,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.4503432512283325, 'learning_rate': 6.919253229281023e-06, 'epoch': 1.31}

 44%|████▎     | 4830/11049 [49:44<1:03:36,  1.63it/s]
 44%|████▎     | 4831/11049 [49:44<1:03:38,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5805190801620483, 'learning_rate': 6.917794499396397e-06, 'epoch': 1.31}

 44%|████▎     | 4831/11049 [49:44<1:03:38,  1.63it/s]
 44%|████▎     | 4832/11049 [49:45<1:03:36,  1.63it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.5241841077804565, 'learning_rate': 6.916335578095179e-06, 'epoch': 1.31}

 44%|████▎     | 4832/11049 [49:45<1:03:36,  1.63it/s]
 44%|████▎     | 4833/11049 [49:45<1:03:37,  1.63it/s]
                                                      
{'loss': 0.2223, 'grad_norm': 0.5975236296653748, 'learning_rate': 6.914876465522984e-06, 'epoch': 1.31}

 44%|████▎     | 4833/11049 [49:45<1:03:37,  1.63it/s]
 44%|████▍     | 4834/11049 [49:46<1:03:35,  1.63it/s]
                                                      
{'loss': 0.259, 'grad_norm': 0.5336275100708008, 'learning_rate': 6.913417161825449e-06, 'epoch': 1.31}

 44%|████▍     | 4834/11049 [49:46<1:03:35,  1.63it/s]
 44%|████▍     | 4835/11049 [49:47<1:03:32,  1.63it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.5322626829147339, 'learning_rate': 6.911957667148229e-06, 'epoch': 1.31}

 44%|████▍     | 4835/11049 [49:47<1:03:32,  1.63it/s]
 44%|████▍     | 4836/11049 [49:47<1:03:35,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5421052575111389, 'learning_rate': 6.9104979816369945e-06, 'epoch': 1.31}

 44%|████▍     | 4836/11049 [49:47<1:03:35,  1.63it/s]
 44%|████▍     | 4837/11049 [49:48<1:03:33,  1.63it/s]
                                                      
{'loss': 0.2694, 'grad_norm': 0.5893518328666687, 'learning_rate': 6.9090381054374424e-06, 'epoch': 1.31}

 44%|████▍     | 4837/11049 [49:48<1:03:33,  1.63it/s]
 44%|████▍     | 4838/11049 [49:48<1:03:31,  1.63it/s]
                                                      
{'loss': 0.2496, 'grad_norm': 0.5770527124404907, 'learning_rate': 6.9075780386952776e-06, 'epoch': 1.31}

 44%|████▍     | 4838/11049 [49:49<1:03:31,  1.63it/s]
 44%|████▍     | 4839/11049 [49:49<1:03:31,  1.63it/s]
                                                      
{'loss': 0.1528, 'grad_norm': 0.40170538425445557, 'learning_rate': 6.906117781556236e-06, 'epoch': 1.31}

 44%|████▍     | 4839/11049 [49:49<1:03:31,  1.63it/s]
 44%|████▍     | 4840/11049 [49:50<1:03:31,  1.63it/s]
                                                      
{'loss': 0.1903, 'grad_norm': 0.5422827005386353, 'learning_rate': 6.904657334166064e-06, 'epoch': 1.31}

 44%|████▍     | 4840/11049 [49:50<1:03:31,  1.63it/s]
 44%|████▍     | 4841/11049 [49:50<1:03:29,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.480709433555603, 'learning_rate': 6.9031966966705326e-06, 'epoch': 1.31}

 44%|████▍     | 4841/11049 [49:50<1:03:29,  1.63it/s]
 44%|████▍     | 4842/11049 [49:51<1:03:26,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.4910866916179657, 'learning_rate': 6.901735869215427e-06, 'epoch': 1.31}

 44%|████▍     | 4842/11049 [49:51<1:03:26,  1.63it/s]
 44%|████▍     | 4843/11049 [49:51<1:03:27,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.5298458337783813, 'learning_rate': 6.900274851946554e-06, 'epoch': 1.31}

 44%|████▍     | 4843/11049 [49:52<1:03:27,  1.63it/s]
 44%|████▍     | 4844/11049 [49:52<1:03:27,  1.63it/s]
                                                      
{'loss': 0.1977, 'grad_norm': 0.4969536364078522, 'learning_rate': 6.8988136450097385e-06, 'epoch': 1.32}

 44%|████▍     | 4844/11049 [49:52<1:03:27,  1.63it/s]
 44%|████▍     | 4845/11049 [49:53<1:03:24,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.5487567186355591, 'learning_rate': 6.897352248550828e-06, 'epoch': 1.32}

 44%|████▍     | 4845/11049 [49:53<1:03:24,  1.63it/s]
 44%|████▍     | 4846/11049 [49:53<1:03:25,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.5078683495521545, 'learning_rate': 6.895890662715681e-06, 'epoch': 1.32}

 44%|████▍     | 4846/11049 [49:53<1:03:25,  1.63it/s]
 44%|████▍     | 4847/11049 [49:54<1:03:23,  1.63it/s]
                                                      
{'loss': 0.1588, 'grad_norm': 0.41986799240112305, 'learning_rate': 6.8944288876501815e-06, 'epoch': 1.32}

 44%|████▍     | 4847/11049 [49:54<1:03:23,  1.63it/s]
 44%|████▍     | 4848/11049 [49:55<1:03:21,  1.63it/s]
                                                      
{'loss': 0.2121, 'grad_norm': 0.550137996673584, 'learning_rate': 6.892966923500232e-06, 'epoch': 1.32}

 44%|████▍     | 4848/11049 [49:55<1:03:21,  1.63it/s]
 44%|████▍     | 4849/11049 [49:55<1:03:21,  1.63it/s]
                                                      
{'loss': 0.2142, 'grad_norm': 0.5530465841293335, 'learning_rate': 6.89150477041175e-06, 'epoch': 1.32}

 44%|████▍     | 4849/11049 [49:55<1:03:21,  1.63it/s]
 44%|████▍     | 4850/11049 [49:56<1:03:21,  1.63it/s]
                                                      
{'loss': 0.2285, 'grad_norm': 0.5409001708030701, 'learning_rate': 6.890042428530674e-06, 'epoch': 1.32}

 44%|████▍     | 4850/11049 [49:56<1:03:21,  1.63it/s]
 44%|████▍     | 4851/11049 [49:56<1:03:20,  1.63it/s]
                                                      
{'loss': 0.2801, 'grad_norm': 0.5872734785079956, 'learning_rate': 6.888579898002964e-06, 'epoch': 1.32}

 44%|████▍     | 4851/11049 [49:57<1:03:20,  1.63it/s]
 44%|████▍     | 4852/11049 [49:57<1:03:22,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5953245162963867, 'learning_rate': 6.8871171789745935e-06, 'epoch': 1.32}

 44%|████▍     | 4852/11049 [49:57<1:03:22,  1.63it/s]
 44%|████▍     | 4853/11049 [49:58<1:03:21,  1.63it/s]
                                                      
{'loss': 0.2112, 'grad_norm': 0.5246890187263489, 'learning_rate': 6.88565427159156e-06, 'epoch': 1.32}

 44%|████▍     | 4853/11049 [49:58<1:03:21,  1.63it/s]
 44%|████▍     | 4854/11049 [49:58<1:03:20,  1.63it/s]
                                                      
{'loss': 0.1554, 'grad_norm': 0.43602174520492554, 'learning_rate': 6.884191175999875e-06, 'epoch': 1.32}

 44%|████▍     | 4854/11049 [49:58<1:03:20,  1.63it/s]
 44%|████▍     | 4855/11049 [49:59<1:03:20,  1.63it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.6093028783798218, 'learning_rate': 6.882727892345575e-06, 'epoch': 1.32}

 44%|████▍     | 4855/11049 [49:59<1:03:20,  1.63it/s]
 44%|████▍     | 4856/11049 [49:59<1:03:18,  1.63it/s]
                                                      
{'loss': 0.2088, 'grad_norm': 0.5160176753997803, 'learning_rate': 6.881264420774707e-06, 'epoch': 1.32}

 44%|████▍     | 4856/11049 [50:00<1:03:18,  1.63it/s]
 44%|████▍     | 4857/11049 [50:00<1:03:18,  1.63it/s]
                                                      
{'loss': 0.2528, 'grad_norm': 0.7352391481399536, 'learning_rate': 6.879800761433345e-06, 'epoch': 1.32}

 44%|████▍     | 4857/11049 [50:00<1:03:18,  1.63it/s]
 44%|████▍     | 4858/11049 [50:01<1:03:19,  1.63it/s]
                                                      
{'loss': 0.2005, 'grad_norm': 0.48971351981163025, 'learning_rate': 6.878336914467575e-06, 'epoch': 1.32}

 44%|████▍     | 4858/11049 [50:01<1:03:19,  1.63it/s]
 44%|████▍     | 4859/11049 [50:01<1:03:19,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.46921151876449585, 'learning_rate': 6.876872880023506e-06, 'epoch': 1.32}

 44%|████▍     | 4859/11049 [50:01<1:03:19,  1.63it/s]
 44%|████▍     | 4860/11049 [50:02<1:03:18,  1.63it/s]
                                                      
{'loss': 0.2114, 'grad_norm': 0.5715038180351257, 'learning_rate': 6.875408658247267e-06, 'epoch': 1.32}

 44%|████▍     | 4860/11049 [50:02<1:03:18,  1.63it/s]
 44%|████▍     | 4861/11049 [50:03<1:03:16,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.6043531894683838, 'learning_rate': 6.873944249284998e-06, 'epoch': 1.32}

 44%|████▍     | 4861/11049 [50:03<1:03:16,  1.63it/s]
 44%|████▍     | 4862/11049 [50:03<1:03:16,  1.63it/s]
                                                      
{'loss': 0.1848, 'grad_norm': 0.4870833456516266, 'learning_rate': 6.872479653282866e-06, 'epoch': 1.32}

 44%|████▍     | 4862/11049 [50:03<1:03:16,  1.63it/s]
 44%|████▍     | 4863/11049 [50:04<1:03:17,  1.63it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.604734480381012, 'learning_rate': 6.871014870387054e-06, 'epoch': 1.32}

 44%|████▍     | 4863/11049 [50:04<1:03:17,  1.63it/s]
 44%|████▍     | 4864/11049 [50:04<1:03:18,  1.63it/s]
                                                      
{'loss': 0.1705, 'grad_norm': 0.4849528968334198, 'learning_rate': 6.869549900743763e-06, 'epoch': 1.32}

 44%|████▍     | 4864/11049 [50:04<1:03:18,  1.63it/s]
 44%|████▍     | 4865/11049 [50:05<1:03:18,  1.63it/s]
                                                      
{'loss': 0.2214, 'grad_norm': 0.5938706994056702, 'learning_rate': 6.868084744499211e-06, 'epoch': 1.32}

 44%|████▍     | 4865/11049 [50:05<1:03:18,  1.63it/s]
 44%|████▍     | 4866/11049 [50:06<1:03:17,  1.63it/s]
                                                      
{'loss': 0.1796, 'grad_norm': 0.7008483409881592, 'learning_rate': 6.8666194017996355e-06, 'epoch': 1.32}

 44%|████▍     | 4866/11049 [50:06<1:03:17,  1.63it/s]
 44%|████▍     | 4867/11049 [50:06<1:03:16,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.6630184054374695, 'learning_rate': 6.865153872791297e-06, 'epoch': 1.32}

 44%|████▍     | 4867/11049 [50:06<1:03:16,  1.63it/s]
 44%|████▍     | 4868/11049 [50:07<1:03:16,  1.63it/s]
                                                      
{'loss': 0.1892, 'grad_norm': 0.4668944180011749, 'learning_rate': 6.8636881576204704e-06, 'epoch': 1.32}

 44%|████▍     | 4868/11049 [50:07<1:03:16,  1.63it/s]
 44%|████▍     | 4869/11049 [50:07<1:03:14,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5551329255104065, 'learning_rate': 6.862222256433448e-06, 'epoch': 1.32}

 44%|████▍     | 4869/11049 [50:08<1:03:14,  1.63it/s]
 44%|████▍     | 4870/11049 [50:08<1:03:12,  1.63it/s]
                                                      
{'loss': 0.2611, 'grad_norm': 0.6188752055168152, 'learning_rate': 6.860756169376544e-06, 'epoch': 1.32}

 44%|████▍     | 4870/11049 [50:08<1:03:12,  1.63it/s]
 44%|████▍     | 4871/11049 [50:09<1:03:11,  1.63it/s]
                                                      
{'loss': 0.2438, 'grad_norm': 0.5927170515060425, 'learning_rate': 6.859289896596089e-06, 'epoch': 1.32}

 44%|████▍     | 4871/11049 [50:09<1:03:11,  1.63it/s]
 44%|████▍     | 4872/11049 [50:09<1:03:09,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.45724257826805115, 'learning_rate': 6.857823438238432e-06, 'epoch': 1.32}

 44%|████▍     | 4872/11049 [50:09<1:03:09,  1.63it/s]
 44%|████▍     | 4873/11049 [50:10<1:03:08,  1.63it/s]
                                                      
{'loss': 0.1632, 'grad_norm': 0.45546066761016846, 'learning_rate': 6.856356794449945e-06, 'epoch': 1.32}

 44%|████▍     | 4873/11049 [50:10<1:03:08,  1.63it/s]
 44%|████▍     | 4874/11049 [50:10<1:03:08,  1.63it/s]
                                                      
{'loss': 0.2515, 'grad_norm': 0.5782216191291809, 'learning_rate': 6.854889965377009e-06, 'epoch': 1.32}

 44%|████▍     | 4874/11049 [50:11<1:03:08,  1.63it/s]
 44%|████▍     | 4875/11049 [50:11<1:03:05,  1.63it/s]
                                                      
{'loss': 0.2255, 'grad_norm': 0.5477927923202515, 'learning_rate': 6.853422951166036e-06, 'epoch': 1.32}

 44%|████▍     | 4875/11049 [50:11<1:03:05,  1.63it/s]
 44%|████▍     | 4876/11049 [50:12<1:03:06,  1.63it/s]
                                                      
{'loss': 0.2106, 'grad_norm': 0.5481293201446533, 'learning_rate': 6.851955751963444e-06, 'epoch': 1.32}

 44%|████▍     | 4876/11049 [50:12<1:03:06,  1.63it/s]
 44%|████▍     | 4877/11049 [50:12<1:03:04,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.6450721621513367, 'learning_rate': 6.85048836791568e-06, 'epoch': 1.32}

 44%|████▍     | 4877/11049 [50:12<1:03:04,  1.63it/s]
 44%|████▍     | 4878/11049 [50:13<1:03:05,  1.63it/s]
                                                      
{'loss': 0.2248, 'grad_norm': 0.535511314868927, 'learning_rate': 6.849020799169201e-06, 'epoch': 1.32}

 44%|████▍     | 4878/11049 [50:13<1:03:05,  1.63it/s]
 44%|████▍     | 4879/11049 [50:14<1:03:04,  1.63it/s]
                                                      
{'loss': 0.2226, 'grad_norm': 0.6360794305801392, 'learning_rate': 6.84755304587049e-06, 'epoch': 1.32}

 44%|████▍     | 4879/11049 [50:14<1:03:04,  1.63it/s]
 44%|████▍     | 4880/11049 [50:14<1:03:05,  1.63it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.45580169558525085, 'learning_rate': 6.84608510816604e-06, 'epoch': 1.33}

 44%|████▍     | 4880/11049 [50:14<1:03:05,  1.63it/s]
 44%|████▍     | 4881/11049 [50:15<1:03:03,  1.63it/s]
                                                      
{'loss': 0.161, 'grad_norm': 0.46843352913856506, 'learning_rate': 6.844616986202371e-06, 'epoch': 1.33}

 44%|████▍     | 4881/11049 [50:15<1:03:03,  1.63it/s]
 44%|████▍     | 4882/11049 [50:15<1:03:03,  1.63it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.56723552942276, 'learning_rate': 6.843148680126015e-06, 'epoch': 1.33}

 44%|████▍     | 4882/11049 [50:16<1:03:03,  1.63it/s]
 44%|████▍     | 4883/11049 [50:16<1:03:02,  1.63it/s]
                                                      
{'loss': 0.2381, 'grad_norm': 0.5880028605461121, 'learning_rate': 6.841680190083527e-06, 'epoch': 1.33}

 44%|████▍     | 4883/11049 [50:16<1:03:02,  1.63it/s]
 44%|████▍     | 4884/11049 [50:17<1:03:01,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.5040557384490967, 'learning_rate': 6.840211516221475e-06, 'epoch': 1.33}

 44%|████▍     | 4884/11049 [50:17<1:03:01,  1.63it/s]
 44%|████▍     | 4885/11049 [50:17<1:03:02,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.5032950043678284, 'learning_rate': 6.838742658686452e-06, 'epoch': 1.33}

 44%|████▍     | 4885/11049 [50:17<1:03:02,  1.63it/s]
 44%|████▍     | 4886/11049 [50:18<1:03:00,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.4822578728199005, 'learning_rate': 6.837273617625065e-06, 'epoch': 1.33}

 44%|████▍     | 4886/11049 [50:18<1:03:00,  1.63it/s]
 44%|████▍     | 4887/11049 [50:18<1:02:59,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.48241040110588074, 'learning_rate': 6.835804393183938e-06, 'epoch': 1.33}

 44%|████▍     | 4887/11049 [50:19<1:02:59,  1.63it/s]
 44%|████▍     | 4888/11049 [50:19<1:03:01,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.5616049766540527, 'learning_rate': 6.834334985509717e-06, 'epoch': 1.33}

 44%|████▍     | 4888/11049 [50:19<1:03:01,  1.63it/s]
 44%|████▍     | 4889/11049 [50:20<1:03:01,  1.63it/s]
                                                      
{'loss': 0.2272, 'grad_norm': 0.504366397857666, 'learning_rate': 6.832865394749065e-06, 'epoch': 1.33}

 44%|████▍     | 4889/11049 [50:20<1:03:01,  1.63it/s]
 44%|████▍     | 4890/11049 [50:20<1:02:58,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.543748676776886, 'learning_rate': 6.831395621048662e-06, 'epoch': 1.33}

 44%|████▍     | 4890/11049 [50:20<1:02:58,  1.63it/s]
 44%|████▍     | 4891/11049 [50:21<1:03:00,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.5370964407920837, 'learning_rate': 6.829925664555209e-06, 'epoch': 1.33}

 44%|████▍     | 4891/11049 [50:21<1:03:00,  1.63it/s]
 44%|████▍     | 4892/11049 [50:22<1:02:58,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.551965057849884, 'learning_rate': 6.828455525415422e-06, 'epoch': 1.33}

 44%|████▍     | 4892/11049 [50:22<1:02:58,  1.63it/s]
 44%|████▍     | 4893/11049 [50:22<1:02:57,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.49241915345191956, 'learning_rate': 6.826985203776036e-06, 'epoch': 1.33}

 44%|████▍     | 4893/11049 [50:22<1:02:57,  1.63it/s]
 44%|████▍     | 4894/11049 [50:23<1:02:55,  1.63it/s]
                                                      
{'loss': 0.2381, 'grad_norm': 0.558448076248169, 'learning_rate': 6.825514699783807e-06, 'epoch': 1.33}

 44%|████▍     | 4894/11049 [50:23<1:02:55,  1.63it/s]
 44%|████▍     | 4895/11049 [50:23<1:02:56,  1.63it/s]
                                                      
{'loss': 0.1696, 'grad_norm': 0.5284132957458496, 'learning_rate': 6.824044013585507e-06, 'epoch': 1.33}

 44%|████▍     | 4895/11049 [50:24<1:02:56,  1.63it/s]
 44%|████▍     | 4896/11049 [50:24<1:02:56,  1.63it/s]
                                                      
{'loss': 0.2368, 'grad_norm': 0.6090107560157776, 'learning_rate': 6.8225731453279254e-06, 'epoch': 1.33}

 44%|████▍     | 4896/11049 [50:24<1:02:56,  1.63it/s]
 44%|████▍     | 4897/11049 [50:25<1:02:55,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5305536389350891, 'learning_rate': 6.821102095157871e-06, 'epoch': 1.33}

 44%|████▍     | 4897/11049 [50:25<1:02:55,  1.63it/s]
 44%|████▍     | 4898/11049 [50:25<1:02:54,  1.63it/s]
                                                      
{'loss': 0.2517, 'grad_norm': 0.6201048493385315, 'learning_rate': 6.819630863222169e-06, 'epoch': 1.33}

 44%|████▍     | 4898/11049 [50:25<1:02:54,  1.63it/s]
 44%|████▍     | 4899/11049 [50:26<1:02:52,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.5476612448692322, 'learning_rate': 6.818159449667667e-06, 'epoch': 1.33}

 44%|████▍     | 4899/11049 [50:26<1:02:52,  1.63it/s]
 44%|████▍     | 4900/11049 [50:26<1:02:52,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5271517038345337, 'learning_rate': 6.816687854641227e-06, 'epoch': 1.33}

 44%|████▍     | 4900/11049 [50:27<1:02:52,  1.63it/s]
 44%|████▍     | 4901/11049 [50:27<1:02:51,  1.63it/s]
                                                      
{'loss': 0.2075, 'grad_norm': 0.6253263354301453, 'learning_rate': 6.815216078289731e-06, 'epoch': 1.33}

 44%|████▍     | 4901/11049 [50:27<1:02:51,  1.63it/s]
 44%|████▍     | 4902/11049 [50:28<1:02:50,  1.63it/s]
                                                      
{'loss': 0.2099, 'grad_norm': 0.5079431533813477, 'learning_rate': 6.813744120760073e-06, 'epoch': 1.33}

 44%|████▍     | 4902/11049 [50:28<1:02:50,  1.63it/s]
 44%|████▍     | 4903/11049 [50:28<1:02:51,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.6419788599014282, 'learning_rate': 6.812271982199177e-06, 'epoch': 1.33}

 44%|████▍     | 4903/11049 [50:28<1:02:51,  1.63it/s]
 44%|████▍     | 4904/11049 [50:29<1:02:51,  1.63it/s]
                                                      
{'loss': 0.2501, 'grad_norm': 0.6827307939529419, 'learning_rate': 6.810799662753975e-06, 'epoch': 1.33}

 44%|████▍     | 4904/11049 [50:29<1:02:51,  1.63it/s]
 44%|████▍     | 4905/11049 [50:30<1:02:49,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.48631033301353455, 'learning_rate': 6.809327162571422e-06, 'epoch': 1.33}

 44%|████▍     | 4905/11049 [50:30<1:02:49,  1.63it/s]
 44%|████▍     | 4906/11049 [50:30<1:02:50,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.5876656174659729, 'learning_rate': 6.807854481798486e-06, 'epoch': 1.33}

 44%|████▍     | 4906/11049 [50:30<1:02:50,  1.63it/s]
 44%|████▍     | 4907/11049 [50:31<1:02:50,  1.63it/s]
                                                      
{'loss': 0.1887, 'grad_norm': 0.5150625705718994, 'learning_rate': 6.806381620582159e-06, 'epoch': 1.33}

 44%|████▍     | 4907/11049 [50:31<1:02:50,  1.63it/s]
 44%|████▍     | 4908/11049 [50:31<1:02:51,  1.63it/s]
                                                      
{'loss': 0.2121, 'grad_norm': 0.6449630856513977, 'learning_rate': 6.804908579069449e-06, 'epoch': 1.33}

 44%|████▍     | 4908/11049 [50:31<1:02:51,  1.63it/s]
 44%|████▍     | 4909/11049 [50:32<1:02:51,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.536937952041626, 'learning_rate': 6.8034353574073815e-06, 'epoch': 1.33}

 44%|████▍     | 4909/11049 [50:32<1:02:51,  1.63it/s]
 44%|████▍     | 4910/11049 [50:33<1:02:50,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.5403285622596741, 'learning_rate': 6.801961955742997e-06, 'epoch': 1.33}

 44%|████▍     | 4910/11049 [50:33<1:02:50,  1.63it/s]
 44%|████▍     | 4911/11049 [50:33<1:02:47,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.46138980984687805, 'learning_rate': 6.800488374223361e-06, 'epoch': 1.33}

 44%|████▍     | 4911/11049 [50:33<1:02:47,  1.63it/s]
 44%|████▍     | 4912/11049 [50:34<1:02:46,  1.63it/s]
                                                      
{'loss': 0.2089, 'grad_norm': 0.5479771494865417, 'learning_rate': 6.799014612995549e-06, 'epoch': 1.33}

 44%|████▍     | 4912/11049 [50:34<1:02:46,  1.63it/s]
 44%|████▍     | 4913/11049 [50:34<1:02:45,  1.63it/s]
                                                      
{'loss': 0.2013, 'grad_norm': 0.43799471855163574, 'learning_rate': 6.797540672206661e-06, 'epoch': 1.33}

 44%|████▍     | 4913/11049 [50:35<1:02:45,  1.63it/s]
 44%|████▍     | 4914/11049 [50:35<1:02:43,  1.63it/s]
                                                      
{'loss': 0.1814, 'grad_norm': 0.4533936679363251, 'learning_rate': 6.796066552003811e-06, 'epoch': 1.33}

 44%|████▍     | 4914/11049 [50:35<1:02:43,  1.63it/s]
 44%|████▍     | 4915/11049 [50:36<1:02:43,  1.63it/s]
                                                      
{'loss': 0.1931, 'grad_norm': 0.5282779932022095, 'learning_rate': 6.794592252534133e-06, 'epoch': 1.33}

 44%|████▍     | 4915/11049 [50:36<1:02:43,  1.63it/s]
 44%|████▍     | 4916/11049 [50:36<1:02:45,  1.63it/s]
                                                      
{'loss': 0.2757, 'grad_norm': 0.7503767609596252, 'learning_rate': 6.793117773944775e-06, 'epoch': 1.33}

 44%|████▍     | 4916/11049 [50:36<1:02:45,  1.63it/s]
 45%|████▍     | 4917/11049 [50:37<1:02:45,  1.63it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.4942866563796997, 'learning_rate': 6.791643116382911e-06, 'epoch': 1.34}

 45%|████▍     | 4917/11049 [50:37<1:02:45,  1.63it/s]
 45%|████▍     | 4918/11049 [50:37<1:02:45,  1.63it/s]
                                                      
{'loss': 0.1783, 'grad_norm': 0.47085559368133545, 'learning_rate': 6.790168279995723e-06, 'epoch': 1.34}

 45%|████▍     | 4918/11049 [50:38<1:02:45,  1.63it/s]
 45%|████▍     | 4919/11049 [50:38<1:02:42,  1.63it/s]
                                                      
{'loss': 0.1965, 'grad_norm': 0.5922309160232544, 'learning_rate': 6.788693264930419e-06, 'epoch': 1.34}

 45%|████▍     | 4919/11049 [50:38<1:02:42,  1.63it/s]
 45%|████▍     | 4920/11049 [50:39<1:02:42,  1.63it/s]
                                                      
{'loss': 0.2551, 'grad_norm': 0.6139312982559204, 'learning_rate': 6.787218071334218e-06, 'epoch': 1.34}

 45%|████▍     | 4920/11049 [50:39<1:02:42,  1.63it/s]
 45%|████▍     | 4921/11049 [50:39<1:02:42,  1.63it/s]
                                                      
{'loss': 0.2817, 'grad_norm': 0.723854124546051, 'learning_rate': 6.785742699354365e-06, 'epoch': 1.34}

 45%|████▍     | 4921/11049 [50:39<1:02:42,  1.63it/s]
 45%|████▍     | 4922/11049 [50:40<1:02:41,  1.63it/s]
                                                      
{'loss': 0.1886, 'grad_norm': 0.5001169443130493, 'learning_rate': 6.784267149138114e-06, 'epoch': 1.34}

 45%|████▍     | 4922/11049 [50:40<1:02:41,  1.63it/s]
 45%|████▍     | 4923/11049 [50:41<1:02:53,  1.62it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5499092936515808, 'learning_rate': 6.782791420832741e-06, 'epoch': 1.34}

 45%|████▍     | 4923/11049 [50:41<1:02:53,  1.62it/s]
 45%|████▍     | 4924/11049 [50:41<1:02:48,  1.63it/s]
                                                      
{'loss': 0.2321, 'grad_norm': 0.5333540439605713, 'learning_rate': 6.781315514585543e-06, 'epoch': 1.34}

 45%|████▍     | 4924/11049 [50:41<1:02:48,  1.63it/s]
 45%|████▍     | 4925/11049 [50:42<1:02:44,  1.63it/s]
                                                      
{'loss': 0.2081, 'grad_norm': 0.587497889995575, 'learning_rate': 6.779839430543827e-06, 'epoch': 1.34}

 45%|████▍     | 4925/11049 [50:42<1:02:44,  1.63it/s]
 45%|████▍     | 4926/11049 [50:42<1:02:40,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.5322203636169434, 'learning_rate': 6.778363168854924e-06, 'epoch': 1.34}

 45%|████▍     | 4926/11049 [50:43<1:02:40,  1.63it/s]
 45%|████▍     | 4927/11049 [50:43<1:02:39,  1.63it/s]
                                                      
{'loss': 0.1753, 'grad_norm': 0.4839498698711395, 'learning_rate': 6.776886729666184e-06, 'epoch': 1.34}

 45%|████▍     | 4927/11049 [50:43<1:02:39,  1.63it/s]
 45%|████▍     | 4928/11049 [50:44<1:02:36,  1.63it/s]
                                                      
{'loss': 0.2289, 'grad_norm': 0.5296884775161743, 'learning_rate': 6.775410113124965e-06, 'epoch': 1.34}

 45%|████▍     | 4928/11049 [50:44<1:02:36,  1.63it/s]
 45%|████▍     | 4929/11049 [50:44<1:02:36,  1.63it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.5149385333061218, 'learning_rate': 6.773933319378656e-06, 'epoch': 1.34}

 45%|████▍     | 4929/11049 [50:44<1:02:36,  1.63it/s]
 45%|████▍     | 4930/11049 [50:45<1:02:41,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.5169363617897034, 'learning_rate': 6.7724563485746504e-06, 'epoch': 1.34}

 45%|████▍     | 4930/11049 [50:45<1:02:41,  1.63it/s]
 45%|████▍     | 4931/11049 [50:45<1:02:39,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.5253390073776245, 'learning_rate': 6.770979200860373e-06, 'epoch': 1.34}

 45%|████▍     | 4931/11049 [50:46<1:02:39,  1.63it/s]
 45%|████▍     | 4932/11049 [50:46<1:02:35,  1.63it/s]
                                                      
{'loss': 0.1705, 'grad_norm': 0.4692191183567047, 'learning_rate': 6.769501876383253e-06, 'epoch': 1.34}

 45%|████▍     | 4932/11049 [50:46<1:02:35,  1.63it/s]
 45%|████▍     | 4933/11049 [50:47<1:02:33,  1.63it/s]
                                                      
{'loss': 0.2009, 'grad_norm': 0.5800149440765381, 'learning_rate': 6.768024375290747e-06, 'epoch': 1.34}

 45%|████▍     | 4933/11049 [50:47<1:02:33,  1.63it/s]
 45%|████▍     | 4934/11049 [50:47<1:02:30,  1.63it/s]
                                                      
{'loss': 0.242, 'grad_norm': 0.5296860933303833, 'learning_rate': 6.766546697730323e-06, 'epoch': 1.34}

 45%|████▍     | 4934/11049 [50:47<1:02:30,  1.63it/s]
 45%|████▍     | 4935/11049 [50:48<1:02:31,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.469780832529068, 'learning_rate': 6.765068843849472e-06, 'epoch': 1.34}

 45%|████▍     | 4935/11049 [50:48<1:02:31,  1.63it/s]
 45%|████▍     | 4936/11049 [50:49<1:02:30,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.4966459274291992, 'learning_rate': 6.763590813795697e-06, 'epoch': 1.34}

 45%|████▍     | 4936/11049 [50:49<1:02:30,  1.63it/s]
 45%|████▍     | 4937/11049 [50:49<1:02:29,  1.63it/s]
                                                      
{'loss': 0.1745, 'grad_norm': 0.5661296248435974, 'learning_rate': 6.7621126077165235e-06, 'epoch': 1.34}

 45%|████▍     | 4937/11049 [50:49<1:02:29,  1.63it/s]
 45%|████▍     | 4938/11049 [50:50<1:02:30,  1.63it/s]
                                                      
{'loss': 0.2271, 'grad_norm': 0.5704197883605957, 'learning_rate': 6.76063422575949e-06, 'epoch': 1.34}

 45%|████▍     | 4938/11049 [50:50<1:02:30,  1.63it/s]
 45%|████▍     | 4939/11049 [50:50<1:02:28,  1.63it/s]
                                                      
{'loss': 0.2229, 'grad_norm': 0.5630187392234802, 'learning_rate': 6.759155668072157e-06, 'epoch': 1.34}

 45%|████▍     | 4939/11049 [50:51<1:02:28,  1.63it/s]
 45%|████▍     | 4940/11049 [50:51<1:02:32,  1.63it/s]
                                                      
{'loss': 0.2492, 'grad_norm': 0.6233543157577515, 'learning_rate': 6.757676934802101e-06, 'epoch': 1.34}

 45%|████▍     | 4940/11049 [50:51<1:02:32,  1.63it/s]
 45%|████▍     | 4941/11049 [50:52<1:02:30,  1.63it/s]
                                                      
{'loss': 0.2074, 'grad_norm': 0.5787903070449829, 'learning_rate': 6.756198026096914e-06, 'epoch': 1.34}

 45%|████▍     | 4941/11049 [50:52<1:02:30,  1.63it/s]
 45%|████▍     | 4942/11049 [50:52<1:02:28,  1.63it/s]
                                                      
{'loss': 0.184, 'grad_norm': 0.48543134331703186, 'learning_rate': 6.754718942104206e-06, 'epoch': 1.34}

 45%|████▍     | 4942/11049 [50:52<1:02:28,  1.63it/s]
 45%|████▍     | 4943/11049 [50:53<1:02:26,  1.63it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.6334580779075623, 'learning_rate': 6.753239682971608e-06, 'epoch': 1.34}

 45%|████▍     | 4943/11049 [50:53<1:02:26,  1.63it/s]
 45%|████▍     | 4944/11049 [50:53<1:02:26,  1.63it/s]
                                                      
{'loss': 0.2466, 'grad_norm': 0.5845242142677307, 'learning_rate': 6.751760248846766e-06, 'epoch': 1.34}

 45%|████▍     | 4944/11049 [50:54<1:02:26,  1.63it/s]
 45%|████▍     | 4945/11049 [50:54<1:02:34,  1.63it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.6239533424377441, 'learning_rate': 6.750280639877343e-06, 'epoch': 1.34}

 45%|████▍     | 4945/11049 [50:54<1:02:34,  1.63it/s]
 45%|████▍     | 4946/11049 [50:55<1:02:31,  1.63it/s]
                                                      
{'loss': 0.3063, 'grad_norm': 0.6116881966590881, 'learning_rate': 6.748800856211018e-06, 'epoch': 1.34}

 45%|████▍     | 4946/11049 [50:55<1:02:31,  1.63it/s]
 45%|████▍     | 4947/11049 [50:55<1:02:28,  1.63it/s]
                                                      
{'loss': 0.2088, 'grad_norm': 0.5466759204864502, 'learning_rate': 6.747320897995493e-06, 'epoch': 1.34}

 45%|████▍     | 4947/11049 [50:55<1:02:28,  1.63it/s]
 45%|████▍     | 4948/11049 [50:56<1:02:27,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5441715717315674, 'learning_rate': 6.74584076537848e-06, 'epoch': 1.34}

 45%|████▍     | 4948/11049 [50:56<1:02:27,  1.63it/s]
 45%|████▍     | 4949/11049 [50:57<1:02:25,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.5307338833808899, 'learning_rate': 6.744360458507714e-06, 'epoch': 1.34}

 45%|████▍     | 4949/11049 [50:57<1:02:25,  1.63it/s]
 45%|████▍     | 4950/11049 [50:57<1:02:23,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.5455916523933411, 'learning_rate': 6.7428799775309465e-06, 'epoch': 1.34}

 45%|████▍     | 4950/11049 [50:57<1:02:23,  1.63it/s]
 45%|████▍     | 4951/11049 [50:58<1:02:25,  1.63it/s]
                                                      
{'loss': 0.2148, 'grad_norm': 0.593370795249939, 'learning_rate': 6.741399322595945e-06, 'epoch': 1.34}

 45%|████▍     | 4951/11049 [50:58<1:02:25,  1.63it/s]
 45%|████▍     | 4952/11049 [50:58<1:02:23,  1.63it/s]
                                                      
{'loss': 0.2333, 'grad_norm': 0.586589515209198, 'learning_rate': 6.739918493850493e-06, 'epoch': 1.34}

 45%|████▍     | 4952/11049 [50:59<1:02:23,  1.63it/s]
 45%|████▍     | 4953/11049 [50:59<1:02:21,  1.63it/s]
                                                      
{'loss': 0.2225, 'grad_norm': 0.6493102312088013, 'learning_rate': 6.738437491442395e-06, 'epoch': 1.34}

 45%|████▍     | 4953/11049 [50:59<1:02:21,  1.63it/s]
 45%|████▍     | 4954/11049 [51:00<1:02:20,  1.63it/s]
                                                      
{'loss': 0.281, 'grad_norm': 0.7106638550758362, 'learning_rate': 6.736956315519471e-06, 'epoch': 1.35}

 45%|████▍     | 4954/11049 [51:00<1:02:20,  1.63it/s]
 45%|████▍     | 4955/11049 [51:00<1:02:18,  1.63it/s]
                                                      
{'loss': 0.1943, 'grad_norm': 0.5234112739562988, 'learning_rate': 6.735474966229558e-06, 'epoch': 1.35}

 45%|████▍     | 4955/11049 [51:00<1:02:18,  1.63it/s]
 45%|████▍     | 4956/11049 [51:01<1:02:17,  1.63it/s]
                                                      
{'loss': 0.2634, 'grad_norm': 0.6723636388778687, 'learning_rate': 6.73399344372051e-06, 'epoch': 1.35}

 45%|████▍     | 4956/11049 [51:01<1:02:17,  1.63it/s]
 45%|████▍     | 4957/11049 [51:01<1:02:16,  1.63it/s]
                                                      
{'loss': 0.2112, 'grad_norm': 0.5748899579048157, 'learning_rate': 6.7325117481402e-06, 'epoch': 1.35}

 45%|████▍     | 4957/11049 [51:02<1:02:16,  1.63it/s]
 45%|████▍     | 4958/11049 [51:02<1:02:14,  1.63it/s]
                                                      
{'loss': 0.2332, 'grad_norm': 0.663498044013977, 'learning_rate': 6.731029879636517e-06, 'epoch': 1.35}

 45%|████▍     | 4958/11049 [51:02<1:02:14,  1.63it/s]
 45%|████▍     | 4959/11049 [51:03<1:02:15,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5864599943161011, 'learning_rate': 6.729547838357367e-06, 'epoch': 1.35}

 45%|████▍     | 4959/11049 [51:03<1:02:15,  1.63it/s]
 45%|████▍     | 4960/11049 [51:03<1:02:14,  1.63it/s]
                                                      
{'loss': 0.2104, 'grad_norm': 0.5224297642707825, 'learning_rate': 6.728065624450674e-06, 'epoch': 1.35}

 45%|████▍     | 4960/11049 [51:03<1:02:14,  1.63it/s]
 45%|████▍     | 4961/11049 [51:04<1:02:13,  1.63it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.4865553081035614, 'learning_rate': 6.726583238064379e-06, 'epoch': 1.35}

 45%|████▍     | 4961/11049 [51:04<1:02:13,  1.63it/s]
 45%|████▍     | 4962/11049 [51:05<1:02:14,  1.63it/s]
                                                      
{'loss': 0.1632, 'grad_norm': 0.5041555762290955, 'learning_rate': 6.725100679346439e-06, 'epoch': 1.35}

 45%|████▍     | 4962/11049 [51:05<1:02:14,  1.63it/s]
 45%|████▍     | 4963/11049 [51:05<1:02:14,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.5110623240470886, 'learning_rate': 6.723617948444833e-06, 'epoch': 1.35}

 45%|████▍     | 4963/11049 [51:05<1:02:14,  1.63it/s]
 45%|████▍     | 4964/11049 [51:06<1:02:14,  1.63it/s]
                                                      
{'loss': 0.244, 'grad_norm': 0.5909296870231628, 'learning_rate': 6.7221350455075484e-06, 'epoch': 1.35}

 45%|████▍     | 4964/11049 [51:06<1:02:14,  1.63it/s]
 45%|████▍     | 4965/11049 [51:06<1:02:12,  1.63it/s]
                                                      
{'loss': 0.1909, 'grad_norm': 0.4812629520893097, 'learning_rate': 6.720651970682599e-06, 'epoch': 1.35}

 45%|████▍     | 4965/11049 [51:06<1:02:12,  1.63it/s]
 45%|████▍     | 4966/11049 [51:07<1:02:12,  1.63it/s]
                                                      
{'loss': 0.2094, 'grad_norm': 0.5986914038658142, 'learning_rate': 6.719168724118008e-06, 'epoch': 1.35}

 45%|████▍     | 4966/11049 [51:07<1:02:12,  1.63it/s]
 45%|████▍     | 4967/11049 [51:08<1:02:11,  1.63it/s]
                                                      
{'loss': 0.171, 'grad_norm': 0.48227658867836, 'learning_rate': 6.717685305961825e-06, 'epoch': 1.35}

 45%|████▍     | 4967/11049 [51:08<1:02:11,  1.63it/s]
 45%|████▍     | 4968/11049 [51:08<1:02:11,  1.63it/s]
                                                      
{'loss': 0.2626, 'grad_norm': 0.6336498856544495, 'learning_rate': 6.716201716362105e-06, 'epoch': 1.35}

 45%|████▍     | 4968/11049 [51:08<1:02:11,  1.63it/s]
 45%|████▍     | 4969/11049 [51:09<1:02:10,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.5460436940193176, 'learning_rate': 6.714717955466931e-06, 'epoch': 1.35}

 45%|████▍     | 4969/11049 [51:09<1:02:10,  1.63it/s]
 45%|████▍     | 4970/11049 [51:09<1:01:59,  1.63it/s]
                                                      
{'loss': 0.2717, 'grad_norm': 0.5708739161491394, 'learning_rate': 6.713234023424395e-06, 'epoch': 1.35}

 45%|████▍     | 4970/11049 [51:10<1:01:59,  1.63it/s]
 45%|████▍     | 4971/11049 [51:10<1:02:12,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.4760338068008423, 'learning_rate': 6.711749920382611e-06, 'epoch': 1.35}

 45%|████▍     | 4971/11049 [51:10<1:02:12,  1.63it/s]
 45%|████▍     | 4972/11049 [51:11<1:02:10,  1.63it/s]
                                                      
{'loss': 0.2102, 'grad_norm': 0.5355578660964966, 'learning_rate': 6.710265646489709e-06, 'epoch': 1.35}

 45%|████▍     | 4972/11049 [51:11<1:02:10,  1.63it/s]
 45%|████▌     | 4973/11049 [51:11<1:02:08,  1.63it/s]
                                                      
{'loss': 0.2054, 'grad_norm': 0.5368221998214722, 'learning_rate': 6.708781201893834e-06, 'epoch': 1.35}

 45%|████▌     | 4973/11049 [51:11<1:02:08,  1.63it/s]
 45%|████▌     | 4974/11049 [51:12<1:02:06,  1.63it/s]
                                                      
{'loss': 0.1687, 'grad_norm': 0.49494871497154236, 'learning_rate': 6.70729658674315e-06, 'epoch': 1.35}

 45%|████▌     | 4974/11049 [51:12<1:02:06,  1.63it/s]
 45%|████▌     | 4975/11049 [51:12<1:02:06,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.6128315925598145, 'learning_rate': 6.705811801185838e-06, 'epoch': 1.35}

 45%|████▌     | 4975/11049 [51:13<1:02:06,  1.63it/s]
 45%|████▌     | 4976/11049 [51:13<1:02:04,  1.63it/s]
                                                      
{'loss': 0.2819, 'grad_norm': 0.6804760098457336, 'learning_rate': 6.704326845370097e-06, 'epoch': 1.35}

 45%|████▌     | 4976/11049 [51:13<1:02:04,  1.63it/s]
 45%|████▌     | 4977/11049 [51:14<1:02:03,  1.63it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.48698559403419495, 'learning_rate': 6.702841719444141e-06, 'epoch': 1.35}

 45%|████▌     | 4977/11049 [51:14<1:02:03,  1.63it/s]
 45%|████▌     | 4978/11049 [51:14<1:02:06,  1.63it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.5683080554008484, 'learning_rate': 6.701356423556198e-06, 'epoch': 1.35}

 45%|████▌     | 4978/11049 [51:14<1:02:06,  1.63it/s]
 45%|████▌     | 4979/11049 [51:15<1:02:05,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.5100578665733337, 'learning_rate': 6.699870957854522e-06, 'epoch': 1.35}

 45%|████▌     | 4979/11049 [51:15<1:02:05,  1.63it/s]
 45%|████▌     | 4980/11049 [51:16<1:02:05,  1.63it/s]
                                                      
{'loss': 0.243, 'grad_norm': 0.6040661931037903, 'learning_rate': 6.698385322487375e-06, 'epoch': 1.35}

 45%|████▌     | 4980/11049 [51:16<1:02:05,  1.63it/s]
 45%|████▌     | 4981/11049 [51:16<1:02:06,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.507135272026062, 'learning_rate': 6.696899517603042e-06, 'epoch': 1.35}

 45%|████▌     | 4981/11049 [51:16<1:02:06,  1.63it/s]
 45%|████▌     | 4982/11049 [51:17<1:02:03,  1.63it/s]
                                                      
{'loss': 0.181, 'grad_norm': 0.538902759552002, 'learning_rate': 6.695413543349818e-06, 'epoch': 1.35}

 45%|████▌     | 4982/11049 [51:17<1:02:03,  1.63it/s]
 45%|████▌     | 4983/11049 [51:17<1:02:02,  1.63it/s]
                                                      
{'loss': 0.2362, 'grad_norm': 0.6477516889572144, 'learning_rate': 6.693927399876024e-06, 'epoch': 1.35}

 45%|████▌     | 4983/11049 [51:18<1:02:02,  1.63it/s]
 45%|████▌     | 4984/11049 [51:18<1:02:01,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.540557324886322, 'learning_rate': 6.692441087329988e-06, 'epoch': 1.35}

 45%|████▌     | 4984/11049 [51:18<1:02:01,  1.63it/s]
 45%|████▌     | 4985/11049 [51:19<1:02:00,  1.63it/s]
                                                      
{'loss': 0.2128, 'grad_norm': 0.5671796798706055, 'learning_rate': 6.690954605860068e-06, 'epoch': 1.35}

 45%|████▌     | 4985/11049 [51:19<1:02:00,  1.63it/s]
 45%|████▌     | 4986/11049 [51:19<1:01:59,  1.63it/s]
                                                      
{'loss': 0.3048, 'grad_norm': 0.6071931719779968, 'learning_rate': 6.689467955614623e-06, 'epoch': 1.35}

 45%|████▌     | 4986/11049 [51:19<1:01:59,  1.63it/s]
 45%|████▌     | 4987/11049 [51:20<1:01:58,  1.63it/s]
                                                      
{'loss': 0.253, 'grad_norm': 0.6201927661895752, 'learning_rate': 6.687981136742041e-06, 'epoch': 1.35}

 45%|████▌     | 4987/11049 [51:20<1:01:58,  1.63it/s]
 45%|████▌     | 4988/11049 [51:20<1:01:57,  1.63it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.6264574527740479, 'learning_rate': 6.686494149390721e-06, 'epoch': 1.35}

 45%|████▌     | 4988/11049 [51:21<1:01:57,  1.63it/s]
 45%|████▌     | 4989/11049 [51:21<1:01:56,  1.63it/s]
                                                      
{'loss': 0.244, 'grad_norm': 0.6582173705101013, 'learning_rate': 6.685006993709081e-06, 'epoch': 1.35}

 45%|████▌     | 4989/11049 [51:21<1:01:56,  1.63it/s]
 45%|████▌     | 4990/11049 [51:22<1:01:56,  1.63it/s]
                                                      
{'loss': 0.1706, 'grad_norm': 0.46003463864326477, 'learning_rate': 6.6835196698455554e-06, 'epoch': 1.35}

 45%|████▌     | 4990/11049 [51:22<1:01:56,  1.63it/s]
 45%|████▌     | 4991/11049 [51:22<1:01:55,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.6516683101654053, 'learning_rate': 6.6820321779485955e-06, 'epoch': 1.36}

 45%|████▌     | 4991/11049 [51:22<1:01:55,  1.63it/s]
 45%|████▌     | 4992/11049 [51:23<1:01:53,  1.63it/s]
                                                      
{'loss': 0.1702, 'grad_norm': 0.5193442106246948, 'learning_rate': 6.680544518166666e-06, 'epoch': 1.36}

 45%|████▌     | 4992/11049 [51:23<1:01:53,  1.63it/s]
 45%|████▌     | 4993/11049 [51:24<1:01:54,  1.63it/s]
                                                      
{'loss': 0.2205, 'grad_norm': 0.5339393019676208, 'learning_rate': 6.679056690648256e-06, 'epoch': 1.36}

 45%|████▌     | 4993/11049 [51:24<1:01:54,  1.63it/s]
 45%|████▌     | 4994/11049 [51:24<1:01:54,  1.63it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.5785607099533081, 'learning_rate': 6.677568695541864e-06, 'epoch': 1.36}

 45%|████▌     | 4994/11049 [51:24<1:01:54,  1.63it/s]
 45%|████▌     | 4995/11049 [51:25<1:01:53,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.5447487235069275, 'learning_rate': 6.676080532996008e-06, 'epoch': 1.36}

 45%|████▌     | 4995/11049 [51:25<1:01:53,  1.63it/s]
 45%|████▌     | 4996/11049 [51:25<1:01:54,  1.63it/s]
                                                      
{'loss': 0.2194, 'grad_norm': 0.5564448833465576, 'learning_rate': 6.674592203159223e-06, 'epoch': 1.36}

 45%|████▌     | 4996/11049 [51:25<1:01:54,  1.63it/s]
 45%|████▌     | 4997/11049 [51:26<1:01:52,  1.63it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.6010661721229553, 'learning_rate': 6.673103706180061e-06, 'epoch': 1.36}

 45%|████▌     | 4997/11049 [51:26<1:01:52,  1.63it/s]
 45%|████▌     | 4998/11049 [51:27<1:01:50,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5294256806373596, 'learning_rate': 6.671615042207089e-06, 'epoch': 1.36}

 45%|████▌     | 4998/11049 [51:27<1:01:50,  1.63it/s]
 45%|████▌     | 4999/11049 [51:27<1:01:49,  1.63it/s]
                                                      
{'loss': 0.2048, 'grad_norm': 0.480682373046875, 'learning_rate': 6.670126211388894e-06, 'epoch': 1.36}

 45%|████▌     | 4999/11049 [51:27<1:01:49,  1.63it/s]
 45%|████▌     | 5000/11049 [51:28<1:01:49,  1.63it/s]
                                                      
{'loss': 0.2254, 'grad_norm': 0.6034947037696838, 'learning_rate': 6.668637213874074e-06, 'epoch': 1.36}

 45%|████▌     | 5000/11049 [51:28<1:01:49,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.36it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.84it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.73it/s]
                                                      

                                               
{'eval_loss': 0.5921181440353394, 'eval_runtime': 1.955, 'eval_samples_per_second': 102.302, 'eval_steps_per_second': 6.65, 'epoch': 1.36}

 45%|████▌     | 5000/11049 [51:30<1:01:49,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.73it/s]

                                               
 45%|████▌     | 5001/11049 [51:30<2:01:05,  1.20s/it]
                                                      
{'loss': 0.2352, 'grad_norm': 0.5520381927490234, 'learning_rate': 6.667148049811249e-06, 'epoch': 1.36}

 45%|████▌     | 5001/11049 [51:31<2:01:05,  1.20s/it]
 45%|████▌     | 5002/11049 [51:31<1:43:18,  1.02s/it]
                                                      
{'loss': 0.1784, 'grad_norm': 0.4541320204734802, 'learning_rate': 6.665658719349053e-06, 'epoch': 1.36}

 45%|████▌     | 5002/11049 [51:31<1:43:18,  1.02s/it]
 45%|████▌     | 5003/11049 [51:32<1:30:51,  1.11it/s]
                                                      
{'loss': 0.2575, 'grad_norm': 0.6904190182685852, 'learning_rate': 6.6641692226361396e-06, 'epoch': 1.36}

 45%|████▌     | 5003/11049 [51:32<1:30:51,  1.11it/s]
 45%|████▌     | 5004/11049 [51:32<1:22:07,  1.23it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5200192928314209, 'learning_rate': 6.662679559821172e-06, 'epoch': 1.36}

 45%|████▌     | 5004/11049 [51:32<1:22:07,  1.23it/s]
 45%|████▌     | 5005/11049 [51:33<1:15:58,  1.33it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.6094182729721069, 'learning_rate': 6.66118973105284e-06, 'epoch': 1.36}

 45%|████▌     | 5005/11049 [51:33<1:15:58,  1.33it/s]
 45%|████▌     | 5006/11049 [51:33<1:11:43,  1.40it/s]
                                                      
{'loss': 0.2168, 'grad_norm': 0.5221908688545227, 'learning_rate': 6.65969973647984e-06, 'epoch': 1.36}

 45%|████▌     | 5006/11049 [51:34<1:11:43,  1.40it/s]
 45%|████▌     | 5007/11049 [51:34<1:08:41,  1.47it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.5762786865234375, 'learning_rate': 6.658209576250892e-06, 'epoch': 1.36}

 45%|████▌     | 5007/11049 [51:34<1:08:41,  1.47it/s]
 45%|████▌     | 5008/11049 [51:35<1:06:37,  1.51it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.5493874549865723, 'learning_rate': 6.65671925051473e-06, 'epoch': 1.36}

 45%|████▌     | 5008/11049 [51:35<1:06:37,  1.51it/s]
 45%|████▌     | 5009/11049 [51:35<1:05:07,  1.55it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5826680064201355, 'learning_rate': 6.655228759420105e-06, 'epoch': 1.36}

 45%|████▌     | 5009/11049 [51:35<1:05:07,  1.55it/s]
 45%|████▌     | 5010/11049 [51:36<1:04:04,  1.57it/s]
                                                      
{'loss': 0.1679, 'grad_norm': 0.46346738934516907, 'learning_rate': 6.653738103115781e-06, 'epoch': 1.36}

 45%|████▌     | 5010/11049 [51:36<1:04:04,  1.57it/s]
 45%|████▌     | 5011/11049 [51:37<1:03:23,  1.59it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5421117544174194, 'learning_rate': 6.652247281750546e-06, 'epoch': 1.36}

 45%|████▌     | 5011/11049 [51:37<1:03:23,  1.59it/s]
 45%|████▌     | 5012/11049 [51:37<1:02:51,  1.60it/s]
                                                      
{'loss': 0.2526, 'grad_norm': 0.6558020710945129, 'learning_rate': 6.650756295473198e-06, 'epoch': 1.36}

 45%|████▌     | 5012/11049 [51:37<1:02:51,  1.60it/s]
 45%|████▌     | 5013/11049 [51:38<1:02:31,  1.61it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.56209397315979, 'learning_rate': 6.6492651444325516e-06, 'epoch': 1.36}

 45%|████▌     | 5013/11049 [51:38<1:02:31,  1.61it/s]
 45%|████▌     | 5014/11049 [51:38<1:02:14,  1.62it/s]
                                                      
{'loss': 0.192, 'grad_norm': 0.5561318397521973, 'learning_rate': 6.647773828777443e-06, 'epoch': 1.36}

 45%|████▌     | 5014/11049 [51:38<1:02:14,  1.62it/s]
 45%|████▌     | 5015/11049 [51:39<1:02:03,  1.62it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.556654691696167, 'learning_rate': 6.646282348656718e-06, 'epoch': 1.36}

 45%|████▌     | 5015/11049 [51:39<1:02:03,  1.62it/s]
 45%|████▌     | 5016/11049 [51:40<1:01:56,  1.62it/s]
                                                      
{'loss': 0.2112, 'grad_norm': 0.554636538028717, 'learning_rate': 6.644790704219247e-06, 'epoch': 1.36}

 45%|████▌     | 5016/11049 [51:40<1:01:56,  1.62it/s]
 45%|████▌     | 5017/11049 [51:40<1:01:51,  1.63it/s]
                                                      
{'loss': 0.2583, 'grad_norm': 0.6168140769004822, 'learning_rate': 6.643298895613909e-06, 'epoch': 1.36}

 45%|████▌     | 5017/11049 [51:40<1:01:51,  1.63it/s]
 45%|████▌     | 5018/11049 [51:41<1:01:49,  1.63it/s]
                                                      
{'loss': 0.2129, 'grad_norm': 0.5937047004699707, 'learning_rate': 6.641806922989605e-06, 'epoch': 1.36}

 45%|████▌     | 5018/11049 [51:41<1:01:49,  1.63it/s]
 45%|████▌     | 5019/11049 [51:41<1:01:45,  1.63it/s]
                                                      
{'loss': 0.2239, 'grad_norm': 0.5636658668518066, 'learning_rate': 6.640314786495245e-06, 'epoch': 1.36}

 45%|████▌     | 5019/11049 [51:42<1:01:45,  1.63it/s]
 45%|████▌     | 5020/11049 [51:42<1:01:42,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5433802604675293, 'learning_rate': 6.638822486279766e-06, 'epoch': 1.36}

 45%|████▌     | 5020/11049 [51:42<1:01:42,  1.63it/s]
 45%|████▌     | 5021/11049 [51:43<1:01:41,  1.63it/s]
                                                      
{'loss': 0.2225, 'grad_norm': 0.5138129591941833, 'learning_rate': 6.637330022492112e-06, 'epoch': 1.36}

 45%|████▌     | 5021/11049 [51:43<1:01:41,  1.63it/s]
 45%|████▌     | 5022/11049 [51:43<1:01:39,  1.63it/s]
                                                      
{'loss': 0.2032, 'grad_norm': 0.5623664259910583, 'learning_rate': 6.635837395281251e-06, 'epoch': 1.36}

 45%|████▌     | 5022/11049 [51:43<1:01:39,  1.63it/s]
 45%|████▌     | 5023/11049 [51:44<1:01:38,  1.63it/s]
                                                      
{'loss': 0.2443, 'grad_norm': 0.5326995849609375, 'learning_rate': 6.6343446047961565e-06, 'epoch': 1.36}

 45%|████▌     | 5023/11049 [51:44<1:01:38,  1.63it/s]
 45%|████▌     | 5024/11049 [51:45<1:01:37,  1.63it/s]
                                                      
{'loss': 0.2051, 'grad_norm': 0.5663406848907471, 'learning_rate': 6.632851651185833e-06, 'epoch': 1.36}

 45%|████▌     | 5024/11049 [51:45<1:01:37,  1.63it/s]
 45%|████▌     | 5025/11049 [51:45<1:01:38,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5667006969451904, 'learning_rate': 6.631358534599288e-06, 'epoch': 1.36}

 45%|████▌     | 5025/11049 [51:45<1:01:38,  1.63it/s]
 45%|████▌     | 5026/11049 [51:46<1:01:36,  1.63it/s]
                                                      
{'loss': 0.2885, 'grad_norm': 0.7190981507301331, 'learning_rate': 6.629865255185553e-06, 'epoch': 1.36}

 45%|████▌     | 5026/11049 [51:46<1:01:36,  1.63it/s]
 45%|████▌     | 5027/11049 [51:46<1:01:35,  1.63it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.5855096578598022, 'learning_rate': 6.628371813093673e-06, 'epoch': 1.36}

 45%|████▌     | 5027/11049 [51:46<1:01:35,  1.63it/s]
 46%|████▌     | 5028/11049 [51:47<1:01:33,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.46935105323791504, 'learning_rate': 6.626878208472709e-06, 'epoch': 1.37}

 46%|████▌     | 5028/11049 [51:47<1:01:33,  1.63it/s]
 46%|████▌     | 5029/11049 [51:48<1:01:31,  1.63it/s]
                                                      
{'loss': 0.1586, 'grad_norm': 0.4624888598918915, 'learning_rate': 6.625384441471738e-06, 'epoch': 1.37}

 46%|████▌     | 5029/11049 [51:48<1:01:31,  1.63it/s]
 46%|████▌     | 5030/11049 [51:48<1:01:30,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.6477422714233398, 'learning_rate': 6.6238905122398566e-06, 'epoch': 1.37}

 46%|████▌     | 5030/11049 [51:48<1:01:30,  1.63it/s]
 46%|████▌     | 5031/11049 [51:49<1:01:30,  1.63it/s]
                                                      
{'loss': 0.2466, 'grad_norm': 0.5910454988479614, 'learning_rate': 6.622396420926173e-06, 'epoch': 1.37}

 46%|████▌     | 5031/11049 [51:49<1:01:30,  1.63it/s]
 46%|████▌     | 5032/11049 [51:49<1:01:29,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.5492244362831116, 'learning_rate': 6.620902167679817e-06, 'epoch': 1.37}

 46%|████▌     | 5032/11049 [51:50<1:01:29,  1.63it/s]
 46%|████▌     | 5033/11049 [51:50<1:01:44,  1.62it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.6279603242874146, 'learning_rate': 6.619407752649926e-06, 'epoch': 1.37}

 46%|████▌     | 5033/11049 [51:50<1:01:44,  1.62it/s]
 46%|████▌     | 5034/11049 [51:51<1:01:40,  1.63it/s]
                                                      
{'loss': 0.2109, 'grad_norm': 0.5023865699768066, 'learning_rate': 6.6179131759856616e-06, 'epoch': 1.37}

 46%|████▌     | 5034/11049 [51:51<1:01:40,  1.63it/s]
 46%|████▌     | 5035/11049 [51:51<1:01:39,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.49871256947517395, 'learning_rate': 6.616418437836199e-06, 'epoch': 1.37}

 46%|████▌     | 5035/11049 [51:51<1:01:39,  1.63it/s]
 46%|████▌     | 5036/11049 [51:52<1:01:45,  1.62it/s]
                                                      
{'loss': 0.2234, 'grad_norm': 0.5325284600257874, 'learning_rate': 6.61492353835073e-06, 'epoch': 1.37}

 46%|████▌     | 5036/11049 [51:52<1:01:45,  1.62it/s]
 46%|████▌     | 5037/11049 [51:52<1:01:39,  1.63it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.46360084414482117, 'learning_rate': 6.613428477678457e-06, 'epoch': 1.37}

 46%|████▌     | 5037/11049 [51:53<1:01:39,  1.63it/s]
 46%|████▌     | 5038/11049 [51:53<1:01:33,  1.63it/s]
                                                      
{'loss': 0.2321, 'grad_norm': 0.5734084248542786, 'learning_rate': 6.611933255968609e-06, 'epoch': 1.37}

 46%|████▌     | 5038/11049 [51:53<1:01:33,  1.63it/s]
 46%|████▌     | 5039/11049 [51:54<1:01:30,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5284753441810608, 'learning_rate': 6.6104378733704235e-06, 'epoch': 1.37}

 46%|████▌     | 5039/11049 [51:54<1:01:30,  1.63it/s]
 46%|████▌     | 5040/11049 [51:54<1:01:36,  1.63it/s]
                                                      
{'loss': 0.2424, 'grad_norm': 0.5712229013442993, 'learning_rate': 6.608942330033153e-06, 'epoch': 1.37}

 46%|████▌     | 5040/11049 [51:54<1:01:36,  1.63it/s]
 46%|████▌     | 5041/11049 [51:55<1:01:35,  1.63it/s]
                                                      
{'loss': 0.2251, 'grad_norm': 0.57677161693573, 'learning_rate': 6.607446626106071e-06, 'epoch': 1.37}

 46%|████▌     | 5041/11049 [51:55<1:01:35,  1.63it/s]
 46%|████▌     | 5042/11049 [51:56<1:01:31,  1.63it/s]
                                                      
{'loss': 0.199, 'grad_norm': 0.5215970873832703, 'learning_rate': 6.6059507617384666e-06, 'epoch': 1.37}

 46%|████▌     | 5042/11049 [51:56<1:01:31,  1.63it/s]
 46%|████▌     | 5043/11049 [51:56<1:01:28,  1.63it/s]
                                                      
{'loss': 0.2127, 'grad_norm': 0.5920398831367493, 'learning_rate': 6.604454737079639e-06, 'epoch': 1.37}

 46%|████▌     | 5043/11049 [51:56<1:01:28,  1.63it/s]
 46%|████▌     | 5044/11049 [51:57<1:01:26,  1.63it/s]
                                                      
{'loss': 0.1791, 'grad_norm': 0.4790590703487396, 'learning_rate': 6.602958552278914e-06, 'epoch': 1.37}

 46%|████▌     | 5044/11049 [51:57<1:01:26,  1.63it/s]
 46%|████▌     | 5045/11049 [51:57<1:01:29,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.6008405685424805, 'learning_rate': 6.60146220748562e-06, 'epoch': 1.37}

 46%|████▌     | 5045/11049 [51:58<1:01:29,  1.63it/s]
 46%|████▌     | 5046/11049 [51:58<1:01:32,  1.63it/s]
                                                      
{'loss': 0.2138, 'grad_norm': 0.5692987442016602, 'learning_rate': 6.599965702849114e-06, 'epoch': 1.37}

 46%|████▌     | 5046/11049 [51:58<1:01:32,  1.63it/s]
 46%|████▌     | 5047/11049 [51:59<1:01:27,  1.63it/s]
                                                      
{'loss': 0.2522, 'grad_norm': 0.6171504855155945, 'learning_rate': 6.598469038518758e-06, 'epoch': 1.37}

 46%|████▌     | 5047/11049 [51:59<1:01:27,  1.63it/s]
 46%|████▌     | 5048/11049 [51:59<1:01:25,  1.63it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.5645386576652527, 'learning_rate': 6.59697221464394e-06, 'epoch': 1.37}

 46%|████▌     | 5048/11049 [51:59<1:01:25,  1.63it/s]
 46%|████▌     | 5049/11049 [52:00<1:01:23,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.5135831832885742, 'learning_rate': 6.595475231374057e-06, 'epoch': 1.37}

 46%|████▌     | 5049/11049 [52:00<1:01:23,  1.63it/s]
 46%|████▌     | 5050/11049 [52:00<1:01:20,  1.63it/s]
                                                      
{'loss': 0.1579, 'grad_norm': 0.41847676038742065, 'learning_rate': 6.593978088858524e-06, 'epoch': 1.37}

 46%|████▌     | 5050/11049 [52:01<1:01:20,  1.63it/s]
 46%|████▌     | 5051/11049 [52:01<1:01:22,  1.63it/s]
                                                      
{'loss': 0.1928, 'grad_norm': 0.5593404769897461, 'learning_rate': 6.592480787246771e-06, 'epoch': 1.37}

 46%|████▌     | 5051/11049 [52:01<1:01:22,  1.63it/s]
 46%|████▌     | 5052/11049 [52:02<1:01:20,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.45312073826789856, 'learning_rate': 6.590983326688248e-06, 'epoch': 1.37}

 46%|████▌     | 5052/11049 [52:02<1:01:20,  1.63it/s]
 46%|████▌     | 5053/11049 [52:02<1:01:19,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.6701663136482239, 'learning_rate': 6.589485707332416e-06, 'epoch': 1.37}

 46%|████▌     | 5053/11049 [52:02<1:01:19,  1.63it/s]
 46%|████▌     | 5054/11049 [52:03<1:01:18,  1.63it/s]
                                                      
{'loss': 0.2636, 'grad_norm': 0.6661977767944336, 'learning_rate': 6.587987929328753e-06, 'epoch': 1.37}

 46%|████▌     | 5054/11049 [52:03<1:01:18,  1.63it/s]
 46%|████▌     | 5055/11049 [52:04<1:01:17,  1.63it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.4391134977340698, 'learning_rate': 6.586489992826752e-06, 'epoch': 1.37}

 46%|████▌     | 5055/11049 [52:04<1:01:17,  1.63it/s]
 46%|████▌     | 5056/11049 [52:04<1:01:19,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.47449636459350586, 'learning_rate': 6.584991897975928e-06, 'epoch': 1.37}

 46%|████▌     | 5056/11049 [52:04<1:01:19,  1.63it/s]
 46%|████▌     | 5057/11049 [52:05<1:01:17,  1.63it/s]
                                                      
{'loss': 0.2447, 'grad_norm': 0.7329329252243042, 'learning_rate': 6.583493644925803e-06, 'epoch': 1.37}

 46%|████▌     | 5057/11049 [52:05<1:01:17,  1.63it/s]
 46%|████▌     | 5058/11049 [52:05<1:01:15,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.6060861349105835, 'learning_rate': 6.58199523382592e-06, 'epoch': 1.37}

 46%|████▌     | 5058/11049 [52:06<1:01:15,  1.63it/s]
 46%|████▌     | 5059/11049 [52:06<1:01:15,  1.63it/s]
                                                      
{'loss': 0.2338, 'grad_norm': 0.5454071760177612, 'learning_rate': 6.5804966648258365e-06, 'epoch': 1.37}

 46%|████▌     | 5059/11049 [52:06<1:01:15,  1.63it/s]
 46%|████▌     | 5060/11049 [52:07<1:01:13,  1.63it/s]
                                                      
{'loss': 0.2191, 'grad_norm': 0.6090410947799683, 'learning_rate': 6.578997938075126e-06, 'epoch': 1.37}

 46%|████▌     | 5060/11049 [52:07<1:01:13,  1.63it/s]
 46%|████▌     | 5061/11049 [52:07<1:01:19,  1.63it/s]
                                                      
{'loss': 0.1943, 'grad_norm': 0.540103018283844, 'learning_rate': 6.577499053723376e-06, 'epoch': 1.37}

 46%|████▌     | 5061/11049 [52:07<1:01:19,  1.63it/s]
 46%|████▌     | 5062/11049 [52:08<1:01:15,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5404326319694519, 'learning_rate': 6.576000011920196e-06, 'epoch': 1.37}

 46%|████▌     | 5062/11049 [52:08<1:01:15,  1.63it/s]
 46%|████▌     | 5063/11049 [52:08<1:01:16,  1.63it/s]
                                                      
{'loss': 0.2142, 'grad_norm': 0.5672445893287659, 'learning_rate': 6.574500812815201e-06, 'epoch': 1.37}

 46%|████▌     | 5063/11049 [52:09<1:01:16,  1.63it/s]
 46%|████▌     | 5064/11049 [52:09<1:01:13,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.6118919849395752, 'learning_rate': 6.57300145655803e-06, 'epoch': 1.37}

 46%|████▌     | 5064/11049 [52:09<1:01:13,  1.63it/s]
 46%|████▌     | 5065/11049 [52:10<1:01:12,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.5649041533470154, 'learning_rate': 6.571501943298335e-06, 'epoch': 1.38}

 46%|████▌     | 5065/11049 [52:10<1:01:12,  1.63it/s]
 46%|████▌     | 5066/11049 [52:10<1:01:13,  1.63it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.4788063168525696, 'learning_rate': 6.570002273185784e-06, 'epoch': 1.38}

 46%|████▌     | 5066/11049 [52:10<1:01:13,  1.63it/s]
 46%|████▌     | 5067/11049 [52:11<1:01:10,  1.63it/s]
                                                      
{'loss': 0.1978, 'grad_norm': 0.5677673816680908, 'learning_rate': 6.568502446370059e-06, 'epoch': 1.38}

 46%|████▌     | 5067/11049 [52:11<1:01:10,  1.63it/s]
 46%|████▌     | 5068/11049 [52:12<1:01:11,  1.63it/s]
                                                      
{'loss': 0.2239, 'grad_norm': 0.5244728326797485, 'learning_rate': 6.56700246300086e-06, 'epoch': 1.38}

 46%|████▌     | 5068/11049 [52:12<1:01:11,  1.63it/s]
 46%|████▌     | 5069/11049 [52:12<1:01:09,  1.63it/s]
                                                      
{'loss': 0.2023, 'grad_norm': 0.5824756622314453, 'learning_rate': 6.5655023232278994e-06, 'epoch': 1.38}

 46%|████▌     | 5069/11049 [52:12<1:01:09,  1.63it/s]
 46%|████▌     | 5070/11049 [52:13<1:01:08,  1.63it/s]
                                                      
{'loss': 0.202, 'grad_norm': 0.5579424500465393, 'learning_rate': 6.5640020272009094e-06, 'epoch': 1.38}

 46%|████▌     | 5070/11049 [52:13<1:01:08,  1.63it/s]
 46%|████▌     | 5071/11049 [52:13<1:01:11,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.6018834710121155, 'learning_rate': 6.562501575069636e-06, 'epoch': 1.38}

 46%|████▌     | 5071/11049 [52:13<1:01:11,  1.63it/s]
 46%|████▌     | 5072/11049 [52:14<1:01:08,  1.63it/s]
                                                      
{'loss': 0.2113, 'grad_norm': 0.5547123551368713, 'learning_rate': 6.56100096698384e-06, 'epoch': 1.38}

 46%|████▌     | 5072/11049 [52:14<1:01:08,  1.63it/s]
 46%|████▌     | 5073/11049 [52:15<1:01:08,  1.63it/s]
                                                      
{'loss': 0.2278, 'grad_norm': 0.5876867175102234, 'learning_rate': 6.559500203093296e-06, 'epoch': 1.38}

 46%|████▌     | 5073/11049 [52:15<1:01:08,  1.63it/s]
 46%|████▌     | 5074/11049 [52:15<1:01:06,  1.63it/s]
                                                      
{'loss': 0.1863, 'grad_norm': 0.5105716586112976, 'learning_rate': 6.5579992835478005e-06, 'epoch': 1.38}

 46%|████▌     | 5074/11049 [52:15<1:01:06,  1.63it/s]
 46%|████▌     | 5075/11049 [52:16<1:01:05,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.42031654715538025, 'learning_rate': 6.5564982084971585e-06, 'epoch': 1.38}

 46%|████▌     | 5075/11049 [52:16<1:01:05,  1.63it/s]
 46%|████▌     | 5076/11049 [52:16<1:01:08,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.7077852487564087, 'learning_rate': 6.554996978091195e-06, 'epoch': 1.38}

 46%|████▌     | 5076/11049 [52:17<1:01:08,  1.63it/s]
 46%|████▌     | 5077/11049 [52:17<1:01:07,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.5200638175010681, 'learning_rate': 6.553495592479747e-06, 'epoch': 1.38}

 46%|████▌     | 5077/11049 [52:17<1:01:07,  1.63it/s]
 46%|████▌     | 5078/11049 [52:18<1:01:04,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5614994764328003, 'learning_rate': 6.551994051812672e-06, 'epoch': 1.38}

 46%|████▌     | 5078/11049 [52:18<1:01:04,  1.63it/s]
 46%|████▌     | 5079/11049 [52:18<1:01:04,  1.63it/s]
                                                      
{'loss': 0.2249, 'grad_norm': 0.598543107509613, 'learning_rate': 6.550492356239837e-06, 'epoch': 1.38}

 46%|████▌     | 5079/11049 [52:18<1:01:04,  1.63it/s]
 46%|████▌     | 5080/11049 [52:19<1:01:03,  1.63it/s]
                                                      
{'loss': 0.2744, 'grad_norm': 0.583676278591156, 'learning_rate': 6.548990505911131e-06, 'epoch': 1.38}

 46%|████▌     | 5080/11049 [52:19<1:01:03,  1.63it/s]
 46%|████▌     | 5081/11049 [52:20<1:01:05,  1.63it/s]
                                                      
{'loss': 0.1933, 'grad_norm': 0.5304747223854065, 'learning_rate': 6.547488500976451e-06, 'epoch': 1.38}

 46%|████▌     | 5081/11049 [52:20<1:01:05,  1.63it/s]
 46%|████▌     | 5082/11049 [52:20<1:01:04,  1.63it/s]
                                                      
{'loss': 0.2556, 'grad_norm': 0.6373019218444824, 'learning_rate': 6.545986341585715e-06, 'epoch': 1.38}

 46%|████▌     | 5082/11049 [52:20<1:01:04,  1.63it/s]
 46%|████▌     | 5083/11049 [52:21<1:01:01,  1.63it/s]
                                                      
{'loss': 0.1934, 'grad_norm': 0.5200267434120178, 'learning_rate': 6.544484027888855e-06, 'epoch': 1.38}

 46%|████▌     | 5083/11049 [52:21<1:01:01,  1.63it/s]
 46%|████▌     | 5084/11049 [52:21<1:01:00,  1.63it/s]
                                                      
{'loss': 0.2684, 'grad_norm': 0.6239976286888123, 'learning_rate': 6.542981560035818e-06, 'epoch': 1.38}

 46%|████▌     | 5084/11049 [52:21<1:01:00,  1.63it/s]
 46%|████▌     | 5085/11049 [52:22<1:00:58,  1.63it/s]
                                                      
{'loss': 0.1972, 'grad_norm': 0.5418205857276917, 'learning_rate': 6.541478938176566e-06, 'epoch': 1.38}

 46%|████▌     | 5085/11049 [52:22<1:00:58,  1.63it/s]
 46%|████▌     | 5086/11049 [52:23<1:01:03,  1.63it/s]
                                                      
{'loss': 0.2269, 'grad_norm': 0.5293089151382446, 'learning_rate': 6.539976162461078e-06, 'epoch': 1.38}

 46%|████▌     | 5086/11049 [52:23<1:01:03,  1.63it/s]
 46%|████▌     | 5087/11049 [52:23<1:01:01,  1.63it/s]
                                                      
{'loss': 0.2071, 'grad_norm': 0.5397235155105591, 'learning_rate': 6.5384732330393455e-06, 'epoch': 1.38}

 46%|████▌     | 5087/11049 [52:23<1:01:01,  1.63it/s]
 46%|████▌     | 5088/11049 [52:24<1:00:59,  1.63it/s]
                                                      
{'loss': 0.2263, 'grad_norm': 0.540168046951294, 'learning_rate': 6.536970150061378e-06, 'epoch': 1.38}

 46%|████▌     | 5088/11049 [52:24<1:00:59,  1.63it/s]
 46%|████▌     | 5089/11049 [52:24<1:00:57,  1.63it/s]
                                                      
{'loss': 0.222, 'grad_norm': 0.5428370237350464, 'learning_rate': 6.535466913677201e-06, 'epoch': 1.38}

 46%|████▌     | 5089/11049 [52:25<1:00:57,  1.63it/s]
 46%|████▌     | 5090/11049 [52:25<1:00:57,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.48651838302612305, 'learning_rate': 6.53396352403685e-06, 'epoch': 1.38}

 46%|████▌     | 5090/11049 [52:25<1:00:57,  1.63it/s]
 46%|████▌     | 5091/11049 [52:26<1:00:59,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.5462241172790527, 'learning_rate': 6.5324599812903825e-06, 'epoch': 1.38}

 46%|████▌     | 5091/11049 [52:26<1:00:59,  1.63it/s]
 46%|████▌     | 5092/11049 [52:26<1:00:58,  1.63it/s]
                                                      
{'loss': 0.1986, 'grad_norm': 0.5361217260360718, 'learning_rate': 6.530956285587868e-06, 'epoch': 1.38}

 46%|████▌     | 5092/11049 [52:26<1:00:58,  1.63it/s]
 46%|████▌     | 5093/11049 [52:27<1:00:54,  1.63it/s]
                                                      
{'loss': 0.2539, 'grad_norm': 0.5570877194404602, 'learning_rate': 6.529452437079391e-06, 'epoch': 1.38}

 46%|████▌     | 5093/11049 [52:27<1:00:54,  1.63it/s]
 46%|████▌     | 5094/11049 [52:27<1:00:52,  1.63it/s]
                                                      
{'loss': 0.2329, 'grad_norm': 0.5874345898628235, 'learning_rate': 6.5279484359150525e-06, 'epoch': 1.38}

 46%|████▌     | 5094/11049 [52:28<1:00:52,  1.63it/s]
 46%|████▌     | 5095/11049 [52:28<1:00:51,  1.63it/s]
                                                      
{'loss': 0.1766, 'grad_norm': 0.49341094493865967, 'learning_rate': 6.5264442822449655e-06, 'epoch': 1.38}

 46%|████▌     | 5095/11049 [52:28<1:00:51,  1.63it/s]
 46%|████▌     | 5096/11049 [52:29<1:00:55,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5902596116065979, 'learning_rate': 6.524939976219263e-06, 'epoch': 1.38}

 46%|████▌     | 5096/11049 [52:29<1:00:55,  1.63it/s]
 46%|████▌     | 5097/11049 [52:29<1:00:54,  1.63it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.5304045081138611, 'learning_rate': 6.52343551798809e-06, 'epoch': 1.38}

 46%|████▌     | 5097/11049 [52:29<1:00:54,  1.63it/s]
 46%|████▌     | 5098/11049 [52:30<1:00:54,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.4767528176307678, 'learning_rate': 6.521930907701612e-06, 'epoch': 1.38}

 46%|████▌     | 5098/11049 [52:30<1:00:54,  1.63it/s]
 46%|████▌     | 5099/11049 [52:31<1:00:52,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5574430823326111, 'learning_rate': 6.520426145509998e-06, 'epoch': 1.38}

 46%|████▌     | 5099/11049 [52:31<1:00:52,  1.63it/s]
 46%|████▌     | 5100/11049 [52:31<1:00:51,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.4335615038871765, 'learning_rate': 6.5189212315634455e-06, 'epoch': 1.38}

 46%|████▌     | 5100/11049 [52:31<1:00:51,  1.63it/s]
 46%|████▌     | 5101/11049 [52:32<1:00:55,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.5059535503387451, 'learning_rate': 6.517416166012156e-06, 'epoch': 1.39}

 46%|████▌     | 5101/11049 [52:32<1:00:55,  1.63it/s]
 46%|████▌     | 5102/11049 [52:32<1:00:53,  1.63it/s]
                                                      
{'loss': 0.1847, 'grad_norm': 0.5216566920280457, 'learning_rate': 6.5159109490063565e-06, 'epoch': 1.39}

 46%|████▌     | 5102/11049 [52:33<1:00:53,  1.63it/s]
 46%|████▌     | 5103/11049 [52:33<1:00:49,  1.63it/s]
                                                      
{'loss': 0.1807, 'grad_norm': 0.5298324227333069, 'learning_rate': 6.514405580696282e-06, 'epoch': 1.39}

 46%|████▌     | 5103/11049 [52:33<1:00:49,  1.63it/s]
 46%|████▌     | 5104/11049 [52:34<1:00:47,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.5960260033607483, 'learning_rate': 6.512900061232183e-06, 'epoch': 1.39}

 46%|████▌     | 5104/11049 [52:34<1:00:47,  1.63it/s]
 46%|████▌     | 5105/11049 [52:34<1:00:48,  1.63it/s]
                                                      
{'loss': 0.1773, 'grad_norm': 0.4985229969024658, 'learning_rate': 6.511394390764326e-06, 'epoch': 1.39}

 46%|████▌     | 5105/11049 [52:34<1:00:48,  1.63it/s]
 46%|████▌     | 5106/11049 [52:35<1:00:48,  1.63it/s]
                                                      
{'loss': 0.2912, 'grad_norm': 0.8057956099510193, 'learning_rate': 6.509888569442997e-06, 'epoch': 1.39}

 46%|████▌     | 5106/11049 [52:35<1:00:48,  1.63it/s]
 46%|████▌     | 5107/11049 [52:35<1:00:48,  1.63it/s]
                                                      
{'loss': 0.2371, 'grad_norm': 0.6698114275932312, 'learning_rate': 6.50838259741849e-06, 'epoch': 1.39}

 46%|████▌     | 5107/11049 [52:36<1:00:48,  1.63it/s]
 46%|████▌     | 5108/11049 [52:36<1:00:45,  1.63it/s]
                                                      
{'loss': 0.2503, 'grad_norm': 0.6561552286148071, 'learning_rate': 6.506876474841119e-06, 'epoch': 1.39}

 46%|████▌     | 5108/11049 [52:36<1:00:45,  1.63it/s]
 46%|████▌     | 5109/11049 [52:37<1:00:43,  1.63it/s]
                                                      
{'loss': 0.2112, 'grad_norm': 0.5654475688934326, 'learning_rate': 6.50537020186121e-06, 'epoch': 1.39}

 46%|████▌     | 5109/11049 [52:37<1:00:43,  1.63it/s]
 46%|████▌     | 5110/11049 [52:37<1:00:42,  1.63it/s]
                                                      
{'loss': 0.2286, 'grad_norm': 0.6525022387504578, 'learning_rate': 6.503863778629106e-06, 'epoch': 1.39}

 46%|████▌     | 5110/11049 [52:37<1:00:42,  1.63it/s]
 46%|████▋     | 5111/11049 [52:38<1:00:44,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.5929815769195557, 'learning_rate': 6.502357205295164e-06, 'epoch': 1.39}

 46%|████▋     | 5111/11049 [52:38<1:00:44,  1.63it/s]
 46%|████▋     | 5112/11049 [52:39<1:00:43,  1.63it/s]
                                                      
{'loss': 0.1978, 'grad_norm': 0.5262721180915833, 'learning_rate': 6.5008504820097574e-06, 'epoch': 1.39}

 46%|████▋     | 5112/11049 [52:39<1:00:43,  1.63it/s]
 46%|████▋     | 5113/11049 [52:39<1:00:42,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.49199607968330383, 'learning_rate': 6.4993436089232705e-06, 'epoch': 1.39}

 46%|████▋     | 5113/11049 [52:39<1:00:42,  1.63it/s]
 46%|████▋     | 5114/11049 [52:40<1:00:43,  1.63it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.5255690217018127, 'learning_rate': 6.4978365861861095e-06, 'epoch': 1.39}

 46%|████▋     | 5114/11049 [52:40<1:00:43,  1.63it/s]
 46%|████▋     | 5115/11049 [52:40<1:00:41,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5201834440231323, 'learning_rate': 6.496329413948688e-06, 'epoch': 1.39}

 46%|████▋     | 5115/11049 [52:41<1:00:41,  1.63it/s]
 46%|████▋     | 5116/11049 [52:41<1:00:58,  1.62it/s]
                                                      
{'loss': 0.2475, 'grad_norm': 0.5433110594749451, 'learning_rate': 6.494822092361441e-06, 'epoch': 1.39}

 46%|████▋     | 5116/11049 [52:41<1:00:58,  1.62it/s]
 46%|████▋     | 5117/11049 [52:42<1:00:51,  1.62it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.5866358280181885, 'learning_rate': 6.493314621574813e-06, 'epoch': 1.39}

 46%|████▋     | 5117/11049 [52:42<1:00:51,  1.62it/s]
 46%|████▋     | 5118/11049 [52:42<1:00:47,  1.63it/s]
                                                      
{'loss': 0.1738, 'grad_norm': 0.4652590751647949, 'learning_rate': 6.491807001739267e-06, 'epoch': 1.39}

 46%|████▋     | 5118/11049 [52:42<1:00:47,  1.63it/s]
 46%|████▋     | 5119/11049 [52:43<1:00:44,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5281182527542114, 'learning_rate': 6.490299233005279e-06, 'epoch': 1.39}

 46%|████▋     | 5119/11049 [52:43<1:00:44,  1.63it/s]
 46%|████▋     | 5120/11049 [52:43<1:00:45,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.5785064697265625, 'learning_rate': 6.488791315523343e-06, 'epoch': 1.39}

 46%|████▋     | 5120/11049 [52:44<1:00:45,  1.63it/s]
 46%|████▋     | 5121/11049 [52:44<1:00:48,  1.62it/s]
                                                      
{'loss': 0.1725, 'grad_norm': 0.4234004318714142, 'learning_rate': 6.487283249443963e-06, 'epoch': 1.39}

 46%|████▋     | 5121/11049 [52:44<1:00:48,  1.62it/s]
 46%|████▋     | 5122/11049 [52:45<1:00:43,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.47645753622055054, 'learning_rate': 6.485775034917661e-06, 'epoch': 1.39}

 46%|████▋     | 5122/11049 [52:45<1:00:43,  1.63it/s]
 46%|████▋     | 5123/11049 [52:45<1:00:42,  1.63it/s]
                                                      
{'loss': 0.1972, 'grad_norm': 0.49944353103637695, 'learning_rate': 6.484266672094972e-06, 'epoch': 1.39}

 46%|████▋     | 5123/11049 [52:45<1:00:42,  1.63it/s]
 46%|████▋     | 5124/11049 [52:46<1:00:40,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.4931822121143341, 'learning_rate': 6.482758161126449e-06, 'epoch': 1.39}

 46%|████▋     | 5124/11049 [52:46<1:00:40,  1.63it/s]
 46%|████▋     | 5125/11049 [52:47<1:00:43,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.49064257740974426, 'learning_rate': 6.481249502162657e-06, 'epoch': 1.39}

 46%|████▋     | 5125/11049 [52:47<1:00:43,  1.63it/s]
 46%|████▋     | 5126/11049 [52:47<1:00:44,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.5131547451019287, 'learning_rate': 6.479740695354175e-06, 'epoch': 1.39}

 46%|████▋     | 5126/11049 [52:47<1:00:44,  1.63it/s]
 46%|████▋     | 5127/11049 [52:48<1:00:40,  1.63it/s]
                                                      
{'loss': 0.2533, 'grad_norm': 0.607770562171936, 'learning_rate': 6.4782317408516e-06, 'epoch': 1.39}

 46%|████▋     | 5127/11049 [52:48<1:00:40,  1.63it/s]
 46%|████▋     | 5128/11049 [52:48<1:02:18,  1.58it/s]
                                                      
{'loss': 0.2069, 'grad_norm': 0.59012770652771, 'learning_rate': 6.4767226388055405e-06, 'epoch': 1.39}

 46%|████▋     | 5128/11049 [52:49<1:02:18,  1.58it/s]
 46%|████▋     | 5129/11049 [52:49<1:01:46,  1.60it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.5075055360794067, 'learning_rate': 6.475213389366623e-06, 'epoch': 1.39}

 46%|████▋     | 5129/11049 [52:49<1:01:46,  1.60it/s]
 46%|████▋     | 5130/11049 [52:50<1:01:26,  1.61it/s]
                                                      
{'loss': 0.1703, 'grad_norm': 0.4848179221153259, 'learning_rate': 6.473703992685485e-06, 'epoch': 1.39}

 46%|████▋     | 5130/11049 [52:50<1:01:26,  1.61it/s]
 46%|████▋     | 5131/11049 [52:50<1:01:13,  1.61it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.4873383045196533, 'learning_rate': 6.4721944489127795e-06, 'epoch': 1.39}

 46%|████▋     | 5131/11049 [52:50<1:01:13,  1.61it/s]
 46%|████▋     | 5132/11049 [52:51<1:00:59,  1.62it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.4695591628551483, 'learning_rate': 6.4706847581991795e-06, 'epoch': 1.39}

 46%|████▋     | 5132/11049 [52:51<1:00:59,  1.62it/s]
 46%|████▋     | 5133/11049 [52:51<1:00:49,  1.62it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.44318586587905884, 'learning_rate': 6.469174920695364e-06, 'epoch': 1.39}

 46%|████▋     | 5133/11049 [52:52<1:00:49,  1.62it/s]
 46%|████▋     | 5134/11049 [52:52<1:00:41,  1.62it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.5294457077980042, 'learning_rate': 6.467664936552037e-06, 'epoch': 1.39}

 46%|████▋     | 5134/11049 [52:52<1:00:41,  1.62it/s]
 46%|████▋     | 5135/11049 [52:53<1:00:42,  1.62it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.5602366924285889, 'learning_rate': 6.466154805919904e-06, 'epoch': 1.39}

 46%|████▋     | 5135/11049 [52:53<1:00:42,  1.62it/s]
 46%|████▋     | 5136/11049 [52:53<1:00:42,  1.62it/s]
                                                      
{'loss': 0.2288, 'grad_norm': 0.6154773235321045, 'learning_rate': 6.464644528949697e-06, 'epoch': 1.39}

 46%|████▋     | 5136/11049 [52:53<1:00:42,  1.62it/s]
 46%|████▋     | 5137/11049 [52:54<1:00:37,  1.63it/s]
                                                      
{'loss': 0.1986, 'grad_norm': 0.5373075008392334, 'learning_rate': 6.463134105792155e-06, 'epoch': 1.39}

 46%|████▋     | 5137/11049 [52:54<1:00:37,  1.63it/s]
 47%|████▋     | 5138/11049 [52:55<1:00:33,  1.63it/s]
                                                      
{'loss': 0.2974, 'grad_norm': 0.6137109398841858, 'learning_rate': 6.461623536598038e-06, 'epoch': 1.4}

 47%|████▋     | 5138/11049 [52:55<1:00:33,  1.63it/s]
 47%|████▋     | 5139/11049 [52:55<1:00:31,  1.63it/s]
                                                      
{'loss': 0.284, 'grad_norm': 0.5966345071792603, 'learning_rate': 6.460112821518114e-06, 'epoch': 1.4}

 47%|████▋     | 5139/11049 [52:55<1:00:31,  1.63it/s]
 47%|████▋     | 5140/11049 [52:56<1:00:48,  1.62it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.5749837756156921, 'learning_rate': 6.458601960703171e-06, 'epoch': 1.4}

 47%|████▋     | 5140/11049 [52:56<1:00:48,  1.62it/s]
 47%|████▋     | 5141/11049 [52:56<1:00:44,  1.62it/s]
                                                      
{'loss': 0.2261, 'grad_norm': 0.48617076873779297, 'learning_rate': 6.457090954304007e-06, 'epoch': 1.4}

 47%|████▋     | 5141/11049 [52:57<1:00:44,  1.62it/s]
 47%|████▋     | 5142/11049 [52:57<1:00:36,  1.62it/s]
                                                      
{'loss': 0.235, 'grad_norm': 0.6037119030952454, 'learning_rate': 6.455579802471439e-06, 'epoch': 1.4}

 47%|████▋     | 5142/11049 [52:57<1:00:36,  1.62it/s]
 47%|████▋     | 5143/11049 [52:58<1:00:31,  1.63it/s]
                                                      
{'loss': 0.1828, 'grad_norm': 0.4495564103126526, 'learning_rate': 6.454068505356296e-06, 'epoch': 1.4}

 47%|████▋     | 5143/11049 [52:58<1:00:31,  1.63it/s]
 47%|████▋     | 5144/11049 [52:58<1:00:28,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5347641706466675, 'learning_rate': 6.452557063109419e-06, 'epoch': 1.4}

 47%|████▋     | 5144/11049 [52:58<1:00:28,  1.63it/s]
 47%|████▋     | 5145/11049 [52:59<1:00:31,  1.63it/s]
                                                      
{'loss': 0.1519, 'grad_norm': 0.418021023273468, 'learning_rate': 6.451045475881668e-06, 'epoch': 1.4}

 47%|████▋     | 5145/11049 [52:59<1:00:31,  1.63it/s]
 47%|████▋     | 5146/11049 [52:59<1:00:31,  1.63it/s]
                                                      
{'loss': 0.1354, 'grad_norm': 0.40804144740104675, 'learning_rate': 6.449533743823917e-06, 'epoch': 1.4}

 47%|████▋     | 5146/11049 [53:00<1:00:31,  1.63it/s]
 47%|████▋     | 5147/11049 [53:00<1:00:28,  1.63it/s]
                                                      
{'loss': 0.2257, 'grad_norm': 0.6152881383895874, 'learning_rate': 6.448021867087052e-06, 'epoch': 1.4}

 47%|████▋     | 5147/11049 [53:00<1:00:28,  1.63it/s]
 47%|████▋     | 5148/11049 [53:01<1:00:26,  1.63it/s]
                                                      
{'loss': 0.1944, 'grad_norm': 0.562956690788269, 'learning_rate': 6.446509845821975e-06, 'epoch': 1.4}

 47%|████▋     | 5148/11049 [53:01<1:00:26,  1.63it/s]
 47%|████▋     | 5149/11049 [53:01<1:00:22,  1.63it/s]
                                                      
{'loss': 0.2263, 'grad_norm': 0.5929930806159973, 'learning_rate': 6.444997680179601e-06, 'epoch': 1.4}

 47%|████▋     | 5149/11049 [53:01<1:00:22,  1.63it/s]
 47%|████▋     | 5150/11049 [53:02<1:00:27,  1.63it/s]
                                                      
{'loss': 0.2155, 'grad_norm': 0.5740496516227722, 'learning_rate': 6.443485370310861e-06, 'epoch': 1.4}

 47%|████▋     | 5150/11049 [53:02<1:00:27,  1.63it/s]
 47%|████▋     | 5151/11049 [53:03<1:00:28,  1.63it/s]
                                                      
{'loss': 0.2586, 'grad_norm': 0.6353343725204468, 'learning_rate': 6.4419729163667e-06, 'epoch': 1.4}

 47%|████▋     | 5151/11049 [53:03<1:00:28,  1.63it/s]
 47%|████▋     | 5152/11049 [53:03<1:00:23,  1.63it/s]
                                                      
{'loss': 0.2004, 'grad_norm': 0.5796723365783691, 'learning_rate': 6.440460318498079e-06, 'epoch': 1.4}

 47%|████▋     | 5152/11049 [53:03<1:00:23,  1.63it/s]
 47%|████▋     | 5153/11049 [53:04<1:00:20,  1.63it/s]
                                                      
{'loss': 0.1902, 'grad_norm': 0.5100917816162109, 'learning_rate': 6.4389475768559675e-06, 'epoch': 1.4}

 47%|████▋     | 5153/11049 [53:04<1:00:20,  1.63it/s]
 47%|████▋     | 5154/11049 [53:04<1:00:18,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.6119540333747864, 'learning_rate': 6.437434691591358e-06, 'epoch': 1.4}

 47%|████▋     | 5154/11049 [53:05<1:00:18,  1.63it/s]
 47%|████▋     | 5155/11049 [53:05<1:00:37,  1.62it/s]
                                                      
{'loss': 0.2303, 'grad_norm': 0.5998790264129639, 'learning_rate': 6.435921662855248e-06, 'epoch': 1.4}

 47%|████▋     | 5155/11049 [53:05<1:00:37,  1.62it/s]
 47%|████▋     | 5156/11049 [53:06<1:00:31,  1.62it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.6014689207077026, 'learning_rate': 6.434408490798658e-06, 'epoch': 1.4}

 47%|████▋     | 5156/11049 [53:06<1:00:31,  1.62it/s]
 47%|████▋     | 5157/11049 [53:06<1:00:25,  1.63it/s]
                                                      
{'loss': 0.197, 'grad_norm': 0.5866451263427734, 'learning_rate': 6.432895175572619e-06, 'epoch': 1.4}

 47%|████▋     | 5157/11049 [53:06<1:00:25,  1.63it/s]
 47%|████▋     | 5158/11049 [53:07<1:00:21,  1.63it/s]
                                                      
{'loss': 0.1594, 'grad_norm': 0.44387608766555786, 'learning_rate': 6.431381717328173e-06, 'epoch': 1.4}

 47%|████▋     | 5158/11049 [53:07<1:00:21,  1.63it/s]
 47%|████▋     | 5159/11049 [53:07<1:00:16,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5138354897499084, 'learning_rate': 6.429868116216382e-06, 'epoch': 1.4}

 47%|████▋     | 5159/11049 [53:08<1:00:16,  1.63it/s]
 47%|████▋     | 5160/11049 [53:08<1:00:16,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.5213884115219116, 'learning_rate': 6.428354372388319e-06, 'epoch': 1.4}

 47%|████▋     | 5160/11049 [53:08<1:00:16,  1.63it/s]
 47%|████▋     | 5161/11049 [53:09<1:00:18,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.5161551833152771, 'learning_rate': 6.426840485995072e-06, 'epoch': 1.4}

 47%|████▋     | 5161/11049 [53:09<1:00:18,  1.63it/s]
 47%|████▋     | 5162/11049 [53:09<1:00:16,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5570116639137268, 'learning_rate': 6.425326457187743e-06, 'epoch': 1.4}

 47%|████▋     | 5162/11049 [53:09<1:00:16,  1.63it/s]
 47%|████▋     | 5163/11049 [53:10<1:00:16,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.5553221702575684, 'learning_rate': 6.423812286117448e-06, 'epoch': 1.4}

 47%|████▋     | 5163/11049 [53:10<1:00:16,  1.63it/s]
 47%|████▋     | 5164/11049 [53:11<1:00:15,  1.63it/s]
                                                      
{'loss': 0.2194, 'grad_norm': 0.5994929671287537, 'learning_rate': 6.4222979729353185e-06, 'epoch': 1.4}

 47%|████▋     | 5164/11049 [53:11<1:00:15,  1.63it/s]
 47%|████▋     | 5165/11049 [53:11<1:00:16,  1.63it/s]
                                                      
{'loss': 0.1873, 'grad_norm': 0.47734344005584717, 'learning_rate': 6.420783517792499e-06, 'epoch': 1.4}

 47%|████▋     | 5165/11049 [53:11<1:00:16,  1.63it/s]
 47%|████▋     | 5166/11049 [53:12<1:00:18,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.5957355499267578, 'learning_rate': 6.4192689208401495e-06, 'epoch': 1.4}

 47%|████▋     | 5166/11049 [53:12<1:00:18,  1.63it/s]
 47%|████▋     | 5167/11049 [53:12<1:00:14,  1.63it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.6551731824874878, 'learning_rate': 6.417754182229441e-06, 'epoch': 1.4}

 47%|████▋     | 5167/11049 [53:13<1:00:14,  1.63it/s]
 47%|████▋     | 5168/11049 [53:13<1:00:12,  1.63it/s]
                                                      
{'loss': 0.1865, 'grad_norm': 0.49796736240386963, 'learning_rate': 6.416239302111562e-06, 'epoch': 1.4}

 47%|████▋     | 5168/11049 [53:13<1:00:12,  1.63it/s]
 47%|████▋     | 5169/11049 [53:14<1:00:10,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.4520101845264435, 'learning_rate': 6.414724280637713e-06, 'epoch': 1.4}

 47%|████▋     | 5169/11049 [53:14<1:00:10,  1.63it/s]
 47%|████▋     | 5170/11049 [53:14<1:00:16,  1.63it/s]
                                                      
{'loss': 0.236, 'grad_norm': 0.637466311454773, 'learning_rate': 6.413209117959111e-06, 'epoch': 1.4}

 47%|████▋     | 5170/11049 [53:14<1:00:16,  1.63it/s]
 47%|████▋     | 5171/11049 [53:15<1:00:15,  1.63it/s]
                                                      
{'loss': 0.2276, 'grad_norm': 0.5651540756225586, 'learning_rate': 6.411693814226984e-06, 'epoch': 1.4}

 47%|████▋     | 5171/11049 [53:15<1:00:15,  1.63it/s]
 47%|████▋     | 5172/11049 [53:15<1:00:12,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.5312032103538513, 'learning_rate': 6.410178369592579e-06, 'epoch': 1.4}

 47%|████▋     | 5172/11049 [53:16<1:00:12,  1.63it/s]
 47%|████▋     | 5173/11049 [53:16<1:00:09,  1.63it/s]
                                                      
{'loss': 0.1729, 'grad_norm': 0.4465585947036743, 'learning_rate': 6.408662784207149e-06, 'epoch': 1.4}

 47%|████▋     | 5173/11049 [53:16<1:00:09,  1.63it/s]
 47%|████▋     | 5174/11049 [53:17<1:00:05,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5051620602607727, 'learning_rate': 6.407147058221969e-06, 'epoch': 1.4}

 47%|████▋     | 5174/11049 [53:17<1:00:05,  1.63it/s]
 47%|████▋     | 5175/11049 [53:17<1:00:10,  1.63it/s]
                                                      
{'loss': 0.2175, 'grad_norm': 0.5790677666664124, 'learning_rate': 6.405631191788323e-06, 'epoch': 1.41}

 47%|████▋     | 5175/11049 [53:17<1:00:10,  1.63it/s]
 47%|████▋     | 5176/11049 [53:18<1:00:09,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5571423172950745, 'learning_rate': 6.404115185057512e-06, 'epoch': 1.41}

 47%|████▋     | 5176/11049 [53:18<1:00:09,  1.63it/s]
 47%|████▋     | 5177/11049 [53:19<1:00:05,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5360521078109741, 'learning_rate': 6.402599038180849e-06, 'epoch': 1.41}

 47%|████▋     | 5177/11049 [53:19<1:00:05,  1.63it/s]
 47%|████▋     | 5178/11049 [53:19<1:00:05,  1.63it/s]
                                                      
{'loss': 0.1828, 'grad_norm': 0.4992612600326538, 'learning_rate': 6.401082751309663e-06, 'epoch': 1.41}

 47%|████▋     | 5178/11049 [53:19<1:00:05,  1.63it/s]
 47%|████▋     | 5179/11049 [53:20<1:00:03,  1.63it/s]
                                                      
{'loss': 0.2013, 'grad_norm': 0.6493327617645264, 'learning_rate': 6.3995663245952955e-06, 'epoch': 1.41}

 47%|████▋     | 5179/11049 [53:20<1:00:03,  1.63it/s]
 47%|████▋     | 5180/11049 [53:20<1:00:02,  1.63it/s]
                                                      
{'loss': 0.1888, 'grad_norm': 0.589691698551178, 'learning_rate': 6.3980497581891025e-06, 'epoch': 1.41}

 47%|████▋     | 5180/11049 [53:21<1:00:02,  1.63it/s]
 47%|████▋     | 5181/11049 [53:21<1:00:05,  1.63it/s]
                                                      
{'loss': 0.2337, 'grad_norm': 0.601161003112793, 'learning_rate': 6.396533052242451e-06, 'epoch': 1.41}

 47%|████▋     | 5181/11049 [53:21<1:00:05,  1.63it/s]
 47%|████▋     | 5182/11049 [53:22<1:00:02,  1.63it/s]
                                                      
{'loss': 0.2445, 'grad_norm': 0.5625121593475342, 'learning_rate': 6.395016206906727e-06, 'epoch': 1.41}

 47%|████▋     | 5182/11049 [53:22<1:00:02,  1.63it/s]
 47%|████▋     | 5183/11049 [53:22<1:00:01,  1.63it/s]
                                                      
{'loss': 0.1816, 'grad_norm': 0.5043273568153381, 'learning_rate': 6.3934992223333284e-06, 'epoch': 1.41}

 47%|████▋     | 5183/11049 [53:22<1:00:01,  1.63it/s]
 47%|████▋     | 5184/11049 [53:23<59:57,  1.63it/s]  
                                                    
{'loss': 0.2095, 'grad_norm': 0.5680971741676331, 'learning_rate': 6.391982098673666e-06, 'epoch': 1.41}

 47%|████▋     | 5184/11049 [53:23<59:57,  1.63it/s]
 47%|████▋     | 5185/11049 [53:23<59:57,  1.63it/s]
                                                    
{'loss': 0.2947, 'grad_norm': 0.5998627543449402, 'learning_rate': 6.3904648360791645e-06, 'epoch': 1.41}

 47%|████▋     | 5185/11049 [53:24<59:57,  1.63it/s]
 47%|████▋     | 5186/11049 [53:24<59:57,  1.63it/s]
                                                    
{'loss': 0.2095, 'grad_norm': 0.48303765058517456, 'learning_rate': 6.388947434701265e-06, 'epoch': 1.41}

 47%|████▋     | 5186/11049 [53:24<59:57,  1.63it/s]
 47%|████▋     | 5187/11049 [53:25<59:56,  1.63it/s]
                                                    
{'loss': 0.2192, 'grad_norm': 0.6023340821266174, 'learning_rate': 6.387429894691417e-06, 'epoch': 1.41}

 47%|████▋     | 5187/11049 [53:25<59:56,  1.63it/s]
 47%|████▋     | 5188/11049 [53:25<59:54,  1.63it/s]
                                                    
{'loss': 0.2265, 'grad_norm': 0.5775161981582642, 'learning_rate': 6.385912216201092e-06, 'epoch': 1.41}

 47%|████▋     | 5188/11049 [53:25<59:54,  1.63it/s]
 47%|████▋     | 5189/11049 [53:26<59:52,  1.63it/s]
                                                    
{'loss': 0.2122, 'grad_norm': 0.4747808575630188, 'learning_rate': 6.384394399381766e-06, 'epoch': 1.41}

 47%|████▋     | 5189/11049 [53:26<59:52,  1.63it/s]
 47%|████▋     | 5190/11049 [53:27<59:53,  1.63it/s]
                                                    
{'loss': 0.178, 'grad_norm': 0.46937936544418335, 'learning_rate': 6.3828764443849375e-06, 'epoch': 1.41}

 47%|████▋     | 5190/11049 [53:27<59:53,  1.63it/s]
 47%|████▋     | 5191/11049 [53:27<59:58,  1.63it/s]
                                                    
{'loss': 0.234, 'grad_norm': 0.6184908151626587, 'learning_rate': 6.381358351362112e-06, 'epoch': 1.41}

 47%|████▋     | 5191/11049 [53:27<59:58,  1.63it/s]
 47%|████▋     | 5192/11049 [53:28<59:55,  1.63it/s]
                                                    
{'loss': 0.198, 'grad_norm': 0.5793507695198059, 'learning_rate': 6.379840120464813e-06, 'epoch': 1.41}

 47%|████▋     | 5192/11049 [53:28<59:55,  1.63it/s]
 47%|████▋     | 5193/11049 [53:28<1:01:24,  1.59it/s]
                                                      
{'loss': 0.2842, 'grad_norm': 0.5787467956542969, 'learning_rate': 6.378321751844578e-06, 'epoch': 1.41}

 47%|████▋     | 5193/11049 [53:29<1:01:24,  1.59it/s]
 47%|████▋     | 5194/11049 [53:29<1:01:09,  1.60it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.5988781452178955, 'learning_rate': 6.376803245652952e-06, 'epoch': 1.41}

 47%|████▋     | 5194/11049 [53:29<1:01:09,  1.60it/s]
 47%|████▋     | 5195/11049 [53:30<1:00:50,  1.60it/s]
                                                      
{'loss': 0.1818, 'grad_norm': 0.4900420010089874, 'learning_rate': 6.375284602041501e-06, 'epoch': 1.41}

 47%|████▋     | 5195/11049 [53:30<1:00:50,  1.60it/s]
 47%|████▋     | 5196/11049 [53:30<1:00:36,  1.61it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5670533776283264, 'learning_rate': 6.373765821161801e-06, 'epoch': 1.41}

 47%|████▋     | 5196/11049 [53:30<1:00:36,  1.61it/s]
 47%|████▋     | 5197/11049 [53:31<1:00:22,  1.62it/s]
                                                      
{'loss': 0.215, 'grad_norm': 0.5662342309951782, 'learning_rate': 6.372246903165445e-06, 'epoch': 1.41}

 47%|████▋     | 5197/11049 [53:31<1:00:22,  1.62it/s]
 47%|████▋     | 5198/11049 [53:31<1:00:11,  1.62it/s]
                                                      
{'loss': 0.227, 'grad_norm': 0.5409900546073914, 'learning_rate': 6.370727848204037e-06, 'epoch': 1.41}

 47%|████▋     | 5198/11049 [53:32<1:00:11,  1.62it/s]
 47%|████▋     | 5199/11049 [53:32<1:00:05,  1.62it/s]
                                                      
{'loss': 0.2934, 'grad_norm': 0.6055232286453247, 'learning_rate': 6.369208656429193e-06, 'epoch': 1.41}

 47%|████▋     | 5199/11049 [53:32<1:00:05,  1.62it/s]
 47%|████▋     | 5200/11049 [53:33<1:00:05,  1.62it/s]
                                                      
{'loss': 0.2166, 'grad_norm': 0.5792824625968933, 'learning_rate': 6.3676893279925456e-06, 'epoch': 1.41}

 47%|████▋     | 5200/11049 [53:33<1:00:05,  1.62it/s]
 47%|████▋     | 5201/11049 [53:33<1:00:03,  1.62it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5167984366416931, 'learning_rate': 6.36616986304574e-06, 'epoch': 1.41}

 47%|████▋     | 5201/11049 [53:33<1:00:03,  1.62it/s]
 47%|████▋     | 5202/11049 [53:34<59:57,  1.63it/s]  
                                                    
{'loss': 0.2559, 'grad_norm': 0.6106614470481873, 'learning_rate': 6.364650261740437e-06, 'epoch': 1.41}

 47%|████▋     | 5202/11049 [53:34<59:57,  1.63it/s]
 47%|████▋     | 5203/11049 [53:35<59:54,  1.63it/s]
                                                    
{'loss': 0.2302, 'grad_norm': 0.5917523503303528, 'learning_rate': 6.363130524228307e-06, 'epoch': 1.41}

 47%|████▋     | 5203/11049 [53:35<59:54,  1.63it/s]
 47%|████▋     | 5204/11049 [53:35<59:51,  1.63it/s]
                                                    
{'loss': 0.2026, 'grad_norm': 0.5188534259796143, 'learning_rate': 6.361610650661036e-06, 'epoch': 1.41}

 47%|████▋     | 5204/11049 [53:35<59:51,  1.63it/s]
 47%|████▋     | 5205/11049 [53:36<1:01:26,  1.59it/s]
                                                      
{'loss': 0.1935, 'grad_norm': 0.5917221903800964, 'learning_rate': 6.360090641190326e-06, 'epoch': 1.41}

 47%|████▋     | 5205/11049 [53:36<1:01:26,  1.59it/s]
 47%|████▋     | 5206/11049 [53:36<1:01:26,  1.59it/s]
                                                      
{'loss': 0.1639, 'grad_norm': 0.45837274193763733, 'learning_rate': 6.358570495967891e-06, 'epoch': 1.41}

 47%|████▋     | 5206/11049 [53:37<1:01:26,  1.59it/s]
 47%|████▋     | 5207/11049 [53:37<1:00:56,  1.60it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.5050905346870422, 'learning_rate': 6.357050215145454e-06, 'epoch': 1.41}

 47%|████▋     | 5207/11049 [53:37<1:00:56,  1.60it/s]
 47%|████▋     | 5208/11049 [53:38<1:00:34,  1.61it/s]
                                                      
{'loss': 0.2437, 'grad_norm': 0.5714099407196045, 'learning_rate': 6.355529798874757e-06, 'epoch': 1.41}

 47%|████▋     | 5208/11049 [53:38<1:00:34,  1.61it/s]
 47%|████▋     | 5209/11049 [53:38<1:00:17,  1.61it/s]
                                                      
{'loss': 0.1471, 'grad_norm': 0.45865437388420105, 'learning_rate': 6.354009247307556e-06, 'epoch': 1.41}

 47%|████▋     | 5209/11049 [53:38<1:00:17,  1.61it/s]
 47%|████▋     | 5210/11049 [53:39<1:00:09,  1.62it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.5644043684005737, 'learning_rate': 6.3524885605956155e-06, 'epoch': 1.41}

 47%|████▋     | 5210/11049 [53:39<1:00:09,  1.62it/s]
 47%|████▋     | 5211/11049 [53:40<1:00:03,  1.62it/s]
                                                      
{'loss': 0.2139, 'grad_norm': 0.5574259757995605, 'learning_rate': 6.350967738890719e-06, 'epoch': 1.41}

 47%|████▋     | 5211/11049 [53:40<1:00:03,  1.62it/s]
 47%|████▋     | 5212/11049 [53:40<59:56,  1.62it/s]  
                                                    
{'loss': 0.2302, 'grad_norm': 0.6092018485069275, 'learning_rate': 6.349446782344657e-06, 'epoch': 1.42}

 47%|████▋     | 5212/11049 [53:40<59:56,  1.62it/s]
 47%|████▋     | 5213/11049 [53:41<59:50,  1.63it/s]
                                                    
{'loss': 0.2283, 'grad_norm': 0.6689876914024353, 'learning_rate': 6.3479256911092435e-06, 'epoch': 1.42}

 47%|████▋     | 5213/11049 [53:41<59:50,  1.63it/s]
 47%|████▋     | 5214/11049 [53:41<59:46,  1.63it/s]
                                                    
{'loss': 0.2104, 'grad_norm': 0.552865743637085, 'learning_rate': 6.3464044653362944e-06, 'epoch': 1.42}

 47%|████▋     | 5214/11049 [53:42<59:46,  1.63it/s]
 47%|████▋     | 5215/11049 [53:42<59:51,  1.62it/s]
                                                    
{'loss': 0.1817, 'grad_norm': 0.5255477428436279, 'learning_rate': 6.344883105177648e-06, 'epoch': 1.42}

 47%|████▋     | 5215/11049 [53:42<59:51,  1.62it/s]
 47%|████▋     | 5216/11049 [53:43<59:49,  1.63it/s]
                                                    
{'loss': 0.2486, 'grad_norm': 0.5855062007904053, 'learning_rate': 6.34336161078515e-06, 'epoch': 1.42}

 47%|████▋     | 5216/11049 [53:43<59:49,  1.63it/s]
 47%|████▋     | 5217/11049 [53:43<59:46,  1.63it/s]
                                                    
{'loss': 0.2367, 'grad_norm': 0.6241427063941956, 'learning_rate': 6.341839982310665e-06, 'epoch': 1.42}

 47%|████▋     | 5217/11049 [53:43<59:46,  1.63it/s]
 47%|████▋     | 5218/11049 [53:44<59:43,  1.63it/s]
                                                    
{'loss': 0.2528, 'grad_norm': 0.5855559706687927, 'learning_rate': 6.340318219906063e-06, 'epoch': 1.42}

 47%|████▋     | 5218/11049 [53:44<59:43,  1.63it/s]
 47%|████▋     | 5219/11049 [53:44<59:37,  1.63it/s]
                                                    
{'loss': 0.2175, 'grad_norm': 0.6254639029502869, 'learning_rate': 6.338796323723236e-06, 'epoch': 1.42}

 47%|████▋     | 5219/11049 [53:45<59:37,  1.63it/s]
 47%|████▋     | 5220/11049 [53:45<59:43,  1.63it/s]
                                                    
{'loss': 0.1604, 'grad_norm': 0.43040159344673157, 'learning_rate': 6.337274293914087e-06, 'epoch': 1.42}

 47%|████▋     | 5220/11049 [53:45<59:43,  1.63it/s]
 47%|████▋     | 5221/11049 [53:46<59:40,  1.63it/s]
                                                    
{'loss': 0.2456, 'grad_norm': 0.5186707973480225, 'learning_rate': 6.335752130630527e-06, 'epoch': 1.42}

 47%|████▋     | 5221/11049 [53:46<59:40,  1.63it/s]
 47%|████▋     | 5222/11049 [53:46<59:37,  1.63it/s]
                                                    
{'loss': 0.1956, 'grad_norm': 0.5254519581794739, 'learning_rate': 6.334229834024486e-06, 'epoch': 1.42}

 47%|████▋     | 5222/11049 [53:46<59:37,  1.63it/s]
 47%|████▋     | 5223/11049 [53:47<59:36,  1.63it/s]
                                                    
{'loss': 0.2499, 'grad_norm': 0.6775186657905579, 'learning_rate': 6.332707404247907e-06, 'epoch': 1.42}

 47%|████▋     | 5223/11049 [53:47<59:36,  1.63it/s]
 47%|████▋     | 5224/11049 [53:48<59:35,  1.63it/s]
                                                    
{'loss': 0.2441, 'grad_norm': 0.642623782157898, 'learning_rate': 6.331184841452743e-06, 'epoch': 1.42}

 47%|████▋     | 5224/11049 [53:48<59:35,  1.63it/s]
 47%|████▋     | 5225/11049 [53:48<59:41,  1.63it/s]
                                                    
{'loss': 0.2239, 'grad_norm': 0.6282913088798523, 'learning_rate': 6.329662145790964e-06, 'epoch': 1.42}

 47%|████▋     | 5225/11049 [53:48<59:41,  1.63it/s]
 47%|████▋     | 5226/11049 [53:49<59:38,  1.63it/s]
                                                    
{'loss': 0.1952, 'grad_norm': 0.5369660258293152, 'learning_rate': 6.328139317414549e-06, 'epoch': 1.42}

 47%|████▋     | 5226/11049 [53:49<59:38,  1.63it/s]
 47%|████▋     | 5227/11049 [53:49<59:36,  1.63it/s]
                                                    
{'loss': 0.1952, 'grad_norm': 0.6049704551696777, 'learning_rate': 6.326616356475496e-06, 'epoch': 1.42}

 47%|████▋     | 5227/11049 [53:50<59:36,  1.63it/s]
 47%|████▋     | 5228/11049 [53:50<59:35,  1.63it/s]
                                                    
{'loss': 0.2198, 'grad_norm': 0.5668331980705261, 'learning_rate': 6.32509326312581e-06, 'epoch': 1.42}

 47%|████▋     | 5228/11049 [53:50<59:35,  1.63it/s]
 47%|████▋     | 5229/11049 [53:51<59:34,  1.63it/s]
                                                    
{'loss': 0.1985, 'grad_norm': 0.5254871845245361, 'learning_rate': 6.323570037517514e-06, 'epoch': 1.42}

 47%|████▋     | 5229/11049 [53:51<59:34,  1.63it/s]
 47%|████▋     | 5230/11049 [53:51<59:39,  1.63it/s]
                                                    
{'loss': 0.2125, 'grad_norm': 0.5040464401245117, 'learning_rate': 6.322046679802639e-06, 'epoch': 1.42}

 47%|████▋     | 5230/11049 [53:51<59:39,  1.63it/s]
 47%|████▋     | 5231/11049 [53:52<59:37,  1.63it/s]
                                                    
{'loss': 0.2438, 'grad_norm': 0.5989706516265869, 'learning_rate': 6.320523190133238e-06, 'epoch': 1.42}

 47%|████▋     | 5231/11049 [53:52<59:37,  1.63it/s]
 47%|████▋     | 5232/11049 [53:52<59:34,  1.63it/s]
                                                    
{'loss': 0.2275, 'grad_norm': 0.5718587636947632, 'learning_rate': 6.318999568661367e-06, 'epoch': 1.42}

 47%|████▋     | 5232/11049 [53:53<59:34,  1.63it/s]
 47%|████▋     | 5233/11049 [53:53<59:31,  1.63it/s]
                                                    
{'loss': 0.193, 'grad_norm': 0.5380573272705078, 'learning_rate': 6.317475815539104e-06, 'epoch': 1.42}

 47%|████▋     | 5233/11049 [53:53<59:31,  1.63it/s]
 47%|████▋     | 5234/11049 [53:54<59:28,  1.63it/s]
                                                    
{'loss': 0.2251, 'grad_norm': 0.5887070298194885, 'learning_rate': 6.315951930918531e-06, 'epoch': 1.42}

 47%|████▋     | 5234/11049 [53:54<59:28,  1.63it/s]
 47%|████▋     | 5235/11049 [53:54<59:33,  1.63it/s]
                                                    
{'loss': 0.2203, 'grad_norm': 0.5495423674583435, 'learning_rate': 6.314427914951753e-06, 'epoch': 1.42}

 47%|████▋     | 5235/11049 [53:54<59:33,  1.63it/s]
 47%|████▋     | 5236/11049 [53:55<59:33,  1.63it/s]
                                                    
{'loss': 0.1778, 'grad_norm': 0.4942028522491455, 'learning_rate': 6.31290376779088e-06, 'epoch': 1.42}

 47%|████▋     | 5236/11049 [53:55<59:33,  1.63it/s]
 47%|████▋     | 5237/11049 [53:56<59:34,  1.63it/s]
                                                    
{'loss': 0.1682, 'grad_norm': 0.48831287026405334, 'learning_rate': 6.311379489588041e-06, 'epoch': 1.42}

 47%|████▋     | 5237/11049 [53:56<59:34,  1.63it/s]
 47%|████▋     | 5238/11049 [53:56<59:30,  1.63it/s]
                                                    
{'loss': 0.2218, 'grad_norm': 0.6429452896118164, 'learning_rate': 6.309855080495373e-06, 'epoch': 1.42}

 47%|████▋     | 5238/11049 [53:56<59:30,  1.63it/s]
 47%|████▋     | 5239/11049 [53:57<59:27,  1.63it/s]
                                                    
{'loss': 0.2549, 'grad_norm': 0.6597173810005188, 'learning_rate': 6.308330540665029e-06, 'epoch': 1.42}

 47%|████▋     | 5239/11049 [53:57<59:27,  1.63it/s]
 47%|████▋     | 5240/11049 [53:57<59:29,  1.63it/s]
                                                    
{'loss': 0.2424, 'grad_norm': 0.5870869755744934, 'learning_rate': 6.306805870249174e-06, 'epoch': 1.42}

 47%|████▋     | 5240/11049 [53:58<59:29,  1.63it/s]
 47%|████▋     | 5241/11049 [53:58<59:26,  1.63it/s]
                                                    
{'loss': 0.1564, 'grad_norm': 0.4515545070171356, 'learning_rate': 6.305281069399989e-06, 'epoch': 1.42}

 47%|████▋     | 5241/11049 [53:58<59:26,  1.63it/s]
 47%|████▋     | 5242/11049 [53:59<59:24,  1.63it/s]
                                                    
{'loss': 0.1603, 'grad_norm': 0.4676342010498047, 'learning_rate': 6.303756138269664e-06, 'epoch': 1.42}

 47%|████▋     | 5242/11049 [53:59<59:24,  1.63it/s]
 47%|████▋     | 5243/11049 [53:59<59:22,  1.63it/s]
                                                    
{'loss': 0.2882, 'grad_norm': 0.5499157309532166, 'learning_rate': 6.302231077010404e-06, 'epoch': 1.42}

 47%|████▋     | 5243/11049 [53:59<59:22,  1.63it/s]
 47%|████▋     | 5244/11049 [54:00<59:20,  1.63it/s]
                                                    
{'loss': 0.2112, 'grad_norm': 0.4748362898826599, 'learning_rate': 6.300705885774424e-06, 'epoch': 1.42}

 47%|████▋     | 5244/11049 [54:00<59:20,  1.63it/s]
 47%|████▋     | 5245/11049 [54:00<59:25,  1.63it/s]
                                                    
{'loss': 0.2475, 'grad_norm': 0.580284595489502, 'learning_rate': 6.299180564713959e-06, 'epoch': 1.42}

 47%|████▋     | 5245/11049 [54:01<59:25,  1.63it/s]
 47%|████▋     | 5246/11049 [54:01<59:26,  1.63it/s]
                                                    
{'loss': 0.1982, 'grad_norm': 0.5683262348175049, 'learning_rate': 6.2976551139812495e-06, 'epoch': 1.42}

 47%|████▋     | 5246/11049 [54:01<59:26,  1.63it/s]
 47%|████▋     | 5247/11049 [54:02<59:23,  1.63it/s]
                                                    
{'loss': 0.1916, 'grad_norm': 0.5651862621307373, 'learning_rate': 6.296129533728553e-06, 'epoch': 1.42}

 47%|████▋     | 5247/11049 [54:02<59:23,  1.63it/s]
 47%|████▋     | 5248/11049 [54:02<59:22,  1.63it/s]
                                                    
{'loss': 0.2166, 'grad_norm': 0.6030105948448181, 'learning_rate': 6.2946038241081375e-06, 'epoch': 1.42}

 47%|████▋     | 5248/11049 [54:02<59:22,  1.63it/s]
 48%|████▊     | 5249/11049 [54:03<59:22,  1.63it/s]
                                                    
{'loss': 0.2186, 'grad_norm': 0.6515210866928101, 'learning_rate': 6.293077985272288e-06, 'epoch': 1.43}

 48%|████▊     | 5249/11049 [54:03<59:22,  1.63it/s]
 48%|████▊     | 5250/11049 [54:04<59:25,  1.63it/s]
                                                    
{'loss': 0.2274, 'grad_norm': 0.5446752309799194, 'learning_rate': 6.291552017373296e-06, 'epoch': 1.43}

 48%|████▊     | 5250/11049 [54:04<59:25,  1.63it/s]
 48%|████▊     | 5251/11049 [54:04<59:39,  1.62it/s]
                                                    
{'loss': 0.1961, 'grad_norm': 0.510559618473053, 'learning_rate': 6.290025920563474e-06, 'epoch': 1.43}

 48%|████▊     | 5251/11049 [54:04<59:39,  1.62it/s]
 48%|████▊     | 5252/11049 [54:05<59:33,  1.62it/s]
                                                    
{'loss': 0.2031, 'grad_norm': 0.49399444460868835, 'learning_rate': 6.288499694995139e-06, 'epoch': 1.43}

 48%|████▊     | 5252/11049 [54:05<59:33,  1.62it/s]
 48%|████▊     | 5253/11049 [54:05<59:26,  1.63it/s]
                                                    
{'loss': 0.2072, 'grad_norm': 0.614765465259552, 'learning_rate': 6.286973340820627e-06, 'epoch': 1.43}

 48%|████▊     | 5253/11049 [54:05<59:26,  1.63it/s]
 48%|████▊     | 5254/11049 [54:06<59:22,  1.63it/s]
                                                    
{'loss': 0.1946, 'grad_norm': 0.5850298404693604, 'learning_rate': 6.285446858192284e-06, 'epoch': 1.43}

 48%|████▊     | 5254/11049 [54:06<59:22,  1.63it/s]
 48%|████▊     | 5255/11049 [54:07<59:24,  1.63it/s]
                                                    
{'loss': 0.2374, 'grad_norm': 0.597575843334198, 'learning_rate': 6.283920247262468e-06, 'epoch': 1.43}

 48%|████▊     | 5255/11049 [54:07<59:24,  1.63it/s]
 48%|████▊     | 5256/11049 [54:07<59:22,  1.63it/s]
                                                    
{'loss': 0.225, 'grad_norm': 0.6710429787635803, 'learning_rate': 6.282393508183555e-06, 'epoch': 1.43}

 48%|████▊     | 5256/11049 [54:07<59:22,  1.63it/s]
 48%|████▊     | 5257/11049 [54:08<59:18,  1.63it/s]
                                                    
{'loss': 0.2465, 'grad_norm': 0.5864368081092834, 'learning_rate': 6.280866641107926e-06, 'epoch': 1.43}

 48%|████▊     | 5257/11049 [54:08<59:18,  1.63it/s]
 48%|████▊     | 5258/11049 [54:08<59:16,  1.63it/s]
                                                    
{'loss': 0.1609, 'grad_norm': 0.47494569420814514, 'learning_rate': 6.2793396461879805e-06, 'epoch': 1.43}

 48%|████▊     | 5258/11049 [54:09<59:16,  1.63it/s]
 48%|████▊     | 5259/11049 [54:09<59:14,  1.63it/s]
                                                    
{'loss': 0.2342, 'grad_norm': 0.6089516878128052, 'learning_rate': 6.27781252357613e-06, 'epoch': 1.43}

 48%|████▊     | 5259/11049 [54:09<59:14,  1.63it/s]
 48%|████▊     | 5260/11049 [54:10<59:18,  1.63it/s]
                                                    
{'loss': 0.1968, 'grad_norm': 0.485390841960907, 'learning_rate': 6.276285273424797e-06, 'epoch': 1.43}

 48%|████▊     | 5260/11049 [54:10<59:18,  1.63it/s]
 48%|████▊     | 5261/11049 [54:10<59:14,  1.63it/s]
                                                    
{'loss': 0.2042, 'grad_norm': 0.5521970987319946, 'learning_rate': 6.274757895886417e-06, 'epoch': 1.43}

 48%|████▊     | 5261/11049 [54:10<59:14,  1.63it/s]
 48%|████▊     | 5262/11049 [54:11<59:12,  1.63it/s]
                                                    
{'loss': 0.1566, 'grad_norm': 0.47358497977256775, 'learning_rate': 6.27323039111344e-06, 'epoch': 1.43}

 48%|████▊     | 5262/11049 [54:11<59:12,  1.63it/s]
 48%|████▊     | 5263/11049 [54:12<59:10,  1.63it/s]
                                                    
{'loss': 0.1982, 'grad_norm': 0.5980965495109558, 'learning_rate': 6.2717027592583255e-06, 'epoch': 1.43}

 48%|████▊     | 5263/11049 [54:12<59:10,  1.63it/s]
 48%|████▊     | 5264/11049 [54:12<59:10,  1.63it/s]
                                                    
{'loss': 0.23, 'grad_norm': 0.6756429672241211, 'learning_rate': 6.2701750004735495e-06, 'epoch': 1.43}

 48%|████▊     | 5264/11049 [54:12<59:10,  1.63it/s]
 48%|████▊     | 5265/11049 [54:13<59:13,  1.63it/s]
                                                    
{'loss': 0.2372, 'grad_norm': 0.6271451711654663, 'learning_rate': 6.268647114911599e-06, 'epoch': 1.43}

 48%|████▊     | 5265/11049 [54:13<59:13,  1.63it/s]
 48%|████▊     | 5266/11049 [54:13<59:10,  1.63it/s]
                                                    
{'loss': 0.2199, 'grad_norm': 0.5656600594520569, 'learning_rate': 6.26711910272497e-06, 'epoch': 1.43}

 48%|████▊     | 5266/11049 [54:13<59:10,  1.63it/s]
 48%|████▊     | 5267/11049 [54:14<59:07,  1.63it/s]
                                                    
{'loss': 0.2416, 'grad_norm': 0.6077378392219543, 'learning_rate': 6.265590964066179e-06, 'epoch': 1.43}

 48%|████▊     | 5267/11049 [54:14<59:07,  1.63it/s]
 48%|████▊     | 5268/11049 [54:15<59:06,  1.63it/s]
                                                    
{'loss': 0.2296, 'grad_norm': 0.6342156529426575, 'learning_rate': 6.264062699087749e-06, 'epoch': 1.43}

 48%|████▊     | 5268/11049 [54:15<59:06,  1.63it/s]
 48%|████▊     | 5269/11049 [54:15<59:04,  1.63it/s]
                                                    
{'loss': 0.2062, 'grad_norm': 0.5110591053962708, 'learning_rate': 6.262534307942219e-06, 'epoch': 1.43}

 48%|████▊     | 5269/11049 [54:15<59:04,  1.63it/s]
 48%|████▊     | 5270/11049 [54:16<59:09,  1.63it/s]
                                                    
{'loss': 0.2171, 'grad_norm': 0.559605598449707, 'learning_rate': 6.261005790782133e-06, 'epoch': 1.43}

 48%|████▊     | 5270/11049 [54:16<59:09,  1.63it/s]
 48%|████▊     | 5271/11049 [54:16<59:07,  1.63it/s]
                                                    
{'loss': 0.172, 'grad_norm': 0.5317603349685669, 'learning_rate': 6.2594771477600615e-06, 'epoch': 1.43}

 48%|████▊     | 5271/11049 [54:17<59:07,  1.63it/s]
 48%|████▊     | 5272/11049 [54:17<59:04,  1.63it/s]
                                                    
{'loss': 0.214, 'grad_norm': 0.6214504241943359, 'learning_rate': 6.257948379028573e-06, 'epoch': 1.43}

 48%|████▊     | 5272/11049 [54:17<59:04,  1.63it/s]
 48%|████▊     | 5273/11049 [54:18<59:03,  1.63it/s]
                                                    
{'loss': 0.2908, 'grad_norm': 0.6484123468399048, 'learning_rate': 6.25641948474026e-06, 'epoch': 1.43}

 48%|████▊     | 5273/11049 [54:18<59:03,  1.63it/s]
 48%|████▊     | 5274/11049 [54:18<59:01,  1.63it/s]
                                                    
{'loss': 0.2164, 'grad_norm': 0.5159224271774292, 'learning_rate': 6.254890465047721e-06, 'epoch': 1.43}

 48%|████▊     | 5274/11049 [54:18<59:01,  1.63it/s]
 48%|████▊     | 5275/11049 [54:19<59:07,  1.63it/s]
                                                    
{'loss': 0.1823, 'grad_norm': 0.47989681363105774, 'learning_rate': 6.253361320103567e-06, 'epoch': 1.43}

 48%|████▊     | 5275/11049 [54:19<59:07,  1.63it/s]
 48%|████▊     | 5276/11049 [54:19<59:05,  1.63it/s]
                                                    
{'loss': 0.1538, 'grad_norm': 0.4743242859840393, 'learning_rate': 6.251832050060425e-06, 'epoch': 1.43}

 48%|████▊     | 5276/11049 [54:20<59:05,  1.63it/s]
 48%|████▊     | 5277/11049 [54:20<59:03,  1.63it/s]
                                                    
{'loss': 0.2135, 'grad_norm': 0.5575497150421143, 'learning_rate': 6.2503026550709315e-06, 'epoch': 1.43}

 48%|████▊     | 5277/11049 [54:20<59:03,  1.63it/s]
 48%|████▊     | 5278/11049 [54:21<59:02,  1.63it/s]
                                                    
{'loss': 0.1785, 'grad_norm': 0.47030383348464966, 'learning_rate': 6.248773135287738e-06, 'epoch': 1.43}

 48%|████▊     | 5278/11049 [54:21<59:02,  1.63it/s]
 48%|████▊     | 5279/11049 [54:21<59:00,  1.63it/s]
                                                    
{'loss': 0.2835, 'grad_norm': 0.7098150849342346, 'learning_rate': 6.247243490863506e-06, 'epoch': 1.43}

 48%|████▊     | 5279/11049 [54:21<59:00,  1.63it/s]
 48%|████▊     | 5280/11049 [54:22<58:59,  1.63it/s]
                                                    
{'loss': 0.22, 'grad_norm': 0.585965096950531, 'learning_rate': 6.24571372195091e-06, 'epoch': 1.43}

 48%|████▊     | 5280/11049 [54:22<58:59,  1.63it/s]
 48%|████▊     | 5281/11049 [54:23<58:58,  1.63it/s]
                                                    
{'loss': 0.2606, 'grad_norm': 0.5600110292434692, 'learning_rate': 6.244183828702639e-06, 'epoch': 1.43}

 48%|████▊     | 5281/11049 [54:23<58:58,  1.63it/s]
 48%|████▊     | 5282/11049 [54:23<58:55,  1.63it/s]
                                                    
{'loss': 0.2021, 'grad_norm': 0.5781539082527161, 'learning_rate': 6.242653811271393e-06, 'epoch': 1.43}

 48%|████▊     | 5282/11049 [54:23<58:55,  1.63it/s]
 48%|████▊     | 5283/11049 [54:24<58:55,  1.63it/s]
                                                    
{'loss': 0.1994, 'grad_norm': 0.5800705552101135, 'learning_rate': 6.241123669809883e-06, 'epoch': 1.43}

 48%|████▊     | 5283/11049 [54:24<58:55,  1.63it/s]
 48%|████▊     | 5284/11049 [54:24<58:53,  1.63it/s]
                                                    
{'loss': 0.2478, 'grad_norm': 0.635480523109436, 'learning_rate': 6.239593404470833e-06, 'epoch': 1.43}

 48%|████▊     | 5284/11049 [54:25<58:53,  1.63it/s]
 48%|████▊     | 5285/11049 [54:25<58:53,  1.63it/s]
                                                    
{'loss': 0.1932, 'grad_norm': 0.5223712921142578, 'learning_rate': 6.238063015406982e-06, 'epoch': 1.43}

 48%|████▊     | 5285/11049 [54:25<58:53,  1.63it/s]
 48%|████▊     | 5286/11049 [54:26<58:54,  1.63it/s]
                                                    
{'loss': 0.1957, 'grad_norm': 0.508621096611023, 'learning_rate': 6.236532502771078e-06, 'epoch': 1.44}

 48%|████▊     | 5286/11049 [54:26<58:54,  1.63it/s]
 48%|████▊     | 5287/11049 [54:26<58:53,  1.63it/s]
                                                    
{'loss': 0.2259, 'grad_norm': 0.5622057914733887, 'learning_rate': 6.235001866715884e-06, 'epoch': 1.44}

 48%|████▊     | 5287/11049 [54:26<58:53,  1.63it/s]
 48%|████▊     | 5288/11049 [54:27<58:53,  1.63it/s]
                                                    
{'loss': 0.211, 'grad_norm': 0.462999552488327, 'learning_rate': 6.233471107394171e-06, 'epoch': 1.44}

 48%|████▊     | 5288/11049 [54:27<58:53,  1.63it/s]
 48%|████▊     | 5289/11049 [54:27<58:52,  1.63it/s]
                                                    
{'loss': 0.2448, 'grad_norm': 0.5898029804229736, 'learning_rate': 6.23194022495873e-06, 'epoch': 1.44}

 48%|████▊     | 5289/11049 [54:28<58:52,  1.63it/s]
 48%|████▊     | 5290/11049 [54:28<58:50,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.49824389815330505, 'learning_rate': 6.230409219562355e-06, 'epoch': 1.44}

 48%|████▊     | 5290/11049 [54:28<58:50,  1.63it/s]
 48%|████▊     | 5291/11049 [54:29<58:51,  1.63it/s]
                                                    
{'loss': 0.1725, 'grad_norm': 0.4862089455127716, 'learning_rate': 6.22887809135786e-06, 'epoch': 1.44}

 48%|████▊     | 5291/11049 [54:29<58:51,  1.63it/s]
 48%|████▊     | 5292/11049 [54:29<58:50,  1.63it/s]
                                                    
{'loss': 0.164, 'grad_norm': 0.48128780722618103, 'learning_rate': 6.2273468404980665e-06, 'epoch': 1.44}

 48%|████▊     | 5292/11049 [54:29<58:50,  1.63it/s]
 48%|████▊     | 5293/11049 [54:30<58:51,  1.63it/s]
                                                    
{'loss': 0.2058, 'grad_norm': 0.5376251935958862, 'learning_rate': 6.22581546713581e-06, 'epoch': 1.44}

 48%|████▊     | 5293/11049 [54:30<58:51,  1.63it/s]
 48%|████▊     | 5294/11049 [54:31<58:50,  1.63it/s]
                                                    
{'loss': 0.2049, 'grad_norm': 0.5071188807487488, 'learning_rate': 6.224283971423938e-06, 'epoch': 1.44}

 48%|████▊     | 5294/11049 [54:31<58:50,  1.63it/s]
 48%|████▊     | 5295/11049 [54:31<58:48,  1.63it/s]
                                                    
{'loss': 0.2209, 'grad_norm': 0.5838590860366821, 'learning_rate': 6.222752353515311e-06, 'epoch': 1.44}

 48%|████▊     | 5295/11049 [54:31<58:48,  1.63it/s]
 48%|████▊     | 5296/11049 [54:32<58:49,  1.63it/s]
                                                    
{'loss': 0.2729, 'grad_norm': 0.6663504242897034, 'learning_rate': 6.221220613562802e-06, 'epoch': 1.44}

 48%|████▊     | 5296/11049 [54:32<58:49,  1.63it/s]
 48%|████▊     | 5297/11049 [54:32<58:48,  1.63it/s]
                                                    
{'loss': 0.2462, 'grad_norm': 0.5045428276062012, 'learning_rate': 6.219688751719293e-06, 'epoch': 1.44}

 48%|████▊     | 5297/11049 [54:32<58:48,  1.63it/s]
 48%|████▊     | 5298/11049 [54:33<58:47,  1.63it/s]
                                                    
{'loss': 0.1858, 'grad_norm': 0.49990764260292053, 'learning_rate': 6.218156768137681e-06, 'epoch': 1.44}

 48%|████▊     | 5298/11049 [54:33<58:47,  1.63it/s]
 48%|████▊     | 5299/11049 [54:34<58:46,  1.63it/s]
                                                    
{'loss': 0.252, 'grad_norm': 0.4556886851787567, 'learning_rate': 6.216624662970875e-06, 'epoch': 1.44}

 48%|████▊     | 5299/11049 [54:34<58:46,  1.63it/s]
 48%|████▊     | 5300/11049 [54:34<58:46,  1.63it/s]
                                                    
{'loss': 0.1825, 'grad_norm': 0.52943354845047, 'learning_rate': 6.215092436371796e-06, 'epoch': 1.44}

 48%|████▊     | 5300/11049 [54:34<58:46,  1.63it/s]
 48%|████▊     | 5301/11049 [54:35<58:50,  1.63it/s]
                                                    
{'loss': 0.2381, 'grad_norm': 0.5359798073768616, 'learning_rate': 6.213560088493376e-06, 'epoch': 1.44}

 48%|████▊     | 5301/11049 [54:35<58:50,  1.63it/s]
 48%|████▊     | 5302/11049 [54:35<58:48,  1.63it/s]
                                                    
{'loss': 0.1821, 'grad_norm': 0.5245092511177063, 'learning_rate': 6.212027619488558e-06, 'epoch': 1.44}

 48%|████▊     | 5302/11049 [54:36<58:48,  1.63it/s]
 48%|████▊     | 5303/11049 [54:36<58:46,  1.63it/s]
                                                    
{'loss': 0.1974, 'grad_norm': 0.5142002701759338, 'learning_rate': 6.210495029510303e-06, 'epoch': 1.44}

 48%|████▊     | 5303/11049 [54:36<58:46,  1.63it/s]
 48%|████▊     | 5304/11049 [54:37<58:45,  1.63it/s]
                                                    
{'loss': 0.2803, 'grad_norm': 0.7105448246002197, 'learning_rate': 6.2089623187115755e-06, 'epoch': 1.44}

 48%|████▊     | 5304/11049 [54:37<58:45,  1.63it/s]
 48%|████▊     | 5305/11049 [54:37<58:42,  1.63it/s]
                                                    
{'loss': 0.2021, 'grad_norm': 0.5604730844497681, 'learning_rate': 6.2074294872453626e-06, 'epoch': 1.44}

 48%|████▊     | 5305/11049 [54:37<58:42,  1.63it/s]
 48%|████▊     | 5306/11049 [54:38<58:42,  1.63it/s]
                                                    
{'loss': 0.1845, 'grad_norm': 0.5192340612411499, 'learning_rate': 6.205896535264652e-06, 'epoch': 1.44}

 48%|████▊     | 5306/11049 [54:38<58:42,  1.63it/s]
 48%|████▊     | 5307/11049 [54:38<58:41,  1.63it/s]
                                                    
{'loss': 0.1814, 'grad_norm': 0.5057665109634399, 'learning_rate': 6.20436346292245e-06, 'epoch': 1.44}

 48%|████▊     | 5307/11049 [54:39<58:41,  1.63it/s]
 48%|████▊     | 5308/11049 [54:39<58:54,  1.62it/s]
                                                    
{'loss': 0.2162, 'grad_norm': 0.5425346493721008, 'learning_rate': 6.202830270371775e-06, 'epoch': 1.44}

 48%|████▊     | 5308/11049 [54:39<58:54,  1.62it/s]
 48%|████▊     | 5309/11049 [54:40<58:49,  1.63it/s]
                                                    
{'loss': 0.1882, 'grad_norm': 0.547600507736206, 'learning_rate': 6.201296957765657e-06, 'epoch': 1.44}

 48%|████▊     | 5309/11049 [54:40<58:49,  1.63it/s]
 48%|████▊     | 5310/11049 [54:40<58:44,  1.63it/s]
                                                    
{'loss': 0.2463, 'grad_norm': 0.6217034459114075, 'learning_rate': 6.199763525257134e-06, 'epoch': 1.44}

 48%|████▊     | 5310/11049 [54:40<58:44,  1.63it/s]
 48%|████▊     | 5311/11049 [54:41<58:41,  1.63it/s]
                                                    
{'loss': 0.2045, 'grad_norm': 0.5339157581329346, 'learning_rate': 6.198229972999263e-06, 'epoch': 1.44}

 48%|████▊     | 5311/11049 [54:41<58:41,  1.63it/s]
 48%|████▊     | 5312/11049 [54:42<58:39,  1.63it/s]
                                                    
{'loss': 0.1931, 'grad_norm': 0.4801114499568939, 'learning_rate': 6.196696301145104e-06, 'epoch': 1.44}

 48%|████▊     | 5312/11049 [54:42<58:39,  1.63it/s]
 48%|████▊     | 5313/11049 [54:42<58:37,  1.63it/s]
                                                    
{'loss': 0.2104, 'grad_norm': 0.5345108509063721, 'learning_rate': 6.195162509847738e-06, 'epoch': 1.44}

 48%|████▊     | 5313/11049 [54:42<58:37,  1.63it/s]
 48%|████▊     | 5314/11049 [54:43<58:37,  1.63it/s]
                                                    
{'loss': 0.2014, 'grad_norm': 0.5460036396980286, 'learning_rate': 6.1936285992602555e-06, 'epoch': 1.44}

 48%|████▊     | 5314/11049 [54:43<58:37,  1.63it/s]
 48%|████▊     | 5315/11049 [54:43<58:36,  1.63it/s]
                                                    
{'loss': 0.1742, 'grad_norm': 0.47945457696914673, 'learning_rate': 6.192094569535752e-06, 'epoch': 1.44}

 48%|████▊     | 5315/11049 [54:44<58:36,  1.63it/s]
 48%|████▊     | 5316/11049 [54:44<58:39,  1.63it/s]
                                                    
{'loss': 0.2945, 'grad_norm': 0.733722448348999, 'learning_rate': 6.1905604208273425e-06, 'epoch': 1.44}

 48%|████▊     | 5316/11049 [54:44<58:39,  1.63it/s]
 48%|████▊     | 5317/11049 [54:45<58:38,  1.63it/s]
                                                    
{'loss': 0.168, 'grad_norm': 0.47771695256233215, 'learning_rate': 6.1890261532881545e-06, 'epoch': 1.44}

 48%|████▊     | 5317/11049 [54:45<58:38,  1.63it/s]
 48%|████▊     | 5318/11049 [54:45<58:36,  1.63it/s]
                                                    
{'loss': 0.1838, 'grad_norm': 0.5491870045661926, 'learning_rate': 6.187491767071321e-06, 'epoch': 1.44}

 48%|████▊     | 5318/11049 [54:45<58:36,  1.63it/s]
 48%|████▊     | 5319/11049 [54:46<58:37,  1.63it/s]
                                                    
{'loss': 0.1834, 'grad_norm': 0.5151842832565308, 'learning_rate': 6.185957262329991e-06, 'epoch': 1.44}

 48%|████▊     | 5319/11049 [54:46<58:37,  1.63it/s]
 48%|████▊     | 5320/11049 [54:46<58:35,  1.63it/s]
                                                    
{'loss': 0.1603, 'grad_norm': 0.5133965015411377, 'learning_rate': 6.184422639217324e-06, 'epoch': 1.44}

 48%|████▊     | 5320/11049 [54:47<58:35,  1.63it/s]
 48%|████▊     | 5321/11049 [54:47<58:33,  1.63it/s]
                                                    
{'loss': 0.191, 'grad_norm': 0.5188175439834595, 'learning_rate': 6.182887897886495e-06, 'epoch': 1.44}

 48%|████▊     | 5321/11049 [54:47<58:33,  1.63it/s]
 48%|████▊     | 5322/11049 [54:48<58:32,  1.63it/s]
                                                    
{'loss': 0.1703, 'grad_norm': 0.49396461248397827, 'learning_rate': 6.1813530384906836e-06, 'epoch': 1.45}

 48%|████▊     | 5322/11049 [54:48<58:32,  1.63it/s]
 48%|████▊     | 5323/11049 [54:48<58:31,  1.63it/s]
                                                    
{'loss': 0.2612, 'grad_norm': 0.6866755485534668, 'learning_rate': 6.17981806118309e-06, 'epoch': 1.45}

 48%|████▊     | 5323/11049 [54:48<58:31,  1.63it/s]
 48%|████▊     | 5324/11049 [54:49<58:30,  1.63it/s]
                                                    
{'loss': 0.2157, 'grad_norm': 0.5387553572654724, 'learning_rate': 6.178282966116918e-06, 'epoch': 1.45}

 48%|████▊     | 5324/11049 [54:49<58:30,  1.63it/s]
 48%|████▊     | 5325/11049 [54:50<58:29,  1.63it/s]
                                                    
{'loss': 0.1543, 'grad_norm': 0.5840543508529663, 'learning_rate': 6.1767477534453864e-06, 'epoch': 1.45}

 48%|████▊     | 5325/11049 [54:50<58:29,  1.63it/s]
 48%|████▊     | 5326/11049 [54:50<58:28,  1.63it/s]
                                                    
{'loss': 0.229, 'grad_norm': 0.6403446793556213, 'learning_rate': 6.175212423321727e-06, 'epoch': 1.45}

 48%|████▊     | 5326/11049 [54:50<58:28,  1.63it/s]
 48%|████▊     | 5327/11049 [54:51<58:29,  1.63it/s]
                                                    
{'loss': 0.1918, 'grad_norm': 0.4944060146808624, 'learning_rate': 6.173676975899183e-06, 'epoch': 1.45}

 48%|████▊     | 5327/11049 [54:51<58:29,  1.63it/s]
 48%|████▊     | 5328/11049 [54:51<58:28,  1.63it/s]
                                                    
{'loss': 0.2291, 'grad_norm': 0.5392511487007141, 'learning_rate': 6.17214141133101e-06, 'epoch': 1.45}

 48%|████▊     | 5328/11049 [54:52<58:28,  1.63it/s]
 48%|████▊     | 5329/11049 [54:52<58:26,  1.63it/s]
                                                    
{'loss': 0.2131, 'grad_norm': 0.5961794257164001, 'learning_rate': 6.17060572977047e-06, 'epoch': 1.45}

 48%|████▊     | 5329/11049 [54:52<58:26,  1.63it/s]
 48%|████▊     | 5330/11049 [54:53<58:25,  1.63it/s]
                                                    
{'loss': 0.1975, 'grad_norm': 0.5080614686012268, 'learning_rate': 6.169069931370842e-06, 'epoch': 1.45}

 48%|████▊     | 5330/11049 [54:53<58:25,  1.63it/s]
 48%|████▊     | 5331/11049 [54:53<58:25,  1.63it/s]
                                                    
{'loss': 0.1205, 'grad_norm': 0.38666480779647827, 'learning_rate': 6.167534016285418e-06, 'epoch': 1.45}

 48%|████▊     | 5331/11049 [54:53<58:25,  1.63it/s]
 48%|████▊     | 5332/11049 [54:54<58:26,  1.63it/s]
                                                    
{'loss': 0.2085, 'grad_norm': 0.5023221373558044, 'learning_rate': 6.165997984667495e-06, 'epoch': 1.45}

 48%|████▊     | 5332/11049 [54:54<58:26,  1.63it/s]
 48%|████▊     | 5333/11049 [54:54<58:25,  1.63it/s]
                                                    
{'loss': 0.185, 'grad_norm': 0.5152432322502136, 'learning_rate': 6.16446183667039e-06, 'epoch': 1.45}

 48%|████▊     | 5333/11049 [54:55<58:25,  1.63it/s]
 48%|████▊     | 5334/11049 [54:55<58:27,  1.63it/s]
                                                    
{'loss': 0.2192, 'grad_norm': 0.649060070514679, 'learning_rate': 6.162925572447421e-06, 'epoch': 1.45}

 48%|████▊     | 5334/11049 [54:55<58:27,  1.63it/s]
 48%|████▊     | 5335/11049 [54:56<58:27,  1.63it/s]
                                                    
{'loss': 0.2382, 'grad_norm': 0.5751520991325378, 'learning_rate': 6.1613891921519295e-06, 'epoch': 1.45}

 48%|████▊     | 5335/11049 [54:56<58:27,  1.63it/s]
 48%|████▊     | 5336/11049 [54:56<58:25,  1.63it/s]
                                                    
{'loss': 0.2331, 'grad_norm': 0.6810868978500366, 'learning_rate': 6.159852695937261e-06, 'epoch': 1.45}

 48%|████▊     | 5336/11049 [54:56<58:25,  1.63it/s]
 48%|████▊     | 5337/11049 [54:57<58:26,  1.63it/s]
                                                    
{'loss': 0.1727, 'grad_norm': 0.4620627760887146, 'learning_rate': 6.158316083956772e-06, 'epoch': 1.45}

 48%|████▊     | 5337/11049 [54:57<58:26,  1.63it/s]
 48%|████▊     | 5338/11049 [54:58<58:24,  1.63it/s]
                                                    
{'loss': 0.196, 'grad_norm': 0.5059835910797119, 'learning_rate': 6.1567793563638355e-06, 'epoch': 1.45}

 48%|████▊     | 5338/11049 [54:58<58:24,  1.63it/s]
 48%|████▊     | 5339/11049 [54:58<58:22,  1.63it/s]
                                                    
{'loss': 0.2112, 'grad_norm': 0.5498257875442505, 'learning_rate': 6.155242513311833e-06, 'epoch': 1.45}

 48%|████▊     | 5339/11049 [54:58<58:22,  1.63it/s]
 48%|████▊     | 5340/11049 [54:59<58:22,  1.63it/s]
                                                    
{'loss': 0.2195, 'grad_norm': 0.5830485820770264, 'learning_rate': 6.153705554954158e-06, 'epoch': 1.45}

 48%|████▊     | 5340/11049 [54:59<58:22,  1.63it/s]
 48%|████▊     | 5341/11049 [54:59<58:21,  1.63it/s]
                                                    
{'loss': 0.2267, 'grad_norm': 0.6096364259719849, 'learning_rate': 6.152168481444218e-06, 'epoch': 1.45}

 48%|████▊     | 5341/11049 [54:59<58:21,  1.63it/s]
 48%|████▊     | 5342/11049 [55:00<58:21,  1.63it/s]
                                                    
{'loss': 0.1914, 'grad_norm': 0.5144574642181396, 'learning_rate': 6.150631292935423e-06, 'epoch': 1.45}

 48%|████▊     | 5342/11049 [55:00<58:21,  1.63it/s]
 48%|████▊     | 5343/11049 [55:01<58:20,  1.63it/s]
                                                    
{'loss': 0.2107, 'grad_norm': 0.5902421474456787, 'learning_rate': 6.149093989581207e-06, 'epoch': 1.45}

 48%|████▊     | 5343/11049 [55:01<58:20,  1.63it/s]
 48%|████▊     | 5344/11049 [55:01<58:18,  1.63it/s]
                                                    
{'loss': 0.2166, 'grad_norm': 0.5625391602516174, 'learning_rate': 6.1475565715350075e-06, 'epoch': 1.45}

 48%|████▊     | 5344/11049 [55:01<58:18,  1.63it/s]
 48%|████▊     | 5345/11049 [55:02<58:18,  1.63it/s]
                                                    
{'loss': 0.2337, 'grad_norm': 0.5890839695930481, 'learning_rate': 6.146019038950275e-06, 'epoch': 1.45}

 48%|████▊     | 5345/11049 [55:02<58:18,  1.63it/s]
 48%|████▊     | 5346/11049 [55:02<58:18,  1.63it/s]
                                                    
{'loss': 0.2281, 'grad_norm': 0.5945565700531006, 'learning_rate': 6.144481391980472e-06, 'epoch': 1.45}

 48%|████▊     | 5346/11049 [55:03<58:18,  1.63it/s]
 48%|████▊     | 5347/11049 [55:03<58:16,  1.63it/s]
                                                    
{'loss': 0.1733, 'grad_norm': 0.5252159237861633, 'learning_rate': 6.142943630779073e-06, 'epoch': 1.45}

 48%|████▊     | 5347/11049 [55:03<58:16,  1.63it/s]
 48%|████▊     | 5348/11049 [55:04<58:16,  1.63it/s]
                                                    
{'loss': 0.2377, 'grad_norm': 0.5942502617835999, 'learning_rate': 6.141405755499563e-06, 'epoch': 1.45}

 48%|████▊     | 5348/11049 [55:04<58:16,  1.63it/s]
 48%|████▊     | 5349/11049 [55:04<58:16,  1.63it/s]
                                                    
{'loss': 0.2321, 'grad_norm': 0.5557655692100525, 'learning_rate': 6.139867766295438e-06, 'epoch': 1.45}

 48%|████▊     | 5349/11049 [55:04<58:16,  1.63it/s]
 48%|████▊     | 5350/11049 [55:05<58:14,  1.63it/s]
                                                    
{'loss': 0.2302, 'grad_norm': 0.5658561587333679, 'learning_rate': 6.138329663320206e-06, 'epoch': 1.45}

 48%|████▊     | 5350/11049 [55:05<58:14,  1.63it/s]
 48%|████▊     | 5351/11049 [55:05<58:17,  1.63it/s]
                                                    
{'loss': 0.1843, 'grad_norm': 0.5156726241111755, 'learning_rate': 6.136791446727387e-06, 'epoch': 1.45}

 48%|████▊     | 5351/11049 [55:06<58:17,  1.63it/s]
 48%|████▊     | 5352/11049 [55:06<58:16,  1.63it/s]
                                                    
{'loss': 0.2458, 'grad_norm': 0.5931477546691895, 'learning_rate': 6.13525311667051e-06, 'epoch': 1.45}

 48%|████▊     | 5352/11049 [55:06<58:16,  1.63it/s]
 48%|████▊     | 5353/11049 [55:07<58:15,  1.63it/s]
                                                    
{'loss': 0.1801, 'grad_norm': 0.47121214866638184, 'learning_rate': 6.13371467330312e-06, 'epoch': 1.45}

 48%|████▊     | 5353/11049 [55:07<58:15,  1.63it/s]
 48%|████▊     | 5354/11049 [55:07<58:13,  1.63it/s]
                                                    
{'loss': 0.1408, 'grad_norm': 0.410083532333374, 'learning_rate': 6.132176116778766e-06, 'epoch': 1.45}

 48%|████▊     | 5354/11049 [55:07<58:13,  1.63it/s]
 48%|████▊     | 5355/11049 [55:08<58:12,  1.63it/s]
                                                    
{'loss': 0.1902, 'grad_norm': 0.4962063729763031, 'learning_rate': 6.130637447251017e-06, 'epoch': 1.45}

 48%|████▊     | 5355/11049 [55:08<58:12,  1.63it/s]
 48%|████▊     | 5356/11049 [55:09<58:13,  1.63it/s]
                                                    
{'loss': 0.1313, 'grad_norm': 0.4432923495769501, 'learning_rate': 6.129098664873444e-06, 'epoch': 1.45}

 48%|████▊     | 5356/11049 [55:09<58:13,  1.63it/s]
 48%|████▊     | 5357/11049 [55:09<58:11,  1.63it/s]
                                                    
{'loss': 0.2272, 'grad_norm': 0.5915234088897705, 'learning_rate': 6.127559769799638e-06, 'epoch': 1.45}

 48%|████▊     | 5357/11049 [55:09<58:11,  1.63it/s]
 48%|████▊     | 5358/11049 [55:10<58:13,  1.63it/s]
                                                    
{'loss': 0.1766, 'grad_norm': 0.5187881588935852, 'learning_rate': 6.1260207621831955e-06, 'epoch': 1.45}

 48%|████▊     | 5358/11049 [55:10<58:13,  1.63it/s]
 49%|████▊     | 5359/11049 [55:10<58:12,  1.63it/s]
                                                    
{'loss': 0.199, 'grad_norm': 0.49587881565093994, 'learning_rate': 6.124481642177728e-06, 'epoch': 1.46}

 49%|████▊     | 5359/11049 [55:11<58:12,  1.63it/s]
 49%|████▊     | 5360/11049 [55:11<58:09,  1.63it/s]
                                                    
{'loss': 0.2449, 'grad_norm': 0.6469907164573669, 'learning_rate': 6.122942409936854e-06, 'epoch': 1.46}

 49%|████▊     | 5360/11049 [55:11<58:09,  1.63it/s]
 49%|████▊     | 5361/11049 [55:12<58:09,  1.63it/s]
                                                    
{'loss': 0.2692, 'grad_norm': 0.6528878808021545, 'learning_rate': 6.121403065614207e-06, 'epoch': 1.46}

 49%|████▊     | 5361/11049 [55:12<58:09,  1.63it/s]
 49%|████▊     | 5362/11049 [55:12<58:08,  1.63it/s]
                                                    
{'loss': 0.1739, 'grad_norm': 0.49369895458221436, 'learning_rate': 6.119863609363429e-06, 'epoch': 1.46}

 49%|████▊     | 5362/11049 [55:12<58:08,  1.63it/s]
 49%|████▊     | 5363/11049 [55:13<58:05,  1.63it/s]
                                                    
{'loss': 0.1776, 'grad_norm': 0.5820326209068298, 'learning_rate': 6.118324041338175e-06, 'epoch': 1.46}

 49%|████▊     | 5363/11049 [55:13<58:05,  1.63it/s]
 49%|████▊     | 5364/11049 [55:13<58:04,  1.63it/s]
                                                    
{'loss': 0.176, 'grad_norm': 0.47485092282295227, 'learning_rate': 6.116784361692112e-06, 'epoch': 1.46}

 49%|████▊     | 5364/11049 [55:14<58:04,  1.63it/s]
 49%|████▊     | 5365/11049 [55:14<58:06,  1.63it/s]
                                                    
{'loss': 0.1417, 'grad_norm': 0.4635707139968872, 'learning_rate': 6.115244570578913e-06, 'epoch': 1.46}

 49%|████▊     | 5365/11049 [55:14<58:06,  1.63it/s]
 49%|████▊     | 5366/11049 [55:15<58:04,  1.63it/s]
                                                    
{'loss': 0.2184, 'grad_norm': 0.5339526534080505, 'learning_rate': 6.1137046681522686e-06, 'epoch': 1.46}

 49%|████▊     | 5366/11049 [55:15<58:04,  1.63it/s]
 49%|████▊     | 5367/11049 [55:15<58:03,  1.63it/s]
                                                    
{'loss': 0.249, 'grad_norm': 0.6419632434844971, 'learning_rate': 6.112164654565878e-06, 'epoch': 1.46}

 49%|████▊     | 5367/11049 [55:15<58:03,  1.63it/s]
 49%|████▊     | 5368/11049 [55:16<58:02,  1.63it/s]
                                                    
{'loss': 0.2202, 'grad_norm': 0.6921680569648743, 'learning_rate': 6.110624529973449e-06, 'epoch': 1.46}

 49%|████▊     | 5368/11049 [55:16<58:02,  1.63it/s]
 49%|████▊     | 5369/11049 [55:17<58:02,  1.63it/s]
                                                    
{'loss': 0.2405, 'grad_norm': 0.7786504626274109, 'learning_rate': 6.109084294528704e-06, 'epoch': 1.46}

 49%|████▊     | 5369/11049 [55:17<58:02,  1.63it/s]
 49%|████▊     | 5370/11049 [55:17<58:03,  1.63it/s]
                                                    
{'loss': 0.2354, 'grad_norm': 0.5626236796379089, 'learning_rate': 6.107543948385376e-06, 'epoch': 1.46}

 49%|████▊     | 5370/11049 [55:17<58:03,  1.63it/s]
 49%|████▊     | 5371/11049 [55:18<58:03,  1.63it/s]
                                                    
{'loss': 0.2086, 'grad_norm': 0.6606736779212952, 'learning_rate': 6.106003491697205e-06, 'epoch': 1.46}

 49%|████▊     | 5371/11049 [55:18<58:03,  1.63it/s]
 49%|████▊     | 5372/11049 [55:18<58:01,  1.63it/s]
                                                    
{'loss': 0.1799, 'grad_norm': 0.4618752896785736, 'learning_rate': 6.104462924617949e-06, 'epoch': 1.46}

 49%|████▊     | 5372/11049 [55:19<58:01,  1.63it/s]
 49%|████▊     | 5373/11049 [55:19<57:59,  1.63it/s]
                                                    
{'loss': 0.204, 'grad_norm': 0.5620256662368774, 'learning_rate': 6.1029222473013705e-06, 'epoch': 1.46}

 49%|████▊     | 5373/11049 [55:19<57:59,  1.63it/s]
 49%|████▊     | 5374/11049 [55:20<57:59,  1.63it/s]
                                                    
{'loss': 0.1745, 'grad_norm': 0.4854971468448639, 'learning_rate': 6.101381459901248e-06, 'epoch': 1.46}

 49%|████▊     | 5374/11049 [55:20<57:59,  1.63it/s]
 49%|████▊     | 5375/11049 [55:20<57:58,  1.63it/s]
                                                    
{'loss': 0.174, 'grad_norm': 0.47855672240257263, 'learning_rate': 6.099840562571366e-06, 'epoch': 1.46}

 49%|████▊     | 5375/11049 [55:20<57:58,  1.63it/s]
 49%|████▊     | 5376/11049 [55:21<58:01,  1.63it/s]
                                                    
{'loss': 0.1782, 'grad_norm': 0.5279954671859741, 'learning_rate': 6.098299555465526e-06, 'epoch': 1.46}

 49%|████▊     | 5376/11049 [55:21<58:01,  1.63it/s]
 49%|████▊     | 5377/11049 [55:21<58:00,  1.63it/s]
                                                    
{'loss': 0.228, 'grad_norm': 0.5902188420295715, 'learning_rate': 6.096758438737534e-06, 'epoch': 1.46}

 49%|████▊     | 5377/11049 [55:22<58:00,  1.63it/s]
 49%|████▊     | 5378/11049 [55:22<57:59,  1.63it/s]
                                                    
{'loss': 0.1909, 'grad_norm': 0.4401131570339203, 'learning_rate': 6.0952172125412116e-06, 'epoch': 1.46}

 49%|████▊     | 5378/11049 [55:22<57:59,  1.63it/s]
 49%|████▊     | 5379/11049 [55:23<57:59,  1.63it/s]
                                                    
{'loss': 0.1611, 'grad_norm': 0.4897833466529846, 'learning_rate': 6.093675877030388e-06, 'epoch': 1.46}

 49%|████▊     | 5379/11049 [55:23<57:59,  1.63it/s]
 49%|████▊     | 5380/11049 [55:23<57:58,  1.63it/s]
                                                    
{'loss': 0.196, 'grad_norm': 0.4823645353317261, 'learning_rate': 6.092134432358909e-06, 'epoch': 1.46}

 49%|████▊     | 5380/11049 [55:23<57:58,  1.63it/s]
 49%|████▊     | 5381/11049 [55:24<57:56,  1.63it/s]
                                                    
{'loss': 0.2295, 'grad_norm': 0.6437877416610718, 'learning_rate': 6.0905928786806236e-06, 'epoch': 1.46}

 49%|████▊     | 5381/11049 [55:24<57:56,  1.63it/s]
 49%|████▊     | 5382/11049 [55:25<57:56,  1.63it/s]
                                                    
{'loss': 0.1911, 'grad_norm': 0.5313066244125366, 'learning_rate': 6.089051216149399e-06, 'epoch': 1.46}

 49%|████▊     | 5382/11049 [55:25<57:56,  1.63it/s]
 49%|████▊     | 5383/11049 [55:25<57:57,  1.63it/s]
                                                    
{'loss': 0.2771, 'grad_norm': 0.6454169750213623, 'learning_rate': 6.087509444919107e-06, 'epoch': 1.46}

 49%|████▊     | 5383/11049 [55:25<57:57,  1.63it/s]
 49%|████▊     | 5384/11049 [55:26<57:57,  1.63it/s]
                                                    
{'loss': 0.1324, 'grad_norm': 0.41991180181503296, 'learning_rate': 6.085967565143632e-06, 'epoch': 1.46}

 49%|████▊     | 5384/11049 [55:26<57:57,  1.63it/s]
 49%|████▊     | 5385/11049 [55:26<57:53,  1.63it/s]
                                                    
{'loss': 0.2063, 'grad_norm': 0.573348879814148, 'learning_rate': 6.084425576976873e-06, 'epoch': 1.46}

 49%|████▊     | 5385/11049 [55:26<57:53,  1.63it/s]
 49%|████▊     | 5386/11049 [55:27<57:52,  1.63it/s]
                                                    
{'loss': 0.1899, 'grad_norm': 0.5042288899421692, 'learning_rate': 6.082883480572737e-06, 'epoch': 1.46}

 49%|████▊     | 5386/11049 [55:27<57:52,  1.63it/s]
 49%|████▉     | 5387/11049 [55:28<57:52,  1.63it/s]
                                                    
{'loss': 0.2141, 'grad_norm': 0.4764375388622284, 'learning_rate': 6.081341276085141e-06, 'epoch': 1.46}

 49%|████▉     | 5387/11049 [55:28<57:52,  1.63it/s]
 49%|████▉     | 5388/11049 [55:28<57:51,  1.63it/s]
                                                    
{'loss': 0.2048, 'grad_norm': 0.5458847880363464, 'learning_rate': 6.079798963668013e-06, 'epoch': 1.46}

 49%|████▉     | 5388/11049 [55:28<57:51,  1.63it/s]
 49%|████▉     | 5389/11049 [55:29<57:49,  1.63it/s]
                                                    
{'loss': 0.211, 'grad_norm': 0.5508624911308289, 'learning_rate': 6.0782565434752925e-06, 'epoch': 1.46}

 49%|████▉     | 5389/11049 [55:29<57:49,  1.63it/s]
 49%|████▉     | 5390/11049 [55:29<57:49,  1.63it/s]
                                                    
{'loss': 0.1636, 'grad_norm': 0.5108669400215149, 'learning_rate': 6.076714015660932e-06, 'epoch': 1.46}

 49%|████▉     | 5390/11049 [55:30<57:49,  1.63it/s]
 49%|████▉     | 5391/11049 [55:30<57:50,  1.63it/s]
                                                    
{'loss': 0.1874, 'grad_norm': 0.44852524995803833, 'learning_rate': 6.0751713803788895e-06, 'epoch': 1.46}

 49%|████▉     | 5391/11049 [55:30<57:50,  1.63it/s]
 49%|████▉     | 5392/11049 [55:31<57:49,  1.63it/s]
                                                    
{'loss': 0.2272, 'grad_norm': 0.5437529683113098, 'learning_rate': 6.073628637783138e-06, 'epoch': 1.46}

 49%|████▉     | 5392/11049 [55:31<57:49,  1.63it/s]
 49%|████▉     | 5393/11049 [55:31<57:48,  1.63it/s]
                                                    
{'loss': 0.1933, 'grad_norm': 0.5519745945930481, 'learning_rate': 6.072085788027659e-06, 'epoch': 1.46}

 49%|████▉     | 5393/11049 [55:31<57:48,  1.63it/s]
 49%|████▉     | 5394/11049 [55:32<57:48,  1.63it/s]
                                                    
{'loss': 0.1705, 'grad_norm': 0.467044472694397, 'learning_rate': 6.0705428312664475e-06, 'epoch': 1.46}

 49%|████▉     | 5394/11049 [55:32<57:48,  1.63it/s]
 49%|████▉     | 5395/11049 [55:32<57:46,  1.63it/s]
                                                    
{'loss': 0.1389, 'grad_norm': 0.39497238397598267, 'learning_rate': 6.068999767653505e-06, 'epoch': 1.46}

 49%|████▉     | 5395/11049 [55:33<57:46,  1.63it/s]
 49%|████▉     | 5396/11049 [55:33<57:45,  1.63it/s]
                                                    
{'loss': 0.1587, 'grad_norm': 0.43906351923942566, 'learning_rate': 6.0674565973428475e-06, 'epoch': 1.47}

 49%|████▉     | 5396/11049 [55:33<57:45,  1.63it/s]
 49%|████▉     | 5397/11049 [55:34<57:43,  1.63it/s]
                                                    
{'loss': 0.2072, 'grad_norm': 0.543541669845581, 'learning_rate': 6.065913320488499e-06, 'epoch': 1.47}

 49%|████▉     | 5397/11049 [55:34<57:43,  1.63it/s]
 49%|████▉     | 5398/11049 [55:34<57:43,  1.63it/s]
                                                    
{'loss': 0.2287, 'grad_norm': 0.5846226215362549, 'learning_rate': 6.0643699372444965e-06, 'epoch': 1.47}

 49%|████▉     | 5398/11049 [55:34<57:43,  1.63it/s]
 49%|████▉     | 5399/11049 [55:35<57:42,  1.63it/s]
                                                    
{'loss': 0.2304, 'grad_norm': 0.5720141530036926, 'learning_rate': 6.062826447764883e-06, 'epoch': 1.47}

 49%|████▉     | 5399/11049 [55:35<57:42,  1.63it/s]
 49%|████▉     | 5400/11049 [55:36<57:43,  1.63it/s]
                                                    
{'loss': 0.2402, 'grad_norm': 0.6467914581298828, 'learning_rate': 6.0612828522037215e-06, 'epoch': 1.47}

 49%|████▉     | 5400/11049 [55:36<57:43,  1.63it/s]
 49%|████▉     | 5401/11049 [55:36<57:45,  1.63it/s]
                                                    
{'loss': 0.2345, 'grad_norm': 0.5858418941497803, 'learning_rate': 6.059739150715073e-06, 'epoch': 1.47}

 49%|████▉     | 5401/11049 [55:36<57:45,  1.63it/s]
 49%|████▉     | 5402/11049 [55:37<57:43,  1.63it/s]
                                                    
{'loss': 0.2335, 'grad_norm': 0.5794399380683899, 'learning_rate': 6.058195343453019e-06, 'epoch': 1.47}

 49%|████▉     | 5402/11049 [55:37<57:43,  1.63it/s]
 49%|████▉     | 5403/11049 [55:37<57:41,  1.63it/s]
                                                    
{'loss': 0.2779, 'grad_norm': 0.6496276259422302, 'learning_rate': 6.056651430571648e-06, 'epoch': 1.47}

 49%|████▉     | 5403/11049 [55:38<57:41,  1.63it/s]
 49%|████▉     | 5404/11049 [55:38<57:39,  1.63it/s]
                                                    
{'loss': 0.2353, 'grad_norm': 0.6048471927642822, 'learning_rate': 6.055107412225058e-06, 'epoch': 1.47}

 49%|████▉     | 5404/11049 [55:38<57:39,  1.63it/s]
 49%|████▉     | 5405/11049 [55:39<57:39,  1.63it/s]
                                                    
{'loss': 0.201, 'grad_norm': 0.5998489856719971, 'learning_rate': 6.053563288567361e-06, 'epoch': 1.47}

 49%|████▉     | 5405/11049 [55:39<57:39,  1.63it/s]
 49%|████▉     | 5406/11049 [55:39<57:37,  1.63it/s]
                                                    
{'loss': 0.1891, 'grad_norm': 0.5115201473236084, 'learning_rate': 6.052019059752675e-06, 'epoch': 1.47}

 49%|████▉     | 5406/11049 [55:39<57:37,  1.63it/s]
 49%|████▉     | 5407/11049 [55:40<57:37,  1.63it/s]
                                                    
{'loss': 0.2397, 'grad_norm': 0.6003186106681824, 'learning_rate': 6.050474725935131e-06, 'epoch': 1.47}

 49%|████▉     | 5407/11049 [55:40<57:37,  1.63it/s]
 49%|████▉     | 5408/11049 [55:40<57:36,  1.63it/s]
                                                    
{'loss': 0.2275, 'grad_norm': 0.6417378783226013, 'learning_rate': 6.04893028726887e-06, 'epoch': 1.47}

 49%|████▉     | 5408/11049 [55:41<57:36,  1.63it/s]
 49%|████▉     | 5409/11049 [55:41<57:37,  1.63it/s]
                                                    
{'loss': 0.1878, 'grad_norm': 0.5431423783302307, 'learning_rate': 6.047385743908045e-06, 'epoch': 1.47}

 49%|████▉     | 5409/11049 [55:41<57:37,  1.63it/s]
 49%|████▉     | 5410/11049 [55:42<57:35,  1.63it/s]
                                                    
{'loss': 0.1969, 'grad_norm': 0.588202714920044, 'learning_rate': 6.045841096006817e-06, 'epoch': 1.47}

 49%|████▉     | 5410/11049 [55:42<57:35,  1.63it/s]
 49%|████▉     | 5411/11049 [55:42<57:35,  1.63it/s]
                                                    
{'loss': 0.2127, 'grad_norm': 0.522139847278595, 'learning_rate': 6.044296343719358e-06, 'epoch': 1.47}

 49%|████▉     | 5411/11049 [55:42<57:35,  1.63it/s]
 49%|████▉     | 5412/11049 [55:43<57:33,  1.63it/s]
                                                    
{'loss': 0.1877, 'grad_norm': 0.5442559123039246, 'learning_rate': 6.042751487199853e-06, 'epoch': 1.47}

 49%|████▉     | 5412/11049 [55:43<57:33,  1.63it/s]
 49%|████▉     | 5413/11049 [55:44<57:32,  1.63it/s]
                                                    
{'loss': 0.1917, 'grad_norm': 0.5176119804382324, 'learning_rate': 6.0412065266024946e-06, 'epoch': 1.47}

 49%|████▉     | 5413/11049 [55:44<57:32,  1.63it/s]
 49%|████▉     | 5414/11049 [55:44<57:34,  1.63it/s]
                                                    
{'loss': 0.2037, 'grad_norm': 0.5353730320930481, 'learning_rate': 6.039661462081484e-06, 'epoch': 1.47}

 49%|████▉     | 5414/11049 [55:44<57:34,  1.63it/s]
 49%|████▉     | 5415/11049 [55:45<57:32,  1.63it/s]
                                                    
{'loss': 0.2577, 'grad_norm': 0.6073235869407654, 'learning_rate': 6.0381162937910385e-06, 'epoch': 1.47}

 49%|████▉     | 5415/11049 [55:45<57:32,  1.63it/s]
 49%|████▉     | 5416/11049 [55:45<57:31,  1.63it/s]
                                                    
{'loss': 0.2214, 'grad_norm': 0.5986045002937317, 'learning_rate': 6.036571021885381e-06, 'epoch': 1.47}

 49%|████▉     | 5416/11049 [55:45<57:31,  1.63it/s]
 49%|████▉     | 5417/11049 [55:46<57:30,  1.63it/s]
                                                    
{'loss': 0.1848, 'grad_norm': 0.5353606939315796, 'learning_rate': 6.035025646518747e-06, 'epoch': 1.47}

 49%|████▉     | 5417/11049 [55:46<57:30,  1.63it/s]
 49%|████▉     | 5418/11049 [55:47<57:30,  1.63it/s]
                                                    
{'loss': 0.2323, 'grad_norm': 0.6053990721702576, 'learning_rate': 6.033480167845383e-06, 'epoch': 1.47}

 49%|████▉     | 5418/11049 [55:47<57:30,  1.63it/s]
 49%|████▉     | 5419/11049 [55:47<57:31,  1.63it/s]
                                                    
{'loss': 0.2176, 'grad_norm': 0.5875673890113831, 'learning_rate': 6.03193458601954e-06, 'epoch': 1.47}

 49%|████▉     | 5419/11049 [55:47<57:31,  1.63it/s]
 49%|████▉     | 5420/11049 [55:48<57:40,  1.63it/s]
                                                    
{'loss': 0.2404, 'grad_norm': 0.5894383192062378, 'learning_rate': 6.030388901195488e-06, 'epoch': 1.47}

 49%|████▉     | 5420/11049 [55:48<57:40,  1.63it/s]
 49%|████▉     | 5421/11049 [55:48<57:37,  1.63it/s]
                                                    
{'loss': 0.1995, 'grad_norm': 0.609468936920166, 'learning_rate': 6.0288431135275006e-06, 'epoch': 1.47}

 49%|████▉     | 5421/11049 [55:49<57:37,  1.63it/s]
 49%|████▉     | 5422/11049 [55:49<57:35,  1.63it/s]
                                                    
{'loss': 0.3133, 'grad_norm': 0.7361733913421631, 'learning_rate': 6.027297223169867e-06, 'epoch': 1.47}

 49%|████▉     | 5422/11049 [55:49<57:35,  1.63it/s]
 49%|████▉     | 5423/11049 [55:50<57:33,  1.63it/s]
                                                    
{'loss': 0.2357, 'grad_norm': 0.6765925288200378, 'learning_rate': 6.025751230276881e-06, 'epoch': 1.47}

 49%|████▉     | 5423/11049 [55:50<57:33,  1.63it/s]
 49%|████▉     | 5424/11049 [55:50<57:30,  1.63it/s]
                                                    
{'loss': 0.2306, 'grad_norm': 0.5866010785102844, 'learning_rate': 6.02420513500285e-06, 'epoch': 1.47}

 49%|████▉     | 5424/11049 [55:50<57:30,  1.63it/s]
 49%|████▉     | 5425/11049 [55:51<57:30,  1.63it/s]
                                                    
{'loss': 0.1742, 'grad_norm': 0.49115803837776184, 'learning_rate': 6.02265893750209e-06, 'epoch': 1.47}

 49%|████▉     | 5425/11049 [55:51<57:30,  1.63it/s]
 49%|████▉     | 5426/11049 [55:51<57:29,  1.63it/s]
                                                    
{'loss': 0.193, 'grad_norm': 0.48083871603012085, 'learning_rate': 6.021112637928932e-06, 'epoch': 1.47}

 49%|████▉     | 5426/11049 [55:52<57:29,  1.63it/s]
 49%|████▉     | 5427/11049 [55:52<57:28,  1.63it/s]
                                                    
{'loss': 0.1887, 'grad_norm': 0.5384836196899414, 'learning_rate': 6.019566236437709e-06, 'epoch': 1.47}

 49%|████▉     | 5427/11049 [55:52<57:28,  1.63it/s]
 49%|████▉     | 5428/11049 [55:53<57:26,  1.63it/s]
                                                    
{'loss': 0.1878, 'grad_norm': 0.4911344349384308, 'learning_rate': 6.018019733182772e-06, 'epoch': 1.47}

 49%|████▉     | 5428/11049 [55:53<57:26,  1.63it/s]
 49%|████▉     | 5429/11049 [55:53<57:24,  1.63it/s]
                                                    
{'loss': 0.2421, 'grad_norm': 0.604550838470459, 'learning_rate': 6.016473128318475e-06, 'epoch': 1.47}

 49%|████▉     | 5429/11049 [55:53<57:24,  1.63it/s]
 49%|████▉     | 5430/11049 [55:54<57:24,  1.63it/s]
                                                    
{'loss': 0.155, 'grad_norm': 0.42916378378868103, 'learning_rate': 6.0149264219991895e-06, 'epoch': 1.47}

 49%|████▉     | 5430/11049 [55:54<57:24,  1.63it/s]
 49%|████▉     | 5431/11049 [55:55<57:25,  1.63it/s]
                                                    
{'loss': 0.1953, 'grad_norm': 0.4977087080478668, 'learning_rate': 6.013379614379292e-06, 'epoch': 1.47}

 49%|████▉     | 5431/11049 [55:55<57:25,  1.63it/s]
 49%|████▉     | 5432/11049 [55:55<57:23,  1.63it/s]
                                                    
{'loss': 0.1997, 'grad_norm': 0.5054461359977722, 'learning_rate': 6.011832705613171e-06, 'epoch': 1.47}

 49%|████▉     | 5432/11049 [55:55<57:23,  1.63it/s]
 49%|████▉     | 5433/11049 [55:56<57:25,  1.63it/s]
                                                    
{'loss': 0.2175, 'grad_norm': 0.5714769959449768, 'learning_rate': 6.010285695855222e-06, 'epoch': 1.48}

 49%|████▉     | 5433/11049 [55:56<57:25,  1.63it/s]
 49%|████▉     | 5434/11049 [55:56<57:24,  1.63it/s]
                                                    
{'loss': 0.2307, 'grad_norm': 0.5935989022254944, 'learning_rate': 6.0087385852598564e-06, 'epoch': 1.48}

 49%|████▉     | 5434/11049 [55:57<57:24,  1.63it/s]
 49%|████▉     | 5435/11049 [55:57<57:23,  1.63it/s]
                                                    
{'loss': 0.1769, 'grad_norm': 0.46835947036743164, 'learning_rate': 6.0071913739814924e-06, 'epoch': 1.48}

 49%|████▉     | 5435/11049 [55:57<57:23,  1.63it/s]
 49%|████▉     | 5436/11049 [55:58<57:35,  1.62it/s]
                                                    
{'loss': 0.2405, 'grad_norm': 0.5596895813941956, 'learning_rate': 6.005644062174558e-06, 'epoch': 1.48}

 49%|████▉     | 5436/11049 [55:58<57:35,  1.62it/s]
 49%|████▉     | 5437/11049 [55:58<57:29,  1.63it/s]
                                                    
{'loss': 0.2285, 'grad_norm': 0.6720867156982422, 'learning_rate': 6.004096649993491e-06, 'epoch': 1.48}

 49%|████▉     | 5437/11049 [55:58<57:29,  1.63it/s]
 49%|████▉     | 5438/11049 [55:59<57:25,  1.63it/s]
                                                    
{'loss': 0.1508, 'grad_norm': 0.40974581241607666, 'learning_rate': 6.002549137592739e-06, 'epoch': 1.48}

 49%|████▉     | 5438/11049 [55:59<57:25,  1.63it/s]
 49%|████▉     | 5439/11049 [55:59<57:24,  1.63it/s]
                                                    
{'loss': 0.1829, 'grad_norm': 0.5698305368423462, 'learning_rate': 6.001001525126762e-06, 'epoch': 1.48}

 49%|████▉     | 5439/11049 [56:00<57:24,  1.63it/s]
 49%|████▉     | 5440/11049 [56:00<57:22,  1.63it/s]
                                                    
{'loss': 0.1383, 'grad_norm': 0.4137073755264282, 'learning_rate': 5.999453812750028e-06, 'epoch': 1.48}

 49%|████▉     | 5440/11049 [56:00<57:22,  1.63it/s]
 49%|████▉     | 5441/11049 [56:01<57:25,  1.63it/s]
                                                    
{'loss': 0.1933, 'grad_norm': 0.547767162322998, 'learning_rate': 5.9979060006170164e-06, 'epoch': 1.48}

 49%|████▉     | 5441/11049 [56:01<57:25,  1.63it/s]
 49%|████▉     | 5442/11049 [56:01<57:21,  1.63it/s]
                                                    
{'loss': 0.2297, 'grad_norm': 0.5521672964096069, 'learning_rate': 5.996358088882214e-06, 'epoch': 1.48}

 49%|████▉     | 5442/11049 [56:01<57:21,  1.63it/s]
 49%|████▉     | 5443/11049 [56:02<57:21,  1.63it/s]
                                                    
{'loss': 0.2125, 'grad_norm': 0.5604067444801331, 'learning_rate': 5.994810077700118e-06, 'epoch': 1.48}

 49%|████▉     | 5443/11049 [56:02<57:21,  1.63it/s]
 49%|████▉     | 5444/11049 [56:03<57:18,  1.63it/s]
                                                    
{'loss': 0.2009, 'grad_norm': 0.5432924032211304, 'learning_rate': 5.99326196722524e-06, 'epoch': 1.48}

 49%|████▉     | 5444/11049 [56:03<57:18,  1.63it/s]
 49%|████▉     | 5445/11049 [56:03<57:35,  1.62it/s]
                                                    
{'loss': 0.2057, 'grad_norm': 0.5414132475852966, 'learning_rate': 5.991713757612097e-06, 'epoch': 1.48}

 49%|████▉     | 5445/11049 [56:03<57:35,  1.62it/s]
 49%|████▉     | 5446/11049 [56:04<57:29,  1.62it/s]
                                                    
{'loss': 0.251, 'grad_norm': 0.5904867649078369, 'learning_rate': 5.9901654490152154e-06, 'epoch': 1.48}

 49%|████▉     | 5446/11049 [56:04<57:29,  1.62it/s]
 49%|████▉     | 5447/11049 [56:04<57:23,  1.63it/s]
                                                    
{'loss': 0.2587, 'grad_norm': 0.5778705477714539, 'learning_rate': 5.9886170415891335e-06, 'epoch': 1.48}

 49%|████▉     | 5447/11049 [56:05<57:23,  1.63it/s]
 49%|████▉     | 5448/11049 [56:05<57:20,  1.63it/s]
                                                    
{'loss': 0.2567, 'grad_norm': 0.6535611152648926, 'learning_rate': 5.987068535488401e-06, 'epoch': 1.48}

 49%|████▉     | 5448/11049 [56:05<57:20,  1.63it/s]
 49%|████▉     | 5449/11049 [56:06<57:17,  1.63it/s]
                                                    
{'loss': 0.1538, 'grad_norm': 0.424699991941452, 'learning_rate': 5.9855199308675724e-06, 'epoch': 1.48}

 49%|████▉     | 5449/11049 [56:06<57:17,  1.63it/s]
 49%|████▉     | 5450/11049 [56:06<57:18,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.506040096282959, 'learning_rate': 5.983971227881219e-06, 'epoch': 1.48}

 49%|████▉     | 5450/11049 [56:06<57:18,  1.63it/s]
 49%|████▉     | 5451/11049 [56:07<57:17,  1.63it/s]
                                                    
{'loss': 0.2307, 'grad_norm': 0.7341856360435486, 'learning_rate': 5.982422426683913e-06, 'epoch': 1.48}

 49%|████▉     | 5451/11049 [56:07<57:17,  1.63it/s]
 49%|████▉     | 5452/11049 [56:07<57:15,  1.63it/s]
                                                    
{'loss': 0.2165, 'grad_norm': 0.5352965593338013, 'learning_rate': 5.980873527430249e-06, 'epoch': 1.48}

 49%|████▉     | 5452/11049 [56:08<57:15,  1.63it/s]
 49%|████▉     | 5453/11049 [56:08<57:14,  1.63it/s]
                                                    
{'loss': 0.251, 'grad_norm': 0.7003676891326904, 'learning_rate': 5.979324530274816e-06, 'epoch': 1.48}

 49%|████▉     | 5453/11049 [56:08<57:14,  1.63it/s]
 49%|████▉     | 5454/11049 [56:09<57:13,  1.63it/s]
                                                    
{'loss': 0.1822, 'grad_norm': 0.47185018658638, 'learning_rate': 5.977775435372226e-06, 'epoch': 1.48}

 49%|████▉     | 5454/11049 [56:09<57:13,  1.63it/s]
 49%|████▉     | 5455/11049 [56:09<57:17,  1.63it/s]
                                                    
{'loss': 0.158, 'grad_norm': 0.4681473970413208, 'learning_rate': 5.976226242877092e-06, 'epoch': 1.48}

 49%|████▉     | 5455/11049 [56:09<57:17,  1.63it/s]
 49%|████▉     | 5456/11049 [56:10<57:14,  1.63it/s]
                                                    
{'loss': 0.2324, 'grad_norm': 0.5905625224113464, 'learning_rate': 5.974676952944042e-06, 'epoch': 1.48}

 49%|████▉     | 5456/11049 [56:10<57:14,  1.63it/s]
 49%|████▉     | 5457/11049 [56:11<57:13,  1.63it/s]
                                                    
{'loss': 0.2047, 'grad_norm': 0.553523600101471, 'learning_rate': 5.973127565727711e-06, 'epoch': 1.48}

 49%|████▉     | 5457/11049 [56:11<57:13,  1.63it/s]
 49%|████▉     | 5458/11049 [56:11<57:11,  1.63it/s]
                                                    
{'loss': 0.1734, 'grad_norm': 0.4585290253162384, 'learning_rate': 5.971578081382747e-06, 'epoch': 1.48}

 49%|████▉     | 5458/11049 [56:11<57:11,  1.63it/s]
 49%|████▉     | 5459/11049 [56:12<57:10,  1.63it/s]
                                                    
{'loss': 0.2391, 'grad_norm': 0.6164207458496094, 'learning_rate': 5.9700285000638e-06, 'epoch': 1.48}

 49%|████▉     | 5459/11049 [56:12<57:10,  1.63it/s]
 49%|████▉     | 5460/11049 [56:12<57:28,  1.62it/s]
                                                    
{'loss': 0.219, 'grad_norm': 0.5621952414512634, 'learning_rate': 5.968478821925541e-06, 'epoch': 1.48}

 49%|████▉     | 5460/11049 [56:13<57:28,  1.62it/s]
 49%|████▉     | 5461/11049 [56:13<57:24,  1.62it/s]
                                                    
{'loss': 0.1555, 'grad_norm': 0.4535841941833496, 'learning_rate': 5.966929047122641e-06, 'epoch': 1.48}

 49%|████▉     | 5461/11049 [56:13<57:24,  1.62it/s]
 49%|████▉     | 5462/11049 [56:14<57:19,  1.62it/s]
                                                    
{'loss': 0.221, 'grad_norm': 0.5729551911354065, 'learning_rate': 5.965379175809785e-06, 'epoch': 1.48}

 49%|████▉     | 5462/11049 [56:14<57:19,  1.62it/s]
 49%|████▉     | 5463/11049 [56:14<57:15,  1.63it/s]
                                                    
{'loss': 0.1995, 'grad_norm': 0.505374550819397, 'learning_rate': 5.963829208141666e-06, 'epoch': 1.48}

 49%|████▉     | 5463/11049 [56:14<57:15,  1.63it/s]
 49%|████▉     | 5464/11049 [56:15<57:12,  1.63it/s]
                                                    
{'loss': 0.1935, 'grad_norm': 0.5179196000099182, 'learning_rate': 5.96227914427299e-06, 'epoch': 1.48}

 49%|████▉     | 5464/11049 [56:15<57:12,  1.63it/s]
 49%|████▉     | 5465/11049 [56:15<57:14,  1.63it/s]
                                                    
{'loss': 0.2008, 'grad_norm': 0.4767704904079437, 'learning_rate': 5.960728984358466e-06, 'epoch': 1.48}

 49%|████▉     | 5465/11049 [56:16<57:14,  1.63it/s]
 49%|████▉     | 5466/11049 [56:16<57:16,  1.62it/s]
                                                    
{'loss': 0.2047, 'grad_norm': 0.5880884528160095, 'learning_rate': 5.9591787285528215e-06, 'epoch': 1.48}

 49%|████▉     | 5466/11049 [56:16<57:16,  1.62it/s]
 49%|████▉     | 5467/11049 [56:17<57:13,  1.63it/s]
                                                    
{'loss': 0.2305, 'grad_norm': 0.6660377383232117, 'learning_rate': 5.957628377010786e-06, 'epoch': 1.48}

 49%|████▉     | 5467/11049 [56:17<57:13,  1.63it/s]
 49%|████▉     | 5468/11049 [56:17<57:09,  1.63it/s]
                                                    
{'loss': 0.2346, 'grad_norm': 0.6212232708930969, 'learning_rate': 5.956077929887103e-06, 'epoch': 1.48}

 49%|████▉     | 5468/11049 [56:17<57:09,  1.63it/s]
 49%|████▉     | 5469/11049 [56:18<57:06,  1.63it/s]
                                                    
{'loss': 0.2247, 'grad_norm': 0.5390841960906982, 'learning_rate': 5.954527387336521e-06, 'epoch': 1.48}

 49%|████▉     | 5469/11049 [56:18<57:06,  1.63it/s]
 50%|████▉     | 5470/11049 [56:19<57:10,  1.63it/s]
                                                    
{'loss': 0.1929, 'grad_norm': 0.5856108069419861, 'learning_rate': 5.952976749513802e-06, 'epoch': 1.49}

 50%|████▉     | 5470/11049 [56:19<57:10,  1.63it/s]
 50%|████▉     | 5471/11049 [56:19<57:10,  1.63it/s]
                                                    
{'loss': 0.2517, 'grad_norm': 0.6029380559921265, 'learning_rate': 5.951426016573719e-06, 'epoch': 1.49}

 50%|████▉     | 5471/11049 [56:19<57:10,  1.63it/s]
 50%|████▉     | 5472/11049 [56:20<57:08,  1.63it/s]
                                                    
{'loss': 0.1766, 'grad_norm': 0.48493289947509766, 'learning_rate': 5.949875188671049e-06, 'epoch': 1.49}

 50%|████▉     | 5472/11049 [56:20<57:08,  1.63it/s]
 50%|████▉     | 5473/11049 [56:20<57:03,  1.63it/s]
                                                    
{'loss': 0.2491, 'grad_norm': 0.5957872867584229, 'learning_rate': 5.948324265960581e-06, 'epoch': 1.49}

 50%|████▉     | 5473/11049 [56:20<57:03,  1.63it/s]
 50%|████▉     | 5474/11049 [56:21<57:00,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.6384602785110474, 'learning_rate': 5.946773248597117e-06, 'epoch': 1.49}

 50%|████▉     | 5474/11049 [56:21<57:00,  1.63it/s]
 50%|████▉     | 5475/11049 [56:22<57:03,  1.63it/s]
                                                    
{'loss': 0.2067, 'grad_norm': 0.5518866181373596, 'learning_rate': 5.945222136735461e-06, 'epoch': 1.49}

 50%|████▉     | 5475/11049 [56:22<57:03,  1.63it/s]
 50%|████▉     | 5476/11049 [56:22<57:04,  1.63it/s]
                                                    
{'loss': 0.1761, 'grad_norm': 0.49267134070396423, 'learning_rate': 5.9436709305304355e-06, 'epoch': 1.49}

 50%|████▉     | 5476/11049 [56:22<57:04,  1.63it/s]
 50%|████▉     | 5477/11049 [56:23<57:01,  1.63it/s]
                                                    
{'loss': 0.2091, 'grad_norm': 0.527655839920044, 'learning_rate': 5.942119630136863e-06, 'epoch': 1.49}

 50%|████▉     | 5477/11049 [56:23<57:01,  1.63it/s]
 50%|████▉     | 5478/11049 [56:23<57:00,  1.63it/s]
                                                    
{'loss': 0.2509, 'grad_norm': 0.5978214740753174, 'learning_rate': 5.940568235709584e-06, 'epoch': 1.49}

 50%|████▉     | 5478/11049 [56:24<57:00,  1.63it/s]
 50%|████▉     | 5479/11049 [56:24<56:58,  1.63it/s]
                                                    
{'loss': 0.237, 'grad_norm': 0.5811276435852051, 'learning_rate': 5.939016747403441e-06, 'epoch': 1.49}

 50%|████▉     | 5479/11049 [56:24<56:58,  1.63it/s]
 50%|████▉     | 5480/11049 [56:25<57:03,  1.63it/s]
                                                    
{'loss': 0.2531, 'grad_norm': 0.6950575709342957, 'learning_rate': 5.937465165373292e-06, 'epoch': 1.49}

 50%|████▉     | 5480/11049 [56:25<57:03,  1.63it/s]
 50%|████▉     | 5481/11049 [56:25<57:02,  1.63it/s]
                                                    
{'loss': 0.1748, 'grad_norm': 0.5047531127929688, 'learning_rate': 5.935913489774e-06, 'epoch': 1.49}

 50%|████▉     | 5481/11049 [56:25<57:02,  1.63it/s]
 50%|████▉     | 5482/11049 [56:26<57:00,  1.63it/s]
                                                    
{'loss': 0.2003, 'grad_norm': 0.5153036713600159, 'learning_rate': 5.9343617207604394e-06, 'epoch': 1.49}

 50%|████▉     | 5482/11049 [56:26<57:00,  1.63it/s]
 50%|████▉     | 5483/11049 [56:27<56:56,  1.63it/s]
                                                    
{'loss': 0.2537, 'grad_norm': 0.6500545144081116, 'learning_rate': 5.932809858487493e-06, 'epoch': 1.49}

 50%|████▉     | 5483/11049 [56:27<56:56,  1.63it/s]
 50%|████▉     | 5484/11049 [56:27<56:54,  1.63it/s]
                                                    
{'loss': 0.1947, 'grad_norm': 0.6039723753929138, 'learning_rate': 5.931257903110055e-06, 'epoch': 1.49}

 50%|████▉     | 5484/11049 [56:27<56:54,  1.63it/s]
 50%|████▉     | 5485/11049 [56:28<57:00,  1.63it/s]
                                                    
{'loss': 0.1745, 'grad_norm': 0.5039532780647278, 'learning_rate': 5.929705854783026e-06, 'epoch': 1.49}

 50%|████▉     | 5485/11049 [56:28<57:00,  1.63it/s]
 50%|████▉     | 5486/11049 [56:28<56:57,  1.63it/s]
                                                    
{'loss': 0.2, 'grad_norm': 0.617159903049469, 'learning_rate': 5.928153713661318e-06, 'epoch': 1.49}

 50%|████▉     | 5486/11049 [56:28<56:57,  1.63it/s]
 50%|████▉     | 5487/11049 [56:29<56:53,  1.63it/s]
                                                    
{'loss': 0.1808, 'grad_norm': 0.4666552245616913, 'learning_rate': 5.92660147989985e-06, 'epoch': 1.49}

 50%|████▉     | 5487/11049 [56:29<56:53,  1.63it/s]
 50%|████▉     | 5488/11049 [56:30<56:54,  1.63it/s]
                                                    
{'loss': 0.1816, 'grad_norm': 0.4767322242259979, 'learning_rate': 5.925049153653552e-06, 'epoch': 1.49}

 50%|████▉     | 5488/11049 [56:30<56:54,  1.63it/s]
 50%|████▉     | 5489/11049 [56:30<56:51,  1.63it/s]
                                                    
{'loss': 0.1781, 'grad_norm': 0.5036278367042542, 'learning_rate': 5.923496735077364e-06, 'epoch': 1.49}

 50%|████▉     | 5489/11049 [56:30<56:51,  1.63it/s]
 50%|████▉     | 5490/11049 [56:31<56:54,  1.63it/s]
                                                    
{'loss': 0.2187, 'grad_norm': 0.503411054611206, 'learning_rate': 5.921944224326235e-06, 'epoch': 1.49}

 50%|████▉     | 5490/11049 [56:31<56:54,  1.63it/s]
 50%|████▉     | 5491/11049 [56:31<56:52,  1.63it/s]
                                                    
{'loss': 0.205, 'grad_norm': 0.5508753657341003, 'learning_rate': 5.920391621555118e-06, 'epoch': 1.49}

 50%|████▉     | 5491/11049 [56:32<56:52,  1.63it/s]
 50%|████▉     | 5492/11049 [56:32<56:49,  1.63it/s]
                                                    
{'loss': 0.2203, 'grad_norm': 0.536207377910614, 'learning_rate': 5.918838926918985e-06, 'epoch': 1.49}

 50%|████▉     | 5492/11049 [56:32<56:49,  1.63it/s]
 50%|████▉     | 5493/11049 [56:33<56:50,  1.63it/s]
                                                    
{'loss': 0.1554, 'grad_norm': 0.4746007025241852, 'learning_rate': 5.917286140572808e-06, 'epoch': 1.49}

 50%|████▉     | 5493/11049 [56:33<56:50,  1.63it/s]
 50%|████▉     | 5494/11049 [56:33<56:49,  1.63it/s]
                                                    
{'loss': 0.2599, 'grad_norm': 0.6574121117591858, 'learning_rate': 5.915733262671573e-06, 'epoch': 1.49}

 50%|████▉     | 5494/11049 [56:33<56:49,  1.63it/s]
 50%|████▉     | 5495/11049 [56:34<56:55,  1.63it/s]
                                                    
{'loss': 0.2333, 'grad_norm': 0.5223512649536133, 'learning_rate': 5.914180293370274e-06, 'epoch': 1.49}

 50%|████▉     | 5495/11049 [56:34<56:55,  1.63it/s]
 50%|████▉     | 5496/11049 [56:34<56:52,  1.63it/s]
                                                    
{'loss': 0.1689, 'grad_norm': 0.4765337109565735, 'learning_rate': 5.912627232823915e-06, 'epoch': 1.49}

 50%|████▉     | 5496/11049 [56:35<56:52,  1.63it/s]
 50%|████▉     | 5497/11049 [56:35<56:49,  1.63it/s]
                                                    
{'loss': 0.2064, 'grad_norm': 0.5786719918251038, 'learning_rate': 5.9110740811875055e-06, 'epoch': 1.49}

 50%|████▉     | 5497/11049 [56:35<56:49,  1.63it/s]
 50%|████▉     | 5498/11049 [56:36<56:47,  1.63it/s]
                                                    
{'loss': 0.2977, 'grad_norm': 0.7027663588523865, 'learning_rate': 5.909520838616069e-06, 'epoch': 1.49}

 50%|████▉     | 5498/11049 [56:36<56:47,  1.63it/s]
 50%|████▉     | 5499/11049 [56:36<56:45,  1.63it/s]
                                                    
{'loss': 0.2433, 'grad_norm': 0.5730319023132324, 'learning_rate': 5.907967505264637e-06, 'epoch': 1.49}

 50%|████▉     | 5499/11049 [56:36<56:45,  1.63it/s]
 50%|████▉     | 5500/11049 [56:37<56:48,  1.63it/s]
                                                    
{'loss': 0.1944, 'grad_norm': 0.5475943684577942, 'learning_rate': 5.906414081288247e-06, 'epoch': 1.49}

 50%|████▉     | 5500/11049 [56:37<56:48,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.36it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                    

                                               
{'eval_loss': 0.5673040747642517, 'eval_runtime': 1.9531, 'eval_samples_per_second': 102.4, 'eval_steps_per_second': 6.656, 'epoch': 1.49}

 50%|████▉     | 5500/11049 [56:39<56:48,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 50%|████▉     | 5501/11049 [56:40<1:51:07,  1.20s/it]
                                                      
{'loss': 0.1761, 'grad_norm': 0.5300526022911072, 'learning_rate': 5.904860566841946e-06, 'epoch': 1.49}

 50%|████▉     | 5501/11049 [56:40<1:51:07,  1.20s/it]
 50%|████▉     | 5502/11049 [56:40<1:34:47,  1.03s/it]
                                                      
{'loss': 0.2376, 'grad_norm': 0.6334958672523499, 'learning_rate': 5.903306962080795e-06, 'epoch': 1.49}

 50%|████▉     | 5502/11049 [56:40<1:34:47,  1.03s/it]
 50%|████▉     | 5503/11049 [56:41<1:23:23,  1.11it/s]
                                                      
{'loss': 0.2342, 'grad_norm': 0.6120084524154663, 'learning_rate': 5.901753267159859e-06, 'epoch': 1.49}

 50%|████▉     | 5503/11049 [56:41<1:23:23,  1.11it/s]
 50%|████▉     | 5504/11049 [56:41<1:15:23,  1.23it/s]
                                                      
{'loss': 0.1766, 'grad_norm': 0.5026749968528748, 'learning_rate': 5.9001994822342125e-06, 'epoch': 1.49}

 50%|████▉     | 5504/11049 [56:41<1:15:23,  1.23it/s]
 50%|████▉     | 5505/11049 [56:42<1:09:48,  1.32it/s]
                                                      
{'loss': 0.1933, 'grad_norm': 0.5498432517051697, 'learning_rate': 5.898645607458941e-06, 'epoch': 1.49}

 50%|████▉     | 5505/11049 [56:42<1:09:48,  1.32it/s]
 50%|████▉     | 5506/11049 [56:43<1:05:48,  1.40it/s]
                                                      
{'loss': 0.2249, 'grad_norm': 0.5798428058624268, 'learning_rate': 5.897091642989138e-06, 'epoch': 1.49}

 50%|████▉     | 5506/11049 [56:43<1:05:48,  1.40it/s]
 50%|████▉     | 5507/11049 [56:43<1:03:04,  1.46it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.5062117576599121, 'learning_rate': 5.895537588979906e-06, 'epoch': 1.5}

 50%|████▉     | 5507/11049 [56:43<1:03:04,  1.46it/s]
 50%|████▉     | 5508/11049 [56:44<1:01:07,  1.51it/s]
                                                      
{'loss': 0.2095, 'grad_norm': 0.5448189377784729, 'learning_rate': 5.893983445586357e-06, 'epoch': 1.5}

 50%|████▉     | 5508/11049 [56:44<1:01:07,  1.51it/s]
 50%|████▉     | 5509/11049 [56:44<59:46,  1.54it/s]  
                                                    
{'loss': 0.242, 'grad_norm': 0.6507134437561035, 'learning_rate': 5.892429212963609e-06, 'epoch': 1.5}

 50%|████▉     | 5509/11049 [56:45<59:46,  1.54it/s]
 50%|████▉     | 5510/11049 [56:45<58:49,  1.57it/s]
                                                    
{'loss': 0.2529, 'grad_norm': 0.6151883006095886, 'learning_rate': 5.890874891266792e-06, 'epoch': 1.5}

 50%|████▉     | 5510/11049 [56:45<58:49,  1.57it/s]
 50%|████▉     | 5511/11049 [56:46<58:09,  1.59it/s]
                                                    
{'loss': 0.2112, 'grad_norm': 0.5514077544212341, 'learning_rate': 5.889320480651046e-06, 'epoch': 1.5}

 50%|████▉     | 5511/11049 [56:46<58:09,  1.59it/s]
 50%|████▉     | 5512/11049 [56:46<57:39,  1.60it/s]
                                                    
{'loss': 0.1641, 'grad_norm': 0.47292277216911316, 'learning_rate': 5.887765981271518e-06, 'epoch': 1.5}

 50%|████▉     | 5512/11049 [56:46<57:39,  1.60it/s]
 50%|████▉     | 5513/11049 [56:47<57:20,  1.61it/s]
                                                    
{'loss': 0.1878, 'grad_norm': 0.4787656366825104, 'learning_rate': 5.886211393283359e-06, 'epoch': 1.5}

 50%|████▉     | 5513/11049 [56:47<57:20,  1.61it/s]
 50%|████▉     | 5514/11049 [56:47<57:05,  1.62it/s]
                                                    
{'loss': 0.3131, 'grad_norm': 0.6712121963500977, 'learning_rate': 5.88465671684174e-06, 'epoch': 1.5}

 50%|████▉     | 5514/11049 [56:48<57:05,  1.62it/s]
 50%|████▉     | 5515/11049 [56:48<56:55,  1.62it/s]
                                                    
{'loss': 0.1662, 'grad_norm': 0.5132875442504883, 'learning_rate': 5.883101952101831e-06, 'epoch': 1.5}

 50%|████▉     | 5515/11049 [56:48<56:55,  1.62it/s]
 50%|████▉     | 5516/11049 [56:49<56:49,  1.62it/s]
                                                    
{'loss': 0.2457, 'grad_norm': 0.6049803495407104, 'learning_rate': 5.881547099218815e-06, 'epoch': 1.5}

 50%|████▉     | 5516/11049 [56:49<56:49,  1.62it/s]
 50%|████▉     | 5517/11049 [56:49<56:43,  1.63it/s]
                                                    
{'loss': 0.1623, 'grad_norm': 0.4783758521080017, 'learning_rate': 5.8799921583478825e-06, 'epoch': 1.5}

 50%|████▉     | 5517/11049 [56:49<56:43,  1.63it/s]
 50%|████▉     | 5518/11049 [56:50<56:39,  1.63it/s]
                                                    
{'loss': 0.2149, 'grad_norm': 0.5635424256324768, 'learning_rate': 5.878437129644235e-06, 'epoch': 1.5}

 50%|████▉     | 5518/11049 [56:50<56:39,  1.63it/s]
 50%|████▉     | 5519/11049 [56:51<56:36,  1.63it/s]
                                                    
{'loss': 0.147, 'grad_norm': 0.420775443315506, 'learning_rate': 5.8768820132630786e-06, 'epoch': 1.5}

 50%|████▉     | 5519/11049 [56:51<56:36,  1.63it/s]
 50%|████▉     | 5520/11049 [56:51<56:35,  1.63it/s]
                                                    
{'loss': 0.2166, 'grad_norm': 0.5354664325714111, 'learning_rate': 5.875326809359634e-06, 'epoch': 1.5}

 50%|████▉     | 5520/11049 [56:51<56:35,  1.63it/s]
 50%|████▉     | 5521/11049 [56:52<56:33,  1.63it/s]
                                                    
{'loss': 0.1938, 'grad_norm': 0.5322765707969666, 'learning_rate': 5.873771518089124e-06, 'epoch': 1.5}

 50%|████▉     | 5521/11049 [56:52<56:33,  1.63it/s]
 50%|████▉     | 5522/11049 [56:52<56:31,  1.63it/s]
                                                    
{'loss': 0.2081, 'grad_norm': 0.5171734690666199, 'learning_rate': 5.872216139606787e-06, 'epoch': 1.5}

 50%|████▉     | 5522/11049 [56:53<56:31,  1.63it/s]
 50%|████▉     | 5523/11049 [56:53<56:31,  1.63it/s]
                                                    
{'loss': 0.2362, 'grad_norm': 0.5778666734695435, 'learning_rate': 5.8706606740678616e-06, 'epoch': 1.5}

 50%|████▉     | 5523/11049 [56:53<56:31,  1.63it/s]
 50%|████▉     | 5524/11049 [56:54<56:30,  1.63it/s]
                                                    
{'loss': 0.2124, 'grad_norm': 0.4786258637905121, 'learning_rate': 5.869105121627605e-06, 'epoch': 1.5}

 50%|████▉     | 5524/11049 [56:54<56:30,  1.63it/s]
 50%|█████     | 5525/11049 [56:54<56:30,  1.63it/s]
                                                    
{'loss': 0.2767, 'grad_norm': 0.6727541089057922, 'learning_rate': 5.867549482441276e-06, 'epoch': 1.5}

 50%|█████     | 5525/11049 [56:54<56:30,  1.63it/s]
 50%|█████     | 5526/11049 [56:55<56:29,  1.63it/s]
                                                    
{'loss': 0.2611, 'grad_norm': 0.5629122853279114, 'learning_rate': 5.865993756664144e-06, 'epoch': 1.5}

 50%|█████     | 5526/11049 [56:55<56:29,  1.63it/s]
 50%|█████     | 5527/11049 [56:55<56:28,  1.63it/s]
                                                    
{'loss': 0.2428, 'grad_norm': 0.632839024066925, 'learning_rate': 5.864437944451488e-06, 'epoch': 1.5}

 50%|█████     | 5527/11049 [56:56<56:28,  1.63it/s]
 50%|█████     | 5528/11049 [56:56<56:26,  1.63it/s]
                                                    
{'loss': 0.2121, 'grad_norm': 0.5197262763977051, 'learning_rate': 5.862882045958593e-06, 'epoch': 1.5}

 50%|█████     | 5528/11049 [56:56<56:26,  1.63it/s]
 50%|█████     | 5529/11049 [56:57<56:26,  1.63it/s]
                                                    
{'loss': 0.1527, 'grad_norm': 0.4154447913169861, 'learning_rate': 5.861326061340756e-06, 'epoch': 1.5}

 50%|█████     | 5529/11049 [56:57<56:26,  1.63it/s]
 50%|█████     | 5530/11049 [56:57<56:27,  1.63it/s]
                                                    
{'loss': 0.2209, 'grad_norm': 0.5554603934288025, 'learning_rate': 5.859769990753283e-06, 'epoch': 1.5}

 50%|█████     | 5530/11049 [56:57<56:27,  1.63it/s]
 50%|█████     | 5531/11049 [56:58<56:28,  1.63it/s]
                                                    
{'loss': 0.2343, 'grad_norm': 0.5878157019615173, 'learning_rate': 5.858213834351482e-06, 'epoch': 1.5}

 50%|█████     | 5531/11049 [56:58<56:28,  1.63it/s]
 50%|█████     | 5532/11049 [56:59<56:25,  1.63it/s]
                                                    
{'loss': 0.2129, 'grad_norm': 0.41604769229888916, 'learning_rate': 5.8566575922906785e-06, 'epoch': 1.5}

 50%|█████     | 5532/11049 [56:59<56:25,  1.63it/s]
 50%|█████     | 5533/11049 [56:59<56:24,  1.63it/s]
                                                    
{'loss': 0.2164, 'grad_norm': 0.6310398578643799, 'learning_rate': 5.8551012647262e-06, 'epoch': 1.5}

 50%|█████     | 5533/11049 [56:59<56:24,  1.63it/s]
 50%|█████     | 5534/11049 [57:00<56:24,  1.63it/s]
                                                    
{'loss': 0.1897, 'grad_norm': 0.509066104888916, 'learning_rate': 5.8535448518133855e-06, 'epoch': 1.5}

 50%|█████     | 5534/11049 [57:00<56:24,  1.63it/s]
 50%|█████     | 5535/11049 [57:00<56:23,  1.63it/s]
                                                    
{'loss': 0.1436, 'grad_norm': 0.4385029375553131, 'learning_rate': 5.851988353707581e-06, 'epoch': 1.5}

 50%|█████     | 5535/11049 [57:01<56:23,  1.63it/s]
 50%|█████     | 5536/11049 [57:01<56:22,  1.63it/s]
                                                    
{'loss': 0.1796, 'grad_norm': 0.4827042818069458, 'learning_rate': 5.850431770564145e-06, 'epoch': 1.5}

 50%|█████     | 5536/11049 [57:01<56:22,  1.63it/s]
 50%|█████     | 5537/11049 [57:02<56:23,  1.63it/s]
                                                    
{'loss': 0.2364, 'grad_norm': 0.5784465074539185, 'learning_rate': 5.848875102538435e-06, 'epoch': 1.5}

 50%|█████     | 5537/11049 [57:02<56:23,  1.63it/s]
 50%|█████     | 5538/11049 [57:02<56:20,  1.63it/s]
                                                    
{'loss': 0.1871, 'grad_norm': 0.4889395833015442, 'learning_rate': 5.847318349785829e-06, 'epoch': 1.5}

 50%|█████     | 5538/11049 [57:02<56:20,  1.63it/s]
 50%|█████     | 5539/11049 [57:03<56:19,  1.63it/s]
                                                    
{'loss': 0.1749, 'grad_norm': 0.4525235593318939, 'learning_rate': 5.845761512461705e-06, 'epoch': 1.5}

 50%|█████     | 5539/11049 [57:03<56:19,  1.63it/s]
 50%|█████     | 5540/11049 [57:03<56:19,  1.63it/s]
                                                    
{'loss': 0.1993, 'grad_norm': 0.5591108202934265, 'learning_rate': 5.844204590721454e-06, 'epoch': 1.5}

 50%|█████     | 5540/11049 [57:04<56:19,  1.63it/s]
 50%|█████     | 5541/11049 [57:04<56:17,  1.63it/s]
                                                    
{'loss': 0.2387, 'grad_norm': 0.6553329825401306, 'learning_rate': 5.84264758472047e-06, 'epoch': 1.5}

 50%|█████     | 5541/11049 [57:04<56:17,  1.63it/s]
 50%|█████     | 5542/11049 [57:05<56:17,  1.63it/s]
                                                    
{'loss': 0.2438, 'grad_norm': 0.54676353931427, 'learning_rate': 5.841090494614164e-06, 'epoch': 1.5}

 50%|█████     | 5542/11049 [57:05<56:17,  1.63it/s]
 50%|█████     | 5543/11049 [57:05<56:16,  1.63it/s]
                                                    
{'loss': 0.2538, 'grad_norm': 0.6019430756568909, 'learning_rate': 5.839533320557948e-06, 'epoch': 1.51}

 50%|█████     | 5543/11049 [57:05<56:16,  1.63it/s]
 50%|█████     | 5544/11049 [57:06<56:15,  1.63it/s]
                                                    
{'loss': 0.1824, 'grad_norm': 0.5384637117385864, 'learning_rate': 5.837976062707243e-06, 'epoch': 1.51}

 50%|█████     | 5544/11049 [57:06<56:15,  1.63it/s]
 50%|█████     | 5545/11049 [57:07<56:15,  1.63it/s]
                                                    
{'loss': 0.1586, 'grad_norm': 0.4494341313838959, 'learning_rate': 5.836418721217483e-06, 'epoch': 1.51}

 50%|█████     | 5545/11049 [57:07<56:15,  1.63it/s]
 50%|█████     | 5546/11049 [57:07<56:20,  1.63it/s]
                                                    
{'loss': 0.201, 'grad_norm': 0.5430629253387451, 'learning_rate': 5.834861296244106e-06, 'epoch': 1.51}

 50%|█████     | 5546/11049 [57:07<56:20,  1.63it/s]
 50%|█████     | 5547/11049 [57:08<56:18,  1.63it/s]
                                                    
{'loss': 0.2416, 'grad_norm': 0.6082546710968018, 'learning_rate': 5.833303787942559e-06, 'epoch': 1.51}

 50%|█████     | 5547/11049 [57:08<56:18,  1.63it/s]
 50%|█████     | 5548/11049 [57:08<56:16,  1.63it/s]
                                                    
{'loss': 0.1402, 'grad_norm': 0.42381250858306885, 'learning_rate': 5.831746196468301e-06, 'epoch': 1.51}

 50%|█████     | 5548/11049 [57:08<56:16,  1.63it/s]
 50%|█████     | 5549/11049 [57:09<56:16,  1.63it/s]
                                                    
{'loss': 0.2232, 'grad_norm': 0.5893025398254395, 'learning_rate': 5.830188521976794e-06, 'epoch': 1.51}

 50%|█████     | 5549/11049 [57:09<56:16,  1.63it/s]
 50%|█████     | 5550/11049 [57:10<56:15,  1.63it/s]
                                                    
{'loss': 0.2002, 'grad_norm': 0.550782322883606, 'learning_rate': 5.828630764623511e-06, 'epoch': 1.51}

 50%|█████     | 5550/11049 [57:10<56:15,  1.63it/s]
 50%|█████     | 5551/11049 [57:10<56:13,  1.63it/s]
                                                    
{'loss': 0.2561, 'grad_norm': 0.6542772054672241, 'learning_rate': 5.8270729245639335e-06, 'epoch': 1.51}

 50%|█████     | 5551/11049 [57:10<56:13,  1.63it/s]
 50%|█████     | 5552/11049 [57:11<56:10,  1.63it/s]
                                                    
{'loss': 0.1871, 'grad_norm': 0.46930012106895447, 'learning_rate': 5.82551500195355e-06, 'epoch': 1.51}

 50%|█████     | 5552/11049 [57:11<56:10,  1.63it/s]
 50%|█████     | 5553/11049 [57:11<56:10,  1.63it/s]
                                                    
{'loss': 0.2497, 'grad_norm': 0.5960016846656799, 'learning_rate': 5.823956996947861e-06, 'epoch': 1.51}

 50%|█████     | 5553/11049 [57:12<56:10,  1.63it/s]
 50%|█████     | 5554/11049 [57:12<56:09,  1.63it/s]
                                                    
{'loss': 0.1995, 'grad_norm': 0.49625930190086365, 'learning_rate': 5.822398909702368e-06, 'epoch': 1.51}

 50%|█████     | 5554/11049 [57:12<56:09,  1.63it/s]
 50%|█████     | 5555/11049 [57:13<56:10,  1.63it/s]
                                                    
{'loss': 0.1737, 'grad_norm': 0.4859144687652588, 'learning_rate': 5.820840740372589e-06, 'epoch': 1.51}

 50%|█████     | 5555/11049 [57:13<56:10,  1.63it/s]
 50%|█████     | 5556/11049 [57:13<56:09,  1.63it/s]
                                                    
{'loss': 0.1753, 'grad_norm': 0.4656403958797455, 'learning_rate': 5.819282489114041e-06, 'epoch': 1.51}

 50%|█████     | 5556/11049 [57:13<56:09,  1.63it/s]
 50%|█████     | 5557/11049 [57:14<56:07,  1.63it/s]
                                                    
{'loss': 0.166, 'grad_norm': 0.47287219762802124, 'learning_rate': 5.817724156082258e-06, 'epoch': 1.51}

 50%|█████     | 5557/11049 [57:14<56:07,  1.63it/s]
 50%|█████     | 5558/11049 [57:14<56:08,  1.63it/s]
                                                    
{'loss': 0.2703, 'grad_norm': 0.5545990467071533, 'learning_rate': 5.816165741432778e-06, 'epoch': 1.51}

 50%|█████     | 5558/11049 [57:15<56:08,  1.63it/s]
 50%|█████     | 5559/11049 [57:15<56:10,  1.63it/s]
                                                    
{'loss': 0.2186, 'grad_norm': 0.5626317858695984, 'learning_rate': 5.814607245321148e-06, 'epoch': 1.51}

 50%|█████     | 5559/11049 [57:15<56:10,  1.63it/s]
 50%|█████     | 5560/11049 [57:16<56:07,  1.63it/s]
                                                    
{'loss': 0.1991, 'grad_norm': 0.5609529614448547, 'learning_rate': 5.8130486679029216e-06, 'epoch': 1.51}

 50%|█████     | 5560/11049 [57:16<56:07,  1.63it/s]
 50%|█████     | 5561/11049 [57:16<56:06,  1.63it/s]
                                                    
{'loss': 0.2277, 'grad_norm': 0.5338162183761597, 'learning_rate': 5.811490009333662e-06, 'epoch': 1.51}

 50%|█████     | 5561/11049 [57:16<56:06,  1.63it/s]
 50%|█████     | 5562/11049 [57:17<56:06,  1.63it/s]
                                                    
{'loss': 0.1587, 'grad_norm': 0.42769986391067505, 'learning_rate': 5.8099312697689415e-06, 'epoch': 1.51}

 50%|█████     | 5562/11049 [57:17<56:06,  1.63it/s]
 50%|█████     | 5563/11049 [57:18<56:03,  1.63it/s]
                                                    
{'loss': 0.2054, 'grad_norm': 0.5649309158325195, 'learning_rate': 5.8083724493643365e-06, 'epoch': 1.51}

 50%|█████     | 5563/11049 [57:18<56:03,  1.63it/s]
 50%|█████     | 5564/11049 [57:18<56:03,  1.63it/s]
                                                    
{'loss': 0.2245, 'grad_norm': 0.5878615379333496, 'learning_rate': 5.806813548275435e-06, 'epoch': 1.51}

 50%|█████     | 5564/11049 [57:18<56:03,  1.63it/s]
 50%|█████     | 5565/11049 [57:19<56:01,  1.63it/s]
                                                    
{'loss': 0.2064, 'grad_norm': 0.555316686630249, 'learning_rate': 5.8052545666578344e-06, 'epoch': 1.51}

 50%|█████     | 5565/11049 [57:19<56:01,  1.63it/s]
 50%|█████     | 5566/11049 [57:19<56:01,  1.63it/s]
                                                    
{'loss': 0.2199, 'grad_norm': 0.5701894164085388, 'learning_rate': 5.803695504667135e-06, 'epoch': 1.51}

 50%|█████     | 5566/11049 [57:20<56:01,  1.63it/s]
 50%|█████     | 5567/11049 [57:20<56:02,  1.63it/s]
                                                    
{'loss': 0.2279, 'grad_norm': 0.6690571904182434, 'learning_rate': 5.802136362458949e-06, 'epoch': 1.51}

 50%|█████     | 5567/11049 [57:20<56:02,  1.63it/s]
 50%|█████     | 5568/11049 [57:21<56:00,  1.63it/s]
                                                    
{'loss': 0.2154, 'grad_norm': 0.6034716963768005, 'learning_rate': 5.800577140188896e-06, 'epoch': 1.51}

 50%|█████     | 5568/11049 [57:21<56:00,  1.63it/s]
 50%|█████     | 5569/11049 [57:21<55:59,  1.63it/s]
                                                    
{'loss': 0.2144, 'grad_norm': 0.5819652080535889, 'learning_rate': 5.7990178380126026e-06, 'epoch': 1.51}

 50%|█████     | 5569/11049 [57:21<55:59,  1.63it/s]
 50%|█████     | 5570/11049 [57:22<55:58,  1.63it/s]
                                                    
{'loss': 0.1779, 'grad_norm': 0.4495888352394104, 'learning_rate': 5.797458456085704e-06, 'epoch': 1.51}

 50%|█████     | 5570/11049 [57:22<55:58,  1.63it/s]
 50%|█████     | 5571/11049 [57:22<55:57,  1.63it/s]
                                                    
{'loss': 0.1912, 'grad_norm': 0.503230094909668, 'learning_rate': 5.7958989945638455e-06, 'epoch': 1.51}

 50%|█████     | 5571/11049 [57:23<55:57,  1.63it/s]
 50%|█████     | 5572/11049 [57:23<55:57,  1.63it/s]
                                                    
{'loss': 0.2004, 'grad_norm': 0.49867376685142517, 'learning_rate': 5.7943394536026745e-06, 'epoch': 1.51}

 50%|█████     | 5572/11049 [57:23<55:57,  1.63it/s]
 50%|█████     | 5573/11049 [57:24<55:56,  1.63it/s]
                                                    
{'loss': 0.2207, 'grad_norm': 0.526530921459198, 'learning_rate': 5.7927798333578535e-06, 'epoch': 1.51}

 50%|█████     | 5573/11049 [57:24<55:56,  1.63it/s]
 50%|█████     | 5574/11049 [57:24<55:56,  1.63it/s]
                                                    
{'loss': 0.1921, 'grad_norm': 0.5464739203453064, 'learning_rate': 5.791220133985045e-06, 'epoch': 1.51}

 50%|█████     | 5574/11049 [57:24<55:56,  1.63it/s]
 50%|█████     | 5575/11049 [57:25<55:58,  1.63it/s]
                                                    
{'loss': 0.1542, 'grad_norm': 0.436170756816864, 'learning_rate': 5.78966035563993e-06, 'epoch': 1.51}

 50%|█████     | 5575/11049 [57:25<55:58,  1.63it/s]
 50%|█████     | 5576/11049 [57:26<55:56,  1.63it/s]
                                                    
{'loss': 0.2541, 'grad_norm': 0.6434240341186523, 'learning_rate': 5.788100498478186e-06, 'epoch': 1.51}

 50%|█████     | 5576/11049 [57:26<55:56,  1.63it/s]
 50%|█████     | 5577/11049 [57:26<55:57,  1.63it/s]
                                                    
{'loss': 0.2941, 'grad_norm': 0.6597697734832764, 'learning_rate': 5.786540562655507e-06, 'epoch': 1.51}

 50%|█████     | 5577/11049 [57:26<55:57,  1.63it/s]
 50%|█████     | 5578/11049 [57:27<55:54,  1.63it/s]
                                                    
{'loss': 0.2116, 'grad_norm': 0.5306911468505859, 'learning_rate': 5.784980548327588e-06, 'epoch': 1.51}

 50%|█████     | 5578/11049 [57:27<55:54,  1.63it/s]
 50%|█████     | 5579/11049 [57:27<55:53,  1.63it/s]
                                                    
{'loss': 0.2115, 'grad_norm': 0.5324018001556396, 'learning_rate': 5.783420455650138e-06, 'epoch': 1.51}

 50%|█████     | 5579/11049 [57:27<55:53,  1.63it/s]
 51%|█████     | 5580/11049 [57:28<55:51,  1.63it/s]
                                                    
{'loss': 0.1914, 'grad_norm': 0.5490619540214539, 'learning_rate': 5.7818602847788705e-06, 'epoch': 1.52}

 51%|█████     | 5580/11049 [57:28<55:51,  1.63it/s]
 51%|█████     | 5581/11049 [57:29<55:51,  1.63it/s]
                                                    
{'loss': 0.1547, 'grad_norm': 0.45898202061653137, 'learning_rate': 5.780300035869508e-06, 'epoch': 1.52}

 51%|█████     | 5581/11049 [57:29<55:51,  1.63it/s]
 51%|█████     | 5582/11049 [57:29<55:50,  1.63it/s]
                                                    
{'loss': 0.22, 'grad_norm': 0.5862070322036743, 'learning_rate': 5.778739709077777e-06, 'epoch': 1.52}

 51%|█████     | 5582/11049 [57:29<55:50,  1.63it/s]
 51%|█████     | 5583/11049 [57:30<55:50,  1.63it/s]
                                                    
{'loss': 0.2084, 'grad_norm': 0.589396595954895, 'learning_rate': 5.777179304559419e-06, 'epoch': 1.52}

 51%|█████     | 5583/11049 [57:30<55:50,  1.63it/s]
 51%|█████     | 5584/11049 [57:30<55:48,  1.63it/s]
                                                    
{'loss': 0.1954, 'grad_norm': 0.5170031785964966, 'learning_rate': 5.775618822470178e-06, 'epoch': 1.52}

 51%|█████     | 5584/11049 [57:31<55:48,  1.63it/s]
 51%|█████     | 5585/11049 [57:31<55:49,  1.63it/s]
                                                    
{'loss': 0.1922, 'grad_norm': 0.5118535161018372, 'learning_rate': 5.774058262965806e-06, 'epoch': 1.52}

 51%|█████     | 5585/11049 [57:31<55:49,  1.63it/s]
 51%|█████     | 5586/11049 [57:32<55:48,  1.63it/s]
                                                    
{'loss': 0.2396, 'grad_norm': 0.6763774752616882, 'learning_rate': 5.772497626202063e-06, 'epoch': 1.52}

 51%|█████     | 5586/11049 [57:32<55:48,  1.63it/s]
 51%|█████     | 5587/11049 [57:32<55:47,  1.63it/s]
                                                    
{'loss': 0.1973, 'grad_norm': 0.5310490727424622, 'learning_rate': 5.7709369123347205e-06, 'epoch': 1.52}

 51%|█████     | 5587/11049 [57:32<55:47,  1.63it/s]
 51%|█████     | 5588/11049 [57:33<55:48,  1.63it/s]
                                                    
{'loss': 0.2242, 'grad_norm': 0.5721475481987, 'learning_rate': 5.76937612151955e-06, 'epoch': 1.52}

 51%|█████     | 5588/11049 [57:33<55:48,  1.63it/s]
 51%|█████     | 5589/11049 [57:33<55:50,  1.63it/s]
                                                    
{'loss': 0.2152, 'grad_norm': 0.5090310573577881, 'learning_rate': 5.767815253912341e-06, 'epoch': 1.52}

 51%|█████     | 5589/11049 [57:34<55:50,  1.63it/s]
 51%|█████     | 5590/11049 [57:34<55:49,  1.63it/s]
                                                    
{'loss': 0.1832, 'grad_norm': 0.43969905376434326, 'learning_rate': 5.766254309668879e-06, 'epoch': 1.52}

 51%|█████     | 5590/11049 [57:34<55:49,  1.63it/s]
 51%|█████     | 5591/11049 [57:35<55:49,  1.63it/s]
                                                    
{'loss': 0.2356, 'grad_norm': 0.5831996202468872, 'learning_rate': 5.764693288944968e-06, 'epoch': 1.52}

 51%|█████     | 5591/11049 [57:35<55:49,  1.63it/s]
 51%|█████     | 5592/11049 [57:35<55:49,  1.63it/s]
                                                    
{'loss': 0.2128, 'grad_norm': 0.5590693950653076, 'learning_rate': 5.763132191896411e-06, 'epoch': 1.52}

 51%|█████     | 5592/11049 [57:35<55:49,  1.63it/s]
 51%|█████     | 5593/11049 [57:36<55:47,  1.63it/s]
                                                    
{'loss': 0.1828, 'grad_norm': 0.43514278531074524, 'learning_rate': 5.761571018679025e-06, 'epoch': 1.52}

 51%|█████     | 5593/11049 [57:36<55:47,  1.63it/s]
 51%|█████     | 5594/11049 [57:37<55:47,  1.63it/s]
                                                    
{'loss': 0.2315, 'grad_norm': 0.5865384936332703, 'learning_rate': 5.760009769448632e-06, 'epoch': 1.52}

 51%|█████     | 5594/11049 [57:37<55:47,  1.63it/s]
 51%|█████     | 5595/11049 [57:37<55:56,  1.62it/s]
                                                    
{'loss': 0.2241, 'grad_norm': 0.5629382729530334, 'learning_rate': 5.75844844436106e-06, 'epoch': 1.52}

 51%|█████     | 5595/11049 [57:37<55:56,  1.62it/s]
 51%|█████     | 5596/11049 [57:38<55:51,  1.63it/s]
                                                    
{'loss': 0.2115, 'grad_norm': 0.5204055309295654, 'learning_rate': 5.756887043572145e-06, 'epoch': 1.52}

 51%|█████     | 5596/11049 [57:38<55:51,  1.63it/s]
 51%|█████     | 5597/11049 [57:38<55:48,  1.63it/s]
                                                    
{'loss': 0.2384, 'grad_norm': 0.6275317668914795, 'learning_rate': 5.755325567237734e-06, 'epoch': 1.52}

 51%|█████     | 5597/11049 [57:39<55:48,  1.63it/s]
 51%|█████     | 5598/11049 [57:39<55:50,  1.63it/s]
                                                    
{'loss': 0.165, 'grad_norm': 0.48794451355934143, 'learning_rate': 5.753764015513678e-06, 'epoch': 1.52}

 51%|█████     | 5598/11049 [57:39<55:50,  1.63it/s]
 51%|█████     | 5599/11049 [57:40<55:44,  1.63it/s]
                                                    
{'loss': 0.2098, 'grad_norm': 0.5575132966041565, 'learning_rate': 5.752202388555839e-06, 'epoch': 1.52}

 51%|█████     | 5599/11049 [57:40<55:44,  1.63it/s]
 51%|█████     | 5600/11049 [57:40<55:42,  1.63it/s]
                                                    
{'loss': 0.2663, 'grad_norm': 0.6395179033279419, 'learning_rate': 5.750640686520079e-06, 'epoch': 1.52}

 51%|█████     | 5600/11049 [57:40<55:42,  1.63it/s]
 51%|█████     | 5601/11049 [57:41<55:44,  1.63it/s]
                                                    
{'loss': 0.2264, 'grad_norm': 0.563713788986206, 'learning_rate': 5.749078909562279e-06, 'epoch': 1.52}

 51%|█████     | 5601/11049 [57:41<55:44,  1.63it/s]
 51%|█████     | 5602/11049 [57:41<55:41,  1.63it/s]
                                                    
{'loss': 0.313, 'grad_norm': 0.5928830504417419, 'learning_rate': 5.747517057838318e-06, 'epoch': 1.52}

 51%|█████     | 5602/11049 [57:42<55:41,  1.63it/s]
 51%|█████     | 5603/11049 [57:42<55:40,  1.63it/s]
                                                    
{'loss': 0.1839, 'grad_norm': 0.5073349475860596, 'learning_rate': 5.745955131504085e-06, 'epoch': 1.52}

 51%|█████     | 5603/11049 [57:42<55:40,  1.63it/s]
 51%|█████     | 5604/11049 [57:43<55:40,  1.63it/s]
                                                    
{'loss': 0.1819, 'grad_norm': 0.4734715521335602, 'learning_rate': 5.744393130715478e-06, 'epoch': 1.52}

 51%|█████     | 5604/11049 [57:43<55:40,  1.63it/s]
 51%|█████     | 5605/11049 [57:43<55:37,  1.63it/s]
                                                    
{'loss': 0.2384, 'grad_norm': 0.602689802646637, 'learning_rate': 5.742831055628402e-06, 'epoch': 1.52}

 51%|█████     | 5605/11049 [57:43<55:37,  1.63it/s]
 51%|█████     | 5606/11049 [57:44<55:37,  1.63it/s]
                                                    
{'loss': 0.2239, 'grad_norm': 0.6025698781013489, 'learning_rate': 5.741268906398767e-06, 'epoch': 1.52}

 51%|█████     | 5606/11049 [57:44<55:37,  1.63it/s]
 51%|█████     | 5607/11049 [57:45<55:37,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.4926740527153015, 'learning_rate': 5.739706683182496e-06, 'epoch': 1.52}

 51%|█████     | 5607/11049 [57:45<55:37,  1.63it/s]
 51%|█████     | 5608/11049 [57:45<55:35,  1.63it/s]
                                                    
{'loss': 0.1614, 'grad_norm': 0.44437432289123535, 'learning_rate': 5.738144386135513e-06, 'epoch': 1.52}

 51%|█████     | 5608/11049 [57:45<55:35,  1.63it/s]
 51%|█████     | 5609/11049 [57:46<55:34,  1.63it/s]
                                                    
{'loss': 0.1613, 'grad_norm': 0.47193533182144165, 'learning_rate': 5.736582015413752e-06, 'epoch': 1.52}

 51%|█████     | 5609/11049 [57:46<55:34,  1.63it/s]
 51%|█████     | 5610/11049 [57:46<55:34,  1.63it/s]
                                                    
{'loss': 0.1964, 'grad_norm': 0.49605149030685425, 'learning_rate': 5.735019571173155e-06, 'epoch': 1.52}

 51%|█████     | 5610/11049 [57:47<55:34,  1.63it/s]
 51%|█████     | 5611/11049 [57:47<55:36,  1.63it/s]
                                                    
{'loss': 0.2206, 'grad_norm': 0.5505457520484924, 'learning_rate': 5.733457053569671e-06, 'epoch': 1.52}

 51%|█████     | 5611/11049 [57:47<55:36,  1.63it/s]
 51%|█████     | 5612/11049 [57:48<55:34,  1.63it/s]
                                                    
{'loss': 0.185, 'grad_norm': 0.5045510530471802, 'learning_rate': 5.731894462759258e-06, 'epoch': 1.52}

 51%|█████     | 5612/11049 [57:48<55:34,  1.63it/s]
 51%|█████     | 5613/11049 [57:48<55:34,  1.63it/s]
                                                    
{'loss': 0.2246, 'grad_norm': 0.5660306811332703, 'learning_rate': 5.730331798897876e-06, 'epoch': 1.52}

 51%|█████     | 5613/11049 [57:48<55:34,  1.63it/s]
 51%|█████     | 5614/11049 [57:49<55:34,  1.63it/s]
                                                    
{'loss': 0.2929, 'grad_norm': 0.603786826133728, 'learning_rate': 5.728769062141497e-06, 'epoch': 1.52}

 51%|█████     | 5614/11049 [57:49<55:34,  1.63it/s]
 51%|█████     | 5615/11049 [57:49<55:32,  1.63it/s]
                                                    
{'loss': 0.2256, 'grad_norm': 0.6245877146720886, 'learning_rate': 5.7272062526461e-06, 'epoch': 1.52}

 51%|█████     | 5615/11049 [57:50<55:32,  1.63it/s]
 51%|█████     | 5616/11049 [57:50<55:33,  1.63it/s]
                                                    
{'loss': 0.1999, 'grad_norm': 0.5405539870262146, 'learning_rate': 5.72564337056767e-06, 'epoch': 1.52}

 51%|█████     | 5616/11049 [57:50<55:33,  1.63it/s]
 51%|█████     | 5617/11049 [57:51<55:32,  1.63it/s]
                                                    
{'loss': 0.2092, 'grad_norm': 0.6206336617469788, 'learning_rate': 5.724080416062198e-06, 'epoch': 1.53}

 51%|█████     | 5617/11049 [57:51<55:32,  1.63it/s]
 51%|█████     | 5618/11049 [57:51<55:32,  1.63it/s]
                                                    
{'loss': 0.2516, 'grad_norm': 0.5929813981056213, 'learning_rate': 5.722517389285685e-06, 'epoch': 1.53}

 51%|█████     | 5618/11049 [57:51<55:32,  1.63it/s]
 51%|█████     | 5619/11049 [57:52<55:30,  1.63it/s]
                                                    
{'loss': 0.1863, 'grad_norm': 0.5266057848930359, 'learning_rate': 5.720954290394137e-06, 'epoch': 1.53}

 51%|█████     | 5619/11049 [57:52<55:30,  1.63it/s]
 51%|█████     | 5620/11049 [57:53<55:29,  1.63it/s]
                                                    
{'loss': 0.2015, 'grad_norm': 0.5752109289169312, 'learning_rate': 5.71939111954357e-06, 'epoch': 1.53}

 51%|█████     | 5620/11049 [57:53<55:29,  1.63it/s]
 51%|█████     | 5621/11049 [57:53<55:29,  1.63it/s]
                                                    
{'loss': 0.238, 'grad_norm': 0.5719152688980103, 'learning_rate': 5.717827876890004e-06, 'epoch': 1.53}

 51%|█████     | 5621/11049 [57:53<55:29,  1.63it/s]
 51%|█████     | 5622/11049 [57:54<55:30,  1.63it/s]
                                                    
{'loss': 0.2054, 'grad_norm': 0.5278688669204712, 'learning_rate': 5.716264562589466e-06, 'epoch': 1.53}

 51%|█████     | 5622/11049 [57:54<55:30,  1.63it/s]
 51%|█████     | 5623/11049 [57:54<55:28,  1.63it/s]
                                                    
{'loss': 0.2142, 'grad_norm': 0.5334541201591492, 'learning_rate': 5.714701176797995e-06, 'epoch': 1.53}

 51%|█████     | 5623/11049 [57:54<55:28,  1.63it/s]
 51%|█████     | 5624/11049 [57:55<55:26,  1.63it/s]
                                                    
{'loss': 0.2047, 'grad_norm': 0.5922707915306091, 'learning_rate': 5.713137719671631e-06, 'epoch': 1.53}

 51%|█████     | 5624/11049 [57:55<55:26,  1.63it/s]
 51%|█████     | 5625/11049 [57:56<55:26,  1.63it/s]
                                                    
{'loss': 0.1673, 'grad_norm': 0.4593181312084198, 'learning_rate': 5.711574191366427e-06, 'epoch': 1.53}

 51%|█████     | 5625/11049 [57:56<55:26,  1.63it/s]
 51%|█████     | 5626/11049 [57:56<55:25,  1.63it/s]
                                                    
{'loss': 0.1954, 'grad_norm': 0.5020883083343506, 'learning_rate': 5.7100105920384365e-06, 'epoch': 1.53}

 51%|█████     | 5626/11049 [57:56<55:25,  1.63it/s]
 51%|█████     | 5627/11049 [57:57<55:25,  1.63it/s]
                                                    
{'loss': 0.2101, 'grad_norm': 0.5868186354637146, 'learning_rate': 5.708446921843724e-06, 'epoch': 1.53}

 51%|█████     | 5627/11049 [57:57<55:25,  1.63it/s]
 51%|█████     | 5628/11049 [57:57<55:25,  1.63it/s]
                                                    
{'loss': 0.1817, 'grad_norm': 0.4944384694099426, 'learning_rate': 5.7068831809383625e-06, 'epoch': 1.53}

 51%|█████     | 5628/11049 [57:58<55:25,  1.63it/s]
 51%|█████     | 5629/11049 [57:58<55:24,  1.63it/s]
                                                    
{'loss': 0.2132, 'grad_norm': 0.5376605987548828, 'learning_rate': 5.70531936947843e-06, 'epoch': 1.53}

 51%|█████     | 5629/11049 [57:58<55:24,  1.63it/s]
 51%|█████     | 5630/11049 [57:59<55:23,  1.63it/s]
                                                    
{'loss': 0.2189, 'grad_norm': 0.578141450881958, 'learning_rate': 5.7037554876200115e-06, 'epoch': 1.53}

 51%|█████     | 5630/11049 [57:59<55:23,  1.63it/s]
 51%|█████     | 5631/11049 [57:59<55:24,  1.63it/s]
                                                    
{'loss': 0.194, 'grad_norm': 0.503769040107727, 'learning_rate': 5.7021915355191996e-06, 'epoch': 1.53}

 51%|█████     | 5631/11049 [57:59<55:24,  1.63it/s]
 51%|█████     | 5632/11049 [58:00<55:23,  1.63it/s]
                                                    
{'loss': 0.176, 'grad_norm': 0.5337768197059631, 'learning_rate': 5.7006275133320906e-06, 'epoch': 1.53}

 51%|█████     | 5632/11049 [58:00<55:23,  1.63it/s]
 51%|█████     | 5633/11049 [58:00<55:22,  1.63it/s]
                                                    
{'loss': 0.2512, 'grad_norm': 0.5743380784988403, 'learning_rate': 5.699063421214794e-06, 'epoch': 1.53}

 51%|█████     | 5633/11049 [58:01<55:22,  1.63it/s]
 51%|█████     | 5634/11049 [58:01<55:25,  1.63it/s]
                                                    
{'loss': 0.1726, 'grad_norm': 0.4857073426246643, 'learning_rate': 5.6974992593234235e-06, 'epoch': 1.53}

 51%|█████     | 5634/11049 [58:01<55:25,  1.63it/s]
 51%|█████     | 5635/11049 [58:02<55:24,  1.63it/s]
                                                    
{'loss': 0.3144, 'grad_norm': 0.6790599226951599, 'learning_rate': 5.695935027814098e-06, 'epoch': 1.53}

 51%|█████     | 5635/11049 [58:02<55:24,  1.63it/s]
 51%|█████     | 5636/11049 [58:02<55:22,  1.63it/s]
                                                    
{'loss': 0.1926, 'grad_norm': 0.42958036065101624, 'learning_rate': 5.694370726842943e-06, 'epoch': 1.53}

 51%|█████     | 5636/11049 [58:02<55:22,  1.63it/s]
 51%|█████     | 5637/11049 [58:03<55:20,  1.63it/s]
                                                    
{'loss': 0.2339, 'grad_norm': 0.7195008993148804, 'learning_rate': 5.6928063565660955e-06, 'epoch': 1.53}

 51%|█████     | 5637/11049 [58:03<55:20,  1.63it/s]
 51%|█████     | 5638/11049 [58:04<55:20,  1.63it/s]
                                                    
{'loss': 0.1496, 'grad_norm': 0.4716675281524658, 'learning_rate': 5.691241917139696e-06, 'epoch': 1.53}

 51%|█████     | 5638/11049 [58:04<55:20,  1.63it/s]
 51%|█████     | 5639/11049 [58:04<55:19,  1.63it/s]
                                                    
{'loss': 0.1785, 'grad_norm': 0.4815792441368103, 'learning_rate': 5.689677408719892e-06, 'epoch': 1.53}

 51%|█████     | 5639/11049 [58:04<55:19,  1.63it/s]
 51%|█████     | 5640/11049 [58:05<55:19,  1.63it/s]
                                                    
{'loss': 0.2525, 'grad_norm': 0.6153025031089783, 'learning_rate': 5.688112831462836e-06, 'epoch': 1.53}

 51%|█████     | 5640/11049 [58:05<55:19,  1.63it/s]
 51%|█████     | 5641/11049 [58:05<55:19,  1.63it/s]
                                                    
{'loss': 0.1687, 'grad_norm': 0.4792863726615906, 'learning_rate': 5.686548185524694e-06, 'epoch': 1.53}

 51%|█████     | 5641/11049 [58:06<55:19,  1.63it/s]
 51%|█████     | 5642/11049 [58:06<55:17,  1.63it/s]
                                                    
{'loss': 0.1961, 'grad_norm': 0.5451179146766663, 'learning_rate': 5.6849834710616315e-06, 'epoch': 1.53}

 51%|█████     | 5642/11049 [58:06<55:17,  1.63it/s]
 51%|█████     | 5643/11049 [58:07<55:16,  1.63it/s]
                                                    
{'loss': 0.2005, 'grad_norm': 0.5126177072525024, 'learning_rate': 5.683418688229826e-06, 'epoch': 1.53}

 51%|█████     | 5643/11049 [58:07<55:16,  1.63it/s]
 51%|█████     | 5644/11049 [58:07<55:14,  1.63it/s]
                                                    
{'loss': 0.2502, 'grad_norm': 0.6486908793449402, 'learning_rate': 5.681853837185457e-06, 'epoch': 1.53}

 51%|█████     | 5644/11049 [58:07<55:14,  1.63it/s]
 51%|█████     | 5645/11049 [58:08<55:14,  1.63it/s]
                                                    
{'loss': 0.2232, 'grad_norm': 0.5721597671508789, 'learning_rate': 5.680288918084716e-06, 'epoch': 1.53}

 51%|█████     | 5645/11049 [58:08<55:14,  1.63it/s]
 51%|█████     | 5646/11049 [58:08<55:14,  1.63it/s]
                                                    
{'loss': 0.2313, 'grad_norm': 0.5395997166633606, 'learning_rate': 5.678723931083798e-06, 'epoch': 1.53}

 51%|█████     | 5646/11049 [58:09<55:14,  1.63it/s]
 51%|█████     | 5647/11049 [58:09<55:13,  1.63it/s]
                                                    
{'loss': 0.2295, 'grad_norm': 0.5483216643333435, 'learning_rate': 5.6771588763389054e-06, 'epoch': 1.53}

 51%|█████     | 5647/11049 [58:09<55:13,  1.63it/s]
 51%|█████     | 5648/11049 [58:10<55:11,  1.63it/s]
                                                    
{'loss': 0.2315, 'grad_norm': 0.6159548759460449, 'learning_rate': 5.675593754006248e-06, 'epoch': 1.53}

 51%|█████     | 5648/11049 [58:10<55:11,  1.63it/s]
 51%|█████     | 5649/11049 [58:10<55:12,  1.63it/s]
                                                    
{'loss': 0.1971, 'grad_norm': 0.49140700697898865, 'learning_rate': 5.674028564242042e-06, 'epoch': 1.53}

 51%|█████     | 5649/11049 [58:10<55:12,  1.63it/s]
 51%|█████     | 5650/11049 [58:11<55:11,  1.63it/s]
                                                    
{'loss': 0.2327, 'grad_norm': 0.5729228258132935, 'learning_rate': 5.672463307202508e-06, 'epoch': 1.53}

 51%|█████     | 5650/11049 [58:11<55:11,  1.63it/s]
 51%|█████     | 5651/11049 [58:12<55:10,  1.63it/s]
                                                    
{'loss': 0.1734, 'grad_norm': 0.561893880367279, 'learning_rate': 5.670897983043879e-06, 'epoch': 1.53}

 51%|█████     | 5651/11049 [58:12<55:10,  1.63it/s]
 51%|█████     | 5652/11049 [58:12<55:09,  1.63it/s]
                                                    
{'loss': 0.1923, 'grad_norm': 0.4838007986545563, 'learning_rate': 5.6693325919223895e-06, 'epoch': 1.53}

 51%|█████     | 5652/11049 [58:12<55:09,  1.63it/s]
 51%|█████     | 5653/11049 [58:13<55:09,  1.63it/s]
                                                    
{'loss': 0.2089, 'grad_norm': 0.5049974918365479, 'learning_rate': 5.667767133994282e-06, 'epoch': 1.53}

 51%|█████     | 5653/11049 [58:13<55:09,  1.63it/s]
 51%|█████     | 5654/11049 [58:13<55:09,  1.63it/s]
                                                    
{'loss': 0.198, 'grad_norm': 0.5628012418746948, 'learning_rate': 5.666201609415807e-06, 'epoch': 1.54}

 51%|█████     | 5654/11049 [58:14<55:09,  1.63it/s]
 51%|█████     | 5655/11049 [58:14<55:08,  1.63it/s]
                                                    
{'loss': 0.2087, 'grad_norm': 0.6163896918296814, 'learning_rate': 5.664636018343219e-06, 'epoch': 1.54}

 51%|█████     | 5655/11049 [58:14<55:08,  1.63it/s]
 51%|█████     | 5656/11049 [58:15<55:08,  1.63it/s]
                                                    
{'loss': 0.2122, 'grad_norm': 0.5538451075553894, 'learning_rate': 5.663070360932784e-06, 'epoch': 1.54}

 51%|█████     | 5656/11049 [58:15<55:08,  1.63it/s]
 51%|█████     | 5657/11049 [58:15<55:06,  1.63it/s]
                                                    
{'loss': 0.2139, 'grad_norm': 0.5753725171089172, 'learning_rate': 5.66150463734077e-06, 'epoch': 1.54}

 51%|█████     | 5657/11049 [58:15<55:06,  1.63it/s]
 51%|█████     | 5658/11049 [58:16<55:06,  1.63it/s]
                                                    
{'loss': 0.1933, 'grad_norm': 0.5343658924102783, 'learning_rate': 5.6599388477234515e-06, 'epoch': 1.54}

 51%|█████     | 5658/11049 [58:16<55:06,  1.63it/s]
 51%|█████     | 5659/11049 [58:16<55:04,  1.63it/s]
                                                    
{'loss': 0.2115, 'grad_norm': 0.5510223507881165, 'learning_rate': 5.6583729922371135e-06, 'epoch': 1.54}

 51%|█████     | 5659/11049 [58:17<55:04,  1.63it/s]
 51%|█████     | 5660/11049 [58:17<55:04,  1.63it/s]
                                                    
{'loss': 0.2194, 'grad_norm': 0.667166531085968, 'learning_rate': 5.656807071038043e-06, 'epoch': 1.54}

 51%|█████     | 5660/11049 [58:17<55:04,  1.63it/s]
 51%|█████     | 5661/11049 [58:18<55:04,  1.63it/s]
                                                    
{'loss': 0.1795, 'grad_norm': 0.514197826385498, 'learning_rate': 5.65524108428254e-06, 'epoch': 1.54}

 51%|█████     | 5661/11049 [58:18<55:04,  1.63it/s]
 51%|█████     | 5662/11049 [58:18<55:03,  1.63it/s]
                                                    
{'loss': 0.1859, 'grad_norm': 0.5277185440063477, 'learning_rate': 5.6536750321269014e-06, 'epoch': 1.54}

 51%|█████     | 5662/11049 [58:18<55:03,  1.63it/s]
 51%|█████▏    | 5663/11049 [58:19<55:02,  1.63it/s]
                                                    
{'loss': 0.2055, 'grad_norm': 0.6131964325904846, 'learning_rate': 5.65210891472744e-06, 'epoch': 1.54}

 51%|█████▏    | 5663/11049 [58:19<55:02,  1.63it/s]
 51%|█████▏    | 5664/11049 [58:20<55:02,  1.63it/s]
                                                    
{'loss': 0.1787, 'grad_norm': 0.46252256631851196, 'learning_rate': 5.650542732240469e-06, 'epoch': 1.54}

 51%|█████▏    | 5664/11049 [58:20<55:02,  1.63it/s]
 51%|█████▏    | 5665/11049 [58:20<55:01,  1.63it/s]
                                                    
{'loss': 0.2159, 'grad_norm': 0.6181107759475708, 'learning_rate': 5.648976484822313e-06, 'epoch': 1.54}

 51%|█████▏    | 5665/11049 [58:20<55:01,  1.63it/s]
 51%|█████▏    | 5666/11049 [58:21<55:02,  1.63it/s]
                                                    
{'loss': 0.2047, 'grad_norm': 0.5006170868873596, 'learning_rate': 5.6474101726292984e-06, 'epoch': 1.54}

 51%|█████▏    | 5666/11049 [58:21<55:02,  1.63it/s]
 51%|█████▏    | 5667/11049 [58:21<54:59,  1.63it/s]
                                                    
{'loss': 0.2126, 'grad_norm': 0.6774604320526123, 'learning_rate': 5.64584379581776e-06, 'epoch': 1.54}

 51%|█████▏    | 5667/11049 [58:21<54:59,  1.63it/s]
 51%|█████▏    | 5668/11049 [58:22<54:57,  1.63it/s]
                                                    
{'loss': 0.234, 'grad_norm': 0.555780827999115, 'learning_rate': 5.644277354544039e-06, 'epoch': 1.54}

 51%|█████▏    | 5668/11049 [58:22<54:57,  1.63it/s]
 51%|█████▏    | 5669/11049 [58:23<54:58,  1.63it/s]
                                                    
{'loss': 0.1625, 'grad_norm': 0.4842192530632019, 'learning_rate': 5.642710848964485e-06, 'epoch': 1.54}

 51%|█████▏    | 5669/11049 [58:23<54:58,  1.63it/s]
 51%|█████▏    | 5670/11049 [58:23<54:58,  1.63it/s]
                                                    
{'loss': 0.2035, 'grad_norm': 0.5736004710197449, 'learning_rate': 5.64114427923545e-06, 'epoch': 1.54}

 51%|█████▏    | 5670/11049 [58:23<54:58,  1.63it/s]
 51%|█████▏    | 5671/11049 [58:24<54:57,  1.63it/s]
                                                    
{'loss': 0.1677, 'grad_norm': 0.45266619324684143, 'learning_rate': 5.6395776455132955e-06, 'epoch': 1.54}

 51%|█████▏    | 5671/11049 [58:24<54:57,  1.63it/s]
 51%|█████▏    | 5672/11049 [58:24<54:56,  1.63it/s]
                                                    
{'loss': 0.2104, 'grad_norm': 0.5395084619522095, 'learning_rate': 5.638010947954388e-06, 'epoch': 1.54}

 51%|█████▏    | 5672/11049 [58:25<54:56,  1.63it/s]
 51%|█████▏    | 5673/11049 [58:25<54:54,  1.63it/s]
                                                    
{'loss': 0.2253, 'grad_norm': 0.6131071448326111, 'learning_rate': 5.636444186715101e-06, 'epoch': 1.54}

 51%|█████▏    | 5673/11049 [58:25<54:54,  1.63it/s]
 51%|█████▏    | 5674/11049 [58:26<54:55,  1.63it/s]
                                                    
{'loss': 0.2577, 'grad_norm': 0.6246507167816162, 'learning_rate': 5.634877361951816e-06, 'epoch': 1.54}

 51%|█████▏    | 5674/11049 [58:26<54:55,  1.63it/s]
 51%|█████▏    | 5675/11049 [58:26<54:55,  1.63it/s]
                                                    
{'loss': 0.1872, 'grad_norm': 0.4878256916999817, 'learning_rate': 5.6333104738209165e-06, 'epoch': 1.54}

 51%|█████▏    | 5675/11049 [58:26<54:55,  1.63it/s]
 51%|█████▏    | 5676/11049 [58:27<54:55,  1.63it/s]
                                                    
{'loss': 0.2095, 'grad_norm': 0.5361782312393188, 'learning_rate': 5.631743522478795e-06, 'epoch': 1.54}

 51%|█████▏    | 5676/11049 [58:27<54:55,  1.63it/s]
 51%|█████▏    | 5677/11049 [58:27<54:55,  1.63it/s]
                                                    
{'loss': 0.1988, 'grad_norm': 0.5967264175415039, 'learning_rate': 5.63017650808185e-06, 'epoch': 1.54}

 51%|█████▏    | 5677/11049 [58:28<54:55,  1.63it/s]
 51%|█████▏    | 5678/11049 [58:28<54:56,  1.63it/s]
                                                    
{'loss': 0.2562, 'grad_norm': 0.6180450916290283, 'learning_rate': 5.628609430786489e-06, 'epoch': 1.54}

 51%|█████▏    | 5678/11049 [58:28<54:56,  1.63it/s]
 51%|█████▏    | 5679/11049 [58:29<54:53,  1.63it/s]
                                                    
{'loss': 0.2649, 'grad_norm': 0.6192799806594849, 'learning_rate': 5.627042290749123e-06, 'epoch': 1.54}

 51%|█████▏    | 5679/11049 [58:29<54:53,  1.63it/s]
 51%|█████▏    | 5680/11049 [58:29<54:53,  1.63it/s]
                                                    
{'loss': 0.2372, 'grad_norm': 0.6269034743309021, 'learning_rate': 5.625475088126166e-06, 'epoch': 1.54}

 51%|█████▏    | 5680/11049 [58:29<54:53,  1.63it/s]
 51%|█████▏    | 5681/11049 [58:30<54:52,  1.63it/s]
                                                    
{'loss': 0.207, 'grad_norm': 0.5598764419555664, 'learning_rate': 5.623907823074044e-06, 'epoch': 1.54}

 51%|█████▏    | 5681/11049 [58:30<54:52,  1.63it/s]
 51%|█████▏    | 5682/11049 [58:31<54:51,  1.63it/s]
                                                    
{'loss': 0.2654, 'grad_norm': 0.6627593040466309, 'learning_rate': 5.622340495749187e-06, 'epoch': 1.54}

 51%|█████▏    | 5682/11049 [58:31<54:51,  1.63it/s]
 51%|█████▏    | 5683/11049 [58:31<54:51,  1.63it/s]
                                                    
{'loss': 0.1727, 'grad_norm': 0.5521000027656555, 'learning_rate': 5.62077310630803e-06, 'epoch': 1.54}

 51%|█████▏    | 5683/11049 [58:31<54:51,  1.63it/s]
 51%|█████▏    | 5684/11049 [58:32<54:50,  1.63it/s]
                                                    
{'loss': 0.1997, 'grad_norm': 0.5720518827438354, 'learning_rate': 5.619205654907018e-06, 'epoch': 1.54}

 51%|█████▏    | 5684/11049 [58:32<54:50,  1.63it/s]
 51%|█████▏    | 5685/11049 [58:32<54:47,  1.63it/s]
                                                    
{'loss': 0.1858, 'grad_norm': 0.4774181544780731, 'learning_rate': 5.617638141702598e-06, 'epoch': 1.54}

 51%|█████▏    | 5685/11049 [58:33<54:47,  1.63it/s]
 51%|█████▏    | 5686/11049 [58:33<54:47,  1.63it/s]
                                                    
{'loss': 0.2043, 'grad_norm': 0.639771044254303, 'learning_rate': 5.616070566851223e-06, 'epoch': 1.54}

 51%|█████▏    | 5686/11049 [58:33<54:47,  1.63it/s]
 51%|█████▏    | 5687/11049 [58:34<54:47,  1.63it/s]
                                                    
{'loss': 0.2226, 'grad_norm': 0.6018191576004028, 'learning_rate': 5.614502930509357e-06, 'epoch': 1.54}

 51%|█████▏    | 5687/11049 [58:34<54:47,  1.63it/s]
 51%|█████▏    | 5688/11049 [58:34<54:46,  1.63it/s]
                                                    
{'loss': 0.1752, 'grad_norm': 0.4510246217250824, 'learning_rate': 5.612935232833465e-06, 'epoch': 1.54}

 51%|█████▏    | 5688/11049 [58:34<54:46,  1.63it/s]
 51%|█████▏    | 5689/11049 [58:35<54:46,  1.63it/s]
                                                    
{'loss': 0.1888, 'grad_norm': 0.44773614406585693, 'learning_rate': 5.611367473980022e-06, 'epoch': 1.54}

 51%|█████▏    | 5689/11049 [58:35<54:46,  1.63it/s]
 51%|█████▏    | 5690/11049 [58:35<54:45,  1.63it/s]
                                                    
{'loss': 0.274, 'grad_norm': 0.6925255656242371, 'learning_rate': 5.609799654105503e-06, 'epoch': 1.54}

 51%|█████▏    | 5690/11049 [58:36<54:45,  1.63it/s]
 52%|█████▏    | 5691/11049 [58:36<54:46,  1.63it/s]
                                                    
{'loss': 0.1824, 'grad_norm': 0.43530380725860596, 'learning_rate': 5.608231773366399e-06, 'epoch': 1.55}

 52%|█████▏    | 5691/11049 [58:36<54:46,  1.63it/s]
 52%|█████▏    | 5692/11049 [58:37<54:44,  1.63it/s]
                                                    
{'loss': 0.1955, 'grad_norm': 0.5486118793487549, 'learning_rate': 5.606663831919198e-06, 'epoch': 1.55}

 52%|█████▏    | 5692/11049 [58:37<54:44,  1.63it/s]
 52%|█████▏    | 5693/11049 [58:37<54:44,  1.63it/s]
                                                    
{'loss': 0.2066, 'grad_norm': 0.505341112613678, 'learning_rate': 5.6050958299203995e-06, 'epoch': 1.55}

 52%|█████▏    | 5693/11049 [58:37<54:44,  1.63it/s]
 52%|█████▏    | 5694/11049 [58:38<54:43,  1.63it/s]
                                                    
{'loss': 0.2497, 'grad_norm': 0.5947741866111755, 'learning_rate': 5.603527767526503e-06, 'epoch': 1.55}

 52%|█████▏    | 5694/11049 [58:38<54:43,  1.63it/s]
 52%|█████▏    | 5695/11049 [58:39<54:43,  1.63it/s]
                                                    
{'loss': 0.3285, 'grad_norm': 0.6769818663597107, 'learning_rate': 5.6019596448940226e-06, 'epoch': 1.55}

 52%|█████▏    | 5695/11049 [58:39<54:43,  1.63it/s]
 52%|█████▏    | 5696/11049 [58:39<54:44,  1.63it/s]
                                                    
{'loss': 0.2339, 'grad_norm': 0.6609101295471191, 'learning_rate': 5.6003914621794705e-06, 'epoch': 1.55}

 52%|█████▏    | 5696/11049 [58:39<54:44,  1.63it/s]
 52%|█████▏    | 5697/11049 [58:40<54:42,  1.63it/s]
                                                    
{'loss': 0.2533, 'grad_norm': 0.6784482002258301, 'learning_rate': 5.598823219539373e-06, 'epoch': 1.55}

 52%|█████▏    | 5697/11049 [58:40<54:42,  1.63it/s]
 52%|█████▏    | 5698/11049 [58:40<54:40,  1.63it/s]
                                                    
{'loss': 0.2042, 'grad_norm': 0.48044365644454956, 'learning_rate': 5.597254917130251e-06, 'epoch': 1.55}

 52%|█████▏    | 5698/11049 [58:40<54:40,  1.63it/s]
 52%|█████▏    | 5699/11049 [58:41<54:39,  1.63it/s]
                                                    
{'loss': 0.2057, 'grad_norm': 0.550071656703949, 'learning_rate': 5.595686555108644e-06, 'epoch': 1.55}

 52%|█████▏    | 5699/11049 [58:41<54:39,  1.63it/s]
 52%|█████▏    | 5700/11049 [58:42<54:39,  1.63it/s]
                                                    
{'loss': 0.2596, 'grad_norm': 0.7071352601051331, 'learning_rate': 5.594118133631087e-06, 'epoch': 1.55}

 52%|█████▏    | 5700/11049 [58:42<54:39,  1.63it/s]
 52%|█████▏    | 5701/11049 [58:42<54:39,  1.63it/s]
                                                    
{'loss': 0.1615, 'grad_norm': 0.5046417713165283, 'learning_rate': 5.592549652854129e-06, 'epoch': 1.55}

 52%|█████▏    | 5701/11049 [58:42<54:39,  1.63it/s]
 52%|█████▏    | 5702/11049 [58:43<54:39,  1.63it/s]
                                                    
{'loss': 0.222, 'grad_norm': 0.5885224938392639, 'learning_rate': 5.590981112934319e-06, 'epoch': 1.55}

 52%|█████▏    | 5702/11049 [58:43<54:39,  1.63it/s]
 52%|█████▏    | 5703/11049 [58:43<54:37,  1.63it/s]
                                                    
{'loss': 0.258, 'grad_norm': 0.6146769523620605, 'learning_rate': 5.589412514028215e-06, 'epoch': 1.55}

 52%|█████▏    | 5703/11049 [58:44<54:37,  1.63it/s]
 52%|█████▏    | 5704/11049 [58:44<54:35,  1.63it/s]
                                                    
{'loss': 0.2057, 'grad_norm': 0.5334696769714355, 'learning_rate': 5.587843856292379e-06, 'epoch': 1.55}

 52%|█████▏    | 5704/11049 [58:44<54:35,  1.63it/s]
 52%|█████▏    | 5705/11049 [58:45<54:35,  1.63it/s]
                                                    
{'loss': 0.1467, 'grad_norm': 0.47886624932289124, 'learning_rate': 5.5862751398833824e-06, 'epoch': 1.55}

 52%|█████▏    | 5705/11049 [58:45<54:35,  1.63it/s]
 52%|█████▏    | 5706/11049 [58:45<54:35,  1.63it/s]
                                                    
{'loss': 0.21, 'grad_norm': 0.5403720736503601, 'learning_rate': 5.5847063649577985e-06, 'epoch': 1.55}

 52%|█████▏    | 5706/11049 [58:45<54:35,  1.63it/s]
 52%|█████▏    | 5707/11049 [58:46<54:35,  1.63it/s]
                                                    
{'loss': 0.2553, 'grad_norm': 0.6392292976379395, 'learning_rate': 5.583137531672207e-06, 'epoch': 1.55}

 52%|█████▏    | 5707/11049 [58:46<54:35,  1.63it/s]
 52%|█████▏    | 5708/11049 [58:46<54:34,  1.63it/s]
                                                    
{'loss': 0.2048, 'grad_norm': 0.534730851650238, 'learning_rate': 5.581568640183196e-06, 'epoch': 1.55}

 52%|█████▏    | 5708/11049 [58:47<54:34,  1.63it/s]
 52%|█████▏    | 5709/11049 [58:47<54:33,  1.63it/s]
                                                    
{'loss': 0.1789, 'grad_norm': 0.48428526520729065, 'learning_rate': 5.579999690647357e-06, 'epoch': 1.55}

 52%|█████▏    | 5709/11049 [58:47<54:33,  1.63it/s]
 52%|█████▏    | 5710/11049 [58:48<54:31,  1.63it/s]
                                                    
{'loss': 0.1468, 'grad_norm': 0.41071590781211853, 'learning_rate': 5.5784306832212885e-06, 'epoch': 1.55}

 52%|█████▏    | 5710/11049 [58:48<54:31,  1.63it/s]
 52%|█████▏    | 5711/11049 [58:48<54:31,  1.63it/s]
                                                    
{'loss': 0.2144, 'grad_norm': 0.5368450880050659, 'learning_rate': 5.576861618061596e-06, 'epoch': 1.55}

 52%|█████▏    | 5711/11049 [58:48<54:31,  1.63it/s]
 52%|█████▏    | 5712/11049 [58:49<54:31,  1.63it/s]
                                                    
{'loss': 0.1832, 'grad_norm': 0.5532564520835876, 'learning_rate': 5.575292495324883e-06, 'epoch': 1.55}

 52%|█████▏    | 5712/11049 [58:49<54:31,  1.63it/s]
 52%|█████▏    | 5713/11049 [58:50<54:31,  1.63it/s]
                                                    
{'loss': 0.2016, 'grad_norm': 0.5761442184448242, 'learning_rate': 5.573723315167773e-06, 'epoch': 1.55}

 52%|█████▏    | 5713/11049 [58:50<54:31,  1.63it/s]
 52%|█████▏    | 5714/11049 [58:50<54:30,  1.63it/s]
                                                    
{'loss': 0.1896, 'grad_norm': 0.5566204786300659, 'learning_rate': 5.572154077746882e-06, 'epoch': 1.55}

 52%|█████▏    | 5714/11049 [58:50<54:30,  1.63it/s]
 52%|█████▏    | 5715/11049 [58:51<54:30,  1.63it/s]
                                                    
{'loss': 0.2387, 'grad_norm': 0.615400493144989, 'learning_rate': 5.570584783218839e-06, 'epoch': 1.55}

 52%|█████▏    | 5715/11049 [58:51<54:30,  1.63it/s]
 52%|█████▏    | 5716/11049 [58:51<54:29,  1.63it/s]
                                                    
{'loss': 0.2038, 'grad_norm': 0.5066112875938416, 'learning_rate': 5.569015431740275e-06, 'epoch': 1.55}

 52%|█████▏    | 5716/11049 [58:52<54:29,  1.63it/s]
 52%|█████▏    | 5717/11049 [58:52<54:29,  1.63it/s]
                                                    
{'loss': 0.205, 'grad_norm': 0.6071010828018188, 'learning_rate': 5.567446023467828e-06, 'epoch': 1.55}

 52%|█████▏    | 5717/11049 [58:52<54:29,  1.63it/s]
 52%|█████▏    | 5718/11049 [58:53<54:30,  1.63it/s]
                                                    
{'loss': 0.2013, 'grad_norm': 0.5448998212814331, 'learning_rate': 5.565876558558144e-06, 'epoch': 1.55}

 52%|█████▏    | 5718/11049 [58:53<54:30,  1.63it/s]
 52%|█████▏    | 5719/11049 [58:53<54:30,  1.63it/s]
                                                    
{'loss': 0.2215, 'grad_norm': 0.6129276752471924, 'learning_rate': 5.564307037167873e-06, 'epoch': 1.55}

 52%|█████▏    | 5719/11049 [58:53<54:30,  1.63it/s]
 52%|█████▏    | 5720/11049 [58:54<54:29,  1.63it/s]
                                                    
{'loss': 0.2189, 'grad_norm': 0.5992164611816406, 'learning_rate': 5.5627374594536655e-06, 'epoch': 1.55}

 52%|█████▏    | 5720/11049 [58:54<54:29,  1.63it/s]
 52%|█████▏    | 5721/11049 [58:54<54:29,  1.63it/s]
                                                    
{'loss': 0.205, 'grad_norm': 0.6059808731079102, 'learning_rate': 5.561167825572187e-06, 'epoch': 1.55}

 52%|█████▏    | 5721/11049 [58:55<54:29,  1.63it/s]
 52%|█████▏    | 5722/11049 [58:55<54:27,  1.63it/s]
                                                    
{'loss': 0.239, 'grad_norm': 0.6382731795310974, 'learning_rate': 5.559598135680102e-06, 'epoch': 1.55}

 52%|█████▏    | 5722/11049 [58:55<54:27,  1.63it/s]
 52%|█████▏    | 5723/11049 [58:56<54:27,  1.63it/s]
                                                    
{'loss': 0.1786, 'grad_norm': 0.5105217695236206, 'learning_rate': 5.558028389934083e-06, 'epoch': 1.55}

 52%|█████▏    | 5723/11049 [58:56<54:27,  1.63it/s]
 52%|█████▏    | 5724/11049 [58:56<54:27,  1.63it/s]
                                                    
{'loss': 0.2097, 'grad_norm': 0.5331946015357971, 'learning_rate': 5.5564585884908075e-06, 'epoch': 1.55}

 52%|█████▏    | 5724/11049 [58:56<54:27,  1.63it/s]
 52%|█████▏    | 5725/11049 [58:57<54:26,  1.63it/s]
                                                    
{'loss': 0.1822, 'grad_norm': 0.44833508133888245, 'learning_rate': 5.5548887315069575e-06, 'epoch': 1.55}

 52%|█████▏    | 5725/11049 [58:57<54:26,  1.63it/s]
 52%|█████▏    | 5726/11049 [58:58<54:25,  1.63it/s]
                                                    
{'loss': 0.1793, 'grad_norm': 0.5547770261764526, 'learning_rate': 5.553318819139224e-06, 'epoch': 1.55}

 52%|█████▏    | 5726/11049 [58:58<54:25,  1.63it/s]
 52%|█████▏    | 5727/11049 [58:58<54:24,  1.63it/s]
                                                    
{'loss': 0.1968, 'grad_norm': 0.5194942951202393, 'learning_rate': 5.5517488515442974e-06, 'epoch': 1.55}

 52%|█████▏    | 5727/11049 [58:58<54:24,  1.63it/s]
 52%|█████▏    | 5728/11049 [58:59<54:23,  1.63it/s]
                                                    
{'loss': 0.2039, 'grad_norm': 0.5351660251617432, 'learning_rate': 5.550178828878882e-06, 'epoch': 1.56}

 52%|█████▏    | 5728/11049 [58:59<54:23,  1.63it/s]
 52%|█████▏    | 5729/11049 [58:59<54:22,  1.63it/s]
                                                    
{'loss': 0.2575, 'grad_norm': 0.5632560849189758, 'learning_rate': 5.54860875129968e-06, 'epoch': 1.56}

 52%|█████▏    | 5729/11049 [58:59<54:22,  1.63it/s]
 52%|█████▏    | 5730/11049 [59:00<54:23,  1.63it/s]
                                                    
{'loss': 0.2271, 'grad_norm': 0.6106551289558411, 'learning_rate': 5.547038618963404e-06, 'epoch': 1.56}

 52%|█████▏    | 5730/11049 [59:00<54:23,  1.63it/s]
 52%|█████▏    | 5731/11049 [59:01<54:21,  1.63it/s]
                                                    
{'loss': 0.1945, 'grad_norm': 0.5042008757591248, 'learning_rate': 5.5454684320267674e-06, 'epoch': 1.56}

 52%|█████▏    | 5731/11049 [59:01<54:21,  1.63it/s]
 52%|█████▏    | 5732/11049 [59:01<54:19,  1.63it/s]
                                                    
{'loss': 0.2128, 'grad_norm': 0.6554059982299805, 'learning_rate': 5.543898190646494e-06, 'epoch': 1.56}

 52%|█████▏    | 5732/11049 [59:01<54:19,  1.63it/s]
 52%|█████▏    | 5733/11049 [59:02<54:19,  1.63it/s]
                                                    
{'loss': 0.2373, 'grad_norm': 0.6017284393310547, 'learning_rate': 5.542327894979312e-06, 'epoch': 1.56}

 52%|█████▏    | 5733/11049 [59:02<54:19,  1.63it/s]
 52%|█████▏    | 5734/11049 [59:02<54:18,  1.63it/s]
                                                    
{'loss': 0.1683, 'grad_norm': 0.48566102981567383, 'learning_rate': 5.54075754518195e-06, 'epoch': 1.56}

 52%|█████▏    | 5734/11049 [59:03<54:18,  1.63it/s]
 52%|█████▏    | 5735/11049 [59:03<54:17,  1.63it/s]
                                                    
{'loss': 0.193, 'grad_norm': 0.5146761536598206, 'learning_rate': 5.539187141411149e-06, 'epoch': 1.56}

 52%|█████▏    | 5735/11049 [59:03<54:17,  1.63it/s]
 52%|█████▏    | 5736/11049 [59:04<54:18,  1.63it/s]
                                                    
{'loss': 0.166, 'grad_norm': 0.44881144165992737, 'learning_rate': 5.537616683823651e-06, 'epoch': 1.56}

 52%|█████▏    | 5736/11049 [59:04<54:18,  1.63it/s]
 52%|█████▏    | 5737/11049 [59:04<54:18,  1.63it/s]
                                                    
{'loss': 0.1893, 'grad_norm': 0.5290031433105469, 'learning_rate': 5.5360461725762045e-06, 'epoch': 1.56}

 52%|█████▏    | 5737/11049 [59:04<54:18,  1.63it/s]
 52%|█████▏    | 5738/11049 [59:05<54:16,  1.63it/s]
                                                    
{'loss': 0.3247, 'grad_norm': 0.6865589022636414, 'learning_rate': 5.534475607825566e-06, 'epoch': 1.56}

 52%|█████▏    | 5738/11049 [59:05<54:16,  1.63it/s]
 52%|█████▏    | 5739/11049 [59:05<54:15,  1.63it/s]
                                                    
{'loss': 0.2028, 'grad_norm': 0.5516877770423889, 'learning_rate': 5.532904989728489e-06, 'epoch': 1.56}

 52%|█████▏    | 5739/11049 [59:06<54:15,  1.63it/s]
 52%|█████▏    | 5740/11049 [59:06<54:15,  1.63it/s]
                                                    
{'loss': 0.1886, 'grad_norm': 0.5111094117164612, 'learning_rate': 5.5313343184417455e-06, 'epoch': 1.56}

 52%|█████▏    | 5740/11049 [59:06<54:15,  1.63it/s]
 52%|█████▏    | 5741/11049 [59:07<54:16,  1.63it/s]
                                                    
{'loss': 0.1861, 'grad_norm': 0.5160163044929504, 'learning_rate': 5.5297635941221e-06, 'epoch': 1.56}

 52%|█████▏    | 5741/11049 [59:07<54:16,  1.63it/s]
 52%|█████▏    | 5742/11049 [59:07<54:15,  1.63it/s]
                                                    
{'loss': 0.1763, 'grad_norm': 0.4621002674102783, 'learning_rate': 5.52819281692633e-06, 'epoch': 1.56}

 52%|█████▏    | 5742/11049 [59:07<54:15,  1.63it/s]
 52%|█████▏    | 5743/11049 [59:08<54:15,  1.63it/s]
                                                    
{'loss': 0.1937, 'grad_norm': 0.4829954206943512, 'learning_rate': 5.526621987011215e-06, 'epoch': 1.56}

 52%|█████▏    | 5743/11049 [59:08<54:15,  1.63it/s]
 52%|█████▏    | 5744/11049 [59:09<54:14,  1.63it/s]
                                                    
{'loss': 0.2372, 'grad_norm': 0.6372929215431213, 'learning_rate': 5.525051104533542e-06, 'epoch': 1.56}

 52%|█████▏    | 5744/11049 [59:09<54:14,  1.63it/s]
 52%|█████▏    | 5745/11049 [59:09<54:14,  1.63it/s]
                                                    
{'loss': 0.2097, 'grad_norm': 0.5479776263237, 'learning_rate': 5.5234801696500996e-06, 'epoch': 1.56}

 52%|█████▏    | 5745/11049 [59:09<54:14,  1.63it/s]
 52%|█████▏    | 5746/11049 [59:10<54:12,  1.63it/s]
                                                    
{'loss': 0.214, 'grad_norm': 0.4759293794631958, 'learning_rate': 5.521909182517689e-06, 'epoch': 1.56}

 52%|█████▏    | 5746/11049 [59:10<54:12,  1.63it/s]
 52%|█████▏    | 5747/11049 [59:10<54:11,  1.63it/s]
                                                    
{'loss': 0.2185, 'grad_norm': 0.5874896049499512, 'learning_rate': 5.520338143293106e-06, 'epoch': 1.56}

 52%|█████▏    | 5747/11049 [59:11<54:11,  1.63it/s]
 52%|█████▏    | 5748/11049 [59:11<54:11,  1.63it/s]
                                                    
{'loss': 0.1788, 'grad_norm': 0.5085946321487427, 'learning_rate': 5.51876705213316e-06, 'epoch': 1.56}

 52%|█████▏    | 5748/11049 [59:11<54:11,  1.63it/s]
 52%|█████▏    | 5749/11049 [59:12<54:10,  1.63it/s]
                                                    
{'loss': 0.2098, 'grad_norm': 0.5557979941368103, 'learning_rate': 5.517195909194664e-06, 'epoch': 1.56}

 52%|█████▏    | 5749/11049 [59:12<54:10,  1.63it/s]
 52%|█████▏    | 5750/11049 [59:12<54:08,  1.63it/s]
                                                    
{'loss': 0.1258, 'grad_norm': 0.39028891921043396, 'learning_rate': 5.515624714634432e-06, 'epoch': 1.56}

 52%|█████▏    | 5750/11049 [59:12<54:08,  1.63it/s]
 52%|█████▏    | 5751/11049 [59:13<54:10,  1.63it/s]
                                                    
{'loss': 0.1785, 'grad_norm': 0.5708671808242798, 'learning_rate': 5.514053468609289e-06, 'epoch': 1.56}

 52%|█████▏    | 5751/11049 [59:13<54:10,  1.63it/s]
 52%|█████▏    | 5752/11049 [59:13<54:10,  1.63it/s]
                                                    
{'loss': 0.1605, 'grad_norm': 0.482501357793808, 'learning_rate': 5.5124821712760616e-06, 'epoch': 1.56}

 52%|█████▏    | 5752/11049 [59:14<54:10,  1.63it/s]
 52%|█████▏    | 5753/11049 [59:14<54:10,  1.63it/s]
                                                    
{'loss': 0.208, 'grad_norm': 0.5819920301437378, 'learning_rate': 5.51091082279158e-06, 'epoch': 1.56}

 52%|█████▏    | 5753/11049 [59:14<54:10,  1.63it/s]
 52%|█████▏    | 5754/11049 [59:15<54:10,  1.63it/s]
                                                    
{'loss': 0.2077, 'grad_norm': 0.5617388486862183, 'learning_rate': 5.509339423312684e-06, 'epoch': 1.56}

 52%|█████▏    | 5754/11049 [59:15<54:10,  1.63it/s]
 52%|█████▏    | 5755/11049 [59:15<54:09,  1.63it/s]
                                                    
{'loss': 0.1754, 'grad_norm': 0.502931535243988, 'learning_rate': 5.507767972996216e-06, 'epoch': 1.56}

 52%|█████▏    | 5755/11049 [59:15<54:09,  1.63it/s]
 52%|█████▏    | 5756/11049 [59:16<54:07,  1.63it/s]
                                                    
{'loss': 0.196, 'grad_norm': 0.5171089172363281, 'learning_rate': 5.506196471999025e-06, 'epoch': 1.56}

 52%|█████▏    | 5756/11049 [59:16<54:07,  1.63it/s]
 52%|█████▏    | 5757/11049 [59:17<54:07,  1.63it/s]
                                                    
{'loss': 0.1774, 'grad_norm': 0.48539918661117554, 'learning_rate': 5.504624920477959e-06, 'epoch': 1.56}

 52%|█████▏    | 5757/11049 [59:17<54:07,  1.63it/s]
 52%|█████▏    | 5758/11049 [59:17<54:05,  1.63it/s]
                                                    
{'loss': 0.2107, 'grad_norm': 0.5349467992782593, 'learning_rate': 5.5030533185898815e-06, 'epoch': 1.56}

 52%|█████▏    | 5758/11049 [59:17<54:05,  1.63it/s]
 52%|█████▏    | 5759/11049 [59:18<54:04,  1.63it/s]
                                                    
{'loss': 0.2182, 'grad_norm': 0.6528231501579285, 'learning_rate': 5.501481666491652e-06, 'epoch': 1.56}

 52%|█████▏    | 5759/11049 [59:18<54:04,  1.63it/s]
 52%|█████▏    | 5760/11049 [59:18<54:03,  1.63it/s]
                                                    
{'loss': 0.1469, 'grad_norm': 0.5015085339546204, 'learning_rate': 5.49990996434014e-06, 'epoch': 1.56}

 52%|█████▏    | 5760/11049 [59:19<54:03,  1.63it/s]
 52%|█████▏    | 5761/11049 [59:19<54:05,  1.63it/s]
                                                    
{'loss': 0.1998, 'grad_norm': 0.5155866146087646, 'learning_rate': 5.498338212292216e-06, 'epoch': 1.56}

 52%|█████▏    | 5761/11049 [59:19<54:05,  1.63it/s]
 52%|█████▏    | 5762/11049 [59:20<54:04,  1.63it/s]
                                                    
{'loss': 0.2051, 'grad_norm': 0.5560298562049866, 'learning_rate': 5.49676641050476e-06, 'epoch': 1.56}

 52%|█████▏    | 5762/11049 [59:20<54:04,  1.63it/s]
 52%|█████▏    | 5763/11049 [59:20<54:03,  1.63it/s]
                                                    
{'loss': 0.237, 'grad_norm': 0.6528435945510864, 'learning_rate': 5.4951945591346534e-06, 'epoch': 1.56}

 52%|█████▏    | 5763/11049 [59:20<54:03,  1.63it/s]
 52%|█████▏    | 5764/11049 [59:21<54:02,  1.63it/s]
                                                    
{'loss': 0.2134, 'grad_norm': 0.563268780708313, 'learning_rate': 5.493622658338786e-06, 'epoch': 1.57}

 52%|█████▏    | 5764/11049 [59:21<54:02,  1.63it/s]
 52%|█████▏    | 5765/11049 [59:21<54:02,  1.63it/s]
                                                    
{'loss': 0.238, 'grad_norm': 0.6153100728988647, 'learning_rate': 5.49205070827405e-06, 'epoch': 1.57}

 52%|█████▏    | 5765/11049 [59:22<54:02,  1.63it/s]
 52%|█████▏    | 5766/11049 [59:22<54:00,  1.63it/s]
                                                    
{'loss': 0.2524, 'grad_norm': 0.5440106391906738, 'learning_rate': 5.49047870909734e-06, 'epoch': 1.57}

 52%|█████▏    | 5766/11049 [59:22<54:00,  1.63it/s]
 52%|█████▏    | 5767/11049 [59:23<54:00,  1.63it/s]
                                                    
{'loss': 0.1685, 'grad_norm': 0.5329232215881348, 'learning_rate': 5.488906660965561e-06, 'epoch': 1.57}

 52%|█████▏    | 5767/11049 [59:23<54:00,  1.63it/s]
 52%|█████▏    | 5768/11049 [59:23<53:58,  1.63it/s]
                                                    
{'loss': 0.2156, 'grad_norm': 0.5585209727287292, 'learning_rate': 5.48733456403562e-06, 'epoch': 1.57}

 52%|█████▏    | 5768/11049 [59:23<53:58,  1.63it/s]
 52%|█████▏    | 5769/11049 [59:24<53:58,  1.63it/s]
                                                    
{'loss': 0.2465, 'grad_norm': 0.507972002029419, 'learning_rate': 5.48576241846443e-06, 'epoch': 1.57}

 52%|█████▏    | 5769/11049 [59:24<53:58,  1.63it/s]
 52%|█████▏    | 5770/11049 [59:25<53:58,  1.63it/s]
                                                    
{'loss': 0.2306, 'grad_norm': 0.8149218559265137, 'learning_rate': 5.484190224408908e-06, 'epoch': 1.57}

 52%|█████▏    | 5770/11049 [59:25<53:58,  1.63it/s]
 52%|█████▏    | 5771/11049 [59:25<53:56,  1.63it/s]
                                                    
{'loss': 0.225, 'grad_norm': 0.5958421230316162, 'learning_rate': 5.482617982025973e-06, 'epoch': 1.57}

 52%|█████▏    | 5771/11049 [59:25<53:56,  1.63it/s]
 52%|█████▏    | 5772/11049 [59:26<53:56,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.5220982432365417, 'learning_rate': 5.481045691472555e-06, 'epoch': 1.57}

 52%|█████▏    | 5772/11049 [59:26<53:56,  1.63it/s]
 52%|█████▏    | 5773/11049 [59:26<53:56,  1.63it/s]
                                                    
{'loss': 0.2367, 'grad_norm': 0.7150710821151733, 'learning_rate': 5.4794733529055855e-06, 'epoch': 1.57}

 52%|█████▏    | 5773/11049 [59:26<53:56,  1.63it/s]
 52%|█████▏    | 5774/11049 [59:27<53:56,  1.63it/s]
                                                    
{'loss': 0.2734, 'grad_norm': 0.7098398804664612, 'learning_rate': 5.477900966481999e-06, 'epoch': 1.57}

 52%|█████▏    | 5774/11049 [59:27<53:56,  1.63it/s]
 52%|█████▏    | 5775/11049 [59:28<53:54,  1.63it/s]
                                                    
{'loss': 0.2324, 'grad_norm': 0.6258149743080139, 'learning_rate': 5.476328532358736e-06, 'epoch': 1.57}

 52%|█████▏    | 5775/11049 [59:28<53:54,  1.63it/s]
 52%|█████▏    | 5776/11049 [59:28<53:54,  1.63it/s]
                                                    
{'loss': 0.2709, 'grad_norm': 0.685448408126831, 'learning_rate': 5.474756050692747e-06, 'epoch': 1.57}

 52%|█████▏    | 5776/11049 [59:28<53:54,  1.63it/s]
 52%|█████▏    | 5777/11049 [59:29<53:54,  1.63it/s]
                                                    
{'loss': 0.2366, 'grad_norm': 0.5560364127159119, 'learning_rate': 5.473183521640978e-06, 'epoch': 1.57}

 52%|█████▏    | 5777/11049 [59:29<53:54,  1.63it/s]
 52%|█████▏    | 5778/11049 [59:29<53:52,  1.63it/s]
                                                    
{'loss': 0.1563, 'grad_norm': 0.46747636795043945, 'learning_rate': 5.471610945360388e-06, 'epoch': 1.57}

 52%|█████▏    | 5778/11049 [59:30<53:52,  1.63it/s]
 52%|█████▏    | 5779/11049 [59:30<53:51,  1.63it/s]
                                                    
{'loss': 0.1928, 'grad_norm': 0.52064049243927, 'learning_rate': 5.470038322007931e-06, 'epoch': 1.57}

 52%|█████▏    | 5779/11049 [59:30<53:51,  1.63it/s]
 52%|█████▏    | 5780/11049 [59:31<53:51,  1.63it/s]
                                                    
{'loss': 0.2263, 'grad_norm': 0.5647681355476379, 'learning_rate': 5.468465651740579e-06, 'epoch': 1.57}

 52%|█████▏    | 5780/11049 [59:31<53:51,  1.63it/s]
 52%|█████▏    | 5781/11049 [59:31<53:50,  1.63it/s]
                                                    
{'loss': 0.189, 'grad_norm': 0.5293217897415161, 'learning_rate': 5.4668929347152966e-06, 'epoch': 1.57}

 52%|█████▏    | 5781/11049 [59:31<53:50,  1.63it/s]
 52%|█████▏    | 5782/11049 [59:32<53:50,  1.63it/s]
                                                    
{'loss': 0.1599, 'grad_norm': 0.4459681808948517, 'learning_rate': 5.465320171089062e-06, 'epoch': 1.57}

 52%|█████▏    | 5782/11049 [59:32<53:50,  1.63it/s]
 52%|█████▏    | 5783/11049 [59:32<53:49,  1.63it/s]
                                                    
{'loss': 0.2416, 'grad_norm': 0.5060070157051086, 'learning_rate': 5.46374736101885e-06, 'epoch': 1.57}

 52%|█████▏    | 5783/11049 [59:33<53:49,  1.63it/s]
 52%|█████▏    | 5784/11049 [59:33<53:49,  1.63it/s]
                                                    
{'loss': 0.182, 'grad_norm': 0.49510177969932556, 'learning_rate': 5.462174504661646e-06, 'epoch': 1.57}

 52%|█████▏    | 5784/11049 [59:33<53:49,  1.63it/s]
 52%|█████▏    | 5785/11049 [59:34<53:47,  1.63it/s]
                                                    
{'loss': 0.2283, 'grad_norm': 0.5541098713874817, 'learning_rate': 5.460601602174437e-06, 'epoch': 1.57}

 52%|█████▏    | 5785/11049 [59:34<53:47,  1.63it/s]
 52%|█████▏    | 5786/11049 [59:34<53:46,  1.63it/s]
                                                    
{'loss': 0.1942, 'grad_norm': 0.5934491753578186, 'learning_rate': 5.459028653714217e-06, 'epoch': 1.57}

 52%|█████▏    | 5786/11049 [59:34<53:46,  1.63it/s]
 52%|█████▏    | 5787/11049 [59:35<53:44,  1.63it/s]
                                                    
{'loss': 0.1621, 'grad_norm': 0.4858485460281372, 'learning_rate': 5.457455659437984e-06, 'epoch': 1.57}

 52%|█████▏    | 5787/11049 [59:35<53:44,  1.63it/s]
 52%|█████▏    | 5788/11049 [59:36<53:45,  1.63it/s]
                                                    
{'loss': 0.1789, 'grad_norm': 0.514887809753418, 'learning_rate': 5.4558826195027355e-06, 'epoch': 1.57}

 52%|█████▏    | 5788/11049 [59:36<53:45,  1.63it/s]
 52%|█████▏    | 5789/11049 [59:36<53:45,  1.63it/s]
                                                    
{'loss': 0.1781, 'grad_norm': 0.48010149598121643, 'learning_rate': 5.454309534065483e-06, 'epoch': 1.57}

 52%|█████▏    | 5789/11049 [59:36<53:45,  1.63it/s]
 52%|█████▏    | 5790/11049 [59:37<53:44,  1.63it/s]
                                                    
{'loss': 0.1502, 'grad_norm': 0.41298896074295044, 'learning_rate': 5.452736403283234e-06, 'epoch': 1.57}

 52%|█████▏    | 5790/11049 [59:37<53:44,  1.63it/s]
 52%|█████▏    | 5791/11049 [59:37<53:44,  1.63it/s]
                                                    
{'loss': 0.1542, 'grad_norm': 0.4608064591884613, 'learning_rate': 5.451163227313006e-06, 'epoch': 1.57}

 52%|█████▏    | 5791/11049 [59:38<53:44,  1.63it/s]
 52%|█████▏    | 5792/11049 [59:38<53:44,  1.63it/s]
                                                    
{'loss': 0.1825, 'grad_norm': 0.4852272570133209, 'learning_rate': 5.449590006311818e-06, 'epoch': 1.57}

 52%|█████▏    | 5792/11049 [59:38<53:44,  1.63it/s]
 52%|█████▏    | 5793/11049 [59:39<53:45,  1.63it/s]
                                                    
{'loss': 0.2266, 'grad_norm': 0.4821820855140686, 'learning_rate': 5.448016740436693e-06, 'epoch': 1.57}

 52%|█████▏    | 5793/11049 [59:39<53:45,  1.63it/s]
 52%|█████▏    | 5794/11049 [59:39<53:44,  1.63it/s]
                                                    
{'loss': 0.1823, 'grad_norm': 0.500478208065033, 'learning_rate': 5.446443429844664e-06, 'epoch': 1.57}

 52%|█████▏    | 5794/11049 [59:39<53:44,  1.63it/s]
 52%|█████▏    | 5795/11049 [59:40<53:42,  1.63it/s]
                                                    
{'loss': 0.2413, 'grad_norm': 0.599268913269043, 'learning_rate': 5.444870074692758e-06, 'epoch': 1.57}

 52%|█████▏    | 5795/11049 [59:40<53:42,  1.63it/s]
 52%|█████▏    | 5796/11049 [59:40<53:42,  1.63it/s]
                                                    
{'loss': 0.1847, 'grad_norm': 0.6135851740837097, 'learning_rate': 5.4432966751380214e-06, 'epoch': 1.57}

 52%|█████▏    | 5796/11049 [59:41<53:42,  1.63it/s]
 52%|█████▏    | 5797/11049 [59:41<53:41,  1.63it/s]
                                                    
{'loss': 0.288, 'grad_norm': 0.6494357585906982, 'learning_rate': 5.441723231337488e-06, 'epoch': 1.57}

 52%|█████▏    | 5797/11049 [59:41<53:41,  1.63it/s]
 52%|█████▏    | 5798/11049 [59:42<53:42,  1.63it/s]
                                                    
{'loss': 0.1991, 'grad_norm': 0.5355369448661804, 'learning_rate': 5.4401497434482095e-06, 'epoch': 1.57}

 52%|█████▏    | 5798/11049 [59:42<53:42,  1.63it/s]
 52%|█████▏    | 5799/11049 [59:42<53:40,  1.63it/s]
                                                    
{'loss': 0.1877, 'grad_norm': 0.4955301880836487, 'learning_rate': 5.438576211627235e-06, 'epoch': 1.57}

 52%|█████▏    | 5799/11049 [59:42<53:40,  1.63it/s]
 52%|█████▏    | 5800/11049 [59:43<53:40,  1.63it/s]
                                                    
{'loss': 0.2059, 'grad_norm': 0.5562866926193237, 'learning_rate': 5.437002636031621e-06, 'epoch': 1.57}

 52%|█████▏    | 5800/11049 [59:43<53:40,  1.63it/s]
 53%|█████▎    | 5801/11049 [59:44<53:39,  1.63it/s]
                                                    
{'loss': 0.2051, 'grad_norm': 0.5097624063491821, 'learning_rate': 5.435429016818428e-06, 'epoch': 1.58}

 53%|█████▎    | 5801/11049 [59:44<53:39,  1.63it/s]
 53%|█████▎    | 5802/11049 [59:44<53:39,  1.63it/s]
                                                    
{'loss': 0.2772, 'grad_norm': 0.7172991037368774, 'learning_rate': 5.433855354144717e-06, 'epoch': 1.58}

 53%|█████▎    | 5802/11049 [59:44<53:39,  1.63it/s]
 53%|█████▎    | 5803/11049 [59:45<53:38,  1.63it/s]
                                                    
{'loss': 0.1925, 'grad_norm': 0.5034726858139038, 'learning_rate': 5.432281648167559e-06, 'epoch': 1.58}

 53%|█████▎    | 5803/11049 [59:45<53:38,  1.63it/s]
 53%|█████▎    | 5804/11049 [59:45<53:37,  1.63it/s]
                                                    
{'loss': 0.2085, 'grad_norm': 0.5289742350578308, 'learning_rate': 5.430707899044027e-06, 'epoch': 1.58}

 53%|█████▎    | 5804/11049 [59:46<53:37,  1.63it/s]
 53%|█████▎    | 5805/11049 [59:46<53:37,  1.63it/s]
                                                    
{'loss': 0.1659, 'grad_norm': 0.47632473707199097, 'learning_rate': 5.4291341069311985e-06, 'epoch': 1.58}

 53%|█████▎    | 5805/11049 [59:46<53:37,  1.63it/s]
 53%|█████▎    | 5806/11049 [59:47<53:38,  1.63it/s]
                                                    
{'loss': 0.1881, 'grad_norm': 0.500538170337677, 'learning_rate': 5.427560271986155e-06, 'epoch': 1.58}

 53%|█████▎    | 5806/11049 [59:47<53:38,  1.63it/s]
 53%|█████▎    | 5807/11049 [59:47<53:44,  1.63it/s]
                                                    
{'loss': 0.1735, 'grad_norm': 0.49457255005836487, 'learning_rate': 5.425986394365977e-06, 'epoch': 1.58}

 53%|█████▎    | 5807/11049 [59:47<53:44,  1.63it/s]
 53%|█████▎    | 5808/11049 [59:48<53:42,  1.63it/s]
                                                    
{'loss': 0.2252, 'grad_norm': 0.5556842684745789, 'learning_rate': 5.4244124742277615e-06, 'epoch': 1.58}

 53%|█████▎    | 5808/11049 [59:48<53:42,  1.63it/s]
 53%|█████▎    | 5809/11049 [59:48<53:39,  1.63it/s]
                                                    
{'loss': 0.2117, 'grad_norm': 0.5624298453330994, 'learning_rate': 5.422838511728601e-06, 'epoch': 1.58}

 53%|█████▎    | 5809/11049 [59:49<53:39,  1.63it/s]
 53%|█████▎    | 5810/11049 [59:49<53:37,  1.63it/s]
                                                    
{'loss': 0.1514, 'grad_norm': 0.4193194806575775, 'learning_rate': 5.421264507025591e-06, 'epoch': 1.58}

 53%|█████▎    | 5810/11049 [59:49<53:37,  1.63it/s]
 53%|█████▎    | 5811/11049 [59:50<53:39,  1.63it/s]
                                                    
{'loss': 0.246, 'grad_norm': 0.5839502811431885, 'learning_rate': 5.419690460275836e-06, 'epoch': 1.58}

 53%|█████▎    | 5811/11049 [59:50<53:39,  1.63it/s]
 53%|█████▎    | 5812/11049 [59:50<53:36,  1.63it/s]
                                                    
{'loss': 0.2537, 'grad_norm': 0.6704710125923157, 'learning_rate': 5.418116371636444e-06, 'epoch': 1.58}

 53%|█████▎    | 5812/11049 [59:50<53:36,  1.63it/s]
 53%|█████▎    | 5813/11049 [59:51<53:35,  1.63it/s]
                                                    
{'loss': 0.1621, 'grad_norm': 0.4602530896663666, 'learning_rate': 5.416542241264524e-06, 'epoch': 1.58}

 53%|█████▎    | 5813/11049 [59:51<53:35,  1.63it/s]
 53%|█████▎    | 5814/11049 [59:52<53:34,  1.63it/s]
                                                    
{'loss': 0.1516, 'grad_norm': 0.4356822371482849, 'learning_rate': 5.4149680693171934e-06, 'epoch': 1.58}

 53%|█████▎    | 5814/11049 [59:52<53:34,  1.63it/s]
 53%|█████▎    | 5815/11049 [59:52<53:37,  1.63it/s]
                                                    
{'loss': 0.196, 'grad_norm': 0.486590713262558, 'learning_rate': 5.4133938559515695e-06, 'epoch': 1.58}

 53%|█████▎    | 5815/11049 [59:52<53:37,  1.63it/s]
 53%|█████▎    | 5816/11049 [59:53<53:34,  1.63it/s]
                                                    
{'loss': 0.1885, 'grad_norm': 0.48819229006767273, 'learning_rate': 5.411819601324777e-06, 'epoch': 1.58}

 53%|█████▎    | 5816/11049 [59:53<53:34,  1.63it/s]
 53%|█████▎    | 5817/11049 [59:53<53:31,  1.63it/s]
                                                    
{'loss': 0.2096, 'grad_norm': 0.5686704516410828, 'learning_rate': 5.410245305593942e-06, 'epoch': 1.58}

 53%|█████▎    | 5817/11049 [59:53<53:31,  1.63it/s]
 53%|█████▎    | 5818/11049 [59:54<53:31,  1.63it/s]
                                                    
{'loss': 0.1932, 'grad_norm': 0.5289185643196106, 'learning_rate': 5.408670968916198e-06, 'epoch': 1.58}

 53%|█████▎    | 5818/11049 [59:54<53:31,  1.63it/s]
 53%|█████▎    | 5819/11049 [59:55<53:29,  1.63it/s]
                                                    
{'loss': 0.2082, 'grad_norm': 0.5136621594429016, 'learning_rate': 5.4070965914486804e-06, 'epoch': 1.58}

 53%|█████▎    | 5819/11049 [59:55<53:29,  1.63it/s]
 53%|█████▎    | 5820/11049 [59:55<53:31,  1.63it/s]
                                                    
{'loss': 0.225, 'grad_norm': 0.5708807110786438, 'learning_rate': 5.4055221733485295e-06, 'epoch': 1.58}

 53%|█████▎    | 5820/11049 [59:55<53:31,  1.63it/s]
 53%|█████▎    | 5821/11049 [59:56<53:29,  1.63it/s]
                                                    
{'loss': 0.1928, 'grad_norm': 0.5315220355987549, 'learning_rate': 5.403947714772887e-06, 'epoch': 1.58}

 53%|█████▎    | 5821/11049 [59:56<53:29,  1.63it/s]
 53%|█████▎    | 5822/11049 [59:56<53:27,  1.63it/s]
                                                    
{'loss': 0.2779, 'grad_norm': 0.7709841132164001, 'learning_rate': 5.4023732158789035e-06, 'epoch': 1.58}

 53%|█████▎    | 5822/11049 [59:57<53:27,  1.63it/s]
 53%|█████▎    | 5823/11049 [59:57<55:00,  1.58it/s]
                                                    
{'loss': 0.2174, 'grad_norm': 0.5401394367218018, 'learning_rate': 5.400798676823728e-06, 'epoch': 1.58}

 53%|█████▎    | 5823/11049 [59:57<55:00,  1.58it/s]
 53%|█████▎    | 5824/11049 [59:58<54:29,  1.60it/s]
                                                    
{'loss': 0.1739, 'grad_norm': 0.47460880875587463, 'learning_rate': 5.3992240977645205e-06, 'epoch': 1.58}

 53%|█████▎    | 5824/11049 [59:58<54:29,  1.60it/s]
 53%|█████▎    | 5825/11049 [59:58<54:14,  1.61it/s]
                                                    
{'loss': 0.184, 'grad_norm': 0.49580585956573486, 'learning_rate': 5.397649478858437e-06, 'epoch': 1.58}

 53%|█████▎    | 5825/11049 [59:58<54:14,  1.61it/s]
 53%|█████▎    | 5826/11049 [59:59<54:01,  1.61it/s]
                                                    
{'loss': 0.2183, 'grad_norm': 0.6082660555839539, 'learning_rate': 5.396074820262644e-06, 'epoch': 1.58}

 53%|█████▎    | 5826/11049 [59:59<54:01,  1.61it/s]
 53%|█████▎    | 5827/11049 [1:00:00<53:49,  1.62it/s]
                                                      
{'loss': 0.1945, 'grad_norm': 0.5545386672019958, 'learning_rate': 5.39450012213431e-06, 'epoch': 1.58}

 53%|█████▎    | 5827/11049 [1:00:00<53:49,  1.62it/s]
 53%|█████▎    | 5828/11049 [1:00:00<53:41,  1.62it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.5749402642250061, 'learning_rate': 5.392925384630605e-06, 'epoch': 1.58}

 53%|█████▎    | 5828/11049 [1:00:00<53:41,  1.62it/s]
 53%|█████▎    | 5829/11049 [1:00:01<53:35,  1.62it/s]
                                                      
{'loss': 0.2665, 'grad_norm': 0.5795673727989197, 'learning_rate': 5.391350607908704e-06, 'epoch': 1.58}

 53%|█████▎    | 5829/11049 [1:00:01<53:35,  1.62it/s]
 53%|█████▎    | 5830/11049 [1:00:01<53:32,  1.62it/s]
                                                      
{'loss': 0.2037, 'grad_norm': 0.49500104784965515, 'learning_rate': 5.3897757921257885e-06, 'epoch': 1.58}

 53%|█████▎    | 5830/11049 [1:00:02<53:32,  1.62it/s]
 53%|█████▎    | 5831/11049 [1:00:02<53:33,  1.62it/s]
                                                      
{'loss': 0.2418, 'grad_norm': 0.5884004831314087, 'learning_rate': 5.388200937439042e-06, 'epoch': 1.58}

 53%|█████▎    | 5831/11049 [1:00:02<53:33,  1.62it/s]
 53%|█████▎    | 5832/11049 [1:00:03<53:27,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.48519277572631836, 'learning_rate': 5.3866260440056525e-06, 'epoch': 1.58}

 53%|█████▎    | 5832/11049 [1:00:03<53:27,  1.63it/s]
 53%|█████▎    | 5833/11049 [1:00:03<53:24,  1.63it/s]
                                                      
{'loss': 0.2656, 'grad_norm': 0.6486887335777283, 'learning_rate': 5.3850511119828095e-06, 'epoch': 1.58}

 53%|█████▎    | 5833/11049 [1:00:03<53:24,  1.63it/s]
 53%|█████▎    | 5834/11049 [1:00:04<53:21,  1.63it/s]
                                                      
{'loss': 0.2245, 'grad_norm': 0.5550941228866577, 'learning_rate': 5.38347614152771e-06, 'epoch': 1.58}

 53%|█████▎    | 5834/11049 [1:00:04<53:21,  1.63it/s]
 53%|█████▎    | 5835/11049 [1:00:04<53:23,  1.63it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.5164259672164917, 'learning_rate': 5.381901132797551e-06, 'epoch': 1.58}

 53%|█████▎    | 5835/11049 [1:00:05<53:23,  1.63it/s]
 53%|█████▎    | 5836/11049 [1:00:05<53:24,  1.63it/s]
                                                      
{'loss': 0.2244, 'grad_norm': 0.5840450525283813, 'learning_rate': 5.380326085949538e-06, 'epoch': 1.58}

 53%|█████▎    | 5836/11049 [1:00:05<53:24,  1.63it/s]
 53%|█████▎    | 5837/11049 [1:00:06<53:21,  1.63it/s]
                                                      
{'loss': 0.2105, 'grad_norm': 0.5866053104400635, 'learning_rate': 5.3787510011408765e-06, 'epoch': 1.58}

 53%|█████▎    | 5837/11049 [1:00:06<53:21,  1.63it/s]
 53%|█████▎    | 5838/11049 [1:00:06<53:20,  1.63it/s]
                                                      
{'loss': 0.2069, 'grad_norm': 0.5605260729789734, 'learning_rate': 5.377175878528776e-06, 'epoch': 1.59}

 53%|█████▎    | 5838/11049 [1:00:06<53:20,  1.63it/s]
 53%|█████▎    | 5839/11049 [1:00:07<53:19,  1.63it/s]
                                                      
{'loss': 0.2715, 'grad_norm': 0.7105318307876587, 'learning_rate': 5.375600718270452e-06, 'epoch': 1.59}

 53%|█████▎    | 5839/11049 [1:00:07<53:19,  1.63it/s]
 53%|█████▎    | 5840/11049 [1:00:08<53:21,  1.63it/s]
                                                      
{'loss': 0.2202, 'grad_norm': 0.5259848833084106, 'learning_rate': 5.3740255205231216e-06, 'epoch': 1.59}

 53%|█████▎    | 5840/11049 [1:00:08<53:21,  1.63it/s]
 53%|█████▎    | 5841/11049 [1:00:08<53:18,  1.63it/s]
                                                      
{'loss': 0.1954, 'grad_norm': 0.5200240612030029, 'learning_rate': 5.3724502854440085e-06, 'epoch': 1.59}

 53%|█████▎    | 5841/11049 [1:00:08<53:18,  1.63it/s]
 53%|█████▎    | 5842/11049 [1:00:09<53:17,  1.63it/s]
                                                      
{'loss': 0.1438, 'grad_norm': 0.42266523838043213, 'learning_rate': 5.3708750131903355e-06, 'epoch': 1.59}

 53%|█████▎    | 5842/11049 [1:00:09<53:17,  1.63it/s]
 53%|█████▎    | 5843/11049 [1:00:09<53:15,  1.63it/s]
                                                      
{'loss': 0.2352, 'grad_norm': 0.5030393004417419, 'learning_rate': 5.369299703919332e-06, 'epoch': 1.59}

 53%|█████▎    | 5843/11049 [1:00:10<53:15,  1.63it/s]
 53%|█████▎    | 5844/11049 [1:00:10<53:21,  1.63it/s]
                                                      
{'loss': 0.1883, 'grad_norm': 0.5383791327476501, 'learning_rate': 5.367724357788233e-06, 'epoch': 1.59}

 53%|█████▎    | 5844/11049 [1:00:10<53:21,  1.63it/s]
 53%|█████▎    | 5845/11049 [1:00:11<53:20,  1.63it/s]
                                                      
{'loss': 0.2233, 'grad_norm': 0.5900449156761169, 'learning_rate': 5.366148974954275e-06, 'epoch': 1.59}

 53%|█████▎    | 5845/11049 [1:00:11<53:20,  1.63it/s]
 53%|█████▎    | 5846/11049 [1:00:11<53:19,  1.63it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.5998754501342773, 'learning_rate': 5.364573555574696e-06, 'epoch': 1.59}

 53%|█████▎    | 5846/11049 [1:00:11<53:19,  1.63it/s]
 53%|█████▎    | 5847/11049 [1:00:12<53:17,  1.63it/s]
                                                      
{'loss': 0.2304, 'grad_norm': 0.5804275870323181, 'learning_rate': 5.36299809980674e-06, 'epoch': 1.59}

 53%|█████▎    | 5847/11049 [1:00:12<53:17,  1.63it/s]
 53%|█████▎    | 5848/11049 [1:00:12<53:15,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.5280507802963257, 'learning_rate': 5.361422607807656e-06, 'epoch': 1.59}

 53%|█████▎    | 5848/11049 [1:00:13<53:15,  1.63it/s]
 53%|█████▎    | 5849/11049 [1:00:13<53:14,  1.63it/s]
                                                      
{'loss': 0.2304, 'grad_norm': 0.554943323135376, 'learning_rate': 5.3598470797346945e-06, 'epoch': 1.59}

 53%|█████▎    | 5849/11049 [1:00:13<53:14,  1.63it/s]
 53%|█████▎    | 5850/11049 [1:00:14<53:17,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.6324553489685059, 'learning_rate': 5.358271515745111e-06, 'epoch': 1.59}

 53%|█████▎    | 5850/11049 [1:00:14<53:17,  1.63it/s]
 53%|█████▎    | 5851/11049 [1:00:14<53:16,  1.63it/s]
                                                      
{'loss': 0.1849, 'grad_norm': 0.4739014208316803, 'learning_rate': 5.356695915996162e-06, 'epoch': 1.59}

 53%|█████▎    | 5851/11049 [1:00:14<53:16,  1.63it/s]
 53%|█████▎    | 5852/11049 [1:00:15<53:12,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.624697744846344, 'learning_rate': 5.355120280645112e-06, 'epoch': 1.59}

 53%|█████▎    | 5852/11049 [1:00:15<53:12,  1.63it/s]
 53%|█████▎    | 5853/11049 [1:00:16<53:10,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.5528310537338257, 'learning_rate': 5.3535446098492225e-06, 'epoch': 1.59}

 53%|█████▎    | 5853/11049 [1:00:16<53:10,  1.63it/s]
 53%|█████▎    | 5854/11049 [1:00:16<53:09,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.7105212807655334, 'learning_rate': 5.351968903765766e-06, 'epoch': 1.59}

 53%|█████▎    | 5854/11049 [1:00:16<53:09,  1.63it/s]
 53%|█████▎    | 5855/11049 [1:00:17<53:13,  1.63it/s]
                                                      
{'loss': 0.1945, 'grad_norm': 0.4940994381904602, 'learning_rate': 5.350393162552015e-06, 'epoch': 1.59}

 53%|█████▎    | 5855/11049 [1:00:17<53:13,  1.63it/s]
 53%|█████▎    | 5856/11049 [1:00:17<53:12,  1.63it/s]
                                                      
{'loss': 0.1935, 'grad_norm': 0.5253417491912842, 'learning_rate': 5.348817386365243e-06, 'epoch': 1.59}

 53%|█████▎    | 5856/11049 [1:00:18<53:12,  1.63it/s]
 53%|█████▎    | 5857/11049 [1:00:18<53:10,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.7374346852302551, 'learning_rate': 5.347241575362729e-06, 'epoch': 1.59}

 53%|█████▎    | 5857/11049 [1:00:18<53:10,  1.63it/s]
 53%|█████▎    | 5858/11049 [1:00:19<53:08,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.5763736963272095, 'learning_rate': 5.34566572970176e-06, 'epoch': 1.59}

 53%|█████▎    | 5858/11049 [1:00:19<53:08,  1.63it/s]
 53%|█████▎    | 5859/11049 [1:00:19<53:05,  1.63it/s]
                                                      
{'loss': 0.2071, 'grad_norm': 0.5568073391914368, 'learning_rate': 5.34408984953962e-06, 'epoch': 1.59}

 53%|█████▎    | 5859/11049 [1:00:19<53:05,  1.63it/s]
 53%|█████▎    | 5860/11049 [1:00:20<53:09,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5691989660263062, 'learning_rate': 5.342513935033599e-06, 'epoch': 1.59}

 53%|█████▎    | 5860/11049 [1:00:20<53:09,  1.63it/s]
 53%|█████▎    | 5861/11049 [1:00:20<53:10,  1.63it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.556255578994751, 'learning_rate': 5.340937986340988e-06, 'epoch': 1.59}

 53%|█████▎    | 5861/11049 [1:00:21<53:10,  1.63it/s]
 53%|█████▎    | 5862/11049 [1:00:21<53:08,  1.63it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.6776880621910095, 'learning_rate': 5.3393620036190875e-06, 'epoch': 1.59}

 53%|█████▎    | 5862/11049 [1:00:21<53:08,  1.63it/s]
 53%|█████▎    | 5863/11049 [1:00:22<53:04,  1.63it/s]
                                                      
{'loss': 0.1705, 'grad_norm': 0.5058559775352478, 'learning_rate': 5.337785987025197e-06, 'epoch': 1.59}

 53%|█████▎    | 5863/11049 [1:00:22<53:04,  1.63it/s]
 53%|█████▎    | 5864/11049 [1:00:22<53:02,  1.63it/s]
                                                      
{'loss': 0.1769, 'grad_norm': 0.4543260335922241, 'learning_rate': 5.336209936716617e-06, 'epoch': 1.59}

 53%|█████▎    | 5864/11049 [1:00:22<53:02,  1.63it/s]
 53%|█████▎    | 5865/11049 [1:00:23<53:07,  1.63it/s]
                                                      
{'loss': 0.2497, 'grad_norm': 0.5930517911911011, 'learning_rate': 5.334633852850657e-06, 'epoch': 1.59}

 53%|█████▎    | 5865/11049 [1:00:23<53:07,  1.63it/s]
 53%|█████▎    | 5866/11049 [1:00:24<53:08,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.5661671161651611, 'learning_rate': 5.333057735584627e-06, 'epoch': 1.59}

 53%|█████▎    | 5866/11049 [1:00:24<53:08,  1.63it/s]
 53%|█████▎    | 5867/11049 [1:00:24<53:05,  1.63it/s]
                                                      
{'loss': 0.2006, 'grad_norm': 0.5129633545875549, 'learning_rate': 5.331481585075838e-06, 'epoch': 1.59}

 53%|█████▎    | 5867/11049 [1:00:24<53:05,  1.63it/s]
 53%|█████▎    | 5868/11049 [1:00:25<53:01,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.48483210802078247, 'learning_rate': 5.329905401481612e-06, 'epoch': 1.59}

 53%|█████▎    | 5868/11049 [1:00:25<53:01,  1.63it/s]
 53%|█████▎    | 5869/11049 [1:00:25<53:02,  1.63it/s]
                                                      
{'loss': 0.2798, 'grad_norm': 0.6331503391265869, 'learning_rate': 5.328329184959263e-06, 'epoch': 1.59}

 53%|█████▎    | 5869/11049 [1:00:25<53:02,  1.63it/s]
 53%|█████▎    | 5870/11049 [1:00:26<53:03,  1.63it/s]
                                                      
{'loss': 0.2757, 'grad_norm': 0.6385791301727295, 'learning_rate': 5.326752935666118e-06, 'epoch': 1.59}

 53%|█████▎    | 5870/11049 [1:00:26<53:03,  1.63it/s]
 53%|█████▎    | 5871/11049 [1:00:27<53:00,  1.63it/s]
                                                      
{'loss': 0.2264, 'grad_norm': 0.5842313766479492, 'learning_rate': 5.325176653759504e-06, 'epoch': 1.59}

 53%|█████▎    | 5871/11049 [1:00:27<53:00,  1.63it/s]
 53%|█████▎    | 5872/11049 [1:00:27<52:59,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.5417373776435852, 'learning_rate': 5.323600339396749e-06, 'epoch': 1.59}

 53%|█████▎    | 5872/11049 [1:00:27<52:59,  1.63it/s]
 53%|█████▎    | 5873/11049 [1:00:28<52:57,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.5724193453788757, 'learning_rate': 5.322023992735188e-06, 'epoch': 1.59}

 53%|█████▎    | 5873/11049 [1:00:28<52:57,  1.63it/s]
 53%|█████▎    | 5874/11049 [1:00:28<52:57,  1.63it/s]
                                                      
{'loss': 0.1815, 'grad_norm': 0.4845239222049713, 'learning_rate': 5.320447613932157e-06, 'epoch': 1.59}

 53%|█████▎    | 5874/11049 [1:00:29<52:57,  1.63it/s]
 53%|█████▎    | 5875/11049 [1:00:29<53:00,  1.63it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.5872681140899658, 'learning_rate': 5.318871203144994e-06, 'epoch': 1.6}

 53%|█████▎    | 5875/11049 [1:00:29<53:00,  1.63it/s]
 53%|█████▎    | 5876/11049 [1:00:30<52:57,  1.63it/s]
                                                      
{'loss': 0.1845, 'grad_norm': 0.5064821839332581, 'learning_rate': 5.3172947605310434e-06, 'epoch': 1.6}

 53%|█████▎    | 5876/11049 [1:00:30<52:57,  1.63it/s]
 53%|█████▎    | 5877/11049 [1:00:30<52:56,  1.63it/s]
                                                      
{'loss': 0.248, 'grad_norm': 0.6759538650512695, 'learning_rate': 5.315718286247651e-06, 'epoch': 1.6}

 53%|█████▎    | 5877/11049 [1:00:30<52:56,  1.63it/s]
 53%|█████▎    | 5878/11049 [1:00:31<52:53,  1.63it/s]
                                                      
{'loss': 0.177, 'grad_norm': 0.5022595524787903, 'learning_rate': 5.3141417804521665e-06, 'epoch': 1.6}

 53%|█████▎    | 5878/11049 [1:00:31<52:53,  1.63it/s]
 53%|█████▎    | 5879/11049 [1:00:31<52:51,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.5859481692314148, 'learning_rate': 5.312565243301939e-06, 'epoch': 1.6}

 53%|█████▎    | 5879/11049 [1:00:32<52:51,  1.63it/s]
 53%|█████▎    | 5880/11049 [1:00:32<52:54,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.4970458149909973, 'learning_rate': 5.310988674954329e-06, 'epoch': 1.6}

 53%|█████▎    | 5880/11049 [1:00:32<52:54,  1.63it/s]
 53%|█████▎    | 5881/11049 [1:00:33<52:51,  1.63it/s]
                                                      
{'loss': 0.274, 'grad_norm': 0.6894893050193787, 'learning_rate': 5.309412075566692e-06, 'epoch': 1.6}

 53%|█████▎    | 5881/11049 [1:00:33<52:51,  1.63it/s]
 53%|█████▎    | 5882/11049 [1:00:33<54:11,  1.59it/s]
                                                      
{'loss': 0.1939, 'grad_norm': 0.5116114616394043, 'learning_rate': 5.3078354452963895e-06, 'epoch': 1.6}

 53%|█████▎    | 5882/11049 [1:00:34<54:11,  1.59it/s]
 53%|█████▎    | 5883/11049 [1:00:34<53:57,  1.60it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.5525174736976624, 'learning_rate': 5.306258784300786e-06, 'epoch': 1.6}

 53%|█████▎    | 5883/11049 [1:00:34<53:57,  1.60it/s]
 53%|█████▎    | 5884/11049 [1:00:35<53:36,  1.61it/s]
                                                      
{'loss': 0.2587, 'grad_norm': 0.683540403842926, 'learning_rate': 5.304682092737251e-06, 'epoch': 1.6}

 53%|█████▎    | 5884/11049 [1:00:35<53:36,  1.61it/s]
 53%|█████▎    | 5885/11049 [1:00:35<53:39,  1.60it/s]
                                                      
{'loss': 0.2212, 'grad_norm': 0.5258938670158386, 'learning_rate': 5.3031053707631545e-06, 'epoch': 1.6}

 53%|█████▎    | 5885/11049 [1:00:35<53:39,  1.60it/s]
 53%|█████▎    | 5886/11049 [1:00:36<53:26,  1.61it/s]
                                                      
{'loss': 0.2028, 'grad_norm': 0.4528655409812927, 'learning_rate': 5.3015286185358706e-06, 'epoch': 1.6}

 53%|█████▎    | 5886/11049 [1:00:36<53:26,  1.61it/s]
 53%|█████▎    | 5887/11049 [1:00:36<53:13,  1.62it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.4890059530735016, 'learning_rate': 5.299951836212774e-06, 'epoch': 1.6}

 53%|█████▎    | 5887/11049 [1:00:37<53:13,  1.62it/s]
 53%|█████▎    | 5888/11049 [1:00:37<53:04,  1.62it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.5874205827713013, 'learning_rate': 5.298375023951249e-06, 'epoch': 1.6}

 53%|█████▎    | 5888/11049 [1:00:37<53:04,  1.62it/s]
 53%|█████▎    | 5889/11049 [1:00:38<52:59,  1.62it/s]
                                                      
{'loss': 0.2755, 'grad_norm': 0.6203283071517944, 'learning_rate': 5.296798181908673e-06, 'epoch': 1.6}

 53%|█████▎    | 5889/11049 [1:00:38<52:59,  1.62it/s]
 53%|█████▎    | 5890/11049 [1:00:38<53:03,  1.62it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.4735419750213623, 'learning_rate': 5.295221310242438e-06, 'epoch': 1.6}

 53%|█████▎    | 5890/11049 [1:00:38<53:03,  1.62it/s]
 53%|█████▎    | 5891/11049 [1:00:39<52:58,  1.62it/s]
                                                      
{'loss': 0.1823, 'grad_norm': 0.5045605301856995, 'learning_rate': 5.293644409109928e-06, 'epoch': 1.6}

 53%|█████▎    | 5891/11049 [1:00:39<52:58,  1.62it/s]
 53%|█████▎    | 5892/11049 [1:00:40<52:54,  1.62it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.5755146741867065, 'learning_rate': 5.2920674786685365e-06, 'epoch': 1.6}

 53%|█████▎    | 5892/11049 [1:00:40<52:54,  1.62it/s]
 53%|█████▎    | 5893/11049 [1:00:40<52:51,  1.63it/s]
                                                      
{'loss': 0.1994, 'grad_norm': 0.5651224851608276, 'learning_rate': 5.2904905190756574e-06, 'epoch': 1.6}

 53%|█████▎    | 5893/11049 [1:00:40<52:51,  1.63it/s]
 53%|█████▎    | 5894/11049 [1:00:41<54:05,  1.59it/s]
                                                      
{'loss': 0.1859, 'grad_norm': 0.5039792060852051, 'learning_rate': 5.288913530488691e-06, 'epoch': 1.6}

 53%|█████▎    | 5894/11049 [1:00:41<54:05,  1.59it/s]
 53%|█████▎    | 5895/11049 [1:00:41<53:55,  1.59it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.5819860100746155, 'learning_rate': 5.2873365130650335e-06, 'epoch': 1.6}

 53%|█████▎    | 5895/11049 [1:00:42<53:55,  1.59it/s]
 53%|█████▎    | 5896/11049 [1:00:42<53:35,  1.60it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.5655066967010498, 'learning_rate': 5.285759466962092e-06, 'epoch': 1.6}

 53%|█████▎    | 5896/11049 [1:00:42<53:35,  1.60it/s]
 53%|█████▎    | 5897/11049 [1:00:43<53:18,  1.61it/s]
                                                      
{'loss': 0.1755, 'grad_norm': 0.4939795136451721, 'learning_rate': 5.284182392337269e-06, 'epoch': 1.6}

 53%|█████▎    | 5897/11049 [1:00:43<53:18,  1.61it/s]
 53%|█████▎    | 5898/11049 [1:00:43<53:07,  1.62it/s]
                                                      
{'loss': 0.1901, 'grad_norm': 0.49445587396621704, 'learning_rate': 5.282605289347978e-06, 'epoch': 1.6}

 53%|█████▎    | 5898/11049 [1:00:43<53:07,  1.62it/s]
 53%|█████▎    | 5899/11049 [1:00:44<53:00,  1.62it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.49775394797325134, 'learning_rate': 5.281028158151629e-06, 'epoch': 1.6}

 53%|█████▎    | 5899/11049 [1:00:44<53:00,  1.62it/s]
 53%|█████▎    | 5900/11049 [1:00:45<52:56,  1.62it/s]
                                                      
{'loss': 0.2318, 'grad_norm': 0.5946958661079407, 'learning_rate': 5.279450998905635e-06, 'epoch': 1.6}

 53%|█████▎    | 5900/11049 [1:00:45<52:56,  1.62it/s]
 53%|█████▎    | 5901/11049 [1:00:45<52:55,  1.62it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.4955833852291107, 'learning_rate': 5.277873811767415e-06, 'epoch': 1.6}

 53%|█████▎    | 5901/11049 [1:00:45<52:55,  1.62it/s]
 53%|█████▎    | 5902/11049 [1:00:46<52:48,  1.62it/s]
                                                      
{'loss': 0.2583, 'grad_norm': 0.6125827431678772, 'learning_rate': 5.2762965968943894e-06, 'epoch': 1.6}

 53%|█████▎    | 5902/11049 [1:00:46<52:48,  1.62it/s]
 53%|█████▎    | 5903/11049 [1:00:46<52:44,  1.63it/s]
                                                      
{'loss': 0.1938, 'grad_norm': 0.6125308871269226, 'learning_rate': 5.274719354443981e-06, 'epoch': 1.6}

 53%|█████▎    | 5903/11049 [1:00:47<52:44,  1.63it/s]
 53%|█████▎    | 5904/11049 [1:00:47<52:42,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.6156142950057983, 'learning_rate': 5.273142084573617e-06, 'epoch': 1.6}

 53%|█████▎    | 5904/11049 [1:00:47<52:42,  1.63it/s]
 53%|█████▎    | 5905/11049 [1:00:48<52:58,  1.62it/s]
                                                      
{'loss': 0.2245, 'grad_norm': 0.5494880080223083, 'learning_rate': 5.271564787440723e-06, 'epoch': 1.6}

 53%|█████▎    | 5905/11049 [1:00:48<52:58,  1.62it/s]
 53%|█████▎    | 5906/11049 [1:00:48<52:53,  1.62it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5171440243721008, 'learning_rate': 5.269987463202732e-06, 'epoch': 1.6}

 53%|█████▎    | 5906/11049 [1:00:48<52:53,  1.62it/s]
 53%|█████▎    | 5907/11049 [1:00:49<52:47,  1.62it/s]
                                                      
{'loss': 0.1811, 'grad_norm': 0.4850439429283142, 'learning_rate': 5.268410112017078e-06, 'epoch': 1.6}

 53%|█████▎    | 5907/11049 [1:00:49<52:47,  1.62it/s]
 53%|█████▎    | 5908/11049 [1:00:49<52:43,  1.63it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.5936897993087769, 'learning_rate': 5.266832734041198e-06, 'epoch': 1.6}

 53%|█████▎    | 5908/11049 [1:00:50<52:43,  1.63it/s]
 53%|█████▎    | 5909/11049 [1:00:50<52:42,  1.63it/s]
                                                      
{'loss': 0.1773, 'grad_norm': 0.5142015814781189, 'learning_rate': 5.2652553294325326e-06, 'epoch': 1.6}

 53%|█████▎    | 5909/11049 [1:00:50<52:42,  1.63it/s]
 53%|█████▎    | 5910/11049 [1:00:51<52:44,  1.62it/s]
                                                      
{'loss': 0.1617, 'grad_norm': 0.45259320735931396, 'learning_rate': 5.2636778983485195e-06, 'epoch': 1.6}

 53%|█████▎    | 5910/11049 [1:00:51<52:44,  1.62it/s]
 53%|█████▎    | 5911/11049 [1:00:51<52:41,  1.63it/s]
                                                      
{'loss': 0.2219, 'grad_norm': 0.5138906836509705, 'learning_rate': 5.262100440946607e-06, 'epoch': 1.6}

 53%|█████▎    | 5911/11049 [1:00:51<52:41,  1.63it/s]
 54%|█████▎    | 5912/11049 [1:00:52<52:37,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5193764567375183, 'learning_rate': 5.260522957384241e-06, 'epoch': 1.61}

 54%|█████▎    | 5912/11049 [1:00:52<52:37,  1.63it/s]
 54%|█████▎    | 5913/11049 [1:00:53<52:34,  1.63it/s]
                                                      
{'loss': 0.264, 'grad_norm': 0.6329810619354248, 'learning_rate': 5.258945447818872e-06, 'epoch': 1.61}

 54%|█████▎    | 5913/11049 [1:00:53<52:34,  1.63it/s]
 54%|█████▎    | 5914/11049 [1:00:53<52:31,  1.63it/s]
                                                      
{'loss': 0.2089, 'grad_norm': 0.6612871289253235, 'learning_rate': 5.257367912407953e-06, 'epoch': 1.61}

 54%|█████▎    | 5914/11049 [1:00:53<52:31,  1.63it/s]
 54%|█████▎    | 5915/11049 [1:00:54<52:32,  1.63it/s]
                                                      
{'loss': 0.2567, 'grad_norm': 0.5960834622383118, 'learning_rate': 5.255790351308937e-06, 'epoch': 1.61}

 54%|█████▎    | 5915/11049 [1:00:54<52:32,  1.63it/s]
 54%|█████▎    | 5916/11049 [1:00:54<52:32,  1.63it/s]
                                                      
{'loss': 0.2204, 'grad_norm': 0.5636206269264221, 'learning_rate': 5.254212764679283e-06, 'epoch': 1.61}

 54%|█████▎    | 5916/11049 [1:00:54<52:32,  1.63it/s]
 54%|█████▎    | 5917/11049 [1:00:55<52:30,  1.63it/s]
                                                      
{'loss': 0.1999, 'grad_norm': 0.5575878620147705, 'learning_rate': 5.2526351526764515e-06, 'epoch': 1.61}

 54%|█████▎    | 5917/11049 [1:00:55<52:30,  1.63it/s]
 54%|█████▎    | 5918/11049 [1:00:56<52:28,  1.63it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5948829650878906, 'learning_rate': 5.251057515457906e-06, 'epoch': 1.61}

 54%|█████▎    | 5918/11049 [1:00:56<52:28,  1.63it/s]
 54%|█████▎    | 5919/11049 [1:00:56<52:28,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.5255890488624573, 'learning_rate': 5.24947985318111e-06, 'epoch': 1.61}

 54%|█████▎    | 5919/11049 [1:00:56<52:28,  1.63it/s]
 54%|█████▎    | 5920/11049 [1:00:57<52:28,  1.63it/s]
                                                      
{'loss': 0.2272, 'grad_norm': 0.537489116191864, 'learning_rate': 5.24790216600353e-06, 'epoch': 1.61}

 54%|█████▎    | 5920/11049 [1:00:57<52:28,  1.63it/s]
 54%|█████▎    | 5921/11049 [1:00:57<52:27,  1.63it/s]
                                                      
{'loss': 0.2681, 'grad_norm': 0.5559991598129272, 'learning_rate': 5.24632445408264e-06, 'epoch': 1.61}

 54%|█████▎    | 5921/11049 [1:00:58<52:27,  1.63it/s]
 54%|█████▎    | 5922/11049 [1:00:58<52:27,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.5615928769111633, 'learning_rate': 5.24474671757591e-06, 'epoch': 1.61}

 54%|█████▎    | 5922/11049 [1:00:58<52:27,  1.63it/s]
 54%|█████▎    | 5923/11049 [1:00:59<52:26,  1.63it/s]
                                                      
{'loss': 0.2567, 'grad_norm': 0.6728448271751404, 'learning_rate': 5.2431689566408165e-06, 'epoch': 1.61}

 54%|█████▎    | 5923/11049 [1:00:59<52:26,  1.63it/s]
 54%|█████▎    | 5924/11049 [1:00:59<52:24,  1.63it/s]
                                                      
{'loss': 0.2778, 'grad_norm': 0.5267772674560547, 'learning_rate': 5.241591171434835e-06, 'epoch': 1.61}

 54%|█████▎    | 5924/11049 [1:00:59<52:24,  1.63it/s]
 54%|█████▎    | 5925/11049 [1:01:00<52:25,  1.63it/s]
                                                      
{'loss': 0.2359, 'grad_norm': 0.6128374338150024, 'learning_rate': 5.240013362115447e-06, 'epoch': 1.61}

 54%|█████▎    | 5925/11049 [1:01:00<52:25,  1.63it/s]
 54%|█████▎    | 5926/11049 [1:01:01<52:23,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.5263866186141968, 'learning_rate': 5.2384355288401345e-06, 'epoch': 1.61}

 54%|█████▎    | 5926/11049 [1:01:01<52:23,  1.63it/s]
 54%|█████▎    | 5927/11049 [1:01:01<52:24,  1.63it/s]
                                                      
{'loss': 0.2658, 'grad_norm': 0.6179332733154297, 'learning_rate': 5.2368576717663845e-06, 'epoch': 1.61}

 54%|█████▎    | 5927/11049 [1:01:01<52:24,  1.63it/s]
 54%|█████▎    | 5928/11049 [1:01:02<52:21,  1.63it/s]
                                                      
{'loss': 0.2027, 'grad_norm': 0.5165181159973145, 'learning_rate': 5.235279791051681e-06, 'epoch': 1.61}

 54%|█████▎    | 5928/11049 [1:01:02<52:21,  1.63it/s]
 54%|█████▎    | 5929/11049 [1:01:02<52:20,  1.63it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.5838059186935425, 'learning_rate': 5.233701886853515e-06, 'epoch': 1.61}

 54%|█████▎    | 5929/11049 [1:01:02<52:20,  1.63it/s]
 54%|█████▎    | 5930/11049 [1:01:03<52:20,  1.63it/s]
                                                      
{'loss': 0.1773, 'grad_norm': 0.5182381868362427, 'learning_rate': 5.232123959329376e-06, 'epoch': 1.61}

 54%|█████▎    | 5930/11049 [1:01:03<52:20,  1.63it/s]
 54%|█████▎    | 5931/11049 [1:01:04<52:19,  1.63it/s]
                                                      
{'loss': 0.1852, 'grad_norm': 0.4859094023704529, 'learning_rate': 5.230546008636763e-06, 'epoch': 1.61}

 54%|█████▎    | 5931/11049 [1:01:04<52:19,  1.63it/s]
 54%|█████▎    | 5932/11049 [1:01:04<52:19,  1.63it/s]
                                                      
{'loss': 0.233, 'grad_norm': 0.5180421471595764, 'learning_rate': 5.2289680349331695e-06, 'epoch': 1.61}

 54%|█████▎    | 5932/11049 [1:01:04<52:19,  1.63it/s]
 54%|█████▎    | 5933/11049 [1:01:05<52:19,  1.63it/s]
                                                      
{'loss': 0.1529, 'grad_norm': 0.4585719704627991, 'learning_rate': 5.227390038376094e-06, 'epoch': 1.61}

 54%|█████▎    | 5933/11049 [1:01:05<52:19,  1.63it/s]
 54%|█████▎    | 5934/11049 [1:01:05<52:19,  1.63it/s]
                                                      
{'loss': 0.1888, 'grad_norm': 0.518336296081543, 'learning_rate': 5.225812019123038e-06, 'epoch': 1.61}

 54%|█████▎    | 5934/11049 [1:01:06<52:19,  1.63it/s]
 54%|█████▎    | 5935/11049 [1:01:06<52:30,  1.62it/s]
                                                      
{'loss': 0.1839, 'grad_norm': 0.47650986909866333, 'learning_rate': 5.224233977331506e-06, 'epoch': 1.61}

 54%|█████▎    | 5935/11049 [1:01:06<52:30,  1.62it/s]
 54%|█████▎    | 5936/11049 [1:01:07<52:18,  1.63it/s]
                                                      
{'loss': 0.2153, 'grad_norm': 0.557795524597168, 'learning_rate': 5.222655913159001e-06, 'epoch': 1.61}

 54%|█████▎    | 5936/11049 [1:01:07<52:18,  1.63it/s]
 54%|█████▎    | 5937/11049 [1:01:07<52:17,  1.63it/s]
                                                      
{'loss': 0.1676, 'grad_norm': 0.4957614839076996, 'learning_rate': 5.221077826763035e-06, 'epoch': 1.61}

 54%|█████▎    | 5937/11049 [1:01:07<52:17,  1.63it/s]
 54%|█████▎    | 5938/11049 [1:01:08<52:15,  1.63it/s]
                                                      
{'loss': 0.2191, 'grad_norm': 0.5082067251205444, 'learning_rate': 5.219499718301113e-06, 'epoch': 1.61}

 54%|█████▎    | 5938/11049 [1:01:08<52:15,  1.63it/s]
 54%|█████▍    | 5939/11049 [1:01:08<52:14,  1.63it/s]
                                                      
{'loss': 0.1677, 'grad_norm': 0.4313064515590668, 'learning_rate': 5.217921587930751e-06, 'epoch': 1.61}

 54%|█████▍    | 5939/11049 [1:01:09<52:14,  1.63it/s]
 54%|█████▍    | 5940/11049 [1:01:09<52:13,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.5094134211540222, 'learning_rate': 5.2163434358094624e-06, 'epoch': 1.61}

 54%|█████▍    | 5940/11049 [1:01:09<52:13,  1.63it/s]
 54%|█████▍    | 5941/11049 [1:01:10<52:13,  1.63it/s]
                                                      
{'loss': 0.1686, 'grad_norm': 0.4489089846611023, 'learning_rate': 5.214765262094764e-06, 'epoch': 1.61}

 54%|█████▍    | 5941/11049 [1:01:10<52:13,  1.63it/s]
 54%|█████▍    | 5942/11049 [1:01:10<52:12,  1.63it/s]
                                                      
{'loss': 0.1975, 'grad_norm': 0.48494529724121094, 'learning_rate': 5.213187066944173e-06, 'epoch': 1.61}

 54%|█████▍    | 5942/11049 [1:01:10<52:12,  1.63it/s]
 54%|█████▍    | 5943/11049 [1:01:11<52:13,  1.63it/s]
                                                      
{'loss': 0.2682, 'grad_norm': 0.538010835647583, 'learning_rate': 5.211608850515213e-06, 'epoch': 1.61}

 54%|█████▍    | 5943/11049 [1:01:11<52:13,  1.63it/s]
 54%|█████▍    | 5944/11049 [1:01:12<52:17,  1.63it/s]
                                                      
{'loss': 0.2242, 'grad_norm': 0.494295597076416, 'learning_rate': 5.210030612965403e-06, 'epoch': 1.61}

 54%|█████▍    | 5944/11049 [1:01:12<52:17,  1.63it/s]
 54%|█████▍    | 5945/11049 [1:01:12<52:15,  1.63it/s]
                                                      
{'loss': 0.179, 'grad_norm': 0.6030604839324951, 'learning_rate': 5.208452354452275e-06, 'epoch': 1.61}

 54%|█████▍    | 5945/11049 [1:01:12<52:15,  1.63it/s]
 54%|█████▍    | 5946/11049 [1:01:13<52:14,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5745953321456909, 'learning_rate': 5.206874075133349e-06, 'epoch': 1.61}

 54%|█████▍    | 5946/11049 [1:01:13<52:14,  1.63it/s]
 54%|█████▍    | 5947/11049 [1:01:13<52:11,  1.63it/s]
                                                      
{'loss': 0.2148, 'grad_norm': 0.5068653225898743, 'learning_rate': 5.205295775166158e-06, 'epoch': 1.61}

 54%|█████▍    | 5947/11049 [1:01:14<52:11,  1.63it/s]
 54%|█████▍    | 5948/11049 [1:01:14<52:09,  1.63it/s]
                                                      
{'loss': 0.1721, 'grad_norm': 0.47426295280456543, 'learning_rate': 5.203717454708231e-06, 'epoch': 1.61}

 54%|█████▍    | 5948/11049 [1:01:14<52:09,  1.63it/s]
 54%|█████▍    | 5949/11049 [1:01:15<52:13,  1.63it/s]
                                                      
{'loss': 0.169, 'grad_norm': 0.571739673614502, 'learning_rate': 5.202139113917108e-06, 'epoch': 1.62}

 54%|█████▍    | 5949/11049 [1:01:15<52:13,  1.63it/s]
 54%|█████▍    | 5950/11049 [1:01:15<52:12,  1.63it/s]
                                                      
{'loss': 0.2083, 'grad_norm': 0.5256932377815247, 'learning_rate': 5.200560752950314e-06, 'epoch': 1.62}

 54%|█████▍    | 5950/11049 [1:01:15<52:12,  1.63it/s]
 54%|█████▍    | 5951/11049 [1:01:16<52:08,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.6183280348777771, 'learning_rate': 5.198982371965395e-06, 'epoch': 1.62}

 54%|█████▍    | 5951/11049 [1:01:16<52:08,  1.63it/s]
 54%|█████▍    | 5952/11049 [1:01:16<52:07,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.5874030590057373, 'learning_rate': 5.197403971119885e-06, 'epoch': 1.62}

 54%|█████▍    | 5952/11049 [1:01:17<52:07,  1.63it/s]
 54%|█████▍    | 5953/11049 [1:01:17<52:06,  1.63it/s]
                                                      
{'loss': 0.1698, 'grad_norm': 0.4664185345172882, 'learning_rate': 5.1958255505713305e-06, 'epoch': 1.62}

 54%|█████▍    | 5953/11049 [1:01:17<52:06,  1.63it/s]
 54%|█████▍    | 5954/11049 [1:01:18<52:05,  1.63it/s]
                                                      
{'loss': 0.194, 'grad_norm': 0.5669452548027039, 'learning_rate': 5.194247110477272e-06, 'epoch': 1.62}

 54%|█████▍    | 5954/11049 [1:01:18<52:05,  1.63it/s]
 54%|█████▍    | 5955/11049 [1:01:18<52:05,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.4903378486633301, 'learning_rate': 5.192668650995255e-06, 'epoch': 1.62}

 54%|█████▍    | 5955/11049 [1:01:18<52:05,  1.63it/s]
 54%|█████▍    | 5956/11049 [1:01:19<52:05,  1.63it/s]
                                                      
{'loss': 0.2084, 'grad_norm': 0.5311864018440247, 'learning_rate': 5.191090172282826e-06, 'epoch': 1.62}

 54%|█████▍    | 5956/11049 [1:01:19<52:05,  1.63it/s]
 54%|█████▍    | 5957/11049 [1:01:20<52:04,  1.63it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.5382710099220276, 'learning_rate': 5.189511674497536e-06, 'epoch': 1.62}

 54%|█████▍    | 5957/11049 [1:01:20<52:04,  1.63it/s]
 54%|█████▍    | 5958/11049 [1:01:20<52:04,  1.63it/s]
                                                      
{'loss': 0.2437, 'grad_norm': 0.643195629119873, 'learning_rate': 5.187933157796935e-06, 'epoch': 1.62}

 54%|█████▍    | 5958/11049 [1:01:20<52:04,  1.63it/s]
 54%|█████▍    | 5959/11049 [1:01:21<52:04,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.4529576599597931, 'learning_rate': 5.186354622338578e-06, 'epoch': 1.62}

 54%|█████▍    | 5959/11049 [1:01:21<52:04,  1.63it/s]
 54%|█████▍    | 5960/11049 [1:01:21<52:03,  1.63it/s]
                                                      
{'loss': 0.2322, 'grad_norm': 0.6221634149551392, 'learning_rate': 5.1847760682800154e-06, 'epoch': 1.62}

 54%|█████▍    | 5960/11049 [1:01:22<52:03,  1.63it/s]
 54%|█████▍    | 5961/11049 [1:01:22<52:02,  1.63it/s]
                                                      
{'loss': 0.2395, 'grad_norm': 0.5900593400001526, 'learning_rate': 5.1831974957788075e-06, 'epoch': 1.62}

 54%|█████▍    | 5961/11049 [1:01:22<52:02,  1.63it/s]
 54%|█████▍    | 5962/11049 [1:01:23<52:00,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.4999561607837677, 'learning_rate': 5.181618904992512e-06, 'epoch': 1.62}

 54%|█████▍    | 5962/11049 [1:01:23<52:00,  1.63it/s]
 54%|█████▍    | 5963/11049 [1:01:23<51:59,  1.63it/s]
                                                      
{'loss': 0.2286, 'grad_norm': 0.5757396221160889, 'learning_rate': 5.180040296078691e-06, 'epoch': 1.62}

 54%|█████▍    | 5963/11049 [1:01:23<51:59,  1.63it/s]
 54%|█████▍    | 5964/11049 [1:01:24<51:58,  1.63it/s]
                                                      
{'loss': 0.2301, 'grad_norm': 0.6218191981315613, 'learning_rate': 5.178461669194903e-06, 'epoch': 1.62}

 54%|█████▍    | 5964/11049 [1:01:24<51:58,  1.63it/s]
 54%|█████▍    | 5965/11049 [1:01:24<51:57,  1.63it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.488665908575058, 'learning_rate': 5.176883024498716e-06, 'epoch': 1.62}

 54%|█████▍    | 5965/11049 [1:01:25<51:57,  1.63it/s]
 54%|█████▍    | 5966/11049 [1:01:25<51:57,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.5152221322059631, 'learning_rate': 5.175304362147692e-06, 'epoch': 1.62}

 54%|█████▍    | 5966/11049 [1:01:25<51:57,  1.63it/s]
 54%|█████▍    | 5967/11049 [1:01:26<51:56,  1.63it/s]
                                                      
{'loss': 0.1957, 'grad_norm': 0.5354474186897278, 'learning_rate': 5.173725682299402e-06, 'epoch': 1.62}

 54%|█████▍    | 5967/11049 [1:01:26<51:56,  1.63it/s]
 54%|█████▍    | 5968/11049 [1:01:26<51:55,  1.63it/s]
                                                      
{'loss': 0.2565, 'grad_norm': 0.6305788159370422, 'learning_rate': 5.1721469851114124e-06, 'epoch': 1.62}

 54%|█████▍    | 5968/11049 [1:01:26<51:55,  1.63it/s]
 54%|█████▍    | 5969/11049 [1:01:27<51:57,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5591181516647339, 'learning_rate': 5.1705682707412965e-06, 'epoch': 1.62}

 54%|█████▍    | 5969/11049 [1:01:27<51:57,  1.63it/s]
 54%|█████▍    | 5970/11049 [1:01:28<51:54,  1.63it/s]
                                                      
{'loss': 0.2568, 'grad_norm': 0.6878177523612976, 'learning_rate': 5.168989539346625e-06, 'epoch': 1.62}

 54%|█████▍    | 5970/11049 [1:01:28<51:54,  1.63it/s]
 54%|█████▍    | 5971/11049 [1:01:28<51:54,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5540692806243896, 'learning_rate': 5.167410791084973e-06, 'epoch': 1.62}

 54%|█████▍    | 5971/11049 [1:01:28<51:54,  1.63it/s]
 54%|█████▍    | 5972/11049 [1:01:29<51:54,  1.63it/s]
                                                      
{'loss': 0.2558, 'grad_norm': 0.6061499714851379, 'learning_rate': 5.16583202611392e-06, 'epoch': 1.62}

 54%|█████▍    | 5972/11049 [1:01:29<51:54,  1.63it/s]
 54%|█████▍    | 5973/11049 [1:01:29<51:53,  1.63it/s]
                                                      
{'loss': 0.1771, 'grad_norm': 0.5061869025230408, 'learning_rate': 5.1642532445910385e-06, 'epoch': 1.62}

 54%|█████▍    | 5973/11049 [1:01:29<51:53,  1.63it/s]
 54%|█████▍    | 5974/11049 [1:01:30<51:53,  1.63it/s]
                                                      
{'loss': 0.226, 'grad_norm': 0.6103920340538025, 'learning_rate': 5.16267444667391e-06, 'epoch': 1.62}

 54%|█████▍    | 5974/11049 [1:01:30<51:53,  1.63it/s]
 54%|█████▍    | 5975/11049 [1:01:31<51:53,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.6724069118499756, 'learning_rate': 5.161095632520117e-06, 'epoch': 1.62}

 54%|█████▍    | 5975/11049 [1:01:31<51:53,  1.63it/s]
 54%|█████▍    | 5976/11049 [1:01:31<51:52,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.5843299627304077, 'learning_rate': 5.159516802287241e-06, 'epoch': 1.62}

 54%|█████▍    | 5976/11049 [1:01:31<51:52,  1.63it/s]
 54%|█████▍    | 5977/11049 [1:01:32<51:52,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.5048021674156189, 'learning_rate': 5.157937956132866e-06, 'epoch': 1.62}

 54%|█████▍    | 5977/11049 [1:01:32<51:52,  1.63it/s]
 54%|█████▍    | 5978/11049 [1:01:32<51:50,  1.63it/s]
                                                      
{'loss': 0.1643, 'grad_norm': 0.4542459547519684, 'learning_rate': 5.156359094214577e-06, 'epoch': 1.62}

 54%|█████▍    | 5978/11049 [1:01:33<51:50,  1.63it/s]
 54%|█████▍    | 5979/11049 [1:01:33<51:48,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.5924171209335327, 'learning_rate': 5.154780216689964e-06, 'epoch': 1.62}

 54%|█████▍    | 5979/11049 [1:01:33<51:48,  1.63it/s]
 54%|█████▍    | 5980/11049 [1:01:34<51:48,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.4652291238307953, 'learning_rate': 5.153201323716614e-06, 'epoch': 1.62}

 54%|█████▍    | 5980/11049 [1:01:34<51:48,  1.63it/s]
 54%|█████▍    | 5981/11049 [1:01:34<51:49,  1.63it/s]
                                                      
{'loss': 0.222, 'grad_norm': 0.5575240850448608, 'learning_rate': 5.151622415452119e-06, 'epoch': 1.62}

 54%|█████▍    | 5981/11049 [1:01:34<51:49,  1.63it/s]
 54%|█████▍    | 5982/11049 [1:01:35<51:47,  1.63it/s]
                                                      
{'loss': 0.2595, 'grad_norm': 0.6563448905944824, 'learning_rate': 5.150043492054069e-06, 'epoch': 1.62}

 54%|█████▍    | 5982/11049 [1:01:35<51:47,  1.63it/s]
 54%|█████▍    | 5983/11049 [1:01:35<51:46,  1.63it/s]
                                                      
{'loss': 0.2075, 'grad_norm': 0.5269074440002441, 'learning_rate': 5.14846455368006e-06, 'epoch': 1.62}

 54%|█████▍    | 5983/11049 [1:01:36<51:46,  1.63it/s]
 54%|█████▍    | 5984/11049 [1:01:36<51:48,  1.63it/s]
                                                      
{'loss': 0.2153, 'grad_norm': 0.5836468935012817, 'learning_rate': 5.146885600487685e-06, 'epoch': 1.62}

 54%|█████▍    | 5984/11049 [1:01:36<51:48,  1.63it/s]
 54%|█████▍    | 5985/11049 [1:01:37<51:48,  1.63it/s]
                                                      
{'loss': 0.1529, 'grad_norm': 0.43407249450683594, 'learning_rate': 5.145306632634544e-06, 'epoch': 1.63}

 54%|█████▍    | 5985/11049 [1:01:37<51:48,  1.63it/s]
 54%|█████▍    | 5986/11049 [1:01:37<51:47,  1.63it/s]
                                                      
{'loss': 0.186, 'grad_norm': 0.5277095437049866, 'learning_rate': 5.1437276502782305e-06, 'epoch': 1.63}

 54%|█████▍    | 5986/11049 [1:01:37<51:47,  1.63it/s]
 54%|█████▍    | 5987/11049 [1:01:38<51:47,  1.63it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.5152656435966492, 'learning_rate': 5.142148653576346e-06, 'epoch': 1.63}

 54%|█████▍    | 5987/11049 [1:01:38<51:47,  1.63it/s]
 54%|█████▍    | 5988/11049 [1:01:39<51:46,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5735384821891785, 'learning_rate': 5.1405696426864916e-06, 'epoch': 1.63}

 54%|█████▍    | 5988/11049 [1:01:39<51:46,  1.63it/s]
 54%|█████▍    | 5989/11049 [1:01:39<51:45,  1.63it/s]
                                                      
{'loss': 0.2263, 'grad_norm': 0.5947397351264954, 'learning_rate': 5.1389906177662705e-06, 'epoch': 1.63}

 54%|█████▍    | 5989/11049 [1:01:39<51:45,  1.63it/s]
 54%|█████▍    | 5990/11049 [1:01:40<51:44,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.5291584134101868, 'learning_rate': 5.137411578973286e-06, 'epoch': 1.63}

 54%|█████▍    | 5990/11049 [1:01:40<51:44,  1.63it/s]
 54%|█████▍    | 5991/11049 [1:01:40<51:43,  1.63it/s]
                                                      
{'loss': 0.2503, 'grad_norm': 0.6148781180381775, 'learning_rate': 5.135832526465142e-06, 'epoch': 1.63}

 54%|█████▍    | 5991/11049 [1:01:41<51:43,  1.63it/s]
 54%|█████▍    | 5992/11049 [1:01:41<51:41,  1.63it/s]
                                                      
{'loss': 0.2789, 'grad_norm': 0.5903288722038269, 'learning_rate': 5.134253460399444e-06, 'epoch': 1.63}

 54%|█████▍    | 5992/11049 [1:01:41<51:41,  1.63it/s]
 54%|█████▍    | 5993/11049 [1:01:42<51:41,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.5252858996391296, 'learning_rate': 5.132674380933803e-06, 'epoch': 1.63}

 54%|█████▍    | 5993/11049 [1:01:42<51:41,  1.63it/s]
 54%|█████▍    | 5994/11049 [1:01:42<51:40,  1.63it/s]
                                                      
{'loss': 0.2539, 'grad_norm': 0.6184556484222412, 'learning_rate': 5.131095288225827e-06, 'epoch': 1.63}

 54%|█████▍    | 5994/11049 [1:01:42<51:40,  1.63it/s]
 54%|█████▍    | 5995/11049 [1:01:43<51:39,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5568743348121643, 'learning_rate': 5.129516182433126e-06, 'epoch': 1.63}

 54%|█████▍    | 5995/11049 [1:01:43<51:39,  1.63it/s]
 54%|█████▍    | 5996/11049 [1:01:43<51:38,  1.63it/s]
                                                      
{'loss': 0.2008, 'grad_norm': 0.559810221195221, 'learning_rate': 5.127937063713312e-06, 'epoch': 1.63}

 54%|█████▍    | 5996/11049 [1:01:44<51:38,  1.63it/s]
 54%|█████▍    | 5997/11049 [1:01:44<51:37,  1.63it/s]
                                                      
{'loss': 0.1996, 'grad_norm': 0.4885689616203308, 'learning_rate': 5.126357932223998e-06, 'epoch': 1.63}

 54%|█████▍    | 5997/11049 [1:01:44<51:37,  1.63it/s]
 54%|█████▍    | 5998/11049 [1:01:45<51:37,  1.63it/s]
                                                      
{'loss': 0.296, 'grad_norm': 0.6839284896850586, 'learning_rate': 5.124778788122799e-06, 'epoch': 1.63}

 54%|█████▍    | 5998/11049 [1:01:45<51:37,  1.63it/s]
 54%|█████▍    | 5999/11049 [1:01:45<51:40,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.4733452796936035, 'learning_rate': 5.1231996315673295e-06, 'epoch': 1.63}

 54%|█████▍    | 5999/11049 [1:01:45<51:40,  1.63it/s]
 54%|█████▍    | 6000/11049 [1:01:46<51:40,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.521257758140564, 'learning_rate': 5.121620462715205e-06, 'epoch': 1.63}

 54%|█████▍    | 6000/11049 [1:01:46<51:40,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.35it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.90it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.5604312419891357, 'eval_runtime': 1.9539, 'eval_samples_per_second': 102.359, 'eval_steps_per_second': 6.653, 'epoch': 1.63}

 54%|█████▍    | 6000/11049 [1:01:48<51:40,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 54%|█████▍    | 6001/11049 [1:01:48<1:41:05,  1.20s/it]
                                                        
{'loss': 0.1504, 'grad_norm': 0.442032128572464, 'learning_rate': 5.120041281724048e-06, 'epoch': 1.63}

 54%|█████▍    | 6001/11049 [1:01:49<1:41:05,  1.20s/it]
 54%|█████▍    | 6002/11049 [1:01:49<1:26:12,  1.02s/it]
                                                        
{'loss': 0.2268, 'grad_norm': 0.5761362910270691, 'learning_rate': 5.118462088751475e-06, 'epoch': 1.63}

 54%|█████▍    | 6002/11049 [1:01:49<1:26:12,  1.02s/it]
 54%|█████▍    | 6003/11049 [1:01:50<1:15:49,  1.11it/s]
                                                        
{'loss': 0.2162, 'grad_norm': 0.5688129663467407, 'learning_rate': 5.1168828839551075e-06, 'epoch': 1.63}

 54%|█████▍    | 6003/11049 [1:01:50<1:15:49,  1.11it/s]
 54%|█████▍    | 6004/11049 [1:01:50<1:08:35,  1.23it/s]
                                                        
{'loss': 0.2385, 'grad_norm': 0.6157355308532715, 'learning_rate': 5.115303667492565e-06, 'epoch': 1.63}

 54%|█████▍    | 6004/11049 [1:01:50<1:08:35,  1.23it/s]
 54%|█████▍    | 6005/11049 [1:01:51<1:03:29,  1.32it/s]
                                                        
{'loss': 0.2837, 'grad_norm': 0.6291514039039612, 'learning_rate': 5.1137244395214725e-06, 'epoch': 1.63}

 54%|█████▍    | 6005/11049 [1:01:51<1:03:29,  1.32it/s]
 54%|█████▍    | 6006/11049 [1:01:52<59:55,  1.40it/s]  
                                                      
{'loss': 0.2203, 'grad_norm': 0.6600533127784729, 'learning_rate': 5.112145200199453e-06, 'epoch': 1.63}

 54%|█████▍    | 6006/11049 [1:01:52<59:55,  1.40it/s]
 54%|█████▍    | 6007/11049 [1:01:52<57:23,  1.46it/s]
                                                      
{'loss': 0.2677, 'grad_norm': 0.5705644488334656, 'learning_rate': 5.110565949684133e-06, 'epoch': 1.63}

 54%|█████▍    | 6007/11049 [1:01:52<57:23,  1.46it/s]
 54%|█████▍    | 6008/11049 [1:01:53<55:37,  1.51it/s]
                                                      
{'loss': 0.1754, 'grad_norm': 0.4343145787715912, 'learning_rate': 5.108986688133137e-06, 'epoch': 1.63}

 54%|█████▍    | 6008/11049 [1:01:53<55:37,  1.51it/s]
 54%|█████▍    | 6009/11049 [1:01:53<54:25,  1.54it/s]
                                                      
{'loss': 0.1697, 'grad_norm': 0.48011043667793274, 'learning_rate': 5.107407415704094e-06, 'epoch': 1.63}

 54%|█████▍    | 6009/11049 [1:01:54<54:25,  1.54it/s]
 54%|█████▍    | 6010/11049 [1:01:54<53:31,  1.57it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.6186423897743225, 'learning_rate': 5.10582813255463e-06, 'epoch': 1.63}

 54%|█████▍    | 6010/11049 [1:01:54<53:31,  1.57it/s]
 54%|█████▍    | 6011/11049 [1:01:55<52:57,  1.59it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.5299456715583801, 'learning_rate': 5.104248838842377e-06, 'epoch': 1.63}

 54%|█████▍    | 6011/11049 [1:01:55<52:57,  1.59it/s]
 54%|█████▍    | 6012/11049 [1:01:55<52:28,  1.60it/s]
                                                      
{'loss': 0.1997, 'grad_norm': 0.5182889699935913, 'learning_rate': 5.1026695347249654e-06, 'epoch': 1.63}

 54%|█████▍    | 6012/11049 [1:01:55<52:28,  1.60it/s]
 54%|█████▍    | 6013/11049 [1:01:56<52:09,  1.61it/s]
                                                      
{'loss': 0.2231, 'grad_norm': 0.5605229139328003, 'learning_rate': 5.101090220360025e-06, 'epoch': 1.63}

 54%|█████▍    | 6013/11049 [1:01:56<52:09,  1.61it/s]
 54%|█████▍    | 6014/11049 [1:01:56<51:57,  1.62it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.47068190574645996, 'learning_rate': 5.09951089590519e-06, 'epoch': 1.63}

 54%|█████▍    | 6014/11049 [1:01:57<51:57,  1.62it/s]
 54%|█████▍    | 6015/11049 [1:01:57<51:48,  1.62it/s]
                                                      
{'loss': 0.2618, 'grad_norm': 0.6450355052947998, 'learning_rate': 5.097931561518092e-06, 'epoch': 1.63}

 54%|█████▍    | 6015/11049 [1:01:57<51:48,  1.62it/s]
 54%|█████▍    | 6016/11049 [1:01:58<51:43,  1.62it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.5498982667922974, 'learning_rate': 5.0963522173563694e-06, 'epoch': 1.63}

 54%|█████▍    | 6016/11049 [1:01:58<51:43,  1.62it/s]
 54%|█████▍    | 6017/11049 [1:01:58<51:37,  1.62it/s]
                                                      
{'loss': 0.1946, 'grad_norm': 0.5409318208694458, 'learning_rate': 5.094772863577655e-06, 'epoch': 1.63}

 54%|█████▍    | 6017/11049 [1:01:58<51:37,  1.62it/s]
 54%|█████▍    | 6018/11049 [1:01:59<51:36,  1.62it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.5480420589447021, 'learning_rate': 5.0931935003395835e-06, 'epoch': 1.63}

 54%|█████▍    | 6018/11049 [1:01:59<51:36,  1.62it/s]
 54%|█████▍    | 6019/11049 [1:02:00<51:34,  1.63it/s]
                                                      
{'loss': 0.1457, 'grad_norm': 0.42406100034713745, 'learning_rate': 5.091614127799798e-06, 'epoch': 1.63}

 54%|█████▍    | 6019/11049 [1:02:00<51:34,  1.63it/s]
 54%|█████▍    | 6020/11049 [1:02:00<51:31,  1.63it/s]
                                                      
{'loss': 0.1974, 'grad_norm': 0.5746368169784546, 'learning_rate': 5.090034746115931e-06, 'epoch': 1.63}

 54%|█████▍    | 6020/11049 [1:02:00<51:31,  1.63it/s]
 54%|█████▍    | 6021/11049 [1:02:01<51:29,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.44845569133758545, 'learning_rate': 5.088455355445626e-06, 'epoch': 1.63}

 54%|█████▍    | 6021/11049 [1:02:01<51:29,  1.63it/s]
 55%|█████▍    | 6022/11049 [1:02:01<51:27,  1.63it/s]
                                                      
{'loss': 0.2195, 'grad_norm': 0.588666558265686, 'learning_rate': 5.086875955946521e-06, 'epoch': 1.64}

 55%|█████▍    | 6022/11049 [1:02:02<51:27,  1.63it/s]
 55%|█████▍    | 6023/11049 [1:02:02<51:25,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.4549628496170044, 'learning_rate': 5.085296547776258e-06, 'epoch': 1.64}

 55%|█████▍    | 6023/11049 [1:02:02<51:25,  1.63it/s]
 55%|█████▍    | 6024/11049 [1:02:03<51:26,  1.63it/s]
                                                      
{'loss': 0.2211, 'grad_norm': 0.523341178894043, 'learning_rate': 5.083717131092478e-06, 'epoch': 1.64}

 55%|█████▍    | 6024/11049 [1:02:03<51:26,  1.63it/s]
 55%|█████▍    | 6025/11049 [1:02:03<51:25,  1.63it/s]
                                                      
{'loss': 0.1929, 'grad_norm': 0.4820314943790436, 'learning_rate': 5.082137706052826e-06, 'epoch': 1.64}

 55%|█████▍    | 6025/11049 [1:02:03<51:25,  1.63it/s]
 55%|█████▍    | 6026/11049 [1:02:04<51:23,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.5005979537963867, 'learning_rate': 5.080558272814945e-06, 'epoch': 1.64}

 55%|█████▍    | 6026/11049 [1:02:04<51:23,  1.63it/s]
 55%|█████▍    | 6027/11049 [1:02:04<51:23,  1.63it/s]
                                                      
{'loss': 0.1722, 'grad_norm': 0.45596012473106384, 'learning_rate': 5.0789788315364784e-06, 'epoch': 1.64}

 55%|█████▍    | 6027/11049 [1:02:05<51:23,  1.63it/s]
 55%|█████▍    | 6028/11049 [1:02:05<51:21,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.5479597449302673, 'learning_rate': 5.07739938237507e-06, 'epoch': 1.64}

 55%|█████▍    | 6028/11049 [1:02:05<51:21,  1.63it/s]
 55%|█████▍    | 6029/11049 [1:02:06<51:22,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.5434092283248901, 'learning_rate': 5.07581992548837e-06, 'epoch': 1.64}

 55%|█████▍    | 6029/11049 [1:02:06<51:22,  1.63it/s]
 55%|█████▍    | 6030/11049 [1:02:06<51:20,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.533380925655365, 'learning_rate': 5.0742404610340225e-06, 'epoch': 1.64}

 55%|█████▍    | 6030/11049 [1:02:06<51:20,  1.63it/s]
 55%|█████▍    | 6031/11049 [1:02:07<51:19,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5514494180679321, 'learning_rate': 5.0726609891696755e-06, 'epoch': 1.64}

 55%|█████▍    | 6031/11049 [1:02:07<51:19,  1.63it/s]
 55%|█████▍    | 6032/11049 [1:02:08<51:17,  1.63it/s]
                                                      
{'loss': 0.1864, 'grad_norm': 0.4571456015110016, 'learning_rate': 5.0710815100529765e-06, 'epoch': 1.64}

 55%|█████▍    | 6032/11049 [1:02:08<51:17,  1.63it/s]
 55%|█████▍    | 6033/11049 [1:02:08<51:16,  1.63it/s]
                                                      
{'loss': 0.2035, 'grad_norm': 0.5796554684638977, 'learning_rate': 5.069502023841576e-06, 'epoch': 1.64}

 55%|█████▍    | 6033/11049 [1:02:08<51:16,  1.63it/s]
 55%|█████▍    | 6034/11049 [1:02:09<51:18,  1.63it/s]
                                                      
{'loss': 0.2079, 'grad_norm': 0.5342492461204529, 'learning_rate': 5.067922530693125e-06, 'epoch': 1.64}

 55%|█████▍    | 6034/11049 [1:02:09<51:18,  1.63it/s]
 55%|█████▍    | 6035/11049 [1:02:09<51:16,  1.63it/s]
                                                      
{'loss': 0.139, 'grad_norm': 0.44664618372917175, 'learning_rate': 5.06634303076527e-06, 'epoch': 1.64}

 55%|█████▍    | 6035/11049 [1:02:09<51:16,  1.63it/s]
 55%|█████▍    | 6036/11049 [1:02:10<51:15,  1.63it/s]
                                                      
{'loss': 0.2249, 'grad_norm': 0.6187013983726501, 'learning_rate': 5.064763524215664e-06, 'epoch': 1.64}

 55%|█████▍    | 6036/11049 [1:02:10<51:15,  1.63it/s]
 55%|█████▍    | 6037/11049 [1:02:11<51:14,  1.63it/s]
                                                      
{'loss': 0.1908, 'grad_norm': 0.5171875953674316, 'learning_rate': 5.063184011201961e-06, 'epoch': 1.64}

 55%|█████▍    | 6037/11049 [1:02:11<51:14,  1.63it/s]
 55%|█████▍    | 6038/11049 [1:02:11<51:13,  1.63it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.4974888563156128, 'learning_rate': 5.061604491881811e-06, 'epoch': 1.64}

 55%|█████▍    | 6038/11049 [1:02:11<51:13,  1.63it/s]
 55%|█████▍    | 6039/11049 [1:02:12<51:15,  1.63it/s]
                                                      
{'loss': 0.2348, 'grad_norm': 0.5633903741836548, 'learning_rate': 5.06002496641287e-06, 'epoch': 1.64}

 55%|█████▍    | 6039/11049 [1:02:12<51:15,  1.63it/s]
 55%|█████▍    | 6040/11049 [1:02:12<51:14,  1.63it/s]
                                                      
{'loss': 0.1994, 'grad_norm': 0.5617734789848328, 'learning_rate': 5.058445434952787e-06, 'epoch': 1.64}

 55%|█████▍    | 6040/11049 [1:02:13<51:14,  1.63it/s]
 55%|█████▍    | 6041/11049 [1:02:13<51:12,  1.63it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5321425199508667, 'learning_rate': 5.056865897659219e-06, 'epoch': 1.64}

 55%|█████▍    | 6041/11049 [1:02:13<51:12,  1.63it/s]
 55%|█████▍    | 6042/11049 [1:02:14<51:12,  1.63it/s]
                                                      
{'loss': 0.2447, 'grad_norm': 0.6059069633483887, 'learning_rate': 5.05528635468982e-06, 'epoch': 1.64}

 55%|█████▍    | 6042/11049 [1:02:14<51:12,  1.63it/s]
 55%|█████▍    | 6043/11049 [1:02:14<51:11,  1.63it/s]
                                                      
{'loss': 0.1854, 'grad_norm': 0.5553567409515381, 'learning_rate': 5.053706806202247e-06, 'epoch': 1.64}

 55%|█████▍    | 6043/11049 [1:02:14<51:11,  1.63it/s]
 55%|█████▍    | 6044/11049 [1:02:15<51:13,  1.63it/s]
                                                      
{'loss': 0.2325, 'grad_norm': 0.6675068736076355, 'learning_rate': 5.052127252354155e-06, 'epoch': 1.64}

 55%|█████▍    | 6044/11049 [1:02:15<51:13,  1.63it/s]
 55%|█████▍    | 6045/11049 [1:02:15<51:11,  1.63it/s]
                                                      
{'loss': 0.2323, 'grad_norm': 0.5859593749046326, 'learning_rate': 5.050547693303201e-06, 'epoch': 1.64}

 55%|█████▍    | 6045/11049 [1:02:16<51:11,  1.63it/s]
 55%|█████▍    | 6046/11049 [1:02:16<51:09,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.5820112228393555, 'learning_rate': 5.0489681292070404e-06, 'epoch': 1.64}

 55%|█████▍    | 6046/11049 [1:02:16<51:09,  1.63it/s]
 55%|█████▍    | 6047/11049 [1:02:17<51:07,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.5356411933898926, 'learning_rate': 5.047388560223332e-06, 'epoch': 1.64}

 55%|█████▍    | 6047/11049 [1:02:17<51:07,  1.63it/s]
 55%|█████▍    | 6048/11049 [1:02:17<51:07,  1.63it/s]
                                                      
{'loss': 0.1905, 'grad_norm': 0.5078060030937195, 'learning_rate': 5.0458089865097345e-06, 'epoch': 1.64}

 55%|█████▍    | 6048/11049 [1:02:17<51:07,  1.63it/s]
 55%|█████▍    | 6049/11049 [1:02:18<51:11,  1.63it/s]
                                                      
{'loss': 0.253, 'grad_norm': 0.6070963740348816, 'learning_rate': 5.044229408223906e-06, 'epoch': 1.64}

 55%|█████▍    | 6049/11049 [1:02:18<51:11,  1.63it/s]
 55%|█████▍    | 6050/11049 [1:02:19<51:08,  1.63it/s]
                                                      
{'loss': 0.1723, 'grad_norm': 0.4762404263019562, 'learning_rate': 5.042649825523503e-06, 'epoch': 1.64}

 55%|█████▍    | 6050/11049 [1:02:19<51:08,  1.63it/s]
 55%|█████▍    | 6051/11049 [1:02:19<51:07,  1.63it/s]
                                                      
{'loss': 0.2599, 'grad_norm': 0.6139150261878967, 'learning_rate': 5.0410702385661904e-06, 'epoch': 1.64}

 55%|█████▍    | 6051/11049 [1:02:19<51:07,  1.63it/s]
 55%|█████▍    | 6052/11049 [1:02:20<51:07,  1.63it/s]
                                                      
{'loss': 0.2354, 'grad_norm': 0.5207996964454651, 'learning_rate': 5.039490647509623e-06, 'epoch': 1.64}

 55%|█████▍    | 6052/11049 [1:02:20<51:07,  1.63it/s]
 55%|█████▍    | 6053/11049 [1:02:20<51:05,  1.63it/s]
                                                      
{'loss': 0.1761, 'grad_norm': 0.5212604403495789, 'learning_rate': 5.0379110525114626e-06, 'epoch': 1.64}

 55%|█████▍    | 6053/11049 [1:02:21<51:05,  1.63it/s]
 55%|█████▍    | 6054/11049 [1:02:21<51:08,  1.63it/s]
                                                      
{'loss': 0.2691, 'grad_norm': 0.7330812215805054, 'learning_rate': 5.036331453729369e-06, 'epoch': 1.64}

 55%|█████▍    | 6054/11049 [1:02:21<51:08,  1.63it/s]
 55%|█████▍    | 6055/11049 [1:02:22<51:06,  1.63it/s]
                                                      
{'loss': 0.205, 'grad_norm': 0.5433403849601746, 'learning_rate': 5.0347518513210056e-06, 'epoch': 1.64}

 55%|█████▍    | 6055/11049 [1:02:22<51:06,  1.63it/s]
 55%|█████▍    | 6056/11049 [1:02:22<51:04,  1.63it/s]
                                                      
{'loss': 0.2012, 'grad_norm': 0.4873649775981903, 'learning_rate': 5.033172245444031e-06, 'epoch': 1.64}

 55%|█████▍    | 6056/11049 [1:02:22<51:04,  1.63it/s]
 55%|█████▍    | 6057/11049 [1:02:23<51:03,  1.63it/s]
                                                      
{'loss': 0.1845, 'grad_norm': 0.5590596795082092, 'learning_rate': 5.031592636256111e-06, 'epoch': 1.64}

 55%|█████▍    | 6057/11049 [1:02:23<51:03,  1.63it/s]
 55%|█████▍    | 6058/11049 [1:02:23<51:03,  1.63it/s]
                                                      
{'loss': 0.2541, 'grad_norm': 0.6399956345558167, 'learning_rate': 5.030013023914903e-06, 'epoch': 1.64}

 55%|█████▍    | 6058/11049 [1:02:24<51:03,  1.63it/s]
 55%|█████▍    | 6059/11049 [1:02:24<51:05,  1.63it/s]
                                                      
{'loss': 0.1704, 'grad_norm': 0.4816545844078064, 'learning_rate': 5.02843340857807e-06, 'epoch': 1.65}

 55%|█████▍    | 6059/11049 [1:02:24<51:05,  1.63it/s]
 55%|█████▍    | 6060/11049 [1:02:25<51:04,  1.63it/s]
                                                      
{'loss': 0.194, 'grad_norm': 0.5825765132904053, 'learning_rate': 5.026853790403276e-06, 'epoch': 1.65}

 55%|█████▍    | 6060/11049 [1:02:25<51:04,  1.63it/s]
 55%|█████▍    | 6061/11049 [1:02:25<51:04,  1.63it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.6080949306488037, 'learning_rate': 5.025274169548187e-06, 'epoch': 1.65}

 55%|█████▍    | 6061/11049 [1:02:25<51:04,  1.63it/s]
 55%|█████▍    | 6062/11049 [1:02:26<51:02,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5482795834541321, 'learning_rate': 5.023694546170461e-06, 'epoch': 1.65}

 55%|█████▍    | 6062/11049 [1:02:26<51:02,  1.63it/s]
 55%|█████▍    | 6063/11049 [1:02:27<51:01,  1.63it/s]
                                                      
{'loss': 0.2886, 'grad_norm': 0.7384748458862305, 'learning_rate': 5.022114920427764e-06, 'epoch': 1.65}

 55%|█████▍    | 6063/11049 [1:02:27<51:01,  1.63it/s]
 55%|█████▍    | 6064/11049 [1:02:27<51:02,  1.63it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.6191583275794983, 'learning_rate': 5.020535292477757e-06, 'epoch': 1.65}

 55%|█████▍    | 6064/11049 [1:02:27<51:02,  1.63it/s]
 55%|█████▍    | 6065/11049 [1:02:28<50:58,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.5541807413101196, 'learning_rate': 5.018955662478109e-06, 'epoch': 1.65}

 55%|█████▍    | 6065/11049 [1:02:28<50:58,  1.63it/s]
 55%|█████▍    | 6066/11049 [1:02:28<51:02,  1.63it/s]
                                                      
{'loss': 0.1467, 'grad_norm': 0.44197508692741394, 'learning_rate': 5.017376030586481e-06, 'epoch': 1.65}

 55%|█████▍    | 6066/11049 [1:02:29<51:02,  1.63it/s]
 55%|█████▍    | 6067/11049 [1:02:29<50:58,  1.63it/s]
                                                      
{'loss': 0.2563, 'grad_norm': 0.6034559011459351, 'learning_rate': 5.0157963969605374e-06, 'epoch': 1.65}

 55%|█████▍    | 6067/11049 [1:02:29<50:58,  1.63it/s]
 55%|█████▍    | 6068/11049 [1:02:30<50:57,  1.63it/s]
                                                      
{'loss': 0.2169, 'grad_norm': 0.5109020471572876, 'learning_rate': 5.014216761757941e-06, 'epoch': 1.65}

 55%|█████▍    | 6068/11049 [1:02:30<50:57,  1.63it/s]
 55%|█████▍    | 6069/11049 [1:02:30<50:58,  1.63it/s]
                                                      
{'loss': 0.2413, 'grad_norm': 0.5156242251396179, 'learning_rate': 5.01263712513636e-06, 'epoch': 1.65}

 55%|█████▍    | 6069/11049 [1:02:30<50:58,  1.63it/s]
 55%|█████▍    | 6070/11049 [1:02:31<50:55,  1.63it/s]
                                                      
{'loss': 0.178, 'grad_norm': 0.4634234309196472, 'learning_rate': 5.0110574872534575e-06, 'epoch': 1.65}

 55%|█████▍    | 6070/11049 [1:02:31<50:55,  1.63it/s]
 55%|█████▍    | 6071/11049 [1:02:31<50:54,  1.63it/s]
                                                      
{'loss': 0.2413, 'grad_norm': 0.5599943995475769, 'learning_rate': 5.0094778482668986e-06, 'epoch': 1.65}

 55%|█████▍    | 6071/11049 [1:02:32<50:54,  1.63it/s]
 55%|█████▍    | 6072/11049 [1:02:32<50:52,  1.63it/s]
                                                      
{'loss': 0.2353, 'grad_norm': 0.6796154379844666, 'learning_rate': 5.007898208334346e-06, 'epoch': 1.65}

 55%|█████▍    | 6072/11049 [1:02:32<50:52,  1.63it/s]
 55%|█████▍    | 6073/11049 [1:02:33<50:52,  1.63it/s]
                                                      
{'loss': 0.2219, 'grad_norm': 0.7116489410400391, 'learning_rate': 5.0063185676134695e-06, 'epoch': 1.65}

 55%|█████▍    | 6073/11049 [1:02:33<50:52,  1.63it/s]
 55%|█████▍    | 6074/11049 [1:02:33<50:53,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.513731837272644, 'learning_rate': 5.00473892626193e-06, 'epoch': 1.65}

 55%|█████▍    | 6074/11049 [1:02:33<50:53,  1.63it/s]
 55%|█████▍    | 6075/11049 [1:02:34<50:51,  1.63it/s]
                                                      
{'loss': 0.2061, 'grad_norm': 0.5224097371101379, 'learning_rate': 5.0031592844373976e-06, 'epoch': 1.65}

 55%|█████▍    | 6075/11049 [1:02:34<50:51,  1.63it/s]
 55%|█████▍    | 6076/11049 [1:02:35<50:50,  1.63it/s]
                                                      
{'loss': 0.2477, 'grad_norm': 0.6315658092498779, 'learning_rate': 5.0015796422975315e-06, 'epoch': 1.65}

 55%|█████▍    | 6076/11049 [1:02:35<50:50,  1.63it/s]
 55%|█████▌    | 6077/11049 [1:02:35<50:48,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.583670973777771, 'learning_rate': 5e-06, 'epoch': 1.65}

 55%|█████▌    | 6077/11049 [1:02:35<50:48,  1.63it/s]
 55%|█████▌    | 6078/11049 [1:02:36<50:52,  1.63it/s]
                                                      
{'loss': 0.1727, 'grad_norm': 0.4932307302951813, 'learning_rate': 4.99842035770247e-06, 'epoch': 1.65}

 55%|█████▌    | 6078/11049 [1:02:36<50:52,  1.63it/s]
 55%|█████▌    | 6079/11049 [1:02:36<50:55,  1.63it/s]
                                                      
{'loss': 0.2008, 'grad_norm': 0.4803744852542877, 'learning_rate': 4.996840715562605e-06, 'epoch': 1.65}

 55%|█████▌    | 6079/11049 [1:02:36<50:55,  1.63it/s]
 55%|█████▌    | 6080/11049 [1:02:37<50:51,  1.63it/s]
                                                      
{'loss': 0.2509, 'grad_norm': 0.6212775111198425, 'learning_rate': 4.99526107373807e-06, 'epoch': 1.65}

 55%|█████▌    | 6080/11049 [1:02:37<50:51,  1.63it/s]
 55%|█████▌    | 6081/11049 [1:02:38<50:49,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.4780467450618744, 'learning_rate': 4.993681432386532e-06, 'epoch': 1.65}

 55%|█████▌    | 6081/11049 [1:02:38<50:49,  1.63it/s]
 55%|█████▌    | 6082/11049 [1:02:38<50:48,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.6145039200782776, 'learning_rate': 4.992101791665655e-06, 'epoch': 1.65}

 55%|█████▌    | 6082/11049 [1:02:38<50:48,  1.63it/s]
 55%|█████▌    | 6083/11049 [1:02:39<50:46,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.6206029057502747, 'learning_rate': 4.990522151733104e-06, 'epoch': 1.65}

 55%|█████▌    | 6083/11049 [1:02:39<50:46,  1.63it/s]
 55%|█████▌    | 6084/11049 [1:02:39<50:48,  1.63it/s]
                                                      
{'loss': 0.1909, 'grad_norm': 0.5458110570907593, 'learning_rate': 4.988942512746543e-06, 'epoch': 1.65}

 55%|█████▌    | 6084/11049 [1:02:40<50:48,  1.63it/s]
 55%|█████▌    | 6085/11049 [1:02:40<50:47,  1.63it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.5586774945259094, 'learning_rate': 4.987362874863641e-06, 'epoch': 1.65}

 55%|█████▌    | 6085/11049 [1:02:40<50:47,  1.63it/s]
 55%|█████▌    | 6086/11049 [1:02:41<50:46,  1.63it/s]
                                                      
{'loss': 0.2452, 'grad_norm': 0.6786341667175293, 'learning_rate': 4.98578323824206e-06, 'epoch': 1.65}

 55%|█████▌    | 6086/11049 [1:02:41<50:46,  1.63it/s]
 55%|█████▌    | 6087/11049 [1:02:41<50:44,  1.63it/s]
                                                      
{'loss': 0.3204, 'grad_norm': 0.7165158987045288, 'learning_rate': 4.984203603039465e-06, 'epoch': 1.65}

 55%|█████▌    | 6087/11049 [1:02:41<50:44,  1.63it/s]
 55%|█████▌    | 6088/11049 [1:02:42<50:44,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.6111377477645874, 'learning_rate': 4.982623969413521e-06, 'epoch': 1.65}

 55%|█████▌    | 6088/11049 [1:02:42<50:44,  1.63it/s]
 55%|█████▌    | 6089/11049 [1:02:43<50:45,  1.63it/s]
                                                      
{'loss': 0.2582, 'grad_norm': 0.6978805661201477, 'learning_rate': 4.981044337521892e-06, 'epoch': 1.65}

 55%|█████▌    | 6089/11049 [1:02:43<50:45,  1.63it/s]
 55%|█████▌    | 6090/11049 [1:02:43<50:43,  1.63it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.527508556842804, 'learning_rate': 4.979464707522244e-06, 'epoch': 1.65}

 55%|█████▌    | 6090/11049 [1:02:43<50:43,  1.63it/s]
 55%|█████▌    | 6091/11049 [1:02:44<50:43,  1.63it/s]
                                                      
{'loss': 0.2669, 'grad_norm': 0.6899247765541077, 'learning_rate': 4.9778850795722385e-06, 'epoch': 1.65}

 55%|█████▌    | 6091/11049 [1:02:44<50:43,  1.63it/s]
 55%|█████▌    | 6092/11049 [1:02:44<50:41,  1.63it/s]
                                                      
{'loss': 0.1774, 'grad_norm': 0.48866477608680725, 'learning_rate': 4.9763054538295395e-06, 'epoch': 1.65}

 55%|█████▌    | 6092/11049 [1:02:44<50:41,  1.63it/s]
 55%|█████▌    | 6093/11049 [1:02:45<50:40,  1.63it/s]
                                                      
{'loss': 0.2002, 'grad_norm': 0.5172343850135803, 'learning_rate': 4.974725830451815e-06, 'epoch': 1.65}

 55%|█████▌    | 6093/11049 [1:02:45<50:40,  1.63it/s]
 55%|█████▌    | 6094/11049 [1:02:46<50:41,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.5888762474060059, 'learning_rate': 4.973146209596725e-06, 'epoch': 1.65}

 55%|█████▌    | 6094/11049 [1:02:46<50:41,  1.63it/s]
 55%|█████▌    | 6095/11049 [1:02:46<50:40,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5294392704963684, 'learning_rate': 4.971566591421932e-06, 'epoch': 1.65}

 55%|█████▌    | 6095/11049 [1:02:46<50:40,  1.63it/s]
 55%|█████▌    | 6096/11049 [1:02:47<50:40,  1.63it/s]
                                                      
{'loss': 0.2036, 'grad_norm': 0.678933322429657, 'learning_rate': 4.969986976085098e-06, 'epoch': 1.66}

 55%|█████▌    | 6096/11049 [1:02:47<50:40,  1.63it/s]
 55%|█████▌    | 6097/11049 [1:02:47<50:38,  1.63it/s]
                                                      
{'loss': 0.2478, 'grad_norm': 0.6350818872451782, 'learning_rate': 4.968407363743891e-06, 'epoch': 1.66}

 55%|█████▌    | 6097/11049 [1:02:48<50:38,  1.63it/s]
 55%|█████▌    | 6098/11049 [1:02:48<50:37,  1.63it/s]
                                                      
{'loss': 0.194, 'grad_norm': 0.5777277946472168, 'learning_rate': 4.96682775455597e-06, 'epoch': 1.66}

 55%|█████▌    | 6098/11049 [1:02:48<50:37,  1.63it/s]
 55%|█████▌    | 6099/11049 [1:02:49<50:39,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.4946356415748596, 'learning_rate': 4.965248148678997e-06, 'epoch': 1.66}

 55%|█████▌    | 6099/11049 [1:02:49<50:39,  1.63it/s]
 55%|█████▌    | 6100/11049 [1:02:49<50:37,  1.63it/s]
                                                      
{'loss': 0.1844, 'grad_norm': 0.5430625081062317, 'learning_rate': 4.963668546270631e-06, 'epoch': 1.66}

 55%|█████▌    | 6100/11049 [1:02:49<50:37,  1.63it/s]
 55%|█████▌    | 6101/11049 [1:02:50<50:37,  1.63it/s]
                                                      
{'loss': 0.2147, 'grad_norm': 0.5861485600471497, 'learning_rate': 4.962088947488538e-06, 'epoch': 1.66}

 55%|█████▌    | 6101/11049 [1:02:50<50:37,  1.63it/s]
 55%|█████▌    | 6102/11049 [1:02:50<50:35,  1.63it/s]
                                                      
{'loss': 0.2252, 'grad_norm': 0.6023551821708679, 'learning_rate': 4.960509352490379e-06, 'epoch': 1.66}

 55%|█████▌    | 6102/11049 [1:02:51<50:35,  1.63it/s]
 55%|█████▌    | 6103/11049 [1:02:51<50:37,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.5375580191612244, 'learning_rate': 4.958929761433813e-06, 'epoch': 1.66}

 55%|█████▌    | 6103/11049 [1:02:51<50:37,  1.63it/s]
 55%|█████▌    | 6104/11049 [1:02:52<50:54,  1.62it/s]
                                                      
{'loss': 0.2133, 'grad_norm': 0.5911940336227417, 'learning_rate': 4.957350174476496e-06, 'epoch': 1.66}

 55%|█████▌    | 6104/11049 [1:02:52<50:54,  1.62it/s]
 55%|█████▌    | 6105/11049 [1:02:52<50:47,  1.62it/s]
                                                      
{'loss': 0.1913, 'grad_norm': 0.5270588397979736, 'learning_rate': 4.955770591776095e-06, 'epoch': 1.66}

 55%|█████▌    | 6105/11049 [1:02:52<50:47,  1.62it/s]
 55%|█████▌    | 6106/11049 [1:02:53<50:44,  1.62it/s]
                                                      
{'loss': 0.1564, 'grad_norm': 0.42923033237457275, 'learning_rate': 4.954191013490266e-06, 'epoch': 1.66}

 55%|█████▌    | 6106/11049 [1:02:53<50:44,  1.62it/s]
 55%|█████▌    | 6107/11049 [1:02:54<50:40,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.47962865233421326, 'learning_rate': 4.952611439776669e-06, 'epoch': 1.66}

 55%|█████▌    | 6107/11049 [1:02:54<50:40,  1.63it/s]
 55%|█████▌    | 6108/11049 [1:02:54<50:35,  1.63it/s]
                                                      
{'loss': 0.2513, 'grad_norm': 0.5470536351203918, 'learning_rate': 4.95103187079296e-06, 'epoch': 1.66}

 55%|█████▌    | 6108/11049 [1:02:54<50:35,  1.63it/s]
 55%|█████▌    | 6109/11049 [1:02:55<50:35,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.5334787368774414, 'learning_rate': 4.949452306696801e-06, 'epoch': 1.66}

 55%|█████▌    | 6109/11049 [1:02:55<50:35,  1.63it/s]
 55%|█████▌    | 6110/11049 [1:02:55<50:38,  1.63it/s]
                                                      
{'loss': 0.1612, 'grad_norm': 0.48093581199645996, 'learning_rate': 4.9478727476458465e-06, 'epoch': 1.66}

 55%|█████▌    | 6110/11049 [1:02:56<50:38,  1.63it/s]
 55%|█████▌    | 6111/11049 [1:02:56<50:37,  1.63it/s]
                                                      
{'loss': 0.1979, 'grad_norm': 0.548451840877533, 'learning_rate': 4.946293193797755e-06, 'epoch': 1.66}

 55%|█████▌    | 6111/11049 [1:02:56<50:37,  1.63it/s]
 55%|█████▌    | 6112/11049 [1:02:57<50:33,  1.63it/s]
                                                      
{'loss': 0.2739, 'grad_norm': 0.7975024580955505, 'learning_rate': 4.944713645310181e-06, 'epoch': 1.66}

 55%|█████▌    | 6112/11049 [1:02:57<50:33,  1.63it/s]
 55%|█████▌    | 6113/11049 [1:02:57<50:31,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.4626414477825165, 'learning_rate': 4.943134102340782e-06, 'epoch': 1.66}

 55%|█████▌    | 6113/11049 [1:02:57<50:31,  1.63it/s]
 55%|█████▌    | 6114/11049 [1:02:58<50:29,  1.63it/s]
                                                      
{'loss': 0.2368, 'grad_norm': 0.682809591293335, 'learning_rate': 4.941554565047215e-06, 'epoch': 1.66}

 55%|█████▌    | 6114/11049 [1:02:58<50:29,  1.63it/s]
 55%|█████▌    | 6115/11049 [1:02:58<50:33,  1.63it/s]
                                                      
{'loss': 0.2033, 'grad_norm': 0.6017138361930847, 'learning_rate': 4.939975033587132e-06, 'epoch': 1.66}

 55%|█████▌    | 6115/11049 [1:02:59<50:33,  1.63it/s]
 55%|█████▌    | 6116/11049 [1:02:59<50:34,  1.63it/s]
                                                      
{'loss': 0.168, 'grad_norm': 0.45959144830703735, 'learning_rate': 4.938395508118189e-06, 'epoch': 1.66}

 55%|█████▌    | 6116/11049 [1:02:59<50:34,  1.63it/s]
 55%|█████▌    | 6117/11049 [1:03:00<50:30,  1.63it/s]
                                                      
{'loss': 0.2578, 'grad_norm': 0.5330961346626282, 'learning_rate': 4.93681598879804e-06, 'epoch': 1.66}

 55%|█████▌    | 6117/11049 [1:03:00<50:30,  1.63it/s]
 55%|█████▌    | 6118/11049 [1:03:00<50:28,  1.63it/s]
                                                      
{'loss': 0.1849, 'grad_norm': 0.4672229588031769, 'learning_rate': 4.9352364757843365e-06, 'epoch': 1.66}

 55%|█████▌    | 6118/11049 [1:03:00<50:28,  1.63it/s]
 55%|█████▌    | 6119/11049 [1:03:01<50:26,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.6883156299591064, 'learning_rate': 4.933656969234732e-06, 'epoch': 1.66}

 55%|█████▌    | 6119/11049 [1:03:01<50:26,  1.63it/s]
 55%|█████▌    | 6120/11049 [1:03:02<50:31,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.5098857879638672, 'learning_rate': 4.9320774693068776e-06, 'epoch': 1.66}

 55%|█████▌    | 6120/11049 [1:03:02<50:31,  1.63it/s]
 55%|█████▌    | 6121/11049 [1:03:02<50:27,  1.63it/s]
                                                      
{'loss': 0.2213, 'grad_norm': 0.522891104221344, 'learning_rate': 4.9304979761584256e-06, 'epoch': 1.66}

 55%|█████▌    | 6121/11049 [1:03:02<50:27,  1.63it/s]
 55%|█████▌    | 6122/11049 [1:03:03<50:26,  1.63it/s]
                                                      
{'loss': 0.2151, 'grad_norm': 0.6341266632080078, 'learning_rate': 4.928918489947025e-06, 'epoch': 1.66}

 55%|█████▌    | 6122/11049 [1:03:03<50:26,  1.63it/s]
 55%|█████▌    | 6123/11049 [1:03:03<50:23,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5536563992500305, 'learning_rate': 4.927339010830328e-06, 'epoch': 1.66}

 55%|█████▌    | 6123/11049 [1:03:04<50:23,  1.63it/s]
 55%|█████▌    | 6124/11049 [1:03:04<50:21,  1.63it/s]
                                                      
{'loss': 0.1629, 'grad_norm': 0.5476338267326355, 'learning_rate': 4.92575953896598e-06, 'epoch': 1.66}

 55%|█████▌    | 6124/11049 [1:03:04<50:21,  1.63it/s]
 55%|█████▌    | 6125/11049 [1:03:05<50:26,  1.63it/s]
                                                      
{'loss': 0.2193, 'grad_norm': 0.5096233487129211, 'learning_rate': 4.924180074511632e-06, 'epoch': 1.66}

 55%|█████▌    | 6125/11049 [1:03:05<50:26,  1.63it/s]
 55%|█████▌    | 6126/11049 [1:03:05<50:23,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.5568389892578125, 'learning_rate': 4.922600617624932e-06, 'epoch': 1.66}

 55%|█████▌    | 6126/11049 [1:03:05<50:23,  1.63it/s]
 55%|█████▌    | 6127/11049 [1:03:06<50:21,  1.63it/s]
                                                      
{'loss': 0.1533, 'grad_norm': 0.4109070897102356, 'learning_rate': 4.921021168463525e-06, 'epoch': 1.66}

 55%|█████▌    | 6127/11049 [1:03:06<50:21,  1.63it/s]
 55%|█████▌    | 6128/11049 [1:03:06<50:21,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.6254450082778931, 'learning_rate': 4.919441727185056e-06, 'epoch': 1.66}

 55%|█████▌    | 6128/11049 [1:03:07<50:21,  1.63it/s]
 55%|█████▌    | 6129/11049 [1:03:07<50:20,  1.63it/s]
                                                      
{'loss': 0.2421, 'grad_norm': 0.70321124792099, 'learning_rate': 4.9178622939471746e-06, 'epoch': 1.66}

 55%|█████▌    | 6129/11049 [1:03:07<50:20,  1.63it/s]
 55%|█████▌    | 6130/11049 [1:03:08<50:21,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.5699828267097473, 'learning_rate': 4.916282868907523e-06, 'epoch': 1.66}

 55%|█████▌    | 6130/11049 [1:03:08<50:21,  1.63it/s]
 55%|█████▌    | 6131/11049 [1:03:08<50:19,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.6299188733100891, 'learning_rate': 4.914703452223744e-06, 'epoch': 1.66}

 55%|█████▌    | 6131/11049 [1:03:08<50:19,  1.63it/s]
 55%|█████▌    | 6132/11049 [1:03:09<50:18,  1.63it/s]
                                                      
{'loss': 0.2173, 'grad_norm': 0.6290990114212036, 'learning_rate': 4.913124044053479e-06, 'epoch': 1.66}

 55%|█████▌    | 6132/11049 [1:03:09<50:18,  1.63it/s]
 56%|█████▌    | 6133/11049 [1:03:10<50:17,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.5027425289154053, 'learning_rate': 4.9115446445543755e-06, 'epoch': 1.67}

 56%|█████▌    | 6133/11049 [1:03:10<50:17,  1.63it/s]
 56%|█████▌    | 6134/11049 [1:03:10<50:15,  1.63it/s]
                                                      
{'loss': 0.2132, 'grad_norm': 0.5951563715934753, 'learning_rate': 4.909965253884071e-06, 'epoch': 1.67}

 56%|█████▌    | 6134/11049 [1:03:10<50:15,  1.63it/s]
 56%|█████▌    | 6135/11049 [1:03:11<50:19,  1.63it/s]
                                                      
{'loss': 0.197, 'grad_norm': 0.5121418237686157, 'learning_rate': 4.9083858722002054e-06, 'epoch': 1.67}

 56%|█████▌    | 6135/11049 [1:03:11<50:19,  1.63it/s]
 56%|█████▌    | 6136/11049 [1:03:11<50:16,  1.63it/s]
                                                      
{'loss': 0.2704, 'grad_norm': 0.5961558222770691, 'learning_rate': 4.9068064996604165e-06, 'epoch': 1.67}

 56%|█████▌    | 6136/11049 [1:03:12<50:16,  1.63it/s]
 56%|█████▌    | 6137/11049 [1:03:12<50:15,  1.63it/s]
                                                      
{'loss': 0.1459, 'grad_norm': 0.4317757785320282, 'learning_rate': 4.905227136422347e-06, 'epoch': 1.67}

 56%|█████▌    | 6137/11049 [1:03:12<50:15,  1.63it/s]
 56%|█████▌    | 6138/11049 [1:03:13<50:14,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.5785221457481384, 'learning_rate': 4.903647782643632e-06, 'epoch': 1.67}

 56%|█████▌    | 6138/11049 [1:03:13<50:14,  1.63it/s]
 56%|█████▌    | 6139/11049 [1:03:13<50:12,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.5189679265022278, 'learning_rate': 4.902068438481909e-06, 'epoch': 1.67}

 56%|█████▌    | 6139/11049 [1:03:13<50:12,  1.63it/s]
 56%|█████▌    | 6140/11049 [1:03:14<50:15,  1.63it/s]
                                                      
{'loss': 0.2072, 'grad_norm': 0.5405644774436951, 'learning_rate': 4.900489104094811e-06, 'epoch': 1.67}

 56%|█████▌    | 6140/11049 [1:03:14<50:15,  1.63it/s]
 56%|█████▌    | 6141/11049 [1:03:14<50:13,  1.63it/s]
                                                      
{'loss': 0.1492, 'grad_norm': 0.41086798906326294, 'learning_rate': 4.8989097796399755e-06, 'epoch': 1.67}

 56%|█████▌    | 6141/11049 [1:03:15<50:13,  1.63it/s]
 56%|█████▌    | 6142/11049 [1:03:15<50:11,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.5447717308998108, 'learning_rate': 4.897330465275036e-06, 'epoch': 1.67}

 56%|█████▌    | 6142/11049 [1:03:15<50:11,  1.63it/s]
 56%|█████▌    | 6143/11049 [1:03:16<50:09,  1.63it/s]
                                                      
{'loss': 0.2371, 'grad_norm': 0.6001719236373901, 'learning_rate': 4.895751161157624e-06, 'epoch': 1.67}

 56%|█████▌    | 6143/11049 [1:03:16<50:09,  1.63it/s]
 56%|█████▌    | 6144/11049 [1:03:16<50:09,  1.63it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.5839008688926697, 'learning_rate': 4.89417186744537e-06, 'epoch': 1.67}

 56%|█████▌    | 6144/11049 [1:03:16<50:09,  1.63it/s]
 56%|█████▌    | 6145/11049 [1:03:17<50:11,  1.63it/s]
                                                      
{'loss': 0.2227, 'grad_norm': 0.5635821223258972, 'learning_rate': 4.892592584295907e-06, 'epoch': 1.67}

 56%|█████▌    | 6145/11049 [1:03:17<50:11,  1.63it/s]
 56%|█████▌    | 6146/11049 [1:03:18<50:10,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.48153752088546753, 'learning_rate': 4.891013311866864e-06, 'epoch': 1.67}

 56%|█████▌    | 6146/11049 [1:03:18<50:10,  1.63it/s]
 56%|█████▌    | 6147/11049 [1:03:18<50:15,  1.63it/s]
                                                      
{'loss': 0.1509, 'grad_norm': 0.48474371433258057, 'learning_rate': 4.8894340503158685e-06, 'epoch': 1.67}

 56%|█████▌    | 6147/11049 [1:03:18<50:15,  1.63it/s]
 56%|█████▌    | 6148/11049 [1:03:19<50:13,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.5375577211380005, 'learning_rate': 4.887854799800547e-06, 'epoch': 1.67}

 56%|█████▌    | 6148/11049 [1:03:19<50:13,  1.63it/s]
 56%|█████▌    | 6149/11049 [1:03:19<50:10,  1.63it/s]
                                                      
{'loss': 0.2272, 'grad_norm': 0.6845714449882507, 'learning_rate': 4.886275560478529e-06, 'epoch': 1.67}

 56%|█████▌    | 6149/11049 [1:03:19<50:10,  1.63it/s]
 56%|█████▌    | 6150/11049 [1:03:20<50:10,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.5644966959953308, 'learning_rate': 4.884696332507436e-06, 'epoch': 1.67}

 56%|█████▌    | 6150/11049 [1:03:20<50:10,  1.63it/s]
 56%|█████▌    | 6151/11049 [1:03:21<50:10,  1.63it/s]
                                                      
{'loss': 0.2173, 'grad_norm': 0.7340266704559326, 'learning_rate': 4.883117116044895e-06, 'epoch': 1.67}

 56%|█████▌    | 6151/11049 [1:03:21<50:10,  1.63it/s]
 56%|█████▌    | 6152/11049 [1:03:21<50:09,  1.63it/s]
                                                      
{'loss': 0.2091, 'grad_norm': 0.47979873418807983, 'learning_rate': 4.881537911248526e-06, 'epoch': 1.67}

 56%|█████▌    | 6152/11049 [1:03:21<50:09,  1.63it/s]
 56%|█████▌    | 6153/11049 [1:03:22<50:07,  1.63it/s]
                                                      
{'loss': 0.1941, 'grad_norm': 0.5147534608840942, 'learning_rate': 4.8799587182759526e-06, 'epoch': 1.67}

 56%|█████▌    | 6153/11049 [1:03:22<50:07,  1.63it/s]
 56%|█████▌    | 6154/11049 [1:03:22<50:05,  1.63it/s]
                                                      
{'loss': 0.2047, 'grad_norm': 0.6071460247039795, 'learning_rate': 4.878379537284796e-06, 'epoch': 1.67}

 56%|█████▌    | 6154/11049 [1:03:23<50:05,  1.63it/s]
 56%|█████▌    | 6155/11049 [1:03:23<50:20,  1.62it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.5765802264213562, 'learning_rate': 4.876800368432674e-06, 'epoch': 1.67}

 56%|█████▌    | 6155/11049 [1:03:23<50:20,  1.62it/s]
 56%|█████▌    | 6156/11049 [1:03:24<50:14,  1.62it/s]
                                                      
{'loss': 0.2375, 'grad_norm': 0.5787980556488037, 'learning_rate': 4.875221211877203e-06, 'epoch': 1.67}

 56%|█████▌    | 6156/11049 [1:03:24<50:14,  1.62it/s]
 56%|█████▌    | 6157/11049 [1:03:24<50:10,  1.62it/s]
                                                      
{'loss': 0.2159, 'grad_norm': 0.5874403715133667, 'learning_rate': 4.873642067776004e-06, 'epoch': 1.67}

 56%|█████▌    | 6157/11049 [1:03:24<50:10,  1.62it/s]
 56%|█████▌    | 6158/11049 [1:03:25<50:06,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.5526905655860901, 'learning_rate': 4.87206293628669e-06, 'epoch': 1.67}

 56%|█████▌    | 6158/11049 [1:03:25<50:06,  1.63it/s]
 56%|█████▌    | 6159/11049 [1:03:26<50:03,  1.63it/s]
                                                      
{'loss': 0.199, 'grad_norm': 0.5691990256309509, 'learning_rate': 4.870483817566876e-06, 'epoch': 1.67}

 56%|█████▌    | 6159/11049 [1:03:26<50:03,  1.63it/s]
 56%|█████▌    | 6160/11049 [1:03:26<50:06,  1.63it/s]
                                                      
{'loss': 0.2329, 'grad_norm': 0.6006068587303162, 'learning_rate': 4.868904711774174e-06, 'epoch': 1.67}

 56%|█████▌    | 6160/11049 [1:03:26<50:06,  1.63it/s]
 56%|█████▌    | 6161/11049 [1:03:27<50:04,  1.63it/s]
                                                      
{'loss': 0.1686, 'grad_norm': 0.45937949419021606, 'learning_rate': 4.867325619066198e-06, 'epoch': 1.67}

 56%|█████▌    | 6161/11049 [1:03:27<50:04,  1.63it/s]
 56%|█████▌    | 6162/11049 [1:03:27<50:02,  1.63it/s]
                                                      
{'loss': 0.3217, 'grad_norm': 0.7146846652030945, 'learning_rate': 4.865746539600557e-06, 'epoch': 1.67}

 56%|█████▌    | 6162/11049 [1:03:27<50:02,  1.63it/s]
 56%|█████▌    | 6163/11049 [1:03:28<50:00,  1.63it/s]
                                                      
{'loss': 0.2211, 'grad_norm': 0.5397557616233826, 'learning_rate': 4.864167473534861e-06, 'epoch': 1.67}

 56%|█████▌    | 6163/11049 [1:03:28<50:00,  1.63it/s]
 56%|█████▌    | 6164/11049 [1:03:29<49:58,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.4975738823413849, 'learning_rate': 4.862588421026715e-06, 'epoch': 1.67}

 56%|█████▌    | 6164/11049 [1:03:29<49:58,  1.63it/s]
 56%|█████▌    | 6165/11049 [1:03:29<50:00,  1.63it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.5974514484405518, 'learning_rate': 4.86100938223373e-06, 'epoch': 1.67}

 56%|█████▌    | 6165/11049 [1:03:29<50:00,  1.63it/s]
 56%|█████▌    | 6166/11049 [1:03:30<49:57,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5925843715667725, 'learning_rate': 4.859430357313509e-06, 'epoch': 1.67}

 56%|█████▌    | 6166/11049 [1:03:30<49:57,  1.63it/s]
 56%|█████▌    | 6167/11049 [1:03:30<49:55,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.5181153416633606, 'learning_rate': 4.857851346423656e-06, 'epoch': 1.67}

 56%|█████▌    | 6167/11049 [1:03:31<49:55,  1.63it/s]
 56%|█████▌    | 6168/11049 [1:03:31<49:54,  1.63it/s]
                                                      
{'loss': 0.3517, 'grad_norm': 0.5649585127830505, 'learning_rate': 4.85627234972177e-06, 'epoch': 1.67}

 56%|█████▌    | 6168/11049 [1:03:31<49:54,  1.63it/s]
 56%|█████▌    | 6169/11049 [1:03:32<49:53,  1.63it/s]
                                                      
{'loss': 0.1801, 'grad_norm': 0.45952820777893066, 'learning_rate': 4.854693367365457e-06, 'epoch': 1.67}

 56%|█████▌    | 6169/11049 [1:03:32<49:53,  1.63it/s]
 56%|█████▌    | 6170/11049 [1:03:32<49:55,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.5064780712127686, 'learning_rate': 4.8531143995123164e-06, 'epoch': 1.68}

 56%|█████▌    | 6170/11049 [1:03:32<49:55,  1.63it/s]
 56%|█████▌    | 6171/11049 [1:03:33<49:53,  1.63it/s]
                                                      
{'loss': 0.2019, 'grad_norm': 0.5581550002098083, 'learning_rate': 4.851535446319942e-06, 'epoch': 1.68}

 56%|█████▌    | 6171/11049 [1:03:33<49:53,  1.63it/s]
 56%|█████▌    | 6172/11049 [1:03:33<49:53,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.48615172505378723, 'learning_rate': 4.849956507945931e-06, 'epoch': 1.68}

 56%|█████▌    | 6172/11049 [1:03:34<49:53,  1.63it/s]
 56%|█████▌    | 6173/11049 [1:03:34<49:52,  1.63it/s]
                                                      
{'loss': 0.2009, 'grad_norm': 0.5613871812820435, 'learning_rate': 4.848377584547883e-06, 'epoch': 1.68}

 56%|█████▌    | 6173/11049 [1:03:34<49:52,  1.63it/s]
 56%|█████▌    | 6174/11049 [1:03:35<49:51,  1.63it/s]
                                                      
{'loss': 0.1874, 'grad_norm': 0.5271304249763489, 'learning_rate': 4.846798676283387e-06, 'epoch': 1.68}

 56%|█████▌    | 6174/11049 [1:03:35<49:51,  1.63it/s]
 56%|█████▌    | 6175/11049 [1:03:35<49:54,  1.63it/s]
                                                      
{'loss': 0.2311, 'grad_norm': 0.6046825051307678, 'learning_rate': 4.845219783310039e-06, 'epoch': 1.68}

 56%|█████▌    | 6175/11049 [1:03:35<49:54,  1.63it/s]
 56%|█████▌    | 6176/11049 [1:03:36<49:53,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5006795525550842, 'learning_rate': 4.843640905785423e-06, 'epoch': 1.68}

 56%|█████▌    | 6176/11049 [1:03:36<49:53,  1.63it/s]
 56%|█████▌    | 6177/11049 [1:03:37<49:51,  1.63it/s]
                                                      
{'loss': 0.2046, 'grad_norm': 0.5303464531898499, 'learning_rate': 4.842062043867136e-06, 'epoch': 1.68}

 56%|█████▌    | 6177/11049 [1:03:37<49:51,  1.63it/s]
 56%|█████▌    | 6178/11049 [1:03:37<49:48,  1.63it/s]
                                                      
{'loss': 0.2563, 'grad_norm': 0.8081824779510498, 'learning_rate': 4.840483197712761e-06, 'epoch': 1.68}

 56%|█████▌    | 6178/11049 [1:03:37<49:48,  1.63it/s]
 56%|█████▌    | 6179/11049 [1:03:38<49:47,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.5103502869606018, 'learning_rate': 4.838904367479885e-06, 'epoch': 1.68}

 56%|█████▌    | 6179/11049 [1:03:38<49:47,  1.63it/s]
 56%|█████▌    | 6180/11049 [1:03:38<49:48,  1.63it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.6388276219367981, 'learning_rate': 4.837325553326091e-06, 'epoch': 1.68}

 56%|█████▌    | 6180/11049 [1:03:39<49:48,  1.63it/s]
 56%|█████▌    | 6181/11049 [1:03:39<49:48,  1.63it/s]
                                                      
{'loss': 0.2744, 'grad_norm': 0.5644265413284302, 'learning_rate': 4.835746755408962e-06, 'epoch': 1.68}

 56%|█████▌    | 6181/11049 [1:03:39<49:48,  1.63it/s]
 56%|█████▌    | 6182/11049 [1:03:40<49:48,  1.63it/s]
                                                      
{'loss': 0.1686, 'grad_norm': 0.522719144821167, 'learning_rate': 4.834167973886082e-06, 'epoch': 1.68}

 56%|█████▌    | 6182/11049 [1:03:40<49:48,  1.63it/s]
 56%|█████▌    | 6183/11049 [1:03:40<49:46,  1.63it/s]
                                                      
{'loss': 0.168, 'grad_norm': 0.4760133624076843, 'learning_rate': 4.832589208915028e-06, 'epoch': 1.68}

 56%|█████▌    | 6183/11049 [1:03:40<49:46,  1.63it/s]
 56%|█████▌    | 6184/11049 [1:03:41<49:45,  1.63it/s]
                                                      
{'loss': 0.2613, 'grad_norm': 0.576991617679596, 'learning_rate': 4.831010460653376e-06, 'epoch': 1.68}

 56%|█████▌    | 6184/11049 [1:03:41<49:45,  1.63it/s]
 56%|█████▌    | 6185/11049 [1:03:41<49:48,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.5956869125366211, 'learning_rate': 4.829431729258705e-06, 'epoch': 1.68}

 56%|█████▌    | 6185/11049 [1:03:42<49:48,  1.63it/s]
 56%|█████▌    | 6186/11049 [1:03:42<49:46,  1.63it/s]
                                                      
{'loss': 0.155, 'grad_norm': 0.47302374243736267, 'learning_rate': 4.827853014888589e-06, 'epoch': 1.68}

 56%|█████▌    | 6186/11049 [1:03:42<49:46,  1.63it/s]
 56%|█████▌    | 6187/11049 [1:03:43<49:46,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.5553581714630127, 'learning_rate': 4.8262743177006e-06, 'epoch': 1.68}

 56%|█████▌    | 6187/11049 [1:03:43<49:46,  1.63it/s]
 56%|█████▌    | 6188/11049 [1:03:43<49:44,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.5853592157363892, 'learning_rate': 4.824695637852309e-06, 'epoch': 1.68}

 56%|█████▌    | 6188/11049 [1:03:43<49:44,  1.63it/s]
 56%|█████▌    | 6189/11049 [1:03:44<49:42,  1.63it/s]
                                                      
{'loss': 0.2223, 'grad_norm': 0.59136962890625, 'learning_rate': 4.823116975501287e-06, 'epoch': 1.68}

 56%|█████▌    | 6189/11049 [1:03:44<49:42,  1.63it/s]
 56%|█████▌    | 6190/11049 [1:03:45<49:46,  1.63it/s]
                                                      
{'loss': 0.2426, 'grad_norm': 0.5317258238792419, 'learning_rate': 4.821538330805098e-06, 'epoch': 1.68}

 56%|█████▌    | 6190/11049 [1:03:45<49:46,  1.63it/s]
 56%|█████▌    | 6191/11049 [1:03:45<49:42,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.6218146085739136, 'learning_rate': 4.819959703921312e-06, 'epoch': 1.68}

 56%|█████▌    | 6191/11049 [1:03:45<49:42,  1.63it/s]
 56%|█████▌    | 6192/11049 [1:03:46<49:40,  1.63it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.5218432545661926, 'learning_rate': 4.818381095007489e-06, 'epoch': 1.68}

 56%|█████▌    | 6192/11049 [1:03:46<49:40,  1.63it/s]
 56%|█████▌    | 6193/11049 [1:03:46<49:40,  1.63it/s]
                                                      
{'loss': 0.1544, 'grad_norm': 0.49472615122795105, 'learning_rate': 4.816802504221194e-06, 'epoch': 1.68}

 56%|█████▌    | 6193/11049 [1:03:47<49:40,  1.63it/s]
 56%|█████▌    | 6194/11049 [1:03:47<49:38,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.49397894740104675, 'learning_rate': 4.815223931719987e-06, 'epoch': 1.68}

 56%|█████▌    | 6194/11049 [1:03:47<49:38,  1.63it/s]
 56%|█████▌    | 6195/11049 [1:03:48<49:42,  1.63it/s]
                                                      
{'loss': 0.2353, 'grad_norm': 0.5032899379730225, 'learning_rate': 4.813645377661426e-06, 'epoch': 1.68}

 56%|█████▌    | 6195/11049 [1:03:48<49:42,  1.63it/s]
 56%|█████▌    | 6196/11049 [1:03:48<49:52,  1.62it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.46534964442253113, 'learning_rate': 4.812066842203066e-06, 'epoch': 1.68}

 56%|█████▌    | 6196/11049 [1:03:48<49:52,  1.62it/s]
 56%|█████▌    | 6197/11049 [1:03:49<49:45,  1.63it/s]
                                                      
{'loss': 0.2308, 'grad_norm': 0.6334192156791687, 'learning_rate': 4.810488325502466e-06, 'epoch': 1.68}

 56%|█████▌    | 6197/11049 [1:03:49<49:45,  1.63it/s]
 56%|█████▌    | 6198/11049 [1:03:49<49:46,  1.62it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.4382970631122589, 'learning_rate': 4.808909827717175e-06, 'epoch': 1.68}

 56%|█████▌    | 6198/11049 [1:03:50<49:46,  1.62it/s]
 56%|█████▌    | 6199/11049 [1:03:50<49:40,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.47735244035720825, 'learning_rate': 4.8073313490047474e-06, 'epoch': 1.68}

 56%|█████▌    | 6199/11049 [1:03:50<49:40,  1.63it/s]
 56%|█████▌    | 6200/11049 [1:03:51<49:42,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.5319987535476685, 'learning_rate': 4.805752889522728e-06, 'epoch': 1.68}

 56%|█████▌    | 6200/11049 [1:03:51<49:42,  1.63it/s]
 56%|█████▌    | 6201/11049 [1:03:51<49:41,  1.63it/s]
                                                      
{'loss': 0.1936, 'grad_norm': 0.5759357810020447, 'learning_rate': 4.804174449428671e-06, 'epoch': 1.68}

 56%|█████▌    | 6201/11049 [1:03:51<49:41,  1.63it/s]
 56%|█████▌    | 6202/11049 [1:03:52<49:39,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.5294561982154846, 'learning_rate': 4.8025960288801155e-06, 'epoch': 1.68}

 56%|█████▌    | 6202/11049 [1:03:52<49:39,  1.63it/s]
 56%|█████▌    | 6203/11049 [1:03:53<49:34,  1.63it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.47417575120925903, 'learning_rate': 4.8010176280346075e-06, 'epoch': 1.68}

 56%|█████▌    | 6203/11049 [1:03:53<49:34,  1.63it/s]
 56%|█████▌    | 6204/11049 [1:03:53<49:37,  1.63it/s]
                                                      
{'loss': 0.2033, 'grad_norm': 0.5527548789978027, 'learning_rate': 4.799439247049686e-06, 'epoch': 1.68}

 56%|█████▌    | 6204/11049 [1:03:53<49:37,  1.63it/s]
 56%|█████▌    | 6205/11049 [1:03:54<49:38,  1.63it/s]
                                                      
{'loss': 0.1663, 'grad_norm': 0.4286825358867645, 'learning_rate': 4.797860886082895e-06, 'epoch': 1.68}

 56%|█████▌    | 6205/11049 [1:03:54<49:38,  1.63it/s]
 56%|█████▌    | 6206/11049 [1:03:54<49:53,  1.62it/s]
                                                      
{'loss': 0.1784, 'grad_norm': 0.5012944340705872, 'learning_rate': 4.79628254529177e-06, 'epoch': 1.69}

 56%|█████▌    | 6206/11049 [1:03:55<49:53,  1.62it/s]
 56%|█████▌    | 6207/11049 [1:03:55<49:45,  1.62it/s]
                                                      
{'loss': 0.2382, 'grad_norm': 0.6218435168266296, 'learning_rate': 4.794704224833845e-06, 'epoch': 1.69}

 56%|█████▌    | 6207/11049 [1:03:55<49:45,  1.62it/s]
 56%|█████▌    | 6208/11049 [1:03:56<49:40,  1.62it/s]
                                                      
{'loss': 0.2161, 'grad_norm': 0.5804811120033264, 'learning_rate': 4.793125924866651e-06, 'epoch': 1.69}

 56%|█████▌    | 6208/11049 [1:03:56<49:40,  1.62it/s]
 56%|█████▌    | 6209/11049 [1:03:56<49:35,  1.63it/s]
                                                      
{'loss': 0.2469, 'grad_norm': 0.5596821308135986, 'learning_rate': 4.791547645547727e-06, 'epoch': 1.69}

 56%|█████▌    | 6209/11049 [1:03:56<49:35,  1.63it/s]
 56%|█████▌    | 6210/11049 [1:03:57<49:38,  1.62it/s]
                                                      
{'loss': 0.2907, 'grad_norm': 0.6285413503646851, 'learning_rate': 4.789969387034598e-06, 'epoch': 1.69}

 56%|█████▌    | 6210/11049 [1:03:57<49:38,  1.62it/s]
 56%|█████▌    | 6211/11049 [1:03:57<49:38,  1.62it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.5265481472015381, 'learning_rate': 4.78839114948479e-06, 'epoch': 1.69}

 56%|█████▌    | 6211/11049 [1:03:58<49:38,  1.62it/s]
 56%|█████▌    | 6212/11049 [1:03:58<49:32,  1.63it/s]
                                                      
{'loss': 0.1641, 'grad_norm': 0.44091376662254333, 'learning_rate': 4.786812933055828e-06, 'epoch': 1.69}

 56%|█████▌    | 6212/11049 [1:03:58<49:32,  1.63it/s]
 56%|█████▌    | 6213/11049 [1:03:59<49:29,  1.63it/s]
                                                      
{'loss': 0.2382, 'grad_norm': 0.5931034088134766, 'learning_rate': 4.785234737905238e-06, 'epoch': 1.69}

 56%|█████▌    | 6213/11049 [1:03:59<49:29,  1.63it/s]
 56%|█████▌    | 6214/11049 [1:03:59<49:28,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.6038080453872681, 'learning_rate': 4.783656564190539e-06, 'epoch': 1.69}

 56%|█████▌    | 6214/11049 [1:03:59<49:28,  1.63it/s]
 56%|█████▌    | 6215/11049 [1:04:00<49:40,  1.62it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.5572042465209961, 'learning_rate': 4.782078412069251e-06, 'epoch': 1.69}

 56%|█████▌    | 6215/11049 [1:04:00<49:40,  1.62it/s]
 56%|█████▋    | 6216/11049 [1:04:01<49:35,  1.62it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.4803481698036194, 'learning_rate': 4.780500281698888e-06, 'epoch': 1.69}

 56%|█████▋    | 6216/11049 [1:04:01<49:35,  1.62it/s]
 56%|█████▋    | 6217/11049 [1:04:01<49:31,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.6242017149925232, 'learning_rate': 4.778922173236968e-06, 'epoch': 1.69}

 56%|█████▋    | 6217/11049 [1:04:01<49:31,  1.63it/s]
 56%|█████▋    | 6218/11049 [1:04:02<49:27,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.5025842785835266, 'learning_rate': 4.7773440868409996e-06, 'epoch': 1.69}

 56%|█████▋    | 6218/11049 [1:04:02<49:27,  1.63it/s]
 56%|█████▋    | 6219/11049 [1:04:02<49:25,  1.63it/s]
                                                      
{'loss': 0.2586, 'grad_norm': 0.5616719126701355, 'learning_rate': 4.775766022668497e-06, 'epoch': 1.69}

 56%|█████▋    | 6219/11049 [1:04:03<49:25,  1.63it/s]
 56%|█████▋    | 6220/11049 [1:04:03<49:29,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.5534199476242065, 'learning_rate': 4.774187980876963e-06, 'epoch': 1.69}

 56%|█████▋    | 6220/11049 [1:04:03<49:29,  1.63it/s]
 56%|█████▋    | 6221/11049 [1:04:04<49:25,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.559343695640564, 'learning_rate': 4.772609961623907e-06, 'epoch': 1.69}

 56%|█████▋    | 6221/11049 [1:04:04<49:25,  1.63it/s]
 56%|█████▋    | 6222/11049 [1:04:04<49:23,  1.63it/s]
                                                      
{'loss': 0.2013, 'grad_norm': 0.5609543323516846, 'learning_rate': 4.771031965066832e-06, 'epoch': 1.69}

 56%|█████▋    | 6222/11049 [1:04:04<49:23,  1.63it/s]
 56%|█████▋    | 6223/11049 [1:04:05<49:25,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.5713399052619934, 'learning_rate': 4.7694539913632385e-06, 'epoch': 1.69}

 56%|█████▋    | 6223/11049 [1:04:05<49:25,  1.63it/s]
 56%|█████▋    | 6224/11049 [1:04:05<49:19,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.6143503785133362, 'learning_rate': 4.767876040670624e-06, 'epoch': 1.69}

 56%|█████▋    | 6224/11049 [1:04:06<49:19,  1.63it/s]
 56%|█████▋    | 6225/11049 [1:04:06<49:24,  1.63it/s]
                                                      
{'loss': 0.195, 'grad_norm': 0.5717735886573792, 'learning_rate': 4.7662981131464866e-06, 'epoch': 1.69}

 56%|█████▋    | 6225/11049 [1:04:06<49:24,  1.63it/s]
 56%|█████▋    | 6226/11049 [1:04:07<49:22,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.6345407962799072, 'learning_rate': 4.764720208948321e-06, 'epoch': 1.69}

 56%|█████▋    | 6226/11049 [1:04:07<49:22,  1.63it/s]
 56%|█████▋    | 6227/11049 [1:04:07<49:21,  1.63it/s]
                                                      
{'loss': 0.1724, 'grad_norm': 0.44983619451522827, 'learning_rate': 4.763142328233617e-06, 'epoch': 1.69}

 56%|█████▋    | 6227/11049 [1:04:07<49:21,  1.63it/s]
 56%|█████▋    | 6228/11049 [1:04:08<49:18,  1.63it/s]
                                                      
{'loss': 0.1834, 'grad_norm': 0.4757164716720581, 'learning_rate': 4.7615644711598654e-06, 'epoch': 1.69}

 56%|█████▋    | 6228/11049 [1:04:08<49:18,  1.63it/s]
 56%|█████▋    | 6229/11049 [1:04:09<49:16,  1.63it/s]
                                                      
{'loss': 0.2434, 'grad_norm': 0.5793637037277222, 'learning_rate': 4.759986637884554e-06, 'epoch': 1.69}

 56%|█████▋    | 6229/11049 [1:04:09<49:16,  1.63it/s]
 56%|█████▋    | 6230/11049 [1:04:09<49:21,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.55601966381073, 'learning_rate': 4.758408828565167e-06, 'epoch': 1.69}

 56%|█████▋    | 6230/11049 [1:04:09<49:21,  1.63it/s]
 56%|█████▋    | 6231/11049 [1:04:10<49:18,  1.63it/s]
                                                      
{'loss': 0.2171, 'grad_norm': 0.5304467082023621, 'learning_rate': 4.756831043359186e-06, 'epoch': 1.69}

 56%|█████▋    | 6231/11049 [1:04:10<49:18,  1.63it/s]
 56%|█████▋    | 6232/11049 [1:04:10<49:16,  1.63it/s]
                                                      
{'loss': 0.2488, 'grad_norm': 0.5469834804534912, 'learning_rate': 4.755253282424091e-06, 'epoch': 1.69}

 56%|█████▋    | 6232/11049 [1:04:10<49:16,  1.63it/s]
 56%|█████▋    | 6233/11049 [1:04:11<49:16,  1.63it/s]
                                                      
{'loss': 0.2487, 'grad_norm': 0.6643978953361511, 'learning_rate': 4.753675545917361e-06, 'epoch': 1.69}

 56%|█████▋    | 6233/11049 [1:04:11<49:16,  1.63it/s]
 56%|█████▋    | 6234/11049 [1:04:12<49:16,  1.63it/s]
                                                      
{'loss': 0.1718, 'grad_norm': 0.4525914490222931, 'learning_rate': 4.752097833996471e-06, 'epoch': 1.69}

 56%|█████▋    | 6234/11049 [1:04:12<49:16,  1.63it/s]
 56%|█████▋    | 6235/11049 [1:04:12<49:17,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.6001445651054382, 'learning_rate': 4.7505201468188925e-06, 'epoch': 1.69}

 56%|█████▋    | 6235/11049 [1:04:12<49:17,  1.63it/s]
 56%|█████▋    | 6236/11049 [1:04:13<49:17,  1.63it/s]
                                                      
{'loss': 0.2104, 'grad_norm': 0.5843958854675293, 'learning_rate': 4.748942484542096e-06, 'epoch': 1.69}

 56%|█████▋    | 6236/11049 [1:04:13<49:17,  1.63it/s]
 56%|█████▋    | 6237/11049 [1:04:13<49:13,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.6104477643966675, 'learning_rate': 4.747364847323549e-06, 'epoch': 1.69}

 56%|█████▋    | 6237/11049 [1:04:14<49:13,  1.63it/s]
 56%|█████▋    | 6238/11049 [1:04:14<49:12,  1.63it/s]
                                                      
{'loss': 0.2109, 'grad_norm': 0.5292787551879883, 'learning_rate': 4.745787235320718e-06, 'epoch': 1.69}

 56%|█████▋    | 6238/11049 [1:04:14<49:12,  1.63it/s]
 56%|█████▋    | 6239/11049 [1:04:15<49:11,  1.63it/s]
                                                      
{'loss': 0.3555, 'grad_norm': 0.6954163908958435, 'learning_rate': 4.744209648691065e-06, 'epoch': 1.69}

 56%|█████▋    | 6239/11049 [1:04:15<49:11,  1.63it/s]
 56%|█████▋    | 6240/11049 [1:04:15<49:12,  1.63it/s]
                                                      
{'loss': 0.2411, 'grad_norm': 0.5650041699409485, 'learning_rate': 4.742632087592048e-06, 'epoch': 1.69}

 56%|█████▋    | 6240/11049 [1:04:15<49:12,  1.63it/s]
 56%|█████▋    | 6241/11049 [1:04:16<49:10,  1.63it/s]
                                                      
{'loss': 0.1691, 'grad_norm': 0.4213797152042389, 'learning_rate': 4.74105455218113e-06, 'epoch': 1.69}

 56%|█████▋    | 6241/11049 [1:04:16<49:10,  1.63it/s]
 56%|█████▋    | 6242/11049 [1:04:16<49:08,  1.63it/s]
                                                      
{'loss': 0.2374, 'grad_norm': 0.6508099436759949, 'learning_rate': 4.739477042615761e-06, 'epoch': 1.69}

 56%|█████▋    | 6242/11049 [1:04:17<49:08,  1.63it/s]
 57%|█████▋    | 6243/11049 [1:04:17<49:08,  1.63it/s]
                                                      
{'loss': 0.2927, 'grad_norm': 0.7300196886062622, 'learning_rate': 4.737899559053396e-06, 'epoch': 1.7}

 57%|█████▋    | 6243/11049 [1:04:17<49:08,  1.63it/s]
 57%|█████▋    | 6244/11049 [1:04:18<49:07,  1.63it/s]
                                                      
{'loss': 0.2175, 'grad_norm': 0.5625291466712952, 'learning_rate': 4.736322101651481e-06, 'epoch': 1.7}

 57%|█████▋    | 6244/11049 [1:04:18<49:07,  1.63it/s]
 57%|█████▋    | 6245/11049 [1:04:18<49:19,  1.62it/s]
                                                      
{'loss': 0.2266, 'grad_norm': 0.5564271807670593, 'learning_rate': 4.734744670567469e-06, 'epoch': 1.7}

 57%|█████▋    | 6245/11049 [1:04:18<49:19,  1.62it/s]
 57%|█████▋    | 6246/11049 [1:04:19<49:15,  1.63it/s]
                                                      
{'loss': 0.1888, 'grad_norm': 0.5006605982780457, 'learning_rate': 4.733167265958803e-06, 'epoch': 1.7}

 57%|█████▋    | 6246/11049 [1:04:19<49:15,  1.63it/s]
 57%|█████▋    | 6247/11049 [1:04:20<49:12,  1.63it/s]
                                                      
{'loss': 0.1823, 'grad_norm': 0.5564754009246826, 'learning_rate': 4.731589887982924e-06, 'epoch': 1.7}

 57%|█████▋    | 6247/11049 [1:04:20<49:12,  1.63it/s]
 57%|█████▋    | 6248/11049 [1:04:20<49:08,  1.63it/s]
                                                      
{'loss': 0.2098, 'grad_norm': 0.5207707285881042, 'learning_rate': 4.730012536797268e-06, 'epoch': 1.7}

 57%|█████▋    | 6248/11049 [1:04:20<49:08,  1.63it/s]
 57%|█████▋    | 6249/11049 [1:04:21<49:05,  1.63it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.6351243853569031, 'learning_rate': 4.728435212559278e-06, 'epoch': 1.7}

 57%|█████▋    | 6249/11049 [1:04:21<49:05,  1.63it/s]
 57%|█████▋    | 6250/11049 [1:04:21<49:09,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.6163270473480225, 'learning_rate': 4.726857915426385e-06, 'epoch': 1.7}

 57%|█████▋    | 6250/11049 [1:04:22<49:09,  1.63it/s]
 57%|█████▋    | 6251/11049 [1:04:22<49:06,  1.63it/s]
                                                      
{'loss': 0.179, 'grad_norm': 0.4638058543205261, 'learning_rate': 4.7252806455560215e-06, 'epoch': 1.7}

 57%|█████▋    | 6251/11049 [1:04:22<49:06,  1.63it/s]
 57%|█████▋    | 6252/11049 [1:04:23<49:04,  1.63it/s]
                                                      
{'loss': 0.1595, 'grad_norm': 0.43897774815559387, 'learning_rate': 4.723703403105611e-06, 'epoch': 1.7}

 57%|█████▋    | 6252/11049 [1:04:23<49:04,  1.63it/s]
 57%|█████▋    | 6253/11049 [1:04:23<49:03,  1.63it/s]
                                                      
{'loss': 0.196, 'grad_norm': 0.5447337627410889, 'learning_rate': 4.722126188232586e-06, 'epoch': 1.7}

 57%|█████▋    | 6253/11049 [1:04:23<49:03,  1.63it/s]
 57%|█████▋    | 6254/11049 [1:04:24<49:02,  1.63it/s]
                                                      
{'loss': 0.2106, 'grad_norm': 0.5667629241943359, 'learning_rate': 4.720549001094366e-06, 'epoch': 1.7}

 57%|█████▋    | 6254/11049 [1:04:24<49:02,  1.63it/s]
 57%|█████▋    | 6255/11049 [1:04:24<49:05,  1.63it/s]
                                                      
{'loss': 0.2048, 'grad_norm': 0.5606364607810974, 'learning_rate': 4.718971841848373e-06, 'epoch': 1.7}

 57%|█████▋    | 6255/11049 [1:04:25<49:05,  1.63it/s]
 57%|█████▋    | 6256/11049 [1:04:25<49:02,  1.63it/s]
                                                      
{'loss': 0.208, 'grad_norm': 0.5986608862876892, 'learning_rate': 4.717394710652024e-06, 'epoch': 1.7}

 57%|█████▋    | 6256/11049 [1:04:25<49:02,  1.63it/s]
 57%|█████▋    | 6257/11049 [1:04:26<49:02,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.6114372611045837, 'learning_rate': 4.715817607662731e-06, 'epoch': 1.7}

 57%|█████▋    | 6257/11049 [1:04:26<49:02,  1.63it/s]
 57%|█████▋    | 6258/11049 [1:04:26<49:00,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.45253872871398926, 'learning_rate': 4.714240533037909e-06, 'epoch': 1.7}

 57%|█████▋    | 6258/11049 [1:04:26<49:00,  1.63it/s]
 57%|█████▋    | 6259/11049 [1:04:27<48:59,  1.63it/s]
                                                      
{'loss': 0.2388, 'grad_norm': 0.5880632996559143, 'learning_rate': 4.712663486934967e-06, 'epoch': 1.7}

 57%|█████▋    | 6259/11049 [1:04:27<48:59,  1.63it/s]
 57%|█████▋    | 6260/11049 [1:04:28<49:03,  1.63it/s]
                                                      
{'loss': 0.1836, 'grad_norm': 0.4699879586696625, 'learning_rate': 4.711086469511311e-06, 'epoch': 1.7}

 57%|█████▋    | 6260/11049 [1:04:28<49:03,  1.63it/s]
 57%|█████▋    | 6261/11049 [1:04:28<49:00,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.5433023571968079, 'learning_rate': 4.7095094809243425e-06, 'epoch': 1.7}

 57%|█████▋    | 6261/11049 [1:04:28<49:00,  1.63it/s]
 57%|█████▋    | 6262/11049 [1:04:29<49:00,  1.63it/s]
                                                      
{'loss': 0.1694, 'grad_norm': 0.4825179874897003, 'learning_rate': 4.707932521331465e-06, 'epoch': 1.7}

 57%|█████▋    | 6262/11049 [1:04:29<49:00,  1.63it/s]
 57%|█████▋    | 6263/11049 [1:04:29<49:00,  1.63it/s]
                                                      
{'loss': 0.2355, 'grad_norm': 0.585006833076477, 'learning_rate': 4.706355590890073e-06, 'epoch': 1.7}

 57%|█████▋    | 6263/11049 [1:04:30<49:00,  1.63it/s]
 57%|█████▋    | 6264/11049 [1:04:30<48:59,  1.63it/s]
                                                      
{'loss': 0.2505, 'grad_norm': 0.6485965251922607, 'learning_rate': 4.704778689757564e-06, 'epoch': 1.7}

 57%|█████▋    | 6264/11049 [1:04:30<48:59,  1.63it/s]
 57%|█████▋    | 6265/11049 [1:04:31<49:01,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.6760232448577881, 'learning_rate': 4.703201818091326e-06, 'epoch': 1.7}

 57%|█████▋    | 6265/11049 [1:04:31<49:01,  1.63it/s]
 57%|█████▋    | 6266/11049 [1:04:31<49:02,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.5437039136886597, 'learning_rate': 4.701624976048753e-06, 'epoch': 1.7}

 57%|█████▋    | 6266/11049 [1:04:31<49:02,  1.63it/s]
 57%|█████▋    | 6267/11049 [1:04:32<48:59,  1.63it/s]
                                                      
{'loss': 0.2434, 'grad_norm': 0.5655441880226135, 'learning_rate': 4.700048163787227e-06, 'epoch': 1.7}

 57%|█████▋    | 6267/11049 [1:04:32<48:59,  1.63it/s]
 57%|█████▋    | 6268/11049 [1:04:32<48:56,  1.63it/s]
                                                      
{'loss': 0.1814, 'grad_norm': 0.45875170826911926, 'learning_rate': 4.698471381464131e-06, 'epoch': 1.7}

 57%|█████▋    | 6268/11049 [1:04:33<48:56,  1.63it/s]
 57%|█████▋    | 6269/11049 [1:04:33<48:54,  1.63it/s]
                                                      
{'loss': 0.2566, 'grad_norm': 0.6466536521911621, 'learning_rate': 4.696894629236846e-06, 'epoch': 1.7}

 57%|█████▋    | 6269/11049 [1:04:33<48:54,  1.63it/s]
 57%|█████▋    | 6270/11049 [1:04:34<48:55,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.6568584442138672, 'learning_rate': 4.69531790726275e-06, 'epoch': 1.7}

 57%|█████▋    | 6270/11049 [1:04:34<48:55,  1.63it/s]
 57%|█████▋    | 6271/11049 [1:04:34<48:53,  1.63it/s]
                                                      
{'loss': 0.1634, 'grad_norm': 0.43214771151542664, 'learning_rate': 4.693741215699215e-06, 'epoch': 1.7}

 57%|█████▋    | 6271/11049 [1:04:34<48:53,  1.63it/s]
 57%|█████▋    | 6272/11049 [1:04:35<48:52,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.5123289823532104, 'learning_rate': 4.692164554703613e-06, 'epoch': 1.7}

 57%|█████▋    | 6272/11049 [1:04:35<48:52,  1.63it/s]
 57%|█████▋    | 6273/11049 [1:04:36<48:52,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.4694958031177521, 'learning_rate': 4.690587924433309e-06, 'epoch': 1.7}

 57%|█████▋    | 6273/11049 [1:04:36<48:52,  1.63it/s]
 57%|█████▋    | 6274/11049 [1:04:36<48:53,  1.63it/s]
                                                      
{'loss': 0.2152, 'grad_norm': 0.5560498833656311, 'learning_rate': 4.689011325045672e-06, 'epoch': 1.7}

 57%|█████▋    | 6274/11049 [1:04:36<48:53,  1.63it/s]
 57%|█████▋    | 6275/11049 [1:04:37<48:57,  1.63it/s]
                                                      
{'loss': 0.2166, 'grad_norm': 0.5932751893997192, 'learning_rate': 4.6874347566980615e-06, 'epoch': 1.7}

 57%|█████▋    | 6275/11049 [1:04:37<48:57,  1.63it/s]
 57%|█████▋    | 6276/11049 [1:04:37<48:55,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.48151156306266785, 'learning_rate': 4.685858219547836e-06, 'epoch': 1.7}

 57%|█████▋    | 6276/11049 [1:04:38<48:55,  1.63it/s]
 57%|█████▋    | 6277/11049 [1:04:38<48:51,  1.63it/s]
                                                      
{'loss': 0.2146, 'grad_norm': 0.6521475315093994, 'learning_rate': 4.68428171375235e-06, 'epoch': 1.7}

 57%|█████▋    | 6277/11049 [1:04:38<48:51,  1.63it/s]
 57%|█████▋    | 6278/11049 [1:04:39<48:50,  1.63it/s]
                                                      
{'loss': 0.2535, 'grad_norm': 0.6093184947967529, 'learning_rate': 4.682705239468957e-06, 'epoch': 1.7}

 57%|█████▋    | 6278/11049 [1:04:39<48:50,  1.63it/s]
 57%|█████▋    | 6279/11049 [1:04:39<48:48,  1.63it/s]
                                                      
{'loss': 0.1718, 'grad_norm': 0.4660857915878296, 'learning_rate': 4.6811287968550076e-06, 'epoch': 1.7}

 57%|█████▋    | 6279/11049 [1:04:39<48:48,  1.63it/s]
 57%|█████▋    | 6280/11049 [1:04:40<48:49,  1.63it/s]
                                                      
{'loss': 0.2092, 'grad_norm': 0.509010910987854, 'learning_rate': 4.6795523860678456e-06, 'epoch': 1.71}

 57%|█████▋    | 6280/11049 [1:04:40<48:49,  1.63it/s]
 57%|█████▋    | 6281/11049 [1:04:40<48:52,  1.63it/s]
                                                      
{'loss': 0.2015, 'grad_norm': 0.48553287982940674, 'learning_rate': 4.677976007264812e-06, 'epoch': 1.71}

 57%|█████▋    | 6281/11049 [1:04:41<48:52,  1.63it/s]
 57%|█████▋    | 6282/11049 [1:04:41<48:49,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.5427818894386292, 'learning_rate': 4.676399660603252e-06, 'epoch': 1.71}

 57%|█████▋    | 6282/11049 [1:04:41<48:49,  1.63it/s]
 57%|█████▋    | 6283/11049 [1:04:42<48:47,  1.63it/s]
                                                      
{'loss': 0.1434, 'grad_norm': 0.4623703956604004, 'learning_rate': 4.6748233462404975e-06, 'epoch': 1.71}

 57%|█████▋    | 6283/11049 [1:04:42<48:47,  1.63it/s]
 57%|█████▋    | 6284/11049 [1:04:42<48:46,  1.63it/s]
                                                      
{'loss': 0.2022, 'grad_norm': 0.5115708112716675, 'learning_rate': 4.6732470643338835e-06, 'epoch': 1.71}

 57%|█████▋    | 6284/11049 [1:04:42<48:46,  1.63it/s]
 57%|█████▋    | 6285/11049 [1:04:43<48:48,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5307645201683044, 'learning_rate': 4.671670815040737e-06, 'epoch': 1.71}

 57%|█████▋    | 6285/11049 [1:04:43<48:48,  1.63it/s]
 57%|█████▋    | 6286/11049 [1:04:44<48:45,  1.63it/s]
                                                      
{'loss': 0.1868, 'grad_norm': 0.465812623500824, 'learning_rate': 4.67009459851839e-06, 'epoch': 1.71}

 57%|█████▋    | 6286/11049 [1:04:44<48:45,  1.63it/s]
 57%|█████▋    | 6287/11049 [1:04:44<48:43,  1.63it/s]
                                                      
{'loss': 0.246, 'grad_norm': 0.6133951544761658, 'learning_rate': 4.668518414924163e-06, 'epoch': 1.71}

 57%|█████▋    | 6287/11049 [1:04:44<48:43,  1.63it/s]
 57%|█████▋    | 6288/11049 [1:04:45<48:42,  1.63it/s]
                                                      
{'loss': 0.2062, 'grad_norm': 0.5311725735664368, 'learning_rate': 4.666942264415376e-06, 'epoch': 1.71}

 57%|█████▋    | 6288/11049 [1:04:45<48:42,  1.63it/s]
 57%|█████▋    | 6289/11049 [1:04:45<48:41,  1.63it/s]
                                                      
{'loss': 0.2417, 'grad_norm': 0.5870767831802368, 'learning_rate': 4.665366147149343e-06, 'epoch': 1.71}

 57%|█████▋    | 6289/11049 [1:04:45<48:41,  1.63it/s]
 57%|█████▋    | 6290/11049 [1:04:46<48:43,  1.63it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.5339056849479675, 'learning_rate': 4.6637900632833835e-06, 'epoch': 1.71}

 57%|█████▋    | 6290/11049 [1:04:46<48:43,  1.63it/s]
 57%|█████▋    | 6291/11049 [1:04:47<48:41,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.5309311151504517, 'learning_rate': 4.662214012974805e-06, 'epoch': 1.71}

 57%|█████▋    | 6291/11049 [1:04:47<48:41,  1.63it/s]
 57%|█████▋    | 6292/11049 [1:04:47<48:39,  1.63it/s]
                                                      
{'loss': 0.1877, 'grad_norm': 0.5362887978553772, 'learning_rate': 4.660637996380914e-06, 'epoch': 1.71}

 57%|█████▋    | 6292/11049 [1:04:47<48:39,  1.63it/s]
 57%|█████▋    | 6293/11049 [1:04:48<48:38,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.6029419302940369, 'learning_rate': 4.659062013659012e-06, 'epoch': 1.71}

 57%|█████▋    | 6293/11049 [1:04:48<48:38,  1.63it/s]
 57%|█████▋    | 6294/11049 [1:04:48<48:36,  1.63it/s]
                                                      
{'loss': 0.1699, 'grad_norm': 0.4853679835796356, 'learning_rate': 4.657486064966403e-06, 'epoch': 1.71}

 57%|█████▋    | 6294/11049 [1:04:49<48:36,  1.63it/s]
 57%|█████▋    | 6295/11049 [1:04:49<48:40,  1.63it/s]
                                                      
{'loss': 0.1876, 'grad_norm': 0.49730852246284485, 'learning_rate': 4.655910150460381e-06, 'epoch': 1.71}

 57%|█████▋    | 6295/11049 [1:04:49<48:40,  1.63it/s]
 57%|█████▋    | 6296/11049 [1:04:50<48:37,  1.63it/s]
                                                      
{'loss': 0.1769, 'grad_norm': 0.5576571822166443, 'learning_rate': 4.654334270298242e-06, 'epoch': 1.71}

 57%|█████▋    | 6296/11049 [1:04:50<48:37,  1.63it/s]
 57%|█████▋    | 6297/11049 [1:04:50<48:36,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.5445137023925781, 'learning_rate': 4.652758424637271e-06, 'epoch': 1.71}

 57%|█████▋    | 6297/11049 [1:04:50<48:36,  1.63it/s]
 57%|█████▋    | 6298/11049 [1:04:51<48:35,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.5712738037109375, 'learning_rate': 4.651182613634759e-06, 'epoch': 1.71}

 57%|█████▋    | 6298/11049 [1:04:51<48:35,  1.63it/s]
 57%|█████▋    | 6299/11049 [1:04:52<48:33,  1.63it/s]
                                                      
{'loss': 0.231, 'grad_norm': 0.5991244912147522, 'learning_rate': 4.649606837447987e-06, 'epoch': 1.71}

 57%|█████▋    | 6299/11049 [1:04:52<48:33,  1.63it/s]
 57%|█████▋    | 6300/11049 [1:04:52<48:38,  1.63it/s]
                                                      
{'loss': 0.1986, 'grad_norm': 0.5348066091537476, 'learning_rate': 4.6480310962342355e-06, 'epoch': 1.71}

 57%|█████▋    | 6300/11049 [1:04:52<48:38,  1.63it/s]
 57%|█████▋    | 6301/11049 [1:04:53<48:35,  1.63it/s]
                                                      
{'loss': 0.2375, 'grad_norm': 0.5796136260032654, 'learning_rate': 4.646455390150778e-06, 'epoch': 1.71}

 57%|█████▋    | 6301/11049 [1:04:53<48:35,  1.63it/s]
 57%|█████▋    | 6302/11049 [1:04:53<48:33,  1.63it/s]
                                                      
{'loss': 0.2827, 'grad_norm': 0.66932213306427, 'learning_rate': 4.64487971935489e-06, 'epoch': 1.71}

 57%|█████▋    | 6302/11049 [1:04:53<48:33,  1.63it/s]
 57%|█████▋    | 6303/11049 [1:04:54<48:35,  1.63it/s]
                                                      
{'loss': 0.188, 'grad_norm': 0.5706889033317566, 'learning_rate': 4.643304084003839e-06, 'epoch': 1.71}

 57%|█████▋    | 6303/11049 [1:04:54<48:35,  1.63it/s]
 57%|█████▋    | 6304/11049 [1:04:55<48:34,  1.63it/s]
                                                      
{'loss': 0.186, 'grad_norm': 0.4916166067123413, 'learning_rate': 4.641728484254891e-06, 'epoch': 1.71}

 57%|█████▋    | 6304/11049 [1:04:55<48:34,  1.63it/s]
 57%|█████▋    | 6305/11049 [1:04:55<48:36,  1.63it/s]
                                                      
{'loss': 0.2708, 'grad_norm': 0.5877018570899963, 'learning_rate': 4.640152920265306e-06, 'epoch': 1.71}

 57%|█████▋    | 6305/11049 [1:04:55<48:36,  1.63it/s]
 57%|█████▋    | 6306/11049 [1:04:56<48:34,  1.63it/s]
                                                      
{'loss': 0.1936, 'grad_norm': 0.5674104690551758, 'learning_rate': 4.638577392192345e-06, 'epoch': 1.71}

 57%|█████▋    | 6306/11049 [1:04:56<48:34,  1.63it/s]
 57%|█████▋    | 6307/11049 [1:04:56<48:31,  1.63it/s]
                                                      
{'loss': 0.1792, 'grad_norm': 0.4784173369407654, 'learning_rate': 4.637001900193262e-06, 'epoch': 1.71}

 57%|█████▋    | 6307/11049 [1:04:57<48:31,  1.63it/s]
 57%|█████▋    | 6308/11049 [1:04:57<48:30,  1.63it/s]
                                                      
{'loss': 0.2507, 'grad_norm': 0.6186861395835876, 'learning_rate': 4.6354264444253074e-06, 'epoch': 1.71}

 57%|█████▋    | 6308/11049 [1:04:57<48:30,  1.63it/s]
 57%|█████▋    | 6309/11049 [1:04:58<48:29,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.5311223268508911, 'learning_rate': 4.6338510250457266e-06, 'epoch': 1.71}

 57%|█████▋    | 6309/11049 [1:04:58<48:29,  1.63it/s]
 57%|█████▋    | 6310/11049 [1:04:58<48:32,  1.63it/s]
                                                      
{'loss': 0.2569, 'grad_norm': 0.6015767455101013, 'learning_rate': 4.6322756422117684e-06, 'epoch': 1.71}

 57%|█████▋    | 6310/11049 [1:04:58<48:32,  1.63it/s]
 57%|█████▋    | 6311/11049 [1:04:59<48:30,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5304619669914246, 'learning_rate': 4.630700296080669e-06, 'epoch': 1.71}

 57%|█████▋    | 6311/11049 [1:04:59<48:30,  1.63it/s]
 57%|█████▋    | 6312/11049 [1:04:59<48:28,  1.63it/s]
                                                      
{'loss': 0.1951, 'grad_norm': 0.6076170206069946, 'learning_rate': 4.629124986809667e-06, 'epoch': 1.71}

 57%|█████▋    | 6312/11049 [1:05:00<48:28,  1.63it/s]
 57%|█████▋    | 6313/11049 [1:05:00<48:27,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.47832024097442627, 'learning_rate': 4.627549714555993e-06, 'epoch': 1.71}

 57%|█████▋    | 6313/11049 [1:05:00<48:27,  1.63it/s]
 57%|█████▋    | 6314/11049 [1:05:01<48:25,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.5583305358886719, 'learning_rate': 4.625974479476879e-06, 'epoch': 1.71}

 57%|█████▋    | 6314/11049 [1:05:01<48:25,  1.63it/s]
 57%|█████▋    | 6315/11049 [1:05:01<48:29,  1.63it/s]
                                                      
{'loss': 0.2311, 'grad_norm': 0.5571518540382385, 'learning_rate': 4.62439928172955e-06, 'epoch': 1.71}

 57%|█████▋    | 6315/11049 [1:05:01<48:29,  1.63it/s]
 57%|█████▋    | 6316/11049 [1:05:02<48:27,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.5204542875289917, 'learning_rate': 4.622824121471226e-06, 'epoch': 1.71}

 57%|█████▋    | 6316/11049 [1:05:02<48:27,  1.63it/s]
 57%|█████▋    | 6317/11049 [1:05:03<48:25,  1.63it/s]
                                                      
{'loss': 0.2279, 'grad_norm': 0.5579009652137756, 'learning_rate': 4.621248998859124e-06, 'epoch': 1.72}

 57%|█████▋    | 6317/11049 [1:05:03<48:25,  1.63it/s]
 57%|█████▋    | 6318/11049 [1:05:03<48:23,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.5015605092048645, 'learning_rate': 4.619673914050464e-06, 'epoch': 1.72}

 57%|█████▋    | 6318/11049 [1:05:03<48:23,  1.63it/s]
 57%|█████▋    | 6319/11049 [1:05:04<48:23,  1.63it/s]
                                                      
{'loss': 0.1729, 'grad_norm': 0.4698612093925476, 'learning_rate': 4.61809886720245e-06, 'epoch': 1.72}

 57%|█████▋    | 6319/11049 [1:05:04<48:23,  1.63it/s]
 57%|█████▋    | 6320/11049 [1:05:04<48:26,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.5793324708938599, 'learning_rate': 4.6165238584722926e-06, 'epoch': 1.72}

 57%|█████▋    | 6320/11049 [1:05:05<48:26,  1.63it/s]
 57%|█████▋    | 6321/11049 [1:05:05<48:24,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.5179330706596375, 'learning_rate': 4.614948888017191e-06, 'epoch': 1.72}

 57%|█████▋    | 6321/11049 [1:05:05<48:24,  1.63it/s]
 57%|█████▋    | 6322/11049 [1:05:06<48:22,  1.63it/s]
                                                      
{'loss': 0.2645, 'grad_norm': 0.695035994052887, 'learning_rate': 4.613373955994348e-06, 'epoch': 1.72}

 57%|█████▋    | 6322/11049 [1:05:06<48:22,  1.63it/s]
 57%|█████▋    | 6323/11049 [1:05:06<48:20,  1.63it/s]
                                                      
{'loss': 0.1787, 'grad_norm': 0.4912552535533905, 'learning_rate': 4.61179906256096e-06, 'epoch': 1.72}

 57%|█████▋    | 6323/11049 [1:05:06<48:20,  1.63it/s]
 57%|█████▋    | 6324/11049 [1:05:07<48:19,  1.63it/s]
                                                      
{'loss': 0.185, 'grad_norm': 0.5371565818786621, 'learning_rate': 4.610224207874214e-06, 'epoch': 1.72}

 57%|█████▋    | 6324/11049 [1:05:07<48:19,  1.63it/s]
 57%|█████▋    | 6325/11049 [1:05:07<48:20,  1.63it/s]
                                                      
{'loss': 0.2216, 'grad_norm': 0.5411171317100525, 'learning_rate': 4.6086493920912964e-06, 'epoch': 1.72}

 57%|█████▋    | 6325/11049 [1:05:08<48:20,  1.63it/s]
 57%|█████▋    | 6326/11049 [1:05:08<48:18,  1.63it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.42405474185943604, 'learning_rate': 4.607074615369396e-06, 'epoch': 1.72}

 57%|█████▋    | 6326/11049 [1:05:08<48:18,  1.63it/s]
 57%|█████▋    | 6327/11049 [1:05:09<48:18,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5588636994361877, 'learning_rate': 4.605499877865691e-06, 'epoch': 1.72}

 57%|█████▋    | 6327/11049 [1:05:09<48:18,  1.63it/s]
 57%|█████▋    | 6328/11049 [1:05:09<48:16,  1.63it/s]
                                                      
{'loss': 0.2093, 'grad_norm': 0.5145182609558105, 'learning_rate': 4.603925179737358e-06, 'epoch': 1.72}

 57%|█████▋    | 6328/11049 [1:05:09<48:16,  1.63it/s]
 57%|█████▋    | 6329/11049 [1:05:10<48:15,  1.63it/s]
                                                      
{'loss': 0.3064, 'grad_norm': 0.8542454838752747, 'learning_rate': 4.6023505211415635e-06, 'epoch': 1.72}

 57%|█████▋    | 6329/11049 [1:05:10<48:15,  1.63it/s]
 57%|█████▋    | 6330/11049 [1:05:11<48:17,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5744643807411194, 'learning_rate': 4.600775902235481e-06, 'epoch': 1.72}

 57%|█████▋    | 6330/11049 [1:05:11<48:17,  1.63it/s]
 57%|█████▋    | 6331/11049 [1:05:11<48:15,  1.63it/s]
                                                      
{'loss': 0.1974, 'grad_norm': 0.5555375814437866, 'learning_rate': 4.599201323176272e-06, 'epoch': 1.72}

 57%|█████▋    | 6331/11049 [1:05:11<48:15,  1.63it/s]
 57%|█████▋    | 6332/11049 [1:05:12<48:14,  1.63it/s]
                                                      
{'loss': 0.1678, 'grad_norm': 0.52585768699646, 'learning_rate': 4.597626784121099e-06, 'epoch': 1.72}

 57%|█████▋    | 6332/11049 [1:05:12<48:14,  1.63it/s]
 57%|█████▋    | 6333/11049 [1:05:12<48:14,  1.63it/s]
                                                      
{'loss': 0.1703, 'grad_norm': 0.46007809042930603, 'learning_rate': 4.596052285227114e-06, 'epoch': 1.72}

 57%|█████▋    | 6333/11049 [1:05:13<48:14,  1.63it/s]
 57%|█████▋    | 6334/11049 [1:05:13<48:13,  1.63it/s]
                                                      
{'loss': 0.163, 'grad_norm': 0.503681480884552, 'learning_rate': 4.594477826651472e-06, 'epoch': 1.72}

 57%|█████▋    | 6334/11049 [1:05:13<48:13,  1.63it/s]
 57%|█████▋    | 6335/11049 [1:05:14<48:16,  1.63it/s]
                                                      
{'loss': 0.2402, 'grad_norm': 0.5941452980041504, 'learning_rate': 4.59290340855132e-06, 'epoch': 1.72}

 57%|█████▋    | 6335/11049 [1:05:14<48:16,  1.63it/s]
 57%|█████▋    | 6336/11049 [1:05:14<48:14,  1.63it/s]
                                                      
{'loss': 0.2084, 'grad_norm': 0.5378054976463318, 'learning_rate': 4.591329031083803e-06, 'epoch': 1.72}

 57%|█████▋    | 6336/11049 [1:05:14<48:14,  1.63it/s]
 57%|█████▋    | 6337/11049 [1:05:15<48:14,  1.63it/s]
                                                      
{'loss': 0.1758, 'grad_norm': 0.4728856384754181, 'learning_rate': 4.589754694406058e-06, 'epoch': 1.72}

 57%|█████▋    | 6337/11049 [1:05:15<48:14,  1.63it/s]
 57%|█████▋    | 6338/11049 [1:05:15<48:12,  1.63it/s]
                                                      
{'loss': 0.1582, 'grad_norm': 0.4800257086753845, 'learning_rate': 4.588180398675224e-06, 'epoch': 1.72}

 57%|█████▋    | 6338/11049 [1:05:16<48:12,  1.63it/s]
 57%|█████▋    | 6339/11049 [1:05:16<48:10,  1.63it/s]
                                                      
{'loss': 0.2638, 'grad_norm': 0.7213047742843628, 'learning_rate': 4.586606144048432e-06, 'epoch': 1.72}

 57%|█████▋    | 6339/11049 [1:05:16<48:10,  1.63it/s]
 57%|█████▋    | 6340/11049 [1:05:17<48:14,  1.63it/s]
                                                      
{'loss': 0.2204, 'grad_norm': 0.5457931160926819, 'learning_rate': 4.585031930682808e-06, 'epoch': 1.72}

 57%|█████▋    | 6340/11049 [1:05:17<48:14,  1.63it/s]
 57%|█████▋    | 6341/11049 [1:05:17<48:11,  1.63it/s]
                                                      
{'loss': 0.2285, 'grad_norm': 0.5344275236129761, 'learning_rate': 4.583457758735477e-06, 'epoch': 1.72}

 57%|█████▋    | 6341/11049 [1:05:17<48:11,  1.63it/s]
 57%|█████▋    | 6342/11049 [1:05:18<48:09,  1.63it/s]
                                                      
{'loss': 0.1712, 'grad_norm': 0.43828681111335754, 'learning_rate': 4.581883628363557e-06, 'epoch': 1.72}

 57%|█████▋    | 6342/11049 [1:05:18<48:09,  1.63it/s]
 57%|█████▋    | 6343/11049 [1:05:19<48:08,  1.63it/s]
                                                      
{'loss': 0.1858, 'grad_norm': 0.5269228219985962, 'learning_rate': 4.580309539724166e-06, 'epoch': 1.72}

 57%|█████▋    | 6343/11049 [1:05:19<48:08,  1.63it/s]
 57%|█████▋    | 6344/11049 [1:05:19<48:05,  1.63it/s]
                                                      
{'loss': 0.2079, 'grad_norm': 0.5175990462303162, 'learning_rate': 4.578735492974411e-06, 'epoch': 1.72}

 57%|█████▋    | 6344/11049 [1:05:19<48:05,  1.63it/s]
 57%|█████▋    | 6345/11049 [1:05:20<48:09,  1.63it/s]
                                                      
{'loss': 0.1842, 'grad_norm': 0.5148940682411194, 'learning_rate': 4.577161488271401e-06, 'epoch': 1.72}

 57%|█████▋    | 6345/11049 [1:05:20<48:09,  1.63it/s]
 57%|█████▋    | 6346/11049 [1:05:20<48:06,  1.63it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.48159775137901306, 'learning_rate': 4.575587525772239e-06, 'epoch': 1.72}

 57%|█████▋    | 6346/11049 [1:05:20<48:06,  1.63it/s]
 57%|█████▋    | 6347/11049 [1:05:21<48:05,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.5305370688438416, 'learning_rate': 4.574013605634024e-06, 'epoch': 1.72}

 57%|█████▋    | 6347/11049 [1:05:21<48:05,  1.63it/s]
 57%|█████▋    | 6348/11049 [1:05:22<48:04,  1.63it/s]
                                                      
{'loss': 0.2777, 'grad_norm': 0.6224814653396606, 'learning_rate': 4.572439728013849e-06, 'epoch': 1.72}

 57%|█████▋    | 6348/11049 [1:05:22<48:04,  1.63it/s]
 57%|█████▋    | 6349/11049 [1:05:22<48:03,  1.63it/s]
                                                      
{'loss': 0.2033, 'grad_norm': 0.5542730093002319, 'learning_rate': 4.570865893068802e-06, 'epoch': 1.72}

 57%|█████▋    | 6349/11049 [1:05:22<48:03,  1.63it/s]
 57%|█████▋    | 6350/11049 [1:05:23<48:07,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.4885565936565399, 'learning_rate': 4.569292100955973e-06, 'epoch': 1.72}

 57%|█████▋    | 6350/11049 [1:05:23<48:07,  1.63it/s]
 57%|█████▋    | 6351/11049 [1:05:23<48:04,  1.63it/s]
                                                      
{'loss': 0.2011, 'grad_norm': 0.5530111789703369, 'learning_rate': 4.567718351832442e-06, 'epoch': 1.72}

 57%|█████▋    | 6351/11049 [1:05:24<48:04,  1.63it/s]
 57%|█████▋    | 6352/11049 [1:05:24<48:03,  1.63it/s]
                                                      
{'loss': 0.1758, 'grad_norm': 0.5386800765991211, 'learning_rate': 4.566144645855285e-06, 'epoch': 1.72}

 57%|█████▋    | 6352/11049 [1:05:24<48:03,  1.63it/s]
 57%|█████▋    | 6353/11049 [1:05:25<48:01,  1.63it/s]
                                                      
{'loss': 0.2183, 'grad_norm': 0.559790849685669, 'learning_rate': 4.564570983181573e-06, 'epoch': 1.72}

 57%|█████▋    | 6353/11049 [1:05:25<48:01,  1.63it/s]
 58%|█████▊    | 6354/11049 [1:05:25<48:00,  1.63it/s]
                                                      
{'loss': 0.2182, 'grad_norm': 0.529066801071167, 'learning_rate': 4.562997363968381e-06, 'epoch': 1.73}

 58%|█████▊    | 6354/11049 [1:05:25<48:00,  1.63it/s]
 58%|█████▊    | 6355/11049 [1:05:26<48:02,  1.63it/s]
                                                      
{'loss': 0.2028, 'grad_norm': 0.5203354358673096, 'learning_rate': 4.561423788372767e-06, 'epoch': 1.73}

 58%|█████▊    | 6355/11049 [1:05:26<48:02,  1.63it/s]
 58%|█████▊    | 6356/11049 [1:05:26<48:00,  1.63it/s]
                                                      
{'loss': 0.1518, 'grad_norm': 0.43461695313453674, 'learning_rate': 4.559850256551793e-06, 'epoch': 1.73}

 58%|█████▊    | 6356/11049 [1:05:27<48:00,  1.63it/s]
 58%|█████▊    | 6357/11049 [1:05:27<47:58,  1.63it/s]
                                                      
{'loss': 0.2134, 'grad_norm': 0.584725558757782, 'learning_rate': 4.558276768662512e-06, 'epoch': 1.73}

 58%|█████▊    | 6357/11049 [1:05:27<47:58,  1.63it/s]
 58%|█████▊    | 6358/11049 [1:05:28<47:57,  1.63it/s]
                                                      
{'loss': 0.2705, 'grad_norm': 0.5917019248008728, 'learning_rate': 4.556703324861981e-06, 'epoch': 1.73}

 58%|█████▊    | 6358/11049 [1:05:28<47:57,  1.63it/s]
 58%|█████▊    | 6359/11049 [1:05:28<47:57,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.5799717903137207, 'learning_rate': 4.555129925307243e-06, 'epoch': 1.73}

 58%|█████▊    | 6359/11049 [1:05:28<47:57,  1.63it/s]
 58%|█████▊    | 6360/11049 [1:05:29<48:00,  1.63it/s]
                                                      
{'loss': 0.1908, 'grad_norm': 0.5343596339225769, 'learning_rate': 4.55355657015534e-06, 'epoch': 1.73}

 58%|█████▊    | 6360/11049 [1:05:29<48:00,  1.63it/s]
 58%|█████▊    | 6361/11049 [1:05:30<48:01,  1.63it/s]
                                                      
{'loss': 0.2712, 'grad_norm': 0.6273738145828247, 'learning_rate': 4.5519832595633076e-06, 'epoch': 1.73}

 58%|█████▊    | 6361/11049 [1:05:30<48:01,  1.63it/s]
 58%|█████▊    | 6362/11049 [1:05:30<48:00,  1.63it/s]
                                                      
{'loss': 0.2319, 'grad_norm': 0.5877447128295898, 'learning_rate': 4.550409993688184e-06, 'epoch': 1.73}

 58%|█████▊    | 6362/11049 [1:05:30<48:00,  1.63it/s]
 58%|█████▊    | 6363/11049 [1:05:31<47:55,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5274825096130371, 'learning_rate': 4.548836772686995e-06, 'epoch': 1.73}

 58%|█████▊    | 6363/11049 [1:05:31<47:55,  1.63it/s]
 58%|█████▊    | 6364/11049 [1:05:31<47:55,  1.63it/s]
                                                      
{'loss': 0.2092, 'grad_norm': 0.5507463812828064, 'learning_rate': 4.547263596716768e-06, 'epoch': 1.73}

 58%|█████▊    | 6364/11049 [1:05:32<47:55,  1.63it/s]
 58%|█████▊    | 6365/11049 [1:05:32<47:59,  1.63it/s]
                                                      
{'loss': 0.2527, 'grad_norm': 0.610773503780365, 'learning_rate': 4.545690465934518e-06, 'epoch': 1.73}

 58%|█████▊    | 6365/11049 [1:05:32<47:59,  1.63it/s]
 58%|█████▊    | 6366/11049 [1:05:33<47:58,  1.63it/s]
                                                      
{'loss': 0.1638, 'grad_norm': 0.4864136874675751, 'learning_rate': 4.544117380497265e-06, 'epoch': 1.73}

 58%|█████▊    | 6366/11049 [1:05:33<47:58,  1.63it/s]
 58%|█████▊    | 6367/11049 [1:05:33<47:55,  1.63it/s]
                                                      
{'loss': 0.2192, 'grad_norm': 0.5832316279411316, 'learning_rate': 4.542544340562019e-06, 'epoch': 1.73}

 58%|█████▊    | 6367/11049 [1:05:33<47:55,  1.63it/s]
 58%|█████▊    | 6368/11049 [1:05:34<47:54,  1.63it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.5591956377029419, 'learning_rate': 4.540971346285784e-06, 'epoch': 1.73}

 58%|█████▊    | 6368/11049 [1:05:34<47:54,  1.63it/s]
 58%|█████▊    | 6369/11049 [1:05:34<47:53,  1.63it/s]
                                                      
{'loss': 0.2406, 'grad_norm': 0.6252442598342896, 'learning_rate': 4.539398397825563e-06, 'epoch': 1.73}

 58%|█████▊    | 6369/11049 [1:05:35<47:53,  1.63it/s]
 58%|█████▊    | 6370/11049 [1:05:35<47:56,  1.63it/s]
                                                      
{'loss': 0.2155, 'grad_norm': 0.5461089611053467, 'learning_rate': 4.537825495338356e-06, 'epoch': 1.73}

 58%|█████▊    | 6370/11049 [1:05:35<47:56,  1.63it/s]
 58%|█████▊    | 6371/11049 [1:05:36<47:54,  1.63it/s]
                                                      
{'loss': 0.1871, 'grad_norm': 0.555149257183075, 'learning_rate': 4.536252638981152e-06, 'epoch': 1.73}

 58%|█████▊    | 6371/11049 [1:05:36<47:54,  1.63it/s]
 58%|█████▊    | 6372/11049 [1:05:36<47:51,  1.63it/s]
                                                      
{'loss': 0.2004, 'grad_norm': 0.5026284456253052, 'learning_rate': 4.53467982891094e-06, 'epoch': 1.73}

 58%|█████▊    | 6372/11049 [1:05:36<47:51,  1.63it/s]
 58%|█████▊    | 6373/11049 [1:05:37<47:50,  1.63it/s]
                                                      
{'loss': 0.2055, 'grad_norm': 0.5855298042297363, 'learning_rate': 4.533107065284703e-06, 'epoch': 1.73}

 58%|█████▊    | 6373/11049 [1:05:37<47:50,  1.63it/s]
 58%|█████▊    | 6374/11049 [1:05:38<47:47,  1.63it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.5424288511276245, 'learning_rate': 4.531534348259422e-06, 'epoch': 1.73}

 58%|█████▊    | 6374/11049 [1:05:38<47:47,  1.63it/s]
 58%|█████▊    | 6375/11049 [1:05:38<47:50,  1.63it/s]
                                                      
{'loss': 0.1548, 'grad_norm': 0.4542744755744934, 'learning_rate': 4.52996167799207e-06, 'epoch': 1.73}

 58%|█████▊    | 6375/11049 [1:05:38<47:50,  1.63it/s]
 58%|█████▊    | 6376/11049 [1:05:39<47:50,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.4810096025466919, 'learning_rate': 4.528389054639615e-06, 'epoch': 1.73}

 58%|█████▊    | 6376/11049 [1:05:39<47:50,  1.63it/s]
 58%|█████▊    | 6377/11049 [1:05:39<47:48,  1.63it/s]
                                                      
{'loss': 0.1897, 'grad_norm': 0.5286756753921509, 'learning_rate': 4.526816478359023e-06, 'epoch': 1.73}

 58%|█████▊    | 6377/11049 [1:05:40<47:48,  1.63it/s]
 58%|█████▊    | 6378/11049 [1:05:40<47:47,  1.63it/s]
                                                      
{'loss': 0.1626, 'grad_norm': 0.4648369252681732, 'learning_rate': 4.525243949307255e-06, 'epoch': 1.73}

 58%|█████▊    | 6378/11049 [1:05:40<47:47,  1.63it/s]
 58%|█████▊    | 6379/11049 [1:05:41<47:47,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.49801021814346313, 'learning_rate': 4.5236714676412644e-06, 'epoch': 1.73}

 58%|█████▊    | 6379/11049 [1:05:41<47:47,  1.63it/s]
 58%|█████▊    | 6380/11049 [1:05:41<47:48,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5250387191772461, 'learning_rate': 4.5220990335180035e-06, 'epoch': 1.73}

 58%|█████▊    | 6380/11049 [1:05:41<47:48,  1.63it/s]
 58%|█████▊    | 6381/11049 [1:05:42<47:46,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5118317604064941, 'learning_rate': 4.520526647094416e-06, 'epoch': 1.73}

 58%|█████▊    | 6381/11049 [1:05:42<47:46,  1.63it/s]
 58%|█████▊    | 6382/11049 [1:05:42<47:45,  1.63it/s]
                                                      
{'loss': 0.2184, 'grad_norm': 0.5965331792831421, 'learning_rate': 4.518954308527446e-06, 'epoch': 1.73}

 58%|█████▊    | 6382/11049 [1:05:43<47:45,  1.63it/s]
 58%|█████▊    | 6383/11049 [1:05:43<47:44,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.5737684369087219, 'learning_rate': 4.517382017974028e-06, 'epoch': 1.73}

 58%|█████▊    | 6383/11049 [1:05:43<47:44,  1.63it/s]
 58%|█████▊    | 6384/11049 [1:05:44<47:42,  1.63it/s]
                                                      
{'loss': 0.1826, 'grad_norm': 0.5004974007606506, 'learning_rate': 4.515809775591095e-06, 'epoch': 1.73}

 58%|█████▊    | 6384/11049 [1:05:44<47:42,  1.63it/s]
 58%|█████▊    | 6385/11049 [1:05:44<47:46,  1.63it/s]
                                                      
{'loss': 0.2496, 'grad_norm': 0.5473154187202454, 'learning_rate': 4.514237581535571e-06, 'epoch': 1.73}

 58%|█████▊    | 6385/11049 [1:05:44<47:46,  1.63it/s]
 58%|█████▊    | 6386/11049 [1:05:45<47:44,  1.63it/s]
                                                      
{'loss': 0.21, 'grad_norm': 0.6016470193862915, 'learning_rate': 4.512665435964381e-06, 'epoch': 1.73}

 58%|█████▊    | 6386/11049 [1:05:45<47:44,  1.63it/s]
 58%|█████▊    | 6387/11049 [1:05:46<47:42,  1.63it/s]
                                                      
{'loss': 0.2266, 'grad_norm': 0.5887229442596436, 'learning_rate': 4.511093339034441e-06, 'epoch': 1.73}

 58%|█████▊    | 6387/11049 [1:05:46<47:42,  1.63it/s]
 58%|█████▊    | 6388/11049 [1:05:46<47:54,  1.62it/s]
                                                      
{'loss': 0.2362, 'grad_norm': 0.6536058783531189, 'learning_rate': 4.509521290902662e-06, 'epoch': 1.73}

 58%|█████▊    | 6388/11049 [1:05:46<47:54,  1.62it/s]
 58%|█████▊    | 6389/11049 [1:05:47<47:48,  1.62it/s]
                                                      
{'loss': 0.1917, 'grad_norm': 0.5290526747703552, 'learning_rate': 4.507949291725951e-06, 'epoch': 1.73}

 58%|█████▊    | 6389/11049 [1:05:47<47:48,  1.62it/s]
 58%|█████▊    | 6390/11049 [1:05:47<47:48,  1.62it/s]
                                                      
{'loss': 0.1748, 'grad_norm': 0.5022408962249756, 'learning_rate': 4.506377341661215e-06, 'epoch': 1.73}

 58%|█████▊    | 6390/11049 [1:05:48<47:48,  1.62it/s]
 58%|█████▊    | 6391/11049 [1:05:48<47:45,  1.63it/s]
                                                      
{'loss': 0.1904, 'grad_norm': 0.4624047577381134, 'learning_rate': 4.504805440865347e-06, 'epoch': 1.74}

 58%|█████▊    | 6391/11049 [1:05:48<47:45,  1.63it/s]
 58%|█████▊    | 6392/11049 [1:05:49<47:41,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.5652979612350464, 'learning_rate': 4.5032335894952425e-06, 'epoch': 1.74}

 58%|█████▊    | 6392/11049 [1:05:49<47:41,  1.63it/s]
 58%|█████▊    | 6393/11049 [1:05:49<47:39,  1.63it/s]
                                                      
{'loss': 0.1507, 'grad_norm': 0.48526906967163086, 'learning_rate': 4.501661787707784e-06, 'epoch': 1.74}

 58%|█████▊    | 6393/11049 [1:05:49<47:39,  1.63it/s]
 58%|█████▊    | 6394/11049 [1:05:50<47:40,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5432410836219788, 'learning_rate': 4.500090035659861e-06, 'epoch': 1.74}

 58%|█████▊    | 6394/11049 [1:05:50<47:40,  1.63it/s]
 58%|█████▊    | 6395/11049 [1:05:50<47:41,  1.63it/s]
                                                      
{'loss': 0.2343, 'grad_norm': 0.5995243787765503, 'learning_rate': 4.498518333508351e-06, 'epoch': 1.74}

 58%|█████▊    | 6395/11049 [1:05:51<47:41,  1.63it/s]
 58%|█████▊    | 6396/11049 [1:05:51<47:39,  1.63it/s]
                                                      
{'loss': 0.1661, 'grad_norm': 0.44447341561317444, 'learning_rate': 4.496946681410121e-06, 'epoch': 1.74}

 58%|█████▊    | 6396/11049 [1:05:51<47:39,  1.63it/s]
 58%|█████▊    | 6397/11049 [1:05:52<47:37,  1.63it/s]
                                                      
{'loss': 0.1334, 'grad_norm': 0.43063536286354065, 'learning_rate': 4.495375079522041e-06, 'epoch': 1.74}

 58%|█████▊    | 6397/11049 [1:05:52<47:37,  1.63it/s]
 58%|█████▊    | 6398/11049 [1:05:52<47:35,  1.63it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.5514809489250183, 'learning_rate': 4.493803528000978e-06, 'epoch': 1.74}

 58%|█████▊    | 6398/11049 [1:05:52<47:35,  1.63it/s]
 58%|█████▊    | 6399/11049 [1:05:53<47:38,  1.63it/s]
                                                      
{'loss': 0.1745, 'grad_norm': 0.5276049971580505, 'learning_rate': 4.492232027003785e-06, 'epoch': 1.74}

 58%|█████▊    | 6399/11049 [1:05:53<47:38,  1.63it/s]
 58%|█████▊    | 6400/11049 [1:05:54<47:39,  1.63it/s]
                                                      
{'loss': 0.1835, 'grad_norm': 0.514093816280365, 'learning_rate': 4.490660576687318e-06, 'epoch': 1.74}

 58%|█████▊    | 6400/11049 [1:05:54<47:39,  1.63it/s]
 58%|█████▊    | 6401/11049 [1:05:54<47:39,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.432396799325943, 'learning_rate': 4.489089177208421e-06, 'epoch': 1.74}

 58%|█████▊    | 6401/11049 [1:05:54<47:39,  1.63it/s]
 58%|█████▊    | 6402/11049 [1:05:55<47:36,  1.63it/s]
                                                      
{'loss': 0.1691, 'grad_norm': 0.4603880047798157, 'learning_rate': 4.487517828723941e-06, 'epoch': 1.74}

 58%|█████▊    | 6402/11049 [1:05:55<47:36,  1.63it/s]
 58%|█████▊    | 6403/11049 [1:05:55<47:34,  1.63it/s]
                                                      
{'loss': 0.2548, 'grad_norm': 0.6432421803474426, 'learning_rate': 4.485946531390713e-06, 'epoch': 1.74}

 58%|█████▊    | 6403/11049 [1:05:56<47:34,  1.63it/s]
 58%|█████▊    | 6404/11049 [1:05:56<47:33,  1.63it/s]
                                                      
{'loss': 0.186, 'grad_norm': 0.5821009278297424, 'learning_rate': 4.484375285365569e-06, 'epoch': 1.74}

 58%|█████▊    | 6404/11049 [1:05:56<47:33,  1.63it/s]
 58%|█████▊    | 6405/11049 [1:05:57<47:34,  1.63it/s]
                                                      
{'loss': 0.2785, 'grad_norm': 0.9806982278823853, 'learning_rate': 4.482804090805337e-06, 'epoch': 1.74}

 58%|█████▊    | 6405/11049 [1:05:57<47:34,  1.63it/s]
 58%|█████▊    | 6406/11049 [1:05:57<47:31,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.48959270119667053, 'learning_rate': 4.4812329478668406e-06, 'epoch': 1.74}

 58%|█████▊    | 6406/11049 [1:05:57<47:31,  1.63it/s]
 58%|█████▊    | 6407/11049 [1:05:58<47:29,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.6417961120605469, 'learning_rate': 4.479661856706896e-06, 'epoch': 1.74}

 58%|█████▊    | 6407/11049 [1:05:58<47:29,  1.63it/s]
 58%|█████▊    | 6408/11049 [1:05:58<47:28,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.6217170357704163, 'learning_rate': 4.478090817482314e-06, 'epoch': 1.74}

 58%|█████▊    | 6408/11049 [1:05:59<47:28,  1.63it/s]
 58%|█████▊    | 6409/11049 [1:05:59<47:26,  1.63it/s]
                                                      
{'loss': 0.2184, 'grad_norm': 0.5718141198158264, 'learning_rate': 4.4765198303499e-06, 'epoch': 1.74}

 58%|█████▊    | 6409/11049 [1:05:59<47:26,  1.63it/s]
 58%|█████▊    | 6410/11049 [1:06:00<47:30,  1.63it/s]
                                                      
{'loss': 0.2287, 'grad_norm': 0.5718065500259399, 'learning_rate': 4.47494889546646e-06, 'epoch': 1.74}

 58%|█████▊    | 6410/11049 [1:06:00<47:30,  1.63it/s]
 58%|█████▊    | 6411/11049 [1:06:00<47:27,  1.63it/s]
                                                      
{'loss': 0.2421, 'grad_norm': 0.5973682403564453, 'learning_rate': 4.473378012988787e-06, 'epoch': 1.74}

 58%|█████▊    | 6411/11049 [1:06:00<47:27,  1.63it/s]
 58%|█████▊    | 6412/11049 [1:06:01<47:25,  1.63it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.5475882887840271, 'learning_rate': 4.471807183073672e-06, 'epoch': 1.74}

 58%|█████▊    | 6412/11049 [1:06:01<47:25,  1.63it/s]
 58%|█████▊    | 6413/11049 [1:06:02<47:24,  1.63it/s]
                                                      
{'loss': 0.238, 'grad_norm': 0.7105525732040405, 'learning_rate': 4.470236405877901e-06, 'epoch': 1.74}

 58%|█████▊    | 6413/11049 [1:06:02<47:24,  1.63it/s]
 58%|█████▊    | 6414/11049 [1:06:02<47:22,  1.63it/s]
                                                      
{'loss': 0.2498, 'grad_norm': 0.6467272639274597, 'learning_rate': 4.468665681558256e-06, 'epoch': 1.74}

 58%|█████▊    | 6414/11049 [1:06:02<47:22,  1.63it/s]
 58%|█████▊    | 6415/11049 [1:06:03<47:26,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.5586100220680237, 'learning_rate': 4.467095010271512e-06, 'epoch': 1.74}

 58%|█████▊    | 6415/11049 [1:06:03<47:26,  1.63it/s]
 58%|█████▊    | 6416/11049 [1:06:03<47:23,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.46374744176864624, 'learning_rate': 4.465524392174437e-06, 'epoch': 1.74}

 58%|█████▊    | 6416/11049 [1:06:03<47:23,  1.63it/s]
 58%|█████▊    | 6417/11049 [1:06:04<47:22,  1.63it/s]
                                                      
{'loss': 0.2218, 'grad_norm': 0.4738585948944092, 'learning_rate': 4.463953827423796e-06, 'epoch': 1.74}

 58%|█████▊    | 6417/11049 [1:06:04<47:22,  1.63it/s]
 58%|█████▊    | 6418/11049 [1:06:05<47:22,  1.63it/s]
                                                      
{'loss': 0.1863, 'grad_norm': 0.49932411313056946, 'learning_rate': 4.4623833161763504e-06, 'epoch': 1.74}

 58%|█████▊    | 6418/11049 [1:06:05<47:22,  1.63it/s]
 58%|█████▊    | 6419/11049 [1:06:05<47:20,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.6180002689361572, 'learning_rate': 4.4608128585888535e-06, 'epoch': 1.74}

 58%|█████▊    | 6419/11049 [1:06:05<47:20,  1.63it/s]
 58%|█████▊    | 6420/11049 [1:06:06<47:23,  1.63it/s]
                                                      
{'loss': 0.2214, 'grad_norm': 0.6172319054603577, 'learning_rate': 4.459242454818052e-06, 'epoch': 1.74}

 58%|█████▊    | 6420/11049 [1:06:06<47:23,  1.63it/s]
 58%|█████▊    | 6421/11049 [1:06:06<47:22,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.6162821650505066, 'learning_rate': 4.45767210502069e-06, 'epoch': 1.74}

 58%|█████▊    | 6421/11049 [1:06:07<47:22,  1.63it/s]
 58%|█████▊    | 6422/11049 [1:06:07<47:19,  1.63it/s]
                                                      
{'loss': 0.1897, 'grad_norm': 0.4796738028526306, 'learning_rate': 4.456101809353507e-06, 'epoch': 1.74}

 58%|█████▊    | 6422/11049 [1:06:07<47:19,  1.63it/s]
 58%|█████▊    | 6423/11049 [1:06:08<47:17,  1.63it/s]
                                                      
{'loss': 0.2215, 'grad_norm': 0.5668736696243286, 'learning_rate': 4.454531567973234e-06, 'epoch': 1.74}

 58%|█████▊    | 6423/11049 [1:06:08<47:17,  1.63it/s]
 58%|█████▊    | 6424/11049 [1:06:08<47:15,  1.63it/s]
                                                      
{'loss': 0.1743, 'grad_norm': 0.49276041984558105, 'learning_rate': 4.452961381036599e-06, 'epoch': 1.74}

 58%|█████▊    | 6424/11049 [1:06:08<47:15,  1.63it/s]
 58%|█████▊    | 6425/11049 [1:06:09<47:19,  1.63it/s]
                                                      
{'loss': 0.2011, 'grad_norm': 0.5366981625556946, 'learning_rate': 4.45139124870032e-06, 'epoch': 1.74}

 58%|█████▊    | 6425/11049 [1:06:09<47:19,  1.63it/s]
 58%|█████▊    | 6426/11049 [1:06:09<47:20,  1.63it/s]
                                                      
{'loss': 0.1722, 'grad_norm': 0.5371056795120239, 'learning_rate': 4.44982117112112e-06, 'epoch': 1.74}

 58%|█████▊    | 6426/11049 [1:06:10<47:20,  1.63it/s]
 58%|█████▊    | 6427/11049 [1:06:10<47:18,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.4799477159976959, 'learning_rate': 4.448251148455704e-06, 'epoch': 1.75}

 58%|█████▊    | 6427/11049 [1:06:10<47:18,  1.63it/s]
 58%|█████▊    | 6428/11049 [1:06:11<47:17,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.4855690598487854, 'learning_rate': 4.446681180860779e-06, 'epoch': 1.75}

 58%|█████▊    | 6428/11049 [1:06:11<47:17,  1.63it/s]
 58%|█████▊    | 6429/11049 [1:06:11<47:14,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.5341426134109497, 'learning_rate': 4.4451112684930424e-06, 'epoch': 1.75}

 58%|█████▊    | 6429/11049 [1:06:11<47:14,  1.63it/s]
 58%|█████▊    | 6430/11049 [1:06:12<47:16,  1.63it/s]
                                                      
{'loss': 0.1787, 'grad_norm': 0.46717795729637146, 'learning_rate': 4.443541411509193e-06, 'epoch': 1.75}

 58%|█████▊    | 6430/11049 [1:06:12<47:16,  1.63it/s]
 58%|█████▊    | 6431/11049 [1:06:13<47:14,  1.63it/s]
                                                      
{'loss': 0.2286, 'grad_norm': 0.5592468976974487, 'learning_rate': 4.441971610065919e-06, 'epoch': 1.75}

 58%|█████▊    | 6431/11049 [1:06:13<47:14,  1.63it/s]
 58%|█████▊    | 6432/11049 [1:06:13<47:13,  1.63it/s]
                                                      
{'loss': 0.1558, 'grad_norm': 0.4162375032901764, 'learning_rate': 4.4404018643199e-06, 'epoch': 1.75}

 58%|█████▊    | 6432/11049 [1:06:13<47:13,  1.63it/s]
 58%|█████▊    | 6433/11049 [1:06:14<47:11,  1.63it/s]
                                                      
{'loss': 0.2205, 'grad_norm': 0.5999361276626587, 'learning_rate': 4.438832174427815e-06, 'epoch': 1.75}

 58%|█████▊    | 6433/11049 [1:06:14<47:11,  1.63it/s]
 58%|█████▊    | 6434/11049 [1:06:14<47:10,  1.63it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.5199214816093445, 'learning_rate': 4.4372625405463345e-06, 'epoch': 1.75}

 58%|█████▊    | 6434/11049 [1:06:15<47:10,  1.63it/s]
 58%|█████▊    | 6435/11049 [1:06:15<47:13,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5544707775115967, 'learning_rate': 4.435692962832129e-06, 'epoch': 1.75}

 58%|█████▊    | 6435/11049 [1:06:15<47:13,  1.63it/s]
 58%|█████▊    | 6436/11049 [1:06:16<47:11,  1.63it/s]
                                                      
{'loss': 0.1738, 'grad_norm': 0.5080341696739197, 'learning_rate': 4.4341234414418575e-06, 'epoch': 1.75}

 58%|█████▊    | 6436/11049 [1:06:16<47:11,  1.63it/s]
 58%|█████▊    | 6437/11049 [1:06:16<47:09,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.5729338526725769, 'learning_rate': 4.4325539765321735e-06, 'epoch': 1.75}

 58%|█████▊    | 6437/11049 [1:06:16<47:09,  1.63it/s]
 58%|█████▊    | 6438/11049 [1:06:17<47:08,  1.63it/s]
                                                      
{'loss': 0.1969, 'grad_norm': 0.5538222789764404, 'learning_rate': 4.430984568259726e-06, 'epoch': 1.75}

 58%|█████▊    | 6438/11049 [1:06:17<47:08,  1.63it/s]
 58%|█████▊    | 6439/11049 [1:06:17<47:08,  1.63it/s]
                                                      
{'loss': 0.1863, 'grad_norm': 0.5305388569831848, 'learning_rate': 4.429415216781162e-06, 'epoch': 1.75}

 58%|█████▊    | 6439/11049 [1:06:18<47:08,  1.63it/s]
 58%|█████▊    | 6440/11049 [1:06:18<47:10,  1.63it/s]
                                                      
{'loss': 0.2027, 'grad_norm': 0.5357538461685181, 'learning_rate': 4.4278459222531186e-06, 'epoch': 1.75}

 58%|█████▊    | 6440/11049 [1:06:18<47:10,  1.63it/s]
 58%|█████▊    | 6441/11049 [1:06:19<47:09,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.5408697128295898, 'learning_rate': 4.426276684832229e-06, 'epoch': 1.75}

 58%|█████▊    | 6441/11049 [1:06:19<47:09,  1.63it/s]
 58%|█████▊    | 6442/11049 [1:06:19<47:08,  1.63it/s]
                                                      
{'loss': 0.144, 'grad_norm': 0.4372609853744507, 'learning_rate': 4.424707504675116e-06, 'epoch': 1.75}

 58%|█████▊    | 6442/11049 [1:06:19<47:08,  1.63it/s]
 58%|█████▊    | 6443/11049 [1:06:20<47:06,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5181801319122314, 'learning_rate': 4.423138381938407e-06, 'epoch': 1.75}

 58%|█████▊    | 6443/11049 [1:06:20<47:06,  1.63it/s]
 58%|█████▊    | 6444/11049 [1:06:21<47:05,  1.63it/s]
                                                      
{'loss': 0.2113, 'grad_norm': 0.5631193518638611, 'learning_rate': 4.421569316778712e-06, 'epoch': 1.75}

 58%|█████▊    | 6444/11049 [1:06:21<47:05,  1.63it/s]
 58%|█████▊    | 6445/11049 [1:06:21<47:08,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.5138988494873047, 'learning_rate': 4.4200003093526454e-06, 'epoch': 1.75}

 58%|█████▊    | 6445/11049 [1:06:21<47:08,  1.63it/s]
 58%|█████▊    | 6446/11049 [1:06:22<47:06,  1.63it/s]
                                                      
{'loss': 0.2059, 'grad_norm': 0.5886678099632263, 'learning_rate': 4.418431359816805e-06, 'epoch': 1.75}

 58%|█████▊    | 6446/11049 [1:06:22<47:06,  1.63it/s]
 58%|█████▊    | 6447/11049 [1:06:22<47:05,  1.63it/s]
                                                      
{'loss': 0.2303, 'grad_norm': 0.5249200463294983, 'learning_rate': 4.416862468327794e-06, 'epoch': 1.75}

 58%|█████▊    | 6447/11049 [1:06:23<47:05,  1.63it/s]
 58%|█████▊    | 6448/11049 [1:06:23<47:05,  1.63it/s]
                                                      
{'loss': 0.2113, 'grad_norm': 0.5405903458595276, 'learning_rate': 4.415293635042203e-06, 'epoch': 1.75}

 58%|█████▊    | 6448/11049 [1:06:23<47:05,  1.63it/s]
 58%|█████▊    | 6449/11049 [1:06:24<47:03,  1.63it/s]
                                                      
{'loss': 0.1656, 'grad_norm': 0.4709301292896271, 'learning_rate': 4.413724860116619e-06, 'epoch': 1.75}

 58%|█████▊    | 6449/11049 [1:06:24<47:03,  1.63it/s]
 58%|█████▊    | 6450/11049 [1:06:24<47:16,  1.62it/s]
                                                      
{'loss': 0.175, 'grad_norm': 0.5872621536254883, 'learning_rate': 4.412156143707621e-06, 'epoch': 1.75}

 58%|█████▊    | 6450/11049 [1:06:24<47:16,  1.62it/s]
 58%|█████▊    | 6451/11049 [1:06:25<47:11,  1.62it/s]
                                                      
{'loss': 0.22, 'grad_norm': 0.5153169631958008, 'learning_rate': 4.4105874859717865e-06, 'epoch': 1.75}

 58%|█████▊    | 6451/11049 [1:06:25<47:11,  1.62it/s]
 58%|█████▊    | 6452/11049 [1:06:25<47:07,  1.63it/s]
                                                      
{'loss': 0.1736, 'grad_norm': 0.5257911682128906, 'learning_rate': 4.409018887065682e-06, 'epoch': 1.75}

 58%|█████▊    | 6452/11049 [1:06:26<47:07,  1.63it/s]
 58%|█████▊    | 6453/11049 [1:06:26<47:02,  1.63it/s]
                                                      
{'loss': 0.2209, 'grad_norm': 0.634094774723053, 'learning_rate': 4.407450347145873e-06, 'epoch': 1.75}

 58%|█████▊    | 6453/11049 [1:06:26<47:02,  1.63it/s]
 58%|█████▊    | 6454/11049 [1:06:27<47:04,  1.63it/s]
                                                      
{'loss': 0.1796, 'grad_norm': 0.5161615014076233, 'learning_rate': 4.405881866368914e-06, 'epoch': 1.75}

 58%|█████▊    | 6454/11049 [1:06:27<47:04,  1.63it/s]
 58%|█████▊    | 6455/11049 [1:06:27<47:04,  1.63it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5729528069496155, 'learning_rate': 4.404313444891358e-06, 'epoch': 1.75}

 58%|█████▊    | 6455/11049 [1:06:27<47:04,  1.63it/s]
 58%|█████▊    | 6456/11049 [1:06:28<47:06,  1.62it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.543022096157074, 'learning_rate': 4.40274508286975e-06, 'epoch': 1.75}

 58%|█████▊    | 6456/11049 [1:06:28<47:06,  1.62it/s]
 58%|█████▊    | 6457/11049 [1:06:29<47:01,  1.63it/s]
                                                      
{'loss': 0.2394, 'grad_norm': 0.5924427509307861, 'learning_rate': 4.40117678046063e-06, 'epoch': 1.75}

 58%|█████▊    | 6457/11049 [1:06:29<47:01,  1.63it/s]
 58%|█████▊    | 6458/11049 [1:06:29<46:58,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.5335250496864319, 'learning_rate': 4.3996085378205294e-06, 'epoch': 1.75}

 58%|█████▊    | 6458/11049 [1:06:29<46:58,  1.63it/s]
 58%|█████▊    | 6459/11049 [1:06:30<46:56,  1.63it/s]
                                                      
{'loss': 0.2542, 'grad_norm': 0.5730504989624023, 'learning_rate': 4.398040355105979e-06, 'epoch': 1.75}

 58%|█████▊    | 6459/11049 [1:06:30<46:56,  1.63it/s]
 58%|█████▊    | 6460/11049 [1:06:30<46:58,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.6195878982543945, 'learning_rate': 4.3964722324734984e-06, 'epoch': 1.75}

 58%|█████▊    | 6460/11049 [1:06:31<46:58,  1.63it/s]
 58%|█████▊    | 6461/11049 [1:06:31<46:55,  1.63it/s]
                                                      
{'loss': 0.1762, 'grad_norm': 0.46395379304885864, 'learning_rate': 4.394904170079604e-06, 'epoch': 1.75}

 58%|█████▊    | 6461/11049 [1:06:31<46:55,  1.63it/s]
 58%|█████▊    | 6462/11049 [1:06:32<46:55,  1.63it/s]
                                                      
{'loss': 0.2697, 'grad_norm': 0.6049699187278748, 'learning_rate': 4.3933361680808025e-06, 'epoch': 1.75}

 58%|█████▊    | 6462/11049 [1:06:32<46:55,  1.63it/s]
 58%|█████▊    | 6463/11049 [1:06:32<46:54,  1.63it/s]
                                                      
{'loss': 0.2275, 'grad_norm': 0.6198537945747375, 'learning_rate': 4.3917682266336024e-06, 'epoch': 1.75}

 58%|█████▊    | 6463/11049 [1:06:32<46:54,  1.63it/s]
 59%|█████▊    | 6464/11049 [1:06:33<47:08,  1.62it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.4792628288269043, 'learning_rate': 4.390200345894498e-06, 'epoch': 1.76}

 59%|█████▊    | 6464/11049 [1:06:33<47:08,  1.62it/s]
 59%|█████▊    | 6465/11049 [1:06:33<47:05,  1.62it/s]
                                                      
{'loss': 0.2331, 'grad_norm': 0.5415591597557068, 'learning_rate': 4.388632526019981e-06, 'epoch': 1.76}

 59%|█████▊    | 6465/11049 [1:06:34<47:05,  1.62it/s]
 59%|█████▊    | 6466/11049 [1:06:34<47:03,  1.62it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.6212263107299805, 'learning_rate': 4.387064767166536e-06, 'epoch': 1.76}

 59%|█████▊    | 6466/11049 [1:06:34<47:03,  1.62it/s]
 59%|█████▊    | 6467/11049 [1:06:35<47:00,  1.62it/s]
                                                      
{'loss': 0.1724, 'grad_norm': 0.4834180474281311, 'learning_rate': 4.385497069490644e-06, 'epoch': 1.76}

 59%|█████▊    | 6467/11049 [1:06:35<47:00,  1.62it/s]
 59%|█████▊    | 6468/11049 [1:06:35<46:56,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5307799577713013, 'learning_rate': 4.383929433148778e-06, 'epoch': 1.76}

 59%|█████▊    | 6468/11049 [1:06:35<46:56,  1.63it/s]
 59%|█████▊    | 6469/11049 [1:06:36<46:57,  1.63it/s]
                                                      
{'loss': 0.192, 'grad_norm': 0.6101492643356323, 'learning_rate': 4.382361858297404e-06, 'epoch': 1.76}

 59%|█████▊    | 6469/11049 [1:06:36<46:57,  1.63it/s]
 59%|█████▊    | 6470/11049 [1:06:37<46:59,  1.62it/s]
                                                      
{'loss': 0.2108, 'grad_norm': 0.5106823444366455, 'learning_rate': 4.380794345092982e-06, 'epoch': 1.76}

 59%|█████▊    | 6470/11049 [1:06:37<46:59,  1.62it/s]
 59%|█████▊    | 6471/11049 [1:06:37<46:57,  1.62it/s]
                                                      
{'loss': 0.233, 'grad_norm': 0.623070240020752, 'learning_rate': 4.37922689369197e-06, 'epoch': 1.76}

 59%|█████▊    | 6471/11049 [1:06:37<46:57,  1.62it/s]
 59%|█████▊    | 6472/11049 [1:06:38<46:54,  1.63it/s]
                                                      
{'loss': 0.2364, 'grad_norm': 0.6501985192298889, 'learning_rate': 4.377659504250815e-06, 'epoch': 1.76}

 59%|█████▊    | 6472/11049 [1:06:38<46:54,  1.63it/s]
 59%|█████▊    | 6473/11049 [1:06:38<46:51,  1.63it/s]
                                                      
{'loss': 0.185, 'grad_norm': 0.5458460450172424, 'learning_rate': 4.3760921769259585e-06, 'epoch': 1.76}

 59%|█████▊    | 6473/11049 [1:06:39<46:51,  1.63it/s]
 59%|█████▊    | 6474/11049 [1:06:39<46:52,  1.63it/s]
                                                      
{'loss': 0.2199, 'grad_norm': 0.5533888339996338, 'learning_rate': 4.374524911873834e-06, 'epoch': 1.76}

 59%|█████▊    | 6474/11049 [1:06:39<46:52,  1.63it/s]
 59%|█████▊    | 6475/11049 [1:06:40<46:53,  1.63it/s]
                                                      
{'loss': 0.2063, 'grad_norm': 0.5290783047676086, 'learning_rate': 4.3729577092508786e-06, 'epoch': 1.76}

 59%|█████▊    | 6475/11049 [1:06:40<46:53,  1.63it/s]
 59%|█████▊    | 6476/11049 [1:06:40<46:53,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.5962367653846741, 'learning_rate': 4.371390569213513e-06, 'epoch': 1.76}

 59%|█████▊    | 6476/11049 [1:06:40<46:53,  1.63it/s]
 59%|█████▊    | 6477/11049 [1:06:41<46:49,  1.63it/s]
                                                      
{'loss': 0.1769, 'grad_norm': 0.5186153650283813, 'learning_rate': 4.369823491918151e-06, 'epoch': 1.76}

 59%|█████▊    | 6477/11049 [1:06:41<46:49,  1.63it/s]
 59%|█████▊    | 6478/11049 [1:06:41<46:47,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5234385132789612, 'learning_rate': 4.368256477521206e-06, 'epoch': 1.76}

 59%|█████▊    | 6478/11049 [1:06:42<46:47,  1.63it/s]
 59%|█████▊    | 6479/11049 [1:06:42<46:47,  1.63it/s]
                                                      
{'loss': 0.2288, 'grad_norm': 0.4917236268520355, 'learning_rate': 4.366689526179085e-06, 'epoch': 1.76}

 59%|█████▊    | 6479/11049 [1:06:42<46:47,  1.63it/s]
 59%|█████▊    | 6480/11049 [1:06:43<46:50,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.6345345973968506, 'learning_rate': 4.365122638048186e-06, 'epoch': 1.76}

 59%|█████▊    | 6480/11049 [1:06:43<46:50,  1.63it/s]
 59%|█████▊    | 6481/11049 [1:06:43<46:49,  1.63it/s]
                                                      
{'loss': 0.2298, 'grad_norm': 0.565556526184082, 'learning_rate': 4.363555813284902e-06, 'epoch': 1.76}

 59%|█████▊    | 6481/11049 [1:06:43<46:49,  1.63it/s]
 59%|█████▊    | 6482/11049 [1:06:44<46:47,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.48135820031166077, 'learning_rate': 4.361989052045613e-06, 'epoch': 1.76}

 59%|█████▊    | 6482/11049 [1:06:44<46:47,  1.63it/s]
 59%|█████▊    | 6483/11049 [1:06:45<46:44,  1.63it/s]
                                                      
{'loss': 0.2244, 'grad_norm': 0.6748956441879272, 'learning_rate': 4.360422354486706e-06, 'epoch': 1.76}

 59%|█████▊    | 6483/11049 [1:06:45<46:44,  1.63it/s]
 59%|█████▊    | 6484/11049 [1:06:45<46:43,  1.63it/s]
                                                      
{'loss': 0.2826, 'grad_norm': 0.6934286952018738, 'learning_rate': 4.3588557207645525e-06, 'epoch': 1.76}

 59%|█████▊    | 6484/11049 [1:06:45<46:43,  1.63it/s]
 59%|█████▊    | 6485/11049 [1:06:46<46:47,  1.63it/s]
                                                      
{'loss': 0.2432, 'grad_norm': 0.5714409947395325, 'learning_rate': 4.357289151035518e-06, 'epoch': 1.76}

 59%|█████▊    | 6485/11049 [1:06:46<46:47,  1.63it/s]
 59%|█████▊    | 6486/11049 [1:06:46<46:43,  1.63it/s]
                                                      
{'loss': 0.1617, 'grad_norm': 0.4431828558444977, 'learning_rate': 4.355722645455962e-06, 'epoch': 1.76}

 59%|█████▊    | 6486/11049 [1:06:46<46:43,  1.63it/s]
 59%|█████▊    | 6487/11049 [1:06:47<46:41,  1.63it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.49809974431991577, 'learning_rate': 4.354156204182241e-06, 'epoch': 1.76}

 59%|█████▊    | 6487/11049 [1:06:47<46:41,  1.63it/s]
 59%|█████▊    | 6488/11049 [1:06:48<46:40,  1.63it/s]
                                                      
{'loss': 0.2044, 'grad_norm': 0.5462708473205566, 'learning_rate': 4.352589827370703e-06, 'epoch': 1.76}

 59%|█████▊    | 6488/11049 [1:06:48<46:40,  1.63it/s]
 59%|█████▊    | 6489/11049 [1:06:48<46:41,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5411583185195923, 'learning_rate': 4.351023515177688e-06, 'epoch': 1.76}

 59%|█████▊    | 6489/11049 [1:06:48<46:41,  1.63it/s]
 59%|█████▊    | 6490/11049 [1:06:49<46:43,  1.63it/s]
                                                      
{'loss': 0.2008, 'grad_norm': 0.6378336548805237, 'learning_rate': 4.349457267759531e-06, 'epoch': 1.76}

 59%|█████▊    | 6490/11049 [1:06:49<46:43,  1.63it/s]
 59%|█████▊    | 6491/11049 [1:06:49<46:40,  1.63it/s]
                                                      
{'loss': 0.1727, 'grad_norm': 0.4706467390060425, 'learning_rate': 4.347891085272562e-06, 'epoch': 1.76}

 59%|█████▊    | 6491/11049 [1:06:50<46:40,  1.63it/s]
 59%|█████▉    | 6492/11049 [1:06:50<46:38,  1.63it/s]
                                                      
{'loss': 0.1622, 'grad_norm': 0.44776731729507446, 'learning_rate': 4.3463249678731e-06, 'epoch': 1.76}

 59%|█████▉    | 6492/11049 [1:06:50<46:38,  1.63it/s]
 59%|█████▉    | 6493/11049 [1:06:51<46:36,  1.63it/s]
                                                      
{'loss': 0.2342, 'grad_norm': 0.6074265837669373, 'learning_rate': 4.344758915717463e-06, 'epoch': 1.76}

 59%|█████▉    | 6493/11049 [1:06:51<46:36,  1.63it/s]
 59%|█████▉    | 6494/11049 [1:06:51<46:40,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.5605944991111755, 'learning_rate': 4.3431929289619575e-06, 'epoch': 1.76}

 59%|█████▉    | 6494/11049 [1:06:51<46:40,  1.63it/s]
 59%|█████▉    | 6495/11049 [1:06:52<46:42,  1.63it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.5446033477783203, 'learning_rate': 4.341627007762888e-06, 'epoch': 1.76}

 59%|█████▉    | 6495/11049 [1:06:52<46:42,  1.63it/s]
 59%|█████▉    | 6496/11049 [1:06:53<46:38,  1.63it/s]
                                                      
{'loss': 0.2169, 'grad_norm': 0.6023707389831543, 'learning_rate': 4.34006115227655e-06, 'epoch': 1.76}

 59%|█████▉    | 6496/11049 [1:06:53<46:38,  1.63it/s]
 59%|█████▉    | 6497/11049 [1:06:53<46:35,  1.63it/s]
                                                      
{'loss': 0.1846, 'grad_norm': 0.47970160841941833, 'learning_rate': 4.338495362659233e-06, 'epoch': 1.76}

 59%|█████▉    | 6497/11049 [1:06:53<46:35,  1.63it/s]
 59%|█████▉    | 6498/11049 [1:06:54<46:34,  1.63it/s]
                                                      
{'loss': 0.2126, 'grad_norm': 0.5775981545448303, 'learning_rate': 4.3369296390672175e-06, 'epoch': 1.76}

 59%|█████▉    | 6498/11049 [1:06:54<46:34,  1.63it/s]
 59%|█████▉    | 6499/11049 [1:06:54<46:35,  1.63it/s]
                                                      
{'loss': 0.2014, 'grad_norm': 0.5613438487052917, 'learning_rate': 4.3353639816567814e-06, 'epoch': 1.76}

 59%|█████▉    | 6499/11049 [1:06:54<46:35,  1.63it/s]
 59%|█████▉    | 6500/11049 [1:06:55<46:38,  1.63it/s]
                                                      
{'loss': 0.1872, 'grad_norm': 0.47698357701301575, 'learning_rate': 4.3337983905841954e-06, 'epoch': 1.76}

 59%|█████▉    | 6500/11049 [1:06:55<46:38,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.33it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.5416428446769714, 'eval_runtime': 1.9538, 'eval_samples_per_second': 102.363, 'eval_steps_per_second': 6.654, 'epoch': 1.76}

 59%|█████▉    | 6500/11049 [1:06:57<46:38,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 59%|█████▉    | 6501/11049 [1:06:58<1:31:08,  1.20s/it]
                                                        
{'loss': 0.2474, 'grad_norm': 0.6104943752288818, 'learning_rate': 4.33223286600572e-06, 'epoch': 1.77}

 59%|█████▉    | 6501/11049 [1:06:58<1:31:08,  1.20s/it]
 59%|█████▉    | 6502/11049 [1:06:58<1:17:43,  1.03s/it]
                                                        
{'loss': 0.1681, 'grad_norm': 0.47488340735435486, 'learning_rate': 4.330667408077612e-06, 'epoch': 1.77}

 59%|█████▉    | 6502/11049 [1:06:58<1:17:43,  1.03s/it]
 59%|█████▉    | 6503/11049 [1:06:59<1:08:20,  1.11it/s]
                                                        
{'loss': 0.2231, 'grad_norm': 0.6274845004081726, 'learning_rate': 4.329102016956123e-06, 'epoch': 1.77}

 59%|█████▉    | 6503/11049 [1:06:59<1:08:20,  1.11it/s]
 59%|█████▉    | 6504/11049 [1:06:59<1:01:48,  1.23it/s]
                                                        
{'loss': 0.2058, 'grad_norm': 0.5268092751502991, 'learning_rate': 4.3275366927974936e-06, 'epoch': 1.77}

 59%|█████▉    | 6504/11049 [1:07:00<1:01:48,  1.23it/s]
 59%|█████▉    | 6505/11049 [1:07:00<57:11,  1.32it/s]  
                                                      
{'loss': 0.1892, 'grad_norm': 0.5111562013626099, 'learning_rate': 4.325971435757961e-06, 'epoch': 1.77}

 59%|█████▉    | 6505/11049 [1:07:00<57:11,  1.32it/s]
 59%|█████▉    | 6506/11049 [1:07:01<53:58,  1.40it/s]
                                                      
{'loss': 0.211, 'grad_norm': 0.5036047697067261, 'learning_rate': 4.324406245993752e-06, 'epoch': 1.77}

 59%|█████▉    | 6506/11049 [1:07:01<53:58,  1.40it/s]
 59%|█████▉    | 6507/11049 [1:07:01<51:41,  1.46it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.5669645071029663, 'learning_rate': 4.322841123661095e-06, 'epoch': 1.77}

 59%|█████▉    | 6507/11049 [1:07:01<51:41,  1.46it/s]
 59%|█████▉    | 6508/11049 [1:07:02<50:05,  1.51it/s]
                                                      
{'loss': 0.1647, 'grad_norm': 0.5110963582992554, 'learning_rate': 4.321276068916204e-06, 'epoch': 1.77}

 59%|█████▉    | 6508/11049 [1:07:02<50:05,  1.51it/s]
 59%|█████▉    | 6509/11049 [1:07:02<48:58,  1.55it/s]
                                                      
{'loss': 0.1787, 'grad_norm': 0.4915027320384979, 'learning_rate': 4.319711081915285e-06, 'epoch': 1.77}

 59%|█████▉    | 6509/11049 [1:07:03<48:58,  1.55it/s]
 59%|█████▉    | 6510/11049 [1:07:03<48:11,  1.57it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.5526107549667358, 'learning_rate': 4.318146162814543e-06, 'epoch': 1.77}

 59%|█████▉    | 6510/11049 [1:07:03<48:11,  1.57it/s]
 59%|█████▉    | 6511/11049 [1:07:04<47:37,  1.59it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.5682249069213867, 'learning_rate': 4.316581311770175e-06, 'epoch': 1.77}

 59%|█████▉    | 6511/11049 [1:07:04<47:37,  1.59it/s]
 59%|█████▉    | 6512/11049 [1:07:04<47:13,  1.60it/s]
                                                      
{'loss': 0.1582, 'grad_norm': 0.5191957950592041, 'learning_rate': 4.31501652893837e-06, 'epoch': 1.77}

 59%|█████▉    | 6512/11049 [1:07:04<47:13,  1.60it/s]
 59%|█████▉    | 6513/11049 [1:07:05<46:57,  1.61it/s]
                                                      
{'loss': 0.2364, 'grad_norm': 0.5626088380813599, 'learning_rate': 4.3134518144753085e-06, 'epoch': 1.77}

 59%|█████▉    | 6513/11049 [1:07:05<46:57,  1.61it/s]
 59%|█████▉    | 6514/11049 [1:07:06<46:45,  1.62it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.4649708867073059, 'learning_rate': 4.311887168537165e-06, 'epoch': 1.77}

 59%|█████▉    | 6514/11049 [1:07:06<46:45,  1.62it/s]
 59%|█████▉    | 6515/11049 [1:07:06<46:38,  1.62it/s]
                                                      
{'loss': 0.2487, 'grad_norm': 0.6710651516914368, 'learning_rate': 4.31032259128011e-06, 'epoch': 1.77}

 59%|█████▉    | 6515/11049 [1:07:06<46:38,  1.62it/s]
 59%|█████▉    | 6516/11049 [1:07:07<46:32,  1.62it/s]
                                                      
{'loss': 0.2229, 'grad_norm': 0.5971934199333191, 'learning_rate': 4.3087580828603055e-06, 'epoch': 1.77}

 59%|█████▉    | 6516/11049 [1:07:07<46:32,  1.62it/s]
 59%|█████▉    | 6517/11049 [1:07:07<47:47,  1.58it/s]
                                                      
{'loss': 0.2398, 'grad_norm': 0.5487771034240723, 'learning_rate': 4.307193643433907e-06, 'epoch': 1.77}

 59%|█████▉    | 6517/11049 [1:07:08<47:47,  1.58it/s]
 59%|█████▉    | 6518/11049 [1:07:08<47:20,  1.59it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.44887834787368774, 'learning_rate': 4.305629273157057e-06, 'epoch': 1.77}

 59%|█████▉    | 6518/11049 [1:07:08<47:20,  1.59it/s]
 59%|█████▉    | 6519/11049 [1:07:09<47:04,  1.60it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.49816691875457764, 'learning_rate': 4.304064972185904e-06, 'epoch': 1.77}

 59%|█████▉    | 6519/11049 [1:07:09<47:04,  1.60it/s]
 59%|█████▉    | 6520/11049 [1:07:09<46:51,  1.61it/s]
                                                      
{'loss': 0.1581, 'grad_norm': 0.48944997787475586, 'learning_rate': 4.302500740676578e-06, 'epoch': 1.77}

 59%|█████▉    | 6520/11049 [1:07:09<46:51,  1.61it/s]
 59%|█████▉    | 6521/11049 [1:07:10<46:41,  1.62it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.5665829181671143, 'learning_rate': 4.300936578785207e-06, 'epoch': 1.77}

 59%|█████▉    | 6521/11049 [1:07:10<46:41,  1.62it/s]
 59%|█████▉    | 6522/11049 [1:07:10<46:33,  1.62it/s]
                                                      
{'loss': 0.1895, 'grad_norm': 0.4848328232765198, 'learning_rate': 4.29937248666791e-06, 'epoch': 1.77}

 59%|█████▉    | 6522/11049 [1:07:11<46:33,  1.62it/s]
 59%|█████▉    | 6523/11049 [1:07:11<46:26,  1.62it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.45875754952430725, 'learning_rate': 4.297808464480803e-06, 'epoch': 1.77}

 59%|█████▉    | 6523/11049 [1:07:11<46:26,  1.62it/s]
 59%|█████▉    | 6524/11049 [1:07:12<46:26,  1.62it/s]
                                                      
{'loss': 0.1814, 'grad_norm': 0.6190785765647888, 'learning_rate': 4.29624451237999e-06, 'epoch': 1.77}

 59%|█████▉    | 6524/11049 [1:07:12<46:26,  1.62it/s]
 59%|█████▉    | 6525/11049 [1:07:12<46:27,  1.62it/s]
                                                      
{'loss': 0.1769, 'grad_norm': 0.5970095992088318, 'learning_rate': 4.294680630521571e-06, 'epoch': 1.77}

 59%|█████▉    | 6525/11049 [1:07:12<46:27,  1.62it/s]
 59%|█████▉    | 6526/11049 [1:07:13<46:40,  1.61it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.5970445871353149, 'learning_rate': 4.2931168190616375e-06, 'epoch': 1.77}

 59%|█████▉    | 6526/11049 [1:07:13<46:40,  1.61it/s]
 59%|█████▉    | 6527/11049 [1:07:14<46:32,  1.62it/s]
                                                      
{'loss': 0.2278, 'grad_norm': 0.522999107837677, 'learning_rate': 4.291553078156277e-06, 'epoch': 1.77}

 59%|█████▉    | 6527/11049 [1:07:14<46:32,  1.62it/s]
 59%|█████▉    | 6528/11049 [1:07:14<46:27,  1.62it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.585865318775177, 'learning_rate': 4.289989407961566e-06, 'epoch': 1.77}

 59%|█████▉    | 6528/11049 [1:07:14<46:27,  1.62it/s]
 59%|█████▉    | 6529/11049 [1:07:15<46:25,  1.62it/s]
                                                      
{'loss': 0.1524, 'grad_norm': 0.4260299801826477, 'learning_rate': 4.2884258086335755e-06, 'epoch': 1.77}

 59%|█████▉    | 6529/11049 [1:07:15<46:25,  1.62it/s]
 59%|█████▉    | 6530/11049 [1:07:15<46:26,  1.62it/s]
                                                      
{'loss': 0.2029, 'grad_norm': 0.5317944288253784, 'learning_rate': 4.286862280328369e-06, 'epoch': 1.77}

 59%|█████▉    | 6530/11049 [1:07:16<46:26,  1.62it/s]
 59%|█████▉    | 6531/11049 [1:07:16<46:24,  1.62it/s]
                                                      
{'loss': 0.2032, 'grad_norm': 0.5254056453704834, 'learning_rate': 4.285298823202006e-06, 'epoch': 1.77}

 59%|█████▉    | 6531/11049 [1:07:16<46:24,  1.62it/s]
 59%|█████▉    | 6532/11049 [1:07:17<46:19,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.43412676453590393, 'learning_rate': 4.283735437410535e-06, 'epoch': 1.77}

 59%|█████▉    | 6532/11049 [1:07:17<46:19,  1.63it/s]
 59%|█████▉    | 6533/11049 [1:07:17<46:15,  1.63it/s]
                                                      
{'loss': 0.2251, 'grad_norm': 0.5446437001228333, 'learning_rate': 4.282172123109999e-06, 'epoch': 1.77}

 59%|█████▉    | 6533/11049 [1:07:17<46:15,  1.63it/s]
 59%|█████▉    | 6534/11049 [1:07:18<46:16,  1.63it/s]
                                                      
{'loss': 0.1565, 'grad_norm': 0.4560549259185791, 'learning_rate': 4.2806088804564315e-06, 'epoch': 1.77}

 59%|█████▉    | 6534/11049 [1:07:18<46:16,  1.63it/s]
 59%|█████▉    | 6535/11049 [1:07:18<46:28,  1.62it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5795577168464661, 'learning_rate': 4.279045709605865e-06, 'epoch': 1.77}

 59%|█████▉    | 6535/11049 [1:07:19<46:28,  1.62it/s]
 59%|█████▉    | 6536/11049 [1:07:19<46:33,  1.62it/s]
                                                      
{'loss': 0.2843, 'grad_norm': 0.654860258102417, 'learning_rate': 4.277482610714318e-06, 'epoch': 1.77}

 59%|█████▉    | 6536/11049 [1:07:19<46:33,  1.62it/s]
 59%|█████▉    | 6537/11049 [1:07:20<46:25,  1.62it/s]
                                                      
{'loss': 0.2263, 'grad_norm': 0.5991030931472778, 'learning_rate': 4.275919583937805e-06, 'epoch': 1.77}

 59%|█████▉    | 6537/11049 [1:07:20<46:25,  1.62it/s]
 59%|█████▉    | 6538/11049 [1:07:20<46:18,  1.62it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.4992755055427551, 'learning_rate': 4.274356629432333e-06, 'epoch': 1.78}

 59%|█████▉    | 6538/11049 [1:07:20<46:18,  1.62it/s]
 59%|█████▉    | 6539/11049 [1:07:21<46:18,  1.62it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.4656527042388916, 'learning_rate': 4.272793747353902e-06, 'epoch': 1.78}

 59%|█████▉    | 6539/11049 [1:07:21<46:18,  1.62it/s]
 59%|█████▉    | 6540/11049 [1:07:22<46:17,  1.62it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.5098277926445007, 'learning_rate': 4.271230937858505e-06, 'epoch': 1.78}

 59%|█████▉    | 6540/11049 [1:07:22<46:17,  1.62it/s]
 59%|█████▉    | 6541/11049 [1:07:22<46:15,  1.62it/s]
                                                      
{'loss': 0.2073, 'grad_norm': 0.6226248741149902, 'learning_rate': 4.269668201102126e-06, 'epoch': 1.78}

 59%|█████▉    | 6541/11049 [1:07:22<46:15,  1.62it/s]
 59%|█████▉    | 6542/11049 [1:07:23<46:12,  1.63it/s]
                                                      
{'loss': 0.2292, 'grad_norm': 0.5564695000648499, 'learning_rate': 4.268105537240743e-06, 'epoch': 1.78}

 59%|█████▉    | 6542/11049 [1:07:23<46:12,  1.63it/s]
 59%|█████▉    | 6543/11049 [1:07:23<46:11,  1.63it/s]
                                                      
{'loss': 0.2157, 'grad_norm': 0.5996451377868652, 'learning_rate': 4.2665429464303295e-06, 'epoch': 1.78}

 59%|█████▉    | 6543/11049 [1:07:24<46:11,  1.63it/s]
 59%|█████▉    | 6544/11049 [1:07:24<46:10,  1.63it/s]
                                                      
{'loss': 0.2584, 'grad_norm': 0.6352394819259644, 'learning_rate': 4.264980428826847e-06, 'epoch': 1.78}

 59%|█████▉    | 6544/11049 [1:07:24<46:10,  1.63it/s]
 59%|█████▉    | 6545/11049 [1:07:25<46:10,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.49043697118759155, 'learning_rate': 4.263417984586251e-06, 'epoch': 1.78}

 59%|█████▉    | 6545/11049 [1:07:25<46:10,  1.63it/s]
 59%|█████▉    | 6546/11049 [1:07:25<46:10,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.4635871946811676, 'learning_rate': 4.261855613864488e-06, 'epoch': 1.78}

 59%|█████▉    | 6546/11049 [1:07:25<46:10,  1.63it/s]
 59%|█████▉    | 6547/11049 [1:07:26<46:06,  1.63it/s]
                                                      
{'loss': 0.2528, 'grad_norm': 0.6021347045898438, 'learning_rate': 4.260293316817505e-06, 'epoch': 1.78}

 59%|█████▉    | 6547/11049 [1:07:26<46:06,  1.63it/s]
 59%|█████▉    | 6548/11049 [1:07:26<46:03,  1.63it/s]
                                                      
{'loss': 0.178, 'grad_norm': 0.4804067015647888, 'learning_rate': 4.258731093601235e-06, 'epoch': 1.78}

 59%|█████▉    | 6548/11049 [1:07:27<46:03,  1.63it/s]
 59%|█████▉    | 6549/11049 [1:07:27<46:02,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.5123584866523743, 'learning_rate': 4.2571689443716015e-06, 'epoch': 1.78}

 59%|█████▉    | 6549/11049 [1:07:27<46:02,  1.63it/s]
 59%|█████▉    | 6550/11049 [1:07:28<46:04,  1.63it/s]
                                                      
{'loss': 0.2748, 'grad_norm': 0.6182291507720947, 'learning_rate': 4.255606869284523e-06, 'epoch': 1.78}

 59%|█████▉    | 6550/11049 [1:07:28<46:04,  1.63it/s]
 59%|█████▉    | 6551/11049 [1:07:28<46:02,  1.63it/s]
                                                      
{'loss': 0.1672, 'grad_norm': 0.4575088620185852, 'learning_rate': 4.254044868495917e-06, 'epoch': 1.78}

 59%|█████▉    | 6551/11049 [1:07:28<46:02,  1.63it/s]
 59%|█████▉    | 6552/11049 [1:07:29<46:00,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.5999683737754822, 'learning_rate': 4.252482942161684e-06, 'epoch': 1.78}

 59%|█████▉    | 6552/11049 [1:07:29<46:00,  1.63it/s]
 59%|█████▉    | 6553/11049 [1:07:30<45:59,  1.63it/s]
                                                      
{'loss': 0.133, 'grad_norm': 0.4039604067802429, 'learning_rate': 4.250921090437723e-06, 'epoch': 1.78}

 59%|█████▉    | 6553/11049 [1:07:30<45:59,  1.63it/s]
 59%|█████▉    | 6554/11049 [1:07:30<45:57,  1.63it/s]
                                                      
{'loss': 0.1539, 'grad_norm': 0.42339569330215454, 'learning_rate': 4.249359313479921e-06, 'epoch': 1.78}

 59%|█████▉    | 6554/11049 [1:07:30<45:57,  1.63it/s]
 59%|█████▉    | 6555/11049 [1:07:31<46:00,  1.63it/s]
                                                      
{'loss': 0.2085, 'grad_norm': 0.501196026802063, 'learning_rate': 4.247797611444163e-06, 'epoch': 1.78}

 59%|█████▉    | 6555/11049 [1:07:31<46:00,  1.63it/s]
 59%|█████▉    | 6556/11049 [1:07:31<45:58,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5447414517402649, 'learning_rate': 4.2462359844863225e-06, 'epoch': 1.78}

 59%|█████▉    | 6556/11049 [1:07:32<45:58,  1.63it/s]
 59%|█████▉    | 6557/11049 [1:07:32<45:57,  1.63it/s]
                                                      
{'loss': 0.2253, 'grad_norm': 0.6156458854675293, 'learning_rate': 4.244674432762268e-06, 'epoch': 1.78}

 59%|█████▉    | 6557/11049 [1:07:32<45:57,  1.63it/s]
 59%|█████▉    | 6558/11049 [1:07:33<45:57,  1.63it/s]
                                                      
{'loss': 0.198, 'grad_norm': 0.5121666789054871, 'learning_rate': 4.243112956427856e-06, 'epoch': 1.78}

 59%|█████▉    | 6558/11049 [1:07:33<45:57,  1.63it/s]
 59%|█████▉    | 6559/11049 [1:07:33<45:56,  1.63it/s]
                                                      
{'loss': 0.2351, 'grad_norm': 0.6083864569664001, 'learning_rate': 4.241551555638942e-06, 'epoch': 1.78}

 59%|█████▉    | 6559/11049 [1:07:33<45:56,  1.63it/s]
 59%|█████▉    | 6560/11049 [1:07:34<46:00,  1.63it/s]
                                                      
{'loss': 0.2142, 'grad_norm': 0.5607906579971313, 'learning_rate': 4.23999023055137e-06, 'epoch': 1.78}

 59%|█████▉    | 6560/11049 [1:07:34<46:00,  1.63it/s]
 59%|█████▉    | 6561/11049 [1:07:34<45:56,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.45508092641830444, 'learning_rate': 4.2384289813209754e-06, 'epoch': 1.78}

 59%|█████▉    | 6561/11049 [1:07:35<45:56,  1.63it/s]
 59%|█████▉    | 6562/11049 [1:07:35<45:55,  1.63it/s]
                                                      
{'loss': 0.2082, 'grad_norm': 0.617321252822876, 'learning_rate': 4.236867808103589e-06, 'epoch': 1.78}

 59%|█████▉    | 6562/11049 [1:07:35<45:55,  1.63it/s]
 59%|█████▉    | 6563/11049 [1:07:36<45:53,  1.63it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5108497142791748, 'learning_rate': 4.235306711055033e-06, 'epoch': 1.78}

 59%|█████▉    | 6563/11049 [1:07:36<45:53,  1.63it/s]
 59%|█████▉    | 6564/11049 [1:07:36<45:52,  1.63it/s]
                                                      
{'loss': 0.1802, 'grad_norm': 0.4661579728126526, 'learning_rate': 4.2337456903311214e-06, 'epoch': 1.78}

 59%|█████▉    | 6564/11049 [1:07:36<45:52,  1.63it/s]
 59%|█████▉    | 6565/11049 [1:07:37<45:54,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.5057246088981628, 'learning_rate': 4.232184746087661e-06, 'epoch': 1.78}

 59%|█████▉    | 6565/11049 [1:07:37<45:54,  1.63it/s]
 59%|█████▉    | 6566/11049 [1:07:38<45:51,  1.63it/s]
                                                      
{'loss': 0.2701, 'grad_norm': 0.7167641520500183, 'learning_rate': 4.23062387848045e-06, 'epoch': 1.78}

 59%|█████▉    | 6566/11049 [1:07:38<45:51,  1.63it/s]
 59%|█████▉    | 6567/11049 [1:07:38<45:51,  1.63it/s]
                                                      
{'loss': 0.2076, 'grad_norm': 0.5568196177482605, 'learning_rate': 4.229063087665282e-06, 'epoch': 1.78}

 59%|█████▉    | 6567/11049 [1:07:38<45:51,  1.63it/s]
 59%|█████▉    | 6568/11049 [1:07:39<45:50,  1.63it/s]
                                                      
{'loss': 0.1819, 'grad_norm': 0.48572635650634766, 'learning_rate': 4.227502373797938e-06, 'epoch': 1.78}

 59%|█████▉    | 6568/11049 [1:07:39<45:50,  1.63it/s]
 59%|█████▉    | 6569/11049 [1:07:39<45:48,  1.63it/s]
                                                      
{'loss': 0.1909, 'grad_norm': 0.5181374549865723, 'learning_rate': 4.225941737034196e-06, 'epoch': 1.78}

 59%|█████▉    | 6569/11049 [1:07:40<45:48,  1.63it/s]
 59%|█████▉    | 6570/11049 [1:07:40<47:03,  1.59it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.4815025329589844, 'learning_rate': 4.224381177529823e-06, 'epoch': 1.78}

 59%|█████▉    | 6570/11049 [1:07:40<47:03,  1.59it/s]
 59%|█████▉    | 6571/11049 [1:07:41<46:54,  1.59it/s]
                                                      
{'loss': 0.2201, 'grad_norm': 0.5934200882911682, 'learning_rate': 4.222820695440582e-06, 'epoch': 1.78}

 59%|█████▉    | 6571/11049 [1:07:41<46:54,  1.59it/s]
 59%|█████▉    | 6572/11049 [1:07:41<46:34,  1.60it/s]
                                                      
{'loss': 0.167, 'grad_norm': 0.43837153911590576, 'learning_rate': 4.2212602909222235e-06, 'epoch': 1.78}

 59%|█████▉    | 6572/11049 [1:07:41<46:34,  1.60it/s]
 59%|█████▉    | 6573/11049 [1:07:42<46:20,  1.61it/s]
                                                      
{'loss': 0.2185, 'grad_norm': 0.5071569085121155, 'learning_rate': 4.219699964130495e-06, 'epoch': 1.78}

 59%|█████▉    | 6573/11049 [1:07:42<46:20,  1.61it/s]
 59%|█████▉    | 6574/11049 [1:07:43<46:12,  1.61it/s]
                                                      
{'loss': 0.2235, 'grad_norm': 0.7704342007637024, 'learning_rate': 4.21813971522113e-06, 'epoch': 1.78}

 59%|█████▉    | 6574/11049 [1:07:43<46:12,  1.61it/s]
 60%|█████▉    | 6575/11049 [1:07:43<46:02,  1.62it/s]
                                                      
{'loss': 0.292, 'grad_norm': 0.6502833962440491, 'learning_rate': 4.216579544349863e-06, 'epoch': 1.79}

 60%|█████▉    | 6575/11049 [1:07:43<46:02,  1.62it/s]
 60%|█████▉    | 6576/11049 [1:07:44<46:00,  1.62it/s]
                                                      
{'loss': 0.187, 'grad_norm': 0.47335106134414673, 'learning_rate': 4.2150194516724135e-06, 'epoch': 1.79}

 60%|█████▉    | 6576/11049 [1:07:44<46:00,  1.62it/s]
 60%|█████▉    | 6577/11049 [1:07:44<45:53,  1.62it/s]
                                                      
{'loss': 0.2258, 'grad_norm': 0.6235002279281616, 'learning_rate': 4.213459437344496e-06, 'epoch': 1.79}

 60%|█████▉    | 6577/11049 [1:07:44<45:53,  1.62it/s]
 60%|█████▉    | 6578/11049 [1:07:45<45:49,  1.63it/s]
                                                      
{'loss': 0.2145, 'grad_norm': 0.5294120907783508, 'learning_rate': 4.211899501521814e-06, 'epoch': 1.79}

 60%|█████▉    | 6578/11049 [1:07:45<45:49,  1.63it/s]
 60%|█████▉    | 6579/11049 [1:07:46<45:48,  1.63it/s]
                                                      
{'loss': 0.1815, 'grad_norm': 0.530951738357544, 'learning_rate': 4.2103396443600716e-06, 'epoch': 1.79}

 60%|█████▉    | 6579/11049 [1:07:46<45:48,  1.63it/s]
 60%|█████▉    | 6580/11049 [1:07:46<45:45,  1.63it/s]
                                                      
{'loss': 0.1532, 'grad_norm': 0.43463602662086487, 'learning_rate': 4.208779866014956e-06, 'epoch': 1.79}

 60%|█████▉    | 6580/11049 [1:07:46<45:45,  1.63it/s]
 60%|█████▉    | 6581/11049 [1:07:47<45:43,  1.63it/s]
                                                      
{'loss': 0.2722, 'grad_norm': 0.6256988644599915, 'learning_rate': 4.20722016664215e-06, 'epoch': 1.79}

 60%|█████▉    | 6581/11049 [1:07:47<45:43,  1.63it/s]
 60%|█████▉    | 6582/11049 [1:07:47<46:46,  1.59it/s]
                                                      
{'loss': 0.2392, 'grad_norm': 0.6810999512672424, 'learning_rate': 4.205660546397326e-06, 'epoch': 1.79}

 60%|█████▉    | 6582/11049 [1:07:48<46:46,  1.59it/s]
 60%|█████▉    | 6583/11049 [1:07:48<46:40,  1.59it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.4719589352607727, 'learning_rate': 4.204101005436156e-06, 'epoch': 1.79}

 60%|█████▉    | 6583/11049 [1:07:48<46:40,  1.59it/s]
 60%|█████▉    | 6584/11049 [1:07:49<46:23,  1.60it/s]
                                                      
{'loss': 0.1999, 'grad_norm': 0.5619065761566162, 'learning_rate': 4.202541543914298e-06, 'epoch': 1.79}

 60%|█████▉    | 6584/11049 [1:07:49<46:23,  1.60it/s]
 60%|█████▉    | 6585/11049 [1:07:49<46:09,  1.61it/s]
                                                      
{'loss': 0.2616, 'grad_norm': 0.6382065415382385, 'learning_rate': 4.2009821619874e-06, 'epoch': 1.79}

 60%|█████▉    | 6585/11049 [1:07:49<46:09,  1.61it/s]
 60%|█████▉    | 6586/11049 [1:07:50<46:01,  1.62it/s]
                                                      
{'loss': 0.1913, 'grad_norm': 0.5819170475006104, 'learning_rate': 4.199422859811105e-06, 'epoch': 1.79}

 60%|█████▉    | 6586/11049 [1:07:50<46:01,  1.62it/s]
 60%|█████▉    | 6587/11049 [1:07:51<45:53,  1.62it/s]
                                                      
{'loss': 0.1726, 'grad_norm': 0.5326296091079712, 'learning_rate': 4.197863637541052e-06, 'epoch': 1.79}

 60%|█████▉    | 6587/11049 [1:07:51<45:53,  1.62it/s]
 60%|█████▉    | 6588/11049 [1:07:51<45:48,  1.62it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.47290533781051636, 'learning_rate': 4.196304495332867e-06, 'epoch': 1.79}

 60%|█████▉    | 6588/11049 [1:07:51<45:48,  1.62it/s]
 60%|█████▉    | 6589/11049 [1:07:52<45:44,  1.63it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.5239476561546326, 'learning_rate': 4.194745433342169e-06, 'epoch': 1.79}

 60%|█████▉    | 6589/11049 [1:07:52<45:44,  1.63it/s]
 60%|█████▉    | 6590/11049 [1:07:52<45:42,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5733680129051208, 'learning_rate': 4.1931864517245656e-06, 'epoch': 1.79}

 60%|█████▉    | 6590/11049 [1:07:53<45:42,  1.63it/s]
 60%|█████▉    | 6591/11049 [1:07:53<45:38,  1.63it/s]
                                                      
{'loss': 0.3324, 'grad_norm': 0.756900429725647, 'learning_rate': 4.191627550635664e-06, 'epoch': 1.79}

 60%|█████▉    | 6591/11049 [1:07:53<45:38,  1.63it/s]
 60%|█████▉    | 6592/11049 [1:07:54<45:36,  1.63it/s]
                                                      
{'loss': 0.2166, 'grad_norm': 0.5837540626525879, 'learning_rate': 4.19006873023106e-06, 'epoch': 1.79}

 60%|█████▉    | 6592/11049 [1:07:54<45:36,  1.63it/s]
 60%|█████▉    | 6593/11049 [1:07:54<45:35,  1.63it/s]
                                                      
{'loss': 0.1868, 'grad_norm': 0.5802608132362366, 'learning_rate': 4.188509990666339e-06, 'epoch': 1.79}

 60%|█████▉    | 6593/11049 [1:07:54<45:35,  1.63it/s]
 60%|█████▉    | 6594/11049 [1:07:55<45:33,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.4810549020767212, 'learning_rate': 4.186951332097078e-06, 'epoch': 1.79}

 60%|█████▉    | 6594/11049 [1:07:55<45:33,  1.63it/s]
 60%|█████▉    | 6595/11049 [1:07:55<45:32,  1.63it/s]
                                                      
{'loss': 0.222, 'grad_norm': 0.6120363473892212, 'learning_rate': 4.185392754678852e-06, 'epoch': 1.79}

 60%|█████▉    | 6595/11049 [1:07:56<45:32,  1.63it/s]
 60%|█████▉    | 6596/11049 [1:07:56<45:32,  1.63it/s]
                                                      
{'loss': 0.1804, 'grad_norm': 0.49711477756500244, 'learning_rate': 4.1838342585672224e-06, 'epoch': 1.79}

 60%|█████▉    | 6596/11049 [1:07:56<45:32,  1.63it/s]
 60%|█████▉    | 6597/11049 [1:07:57<45:30,  1.63it/s]
                                                      
{'loss': 0.2638, 'grad_norm': 0.6506862044334412, 'learning_rate': 4.182275843917743e-06, 'epoch': 1.79}

 60%|█████▉    | 6597/11049 [1:07:57<45:30,  1.63it/s]
 60%|█████▉    | 6598/11049 [1:07:57<45:30,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.577897846698761, 'learning_rate': 4.18071751088596e-06, 'epoch': 1.79}

 60%|█████▉    | 6598/11049 [1:07:57<45:30,  1.63it/s]
 60%|█████▉    | 6599/11049 [1:07:58<45:29,  1.63it/s]
                                                      
{'loss': 0.1587, 'grad_norm': 0.4947333335876465, 'learning_rate': 4.179159259627414e-06, 'epoch': 1.79}

 60%|█████▉    | 6599/11049 [1:07:58<45:29,  1.63it/s]
 60%|█████▉    | 6600/11049 [1:07:59<45:29,  1.63it/s]
                                                      
{'loss': 0.1429, 'grad_norm': 0.41276484727859497, 'learning_rate': 4.177601090297633e-06, 'epoch': 1.79}

 60%|█████▉    | 6600/11049 [1:07:59<45:29,  1.63it/s]
 60%|█████▉    | 6601/11049 [1:07:59<45:30,  1.63it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.43715202808380127, 'learning_rate': 4.1760430030521405e-06, 'epoch': 1.79}

 60%|█████▉    | 6601/11049 [1:07:59<45:30,  1.63it/s]
 60%|█████▉    | 6602/11049 [1:08:00<45:29,  1.63it/s]
                                                      
{'loss': 0.1707, 'grad_norm': 0.5324339866638184, 'learning_rate': 4.17448499804645e-06, 'epoch': 1.79}

 60%|█████▉    | 6602/11049 [1:08:00<45:29,  1.63it/s]
 60%|█████▉    | 6603/11049 [1:08:00<45:28,  1.63it/s]
                                                      
{'loss': 0.1848, 'grad_norm': 0.5400726795196533, 'learning_rate': 4.172927075436067e-06, 'epoch': 1.79}

 60%|█████▉    | 6603/11049 [1:08:01<45:28,  1.63it/s]
 60%|█████▉    | 6604/11049 [1:08:01<45:28,  1.63it/s]
                                                      
{'loss': 0.1543, 'grad_norm': 0.43068334460258484, 'learning_rate': 4.171369235376491e-06, 'epoch': 1.79}

 60%|█████▉    | 6604/11049 [1:08:01<45:28,  1.63it/s]
 60%|█████▉    | 6605/11049 [1:08:02<45:26,  1.63it/s]
                                                      
{'loss': 0.198, 'grad_norm': 0.6042597889900208, 'learning_rate': 4.1698114780232085e-06, 'epoch': 1.79}

 60%|█████▉    | 6605/11049 [1:08:02<45:26,  1.63it/s]
 60%|█████▉    | 6606/11049 [1:08:02<45:24,  1.63it/s]
                                                      
{'loss': 0.2096, 'grad_norm': 0.5818449258804321, 'learning_rate': 4.1682538035317e-06, 'epoch': 1.79}

 60%|█████▉    | 6606/11049 [1:08:02<45:24,  1.63it/s]
 60%|█████▉    | 6607/11049 [1:08:03<45:22,  1.63it/s]
                                                      
{'loss': 0.2026, 'grad_norm': 0.5438275933265686, 'learning_rate': 4.166696212057442e-06, 'epoch': 1.79}

 60%|█████▉    | 6607/11049 [1:08:03<45:22,  1.63it/s]
 60%|█████▉    | 6608/11049 [1:08:03<45:23,  1.63it/s]
                                                      
{'loss': 0.2977, 'grad_norm': 0.6924406886100769, 'learning_rate': 4.165138703755897e-06, 'epoch': 1.79}

 60%|█████▉    | 6608/11049 [1:08:04<45:23,  1.63it/s]
 60%|█████▉    | 6609/11049 [1:08:04<45:22,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.4987524151802063, 'learning_rate': 4.163581278782519e-06, 'epoch': 1.79}

 60%|█████▉    | 6609/11049 [1:08:04<45:22,  1.63it/s]
 60%|█████▉    | 6610/11049 [1:08:05<45:23,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5887771248817444, 'learning_rate': 4.162023937292759e-06, 'epoch': 1.79}

 60%|█████▉    | 6610/11049 [1:08:05<45:23,  1.63it/s]
 60%|█████▉    | 6611/11049 [1:08:05<45:22,  1.63it/s]
                                                      
{'loss': 0.2387, 'grad_norm': 0.6305399537086487, 'learning_rate': 4.160466679442055e-06, 'epoch': 1.8}

 60%|█████▉    | 6611/11049 [1:08:05<45:22,  1.63it/s]
 60%|█████▉    | 6612/11049 [1:08:06<45:21,  1.63it/s]
                                                      
{'loss': 0.166, 'grad_norm': 0.4723343551158905, 'learning_rate': 4.158909505385837e-06, 'epoch': 1.8}

 60%|█████▉    | 6612/11049 [1:08:06<45:21,  1.63it/s]
 60%|█████▉    | 6613/11049 [1:08:07<45:21,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.46914947032928467, 'learning_rate': 4.157352415279531e-06, 'epoch': 1.8}

 60%|█████▉    | 6613/11049 [1:08:07<45:21,  1.63it/s]
 60%|█████▉    | 6614/11049 [1:08:07<45:22,  1.63it/s]
                                                      
{'loss': 0.228, 'grad_norm': 0.5739870071411133, 'learning_rate': 4.155795409278549e-06, 'epoch': 1.8}

 60%|█████▉    | 6614/11049 [1:08:07<45:22,  1.63it/s]
 60%|█████▉    | 6615/11049 [1:08:08<45:21,  1.63it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.4968065321445465, 'learning_rate': 4.1542384875382966e-06, 'epoch': 1.8}

 60%|█████▉    | 6615/11049 [1:08:08<45:21,  1.63it/s]
 60%|█████▉    | 6616/11049 [1:08:08<45:22,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5149734020233154, 'learning_rate': 4.152681650214173e-06, 'epoch': 1.8}

 60%|█████▉    | 6616/11049 [1:08:08<45:22,  1.63it/s]
 60%|█████▉    | 6617/11049 [1:08:09<45:21,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.6171968579292297, 'learning_rate': 4.151124897461567e-06, 'epoch': 1.8}

 60%|█████▉    | 6617/11049 [1:08:09<45:21,  1.63it/s]
 60%|█████▉    | 6618/11049 [1:08:10<45:19,  1.63it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.5405910015106201, 'learning_rate': 4.1495682294358585e-06, 'epoch': 1.8}

 60%|█████▉    | 6618/11049 [1:08:10<45:19,  1.63it/s]
 60%|█████▉    | 6619/11049 [1:08:10<45:17,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.47131645679473877, 'learning_rate': 4.148011646292419e-06, 'epoch': 1.8}

 60%|█████▉    | 6619/11049 [1:08:10<45:17,  1.63it/s]
 60%|█████▉    | 6620/11049 [1:08:11<45:17,  1.63it/s]
                                                      
{'loss': 0.2171, 'grad_norm': 0.6003179550170898, 'learning_rate': 4.146455148186616e-06, 'epoch': 1.8}

 60%|█████▉    | 6620/11049 [1:08:11<45:17,  1.63it/s]
 60%|█████▉    | 6621/11049 [1:08:11<45:16,  1.63it/s]
                                                      
{'loss': 0.1589, 'grad_norm': 0.4690207540988922, 'learning_rate': 4.144898735273801e-06, 'epoch': 1.8}

 60%|█████▉    | 6621/11049 [1:08:12<45:16,  1.63it/s]
 60%|█████▉    | 6622/11049 [1:08:12<45:16,  1.63it/s]
                                                      
{'loss': 0.1792, 'grad_norm': 0.530797004699707, 'learning_rate': 4.143342407709323e-06, 'epoch': 1.8}

 60%|█████▉    | 6622/11049 [1:08:12<45:16,  1.63it/s]
 60%|█████▉    | 6623/11049 [1:08:13<45:15,  1.63it/s]
                                                      
{'loss': 0.218, 'grad_norm': 0.6072197556495667, 'learning_rate': 4.141786165648518e-06, 'epoch': 1.8}

 60%|█████▉    | 6623/11049 [1:08:13<45:15,  1.63it/s]
 60%|█████▉    | 6624/11049 [1:08:13<45:14,  1.63it/s]
                                                      
{'loss': 0.2458, 'grad_norm': 0.6078553199768066, 'learning_rate': 4.1402300092467175e-06, 'epoch': 1.8}

 60%|█████▉    | 6624/11049 [1:08:13<45:14,  1.63it/s]
 60%|█████▉    | 6625/11049 [1:08:14<45:14,  1.63it/s]
                                                      
{'loss': 0.1979, 'grad_norm': 0.573029637336731, 'learning_rate': 4.138673938659245e-06, 'epoch': 1.8}

 60%|█████▉    | 6625/11049 [1:08:14<45:14,  1.63it/s]
 60%|█████▉    | 6626/11049 [1:08:14<45:12,  1.63it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.44049447774887085, 'learning_rate': 4.137117954041409e-06, 'epoch': 1.8}

 60%|█████▉    | 6626/11049 [1:08:15<45:12,  1.63it/s]
 60%|█████▉    | 6627/11049 [1:08:15<45:13,  1.63it/s]
                                                      
{'loss': 0.181, 'grad_norm': 0.48218420147895813, 'learning_rate': 4.135562055548513e-06, 'epoch': 1.8}

 60%|█████▉    | 6627/11049 [1:08:15<45:13,  1.63it/s]
 60%|█████▉    | 6628/11049 [1:08:16<45:11,  1.63it/s]
                                                      
{'loss': 0.2323, 'grad_norm': 0.5720779895782471, 'learning_rate': 4.134006243335857e-06, 'epoch': 1.8}

 60%|█████▉    | 6628/11049 [1:08:16<45:11,  1.63it/s]
 60%|█████▉    | 6629/11049 [1:08:16<45:11,  1.63it/s]
                                                      
{'loss': 0.2648, 'grad_norm': 0.5990586876869202, 'learning_rate': 4.132450517558726e-06, 'epoch': 1.8}

 60%|█████▉    | 6629/11049 [1:08:16<45:11,  1.63it/s]
 60%|██████    | 6630/11049 [1:08:17<45:10,  1.63it/s]
                                                      
{'loss': 0.2185, 'grad_norm': 0.5944317579269409, 'learning_rate': 4.130894878372397e-06, 'epoch': 1.8}

 60%|██████    | 6630/11049 [1:08:17<45:10,  1.63it/s]
 60%|██████    | 6631/11049 [1:08:18<45:09,  1.63it/s]
                                                      
{'loss': 0.1523, 'grad_norm': 0.44747108221054077, 'learning_rate': 4.129339325932138e-06, 'epoch': 1.8}

 60%|██████    | 6631/11049 [1:08:18<45:09,  1.63it/s]
 60%|██████    | 6632/11049 [1:08:18<45:11,  1.63it/s]
                                                      
{'loss': 0.2136, 'grad_norm': 0.5798553228378296, 'learning_rate': 4.127783860393215e-06, 'epoch': 1.8}

 60%|██████    | 6632/11049 [1:08:18<45:11,  1.63it/s]
 60%|██████    | 6633/11049 [1:08:19<45:11,  1.63it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.5230368375778198, 'learning_rate': 4.126228481910877e-06, 'epoch': 1.8}

 60%|██████    | 6633/11049 [1:08:19<45:11,  1.63it/s]
 60%|██████    | 6634/11049 [1:08:19<45:09,  1.63it/s]
                                                      
{'loss': 0.2109, 'grad_norm': 0.5702661871910095, 'learning_rate': 4.124673190640368e-06, 'epoch': 1.8}

 60%|██████    | 6634/11049 [1:08:20<45:09,  1.63it/s]
 60%|██████    | 6635/11049 [1:08:20<45:08,  1.63it/s]
                                                      
{'loss': 0.2502, 'grad_norm': 0.6621404886245728, 'learning_rate': 4.123117986736921e-06, 'epoch': 1.8}

 60%|██████    | 6635/11049 [1:08:20<45:08,  1.63it/s]
 60%|██████    | 6636/11049 [1:08:21<45:08,  1.63it/s]
                                                      
{'loss': 0.202, 'grad_norm': 0.5387259125709534, 'learning_rate': 4.121562870355766e-06, 'epoch': 1.8}

 60%|██████    | 6636/11049 [1:08:21<45:08,  1.63it/s]
 60%|██████    | 6637/11049 [1:08:21<45:05,  1.63it/s]
                                                      
{'loss': 0.2313, 'grad_norm': 0.6022601127624512, 'learning_rate': 4.120007841652118e-06, 'epoch': 1.8}

 60%|██████    | 6637/11049 [1:08:21<45:05,  1.63it/s]
 60%|██████    | 6638/11049 [1:08:22<45:05,  1.63it/s]
                                                      
{'loss': 0.2539, 'grad_norm': 0.5142015814781189, 'learning_rate': 4.118452900781187e-06, 'epoch': 1.8}

 60%|██████    | 6638/11049 [1:08:22<45:05,  1.63it/s]
 60%|██████    | 6639/11049 [1:08:22<45:07,  1.63it/s]
                                                      
{'loss': 0.1783, 'grad_norm': 0.4527747631072998, 'learning_rate': 4.11689804789817e-06, 'epoch': 1.8}

 60%|██████    | 6639/11049 [1:08:23<45:07,  1.63it/s]
 60%|██████    | 6640/11049 [1:08:23<45:05,  1.63it/s]
                                                      
{'loss': 0.16, 'grad_norm': 0.48500731587409973, 'learning_rate': 4.115343283158261e-06, 'epoch': 1.8}

 60%|██████    | 6640/11049 [1:08:23<45:05,  1.63it/s]
 60%|██████    | 6641/11049 [1:08:24<45:04,  1.63it/s]
                                                      
{'loss': 0.2626, 'grad_norm': 0.6456265449523926, 'learning_rate': 4.113788606716641e-06, 'epoch': 1.8}

 60%|██████    | 6641/11049 [1:08:24<45:04,  1.63it/s]
 60%|██████    | 6642/11049 [1:08:24<45:03,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.4537035822868347, 'learning_rate': 4.1122340187284845e-06, 'epoch': 1.8}

 60%|██████    | 6642/11049 [1:08:24<45:03,  1.63it/s]
 60%|██████    | 6643/11049 [1:08:25<45:01,  1.63it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.563721776008606, 'learning_rate': 4.110679519348955e-06, 'epoch': 1.8}

 60%|██████    | 6643/11049 [1:08:25<45:01,  1.63it/s]
 60%|██████    | 6644/11049 [1:08:26<45:00,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.41856271028518677, 'learning_rate': 4.109125108733209e-06, 'epoch': 1.8}

 60%|██████    | 6644/11049 [1:08:26<45:00,  1.63it/s]
 60%|██████    | 6645/11049 [1:08:26<44:59,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.5393004417419434, 'learning_rate': 4.107570787036393e-06, 'epoch': 1.8}

 60%|██████    | 6645/11049 [1:08:26<44:59,  1.63it/s]
 60%|██████    | 6646/11049 [1:08:27<44:59,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.6190416812896729, 'learning_rate': 4.106016554413646e-06, 'epoch': 1.8}

 60%|██████    | 6646/11049 [1:08:27<44:59,  1.63it/s]
 60%|██████    | 6647/11049 [1:08:27<44:58,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.5470106601715088, 'learning_rate': 4.104462411020095e-06, 'epoch': 1.8}

 60%|██████    | 6647/11049 [1:08:27<44:58,  1.63it/s]
 60%|██████    | 6648/11049 [1:08:28<44:58,  1.63it/s]
                                                      
{'loss': 0.1811, 'grad_norm': 0.4932517409324646, 'learning_rate': 4.102908357010864e-06, 'epoch': 1.81}

 60%|██████    | 6648/11049 [1:08:28<44:58,  1.63it/s]
 60%|██████    | 6649/11049 [1:08:29<44:58,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.5188599824905396, 'learning_rate': 4.101354392541061e-06, 'epoch': 1.81}

 60%|██████    | 6649/11049 [1:08:29<44:58,  1.63it/s]
 60%|██████    | 6650/11049 [1:08:29<44:58,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.5885041952133179, 'learning_rate': 4.09980051776579e-06, 'epoch': 1.81}

 60%|██████    | 6650/11049 [1:08:29<44:58,  1.63it/s]
 60%|██████    | 6651/11049 [1:08:30<44:58,  1.63it/s]
                                                      
{'loss': 0.1935, 'grad_norm': 0.56688392162323, 'learning_rate': 4.098246732840143e-06, 'epoch': 1.81}

 60%|██████    | 6651/11049 [1:08:30<44:58,  1.63it/s]
 60%|██████    | 6652/11049 [1:08:30<44:57,  1.63it/s]
                                                      
{'loss': 0.2635, 'grad_norm': 0.6190127730369568, 'learning_rate': 4.096693037919206e-06, 'epoch': 1.81}

 60%|██████    | 6652/11049 [1:08:31<44:57,  1.63it/s]
 60%|██████    | 6653/11049 [1:08:31<44:57,  1.63it/s]
                                                      
{'loss': 0.2602, 'grad_norm': 0.6485802531242371, 'learning_rate': 4.095139433158055e-06, 'epoch': 1.81}

 60%|██████    | 6653/11049 [1:08:31<44:57,  1.63it/s]
 60%|██████    | 6654/11049 [1:08:32<44:55,  1.63it/s]
                                                      
{'loss': 0.263, 'grad_norm': 0.6764535307884216, 'learning_rate': 4.093585918711756e-06, 'epoch': 1.81}

 60%|██████    | 6654/11049 [1:08:32<44:55,  1.63it/s]
 60%|██████    | 6655/11049 [1:08:32<44:54,  1.63it/s]
                                                      
{'loss': 0.1686, 'grad_norm': 0.518310546875, 'learning_rate': 4.092032494735363e-06, 'epoch': 1.81}

 60%|██████    | 6655/11049 [1:08:32<44:54,  1.63it/s]
 60%|██████    | 6656/11049 [1:08:33<44:55,  1.63it/s]
                                                      
{'loss': 0.2148, 'grad_norm': 0.5644158124923706, 'learning_rate': 4.090479161383931e-06, 'epoch': 1.81}

 60%|██████    | 6656/11049 [1:08:33<44:55,  1.63it/s]
 60%|██████    | 6657/11049 [1:08:34<44:54,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.6889545321464539, 'learning_rate': 4.088925918812496e-06, 'epoch': 1.81}

 60%|██████    | 6657/11049 [1:08:34<44:54,  1.63it/s]
 60%|██████    | 6658/11049 [1:08:34<44:54,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.508539080619812, 'learning_rate': 4.087372767176088e-06, 'epoch': 1.81}

 60%|██████    | 6658/11049 [1:08:34<44:54,  1.63it/s]
 60%|██████    | 6659/11049 [1:08:35<44:54,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.4612051844596863, 'learning_rate': 4.085819706629726e-06, 'epoch': 1.81}

 60%|██████    | 6659/11049 [1:08:35<44:54,  1.63it/s]
 60%|██████    | 6660/11049 [1:08:35<44:53,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.4733242392539978, 'learning_rate': 4.084266737328428e-06, 'epoch': 1.81}

 60%|██████    | 6660/11049 [1:08:35<44:53,  1.63it/s]
 60%|██████    | 6661/11049 [1:08:36<44:52,  1.63it/s]
                                                      
{'loss': 0.223, 'grad_norm': 0.6051838397979736, 'learning_rate': 4.082713859427195e-06, 'epoch': 1.81}

 60%|██████    | 6661/11049 [1:08:36<44:52,  1.63it/s]
 60%|██████    | 6662/11049 [1:08:37<44:53,  1.63it/s]
                                                      
{'loss': 0.2486, 'grad_norm': 0.5755401253700256, 'learning_rate': 4.0811610730810176e-06, 'epoch': 1.81}

 60%|██████    | 6662/11049 [1:08:37<44:53,  1.63it/s]
 60%|██████    | 6663/11049 [1:08:37<44:53,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.4873701333999634, 'learning_rate': 4.079608378444882e-06, 'epoch': 1.81}

 60%|██████    | 6663/11049 [1:08:37<44:53,  1.63it/s]
 60%|██████    | 6664/11049 [1:08:38<44:51,  1.63it/s]
                                                      
{'loss': 0.2082, 'grad_norm': 0.5547736883163452, 'learning_rate': 4.0780557756737674e-06, 'epoch': 1.81}

 60%|██████    | 6664/11049 [1:08:38<44:51,  1.63it/s]
 60%|██████    | 6665/11049 [1:08:38<44:49,  1.63it/s]
                                                      
{'loss': 0.2683, 'grad_norm': 0.6423336863517761, 'learning_rate': 4.076503264922637e-06, 'epoch': 1.81}

 60%|██████    | 6665/11049 [1:08:39<44:49,  1.63it/s]
 60%|██████    | 6666/11049 [1:08:39<44:48,  1.63it/s]
                                                      
{'loss': 0.1748, 'grad_norm': 0.555297315120697, 'learning_rate': 4.074950846346451e-06, 'epoch': 1.81}

 60%|██████    | 6666/11049 [1:08:39<44:48,  1.63it/s]
 60%|██████    | 6667/11049 [1:08:40<44:48,  1.63it/s]
                                                      
{'loss': 0.1939, 'grad_norm': 0.505702018737793, 'learning_rate': 4.073398520100151e-06, 'epoch': 1.81}

 60%|██████    | 6667/11049 [1:08:40<44:48,  1.63it/s]
 60%|██████    | 6668/11049 [1:08:40<44:48,  1.63it/s]
                                                      
{'loss': 0.1999, 'grad_norm': 0.5445056557655334, 'learning_rate': 4.071846286338684e-06, 'epoch': 1.81}

 60%|██████    | 6668/11049 [1:08:40<44:48,  1.63it/s]
 60%|██████    | 6669/11049 [1:08:41<44:48,  1.63it/s]
                                                      
{'loss': 0.1823, 'grad_norm': 0.5431514382362366, 'learning_rate': 4.070294145216975e-06, 'epoch': 1.81}

 60%|██████    | 6669/11049 [1:08:41<44:48,  1.63it/s]
 60%|██████    | 6670/11049 [1:08:41<44:47,  1.63it/s]
                                                      
{'loss': 0.2434, 'grad_norm': 0.5568932890892029, 'learning_rate': 4.068742096889947e-06, 'epoch': 1.81}

 60%|██████    | 6670/11049 [1:08:42<44:47,  1.63it/s]
 60%|██████    | 6671/11049 [1:08:42<44:46,  1.63it/s]
                                                      
{'loss': 0.2486, 'grad_norm': 0.653704822063446, 'learning_rate': 4.067190141512507e-06, 'epoch': 1.81}

 60%|██████    | 6671/11049 [1:08:42<44:46,  1.63it/s]
 60%|██████    | 6672/11049 [1:08:43<44:45,  1.63it/s]
                                                      
{'loss': 0.1962, 'grad_norm': 0.5146864652633667, 'learning_rate': 4.065638279239562e-06, 'epoch': 1.81}

 60%|██████    | 6672/11049 [1:08:43<44:45,  1.63it/s]
 60%|██████    | 6673/11049 [1:08:43<44:44,  1.63it/s]
                                                      
{'loss': 0.2887, 'grad_norm': 0.721566379070282, 'learning_rate': 4.064086510226002e-06, 'epoch': 1.81}

 60%|██████    | 6673/11049 [1:08:43<44:44,  1.63it/s]
 60%|██████    | 6674/11049 [1:08:44<44:45,  1.63it/s]
                                                      
{'loss': 0.1642, 'grad_norm': 0.4330711364746094, 'learning_rate': 4.06253483462671e-06, 'epoch': 1.81}

 60%|██████    | 6674/11049 [1:08:44<44:45,  1.63it/s]
 60%|██████    | 6675/11049 [1:08:45<44:43,  1.63it/s]
                                                      
{'loss': 0.1794, 'grad_norm': 0.5130053758621216, 'learning_rate': 4.06098325259656e-06, 'epoch': 1.81}

 60%|██████    | 6675/11049 [1:08:45<44:43,  1.63it/s]
 60%|██████    | 6676/11049 [1:08:45<44:43,  1.63it/s]
                                                      
{'loss': 0.1996, 'grad_norm': 0.5256097316741943, 'learning_rate': 4.059431764290418e-06, 'epoch': 1.81}

 60%|██████    | 6676/11049 [1:08:45<44:43,  1.63it/s]
 60%|██████    | 6677/11049 [1:08:46<44:41,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.6676614880561829, 'learning_rate': 4.057880369863138e-06, 'epoch': 1.81}

 60%|██████    | 6677/11049 [1:08:46<44:41,  1.63it/s]
 60%|██████    | 6678/11049 [1:08:46<44:40,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5219174027442932, 'learning_rate': 4.056329069469567e-06, 'epoch': 1.81}

 60%|██████    | 6678/11049 [1:08:47<44:40,  1.63it/s]
 60%|██████    | 6679/11049 [1:08:47<44:41,  1.63it/s]
                                                      
{'loss': 0.2553, 'grad_norm': 0.6437004804611206, 'learning_rate': 4.05477786326454e-06, 'epoch': 1.81}

 60%|██████    | 6679/11049 [1:08:47<44:41,  1.63it/s]
 60%|██████    | 6680/11049 [1:08:48<44:40,  1.63it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.5829324722290039, 'learning_rate': 4.053226751402885e-06, 'epoch': 1.81}

 60%|██████    | 6680/11049 [1:08:48<44:40,  1.63it/s]
 60%|██████    | 6681/11049 [1:08:48<44:39,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.4600387513637543, 'learning_rate': 4.05167573403942e-06, 'epoch': 1.81}

 60%|██████    | 6681/11049 [1:08:48<44:39,  1.63it/s]
 60%|██████    | 6682/11049 [1:08:49<44:38,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.4671599268913269, 'learning_rate': 4.050124811328954e-06, 'epoch': 1.81}

 60%|██████    | 6682/11049 [1:08:49<44:38,  1.63it/s]
 60%|██████    | 6683/11049 [1:08:49<44:37,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.6752218008041382, 'learning_rate': 4.048573983426283e-06, 'epoch': 1.81}

 60%|██████    | 6683/11049 [1:08:50<44:37,  1.63it/s]
 60%|██████    | 6684/11049 [1:08:50<44:39,  1.63it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.5518930554389954, 'learning_rate': 4.047023250486199e-06, 'epoch': 1.81}

 60%|██████    | 6684/11049 [1:08:50<44:39,  1.63it/s]
 61%|██████    | 6685/11049 [1:08:51<44:36,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5646113753318787, 'learning_rate': 4.0454726126634816e-06, 'epoch': 1.82}

 61%|██████    | 6685/11049 [1:08:51<44:36,  1.63it/s]
 61%|██████    | 6686/11049 [1:08:51<44:37,  1.63it/s]
                                                      
{'loss': 0.1472, 'grad_norm': 0.5011714100837708, 'learning_rate': 4.0439220701129e-06, 'epoch': 1.82}

 61%|██████    | 6686/11049 [1:08:51<44:37,  1.63it/s]
 61%|██████    | 6687/11049 [1:08:52<44:34,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.5155037641525269, 'learning_rate': 4.042371622989215e-06, 'epoch': 1.82}

 61%|██████    | 6687/11049 [1:08:52<44:34,  1.63it/s]
 61%|██████    | 6688/11049 [1:08:53<44:34,  1.63it/s]
                                                      
{'loss': 0.187, 'grad_norm': 0.5170101523399353, 'learning_rate': 4.040821271447179e-06, 'epoch': 1.82}

 61%|██████    | 6688/11049 [1:08:53<44:34,  1.63it/s]
 61%|██████    | 6689/11049 [1:08:53<44:34,  1.63it/s]
                                                      
{'loss': 0.2057, 'grad_norm': 0.5787593126296997, 'learning_rate': 4.039271015641535e-06, 'epoch': 1.82}

 61%|██████    | 6689/11049 [1:08:53<44:34,  1.63it/s]
 61%|██████    | 6690/11049 [1:08:54<44:32,  1.63it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.4866865873336792, 'learning_rate': 4.037720855727013e-06, 'epoch': 1.82}

 61%|██████    | 6690/11049 [1:08:54<44:32,  1.63it/s]
 61%|██████    | 6691/11049 [1:08:54<44:30,  1.63it/s]
                                                      
{'loss': 0.2116, 'grad_norm': 0.532027006149292, 'learning_rate': 4.036170791858334e-06, 'epoch': 1.82}

 61%|██████    | 6691/11049 [1:08:54<44:30,  1.63it/s]
 61%|██████    | 6692/11049 [1:08:55<44:31,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.4833413362503052, 'learning_rate': 4.034620824190218e-06, 'epoch': 1.82}

 61%|██████    | 6692/11049 [1:08:55<44:31,  1.63it/s]
 61%|██████    | 6693/11049 [1:08:56<44:31,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.5409362316131592, 'learning_rate': 4.033070952877362e-06, 'epoch': 1.82}

 61%|██████    | 6693/11049 [1:08:56<44:31,  1.63it/s]
 61%|██████    | 6694/11049 [1:08:56<44:31,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.5147223472595215, 'learning_rate': 4.031521178074461e-06, 'epoch': 1.82}

 61%|██████    | 6694/11049 [1:08:56<44:31,  1.63it/s]
 61%|██████    | 6695/11049 [1:08:57<44:30,  1.63it/s]
                                                      
{'loss': 0.2141, 'grad_norm': 0.5823441743850708, 'learning_rate': 4.0299714999362e-06, 'epoch': 1.82}

 61%|██████    | 6695/11049 [1:08:57<44:30,  1.63it/s]
 61%|██████    | 6696/11049 [1:08:57<44:30,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.5598945617675781, 'learning_rate': 4.0284219186172544e-06, 'epoch': 1.82}

 61%|██████    | 6696/11049 [1:08:58<44:30,  1.63it/s]
 61%|██████    | 6697/11049 [1:08:58<44:30,  1.63it/s]
                                                      
{'loss': 0.1665, 'grad_norm': 0.5419185161590576, 'learning_rate': 4.026872434272291e-06, 'epoch': 1.82}

 61%|██████    | 6697/11049 [1:08:58<44:30,  1.63it/s]
 61%|██████    | 6698/11049 [1:08:59<44:29,  1.63it/s]
                                                      
{'loss': 0.1689, 'grad_norm': 0.44495004415512085, 'learning_rate': 4.02532304705596e-06, 'epoch': 1.82}

 61%|██████    | 6698/11049 [1:08:59<44:29,  1.63it/s]
 61%|██████    | 6699/11049 [1:08:59<44:30,  1.63it/s]
                                                      
{'loss': 0.2414, 'grad_norm': 0.5735781192779541, 'learning_rate': 4.023773757122909e-06, 'epoch': 1.82}

 61%|██████    | 6699/11049 [1:08:59<44:30,  1.63it/s]
 61%|██████    | 6700/11049 [1:09:00<44:30,  1.63it/s]
                                                      
{'loss': 0.2323, 'grad_norm': 0.5798678398132324, 'learning_rate': 4.022224564627775e-06, 'epoch': 1.82}

 61%|██████    | 6700/11049 [1:09:00<44:30,  1.63it/s]
 61%|██████    | 6701/11049 [1:09:00<44:29,  1.63it/s]
                                                      
{'loss': 0.1877, 'grad_norm': 0.5148037075996399, 'learning_rate': 4.020675469725186e-06, 'epoch': 1.82}

 61%|██████    | 6701/11049 [1:09:01<44:29,  1.63it/s]
 61%|██████    | 6702/11049 [1:09:01<44:28,  1.63it/s]
                                                      
{'loss': 0.2051, 'grad_norm': 0.5223986506462097, 'learning_rate': 4.019126472569755e-06, 'epoch': 1.82}

 61%|██████    | 6702/11049 [1:09:01<44:28,  1.63it/s]
 61%|██████    | 6703/11049 [1:09:02<44:27,  1.63it/s]
                                                      
{'loss': 0.2206, 'grad_norm': 0.6268554329872131, 'learning_rate': 4.017577573316086e-06, 'epoch': 1.82}

 61%|██████    | 6703/11049 [1:09:02<44:27,  1.63it/s]
 61%|██████    | 6704/11049 [1:09:02<44:25,  1.63it/s]
                                                      
{'loss': 0.1874, 'grad_norm': 0.522786557674408, 'learning_rate': 4.016028772118783e-06, 'epoch': 1.82}

 61%|██████    | 6704/11049 [1:09:02<44:25,  1.63it/s]
 61%|██████    | 6705/11049 [1:09:03<44:24,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.604712724685669, 'learning_rate': 4.014480069132428e-06, 'epoch': 1.82}

 61%|██████    | 6705/11049 [1:09:03<44:24,  1.63it/s]
 61%|██████    | 6706/11049 [1:09:04<44:24,  1.63it/s]
                                                      
{'loss': 0.2131, 'grad_norm': 0.5685877203941345, 'learning_rate': 4.012931464511603e-06, 'epoch': 1.82}

 61%|██████    | 6706/11049 [1:09:04<44:24,  1.63it/s]
 61%|██████    | 6707/11049 [1:09:04<44:23,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.508395791053772, 'learning_rate': 4.011382958410867e-06, 'epoch': 1.82}

 61%|██████    | 6707/11049 [1:09:04<44:23,  1.63it/s]
 61%|██████    | 6708/11049 [1:09:05<44:22,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.4591195583343506, 'learning_rate': 4.009834550984786e-06, 'epoch': 1.82}

 61%|██████    | 6708/11049 [1:09:05<44:22,  1.63it/s]
 61%|██████    | 6709/11049 [1:09:05<44:22,  1.63it/s]
                                                      
{'loss': 0.177, 'grad_norm': 0.5039516091346741, 'learning_rate': 4.008286242387905e-06, 'epoch': 1.82}

 61%|██████    | 6709/11049 [1:09:06<44:22,  1.63it/s]
 61%|██████    | 6710/11049 [1:09:06<44:21,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.5496600270271301, 'learning_rate': 4.0067380327747616e-06, 'epoch': 1.82}

 61%|██████    | 6710/11049 [1:09:06<44:21,  1.63it/s]
 61%|██████    | 6711/11049 [1:09:07<44:32,  1.62it/s]
                                                      
{'loss': 0.1917, 'grad_norm': 0.5603212714195251, 'learning_rate': 4.005189922299882e-06, 'epoch': 1.82}

 61%|██████    | 6711/11049 [1:09:07<44:32,  1.62it/s]
 61%|██████    | 6712/11049 [1:09:07<44:28,  1.63it/s]
                                                      
{'loss': 0.217, 'grad_norm': 0.6073775887489319, 'learning_rate': 4.003641911117788e-06, 'epoch': 1.82}

 61%|██████    | 6712/11049 [1:09:07<44:28,  1.63it/s]
 61%|██████    | 6713/11049 [1:09:08<44:25,  1.63it/s]
                                                      
{'loss': 0.186, 'grad_norm': 0.48806530237197876, 'learning_rate': 4.002093999382985e-06, 'epoch': 1.82}

 61%|██████    | 6713/11049 [1:09:08<44:25,  1.63it/s]
 61%|██████    | 6714/11049 [1:09:08<44:22,  1.63it/s]
                                                      
{'loss': 0.2427, 'grad_norm': 0.5761623382568359, 'learning_rate': 4.000546187249973e-06, 'epoch': 1.82}

 61%|██████    | 6714/11049 [1:09:09<44:22,  1.63it/s]
 61%|██████    | 6715/11049 [1:09:09<44:20,  1.63it/s]
                                                      
{'loss': 0.242, 'grad_norm': 0.6000058054924011, 'learning_rate': 3.998998474873239e-06, 'epoch': 1.82}

 61%|██████    | 6715/11049 [1:09:09<44:20,  1.63it/s]
 61%|██████    | 6716/11049 [1:09:10<44:19,  1.63it/s]
                                                      
{'loss': 0.207, 'grad_norm': 0.563154399394989, 'learning_rate': 3.997450862407262e-06, 'epoch': 1.82}

 61%|██████    | 6716/11049 [1:09:10<44:19,  1.63it/s]
 61%|██████    | 6717/11049 [1:09:10<44:17,  1.63it/s]
                                                      
{'loss': 0.1651, 'grad_norm': 0.48141875863075256, 'learning_rate': 3.995903350006511e-06, 'epoch': 1.82}

 61%|██████    | 6717/11049 [1:09:10<44:17,  1.63it/s]
 61%|██████    | 6718/11049 [1:09:11<44:17,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.5123791694641113, 'learning_rate': 3.994355937825444e-06, 'epoch': 1.82}

 61%|██████    | 6718/11049 [1:09:11<44:17,  1.63it/s]
 61%|██████    | 6719/11049 [1:09:12<44:30,  1.62it/s]
                                                      
{'loss': 0.2042, 'grad_norm': 0.538061797618866, 'learning_rate': 3.992808626018508e-06, 'epoch': 1.82}

 61%|██████    | 6719/11049 [1:09:12<44:30,  1.62it/s]
 61%|██████    | 6720/11049 [1:09:12<44:25,  1.62it/s]
                                                      
{'loss': 0.2015, 'grad_norm': 0.544651448726654, 'learning_rate': 3.991261414740144e-06, 'epoch': 1.82}

 61%|██████    | 6720/11049 [1:09:12<44:25,  1.62it/s]
 61%|██████    | 6721/11049 [1:09:13<44:21,  1.63it/s]
                                                      
{'loss': 0.1861, 'grad_norm': 0.5488523244857788, 'learning_rate': 3.9897143041447794e-06, 'epoch': 1.82}

 61%|██████    | 6721/11049 [1:09:13<44:21,  1.63it/s]
 61%|██████    | 6722/11049 [1:09:13<44:18,  1.63it/s]
                                                      
{'loss': 0.1977, 'grad_norm': 0.5510073900222778, 'learning_rate': 3.988167294386832e-06, 'epoch': 1.83}

 61%|██████    | 6722/11049 [1:09:14<44:18,  1.63it/s]
 61%|██████    | 6723/11049 [1:09:14<44:18,  1.63it/s]
                                                      
{'loss': 0.2051, 'grad_norm': 0.5388633012771606, 'learning_rate': 3.986620385620709e-06, 'epoch': 1.83}

 61%|██████    | 6723/11049 [1:09:14<44:18,  1.63it/s]
 61%|██████    | 6724/11049 [1:09:15<44:20,  1.63it/s]
                                                      
{'loss': 0.205, 'grad_norm': 0.4993375837802887, 'learning_rate': 3.985073578000811e-06, 'epoch': 1.83}

 61%|██████    | 6724/11049 [1:09:15<44:20,  1.63it/s]
 61%|██████    | 6725/11049 [1:09:15<44:16,  1.63it/s]
                                                      
{'loss': 0.1509, 'grad_norm': 0.4166494309902191, 'learning_rate': 3.983526871681526e-06, 'epoch': 1.83}

 61%|██████    | 6725/11049 [1:09:15<44:16,  1.63it/s]
 61%|██████    | 6726/11049 [1:09:16<44:15,  1.63it/s]
                                                      
{'loss': 0.1842, 'grad_norm': 0.5247176289558411, 'learning_rate': 3.9819802668172305e-06, 'epoch': 1.83}

 61%|██████    | 6726/11049 [1:09:16<44:15,  1.63it/s]
 61%|██████    | 6727/11049 [1:09:16<44:13,  1.63it/s]
                                                      
{'loss': 0.229, 'grad_norm': 0.6413206458091736, 'learning_rate': 3.980433763562292e-06, 'epoch': 1.83}

 61%|██████    | 6727/11049 [1:09:17<44:13,  1.63it/s]
 61%|██████    | 6728/11049 [1:09:17<44:15,  1.63it/s]
                                                      
{'loss': 0.213, 'grad_norm': 0.5705898404121399, 'learning_rate': 3.978887362071069e-06, 'epoch': 1.83}

 61%|██████    | 6728/11049 [1:09:17<44:15,  1.63it/s]
 61%|██████    | 6729/11049 [1:09:18<44:15,  1.63it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.557742178440094, 'learning_rate': 3.977341062497911e-06, 'epoch': 1.83}

 61%|██████    | 6729/11049 [1:09:18<44:15,  1.63it/s]
 61%|██████    | 6730/11049 [1:09:18<44:12,  1.63it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.4720766544342041, 'learning_rate': 3.975794864997152e-06, 'epoch': 1.83}

 61%|██████    | 6730/11049 [1:09:18<44:12,  1.63it/s]
 61%|██████    | 6731/11049 [1:09:19<44:10,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.4931892454624176, 'learning_rate': 3.97424876972312e-06, 'epoch': 1.83}

 61%|██████    | 6731/11049 [1:09:19<44:10,  1.63it/s]
 61%|██████    | 6732/11049 [1:09:20<44:09,  1.63it/s]
                                                      
{'loss': 0.2084, 'grad_norm': 0.5647719502449036, 'learning_rate': 3.9727027768301355e-06, 'epoch': 1.83}

 61%|██████    | 6732/11049 [1:09:20<44:09,  1.63it/s]
 61%|██████    | 6733/11049 [1:09:20<44:07,  1.63it/s]
                                                      
{'loss': 0.2408, 'grad_norm': 0.5555259585380554, 'learning_rate': 3.971156886472501e-06, 'epoch': 1.83}

 61%|██████    | 6733/11049 [1:09:20<44:07,  1.63it/s]
 61%|██████    | 6734/11049 [1:09:21<44:07,  1.63it/s]
                                                      
{'loss': 0.2022, 'grad_norm': 0.5665572285652161, 'learning_rate': 3.969611098804515e-06, 'epoch': 1.83}

 61%|██████    | 6734/11049 [1:09:21<44:07,  1.63it/s]
 61%|██████    | 6735/11049 [1:09:21<44:07,  1.63it/s]
                                                      
{'loss': 0.1822, 'grad_norm': 0.5595694780349731, 'learning_rate': 3.96806541398046e-06, 'epoch': 1.83}

 61%|██████    | 6735/11049 [1:09:22<44:07,  1.63it/s]
 61%|██████    | 6736/11049 [1:09:22<44:05,  1.63it/s]
                                                      
{'loss': 0.2737, 'grad_norm': 0.6307200193405151, 'learning_rate': 3.966519832154619e-06, 'epoch': 1.83}

 61%|██████    | 6736/11049 [1:09:22<44:05,  1.63it/s]
 61%|██████    | 6737/11049 [1:09:23<44:04,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.5863760113716125, 'learning_rate': 3.964974353481254e-06, 'epoch': 1.83}

 61%|██████    | 6737/11049 [1:09:23<44:04,  1.63it/s]
 61%|██████    | 6738/11049 [1:09:23<44:03,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.5693855881690979, 'learning_rate': 3.963428978114621e-06, 'epoch': 1.83}

 61%|██████    | 6738/11049 [1:09:23<44:03,  1.63it/s]
 61%|██████    | 6739/11049 [1:09:24<44:03,  1.63it/s]
                                                      
{'loss': 0.1979, 'grad_norm': 0.5360344052314758, 'learning_rate': 3.961883706208962e-06, 'epoch': 1.83}

 61%|██████    | 6739/11049 [1:09:24<44:03,  1.63it/s]
 61%|██████    | 6740/11049 [1:09:24<44:01,  1.63it/s]
                                                      
{'loss': 0.1931, 'grad_norm': 0.5985453128814697, 'learning_rate': 3.960338537918517e-06, 'epoch': 1.83}

 61%|██████    | 6740/11049 [1:09:25<44:01,  1.63it/s]
 61%|██████    | 6741/11049 [1:09:25<44:02,  1.63it/s]
                                                      
{'loss': 0.1916, 'grad_norm': 0.5276134014129639, 'learning_rate': 3.958793473397507e-06, 'epoch': 1.83}

 61%|██████    | 6741/11049 [1:09:25<44:02,  1.63it/s]
 61%|██████    | 6742/11049 [1:09:26<44:02,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.43097734451293945, 'learning_rate': 3.9572485128001495e-06, 'epoch': 1.83}

 61%|██████    | 6742/11049 [1:09:26<44:02,  1.63it/s]
 61%|██████    | 6743/11049 [1:09:26<44:00,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.48623573780059814, 'learning_rate': 3.955703656280642e-06, 'epoch': 1.83}

 61%|██████    | 6743/11049 [1:09:26<44:00,  1.63it/s]
 61%|██████    | 6744/11049 [1:09:27<44:00,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.46942177414894104, 'learning_rate': 3.954158903993184e-06, 'epoch': 1.83}

 61%|██████    | 6744/11049 [1:09:27<44:00,  1.63it/s]
 61%|██████    | 6745/11049 [1:09:28<43:59,  1.63it/s]
                                                      
{'loss': 0.2782, 'grad_norm': 0.7274152040481567, 'learning_rate': 3.9526142560919566e-06, 'epoch': 1.83}

 61%|██████    | 6745/11049 [1:09:28<43:59,  1.63it/s]
 61%|██████    | 6746/11049 [1:09:28<44:00,  1.63it/s]
                                                      
{'loss': 0.2555, 'grad_norm': 0.765053927898407, 'learning_rate': 3.951069712731131e-06, 'epoch': 1.83}

 61%|██████    | 6746/11049 [1:09:28<44:00,  1.63it/s]
 61%|██████    | 6747/11049 [1:09:29<43:59,  1.63it/s]
                                                      
{'loss': 0.262, 'grad_norm': 0.6481510400772095, 'learning_rate': 3.94952527406487e-06, 'epoch': 1.83}

 61%|██████    | 6747/11049 [1:09:29<43:59,  1.63it/s]
 61%|██████    | 6748/11049 [1:09:29<43:58,  1.63it/s]
                                                      
{'loss': 0.1857, 'grad_norm': 0.5102056264877319, 'learning_rate': 3.947980940247326e-06, 'epoch': 1.83}

 61%|██████    | 6748/11049 [1:09:29<43:58,  1.63it/s]
 61%|██████    | 6749/11049 [1:09:30<43:57,  1.63it/s]
                                                      
{'loss': 0.2542, 'grad_norm': 0.6271718144416809, 'learning_rate': 3.94643671143264e-06, 'epoch': 1.83}

 61%|██████    | 6749/11049 [1:09:30<43:57,  1.63it/s]
 61%|██████    | 6750/11049 [1:09:31<43:56,  1.63it/s]
                                                      
{'loss': 0.2012, 'grad_norm': 0.5253627300262451, 'learning_rate': 3.944892587774942e-06, 'epoch': 1.83}

 61%|██████    | 6750/11049 [1:09:31<43:56,  1.63it/s]
 61%|██████    | 6751/11049 [1:09:31<43:56,  1.63it/s]
                                                      
{'loss': 0.2135, 'grad_norm': 0.6642774343490601, 'learning_rate': 3.9433485694283525e-06, 'epoch': 1.83}

 61%|██████    | 6751/11049 [1:09:31<43:56,  1.63it/s]
 61%|██████    | 6752/11049 [1:09:32<43:54,  1.63it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.48004621267318726, 'learning_rate': 3.941804656546982e-06, 'epoch': 1.83}

 61%|██████    | 6752/11049 [1:09:32<43:54,  1.63it/s]
 61%|██████    | 6753/11049 [1:09:32<43:55,  1.63it/s]
                                                      
{'loss': 0.2412, 'grad_norm': 0.6263664960861206, 'learning_rate': 3.940260849284928e-06, 'epoch': 1.83}

 61%|██████    | 6753/11049 [1:09:33<43:55,  1.63it/s]
 61%|██████    | 6754/11049 [1:09:33<43:54,  1.63it/s]
                                                      
{'loss': 0.2201, 'grad_norm': 0.5608970522880554, 'learning_rate': 3.938717147796281e-06, 'epoch': 1.83}

 61%|██████    | 6754/11049 [1:09:33<43:54,  1.63it/s]
 61%|██████    | 6755/11049 [1:09:34<43:54,  1.63it/s]
                                                      
{'loss': 0.1597, 'grad_norm': 0.4494308531284332, 'learning_rate': 3.937173552235117e-06, 'epoch': 1.83}

 61%|██████    | 6755/11049 [1:09:34<43:54,  1.63it/s]
 61%|██████    | 6756/11049 [1:09:34<43:54,  1.63it/s]
                                                      
{'loss': 0.1803, 'grad_norm': 0.4983553886413574, 'learning_rate': 3.935630062755505e-06, 'epoch': 1.83}

 61%|██████    | 6756/11049 [1:09:34<43:54,  1.63it/s]
 61%|██████    | 6757/11049 [1:09:35<43:51,  1.63it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.5508663058280945, 'learning_rate': 3.934086679511503e-06, 'epoch': 1.83}

 61%|██████    | 6757/11049 [1:09:35<43:51,  1.63it/s]
 61%|██████    | 6758/11049 [1:09:35<43:51,  1.63it/s]
                                                      
{'loss': 0.1985, 'grad_norm': 0.5277474522590637, 'learning_rate': 3.932543402657155e-06, 'epoch': 1.83}

 61%|██████    | 6758/11049 [1:09:36<43:51,  1.63it/s]
 61%|██████    | 6759/11049 [1:09:36<43:51,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.5681845545768738, 'learning_rate': 3.931000232346496e-06, 'epoch': 1.84}

 61%|██████    | 6759/11049 [1:09:36<43:51,  1.63it/s]
 61%|██████    | 6760/11049 [1:09:37<43:49,  1.63it/s]
                                                      
{'loss': 0.2344, 'grad_norm': 0.5861125588417053, 'learning_rate': 3.929457168733554e-06, 'epoch': 1.84}

 61%|██████    | 6760/11049 [1:09:37<43:49,  1.63it/s]
 61%|██████    | 6761/11049 [1:09:37<43:48,  1.63it/s]
                                                      
{'loss': 0.2149, 'grad_norm': 0.5609924793243408, 'learning_rate': 3.927914211972342e-06, 'epoch': 1.84}

 61%|██████    | 6761/11049 [1:09:37<43:48,  1.63it/s]
 61%|██████    | 6762/11049 [1:09:38<43:49,  1.63it/s]
                                                      
{'loss': 0.2282, 'grad_norm': 0.6585202813148499, 'learning_rate': 3.9263713622168645e-06, 'epoch': 1.84}

 61%|██████    | 6762/11049 [1:09:38<43:49,  1.63it/s]
 61%|██████    | 6763/11049 [1:09:39<43:47,  1.63it/s]
                                                      
{'loss': 0.3682, 'grad_norm': 0.8683424592018127, 'learning_rate': 3.924828619621111e-06, 'epoch': 1.84}

 61%|██████    | 6763/11049 [1:09:39<43:47,  1.63it/s]
 61%|██████    | 6764/11049 [1:09:39<43:46,  1.63it/s]
                                                      
{'loss': 0.2425, 'grad_norm': 0.6157574653625488, 'learning_rate': 3.92328598433907e-06, 'epoch': 1.84}

 61%|██████    | 6764/11049 [1:09:39<43:46,  1.63it/s]
 61%|██████    | 6765/11049 [1:09:40<43:46,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.534144401550293, 'learning_rate': 3.921743456524708e-06, 'epoch': 1.84}

 61%|██████    | 6765/11049 [1:09:40<43:46,  1.63it/s]
 61%|██████    | 6766/11049 [1:09:40<43:46,  1.63it/s]
                                                      
{'loss': 0.1857, 'grad_norm': 0.5013571381568909, 'learning_rate': 3.92020103633199e-06, 'epoch': 1.84}

 61%|██████    | 6766/11049 [1:09:41<43:46,  1.63it/s]
 61%|██████    | 6767/11049 [1:09:41<43:45,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.4766905903816223, 'learning_rate': 3.91865872391486e-06, 'epoch': 1.84}

 61%|██████    | 6767/11049 [1:09:41<43:45,  1.63it/s]
 61%|██████▏   | 6768/11049 [1:09:42<43:45,  1.63it/s]
                                                      
{'loss': 0.164, 'grad_norm': 0.46949219703674316, 'learning_rate': 3.917116519427264e-06, 'epoch': 1.84}

 61%|██████▏   | 6768/11049 [1:09:42<43:45,  1.63it/s]
 61%|██████▏   | 6769/11049 [1:09:42<43:44,  1.63it/s]
                                                      
{'loss': 0.2774, 'grad_norm': 0.6185081005096436, 'learning_rate': 3.915574423023128e-06, 'epoch': 1.84}

 61%|██████▏   | 6769/11049 [1:09:42<43:44,  1.63it/s]
 61%|██████▏   | 6770/11049 [1:09:43<43:43,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.5902006030082703, 'learning_rate': 3.91403243485637e-06, 'epoch': 1.84}

 61%|██████▏   | 6770/11049 [1:09:43<43:43,  1.63it/s]
 61%|██████▏   | 6771/11049 [1:09:43<43:43,  1.63it/s]
                                                      
{'loss': 0.2104, 'grad_norm': 0.6078187227249146, 'learning_rate': 3.912490555080894e-06, 'epoch': 1.84}

 61%|██████▏   | 6771/11049 [1:09:44<43:43,  1.63it/s]
 61%|██████▏   | 6772/11049 [1:09:44<43:43,  1.63it/s]
                                                      
{'loss': 0.2207, 'grad_norm': 0.5684984922409058, 'learning_rate': 3.910948783850602e-06, 'epoch': 1.84}

 61%|██████▏   | 6772/11049 [1:09:44<43:43,  1.63it/s]
 61%|██████▏   | 6773/11049 [1:09:45<43:43,  1.63it/s]
                                                      
{'loss': 0.2208, 'grad_norm': 0.5833320617675781, 'learning_rate': 3.909407121319378e-06, 'epoch': 1.84}

 61%|██████▏   | 6773/11049 [1:09:45<43:43,  1.63it/s]
 61%|██████▏   | 6774/11049 [1:09:45<43:42,  1.63it/s]
                                                      
{'loss': 0.2127, 'grad_norm': 0.4710550308227539, 'learning_rate': 3.9078655676410934e-06, 'epoch': 1.84}

 61%|██████▏   | 6774/11049 [1:09:45<43:42,  1.63it/s]
 61%|██████▏   | 6775/11049 [1:09:46<43:41,  1.63it/s]
                                                      
{'loss': 0.1763, 'grad_norm': 0.47091230750083923, 'learning_rate': 3.9063241229696116e-06, 'epoch': 1.84}

 61%|██████▏   | 6775/11049 [1:09:46<43:41,  1.63it/s]
 61%|██████▏   | 6776/11049 [1:09:47<43:40,  1.63it/s]
                                                      
{'loss': 0.2146, 'grad_norm': 0.5365983843803406, 'learning_rate': 3.90478278745879e-06, 'epoch': 1.84}

 61%|██████▏   | 6776/11049 [1:09:47<43:40,  1.63it/s]
 61%|██████▏   | 6777/11049 [1:09:47<43:40,  1.63it/s]
                                                      
{'loss': 0.1893, 'grad_norm': 0.5549877285957336, 'learning_rate': 3.903241561262468e-06, 'epoch': 1.84}

 61%|██████▏   | 6777/11049 [1:09:47<43:40,  1.63it/s]
 61%|██████▏   | 6778/11049 [1:09:48<43:39,  1.63it/s]
                                                      
{'loss': 0.1783, 'grad_norm': 0.47340166568756104, 'learning_rate': 3.9017004445344776e-06, 'epoch': 1.84}

 61%|██████▏   | 6778/11049 [1:09:48<43:39,  1.63it/s]
 61%|██████▏   | 6779/11049 [1:09:48<43:38,  1.63it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.45212480425834656, 'learning_rate': 3.900159437428635e-06, 'epoch': 1.84}

 61%|██████▏   | 6779/11049 [1:09:48<43:38,  1.63it/s]
 61%|██████▏   | 6780/11049 [1:09:49<43:37,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.5448821783065796, 'learning_rate': 3.898618540098754e-06, 'epoch': 1.84}

 61%|██████▏   | 6780/11049 [1:09:49<43:37,  1.63it/s]
 61%|██████▏   | 6781/11049 [1:09:50<43:37,  1.63it/s]
                                                      
{'loss': 0.1812, 'grad_norm': 0.4729512333869934, 'learning_rate': 3.89707775269863e-06, 'epoch': 1.84}

 61%|██████▏   | 6781/11049 [1:09:50<43:37,  1.63it/s]
 61%|██████▏   | 6782/11049 [1:09:50<43:35,  1.63it/s]
                                                      
{'loss': 0.2087, 'grad_norm': 0.5414124727249146, 'learning_rate': 3.895537075382053e-06, 'epoch': 1.84}

 61%|██████▏   | 6782/11049 [1:09:50<43:35,  1.63it/s]
 61%|██████▏   | 6783/11049 [1:09:51<43:35,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.4844529330730438, 'learning_rate': 3.893996508302796e-06, 'epoch': 1.84}

 61%|██████▏   | 6783/11049 [1:09:51<43:35,  1.63it/s]
 61%|██████▏   | 6784/11049 [1:09:51<43:34,  1.63it/s]
                                                      
{'loss': 0.1865, 'grad_norm': 0.47585123777389526, 'learning_rate': 3.892456051614626e-06, 'epoch': 1.84}

 61%|██████▏   | 6784/11049 [1:09:52<43:34,  1.63it/s]
 61%|██████▏   | 6785/11049 [1:09:52<43:34,  1.63it/s]
                                                      
{'loss': 0.2366, 'grad_norm': 0.5858991146087646, 'learning_rate': 3.890915705471297e-06, 'epoch': 1.84}

 61%|██████▏   | 6785/11049 [1:09:52<43:34,  1.63it/s]
 61%|██████▏   | 6786/11049 [1:09:53<43:34,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.5269395112991333, 'learning_rate': 3.8893754700265525e-06, 'epoch': 1.84}

 61%|██████▏   | 6786/11049 [1:09:53<43:34,  1.63it/s]
 61%|██████▏   | 6787/11049 [1:09:53<43:32,  1.63it/s]
                                                      
{'loss': 0.2267, 'grad_norm': 0.5994028449058533, 'learning_rate': 3.887835345434123e-06, 'epoch': 1.84}

 61%|██████▏   | 6787/11049 [1:09:53<43:32,  1.63it/s]
 61%|██████▏   | 6788/11049 [1:09:54<43:32,  1.63it/s]
                                                      
{'loss': 0.2416, 'grad_norm': 0.6040522456169128, 'learning_rate': 3.886295331847731e-06, 'epoch': 1.84}

 61%|██████▏   | 6788/11049 [1:09:54<43:32,  1.63it/s]
 61%|██████▏   | 6789/11049 [1:09:54<43:31,  1.63it/s]
                                                      
{'loss': 0.1803, 'grad_norm': 0.46457138657569885, 'learning_rate': 3.884755429421088e-06, 'epoch': 1.84}

 61%|██████▏   | 6789/11049 [1:09:55<43:31,  1.63it/s]
 61%|██████▏   | 6790/11049 [1:09:55<43:32,  1.63it/s]
                                                      
{'loss': 0.2077, 'grad_norm': 0.5866169333457947, 'learning_rate': 3.88321563830789e-06, 'epoch': 1.84}

 61%|██████▏   | 6790/11049 [1:09:55<43:32,  1.63it/s]
 61%|██████▏   | 6791/11049 [1:09:56<43:30,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.5619638562202454, 'learning_rate': 3.881675958661826e-06, 'epoch': 1.84}

 61%|██████▏   | 6791/11049 [1:09:56<43:30,  1.63it/s]
 61%|██████▏   | 6792/11049 [1:09:56<43:30,  1.63it/s]
                                                      
{'loss': 0.1631, 'grad_norm': 0.42465445399284363, 'learning_rate': 3.880136390636571e-06, 'epoch': 1.84}

 61%|██████▏   | 6792/11049 [1:09:56<43:30,  1.63it/s]
 61%|██████▏   | 6793/11049 [1:09:57<43:29,  1.63it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.57464200258255, 'learning_rate': 3.878596934385794e-06, 'epoch': 1.84}

 61%|██████▏   | 6793/11049 [1:09:57<43:29,  1.63it/s]
 61%|██████▏   | 6794/11049 [1:09:58<43:30,  1.63it/s]
                                                      
{'loss': 0.2163, 'grad_norm': 0.5711137652397156, 'learning_rate': 3.8770575900631465e-06, 'epoch': 1.84}

 61%|██████▏   | 6794/11049 [1:09:58<43:30,  1.63it/s]
 61%|██████▏   | 6795/11049 [1:09:58<43:29,  1.63it/s]
                                                      
{'loss': 0.2095, 'grad_norm': 0.5801634192466736, 'learning_rate': 3.875518357822274e-06, 'epoch': 1.84}

 61%|██████▏   | 6795/11049 [1:09:58<43:29,  1.63it/s]
 62%|██████▏   | 6796/11049 [1:09:59<43:29,  1.63it/s]
                                                      
{'loss': 0.1959, 'grad_norm': 0.5133543014526367, 'learning_rate': 3.873979237816805e-06, 'epoch': 1.85}

 62%|██████▏   | 6796/11049 [1:09:59<43:29,  1.63it/s]
 62%|██████▏   | 6797/11049 [1:09:59<43:27,  1.63it/s]
                                                      
{'loss': 0.193, 'grad_norm': 0.5292988419532776, 'learning_rate': 3.872440230200363e-06, 'epoch': 1.85}

 62%|██████▏   | 6797/11049 [1:10:00<43:27,  1.63it/s]
 62%|██████▏   | 6798/11049 [1:10:00<43:28,  1.63it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.640392005443573, 'learning_rate': 3.870901335126558e-06, 'epoch': 1.85}

 62%|██████▏   | 6798/11049 [1:10:00<43:28,  1.63it/s]
 62%|██████▏   | 6799/11049 [1:10:01<43:29,  1.63it/s]
                                                      
{'loss': 0.2146, 'grad_norm': 0.5256314277648926, 'learning_rate': 3.869362552748987e-06, 'epoch': 1.85}

 62%|██████▏   | 6799/11049 [1:10:01<43:29,  1.63it/s]
 62%|██████▏   | 6800/11049 [1:10:01<43:28,  1.63it/s]
                                                      
{'loss': 0.187, 'grad_norm': 0.5417371392250061, 'learning_rate': 3.867823883221236e-06, 'epoch': 1.85}

 62%|██████▏   | 6800/11049 [1:10:01<43:28,  1.63it/s]
 62%|██████▏   | 6801/11049 [1:10:02<43:28,  1.63it/s]
                                                      
{'loss': 0.1792, 'grad_norm': 0.5126674175262451, 'learning_rate': 3.866285326696883e-06, 'epoch': 1.85}

 62%|██████▏   | 6801/11049 [1:10:02<43:28,  1.63it/s]
 62%|██████▏   | 6802/11049 [1:10:02<43:27,  1.63it/s]
                                                      
{'loss': 0.2899, 'grad_norm': 0.6659507751464844, 'learning_rate': 3.864746883329492e-06, 'epoch': 1.85}

 62%|██████▏   | 6802/11049 [1:10:03<43:27,  1.63it/s]
 62%|██████▏   | 6803/11049 [1:10:03<43:25,  1.63it/s]
                                                      
{'loss': 0.1639, 'grad_norm': 0.4791836142539978, 'learning_rate': 3.8632085532726156e-06, 'epoch': 1.85}

 62%|██████▏   | 6803/11049 [1:10:03<43:25,  1.63it/s]
 62%|██████▏   | 6804/11049 [1:10:04<43:25,  1.63it/s]
                                                      
{'loss': 0.2297, 'grad_norm': 0.6582047343254089, 'learning_rate': 3.861670336679795e-06, 'epoch': 1.85}

 62%|██████▏   | 6804/11049 [1:10:04<43:25,  1.63it/s]
 62%|██████▏   | 6805/11049 [1:10:04<43:24,  1.63it/s]
                                                      
{'loss': 0.1735, 'grad_norm': 0.4753302335739136, 'learning_rate': 3.860132233704563e-06, 'epoch': 1.85}

 62%|██████▏   | 6805/11049 [1:10:04<43:24,  1.63it/s]
 62%|██████▏   | 6806/11049 [1:10:05<43:23,  1.63it/s]
                                                      
{'loss': 0.1831, 'grad_norm': 0.4994391202926636, 'learning_rate': 3.858594244500439e-06, 'epoch': 1.85}

 62%|██████▏   | 6806/11049 [1:10:05<43:23,  1.63it/s]
 62%|██████▏   | 6807/11049 [1:10:06<43:23,  1.63it/s]
                                                      
{'loss': 0.1653, 'grad_norm': 0.48403722047805786, 'learning_rate': 3.857056369220929e-06, 'epoch': 1.85}

 62%|██████▏   | 6807/11049 [1:10:06<43:23,  1.63it/s]
 62%|██████▏   | 6808/11049 [1:10:06<43:21,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.46529972553253174, 'learning_rate': 3.855518608019528e-06, 'epoch': 1.85}

 62%|██████▏   | 6808/11049 [1:10:06<43:21,  1.63it/s]
 62%|██████▏   | 6809/11049 [1:10:07<43:20,  1.63it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.4465577304363251, 'learning_rate': 3.853980961049727e-06, 'epoch': 1.85}

 62%|██████▏   | 6809/11049 [1:10:07<43:20,  1.63it/s]
 62%|██████▏   | 6810/11049 [1:10:07<43:20,  1.63it/s]
                                                      
{'loss': 0.2661, 'grad_norm': 0.6737939715385437, 'learning_rate': 3.852443428464995e-06, 'epoch': 1.85}

 62%|██████▏   | 6810/11049 [1:10:08<43:20,  1.63it/s]
 62%|██████▏   | 6811/11049 [1:10:08<43:18,  1.63it/s]
                                                      
{'loss': 0.1806, 'grad_norm': 0.5762630105018616, 'learning_rate': 3.850906010418795e-06, 'epoch': 1.85}

 62%|██████▏   | 6811/11049 [1:10:08<43:18,  1.63it/s]
 62%|██████▏   | 6812/11049 [1:10:09<43:17,  1.63it/s]
                                                      
{'loss': 0.2702, 'grad_norm': 0.6343604326248169, 'learning_rate': 3.849368707064578e-06, 'epoch': 1.85}

 62%|██████▏   | 6812/11049 [1:10:09<43:17,  1.63it/s]
 62%|██████▏   | 6813/11049 [1:10:09<43:17,  1.63it/s]
                                                      
{'loss': 0.1967, 'grad_norm': 0.5576257109642029, 'learning_rate': 3.847831518555785e-06, 'epoch': 1.85}

 62%|██████▏   | 6813/11049 [1:10:09<43:17,  1.63it/s]
 62%|██████▏   | 6814/11049 [1:10:10<43:16,  1.63it/s]
                                                      
{'loss': 0.2228, 'grad_norm': 0.6311590671539307, 'learning_rate': 3.846294445045843e-06, 'epoch': 1.85}

 62%|██████▏   | 6814/11049 [1:10:10<43:16,  1.63it/s]
 62%|██████▏   | 6815/11049 [1:10:10<43:17,  1.63it/s]
                                                      
{'loss': 0.2298, 'grad_norm': 0.7897527813911438, 'learning_rate': 3.844757486688169e-06, 'epoch': 1.85}

 62%|██████▏   | 6815/11049 [1:10:11<43:17,  1.63it/s]
 62%|██████▏   | 6816/11049 [1:10:11<43:15,  1.63it/s]
                                                      
{'loss': 0.1939, 'grad_norm': 0.6182986497879028, 'learning_rate': 3.843220643636165e-06, 'epoch': 1.85}

 62%|██████▏   | 6816/11049 [1:10:11<43:15,  1.63it/s]
 62%|██████▏   | 6817/11049 [1:10:12<43:15,  1.63it/s]
                                                      
{'loss': 0.2137, 'grad_norm': 0.5614809989929199, 'learning_rate': 3.841683916043229e-06, 'epoch': 1.85}

 62%|██████▏   | 6817/11049 [1:10:12<43:15,  1.63it/s]
 62%|██████▏   | 6818/11049 [1:10:12<43:17,  1.63it/s]
                                                      
{'loss': 0.2114, 'grad_norm': 0.5164547562599182, 'learning_rate': 3.840147304062741e-06, 'epoch': 1.85}

 62%|██████▏   | 6818/11049 [1:10:12<43:17,  1.63it/s]
 62%|██████▏   | 6819/11049 [1:10:13<43:15,  1.63it/s]
                                                      
{'loss': 0.2811, 'grad_norm': 0.7036385536193848, 'learning_rate': 3.838610807848073e-06, 'epoch': 1.85}

 62%|██████▏   | 6819/11049 [1:10:13<43:15,  1.63it/s]
 62%|██████▏   | 6820/11049 [1:10:14<43:14,  1.63it/s]
                                                      
{'loss': 0.2391, 'grad_norm': 0.5369217991828918, 'learning_rate': 3.837074427552579e-06, 'epoch': 1.85}

 62%|██████▏   | 6820/11049 [1:10:14<43:14,  1.63it/s]
 62%|██████▏   | 6821/11049 [1:10:14<43:13,  1.63it/s]
                                                      
{'loss': 0.1901, 'grad_norm': 0.5041623711585999, 'learning_rate': 3.8355381633296114e-06, 'epoch': 1.85}

 62%|██████▏   | 6821/11049 [1:10:14<43:13,  1.63it/s]
 62%|██████▏   | 6822/11049 [1:10:15<43:12,  1.63it/s]
                                                      
{'loss': 0.1786, 'grad_norm': 0.5018851161003113, 'learning_rate': 3.834002015332506e-06, 'epoch': 1.85}

 62%|██████▏   | 6822/11049 [1:10:15<43:12,  1.63it/s]
 62%|██████▏   | 6823/11049 [1:10:15<43:11,  1.63it/s]
                                                      
{'loss': 0.2042, 'grad_norm': 0.5815793871879578, 'learning_rate': 3.832465983714583e-06, 'epoch': 1.85}

 62%|██████▏   | 6823/11049 [1:10:15<43:11,  1.63it/s]
 62%|██████▏   | 6824/11049 [1:10:16<43:10,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.44546768069267273, 'learning_rate': 3.830930068629158e-06, 'epoch': 1.85}

 62%|██████▏   | 6824/11049 [1:10:16<43:10,  1.63it/s]
 62%|██████▏   | 6825/11049 [1:10:17<43:10,  1.63it/s]
                                                      
{'loss': 0.2137, 'grad_norm': 0.5971094369888306, 'learning_rate': 3.829394270229531e-06, 'epoch': 1.85}

 62%|██████▏   | 6825/11049 [1:10:17<43:10,  1.63it/s]
 62%|██████▏   | 6826/11049 [1:10:17<43:08,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.47341716289520264, 'learning_rate': 3.827858588668992e-06, 'epoch': 1.85}

 62%|██████▏   | 6826/11049 [1:10:17<43:08,  1.63it/s]
 62%|██████▏   | 6827/11049 [1:10:18<43:08,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.5430111289024353, 'learning_rate': 3.826323024100818e-06, 'epoch': 1.85}

 62%|██████▏   | 6827/11049 [1:10:18<43:08,  1.63it/s]
 62%|██████▏   | 6828/11049 [1:10:18<43:08,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5105517506599426, 'learning_rate': 3.8247875766782735e-06, 'epoch': 1.85}

 62%|██████▏   | 6828/11049 [1:10:19<43:08,  1.63it/s]
 62%|██████▏   | 6829/11049 [1:10:19<43:07,  1.63it/s]
                                                      
{'loss': 0.1818, 'grad_norm': 0.48690512776374817, 'learning_rate': 3.823252246554615e-06, 'epoch': 1.85}

 62%|██████▏   | 6829/11049 [1:10:19<43:07,  1.63it/s]
 62%|██████▏   | 6830/11049 [1:10:20<43:08,  1.63it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5150865912437439, 'learning_rate': 3.821717033883085e-06, 'epoch': 1.85}

 62%|██████▏   | 6830/11049 [1:10:20<43:08,  1.63it/s]
 62%|██████▏   | 6831/11049 [1:10:20<43:07,  1.63it/s]
                                                      
{'loss': 0.2186, 'grad_norm': 0.531614363193512, 'learning_rate': 3.820181938816912e-06, 'epoch': 1.85}

 62%|██████▏   | 6831/11049 [1:10:20<43:07,  1.63it/s]
 62%|██████▏   | 6832/11049 [1:10:21<43:07,  1.63it/s]
                                                      
{'loss': 0.2577, 'grad_norm': 0.6170182824134827, 'learning_rate': 3.818646961509316e-06, 'epoch': 1.86}

 62%|██████▏   | 6832/11049 [1:10:21<43:07,  1.63it/s]
 62%|██████▏   | 6833/11049 [1:10:21<43:07,  1.63it/s]
                                                      
{'loss': 0.1574, 'grad_norm': 0.48178955912590027, 'learning_rate': 3.817112102113506e-06, 'epoch': 1.86}

 62%|██████▏   | 6833/11049 [1:10:22<43:07,  1.63it/s]
 62%|██████▏   | 6834/11049 [1:10:22<43:06,  1.63it/s]
                                                      
{'loss': 0.2152, 'grad_norm': 0.5992341041564941, 'learning_rate': 3.815577360782677e-06, 'epoch': 1.86}

 62%|██████▏   | 6834/11049 [1:10:22<43:06,  1.63it/s]
 62%|██████▏   | 6835/11049 [1:10:23<43:05,  1.63it/s]
                                                      
{'loss': 0.152, 'grad_norm': 0.4424629509449005, 'learning_rate': 3.8140427376700113e-06, 'epoch': 1.86}

 62%|██████▏   | 6835/11049 [1:10:23<43:05,  1.63it/s]
 62%|██████▏   | 6836/11049 [1:10:23<43:04,  1.63it/s]
                                                      
{'loss': 0.1875, 'grad_norm': 0.56538325548172, 'learning_rate': 3.8125082329286807e-06, 'epoch': 1.86}

 62%|██████▏   | 6836/11049 [1:10:23<43:04,  1.63it/s]
 62%|██████▏   | 6837/11049 [1:10:24<43:03,  1.63it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.5693559646606445, 'learning_rate': 3.810973846711847e-06, 'epoch': 1.86}

 62%|██████▏   | 6837/11049 [1:10:24<43:03,  1.63it/s]
 62%|██████▏   | 6838/11049 [1:10:25<43:03,  1.63it/s]
                                                      
{'loss': 0.1937, 'grad_norm': 0.5058704614639282, 'learning_rate': 3.809439579172658e-06, 'epoch': 1.86}

 62%|██████▏   | 6838/11049 [1:10:25<43:03,  1.63it/s]
 62%|██████▏   | 6839/11049 [1:10:25<43:07,  1.63it/s]
                                                      
{'loss': 0.3077, 'grad_norm': 0.7998045682907104, 'learning_rate': 3.8079054304642503e-06, 'epoch': 1.86}

 62%|██████▏   | 6839/11049 [1:10:25<43:07,  1.63it/s]
 62%|██████▏   | 6840/11049 [1:10:26<43:00,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.54071044921875, 'learning_rate': 3.8063714007397466e-06, 'epoch': 1.86}

 62%|██████▏   | 6840/11049 [1:10:26<43:00,  1.63it/s]
 62%|██████▏   | 6841/11049 [1:10:26<43:00,  1.63it/s]
                                                      
{'loss': 0.19, 'grad_norm': 0.5197923183441162, 'learning_rate': 3.804837490152262e-06, 'epoch': 1.86}

 62%|██████▏   | 6841/11049 [1:10:27<43:00,  1.63it/s]
 62%|██████▏   | 6842/11049 [1:10:27<42:59,  1.63it/s]
                                                      
{'loss': 0.1714, 'grad_norm': 0.45939990878105164, 'learning_rate': 3.803303698854898e-06, 'epoch': 1.86}

 62%|██████▏   | 6842/11049 [1:10:27<42:59,  1.63it/s]
 62%|██████▏   | 6843/11049 [1:10:28<42:58,  1.63it/s]
                                                      
{'loss': 0.2464, 'grad_norm': 0.5916420817375183, 'learning_rate': 3.8017700270007403e-06, 'epoch': 1.86}

 62%|██████▏   | 6843/11049 [1:10:28<42:58,  1.63it/s]
 62%|██████▏   | 6844/11049 [1:10:28<42:58,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.5714649558067322, 'learning_rate': 3.800236474742866e-06, 'epoch': 1.86}

 62%|██████▏   | 6844/11049 [1:10:28<42:58,  1.63it/s]
 62%|██████▏   | 6845/11049 [1:10:29<43:00,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.5351139903068542, 'learning_rate': 3.798703042234345e-06, 'epoch': 1.86}

 62%|██████▏   | 6845/11049 [1:10:29<43:00,  1.63it/s]
 62%|██████▏   | 6846/11049 [1:10:29<43:00,  1.63it/s]
                                                      
{'loss': 0.1911, 'grad_norm': 0.5734145641326904, 'learning_rate': 3.797169729628226e-06, 'epoch': 1.86}

 62%|██████▏   | 6846/11049 [1:10:30<43:00,  1.63it/s]
 62%|██████▏   | 6847/11049 [1:10:30<42:59,  1.63it/s]
                                                      
{'loss': 0.3334, 'grad_norm': 0.5248881578445435, 'learning_rate': 3.7956365370775522e-06, 'epoch': 1.86}

 62%|██████▏   | 6847/11049 [1:10:30<42:59,  1.63it/s]
 62%|██████▏   | 6848/11049 [1:10:31<42:58,  1.63it/s]
                                                      
{'loss': 0.1901, 'grad_norm': 0.5408300757408142, 'learning_rate': 3.794103464735349e-06, 'epoch': 1.86}

 62%|██████▏   | 6848/11049 [1:10:31<42:58,  1.63it/s]
 62%|██████▏   | 6849/11049 [1:10:31<42:56,  1.63it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.5526792407035828, 'learning_rate': 3.7925705127546387e-06, 'epoch': 1.86}

 62%|██████▏   | 6849/11049 [1:10:31<42:56,  1.63it/s]
 62%|██████▏   | 6850/11049 [1:10:32<42:54,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.5636833906173706, 'learning_rate': 3.7910376812884253e-06, 'epoch': 1.86}

 62%|██████▏   | 6850/11049 [1:10:32<42:54,  1.63it/s]
 62%|██████▏   | 6851/11049 [1:10:33<42:54,  1.63it/s]
                                                      
{'loss': 0.2097, 'grad_norm': 0.5619655847549438, 'learning_rate': 3.7895049704897e-06, 'epoch': 1.86}

 62%|██████▏   | 6851/11049 [1:10:33<42:54,  1.63it/s]
 62%|██████▏   | 6852/11049 [1:10:33<42:54,  1.63it/s]
                                                      
{'loss': 0.2597, 'grad_norm': 0.6292957663536072, 'learning_rate': 3.7879723805114425e-06, 'epoch': 1.86}

 62%|██████▏   | 6852/11049 [1:10:33<42:54,  1.63it/s]
 62%|██████▏   | 6853/11049 [1:10:34<43:02,  1.62it/s]
                                                      
{'loss': 0.166, 'grad_norm': 0.5345634818077087, 'learning_rate': 3.7864399115066264e-06, 'epoch': 1.86}

 62%|██████▏   | 6853/11049 [1:10:34<43:02,  1.62it/s]
 62%|██████▏   | 6854/11049 [1:10:34<42:58,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.47082918882369995, 'learning_rate': 3.784907563628206e-06, 'epoch': 1.86}

 62%|██████▏   | 6854/11049 [1:10:35<42:58,  1.63it/s]
 62%|██████▏   | 6855/11049 [1:10:35<42:55,  1.63it/s]
                                                      
{'loss': 0.1641, 'grad_norm': 0.4897073805332184, 'learning_rate': 3.7833753370291276e-06, 'epoch': 1.86}

 62%|██████▏   | 6855/11049 [1:10:35<42:55,  1.63it/s]
 62%|██████▏   | 6856/11049 [1:10:36<42:54,  1.63it/s]
                                                      
{'loss': 0.225, 'grad_norm': 0.8832391500473022, 'learning_rate': 3.78184323186232e-06, 'epoch': 1.86}

 62%|██████▏   | 6856/11049 [1:10:36<42:54,  1.63it/s]
 62%|██████▏   | 6857/11049 [1:10:36<42:53,  1.63it/s]
                                                      
{'loss': 0.2305, 'grad_norm': 0.5871967077255249, 'learning_rate': 3.780311248280708e-06, 'epoch': 1.86}

 62%|██████▏   | 6857/11049 [1:10:36<42:53,  1.63it/s]
 62%|██████▏   | 6858/11049 [1:10:37<42:52,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.43943217396736145, 'learning_rate': 3.778779386437199e-06, 'epoch': 1.86}

 62%|██████▏   | 6858/11049 [1:10:37<42:52,  1.63it/s]
 62%|██████▏   | 6859/11049 [1:10:37<42:52,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5070483088493347, 'learning_rate': 3.7772476464846895e-06, 'epoch': 1.86}

 62%|██████▏   | 6859/11049 [1:10:38<42:52,  1.63it/s]
 62%|██████▏   | 6860/11049 [1:10:38<42:52,  1.63it/s]
                                                      
{'loss': 0.232, 'grad_norm': 0.6097117066383362, 'learning_rate': 3.7757160285760623e-06, 'epoch': 1.86}

 62%|██████▏   | 6860/11049 [1:10:38<42:52,  1.63it/s]
 62%|██████▏   | 6861/11049 [1:10:39<42:52,  1.63it/s]
                                                      
{'loss': 0.255, 'grad_norm': 0.5973337292671204, 'learning_rate': 3.7741845328641913e-06, 'epoch': 1.86}

 62%|██████▏   | 6861/11049 [1:10:39<42:52,  1.63it/s]
 62%|██████▏   | 6862/11049 [1:10:39<42:50,  1.63it/s]
                                                      
{'loss': 0.1534, 'grad_norm': 0.44990411400794983, 'learning_rate': 3.7726531595019355e-06, 'epoch': 1.86}

 62%|██████▏   | 6862/11049 [1:10:39<42:50,  1.63it/s]
 62%|██████▏   | 6863/11049 [1:10:40<42:48,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.483676940202713, 'learning_rate': 3.771121908642142e-06, 'epoch': 1.86}

 62%|██████▏   | 6863/11049 [1:10:40<42:48,  1.63it/s]
 62%|██████▏   | 6864/11049 [1:10:41<42:49,  1.63it/s]
                                                      
{'loss': 0.1968, 'grad_norm': 0.5356450080871582, 'learning_rate': 3.7695907804376457e-06, 'epoch': 1.86}

 62%|██████▏   | 6864/11049 [1:10:41<42:49,  1.63it/s]
 62%|██████▏   | 6865/11049 [1:10:41<42:47,  1.63it/s]
                                                      
{'loss': 0.1604, 'grad_norm': 0.4864186942577362, 'learning_rate': 3.7680597750412715e-06, 'epoch': 1.86}

 62%|██████▏   | 6865/11049 [1:10:41<42:47,  1.63it/s]
 62%|██████▏   | 6866/11049 [1:10:42<42:49,  1.63it/s]
                                                      
{'loss': 0.2389, 'grad_norm': 0.634505033493042, 'learning_rate': 3.7665288926058298e-06, 'epoch': 1.86}

 62%|██████▏   | 6866/11049 [1:10:42<42:49,  1.63it/s]
 62%|██████▏   | 6867/11049 [1:10:42<42:46,  1.63it/s]
                                                      
{'loss': 0.2147, 'grad_norm': 0.778144359588623, 'learning_rate': 3.7649981332841184e-06, 'epoch': 1.86}

 62%|██████▏   | 6867/11049 [1:10:42<42:46,  1.63it/s]
 62%|██████▏   | 6868/11049 [1:10:43<42:45,  1.63it/s]
                                                      
{'loss': 0.2367, 'grad_norm': 0.6422592997550964, 'learning_rate': 3.7634674972289227e-06, 'epoch': 1.86}

 62%|██████▏   | 6868/11049 [1:10:43<42:45,  1.63it/s]
 62%|██████▏   | 6869/11049 [1:10:44<42:44,  1.63it/s]
                                                      
{'loss': 0.1572, 'grad_norm': 0.5064999461174011, 'learning_rate': 3.7619369845930195e-06, 'epoch': 1.87}

 62%|██████▏   | 6869/11049 [1:10:44<42:44,  1.63it/s]
 62%|██████▏   | 6870/11049 [1:10:44<42:44,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.5801289081573486, 'learning_rate': 3.760406595529168e-06, 'epoch': 1.87}

 62%|██████▏   | 6870/11049 [1:10:44<42:44,  1.63it/s]
 62%|██████▏   | 6871/11049 [1:10:45<42:46,  1.63it/s]
                                                      
{'loss': 0.2124, 'grad_norm': 0.5657845139503479, 'learning_rate': 3.7588763301901195e-06, 'epoch': 1.87}

 62%|██████▏   | 6871/11049 [1:10:45<42:46,  1.63it/s]
 62%|██████▏   | 6872/11049 [1:10:45<42:45,  1.63it/s]
                                                      
{'loss': 0.2053, 'grad_norm': 0.5484669804573059, 'learning_rate': 3.7573461887286083e-06, 'epoch': 1.87}

 62%|██████▏   | 6872/11049 [1:10:46<42:45,  1.63it/s]
 62%|██████▏   | 6873/11049 [1:10:46<42:48,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.5814364552497864, 'learning_rate': 3.755816171297362e-06, 'epoch': 1.87}

 62%|██████▏   | 6873/11049 [1:10:46<42:48,  1.63it/s]
 62%|██████▏   | 6874/11049 [1:10:47<42:46,  1.63it/s]
                                                      
{'loss': 0.1999, 'grad_norm': 0.5557949542999268, 'learning_rate': 3.7542862780490913e-06, 'epoch': 1.87}

 62%|██████▏   | 6874/11049 [1:10:47<42:46,  1.63it/s]
 62%|██████▏   | 6875/11049 [1:10:47<42:46,  1.63it/s]
                                                      
{'loss': 0.1839, 'grad_norm': 0.4817996919155121, 'learning_rate': 3.7527565091364964e-06, 'epoch': 1.87}

 62%|██████▏   | 6875/11049 [1:10:47<42:46,  1.63it/s]
 62%|██████▏   | 6876/11049 [1:10:48<42:45,  1.63it/s]
                                                      
{'loss': 0.2487, 'grad_norm': 0.5483908653259277, 'learning_rate': 3.7512268647122635e-06, 'epoch': 1.87}

 62%|██████▏   | 6876/11049 [1:10:48<42:45,  1.63it/s]
 62%|██████▏   | 6877/11049 [1:10:49<42:44,  1.63it/s]
                                                      
{'loss': 0.2112, 'grad_norm': 0.6344693303108215, 'learning_rate': 3.7496973449290697e-06, 'epoch': 1.87}

 62%|██████▏   | 6877/11049 [1:10:49<42:44,  1.63it/s]
 62%|██████▏   | 6878/11049 [1:10:49<42:43,  1.63it/s]
                                                      
{'loss': 0.1553, 'grad_norm': 0.45839211344718933, 'learning_rate': 3.7481679499395773e-06, 'epoch': 1.87}

 62%|██████▏   | 6878/11049 [1:10:49<42:43,  1.63it/s]
 62%|██████▏   | 6879/11049 [1:10:50<42:41,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.45147037506103516, 'learning_rate': 3.746638679896435e-06, 'epoch': 1.87}

 62%|██████▏   | 6879/11049 [1:10:50<42:41,  1.63it/s]
 62%|██████▏   | 6880/11049 [1:10:50<42:39,  1.63it/s]
                                                      
{'loss': 0.1734, 'grad_norm': 0.4728984832763672, 'learning_rate': 3.7451095349522798e-06, 'epoch': 1.87}

 62%|██████▏   | 6880/11049 [1:10:50<42:39,  1.63it/s]
 62%|██████▏   | 6881/11049 [1:10:51<42:38,  1.63it/s]
                                                      
{'loss': 0.1673, 'grad_norm': 0.44311732053756714, 'learning_rate': 3.7435805152597416e-06, 'epoch': 1.87}

 62%|██████▏   | 6881/11049 [1:10:51<42:38,  1.63it/s]
 62%|██████▏   | 6882/11049 [1:10:52<42:37,  1.63it/s]
                                                      
{'loss': 0.2033, 'grad_norm': 0.5534987449645996, 'learning_rate': 3.742051620971428e-06, 'epoch': 1.87}

 62%|██████▏   | 6882/11049 [1:10:52<42:37,  1.63it/s]
 62%|██████▏   | 6883/11049 [1:10:52<42:35,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5296570658683777, 'learning_rate': 3.740522852239942e-06, 'epoch': 1.87}

 62%|██████▏   | 6883/11049 [1:10:52<42:35,  1.63it/s]
 62%|██████▏   | 6884/11049 [1:10:53<42:34,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.5488536953926086, 'learning_rate': 3.738994209217867e-06, 'epoch': 1.87}

 62%|██████▏   | 6884/11049 [1:10:53<42:34,  1.63it/s]
 62%|██████▏   | 6885/11049 [1:10:53<42:34,  1.63it/s]
                                                      
{'loss': 0.2166, 'grad_norm': 0.5588470697402954, 'learning_rate': 3.7374656920577836e-06, 'epoch': 1.87}

 62%|██████▏   | 6885/11049 [1:10:54<42:34,  1.63it/s]
 62%|██████▏   | 6886/11049 [1:10:54<42:33,  1.63it/s]
                                                      
{'loss': 0.1994, 'grad_norm': 0.5562009811401367, 'learning_rate': 3.735937300912253e-06, 'epoch': 1.87}

 62%|██████▏   | 6886/11049 [1:10:54<42:33,  1.63it/s]
 62%|██████▏   | 6887/11049 [1:10:55<42:33,  1.63it/s]
                                                      
{'loss': 0.1755, 'grad_norm': 0.46303823590278625, 'learning_rate': 3.734409035933823e-06, 'epoch': 1.87}

 62%|██████▏   | 6887/11049 [1:10:55<42:33,  1.63it/s]
 62%|██████▏   | 6888/11049 [1:10:55<42:31,  1.63it/s]
                                                      
{'loss': 0.2335, 'grad_norm': 0.6168208718299866, 'learning_rate': 3.7328808972750303e-06, 'epoch': 1.87}

 62%|██████▏   | 6888/11049 [1:10:55<42:31,  1.63it/s]
 62%|██████▏   | 6889/11049 [1:10:56<42:30,  1.63it/s]
                                                      
{'loss': 0.1661, 'grad_norm': 0.4948039948940277, 'learning_rate': 3.7313528850884028e-06, 'epoch': 1.87}

 62%|██████▏   | 6889/11049 [1:10:56<42:30,  1.63it/s]
 62%|██████▏   | 6890/11049 [1:10:56<42:30,  1.63it/s]
                                                      
{'loss': 0.1925, 'grad_norm': 0.5527050495147705, 'learning_rate': 3.7298249995264517e-06, 'epoch': 1.87}

 62%|██████▏   | 6890/11049 [1:10:57<42:30,  1.63it/s]
 62%|██████▏   | 6891/11049 [1:10:57<42:29,  1.63it/s]
                                                      
{'loss': 0.1702, 'grad_norm': 0.49135687947273254, 'learning_rate': 3.7282972407416774e-06, 'epoch': 1.87}

 62%|██████▏   | 6891/11049 [1:10:57<42:29,  1.63it/s]
 62%|██████▏   | 6892/11049 [1:10:58<42:28,  1.63it/s]
                                                      
{'loss': 0.1729, 'grad_norm': 0.5231639742851257, 'learning_rate': 3.7267696088865613e-06, 'epoch': 1.87}

 62%|██████▏   | 6892/11049 [1:10:58<42:28,  1.63it/s]
 62%|██████▏   | 6893/11049 [1:10:58<42:28,  1.63it/s]
                                                      
{'loss': 0.167, 'grad_norm': 0.4710407257080078, 'learning_rate': 3.725242104113584e-06, 'epoch': 1.87}

 62%|██████▏   | 6893/11049 [1:10:58<42:28,  1.63it/s]
 62%|██████▏   | 6894/11049 [1:10:59<42:28,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.5720656514167786, 'learning_rate': 3.723714726575204e-06, 'epoch': 1.87}

 62%|██████▏   | 6894/11049 [1:10:59<42:28,  1.63it/s]
 62%|██████▏   | 6895/11049 [1:11:00<42:27,  1.63it/s]
                                                      
{'loss': 0.1973, 'grad_norm': 0.5331541895866394, 'learning_rate': 3.722187476423871e-06, 'epoch': 1.87}

 62%|██████▏   | 6895/11049 [1:11:00<42:27,  1.63it/s]
 62%|██████▏   | 6896/11049 [1:11:00<42:26,  1.63it/s]
                                                      
{'loss': 0.2203, 'grad_norm': 0.5903019309043884, 'learning_rate': 3.7206603538120194e-06, 'epoch': 1.87}

 62%|██████▏   | 6896/11049 [1:11:00<42:26,  1.63it/s]
 62%|██████▏   | 6897/11049 [1:11:01<42:26,  1.63it/s]
                                                      
{'loss': 0.1465, 'grad_norm': 0.4901302456855774, 'learning_rate': 3.7191333588920745e-06, 'epoch': 1.87}

 62%|██████▏   | 6897/11049 [1:11:01<42:26,  1.63it/s]
 62%|██████▏   | 6898/11049 [1:11:01<42:25,  1.63it/s]
                                                      
{'loss': 0.1691, 'grad_norm': 0.44556131958961487, 'learning_rate': 3.7176064918164467e-06, 'epoch': 1.87}

 62%|██████▏   | 6898/11049 [1:11:02<42:25,  1.63it/s]
 62%|██████▏   | 6899/11049 [1:11:02<42:25,  1.63it/s]
                                                      
{'loss': 0.2094, 'grad_norm': 0.6182780265808105, 'learning_rate': 3.7160797527375325e-06, 'epoch': 1.87}

 62%|██████▏   | 6899/11049 [1:11:02<42:25,  1.63it/s]
 62%|██████▏   | 6900/11049 [1:11:03<42:25,  1.63it/s]
                                                      
{'loss': 0.2363, 'grad_norm': 0.6470573544502258, 'learning_rate': 3.7145531418077176e-06, 'epoch': 1.87}

 62%|██████▏   | 6900/11049 [1:11:03<42:25,  1.63it/s]
 62%|██████▏   | 6901/11049 [1:11:03<42:23,  1.63it/s]
                                                      
{'loss': 0.2428, 'grad_norm': 0.5454068779945374, 'learning_rate': 3.713026659179374e-06, 'epoch': 1.87}

 62%|██████▏   | 6901/11049 [1:11:03<42:23,  1.63it/s]
 62%|██████▏   | 6902/11049 [1:11:04<42:23,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.5550706386566162, 'learning_rate': 3.7115003050048625e-06, 'epoch': 1.87}

 62%|██████▏   | 6902/11049 [1:11:04<42:23,  1.63it/s]
 62%|██████▏   | 6903/11049 [1:11:04<42:27,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.46194666624069214, 'learning_rate': 3.709974079436528e-06, 'epoch': 1.87}

 62%|██████▏   | 6903/11049 [1:11:05<42:27,  1.63it/s]
 62%|██████▏   | 6904/11049 [1:11:05<42:24,  1.63it/s]
                                                      
{'loss': 0.1992, 'grad_norm': 0.5680292248725891, 'learning_rate': 3.7084479826267037e-06, 'epoch': 1.87}

 62%|██████▏   | 6904/11049 [1:11:05<42:24,  1.63it/s]
 62%|██████▏   | 6905/11049 [1:11:06<42:22,  1.63it/s]
                                                      
{'loss': 0.1922, 'grad_norm': 0.5101973414421082, 'learning_rate': 3.706922014727714e-06, 'epoch': 1.87}

 62%|██████▏   | 6905/11049 [1:11:06<42:22,  1.63it/s]
 63%|██████▎   | 6906/11049 [1:11:06<42:20,  1.63it/s]
                                                      
{'loss': 0.2415, 'grad_norm': 0.6157460808753967, 'learning_rate': 3.7053961758918634e-06, 'epoch': 1.88}

 63%|██████▎   | 6906/11049 [1:11:06<42:20,  1.63it/s]
 63%|██████▎   | 6907/11049 [1:11:07<42:19,  1.63it/s]
                                                      
{'loss': 0.2054, 'grad_norm': 0.521205484867096, 'learning_rate': 3.703870466271449e-06, 'epoch': 1.88}

 63%|██████▎   | 6907/11049 [1:11:07<42:19,  1.63it/s]
 63%|██████▎   | 6908/11049 [1:11:08<42:19,  1.63it/s]
                                                      
{'loss': 0.2109, 'grad_norm': 0.5521105527877808, 'learning_rate': 3.7023448860187517e-06, 'epoch': 1.88}

 63%|██████▎   | 6908/11049 [1:11:08<42:19,  1.63it/s]
 63%|██████▎   | 6909/11049 [1:11:08<42:18,  1.63it/s]
                                                      
{'loss': 0.1591, 'grad_norm': 0.47632840275764465, 'learning_rate': 3.7008194352860427e-06, 'epoch': 1.88}

 63%|██████▎   | 6909/11049 [1:11:08<42:18,  1.63it/s]
 63%|██████▎   | 6910/11049 [1:11:09<42:17,  1.63it/s]
                                                      
{'loss': 0.1786, 'grad_norm': 0.5008596181869507, 'learning_rate': 3.6992941142255767e-06, 'epoch': 1.88}

 63%|██████▎   | 6910/11049 [1:11:09<42:17,  1.63it/s]
 63%|██████▎   | 6911/11049 [1:11:09<42:17,  1.63it/s]
                                                      
{'loss': 0.194, 'grad_norm': 0.5167874097824097, 'learning_rate': 3.6977689229895984e-06, 'epoch': 1.88}

 63%|██████▎   | 6911/11049 [1:11:09<42:17,  1.63it/s]
 63%|██████▎   | 6912/11049 [1:11:10<42:17,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.5351163148880005, 'learning_rate': 3.6962438617303377e-06, 'epoch': 1.88}

 63%|██████▎   | 6912/11049 [1:11:10<42:17,  1.63it/s]
 63%|██████▎   | 6913/11049 [1:11:11<42:17,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.5343595147132874, 'learning_rate': 3.694718930600012e-06, 'epoch': 1.88}

 63%|██████▎   | 6913/11049 [1:11:11<42:17,  1.63it/s]
 63%|██████▎   | 6914/11049 [1:11:11<42:18,  1.63it/s]
                                                      
{'loss': 0.3546, 'grad_norm': 0.7181580066680908, 'learning_rate': 3.6931941297508268e-06, 'epoch': 1.88}

 63%|██████▎   | 6914/11049 [1:11:11<42:18,  1.63it/s]
 63%|██████▎   | 6915/11049 [1:11:12<42:17,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.5621857047080994, 'learning_rate': 3.691669459334973e-06, 'epoch': 1.88}

 63%|██████▎   | 6915/11049 [1:11:12<42:17,  1.63it/s]
 63%|██████▎   | 6916/11049 [1:11:12<42:17,  1.63it/s]
                                                      
{'loss': 0.2442, 'grad_norm': 0.6649837493896484, 'learning_rate': 3.690144919504628e-06, 'epoch': 1.88}

 63%|██████▎   | 6916/11049 [1:11:13<42:17,  1.63it/s]
 63%|██████▎   | 6917/11049 [1:11:13<42:14,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.5313088893890381, 'learning_rate': 3.688620510411961e-06, 'epoch': 1.88}

 63%|██████▎   | 6917/11049 [1:11:13<42:14,  1.63it/s]
 63%|██████▎   | 6918/11049 [1:11:14<42:15,  1.63it/s]
                                                      
{'loss': 0.259, 'grad_norm': 0.5930046439170837, 'learning_rate': 3.6870962322091207e-06, 'epoch': 1.88}

 63%|██████▎   | 6918/11049 [1:11:14<42:15,  1.63it/s]
 63%|██████▎   | 6919/11049 [1:11:14<42:13,  1.63it/s]
                                                      
{'loss': 0.1563, 'grad_norm': 0.49152305722236633, 'learning_rate': 3.685572085048249e-06, 'epoch': 1.88}

 63%|██████▎   | 6919/11049 [1:11:14<42:13,  1.63it/s]
 63%|██████▎   | 6920/11049 [1:11:15<42:12,  1.63it/s]
                                                      
{'loss': 0.1807, 'grad_norm': 0.5108211636543274, 'learning_rate': 3.6840480690814685e-06, 'epoch': 1.88}

 63%|██████▎   | 6920/11049 [1:11:15<42:12,  1.63it/s]
 63%|██████▎   | 6921/11049 [1:11:15<42:12,  1.63it/s]
                                                      
{'loss': 0.2353, 'grad_norm': 0.5813350081443787, 'learning_rate': 3.6825241844608973e-06, 'epoch': 1.88}

 63%|██████▎   | 6921/11049 [1:11:16<42:12,  1.63it/s]
 63%|██████▎   | 6922/11049 [1:11:16<42:11,  1.63it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.6352968811988831, 'learning_rate': 3.6810004313386344e-06, 'epoch': 1.88}

 63%|██████▎   | 6922/11049 [1:11:16<42:11,  1.63it/s]
 63%|██████▎   | 6923/11049 [1:11:17<42:11,  1.63it/s]
                                                      
{'loss': 0.2295, 'grad_norm': 0.6295496225357056, 'learning_rate': 3.6794768098667643e-06, 'epoch': 1.88}

 63%|██████▎   | 6923/11049 [1:11:17<42:11,  1.63it/s]
 63%|██████▎   | 6924/11049 [1:11:17<42:09,  1.63it/s]
                                                      
{'loss': 0.281, 'grad_norm': 0.6911706924438477, 'learning_rate': 3.6779533201973606e-06, 'epoch': 1.88}

 63%|██████▎   | 6924/11049 [1:11:17<42:09,  1.63it/s]
 63%|██████▎   | 6925/11049 [1:11:18<42:08,  1.63it/s]
                                                      
{'loss': 0.2212, 'grad_norm': 0.5893959403038025, 'learning_rate': 3.676429962482488e-06, 'epoch': 1.88}

 63%|██████▎   | 6925/11049 [1:11:18<42:08,  1.63it/s]
 63%|██████▎   | 6926/11049 [1:11:19<42:07,  1.63it/s]
                                                      
{'loss': 0.2835, 'grad_norm': 0.6248832941055298, 'learning_rate': 3.674906736874192e-06, 'epoch': 1.88}

 63%|██████▎   | 6926/11049 [1:11:19<42:07,  1.63it/s]
 63%|██████▎   | 6927/11049 [1:11:19<42:07,  1.63it/s]
                                                      
{'loss': 0.1941, 'grad_norm': 0.5384491086006165, 'learning_rate': 3.6733836435245073e-06, 'epoch': 1.88}

 63%|██████▎   | 6927/11049 [1:11:19<42:07,  1.63it/s]
 63%|██████▎   | 6928/11049 [1:11:20<42:07,  1.63it/s]
                                                      
{'loss': 0.1664, 'grad_norm': 0.4294579029083252, 'learning_rate': 3.671860682585451e-06, 'epoch': 1.88}

 63%|██████▎   | 6928/11049 [1:11:20<42:07,  1.63it/s]
 63%|██████▎   | 6929/11049 [1:11:20<42:06,  1.63it/s]
                                                      
{'loss': 0.1991, 'grad_norm': 0.5610736012458801, 'learning_rate': 3.6703378542090373e-06, 'epoch': 1.88}

 63%|██████▎   | 6929/11049 [1:11:21<42:06,  1.63it/s]
 63%|██████▎   | 6930/11049 [1:11:21<42:05,  1.63it/s]
                                                      
{'loss': 0.1571, 'grad_norm': 0.5087662935256958, 'learning_rate': 3.6688151585472575e-06, 'epoch': 1.88}

 63%|██████▎   | 6930/11049 [1:11:21<42:05,  1.63it/s]
 63%|██████▎   | 6931/11049 [1:11:22<42:03,  1.63it/s]
                                                      
{'loss': 0.2481, 'grad_norm': 0.6054145097732544, 'learning_rate': 3.6672925957520945e-06, 'epoch': 1.88}

 63%|██████▎   | 6931/11049 [1:11:22<42:03,  1.63it/s]
 63%|██████▎   | 6932/11049 [1:11:22<42:03,  1.63it/s]
                                                      
{'loss': 0.1348, 'grad_norm': 0.4130357801914215, 'learning_rate': 3.665770165975514e-06, 'epoch': 1.88}

 63%|██████▎   | 6932/11049 [1:11:22<42:03,  1.63it/s]
 63%|██████▎   | 6933/11049 [1:11:23<42:03,  1.63it/s]
                                                      
{'loss': 0.242, 'grad_norm': 0.6229130625724792, 'learning_rate': 3.664247869369474e-06, 'epoch': 1.88}

 63%|██████▎   | 6933/11049 [1:11:23<42:03,  1.63it/s]
 63%|██████▎   | 6934/11049 [1:11:23<42:03,  1.63it/s]
                                                      
{'loss': 0.1442, 'grad_norm': 0.4143443703651428, 'learning_rate': 3.6627257060859145e-06, 'epoch': 1.88}

 63%|██████▎   | 6934/11049 [1:11:24<42:03,  1.63it/s]
 63%|██████▎   | 6935/11049 [1:11:24<42:02,  1.63it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.5900662541389465, 'learning_rate': 3.6612036762767646e-06, 'epoch': 1.88}

 63%|██████▎   | 6935/11049 [1:11:24<42:02,  1.63it/s]
 63%|██████▎   | 6936/11049 [1:11:25<42:02,  1.63it/s]
                                                      
{'loss': 0.1694, 'grad_norm': 0.5321640968322754, 'learning_rate': 3.6596817800939375e-06, 'epoch': 1.88}

 63%|██████▎   | 6936/11049 [1:11:25<42:02,  1.63it/s]
 63%|██████▎   | 6937/11049 [1:11:25<42:02,  1.63it/s]
                                                      
{'loss': 0.26, 'grad_norm': 0.6057809591293335, 'learning_rate': 3.658160017689337e-06, 'epoch': 1.88}

 63%|██████▎   | 6937/11049 [1:11:25<42:02,  1.63it/s]
 63%|██████▎   | 6938/11049 [1:11:26<42:01,  1.63it/s]
                                                      
{'loss': 0.196, 'grad_norm': 0.5544020533561707, 'learning_rate': 3.656638389214851e-06, 'epoch': 1.88}

 63%|██████▎   | 6938/11049 [1:11:26<42:01,  1.63it/s]
 63%|██████▎   | 6939/11049 [1:11:27<42:00,  1.63it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.5148552656173706, 'learning_rate': 3.655116894822354e-06, 'epoch': 1.88}

 63%|██████▎   | 6939/11049 [1:11:27<42:00,  1.63it/s]
 63%|██████▎   | 6940/11049 [1:11:27<42:01,  1.63it/s]
                                                      
{'loss': 0.217, 'grad_norm': 0.5556373596191406, 'learning_rate': 3.6535955346637064e-06, 'epoch': 1.88}

 63%|██████▎   | 6940/11049 [1:11:27<42:01,  1.63it/s]
 63%|██████▎   | 6941/11049 [1:11:28<41:59,  1.63it/s]
                                                      
{'loss': 0.2359, 'grad_norm': 0.594266951084137, 'learning_rate': 3.6520743088907586e-06, 'epoch': 1.88}

 63%|██████▎   | 6941/11049 [1:11:28<41:59,  1.63it/s]
 63%|██████▎   | 6942/11049 [1:11:28<41:59,  1.63it/s]
                                                      
{'loss': 0.2578, 'grad_norm': 0.9774084091186523, 'learning_rate': 3.6505532176553437e-06, 'epoch': 1.88}

 63%|██████▎   | 6942/11049 [1:11:28<41:59,  1.63it/s]
 63%|██████▎   | 6943/11049 [1:11:29<41:57,  1.63it/s]
                                                      
{'loss': 0.1984, 'grad_norm': 0.5365277528762817, 'learning_rate': 3.6490322611092844e-06, 'epoch': 1.89}

 63%|██████▎   | 6943/11049 [1:11:29<41:57,  1.63it/s]
 63%|██████▎   | 6944/11049 [1:11:30<41:58,  1.63it/s]
                                                      
{'loss': 0.1969, 'grad_norm': 0.5572914481163025, 'learning_rate': 3.6475114394043866e-06, 'epoch': 1.89}

 63%|██████▎   | 6944/11049 [1:11:30<41:58,  1.63it/s]
 63%|██████▎   | 6945/11049 [1:11:30<41:57,  1.63it/s]
                                                      
{'loss': 0.2331, 'grad_norm': 0.6070790886878967, 'learning_rate': 3.6459907526924467e-06, 'epoch': 1.89}

 63%|██████▎   | 6945/11049 [1:11:30<41:57,  1.63it/s]
 63%|██████▎   | 6946/11049 [1:11:31<41:55,  1.63it/s]
                                                      
{'loss': 0.2114, 'grad_norm': 0.5924714803695679, 'learning_rate': 3.6444702011252455e-06, 'epoch': 1.89}

 63%|██████▎   | 6946/11049 [1:11:31<41:55,  1.63it/s]
 63%|██████▎   | 6947/11049 [1:11:31<41:55,  1.63it/s]
                                                      
{'loss': 0.1978, 'grad_norm': 0.47936156392097473, 'learning_rate': 3.642949784854549e-06, 'epoch': 1.89}

 63%|██████▎   | 6947/11049 [1:11:32<41:55,  1.63it/s]
 63%|██████▎   | 6948/11049 [1:11:32<41:54,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.5590742230415344, 'learning_rate': 3.6414295040321113e-06, 'epoch': 1.89}

 63%|██████▎   | 6948/11049 [1:11:32<41:54,  1.63it/s]
 63%|██████▎   | 6949/11049 [1:11:33<41:55,  1.63it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.5886721611022949, 'learning_rate': 3.6399093588096745e-06, 'epoch': 1.89}

 63%|██████▎   | 6949/11049 [1:11:33<41:55,  1.63it/s]
 63%|██████▎   | 6950/11049 [1:11:33<41:51,  1.63it/s]
                                                      
{'loss': 0.1716, 'grad_norm': 0.559122622013092, 'learning_rate': 3.6383893493389648e-06, 'epoch': 1.89}

 63%|██████▎   | 6950/11049 [1:11:33<41:51,  1.63it/s]
 63%|██████▎   | 6951/11049 [1:11:34<41:51,  1.63it/s]
                                                      
{'loss': 0.301, 'grad_norm': 0.6145712733268738, 'learning_rate': 3.636869475771695e-06, 'epoch': 1.89}

 63%|██████▎   | 6951/11049 [1:11:34<41:51,  1.63it/s]
 63%|██████▎   | 6952/11049 [1:11:35<41:52,  1.63it/s]
                                                      
{'loss': 0.2067, 'grad_norm': 0.517124593257904, 'learning_rate': 3.635349738259564e-06, 'epoch': 1.89}

 63%|██████▎   | 6952/11049 [1:11:35<41:52,  1.63it/s]
 63%|██████▎   | 6953/11049 [1:11:35<41:51,  1.63it/s]
                                                      
{'loss': 0.2207, 'grad_norm': 0.639552116394043, 'learning_rate': 3.6338301369542604e-06, 'epoch': 1.89}

 63%|██████▎   | 6953/11049 [1:11:35<41:51,  1.63it/s]
 63%|██████▎   | 6954/11049 [1:11:36<41:51,  1.63it/s]
                                                      
{'loss': 0.1761, 'grad_norm': 0.5127758979797363, 'learning_rate': 3.6323106720074565e-06, 'epoch': 1.89}

 63%|██████▎   | 6954/11049 [1:11:36<41:51,  1.63it/s]
 63%|██████▎   | 6955/11049 [1:11:36<41:50,  1.63it/s]
                                                      
{'loss': 0.1931, 'grad_norm': 0.5866638422012329, 'learning_rate': 3.6307913435708097e-06, 'epoch': 1.89}

 63%|██████▎   | 6955/11049 [1:11:36<41:50,  1.63it/s]
 63%|██████▎   | 6956/11049 [1:11:37<41:50,  1.63it/s]
                                                      
{'loss': 0.1625, 'grad_norm': 0.46445798873901367, 'learning_rate': 3.6292721517959632e-06, 'epoch': 1.89}

 63%|██████▎   | 6956/11049 [1:11:37<41:50,  1.63it/s]
 63%|██████▎   | 6957/11049 [1:11:38<41:50,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.538733720779419, 'learning_rate': 3.6277530968345552e-06, 'epoch': 1.89}

 63%|██████▎   | 6957/11049 [1:11:38<41:50,  1.63it/s]
 63%|██████▎   | 6958/11049 [1:11:38<41:49,  1.63it/s]
                                                      
{'loss': 0.2216, 'grad_norm': 0.591060996055603, 'learning_rate': 3.6262341788382e-06, 'epoch': 1.89}

 63%|██████▎   | 6958/11049 [1:11:38<41:49,  1.63it/s]
 63%|██████▎   | 6959/11049 [1:11:39<41:48,  1.63it/s]
                                                      
{'loss': 0.2481, 'grad_norm': 0.6534940600395203, 'learning_rate': 3.6247153979585013e-06, 'epoch': 1.89}

 63%|██████▎   | 6959/11049 [1:11:39<41:48,  1.63it/s]
 63%|██████▎   | 6960/11049 [1:11:39<41:47,  1.63it/s]
                                                      
{'loss': 0.1837, 'grad_norm': 0.5357753038406372, 'learning_rate': 3.623196754347049e-06, 'epoch': 1.89}

 63%|██████▎   | 6960/11049 [1:11:40<41:47,  1.63it/s]
 63%|██████▎   | 6961/11049 [1:11:40<41:47,  1.63it/s]
                                                      
{'loss': 0.1637, 'grad_norm': 0.45103076100349426, 'learning_rate': 3.6216782481554236e-06, 'epoch': 1.89}

 63%|██████▎   | 6961/11049 [1:11:40<41:47,  1.63it/s]
 63%|██████▎   | 6962/11049 [1:11:41<41:47,  1.63it/s]
                                                      
{'loss': 0.2361, 'grad_norm': 0.6621672511100769, 'learning_rate': 3.6201598795351884e-06, 'epoch': 1.89}

 63%|██████▎   | 6962/11049 [1:11:41<41:47,  1.63it/s]
 63%|██████▎   | 6963/11049 [1:11:41<41:46,  1.63it/s]
                                                      
{'loss': 0.1512, 'grad_norm': 0.4817609488964081, 'learning_rate': 3.6186416486378893e-06, 'epoch': 1.89}

 63%|██████▎   | 6963/11049 [1:11:41<41:46,  1.63it/s]
 63%|██████▎   | 6964/11049 [1:11:42<41:45,  1.63it/s]
                                                      
{'loss': 0.2, 'grad_norm': 0.5426888465881348, 'learning_rate': 3.617123555615063e-06, 'epoch': 1.89}

 63%|██████▎   | 6964/11049 [1:11:42<41:45,  1.63it/s]
 63%|██████▎   | 6965/11049 [1:11:42<41:45,  1.63it/s]
                                                      
{'loss': 0.2475, 'grad_norm': 0.6438186168670654, 'learning_rate': 3.615605600618234e-06, 'epoch': 1.89}

 63%|██████▎   | 6965/11049 [1:11:43<41:45,  1.63it/s]
 63%|██████▎   | 6966/11049 [1:11:43<41:44,  1.63it/s]
                                                      
{'loss': 0.1828, 'grad_norm': 0.5162468552589417, 'learning_rate': 3.6140877837989097e-06, 'epoch': 1.89}

 63%|██████▎   | 6966/11049 [1:11:43<41:44,  1.63it/s]
 63%|██████▎   | 6967/11049 [1:11:44<41:43,  1.63it/s]
                                                      
{'loss': 0.3111, 'grad_norm': 0.7091826796531677, 'learning_rate': 3.612570105308585e-06, 'epoch': 1.89}

 63%|██████▎   | 6967/11049 [1:11:44<41:43,  1.63it/s]
 63%|██████▎   | 6968/11049 [1:11:44<41:42,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5941773056983948, 'learning_rate': 3.611052565298738e-06, 'epoch': 1.89}

 63%|██████▎   | 6968/11049 [1:11:44<41:42,  1.63it/s]
 63%|██████▎   | 6969/11049 [1:11:45<41:53,  1.62it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.5427427291870117, 'learning_rate': 3.609535163920836e-06, 'epoch': 1.89}

 63%|██████▎   | 6969/11049 [1:11:45<41:53,  1.62it/s]
 63%|██████▎   | 6970/11049 [1:11:46<41:49,  1.63it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.5062165260314941, 'learning_rate': 3.608017901326335e-06, 'epoch': 1.89}

 63%|██████▎   | 6970/11049 [1:11:46<41:49,  1.63it/s]
 63%|██████▎   | 6971/11049 [1:11:46<41:48,  1.63it/s]
                                                      
{'loss': 0.1854, 'grad_norm': 0.6253733038902283, 'learning_rate': 3.606500777666673e-06, 'epoch': 1.89}

 63%|██████▎   | 6971/11049 [1:11:46<41:48,  1.63it/s]
 63%|██████▎   | 6972/11049 [1:11:47<41:45,  1.63it/s]
                                                      
{'loss': 0.1972, 'grad_norm': 0.5695314407348633, 'learning_rate': 3.604983793093275e-06, 'epoch': 1.89}

 63%|██████▎   | 6972/11049 [1:11:47<41:45,  1.63it/s]
 63%|██████▎   | 6973/11049 [1:11:47<41:43,  1.63it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.6061853766441345, 'learning_rate': 3.6034669477575502e-06, 'epoch': 1.89}

 63%|██████▎   | 6973/11049 [1:11:48<41:43,  1.63it/s]
 63%|██████▎   | 6974/11049 [1:11:48<41:45,  1.63it/s]
                                                      
{'loss': 0.1833, 'grad_norm': 0.5309250950813293, 'learning_rate': 3.6019502418109e-06, 'epoch': 1.89}

 63%|██████▎   | 6974/11049 [1:11:48<41:45,  1.63it/s]
 63%|██████▎   | 6975/11049 [1:11:49<41:43,  1.63it/s]
                                                      
{'loss': 0.1831, 'grad_norm': 0.5132825374603271, 'learning_rate': 3.6004336754047057e-06, 'epoch': 1.89}

 63%|██████▎   | 6975/11049 [1:11:49<41:43,  1.63it/s]
 63%|██████▎   | 6976/11049 [1:11:49<41:40,  1.63it/s]
                                                      
{'loss': 0.1646, 'grad_norm': 0.46254855394363403, 'learning_rate': 3.598917248690338e-06, 'epoch': 1.89}

 63%|██████▎   | 6976/11049 [1:11:49<41:40,  1.63it/s]
 63%|██████▎   | 6977/11049 [1:11:50<41:39,  1.63it/s]
                                                      
{'loss': 0.2399, 'grad_norm': 1.4129408597946167, 'learning_rate': 3.5974009618191512e-06, 'epoch': 1.89}

 63%|██████▎   | 6977/11049 [1:11:50<41:39,  1.63it/s]
 63%|██████▎   | 6978/11049 [1:11:50<41:37,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.47995325922966003, 'learning_rate': 3.5958848149424892e-06, 'epoch': 1.89}

 63%|██████▎   | 6978/11049 [1:11:51<41:37,  1.63it/s]
 63%|██████▎   | 6979/11049 [1:11:51<41:40,  1.63it/s]
                                                      
{'loss': 0.1823, 'grad_norm': 0.5743545293807983, 'learning_rate': 3.5943688082116784e-06, 'epoch': 1.89}

 63%|██████▎   | 6979/11049 [1:11:51<41:40,  1.63it/s]
 63%|██████▎   | 6980/11049 [1:11:52<41:39,  1.63it/s]
                                                      
{'loss': 0.1887, 'grad_norm': 0.5539380311965942, 'learning_rate': 3.5928529417780334e-06, 'epoch': 1.9}

 63%|██████▎   | 6980/11049 [1:11:52<41:39,  1.63it/s]
 63%|██████▎   | 6981/11049 [1:11:52<41:38,  1.63it/s]
                                                      
{'loss': 0.2062, 'grad_norm': 0.47618216276168823, 'learning_rate': 3.5913372157928515e-06, 'epoch': 1.9}

 63%|██████▎   | 6981/11049 [1:11:52<41:38,  1.63it/s]
 63%|██████▎   | 6982/11049 [1:11:53<41:36,  1.63it/s]
                                                      
{'loss': 0.2513, 'grad_norm': 0.6830515265464783, 'learning_rate': 3.589821630407423e-06, 'epoch': 1.9}

 63%|██████▎   | 6982/11049 [1:11:53<41:36,  1.63it/s]
 63%|██████▎   | 6983/11049 [1:11:54<41:36,  1.63it/s]
                                                      
{'loss': 0.1955, 'grad_norm': 0.5967960953712463, 'learning_rate': 3.588306185773016e-06, 'epoch': 1.9}

 63%|██████▎   | 6983/11049 [1:11:54<41:36,  1.63it/s]
 63%|██████▎   | 6984/11049 [1:11:54<41:37,  1.63it/s]
                                                      
{'loss': 0.2125, 'grad_norm': 0.5400844216346741, 'learning_rate': 3.5867908820408904e-06, 'epoch': 1.9}

 63%|██████▎   | 6984/11049 [1:11:54<41:37,  1.63it/s]
 63%|██████▎   | 6985/11049 [1:11:55<41:36,  1.63it/s]
                                                      
{'loss': 0.1603, 'grad_norm': 0.41741228103637695, 'learning_rate': 3.5852757193622878e-06, 'epoch': 1.9}

 63%|██████▎   | 6985/11049 [1:11:55<41:36,  1.63it/s]
 63%|██████▎   | 6986/11049 [1:11:55<41:33,  1.63it/s]
                                                      
{'loss': 0.2125, 'grad_norm': 0.5645383596420288, 'learning_rate': 3.5837606978884397e-06, 'epoch': 1.9}

 63%|██████▎   | 6986/11049 [1:11:56<41:33,  1.63it/s]
 63%|██████▎   | 6987/11049 [1:11:56<41:32,  1.63it/s]
                                                      
{'loss': 0.2082, 'grad_norm': 0.5435958504676819, 'learning_rate': 3.582245817770561e-06, 'epoch': 1.9}

 63%|██████▎   | 6987/11049 [1:11:56<41:32,  1.63it/s]
 63%|██████▎   | 6988/11049 [1:11:57<41:31,  1.63it/s]
                                                      
{'loss': 0.2465, 'grad_norm': 0.6400089263916016, 'learning_rate': 3.5807310791598534e-06, 'epoch': 1.9}

 63%|██████▎   | 6988/11049 [1:11:57<41:31,  1.63it/s]
 63%|██████▎   | 6989/11049 [1:11:57<41:33,  1.63it/s]
                                                      
{'loss': 0.209, 'grad_norm': 0.5291807651519775, 'learning_rate': 3.579216482207502e-06, 'epoch': 1.9}

 63%|██████▎   | 6989/11049 [1:11:57<41:33,  1.63it/s]
 63%|██████▎   | 6990/11049 [1:11:58<41:31,  1.63it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.4944293797016144, 'learning_rate': 3.5777020270646827e-06, 'epoch': 1.9}

 63%|██████▎   | 6990/11049 [1:11:58<41:31,  1.63it/s]
 63%|██████▎   | 6991/11049 [1:11:58<41:32,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.6177921295166016, 'learning_rate': 3.576187713882554e-06, 'epoch': 1.9}

 63%|██████▎   | 6991/11049 [1:11:59<41:32,  1.63it/s]
 63%|██████▎   | 6992/11049 [1:11:59<41:31,  1.63it/s]
                                                      
{'loss': 0.1907, 'grad_norm': 0.5600747466087341, 'learning_rate': 3.574673542812259e-06, 'epoch': 1.9}

 63%|██████▎   | 6992/11049 [1:11:59<41:31,  1.63it/s]
 63%|██████▎   | 6993/11049 [1:12:00<41:29,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.5412001609802246, 'learning_rate': 3.5731595140049296e-06, 'epoch': 1.9}

 63%|██████▎   | 6993/11049 [1:12:00<41:29,  1.63it/s]
 63%|██████▎   | 6994/11049 [1:12:00<41:40,  1.62it/s]
                                                      
{'loss': 0.1595, 'grad_norm': 0.49519893527030945, 'learning_rate': 3.571645627611683e-06, 'epoch': 1.9}

 63%|██████▎   | 6994/11049 [1:12:00<41:40,  1.62it/s]
 63%|██████▎   | 6995/11049 [1:12:01<41:36,  1.62it/s]
                                                      
{'loss': 0.2173, 'grad_norm': 0.5188482403755188, 'learning_rate': 3.5701318837836195e-06, 'epoch': 1.9}

 63%|██████▎   | 6995/11049 [1:12:01<41:36,  1.62it/s]
 63%|██████▎   | 6996/11049 [1:12:02<41:32,  1.63it/s]
                                                      
{'loss': 0.1991, 'grad_norm': 0.565513014793396, 'learning_rate': 3.5686182826718285e-06, 'epoch': 1.9}

 63%|██████▎   | 6996/11049 [1:12:02<41:32,  1.63it/s]
 63%|██████▎   | 6997/11049 [1:12:02<41:29,  1.63it/s]
                                                      
{'loss': 0.1895, 'grad_norm': 0.5556217432022095, 'learning_rate': 3.5671048244273813e-06, 'epoch': 1.9}

 63%|██████▎   | 6997/11049 [1:12:02<41:29,  1.63it/s]
 63%|██████▎   | 6998/11049 [1:12:03<41:27,  1.63it/s]
                                                      
{'loss': 0.2379, 'grad_norm': 0.6520611047744751, 'learning_rate': 3.5655915092013425e-06, 'epoch': 1.9}

 63%|██████▎   | 6998/11049 [1:12:03<41:27,  1.63it/s]
 63%|██████▎   | 6999/11049 [1:12:03<41:27,  1.63it/s]
                                                      
{'loss': 0.192, 'grad_norm': 0.5191778540611267, 'learning_rate': 3.564078337144753e-06, 'epoch': 1.9}

 63%|██████▎   | 6999/11049 [1:12:03<41:27,  1.63it/s]
 63%|██████▎   | 7000/11049 [1:12:04<41:25,  1.63it/s]
                                                      
{'loss': 0.1724, 'grad_norm': 0.4920536279678345, 'learning_rate': 3.5625653084086446e-06, 'epoch': 1.9}

 63%|██████▎   | 7000/11049 [1:12:04<41:25,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.29it/s]

 31%|███       | 4/13 [00:00<00:01,  8.39it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.79it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.41it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.90it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.77it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]
                                                      

                                               
{'eval_loss': 0.5269536375999451, 'eval_runtime': 1.9549, 'eval_samples_per_second': 102.308, 'eval_steps_per_second': 6.65, 'epoch': 1.9}

 63%|██████▎   | 7000/11049 [1:12:06<41:25,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]

                                               
 63%|██████▎   | 7001/11049 [1:12:07<1:21:05,  1.20s/it]
                                                        
{'loss': 0.2514, 'grad_norm': 0.6845265626907349, 'learning_rate': 3.5610524231440324e-06, 'epoch': 1.9}

 63%|██████▎   | 7001/11049 [1:12:07<1:21:05,  1.20s/it]
 63%|██████▎   | 7002/11049 [1:12:07<1:09:08,  1.03s/it]
                                                        
{'loss': 0.189, 'grad_norm': 0.5089027881622314, 'learning_rate': 3.5595396815019223e-06, 'epoch': 1.9}

 63%|██████▎   | 7002/11049 [1:12:07<1:09:08,  1.03s/it]
 63%|██████▎   | 7003/11049 [1:12:08<1:00:47,  1.11it/s]
                                                        
{'loss': 0.2356, 'grad_norm': 0.6117540597915649, 'learning_rate': 3.5580270836333013e-06, 'epoch': 1.9}

 63%|██████▎   | 7003/11049 [1:12:08<1:00:47,  1.11it/s]
 63%|██████▎   | 7004/11049 [1:12:08<55:00,  1.23it/s]  
                                                      
{'loss': 0.1944, 'grad_norm': 0.5232873558998108, 'learning_rate': 3.556514629689141e-06, 'epoch': 1.9}

 63%|██████▎   | 7004/11049 [1:12:09<55:00,  1.23it/s]
 63%|██████▎   | 7005/11049 [1:12:09<50:53,  1.32it/s]
                                                      
{'loss': 0.1649, 'grad_norm': 0.44489628076553345, 'learning_rate': 3.5550023198203996e-06, 'epoch': 1.9}

 63%|██████▎   | 7005/11049 [1:12:09<50:53,  1.32it/s]
 63%|██████▎   | 7006/11049 [1:12:10<48:00,  1.40it/s]
                                                      
{'loss': 0.2224, 'grad_norm': 0.6248433589935303, 'learning_rate': 3.5534901541780264e-06, 'epoch': 1.9}

 63%|██████▎   | 7006/11049 [1:12:10<48:00,  1.40it/s]
 63%|██████▎   | 7007/11049 [1:12:10<45:58,  1.47it/s]
                                                      
{'loss': 0.1915, 'grad_norm': 0.5539447665214539, 'learning_rate': 3.551978132912949e-06, 'epoch': 1.9}

 63%|██████▎   | 7007/11049 [1:12:10<45:58,  1.47it/s]
 63%|██████▎   | 7008/11049 [1:12:11<44:34,  1.51it/s]
                                                      
{'loss': 0.1913, 'grad_norm': 0.5525948405265808, 'learning_rate': 3.550466256176085e-06, 'epoch': 1.9}

 63%|██████▎   | 7008/11049 [1:12:11<44:34,  1.51it/s]
 63%|██████▎   | 7009/11049 [1:12:11<43:38,  1.54it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.5212019681930542, 'learning_rate': 3.5489545241183322e-06, 'epoch': 1.9}

 63%|██████▎   | 7009/11049 [1:12:12<43:38,  1.54it/s]
 63%|██████▎   | 7010/11049 [1:12:12<42:55,  1.57it/s]
                                                      
{'loss': 0.1921, 'grad_norm': 0.5096714496612549, 'learning_rate': 3.5474429368905823e-06, 'epoch': 1.9}

 63%|██████▎   | 7010/11049 [1:12:12<42:55,  1.57it/s]
 63%|██████▎   | 7011/11049 [1:12:13<42:25,  1.59it/s]
                                                      
{'loss': 0.1333, 'grad_norm': 0.3896161913871765, 'learning_rate': 3.5459314946437064e-06, 'epoch': 1.9}

 63%|██████▎   | 7011/11049 [1:12:13<42:25,  1.59it/s]
 63%|██████▎   | 7012/11049 [1:12:13<42:04,  1.60it/s]
                                                      
{'loss': 0.2215, 'grad_norm': 0.5760306715965271, 'learning_rate': 3.544420197528562e-06, 'epoch': 1.9}

 63%|██████▎   | 7012/11049 [1:12:13<42:04,  1.60it/s]
 63%|██████▎   | 7013/11049 [1:12:14<41:49,  1.61it/s]
                                                      
{'loss': 0.2107, 'grad_norm': 0.5472895503044128, 'learning_rate': 3.542909045695993e-06, 'epoch': 1.9}

 63%|██████▎   | 7013/11049 [1:12:14<41:49,  1.61it/s]
 63%|██████▎   | 7014/11049 [1:12:15<41:40,  1.61it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.5606292486190796, 'learning_rate': 3.5413980392968294e-06, 'epoch': 1.9}

 63%|██████▎   | 7014/11049 [1:12:15<41:40,  1.61it/s]
 63%|██████▎   | 7015/11049 [1:12:15<41:32,  1.62it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.5067754983901978, 'learning_rate': 3.539887178481887e-06, 'epoch': 1.9}

 63%|██████▎   | 7015/11049 [1:12:15<41:32,  1.62it/s]
 63%|██████▎   | 7016/11049 [1:12:16<41:26,  1.62it/s]
                                                      
{'loss': 0.2462, 'grad_norm': 0.653522789478302, 'learning_rate': 3.5383764634019634e-06, 'epoch': 1.9}

 63%|██████▎   | 7016/11049 [1:12:16<41:26,  1.62it/s]
 64%|██████▎   | 7017/11049 [1:12:16<41:21,  1.62it/s]
                                                      
{'loss': 0.2081, 'grad_norm': 0.602746307849884, 'learning_rate': 3.536865894207845e-06, 'epoch': 1.91}

 64%|██████▎   | 7017/11049 [1:12:16<41:21,  1.62it/s]
 64%|██████▎   | 7018/11049 [1:12:17<41:17,  1.63it/s]
                                                      
{'loss': 0.2068, 'grad_norm': 0.5179393887519836, 'learning_rate': 3.5353554710503044e-06, 'epoch': 1.91}

 64%|██████▎   | 7018/11049 [1:12:17<41:17,  1.63it/s]
 64%|██████▎   | 7019/11049 [1:12:18<41:15,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5284842848777771, 'learning_rate': 3.5338451940800978e-06, 'epoch': 1.91}

 64%|██████▎   | 7019/11049 [1:12:18<41:15,  1.63it/s]
 64%|██████▎   | 7020/11049 [1:12:18<41:14,  1.63it/s]
                                                      
{'loss': 0.2228, 'grad_norm': 0.5246157646179199, 'learning_rate': 3.532335063447966e-06, 'epoch': 1.91}

 64%|██████▎   | 7020/11049 [1:12:18<41:14,  1.63it/s]
 64%|██████▎   | 7021/11049 [1:12:19<41:12,  1.63it/s]
                                                      
{'loss': 0.2451, 'grad_norm': 0.6025707125663757, 'learning_rate': 3.530825079304635e-06, 'epoch': 1.91}

 64%|██████▎   | 7021/11049 [1:12:19<41:12,  1.63it/s]
 64%|██████▎   | 7022/11049 [1:12:19<41:10,  1.63it/s]
                                                      
{'loss': 0.2406, 'grad_norm': 0.6270599961280823, 'learning_rate': 3.5293152418008213e-06, 'epoch': 1.91}

 64%|██████▎   | 7022/11049 [1:12:20<41:10,  1.63it/s]
 64%|██████▎   | 7023/11049 [1:12:20<41:10,  1.63it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.5385653376579285, 'learning_rate': 3.527805551087221e-06, 'epoch': 1.91}

 64%|██████▎   | 7023/11049 [1:12:20<41:10,  1.63it/s]
 64%|██████▎   | 7024/11049 [1:12:21<41:08,  1.63it/s]
                                                      
{'loss': 0.2031, 'grad_norm': 0.5921337008476257, 'learning_rate': 3.526296007314518e-06, 'epoch': 1.91}

 64%|██████▎   | 7024/11049 [1:12:21<41:08,  1.63it/s]
 64%|██████▎   | 7025/11049 [1:12:21<41:08,  1.63it/s]
                                                      
{'loss': 0.1935, 'grad_norm': 0.4974825978279114, 'learning_rate': 3.5247866106333795e-06, 'epoch': 1.91}

 64%|██████▎   | 7025/11049 [1:12:21<41:08,  1.63it/s]
 64%|██████▎   | 7026/11049 [1:12:22<41:06,  1.63it/s]
                                                      
{'loss': 0.2158, 'grad_norm': 0.5958000421524048, 'learning_rate': 3.5232773611944615e-06, 'epoch': 1.91}

 64%|██████▎   | 7026/11049 [1:12:22<41:06,  1.63it/s]
 64%|██████▎   | 7027/11049 [1:12:23<41:06,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.49344268441200256, 'learning_rate': 3.5217682591484028e-06, 'epoch': 1.91}

 64%|██████▎   | 7027/11049 [1:12:23<41:06,  1.63it/s]
 64%|██████▎   | 7028/11049 [1:12:23<41:05,  1.63it/s]
                                                      
{'loss': 0.2209, 'grad_norm': 0.564266562461853, 'learning_rate': 3.5202593046458272e-06, 'epoch': 1.91}

 64%|██████▎   | 7028/11049 [1:12:23<41:05,  1.63it/s]
 64%|██████▎   | 7029/11049 [1:12:24<41:05,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.539036214351654, 'learning_rate': 3.518750497837344e-06, 'epoch': 1.91}

 64%|██████▎   | 7029/11049 [1:12:24<41:05,  1.63it/s]
 64%|██████▎   | 7030/11049 [1:12:24<41:04,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.5099319815635681, 'learning_rate': 3.5172418388735526e-06, 'epoch': 1.91}

 64%|██████▎   | 7030/11049 [1:12:24<41:04,  1.63it/s]
 64%|██████▎   | 7031/11049 [1:12:25<41:03,  1.63it/s]
                                                      
{'loss': 0.2262, 'grad_norm': 0.617814838886261, 'learning_rate': 3.5157333279050292e-06, 'epoch': 1.91}

 64%|██████▎   | 7031/11049 [1:12:25<41:03,  1.63it/s]
 64%|██████▎   | 7032/11049 [1:12:26<41:02,  1.63it/s]
                                                      
{'loss': 0.2579, 'grad_norm': 0.5121704936027527, 'learning_rate': 3.5142249650823413e-06, 'epoch': 1.91}

 64%|██████▎   | 7032/11049 [1:12:26<41:02,  1.63it/s]
 64%|██████▎   | 7033/11049 [1:12:26<41:01,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.514829695224762, 'learning_rate': 3.512716750556037e-06, 'epoch': 1.91}

 64%|██████▎   | 7033/11049 [1:12:26<41:01,  1.63it/s]
 64%|██████▎   | 7034/11049 [1:12:27<41:01,  1.63it/s]
                                                      
{'loss': 0.2099, 'grad_norm': 0.559112012386322, 'learning_rate': 3.5112086844766586e-06, 'epoch': 1.91}

 64%|██████▎   | 7034/11049 [1:12:27<41:01,  1.63it/s]
 64%|██████▎   | 7035/11049 [1:12:27<41:00,  1.63it/s]
                                                      
{'loss': 0.2404, 'grad_norm': 0.5537869930267334, 'learning_rate': 3.5097007669947213e-06, 'epoch': 1.91}

 64%|██████▎   | 7035/11049 [1:12:28<41:00,  1.63it/s]
 64%|██████▎   | 7036/11049 [1:12:28<41:03,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5519572496414185, 'learning_rate': 3.508192998260735e-06, 'epoch': 1.91}

 64%|██████▎   | 7036/11049 [1:12:28<41:03,  1.63it/s]
 64%|██████▎   | 7037/11049 [1:12:29<41:01,  1.63it/s]
                                                      
{'loss': 0.2456, 'grad_norm': 0.6367548108100891, 'learning_rate': 3.5066853784251876e-06, 'epoch': 1.91}

 64%|██████▎   | 7037/11049 [1:12:29<41:01,  1.63it/s]
 64%|██████▎   | 7038/11049 [1:12:29<41:02,  1.63it/s]
                                                      
{'loss': 0.1771, 'grad_norm': 0.5257665514945984, 'learning_rate': 3.50517790763856e-06, 'epoch': 1.91}

 64%|██████▎   | 7038/11049 [1:12:29<41:02,  1.63it/s]
 64%|██████▎   | 7039/11049 [1:12:30<40:59,  1.63it/s]
                                                      
{'loss': 0.2022, 'grad_norm': 0.5481802821159363, 'learning_rate': 3.5036705860513135e-06, 'epoch': 1.91}

 64%|██████▎   | 7039/11049 [1:12:30<40:59,  1.63it/s]
 64%|██████▎   | 7040/11049 [1:12:30<40:58,  1.63it/s]
                                                      
{'loss': 0.2332, 'grad_norm': 0.5779494643211365, 'learning_rate': 3.502163413813893e-06, 'epoch': 1.91}

 64%|██████▎   | 7040/11049 [1:12:31<40:58,  1.63it/s]
 64%|██████▎   | 7041/11049 [1:12:31<40:58,  1.63it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.5400972962379456, 'learning_rate': 3.50065639107673e-06, 'epoch': 1.91}

 64%|██████▎   | 7041/11049 [1:12:31<40:58,  1.63it/s]
 64%|██████▎   | 7042/11049 [1:12:32<40:57,  1.63it/s]
                                                      
{'loss': 0.2443, 'grad_norm': 0.5426086187362671, 'learning_rate': 3.4991495179902442e-06, 'epoch': 1.91}

 64%|██████▎   | 7042/11049 [1:12:32<40:57,  1.63it/s]
 64%|██████▎   | 7043/11049 [1:12:32<40:58,  1.63it/s]
                                                      
{'loss': 0.1765, 'grad_norm': 0.5174508094787598, 'learning_rate': 3.497642794704837e-06, 'epoch': 1.91}

 64%|██████▎   | 7043/11049 [1:12:32<40:58,  1.63it/s]
 64%|██████▍   | 7044/11049 [1:12:33<40:57,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.5663449764251709, 'learning_rate': 3.4961362213708965e-06, 'epoch': 1.91}

 64%|██████▍   | 7044/11049 [1:12:33<40:57,  1.63it/s]
 64%|██████▍   | 7045/11049 [1:12:34<40:55,  1.63it/s]
                                                      
{'loss': 0.1771, 'grad_norm': 0.4587368667125702, 'learning_rate': 3.4946297981387913e-06, 'epoch': 1.91}

 64%|██████▍   | 7045/11049 [1:12:34<40:55,  1.63it/s]
 64%|██████▍   | 7046/11049 [1:12:34<40:54,  1.63it/s]
                                                      
{'loss': 0.2403, 'grad_norm': 0.5843580365180969, 'learning_rate': 3.4931235251588824e-06, 'epoch': 1.91}

 64%|██████▍   | 7046/11049 [1:12:34<40:54,  1.63it/s]
 64%|██████▍   | 7047/11049 [1:12:35<40:54,  1.63it/s]
                                                      
{'loss': 0.2576, 'grad_norm': 0.6459930539131165, 'learning_rate': 3.491617402581511e-06, 'epoch': 1.91}

 64%|██████▍   | 7047/11049 [1:12:35<40:54,  1.63it/s]
 64%|██████▍   | 7048/11049 [1:12:35<40:54,  1.63it/s]
                                                      
{'loss': 0.1516, 'grad_norm': 0.40948691964149475, 'learning_rate': 3.490111430557005e-06, 'epoch': 1.91}

 64%|██████▍   | 7048/11049 [1:12:36<40:54,  1.63it/s]
 64%|██████▍   | 7049/11049 [1:12:36<40:53,  1.63it/s]
                                                      
{'loss': 0.1645, 'grad_norm': 0.4501282870769501, 'learning_rate': 3.488605609235674e-06, 'epoch': 1.91}

 64%|██████▍   | 7049/11049 [1:12:36<40:53,  1.63it/s]
 64%|██████▍   | 7050/11049 [1:12:37<40:52,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.5013720393180847, 'learning_rate': 3.487099938767819e-06, 'epoch': 1.91}

 64%|██████▍   | 7050/11049 [1:12:37<40:52,  1.63it/s]
 64%|██████▍   | 7051/11049 [1:12:37<40:52,  1.63it/s]
                                                      
{'loss': 0.2521, 'grad_norm': 0.6408898830413818, 'learning_rate': 3.48559441930372e-06, 'epoch': 1.91}

 64%|██████▍   | 7051/11049 [1:12:37<40:52,  1.63it/s]
 64%|██████▍   | 7052/11049 [1:12:38<40:52,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.57269686460495, 'learning_rate': 3.4840890509936447e-06, 'epoch': 1.91}

 64%|██████▍   | 7052/11049 [1:12:38<40:52,  1.63it/s]
 64%|██████▍   | 7053/11049 [1:12:38<40:51,  1.63it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.5559614300727844, 'learning_rate': 3.4825838339878437e-06, 'epoch': 1.92}

 64%|██████▍   | 7053/11049 [1:12:39<40:51,  1.63it/s]
 64%|██████▍   | 7054/11049 [1:12:39<40:50,  1.63it/s]
                                                      
{'loss': 0.2723, 'grad_norm': 0.6314504146575928, 'learning_rate': 3.4810787684365566e-06, 'epoch': 1.92}

 64%|██████▍   | 7054/11049 [1:12:39<40:50,  1.63it/s]
 64%|██████▍   | 7055/11049 [1:12:40<40:48,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.5671715140342712, 'learning_rate': 3.4795738544900026e-06, 'epoch': 1.92}

 64%|██████▍   | 7055/11049 [1:12:40<40:48,  1.63it/s]
 64%|██████▍   | 7056/11049 [1:12:40<40:48,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.5129576921463013, 'learning_rate': 3.4780690922983905e-06, 'epoch': 1.92}

 64%|██████▍   | 7056/11049 [1:12:40<40:48,  1.63it/s]
 64%|██████▍   | 7057/11049 [1:12:41<40:47,  1.63it/s]
                                                      
{'loss': 0.1824, 'grad_norm': 0.5857672095298767, 'learning_rate': 3.4765644820119093e-06, 'epoch': 1.92}

 64%|██████▍   | 7057/11049 [1:12:41<40:47,  1.63it/s]
 64%|██████▍   | 7058/11049 [1:12:42<40:46,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.46913859248161316, 'learning_rate': 3.4750600237807373e-06, 'epoch': 1.92}

 64%|██████▍   | 7058/11049 [1:12:42<40:46,  1.63it/s]
 64%|██████▍   | 7059/11049 [1:12:42<40:47,  1.63it/s]
                                                      
{'loss': 0.2417, 'grad_norm': 0.6154428124427795, 'learning_rate': 3.473555717755036e-06, 'epoch': 1.92}

 64%|██████▍   | 7059/11049 [1:12:42<40:47,  1.63it/s]
 64%|██████▍   | 7060/11049 [1:12:43<40:47,  1.63it/s]
                                                      
{'loss': 0.217, 'grad_norm': 0.8272567987442017, 'learning_rate': 3.4720515640849504e-06, 'epoch': 1.92}

 64%|██████▍   | 7060/11049 [1:12:43<40:47,  1.63it/s]
 64%|██████▍   | 7061/11049 [1:12:43<40:46,  1.63it/s]
                                                      
{'loss': 0.2762, 'grad_norm': 0.7288051247596741, 'learning_rate': 3.4705475629206105e-06, 'epoch': 1.92}

 64%|██████▍   | 7061/11049 [1:12:43<40:46,  1.63it/s]
 64%|██████▍   | 7062/11049 [1:12:44<40:45,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5356341600418091, 'learning_rate': 3.4690437144121337e-06, 'epoch': 1.92}

 64%|██████▍   | 7062/11049 [1:12:44<40:45,  1.63it/s]
 64%|██████▍   | 7063/11049 [1:12:45<40:45,  1.63it/s]
                                                      
{'loss': 0.2171, 'grad_norm': 0.5718829035758972, 'learning_rate': 3.4675400187096187e-06, 'epoch': 1.92}

 64%|██████▍   | 7063/11049 [1:12:45<40:45,  1.63it/s]
 64%|██████▍   | 7064/11049 [1:12:45<40:44,  1.63it/s]
                                                      
{'loss': 0.2338, 'grad_norm': 0.5522310733795166, 'learning_rate': 3.4660364759631516e-06, 'epoch': 1.92}

 64%|██████▍   | 7064/11049 [1:12:45<40:44,  1.63it/s]
 64%|██████▍   | 7065/11049 [1:12:46<40:42,  1.63it/s]
                                                      
{'loss': 0.1833, 'grad_norm': 0.5404722690582275, 'learning_rate': 3.464533086322801e-06, 'epoch': 1.92}

 64%|██████▍   | 7065/11049 [1:12:46<40:42,  1.63it/s]
 64%|██████▍   | 7066/11049 [1:12:46<40:41,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.544492781162262, 'learning_rate': 3.463029849938623e-06, 'epoch': 1.92}

 64%|██████▍   | 7066/11049 [1:12:47<40:41,  1.63it/s]
 64%|██████▍   | 7067/11049 [1:12:47<40:40,  1.63it/s]
                                                      
{'loss': 0.2083, 'grad_norm': 0.513279378414154, 'learning_rate': 3.461526766960656e-06, 'epoch': 1.92}

 64%|██████▍   | 7067/11049 [1:12:47<40:40,  1.63it/s]
 64%|██████▍   | 7068/11049 [1:12:48<40:40,  1.63it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.520348846912384, 'learning_rate': 3.4600238375389246e-06, 'epoch': 1.92}

 64%|██████▍   | 7068/11049 [1:12:48<40:40,  1.63it/s]
 64%|██████▍   | 7069/11049 [1:12:48<40:41,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.5655733942985535, 'learning_rate': 3.4585210618234343e-06, 'epoch': 1.92}

 64%|██████▍   | 7069/11049 [1:12:48<40:41,  1.63it/s]
 64%|██████▍   | 7070/11049 [1:12:49<40:41,  1.63it/s]
                                                      
{'loss': 0.1676, 'grad_norm': 0.44084712862968445, 'learning_rate': 3.4570184399641837e-06, 'epoch': 1.92}

 64%|██████▍   | 7070/11049 [1:12:49<40:41,  1.63it/s]
 64%|██████▍   | 7071/11049 [1:12:49<40:40,  1.63it/s]
                                                      
{'loss': 0.2571, 'grad_norm': 0.6860864162445068, 'learning_rate': 3.4555159721111465e-06, 'epoch': 1.92}

 64%|██████▍   | 7071/11049 [1:12:50<40:40,  1.63it/s]
 64%|██████▍   | 7072/11049 [1:12:50<40:40,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.5435163974761963, 'learning_rate': 3.454013658414287e-06, 'epoch': 1.92}

 64%|██████▍   | 7072/11049 [1:12:50<40:40,  1.63it/s]
 64%|██████▍   | 7073/11049 [1:12:51<40:40,  1.63it/s]
                                                      
{'loss': 0.1834, 'grad_norm': 0.5454567074775696, 'learning_rate': 3.45251149902355e-06, 'epoch': 1.92}

 64%|██████▍   | 7073/11049 [1:12:51<40:40,  1.63it/s]
 64%|██████▍   | 7074/11049 [1:12:51<40:38,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.5254963040351868, 'learning_rate': 3.45100949408887e-06, 'epoch': 1.92}

 64%|██████▍   | 7074/11049 [1:12:51<40:38,  1.63it/s]
 64%|██████▍   | 7075/11049 [1:12:52<40:38,  1.63it/s]
                                                      
{'loss': 0.1964, 'grad_norm': 0.5661920309066772, 'learning_rate': 3.449507643760164e-06, 'epoch': 1.92}

 64%|██████▍   | 7075/11049 [1:12:52<40:38,  1.63it/s]
 64%|██████▍   | 7076/11049 [1:12:53<40:36,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.6461765170097351, 'learning_rate': 3.44800594818733e-06, 'epoch': 1.92}

 64%|██████▍   | 7076/11049 [1:12:53<40:36,  1.63it/s]
 64%|██████▍   | 7077/11049 [1:12:53<40:36,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.5426263809204102, 'learning_rate': 3.4465044075202527e-06, 'epoch': 1.92}

 64%|██████▍   | 7077/11049 [1:12:53<40:36,  1.63it/s]
 64%|██████▍   | 7078/11049 [1:12:54<40:35,  1.63it/s]
                                                      
{'loss': 0.2226, 'grad_norm': 0.5308386087417603, 'learning_rate': 3.445003021908806e-06, 'epoch': 1.92}

 64%|██████▍   | 7078/11049 [1:12:54<40:35,  1.63it/s]
 64%|██████▍   | 7079/11049 [1:12:54<40:34,  1.63it/s]
                                                      
{'loss': 0.1572, 'grad_norm': 0.4727059602737427, 'learning_rate': 3.4435017915028424e-06, 'epoch': 1.92}

 64%|██████▍   | 7079/11049 [1:12:55<40:34,  1.63it/s]
 64%|██████▍   | 7080/11049 [1:12:55<40:33,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.5696502327919006, 'learning_rate': 3.442000716452202e-06, 'epoch': 1.92}

 64%|██████▍   | 7080/11049 [1:12:55<40:33,  1.63it/s]
 64%|██████▍   | 7081/11049 [1:12:56<40:32,  1.63it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.7273691296577454, 'learning_rate': 3.4404997969067043e-06, 'epoch': 1.92}

 64%|██████▍   | 7081/11049 [1:12:56<40:32,  1.63it/s]
 64%|██████▍   | 7082/11049 [1:12:56<40:32,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5922994017601013, 'learning_rate': 3.4389990330161616e-06, 'epoch': 1.92}

 64%|██████▍   | 7082/11049 [1:12:56<40:32,  1.63it/s]
 64%|██████▍   | 7083/11049 [1:12:57<40:31,  1.63it/s]
                                                      
{'loss': 0.2256, 'grad_norm': 0.6988546252250671, 'learning_rate': 3.4374984249303657e-06, 'epoch': 1.92}

 64%|██████▍   | 7083/11049 [1:12:57<40:31,  1.63it/s]
 64%|██████▍   | 7084/11049 [1:12:57<40:31,  1.63it/s]
                                                      
{'loss': 0.2506, 'grad_norm': 0.606277585029602, 'learning_rate': 3.435997972799092e-06, 'epoch': 1.92}

 64%|██████▍   | 7084/11049 [1:12:58<40:31,  1.63it/s]
 64%|██████▍   | 7085/11049 [1:12:58<40:30,  1.63it/s]
                                                      
{'loss': 0.2103, 'grad_norm': 0.5014607310295105, 'learning_rate': 3.434497676772102e-06, 'epoch': 1.92}

 64%|██████▍   | 7085/11049 [1:12:58<40:30,  1.63it/s]
 64%|██████▍   | 7086/11049 [1:12:59<40:34,  1.63it/s]
                                                      
{'loss': 0.1431, 'grad_norm': 0.41209328174591064, 'learning_rate': 3.432997536999142e-06, 'epoch': 1.92}

 64%|██████▍   | 7086/11049 [1:12:59<40:34,  1.63it/s]
 64%|██████▍   | 7087/11049 [1:12:59<40:33,  1.63it/s]
                                                      
{'loss': 0.2346, 'grad_norm': 0.5960246920585632, 'learning_rate': 3.4314975536299422e-06, 'epoch': 1.92}

 64%|██████▍   | 7087/11049 [1:12:59<40:33,  1.63it/s]
 64%|██████▍   | 7088/11049 [1:13:00<40:32,  1.63it/s]
                                                      
{'loss': 0.171, 'grad_norm': 0.48154783248901367, 'learning_rate': 3.4299977268142174e-06, 'epoch': 1.92}

 64%|██████▍   | 7088/11049 [1:13:00<40:32,  1.63it/s]
 64%|██████▍   | 7089/11049 [1:13:01<40:30,  1.63it/s]
                                                      
{'loss': 0.2708, 'grad_norm': 0.6718368530273438, 'learning_rate': 3.428498056701665e-06, 'epoch': 1.92}

 64%|██████▍   | 7089/11049 [1:13:01<40:30,  1.63it/s]
 64%|██████▍   | 7090/11049 [1:13:01<40:28,  1.63it/s]
                                                      
{'loss': 0.2588, 'grad_norm': 0.6222231984138489, 'learning_rate': 3.4269985434419707e-06, 'epoch': 1.93}

 64%|██████▍   | 7090/11049 [1:13:01<40:28,  1.63it/s]
 64%|██████▍   | 7091/11049 [1:13:02<40:28,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.5203183889389038, 'learning_rate': 3.4254991871848003e-06, 'epoch': 1.93}

 64%|██████▍   | 7091/11049 [1:13:02<40:28,  1.63it/s]
 64%|██████▍   | 7092/11049 [1:13:02<40:27,  1.63it/s]
                                                      
{'loss': 0.2337, 'grad_norm': 0.6543760299682617, 'learning_rate': 3.4239999880798063e-06, 'epoch': 1.93}

 64%|██████▍   | 7092/11049 [1:13:03<40:27,  1.63it/s]
 64%|██████▍   | 7093/11049 [1:13:03<40:26,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.4606451690196991, 'learning_rate': 3.422500946276624e-06, 'epoch': 1.93}

 64%|██████▍   | 7093/11049 [1:13:03<40:26,  1.63it/s]
 64%|██████▍   | 7094/11049 [1:13:04<40:25,  1.63it/s]
                                                      
{'loss': 0.2277, 'grad_norm': 0.6902732253074646, 'learning_rate': 3.4210020619248762e-06, 'epoch': 1.93}

 64%|██████▍   | 7094/11049 [1:13:04<40:25,  1.63it/s]
 64%|██████▍   | 7095/11049 [1:13:04<40:24,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.5220097899436951, 'learning_rate': 3.4195033351741656e-06, 'epoch': 1.93}

 64%|██████▍   | 7095/11049 [1:13:04<40:24,  1.63it/s]
 64%|██████▍   | 7096/11049 [1:13:05<40:23,  1.63it/s]
                                                      
{'loss': 0.2122, 'grad_norm': 0.5361208319664001, 'learning_rate': 3.4180047661740825e-06, 'epoch': 1.93}

 64%|██████▍   | 7096/11049 [1:13:05<40:23,  1.63it/s]
 64%|██████▍   | 7097/11049 [1:13:05<40:22,  1.63it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.5715258121490479, 'learning_rate': 3.4165063550741985e-06, 'epoch': 1.93}

 64%|██████▍   | 7097/11049 [1:13:06<40:22,  1.63it/s]
 64%|██████▍   | 7098/11049 [1:13:06<40:22,  1.63it/s]
                                                      
{'loss': 0.2189, 'grad_norm': 0.671120285987854, 'learning_rate': 3.415008102024074e-06, 'epoch': 1.93}

 64%|██████▍   | 7098/11049 [1:13:06<40:22,  1.63it/s]
 64%|██████▍   | 7099/11049 [1:13:07<40:22,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.5085762143135071, 'learning_rate': 3.4135100071732487e-06, 'epoch': 1.93}

 64%|██████▍   | 7099/11049 [1:13:07<40:22,  1.63it/s]
 64%|██████▍   | 7100/11049 [1:13:07<40:22,  1.63it/s]
                                                      
{'loss': 0.224, 'grad_norm': 0.5949926376342773, 'learning_rate': 3.41201207067125e-06, 'epoch': 1.93}

 64%|██████▍   | 7100/11049 [1:13:07<40:22,  1.63it/s]
 64%|██████▍   | 7101/11049 [1:13:08<40:21,  1.63it/s]
                                                      
{'loss': 0.1984, 'grad_norm': 0.5602987408638, 'learning_rate': 3.410514292667586e-06, 'epoch': 1.93}

 64%|██████▍   | 7101/11049 [1:13:08<40:21,  1.63it/s]
 64%|██████▍   | 7102/11049 [1:13:09<40:20,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.5277902483940125, 'learning_rate': 3.4090166733117536e-06, 'epoch': 1.93}

 64%|██████▍   | 7102/11049 [1:13:09<40:20,  1.63it/s]
 64%|██████▍   | 7103/11049 [1:13:09<40:19,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5004592537879944, 'learning_rate': 3.4075192127532298e-06, 'epoch': 1.93}

 64%|██████▍   | 7103/11049 [1:13:09<40:19,  1.63it/s]
 64%|██████▍   | 7104/11049 [1:13:10<40:19,  1.63it/s]
                                                      
{'loss': 0.2064, 'grad_norm': 0.5238564610481262, 'learning_rate': 3.4060219111414783e-06, 'epoch': 1.93}

 64%|██████▍   | 7104/11049 [1:13:10<40:19,  1.63it/s]
 64%|██████▍   | 7105/11049 [1:13:10<40:19,  1.63it/s]
                                                      
{'loss': 0.153, 'grad_norm': 0.4136611521244049, 'learning_rate': 3.4045247686259436e-06, 'epoch': 1.93}

 64%|██████▍   | 7105/11049 [1:13:10<40:19,  1.63it/s]
 64%|██████▍   | 7106/11049 [1:13:11<40:18,  1.63it/s]
                                                      
{'loss': 0.1934, 'grad_norm': 0.484798401594162, 'learning_rate': 3.403027785356062e-06, 'epoch': 1.93}

 64%|██████▍   | 7106/11049 [1:13:11<40:18,  1.63it/s]
 64%|██████▍   | 7107/11049 [1:13:12<40:18,  1.63it/s]
                                                      
{'loss': 0.2065, 'grad_norm': 0.6406707763671875, 'learning_rate': 3.401530961481243e-06, 'epoch': 1.93}

 64%|██████▍   | 7107/11049 [1:13:12<40:18,  1.63it/s]
 64%|██████▍   | 7108/11049 [1:13:12<40:18,  1.63it/s]
                                                      
{'loss': 0.1917, 'grad_norm': 0.5467960834503174, 'learning_rate': 3.4000342971508895e-06, 'epoch': 1.93}

 64%|██████▍   | 7108/11049 [1:13:12<40:18,  1.63it/s]
 64%|██████▍   | 7109/11049 [1:13:13<40:17,  1.63it/s]
                                                      
{'loss': 0.188, 'grad_norm': 0.5345584154129028, 'learning_rate': 3.3985377925143794e-06, 'epoch': 1.93}

 64%|██████▍   | 7109/11049 [1:13:13<40:17,  1.63it/s]
 64%|██████▍   | 7110/11049 [1:13:13<40:15,  1.63it/s]
                                                      
{'loss': 0.2048, 'grad_norm': 0.5527855157852173, 'learning_rate': 3.3970414477210867e-06, 'epoch': 1.93}

 64%|██████▍   | 7110/11049 [1:13:14<40:15,  1.63it/s]
 64%|██████▍   | 7111/11049 [1:13:14<40:15,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.5237541794776917, 'learning_rate': 3.395545262920361e-06, 'epoch': 1.93}

 64%|██████▍   | 7111/11049 [1:13:14<40:15,  1.63it/s]
 64%|██████▍   | 7112/11049 [1:13:15<40:14,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.5678642392158508, 'learning_rate': 3.3940492382615355e-06, 'epoch': 1.93}

 64%|██████▍   | 7112/11049 [1:13:15<40:14,  1.63it/s]
 64%|██████▍   | 7113/11049 [1:13:15<40:14,  1.63it/s]
                                                      
{'loss': 0.2387, 'grad_norm': 0.5646820068359375, 'learning_rate': 3.3925533738939286e-06, 'epoch': 1.93}

 64%|██████▍   | 7113/11049 [1:13:15<40:14,  1.63it/s]
 64%|██████▍   | 7114/11049 [1:13:16<40:14,  1.63it/s]
                                                      
{'loss': 0.1432, 'grad_norm': 0.41206595301628113, 'learning_rate': 3.391057669966848e-06, 'epoch': 1.93}

 64%|██████▍   | 7114/11049 [1:13:16<40:14,  1.63it/s]
 64%|██████▍   | 7115/11049 [1:13:16<40:13,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5613664388656616, 'learning_rate': 3.3895621266295786e-06, 'epoch': 1.93}

 64%|██████▍   | 7115/11049 [1:13:17<40:13,  1.63it/s]
 64%|██████▍   | 7116/11049 [1:13:17<40:11,  1.63it/s]
                                                      
{'loss': 0.2002, 'grad_norm': 0.5757454037666321, 'learning_rate': 3.388066744031393e-06, 'epoch': 1.93}

 64%|██████▍   | 7116/11049 [1:13:17<40:11,  1.63it/s]
 64%|██████▍   | 7117/11049 [1:13:18<40:11,  1.63it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.6440244317054749, 'learning_rate': 3.3865715223215427e-06, 'epoch': 1.93}

 64%|██████▍   | 7117/11049 [1:13:18<40:11,  1.63it/s]
 64%|██████▍   | 7118/11049 [1:13:18<40:11,  1.63it/s]
                                                      
{'loss': 0.217, 'grad_norm': 0.6546130180358887, 'learning_rate': 3.385076461649272e-06, 'epoch': 1.93}

 64%|██████▍   | 7118/11049 [1:13:18<40:11,  1.63it/s]
 64%|██████▍   | 7119/11049 [1:13:19<40:10,  1.63it/s]
                                                      
{'loss': 0.179, 'grad_norm': 0.5474878549575806, 'learning_rate': 3.3835815621638025e-06, 'epoch': 1.93}

 64%|██████▍   | 7119/11049 [1:13:19<40:10,  1.63it/s]
 64%|██████▍   | 7120/11049 [1:13:20<40:09,  1.63it/s]
                                                      
{'loss': 0.1835, 'grad_norm': 0.4918660819530487, 'learning_rate': 3.3820868240143397e-06, 'epoch': 1.93}

 64%|██████▍   | 7120/11049 [1:13:20<40:09,  1.63it/s]
 64%|██████▍   | 7121/11049 [1:13:20<40:08,  1.63it/s]
                                                      
{'loss': 0.1569, 'grad_norm': 0.443503201007843, 'learning_rate': 3.380592247350075e-06, 'epoch': 1.93}

 64%|██████▍   | 7121/11049 [1:13:20<40:08,  1.63it/s]
 64%|██████▍   | 7122/11049 [1:13:21<40:07,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.47958049178123474, 'learning_rate': 3.379097832320185e-06, 'epoch': 1.93}

 64%|██████▍   | 7122/11049 [1:13:21<40:07,  1.63it/s]
 64%|██████▍   | 7123/11049 [1:13:21<40:07,  1.63it/s]
                                                      
{'loss': 0.1778, 'grad_norm': 0.5320932865142822, 'learning_rate': 3.377603579073827e-06, 'epoch': 1.93}

 64%|██████▍   | 7123/11049 [1:13:22<40:07,  1.63it/s]
 64%|██████▍   | 7124/11049 [1:13:22<40:06,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.5155829191207886, 'learning_rate': 3.3761094877601443e-06, 'epoch': 1.93}

 64%|██████▍   | 7124/11049 [1:13:22<40:06,  1.63it/s]
 64%|██████▍   | 7125/11049 [1:13:23<40:05,  1.63it/s]
                                                      
{'loss': 0.2038, 'grad_norm': 0.6729219555854797, 'learning_rate': 3.3746155585282624e-06, 'epoch': 1.93}

 64%|██████▍   | 7125/11049 [1:13:23<40:05,  1.63it/s]
 64%|██████▍   | 7126/11049 [1:13:23<40:05,  1.63it/s]
                                                      
{'loss': 0.2006, 'grad_norm': 0.5466376543045044, 'learning_rate': 3.3731217915272927e-06, 'epoch': 1.93}

 64%|██████▍   | 7126/11049 [1:13:23<40:05,  1.63it/s]
 65%|██████▍   | 7127/11049 [1:13:24<40:04,  1.63it/s]
                                                      
{'loss': 0.1728, 'grad_norm': 0.4800897240638733, 'learning_rate': 3.371628186906329e-06, 'epoch': 1.94}

 65%|██████▍   | 7127/11049 [1:13:24<40:04,  1.63it/s]
 65%|██████▍   | 7128/11049 [1:13:24<40:04,  1.63it/s]
                                                      
{'loss': 0.3015, 'grad_norm': 0.6295761466026306, 'learning_rate': 3.3701347448144484e-06, 'epoch': 1.94}

 65%|██████▍   | 7128/11049 [1:13:25<40:04,  1.63it/s]
 65%|██████▍   | 7129/11049 [1:13:25<40:05,  1.63it/s]
                                                      
{'loss': 0.1931, 'grad_norm': 0.5253621339797974, 'learning_rate': 3.368641465400713e-06, 'epoch': 1.94}

 65%|██████▍   | 7129/11049 [1:13:25<40:05,  1.63it/s]
 65%|██████▍   | 7130/11049 [1:13:26<40:03,  1.63it/s]
                                                      
{'loss': 0.2169, 'grad_norm': 0.6151720285415649, 'learning_rate': 3.367148348814169e-06, 'epoch': 1.94}

 65%|██████▍   | 7130/11049 [1:13:26<40:03,  1.63it/s]
 65%|██████▍   | 7131/11049 [1:13:26<40:03,  1.63it/s]
                                                      
{'loss': 0.204, 'grad_norm': 0.5878021717071533, 'learning_rate': 3.365655395203844e-06, 'epoch': 1.94}

 65%|██████▍   | 7131/11049 [1:13:26<40:03,  1.63it/s]
 65%|██████▍   | 7132/11049 [1:13:27<40:02,  1.63it/s]
                                                      
{'loss': 0.2241, 'grad_norm': 0.5984444618225098, 'learning_rate': 3.3641626047187526e-06, 'epoch': 1.94}

 65%|██████▍   | 7132/11049 [1:13:27<40:02,  1.63it/s]
 65%|██████▍   | 7133/11049 [1:13:28<40:01,  1.63it/s]
                                                      
{'loss': 0.2029, 'grad_norm': 0.6152638792991638, 'learning_rate': 3.3626699775078884e-06, 'epoch': 1.94}

 65%|██████▍   | 7133/11049 [1:13:28<40:01,  1.63it/s]
 65%|██████▍   | 7134/11049 [1:13:28<40:00,  1.63it/s]
                                                      
{'loss': 0.2077, 'grad_norm': 0.5351787209510803, 'learning_rate': 3.361177513720236e-06, 'epoch': 1.94}

 65%|██████▍   | 7134/11049 [1:13:28<40:00,  1.63it/s]
 65%|██████▍   | 7135/11049 [1:13:29<39:59,  1.63it/s]
                                                      
{'loss': 0.1645, 'grad_norm': 0.45764294266700745, 'learning_rate': 3.3596852135047565e-06, 'epoch': 1.94}

 65%|██████▍   | 7135/11049 [1:13:29<39:59,  1.63it/s]
 65%|██████▍   | 7136/11049 [1:13:29<39:58,  1.63it/s]
                                                      
{'loss': 0.2989, 'grad_norm': 0.5413661003112793, 'learning_rate': 3.3581930770103987e-06, 'epoch': 1.94}

 65%|██████▍   | 7136/11049 [1:13:29<39:58,  1.63it/s]
 65%|██████▍   | 7137/11049 [1:13:30<39:58,  1.63it/s]
                                                      
{'loss': 0.1598, 'grad_norm': 0.4663356840610504, 'learning_rate': 3.356701104386092e-06, 'epoch': 1.94}

 65%|██████▍   | 7137/11049 [1:13:30<39:58,  1.63it/s]
 65%|██████▍   | 7138/11049 [1:13:31<39:58,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.4518299102783203, 'learning_rate': 3.3552092957807548e-06, 'epoch': 1.94}

 65%|██████▍   | 7138/11049 [1:13:31<39:58,  1.63it/s]
 65%|██████▍   | 7139/11049 [1:13:31<39:57,  1.63it/s]
                                                      
{'loss': 0.2419, 'grad_norm': 0.4902529716491699, 'learning_rate': 3.353717651343283e-06, 'epoch': 1.94}

 65%|██████▍   | 7139/11049 [1:13:31<39:57,  1.63it/s]
 65%|██████▍   | 7140/11049 [1:13:32<39:57,  1.63it/s]
                                                      
{'loss': 0.1453, 'grad_norm': 0.43813279271125793, 'learning_rate': 3.35222617122256e-06, 'epoch': 1.94}

 65%|██████▍   | 7140/11049 [1:13:32<39:57,  1.63it/s]
 65%|██████▍   | 7141/11049 [1:13:32<39:56,  1.63it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.5610117316246033, 'learning_rate': 3.350734855567449e-06, 'epoch': 1.94}

 65%|██████▍   | 7141/11049 [1:13:33<39:56,  1.63it/s]
 65%|██████▍   | 7142/11049 [1:13:33<39:56,  1.63it/s]
                                                      
{'loss': 0.1774, 'grad_norm': 0.45042529702186584, 'learning_rate': 3.3492437045268043e-06, 'epoch': 1.94}

 65%|██████▍   | 7142/11049 [1:13:33<39:56,  1.63it/s]
 65%|██████▍   | 7143/11049 [1:13:34<39:55,  1.63it/s]
                                                      
{'loss': 0.2772, 'grad_norm': 0.6645841598510742, 'learning_rate': 3.3477527182494556e-06, 'epoch': 1.94}

 65%|██████▍   | 7143/11049 [1:13:34<39:55,  1.63it/s]
 65%|██████▍   | 7144/11049 [1:13:34<39:55,  1.63it/s]
                                                      
{'loss': 0.1797, 'grad_norm': 0.4783523380756378, 'learning_rate': 3.3462618968842197e-06, 'epoch': 1.94}

 65%|██████▍   | 7144/11049 [1:13:34<39:55,  1.63it/s]
 65%|██████▍   | 7145/11049 [1:13:35<39:53,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.47759702801704407, 'learning_rate': 3.344771240579897e-06, 'epoch': 1.94}

 65%|██████▍   | 7145/11049 [1:13:35<39:53,  1.63it/s]
 65%|██████▍   | 7146/11049 [1:13:35<39:52,  1.63it/s]
                                                      
{'loss': 0.2058, 'grad_norm': 0.5738553404808044, 'learning_rate': 3.343280749485269e-06, 'epoch': 1.94}

 65%|██████▍   | 7146/11049 [1:13:36<39:52,  1.63it/s]
 65%|██████▍   | 7147/11049 [1:13:36<39:51,  1.63it/s]
                                                      
{'loss': 0.2027, 'grad_norm': 0.521759569644928, 'learning_rate': 3.3417904237491083e-06, 'epoch': 1.94}

 65%|██████▍   | 7147/11049 [1:13:36<39:51,  1.63it/s]
 65%|██████▍   | 7148/11049 [1:13:37<39:51,  1.63it/s]
                                                      
{'loss': 0.2049, 'grad_norm': 0.553817868232727, 'learning_rate': 3.340300263520161e-06, 'epoch': 1.94}

 65%|██████▍   | 7148/11049 [1:13:37<39:51,  1.63it/s]
 65%|██████▍   | 7149/11049 [1:13:37<39:51,  1.63it/s]
                                                      
{'loss': 0.1801, 'grad_norm': 0.5172674655914307, 'learning_rate': 3.3388102689471625e-06, 'epoch': 1.94}

 65%|██████▍   | 7149/11049 [1:13:37<39:51,  1.63it/s]
 65%|██████▍   | 7150/11049 [1:13:38<39:50,  1.63it/s]
                                                      
{'loss': 0.2345, 'grad_norm': 0.5679014325141907, 'learning_rate': 3.337320440178827e-06, 'epoch': 1.94}

 65%|██████▍   | 7150/11049 [1:13:38<39:50,  1.63it/s]
 65%|██████▍   | 7151/11049 [1:13:39<39:50,  1.63it/s]
                                                      
{'loss': 0.2028, 'grad_norm': 0.5322171449661255, 'learning_rate': 3.3358307773638617e-06, 'epoch': 1.94}

 65%|██████▍   | 7151/11049 [1:13:39<39:50,  1.63it/s]
 65%|██████▍   | 7152/11049 [1:13:39<39:50,  1.63it/s]
                                                      
{'loss': 0.2018, 'grad_norm': 0.5224581956863403, 'learning_rate': 3.334341280650948e-06, 'epoch': 1.94}

 65%|██████▍   | 7152/11049 [1:13:39<39:50,  1.63it/s]
 65%|██████▍   | 7153/11049 [1:13:40<39:48,  1.63it/s]
                                                      
{'loss': 0.2081, 'grad_norm': 0.5560691356658936, 'learning_rate': 3.3328519501887535e-06, 'epoch': 1.94}

 65%|██████▍   | 7153/11049 [1:13:40<39:48,  1.63it/s]
 65%|██████▍   | 7154/11049 [1:13:40<39:47,  1.63it/s]
                                                      
{'loss': 0.3426, 'grad_norm': 0.6531289219856262, 'learning_rate': 3.3313627861259266e-06, 'epoch': 1.94}

 65%|██████▍   | 7154/11049 [1:13:41<39:47,  1.63it/s]
 65%|██████▍   | 7155/11049 [1:13:41<39:45,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5057023167610168, 'learning_rate': 3.3298737886111075e-06, 'epoch': 1.94}

 65%|██████▍   | 7155/11049 [1:13:41<39:45,  1.63it/s]
 65%|██████▍   | 7156/11049 [1:13:42<39:46,  1.63it/s]
                                                      
{'loss': 0.2537, 'grad_norm': 0.6322482228279114, 'learning_rate': 3.3283849577929115e-06, 'epoch': 1.94}

 65%|██████▍   | 7156/11049 [1:13:42<39:46,  1.63it/s]
 65%|██████▍   | 7157/11049 [1:13:42<39:45,  1.63it/s]
                                                      
{'loss': 0.1656, 'grad_norm': 0.40683692693710327, 'learning_rate': 3.3268962938199417e-06, 'epoch': 1.94}

 65%|██████▍   | 7157/11049 [1:13:42<39:45,  1.63it/s]
 65%|██████▍   | 7158/11049 [1:13:43<39:45,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.4631931483745575, 'learning_rate': 3.325407796840778e-06, 'epoch': 1.94}

 65%|██████▍   | 7158/11049 [1:13:43<39:45,  1.63it/s]
 65%|██████▍   | 7159/11049 [1:13:43<39:45,  1.63it/s]
                                                      
{'loss': 0.2283, 'grad_norm': 0.5894894599914551, 'learning_rate': 3.323919467003993e-06, 'epoch': 1.94}

 65%|██████▍   | 7159/11049 [1:13:44<39:45,  1.63it/s]
 65%|██████▍   | 7160/11049 [1:13:44<39:44,  1.63it/s]
                                                      
{'loss': 0.2458, 'grad_norm': 0.5933932662010193, 'learning_rate': 3.322431304458138e-06, 'epoch': 1.94}

 65%|██████▍   | 7160/11049 [1:13:44<39:44,  1.63it/s]
 65%|██████▍   | 7161/11049 [1:13:45<39:44,  1.63it/s]
                                                      
{'loss': 0.264, 'grad_norm': 0.5690271854400635, 'learning_rate': 3.320943309351746e-06, 'epoch': 1.94}

 65%|██████▍   | 7161/11049 [1:13:45<39:44,  1.63it/s]
 65%|██████▍   | 7162/11049 [1:13:45<39:44,  1.63it/s]
                                                      
{'loss': 0.1949, 'grad_norm': 0.5563052296638489, 'learning_rate': 3.3194554818333342e-06, 'epoch': 1.94}

 65%|██████▍   | 7162/11049 [1:13:45<39:44,  1.63it/s]
 65%|██████▍   | 7163/11049 [1:13:46<39:42,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.5266836285591125, 'learning_rate': 3.3179678220514066e-06, 'epoch': 1.94}

 65%|██████▍   | 7163/11049 [1:13:46<39:42,  1.63it/s]
 65%|██████▍   | 7164/11049 [1:13:47<39:42,  1.63it/s]
                                                      
{'loss': 0.2411, 'grad_norm': 0.5677411556243896, 'learning_rate': 3.316480330154446e-06, 'epoch': 1.95}

 65%|██████▍   | 7164/11049 [1:13:47<39:42,  1.63it/s]
 65%|██████▍   | 7165/11049 [1:13:47<39:41,  1.63it/s]
                                                      
{'loss': 0.2139, 'grad_norm': 0.6221973299980164, 'learning_rate': 3.31499300629092e-06, 'epoch': 1.95}

 65%|██████▍   | 7165/11049 [1:13:47<39:41,  1.63it/s]
 65%|██████▍   | 7166/11049 [1:13:48<39:40,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.5515217781066895, 'learning_rate': 3.31350585060928e-06, 'epoch': 1.95}

 65%|██████▍   | 7166/11049 [1:13:48<39:40,  1.63it/s]
 65%|██████▍   | 7167/11049 [1:13:48<39:39,  1.63it/s]
                                                      
{'loss': 0.2043, 'grad_norm': 0.536209225654602, 'learning_rate': 3.31201886325796e-06, 'epoch': 1.95}

 65%|██████▍   | 7167/11049 [1:13:48<39:39,  1.63it/s]
 65%|██████▍   | 7168/11049 [1:13:49<39:39,  1.63it/s]
                                                      
{'loss': 0.2094, 'grad_norm': 0.550206184387207, 'learning_rate': 3.3105320443853785e-06, 'epoch': 1.95}

 65%|██████▍   | 7168/11049 [1:13:49<39:39,  1.63it/s]
 65%|██████▍   | 7169/11049 [1:13:50<39:39,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.4879109561443329, 'learning_rate': 3.3090453941399346e-06, 'epoch': 1.95}

 65%|██████▍   | 7169/11049 [1:13:50<39:39,  1.63it/s]
 65%|██████▍   | 7170/11049 [1:13:50<39:38,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.5728452205657959, 'learning_rate': 3.3075589126700115e-06, 'epoch': 1.95}

 65%|██████▍   | 7170/11049 [1:13:50<39:38,  1.63it/s]
 65%|██████▍   | 7171/11049 [1:13:51<39:38,  1.63it/s]
                                                      
{'loss': 0.2058, 'grad_norm': 0.5260590314865112, 'learning_rate': 3.3060726001239786e-06, 'epoch': 1.95}

 65%|██████▍   | 7171/11049 [1:13:51<39:38,  1.63it/s]
 65%|██████▍   | 7172/11049 [1:13:51<39:36,  1.63it/s]
                                                      
{'loss': 0.2383, 'grad_norm': 0.5532419681549072, 'learning_rate': 3.304586456650184e-06, 'epoch': 1.95}

 65%|██████▍   | 7172/11049 [1:13:52<39:36,  1.63it/s]
 65%|██████▍   | 7173/11049 [1:13:52<39:36,  1.63it/s]
                                                      
{'loss': 0.2165, 'grad_norm': 0.5310776233673096, 'learning_rate': 3.3031004823969616e-06, 'epoch': 1.95}

 65%|██████▍   | 7173/11049 [1:13:52<39:36,  1.63it/s]
 65%|██████▍   | 7174/11049 [1:13:53<39:35,  1.63it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.5031756162643433, 'learning_rate': 3.301614677512626e-06, 'epoch': 1.95}

 65%|██████▍   | 7174/11049 [1:13:53<39:35,  1.63it/s]
 65%|██████▍   | 7175/11049 [1:13:53<39:33,  1.63it/s]
                                                      
{'loss': 0.2434, 'grad_norm': 0.5994096398353577, 'learning_rate': 3.3001290421454797e-06, 'epoch': 1.95}

 65%|██████▍   | 7175/11049 [1:13:53<39:33,  1.63it/s]
 65%|██████▍   | 7176/11049 [1:13:54<39:33,  1.63it/s]
                                                      
{'loss': 0.2075, 'grad_norm': 0.5599207878112793, 'learning_rate': 3.298643576443803e-06, 'epoch': 1.95}

 65%|██████▍   | 7176/11049 [1:13:54<39:33,  1.63it/s]
 65%|██████▍   | 7177/11049 [1:13:54<39:34,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.5301799178123474, 'learning_rate': 3.2971582805558622e-06, 'epoch': 1.95}

 65%|██████▍   | 7177/11049 [1:13:55<39:34,  1.63it/s]
 65%|██████▍   | 7178/11049 [1:13:55<39:32,  1.63it/s]
                                                      
{'loss': 0.2618, 'grad_norm': 0.7030755281448364, 'learning_rate': 3.2956731546299035e-06, 'epoch': 1.95}

 65%|██████▍   | 7178/11049 [1:13:55<39:32,  1.63it/s]
 65%|██████▍   | 7179/11049 [1:13:56<39:32,  1.63it/s]
                                                      
{'loss': 0.2843, 'grad_norm': 0.7778327465057373, 'learning_rate': 3.294188198814162e-06, 'epoch': 1.95}

 65%|██████▍   | 7179/11049 [1:13:56<39:32,  1.63it/s]
 65%|██████▍   | 7180/11049 [1:13:56<39:31,  1.63it/s]
                                                      
{'loss': 0.2013, 'grad_norm': 0.7824579477310181, 'learning_rate': 3.2927034132568516e-06, 'epoch': 1.95}

 65%|██████▍   | 7180/11049 [1:13:56<39:31,  1.63it/s]
 65%|██████▍   | 7181/11049 [1:13:57<39:30,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5533151030540466, 'learning_rate': 3.291218798106168e-06, 'epoch': 1.95}

 65%|██████▍   | 7181/11049 [1:13:57<39:30,  1.63it/s]
 65%|██████▌   | 7182/11049 [1:13:58<39:30,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.5703672766685486, 'learning_rate': 3.289734353510292e-06, 'epoch': 1.95}

 65%|██████▌   | 7182/11049 [1:13:58<39:30,  1.63it/s]
 65%|██████▌   | 7183/11049 [1:13:58<39:30,  1.63it/s]
                                                      
{'loss': 0.2128, 'grad_norm': 0.5336155891418457, 'learning_rate': 3.288250079617391e-06, 'epoch': 1.95}

 65%|██████▌   | 7183/11049 [1:13:58<39:30,  1.63it/s]
 65%|██████▌   | 7184/11049 [1:13:59<39:30,  1.63it/s]
                                                      
{'loss': 0.2092, 'grad_norm': 0.5463854670524597, 'learning_rate': 3.286765976575607e-06, 'epoch': 1.95}

 65%|██████▌   | 7184/11049 [1:13:59<39:30,  1.63it/s]
 65%|██████▌   | 7185/11049 [1:13:59<39:29,  1.63it/s]
                                                      
{'loss': 0.2618, 'grad_norm': 0.6657735705375671, 'learning_rate': 3.285282044533072e-06, 'epoch': 1.95}

 65%|██████▌   | 7185/11049 [1:14:00<39:29,  1.63it/s]
 65%|██████▌   | 7186/11049 [1:14:00<39:29,  1.63it/s]
                                                      
{'loss': 0.2171, 'grad_norm': 0.5864970684051514, 'learning_rate': 3.283798283637895e-06, 'epoch': 1.95}

 65%|██████▌   | 7186/11049 [1:14:00<39:29,  1.63it/s]
 65%|██████▌   | 7187/11049 [1:14:01<39:28,  1.63it/s]
                                                      
{'loss': 0.1284, 'grad_norm': 0.40146130323410034, 'learning_rate': 3.2823146940381767e-06, 'epoch': 1.95}

 65%|██████▌   | 7187/11049 [1:14:01<39:28,  1.63it/s]
 65%|██████▌   | 7188/11049 [1:14:01<39:27,  1.63it/s]
                                                      
{'loss': 0.2235, 'grad_norm': 0.55884850025177, 'learning_rate': 3.2808312758819926e-06, 'epoch': 1.95}

 65%|██████▌   | 7188/11049 [1:14:01<39:27,  1.63it/s]
 65%|██████▌   | 7189/11049 [1:14:02<39:26,  1.63it/s]
                                                      
{'loss': 0.2288, 'grad_norm': 0.5531274080276489, 'learning_rate': 3.279348029317404e-06, 'epoch': 1.95}

 65%|██████▌   | 7189/11049 [1:14:02<39:26,  1.63it/s]
 65%|██████▌   | 7190/11049 [1:14:02<39:24,  1.63it/s]
                                                      
{'loss': 0.1834, 'grad_norm': 0.522754430770874, 'learning_rate': 3.2778649544924524e-06, 'epoch': 1.95}

 65%|██████▌   | 7190/11049 [1:14:03<39:24,  1.63it/s]
 65%|██████▌   | 7191/11049 [1:14:03<39:24,  1.63it/s]
                                                      
{'loss': 0.2157, 'grad_norm': 0.5022901892662048, 'learning_rate': 3.276382051555169e-06, 'epoch': 1.95}

 65%|██████▌   | 7191/11049 [1:14:03<39:24,  1.63it/s]
 65%|██████▌   | 7192/11049 [1:14:04<39:24,  1.63it/s]
                                                      
{'loss': 0.2101, 'grad_norm': 0.5839978456497192, 'learning_rate': 3.274899320653563e-06, 'epoch': 1.95}

 65%|██████▌   | 7192/11049 [1:14:04<39:24,  1.63it/s]
 65%|██████▌   | 7193/11049 [1:14:04<39:23,  1.63it/s]
                                                      
{'loss': 0.1966, 'grad_norm': 0.5527832508087158, 'learning_rate': 3.2734167619356237e-06, 'epoch': 1.95}

 65%|██████▌   | 7193/11049 [1:14:04<39:23,  1.63it/s]
 65%|██████▌   | 7194/11049 [1:14:05<39:22,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.5308157205581665, 'learning_rate': 3.271934375549327e-06, 'epoch': 1.95}

 65%|██████▌   | 7194/11049 [1:14:05<39:22,  1.63it/s]
 65%|██████▌   | 7195/11049 [1:14:06<39:23,  1.63it/s]
                                                      
{'loss': 0.2175, 'grad_norm': 0.5922306180000305, 'learning_rate': 3.2704521616426344e-06, 'epoch': 1.95}

 65%|██████▌   | 7195/11049 [1:14:06<39:23,  1.63it/s]
 65%|██████▌   | 7196/11049 [1:14:06<39:22,  1.63it/s]
                                                      
{'loss': 0.1855, 'grad_norm': 0.5287342667579651, 'learning_rate': 3.2689701203634843e-06, 'epoch': 1.95}

 65%|██████▌   | 7196/11049 [1:14:06<39:22,  1.63it/s]
 65%|██████▌   | 7197/11049 [1:14:07<39:22,  1.63it/s]
                                                      
{'loss': 0.1613, 'grad_norm': 0.4653519093990326, 'learning_rate': 3.2674882518598027e-06, 'epoch': 1.95}

 65%|██████▌   | 7197/11049 [1:14:07<39:22,  1.63it/s]
 65%|██████▌   | 7198/11049 [1:14:07<39:21,  1.63it/s]
                                                      
{'loss': 0.1984, 'grad_norm': 0.49320539832115173, 'learning_rate': 3.2660065562794906e-06, 'epoch': 1.95}

 65%|██████▌   | 7198/11049 [1:14:07<39:21,  1.63it/s]
 65%|██████▌   | 7199/11049 [1:14:08<39:21,  1.63it/s]
                                                      
{'loss': 0.2726, 'grad_norm': 0.8287689089775085, 'learning_rate': 3.2645250337704437e-06, 'epoch': 1.95}

 65%|██████▌   | 7199/11049 [1:14:08<39:21,  1.63it/s]
 65%|██████▌   | 7200/11049 [1:14:09<39:20,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.4587124288082123, 'learning_rate': 3.2630436844805303e-06, 'epoch': 1.95}

 65%|██████▌   | 7200/11049 [1:14:09<39:20,  1.63it/s]
 65%|██████▌   | 7201/11049 [1:14:09<39:20,  1.63it/s]
                                                      
{'loss': 0.2606, 'grad_norm': 0.6925164461135864, 'learning_rate': 3.2615625085576062e-06, 'epoch': 1.96}

 65%|██████▌   | 7201/11049 [1:14:09<39:20,  1.63it/s]
 65%|██████▌   | 7202/11049 [1:14:10<39:18,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.5803421139717102, 'learning_rate': 3.2600815061495085e-06, 'epoch': 1.96}

 65%|██████▌   | 7202/11049 [1:14:10<39:18,  1.63it/s]
 65%|██████▌   | 7203/11049 [1:14:10<39:17,  1.63it/s]
                                                      
{'loss': 0.2873, 'grad_norm': 0.5337466597557068, 'learning_rate': 3.258600677404057e-06, 'epoch': 1.96}

 65%|██████▌   | 7203/11049 [1:14:11<39:17,  1.63it/s]
 65%|██████▌   | 7204/11049 [1:14:11<39:17,  1.63it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.6053942441940308, 'learning_rate': 3.2571200224690548e-06, 'epoch': 1.96}

 65%|██████▌   | 7204/11049 [1:14:11<39:17,  1.63it/s]
 65%|██████▌   | 7205/11049 [1:14:12<39:16,  1.63it/s]
                                                      
{'loss': 0.2168, 'grad_norm': 0.5668114423751831, 'learning_rate': 3.255639541492287e-06, 'epoch': 1.96}

 65%|██████▌   | 7205/11049 [1:14:12<39:16,  1.63it/s]
 65%|██████▌   | 7206/11049 [1:14:12<39:17,  1.63it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.5151408910751343, 'learning_rate': 3.2541592346215213e-06, 'epoch': 1.96}

 65%|██████▌   | 7206/11049 [1:14:12<39:17,  1.63it/s]
 65%|██████▌   | 7207/11049 [1:14:13<39:15,  1.63it/s]
                                                      
{'loss': 0.2473, 'grad_norm': 0.6658587455749512, 'learning_rate': 3.252679102004509e-06, 'epoch': 1.96}

 65%|██████▌   | 7207/11049 [1:14:13<39:15,  1.63it/s]
 65%|██████▌   | 7208/11049 [1:14:13<39:14,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.5301247239112854, 'learning_rate': 3.2511991437889827e-06, 'epoch': 1.96}

 65%|██████▌   | 7208/11049 [1:14:14<39:14,  1.63it/s]
 65%|██████▌   | 7209/11049 [1:14:14<39:14,  1.63it/s]
                                                      
{'loss': 0.1491, 'grad_norm': 0.4573846757411957, 'learning_rate': 3.249719360122659e-06, 'epoch': 1.96}

 65%|██████▌   | 7209/11049 [1:14:14<39:14,  1.63it/s]
 65%|██████▌   | 7210/11049 [1:14:15<39:13,  1.63it/s]
                                                      
{'loss': 0.1726, 'grad_norm': 0.4674282968044281, 'learning_rate': 3.248239751153235e-06, 'epoch': 1.96}

 65%|██████▌   | 7210/11049 [1:14:15<39:13,  1.63it/s]
 65%|██████▌   | 7211/11049 [1:14:15<39:14,  1.63it/s]
                                                      
{'loss': 0.2117, 'grad_norm': 0.5760438442230225, 'learning_rate': 3.2467603170283925e-06, 'epoch': 1.96}

 65%|██████▌   | 7211/11049 [1:14:15<39:14,  1.63it/s]
 65%|██████▌   | 7212/11049 [1:14:16<40:20,  1.59it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.5000552535057068, 'learning_rate': 3.245281057895795e-06, 'epoch': 1.96}

 65%|██████▌   | 7212/11049 [1:14:16<40:20,  1.59it/s]
 65%|██████▌   | 7213/11049 [1:14:17<40:02,  1.60it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5320820808410645, 'learning_rate': 3.243801973903089e-06, 'epoch': 1.96}

 65%|██████▌   | 7213/11049 [1:14:17<40:02,  1.60it/s]
 65%|██████▌   | 7214/11049 [1:14:17<39:50,  1.60it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.5678495764732361, 'learning_rate': 3.2423230651979008e-06, 'epoch': 1.96}

 65%|██████▌   | 7214/11049 [1:14:17<39:50,  1.60it/s]
 65%|██████▌   | 7215/11049 [1:14:18<39:37,  1.61it/s]
                                                      
{'loss': 0.234, 'grad_norm': 0.6955274939537048, 'learning_rate': 3.2408443319278445e-06, 'epoch': 1.96}

 65%|██████▌   | 7215/11049 [1:14:18<39:37,  1.61it/s]
 65%|██████▌   | 7216/11049 [1:14:18<39:28,  1.62it/s]
                                                      
{'loss': 0.1345, 'grad_norm': 0.4430280923843384, 'learning_rate': 3.2393657742405116e-06, 'epoch': 1.96}

 65%|██████▌   | 7216/11049 [1:14:19<39:28,  1.62it/s]
 65%|██████▌   | 7217/11049 [1:14:19<39:22,  1.62it/s]
                                                      
{'loss': 0.1879, 'grad_norm': 0.5254408121109009, 'learning_rate': 3.23788739228348e-06, 'epoch': 1.96}

 65%|██████▌   | 7217/11049 [1:14:19<39:22,  1.62it/s]
 65%|██████▌   | 7218/11049 [1:14:20<39:17,  1.62it/s]
                                                      
{'loss': 0.1736, 'grad_norm': 0.46328139305114746, 'learning_rate': 3.2364091862043045e-06, 'epoch': 1.96}

 65%|██████▌   | 7218/11049 [1:14:20<39:17,  1.62it/s]
 65%|██████▌   | 7219/11049 [1:14:20<39:14,  1.63it/s]
                                                      
{'loss': 0.2381, 'grad_norm': 0.6160288453102112, 'learning_rate': 3.23493115615053e-06, 'epoch': 1.96}

 65%|██████▌   | 7219/11049 [1:14:20<39:14,  1.63it/s]
 65%|██████▌   | 7220/11049 [1:14:21<39:12,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.47727125883102417, 'learning_rate': 3.2334533022696786e-06, 'epoch': 1.96}

 65%|██████▌   | 7220/11049 [1:14:21<39:12,  1.63it/s]
 65%|██████▌   | 7221/11049 [1:14:22<39:12,  1.63it/s]
                                                      
{'loss': 0.2041, 'grad_norm': 0.5469974875450134, 'learning_rate': 3.2319756247092552e-06, 'epoch': 1.96}

 65%|██████▌   | 7221/11049 [1:14:22<39:12,  1.63it/s]
 65%|██████▌   | 7222/11049 [1:14:22<39:10,  1.63it/s]
                                                      
{'loss': 0.2054, 'grad_norm': 0.5423173308372498, 'learning_rate': 3.230498123616747e-06, 'epoch': 1.96}

 65%|██████▌   | 7222/11049 [1:14:22<39:10,  1.63it/s]
 65%|██████▌   | 7223/11049 [1:14:23<39:08,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.6452271938323975, 'learning_rate': 3.2290207991396292e-06, 'epoch': 1.96}

 65%|██████▌   | 7223/11049 [1:14:23<39:08,  1.63it/s]
 65%|██████▌   | 7224/11049 [1:14:23<39:06,  1.63it/s]
                                                      
{'loss': 0.2232, 'grad_norm': 0.5884367227554321, 'learning_rate': 3.22754365142535e-06, 'epoch': 1.96}

 65%|██████▌   | 7224/11049 [1:14:24<39:06,  1.63it/s]
 65%|██████▌   | 7225/11049 [1:14:24<39:06,  1.63it/s]
                                                      
{'loss': 0.1643, 'grad_norm': 0.46489429473876953, 'learning_rate': 3.226066680621347e-06, 'epoch': 1.96}

 65%|██████▌   | 7225/11049 [1:14:24<39:06,  1.63it/s]
 65%|██████▌   | 7226/11049 [1:14:25<39:06,  1.63it/s]
                                                      
{'loss': 0.2327, 'grad_norm': 0.7105047106742859, 'learning_rate': 3.2245898868750345e-06, 'epoch': 1.96}

 65%|██████▌   | 7226/11049 [1:14:25<39:06,  1.63it/s]
 65%|██████▌   | 7227/11049 [1:14:25<39:05,  1.63it/s]
                                                      
{'loss': 0.2126, 'grad_norm': 0.5420989394187927, 'learning_rate': 3.2231132703338176e-06, 'epoch': 1.96}

 65%|██████▌   | 7227/11049 [1:14:25<39:05,  1.63it/s]
 65%|██████▌   | 7228/11049 [1:14:26<39:04,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.5632860064506531, 'learning_rate': 3.2216368311450773e-06, 'epoch': 1.96}

 65%|██████▌   | 7228/11049 [1:14:26<39:04,  1.63it/s]
 65%|██████▌   | 7229/11049 [1:14:26<39:03,  1.63it/s]
                                                      
{'loss': 0.2003, 'grad_norm': 0.5480207800865173, 'learning_rate': 3.2201605694561756e-06, 'epoch': 1.96}

 65%|██████▌   | 7229/11049 [1:14:27<39:03,  1.63it/s]
 65%|██████▌   | 7230/11049 [1:14:27<39:02,  1.63it/s]
                                                      
{'loss': 0.2131, 'grad_norm': 0.5608506798744202, 'learning_rate': 3.2186844854144584e-06, 'epoch': 1.96}

 65%|██████▌   | 7230/11049 [1:14:27<39:02,  1.63it/s]
 65%|██████▌   | 7231/11049 [1:14:28<39:01,  1.63it/s]
                                                      
{'loss': 0.2014, 'grad_norm': 0.5713925957679749, 'learning_rate': 3.217208579167259e-06, 'epoch': 1.96}

 65%|██████▌   | 7231/11049 [1:14:28<39:01,  1.63it/s]
 65%|██████▌   | 7232/11049 [1:14:28<39:01,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.4701998233795166, 'learning_rate': 3.2157328508618873e-06, 'epoch': 1.96}

 65%|██████▌   | 7232/11049 [1:14:28<39:01,  1.63it/s]
 65%|██████▌   | 7233/11049 [1:14:29<38:59,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.49209216237068176, 'learning_rate': 3.2142573006456377e-06, 'epoch': 1.96}

 65%|██████▌   | 7233/11049 [1:14:29<38:59,  1.63it/s]
 65%|██████▌   | 7234/11049 [1:14:30<39:00,  1.63it/s]
                                                      
{'loss': 0.1761, 'grad_norm': 0.5486156344413757, 'learning_rate': 3.2127819286657815e-06, 'epoch': 1.96}

 65%|██████▌   | 7234/11049 [1:14:30<39:00,  1.63it/s]
 65%|██████▌   | 7235/11049 [1:14:30<38:58,  1.63it/s]
                                                      
{'loss': 0.2195, 'grad_norm': 0.6159085631370544, 'learning_rate': 3.211306735069582e-06, 'epoch': 1.96}

 65%|██████▌   | 7235/11049 [1:14:30<38:58,  1.63it/s]
 65%|██████▌   | 7236/11049 [1:14:31<38:57,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.6065266132354736, 'learning_rate': 3.209831720004277e-06, 'epoch': 1.96}

 65%|██████▌   | 7236/11049 [1:14:31<38:57,  1.63it/s]
 65%|██████▌   | 7237/11049 [1:14:31<38:57,  1.63it/s]
                                                      
{'loss': 0.166, 'grad_norm': 0.4602608382701874, 'learning_rate': 3.2083568836170906e-06, 'epoch': 1.96}

 65%|██████▌   | 7237/11049 [1:14:31<38:57,  1.63it/s]
 66%|██████▌   | 7238/11049 [1:14:32<38:58,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.498244971036911, 'learning_rate': 3.2068822260552247e-06, 'epoch': 1.97}

 66%|██████▌   | 7238/11049 [1:14:32<38:58,  1.63it/s]
 66%|██████▌   | 7239/11049 [1:14:33<38:56,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.48248639702796936, 'learning_rate': 3.2054077474658686e-06, 'epoch': 1.97}

 66%|██████▌   | 7239/11049 [1:14:33<38:56,  1.63it/s]
 66%|██████▌   | 7240/11049 [1:14:33<38:56,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.5181230306625366, 'learning_rate': 3.20393344799619e-06, 'epoch': 1.97}

 66%|██████▌   | 7240/11049 [1:14:33<38:56,  1.63it/s]
 66%|██████▌   | 7241/11049 [1:14:34<38:54,  1.63it/s]
                                                      
{'loss': 0.2247, 'grad_norm': 0.6108338832855225, 'learning_rate': 3.20245932779334e-06, 'epoch': 1.97}

 66%|██████▌   | 7241/11049 [1:14:34<38:54,  1.63it/s]
 66%|██████▌   | 7242/11049 [1:14:34<38:54,  1.63it/s]
                                                      
{'loss': 0.2324, 'grad_norm': 0.6282044649124146, 'learning_rate': 3.2009853870044515e-06, 'epoch': 1.97}

 66%|██████▌   | 7242/11049 [1:14:35<38:54,  1.63it/s]
 66%|██████▌   | 7243/11049 [1:14:35<38:53,  1.63it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.5092538595199585, 'learning_rate': 3.19951162577664e-06, 'epoch': 1.97}

 66%|██████▌   | 7243/11049 [1:14:35<38:53,  1.63it/s]
 66%|██████▌   | 7244/11049 [1:14:36<38:53,  1.63it/s]
                                                      
{'loss': 0.1962, 'grad_norm': 0.5005620121955872, 'learning_rate': 3.1980380442570034e-06, 'epoch': 1.97}

 66%|██████▌   | 7244/11049 [1:14:36<38:53,  1.63it/s]
 66%|██████▌   | 7245/11049 [1:14:36<38:52,  1.63it/s]
                                                      
{'loss': 0.254, 'grad_norm': 0.5811136960983276, 'learning_rate': 3.1965646425926205e-06, 'epoch': 1.97}

 66%|██████▌   | 7245/11049 [1:14:36<38:52,  1.63it/s]
 66%|██████▌   | 7246/11049 [1:14:37<38:52,  1.63it/s]
                                                      
{'loss': 0.181, 'grad_norm': 0.5223585367202759, 'learning_rate': 3.1950914209305516e-06, 'epoch': 1.97}

 66%|██████▌   | 7246/11049 [1:14:37<38:52,  1.63it/s]
 66%|██████▌   | 7247/11049 [1:14:37<38:51,  1.63it/s]
                                                      
{'loss': 0.1702, 'grad_norm': 0.5077707767486572, 'learning_rate': 3.1936183794178414e-06, 'epoch': 1.97}

 66%|██████▌   | 7247/11049 [1:14:38<38:51,  1.63it/s]
 66%|██████▌   | 7248/11049 [1:14:38<38:50,  1.63it/s]
                                                      
{'loss': 0.1931, 'grad_norm': 0.6228213310241699, 'learning_rate': 3.1921455182015155e-06, 'epoch': 1.97}

 66%|██████▌   | 7248/11049 [1:14:38<38:50,  1.63it/s]
 66%|██████▌   | 7249/11049 [1:14:39<38:50,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.640734851360321, 'learning_rate': 3.190672837428581e-06, 'epoch': 1.97}

 66%|██████▌   | 7249/11049 [1:14:39<38:50,  1.63it/s]
 66%|██████▌   | 7250/11049 [1:14:39<38:50,  1.63it/s]
                                                      
{'loss': 0.1876, 'grad_norm': 0.5582331418991089, 'learning_rate': 3.1892003372460255e-06, 'epoch': 1.97}

 66%|██████▌   | 7250/11049 [1:14:39<38:50,  1.63it/s]
 66%|██████▌   | 7251/11049 [1:14:40<38:49,  1.63it/s]
                                                      
{'loss': 0.2429, 'grad_norm': 0.6069309711456299, 'learning_rate': 3.187728017800824e-06, 'epoch': 1.97}

 66%|██████▌   | 7251/11049 [1:14:40<38:49,  1.63it/s]
 66%|██████▌   | 7252/11049 [1:14:41<38:48,  1.63it/s]
                                                      
{'loss': 0.1396, 'grad_norm': 0.44407179951667786, 'learning_rate': 3.186255879239928e-06, 'epoch': 1.97}

 66%|██████▌   | 7252/11049 [1:14:41<38:48,  1.63it/s]
 66%|██████▌   | 7253/11049 [1:14:41<38:47,  1.63it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.5537787675857544, 'learning_rate': 3.1847839217102727e-06, 'epoch': 1.97}

 66%|██████▌   | 7253/11049 [1:14:41<38:47,  1.63it/s]
 66%|██████▌   | 7254/11049 [1:14:42<38:47,  1.63it/s]
                                                      
{'loss': 0.2493, 'grad_norm': 0.5885252356529236, 'learning_rate': 3.183312145358774e-06, 'epoch': 1.97}

 66%|██████▌   | 7254/11049 [1:14:42<38:47,  1.63it/s]
 66%|██████▌   | 7255/11049 [1:14:42<38:47,  1.63it/s]
                                                      
{'loss': 0.2066, 'grad_norm': 0.6173581480979919, 'learning_rate': 3.181840550332334e-06, 'epoch': 1.97}

 66%|██████▌   | 7255/11049 [1:14:43<38:47,  1.63it/s]
 66%|██████▌   | 7256/11049 [1:14:43<38:47,  1.63it/s]
                                                      
{'loss': 0.1352, 'grad_norm': 0.38482606410980225, 'learning_rate': 3.1803691367778324e-06, 'epoch': 1.97}

 66%|██████▌   | 7256/11049 [1:14:43<38:47,  1.63it/s]
 66%|██████▌   | 7257/11049 [1:14:44<38:46,  1.63it/s]
                                                      
{'loss': 0.1641, 'grad_norm': 0.46815621852874756, 'learning_rate': 3.178897904842132e-06, 'epoch': 1.97}

 66%|██████▌   | 7257/11049 [1:14:44<38:46,  1.63it/s]
 66%|██████▌   | 7258/11049 [1:14:44<38:49,  1.63it/s]
                                                      
{'loss': 0.2262, 'grad_norm': 0.6217669248580933, 'learning_rate': 3.1774268546720754e-06, 'epoch': 1.97}

 66%|██████▌   | 7258/11049 [1:14:44<38:49,  1.63it/s]
 66%|██████▌   | 7259/11049 [1:14:45<38:47,  1.63it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.48865392804145813, 'learning_rate': 3.175955986414495e-06, 'epoch': 1.97}

 66%|██████▌   | 7259/11049 [1:14:45<38:47,  1.63it/s]
 66%|██████▌   | 7260/11049 [1:14:45<38:45,  1.63it/s]
                                                      
{'loss': 0.199, 'grad_norm': 0.6018447875976562, 'learning_rate': 3.1744853002161945e-06, 'epoch': 1.97}

 66%|██████▌   | 7260/11049 [1:14:46<38:45,  1.63it/s]
 66%|██████▌   | 7261/11049 [1:14:46<38:44,  1.63it/s]
                                                      
{'loss': 0.2162, 'grad_norm': 0.542577862739563, 'learning_rate': 3.1730147962239655e-06, 'epoch': 1.97}

 66%|██████▌   | 7261/11049 [1:14:46<38:44,  1.63it/s]
 66%|██████▌   | 7262/11049 [1:14:47<38:43,  1.63it/s]
                                                      
{'loss': 0.2272, 'grad_norm': 0.5966135263442993, 'learning_rate': 3.171544474584579e-06, 'epoch': 1.97}

 66%|██████▌   | 7262/11049 [1:14:47<38:43,  1.63it/s]
 66%|██████▌   | 7263/11049 [1:14:47<38:42,  1.63it/s]
                                                      
{'loss': 0.1777, 'grad_norm': 0.5484743714332581, 'learning_rate': 3.170074335444792e-06, 'epoch': 1.97}

 66%|██████▌   | 7263/11049 [1:14:47<38:42,  1.63it/s]
 66%|██████▌   | 7264/11049 [1:14:48<38:41,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.4785432517528534, 'learning_rate': 3.16860437895134e-06, 'epoch': 1.97}

 66%|██████▌   | 7264/11049 [1:14:48<38:41,  1.63it/s]
 66%|██████▌   | 7265/11049 [1:14:49<39:39,  1.59it/s]
                                                      
{'loss': 0.2105, 'grad_norm': 0.5277689099311829, 'learning_rate': 3.167134605250938e-06, 'epoch': 1.97}

 66%|██████▌   | 7265/11049 [1:14:49<39:39,  1.59it/s]
 66%|██████▌   | 7266/11049 [1:14:49<39:32,  1.59it/s]
                                                      
{'loss': 0.2227, 'grad_norm': 0.5788359045982361, 'learning_rate': 3.1656650144902834e-06, 'epoch': 1.97}

 66%|██████▌   | 7266/11049 [1:14:49<39:32,  1.59it/s]
 66%|██████▌   | 7267/11049 [1:14:50<39:16,  1.61it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.47000375390052795, 'learning_rate': 3.164195606816063e-06, 'epoch': 1.97}

 66%|██████▌   | 7267/11049 [1:14:50<39:16,  1.61it/s]
 66%|██████▌   | 7268/11049 [1:14:50<39:16,  1.60it/s]
                                                      
{'loss': 0.2099, 'grad_norm': 0.5145304799079895, 'learning_rate': 3.1627263823749366e-06, 'epoch': 1.97}

 66%|██████▌   | 7268/11049 [1:14:51<39:16,  1.60it/s]
 66%|██████▌   | 7269/11049 [1:14:51<39:06,  1.61it/s]
                                                      
{'loss': 0.1803, 'grad_norm': 0.5036191344261169, 'learning_rate': 3.1612573413135494e-06, 'epoch': 1.97}

 66%|██████▌   | 7269/11049 [1:14:51<39:06,  1.61it/s]
 66%|██████▌   | 7270/11049 [1:14:52<38:57,  1.62it/s]
                                                      
{'loss': 0.2259, 'grad_norm': 0.5005730986595154, 'learning_rate': 3.1597884837785246e-06, 'epoch': 1.97}

 66%|██████▌   | 7270/11049 [1:14:52<38:57,  1.62it/s]
 66%|██████▌   | 7271/11049 [1:14:52<38:53,  1.62it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.5387458205223083, 'learning_rate': 3.1583198099164745e-06, 'epoch': 1.97}

 66%|██████▌   | 7271/11049 [1:14:52<38:53,  1.62it/s]
 66%|██████▌   | 7272/11049 [1:14:53<38:47,  1.62it/s]
                                                      
{'loss': 0.2362, 'grad_norm': 0.5708620548248291, 'learning_rate': 3.156851319873986e-06, 'epoch': 1.97}

 66%|██████▌   | 7272/11049 [1:14:53<38:47,  1.62it/s]
 66%|██████▌   | 7273/11049 [1:14:54<38:43,  1.62it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.5179815888404846, 'learning_rate': 3.155383013797631e-06, 'epoch': 1.97}

 66%|██████▌   | 7273/11049 [1:14:54<38:43,  1.62it/s]
 66%|██████▌   | 7274/11049 [1:14:54<38:43,  1.62it/s]
                                                      
{'loss': 0.1962, 'grad_norm': 0.5041226744651794, 'learning_rate': 3.1539148918339614e-06, 'epoch': 1.98}

 66%|██████▌   | 7274/11049 [1:14:54<38:43,  1.62it/s]
 66%|██████▌   | 7275/11049 [1:14:55<38:41,  1.63it/s]
                                                      
{'loss': 0.1989, 'grad_norm': 0.49950110912323, 'learning_rate': 3.152446954129512e-06, 'epoch': 1.98}

 66%|██████▌   | 7275/11049 [1:14:55<38:41,  1.63it/s]
 66%|██████▌   | 7276/11049 [1:14:55<38:38,  1.63it/s]
                                                      
{'loss': 0.2156, 'grad_norm': 0.5873818397521973, 'learning_rate': 3.1509792008308003e-06, 'epoch': 1.98}

 66%|██████▌   | 7276/11049 [1:14:55<38:38,  1.63it/s]
 66%|██████▌   | 7277/11049 [1:14:56<39:35,  1.59it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.5154112577438354, 'learning_rate': 3.149511632084322e-06, 'epoch': 1.98}

 66%|██████▌   | 7277/11049 [1:14:56<39:35,  1.59it/s]
 66%|██████▌   | 7278/11049 [1:14:57<39:28,  1.59it/s]
                                                      
{'loss': 0.1846, 'grad_norm': 0.6026811599731445, 'learning_rate': 3.148044248036557e-06, 'epoch': 1.98}

 66%|██████▌   | 7278/11049 [1:14:57<39:28,  1.59it/s]
 66%|██████▌   | 7279/11049 [1:14:57<39:14,  1.60it/s]
                                                      
{'loss': 0.1897, 'grad_norm': 0.5027973651885986, 'learning_rate': 3.1465770488339664e-06, 'epoch': 1.98}

 66%|██████▌   | 7279/11049 [1:14:57<39:14,  1.60it/s]
 66%|██████▌   | 7280/11049 [1:14:58<39:01,  1.61it/s]
                                                      
{'loss': 0.2766, 'grad_norm': 0.626211404800415, 'learning_rate': 3.1451100346229923e-06, 'epoch': 1.98}

 66%|██████▌   | 7280/11049 [1:14:58<39:01,  1.61it/s]
 66%|██████▌   | 7281/11049 [1:14:58<38:53,  1.61it/s]
                                                      
{'loss': 0.2274, 'grad_norm': 0.6238110065460205, 'learning_rate': 3.1436432055500583e-06, 'epoch': 1.98}

 66%|██████▌   | 7281/11049 [1:14:59<38:53,  1.61it/s]
 66%|██████▌   | 7282/11049 [1:14:59<38:45,  1.62it/s]
                                                      
{'loss': 0.237, 'grad_norm': 0.6091189980506897, 'learning_rate': 3.1421765617615683e-06, 'epoch': 1.98}

 66%|██████▌   | 7282/11049 [1:14:59<38:45,  1.62it/s]
 66%|██████▌   | 7283/11049 [1:15:00<38:43,  1.62it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.512992799282074, 'learning_rate': 3.1407101034039133e-06, 'epoch': 1.98}

 66%|██████▌   | 7283/11049 [1:15:00<38:43,  1.62it/s]
 66%|██████▌   | 7284/11049 [1:15:00<38:39,  1.62it/s]
                                                      
{'loss': 0.2453, 'grad_norm': 0.6081024408340454, 'learning_rate': 3.1392438306234585e-06, 'epoch': 1.98}

 66%|██████▌   | 7284/11049 [1:15:00<38:39,  1.62it/s]
 66%|██████▌   | 7285/11049 [1:15:01<38:36,  1.63it/s]
                                                      
{'loss': 0.2393, 'grad_norm': 0.6409686207771301, 'learning_rate': 3.137777743566554e-06, 'epoch': 1.98}

 66%|██████▌   | 7285/11049 [1:15:01<38:36,  1.63it/s]
 66%|██████▌   | 7286/11049 [1:15:02<38:34,  1.63it/s]
                                                      
{'loss': 0.1983, 'grad_norm': 0.5495205521583557, 'learning_rate': 3.1363118423795312e-06, 'epoch': 1.98}

 66%|██████▌   | 7286/11049 [1:15:02<38:34,  1.63it/s]
 66%|██████▌   | 7287/11049 [1:15:02<38:31,  1.63it/s]
                                                      
{'loss': 0.1546, 'grad_norm': 0.4622156322002411, 'learning_rate': 3.134846127208704e-06, 'epoch': 1.98}

 66%|██████▌   | 7287/11049 [1:15:02<38:31,  1.63it/s]
 66%|██████▌   | 7288/11049 [1:15:03<38:33,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.6332626342773438, 'learning_rate': 3.1333805982003657e-06, 'epoch': 1.98}

 66%|██████▌   | 7288/11049 [1:15:03<38:33,  1.63it/s]
 66%|██████▌   | 7289/11049 [1:15:03<38:32,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.5666394233703613, 'learning_rate': 3.131915255500792e-06, 'epoch': 1.98}

 66%|██████▌   | 7289/11049 [1:15:04<38:32,  1.63it/s]
 66%|██████▌   | 7290/11049 [1:15:04<38:29,  1.63it/s]
                                                      
{'loss': 0.2579, 'grad_norm': 0.6228051781654358, 'learning_rate': 3.130450099256239e-06, 'epoch': 1.98}

 66%|██████▌   | 7290/11049 [1:15:04<38:29,  1.63it/s]
 66%|██████▌   | 7291/11049 [1:15:05<38:27,  1.63it/s]
                                                      
{'loss': 0.2054, 'grad_norm': 0.5282897353172302, 'learning_rate': 3.128985129612947e-06, 'epoch': 1.98}

 66%|██████▌   | 7291/11049 [1:15:05<38:27,  1.63it/s]
 66%|██████▌   | 7292/11049 [1:15:05<38:27,  1.63it/s]
                                                      
{'loss': 0.2493, 'grad_norm': 0.6453180313110352, 'learning_rate': 3.127520346717135e-06, 'epoch': 1.98}

 66%|██████▌   | 7292/11049 [1:15:05<38:27,  1.63it/s]
 66%|██████▌   | 7293/11049 [1:15:06<38:28,  1.63it/s]
                                                      
{'loss': 0.1917, 'grad_norm': 0.5359817147254944, 'learning_rate': 3.1260557507150036e-06, 'epoch': 1.98}

 66%|██████▌   | 7293/11049 [1:15:06<38:28,  1.63it/s]
 66%|██████▌   | 7294/11049 [1:15:06<38:25,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.5198395252227783, 'learning_rate': 3.124591341752734e-06, 'epoch': 1.98}

 66%|██████▌   | 7294/11049 [1:15:07<38:25,  1.63it/s]
 66%|██████▌   | 7295/11049 [1:15:07<38:23,  1.63it/s]
                                                      
{'loss': 0.2174, 'grad_norm': 0.5733126997947693, 'learning_rate': 3.1231271199764943e-06, 'epoch': 1.98}

 66%|██████▌   | 7295/11049 [1:15:07<38:23,  1.63it/s]
 66%|██████▌   | 7296/11049 [1:15:08<38:22,  1.63it/s]
                                                      
{'loss': 0.1995, 'grad_norm': 0.5290693640708923, 'learning_rate': 3.121663085532427e-06, 'epoch': 1.98}

 66%|██████▌   | 7296/11049 [1:15:08<38:22,  1.63it/s]
 66%|██████▌   | 7297/11049 [1:15:08<38:20,  1.63it/s]
                                                      
{'loss': 0.1927, 'grad_norm': 0.5637447237968445, 'learning_rate': 3.120199238566658e-06, 'epoch': 1.98}

 66%|██████▌   | 7297/11049 [1:15:08<38:20,  1.63it/s]
 66%|██████▌   | 7298/11049 [1:15:09<38:20,  1.63it/s]
                                                      
{'loss': 0.2267, 'grad_norm': 0.6022014021873474, 'learning_rate': 3.118735579225293e-06, 'epoch': 1.98}

 66%|██████▌   | 7298/11049 [1:15:09<38:20,  1.63it/s]
 66%|██████▌   | 7299/11049 [1:15:10<38:20,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.5227321982383728, 'learning_rate': 3.1172721076544265e-06, 'epoch': 1.98}

 66%|██████▌   | 7299/11049 [1:15:10<38:20,  1.63it/s]
 66%|██████▌   | 7300/11049 [1:15:10<38:19,  1.63it/s]
                                                      
{'loss': 0.1861, 'grad_norm': 0.5210347175598145, 'learning_rate': 3.115808824000126e-06, 'epoch': 1.98}

 66%|██████▌   | 7300/11049 [1:15:10<38:19,  1.63it/s]
 66%|██████▌   | 7301/11049 [1:15:11<38:22,  1.63it/s]
                                                      
{'loss': 0.2697, 'grad_norm': 0.7350857257843018, 'learning_rate': 3.114345728408442e-06, 'epoch': 1.98}

 66%|██████▌   | 7301/11049 [1:15:11<38:22,  1.63it/s]
 66%|██████▌   | 7302/11049 [1:15:11<38:20,  1.63it/s]
                                                      
{'loss': 0.2333, 'grad_norm': 0.5687047243118286, 'learning_rate': 3.112882821025407e-06, 'epoch': 1.98}

 66%|██████▌   | 7302/11049 [1:15:12<38:20,  1.63it/s]
 66%|██████▌   | 7303/11049 [1:15:12<38:18,  1.63it/s]
                                                      
{'loss': 0.1889, 'grad_norm': 0.5348371863365173, 'learning_rate': 3.111420101997037e-06, 'epoch': 1.98}

 66%|██████▌   | 7303/11049 [1:15:12<38:18,  1.63it/s]
 66%|██████▌   | 7304/11049 [1:15:13<38:17,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5411993265151978, 'learning_rate': 3.1099575714693264e-06, 'epoch': 1.98}

 66%|██████▌   | 7304/11049 [1:15:13<38:17,  1.63it/s]
 66%|██████▌   | 7305/11049 [1:15:13<38:17,  1.63it/s]
                                                      
{'loss': 0.2536, 'grad_norm': 0.6930596828460693, 'learning_rate': 3.1084952295882533e-06, 'epoch': 1.98}

 66%|██████▌   | 7305/11049 [1:15:13<38:17,  1.63it/s]
 66%|██████▌   | 7306/11049 [1:15:14<38:18,  1.63it/s]
                                                      
{'loss': 0.2263, 'grad_norm': 0.583876371383667, 'learning_rate': 3.107033076499769e-06, 'epoch': 1.98}

 66%|██████▌   | 7306/11049 [1:15:14<38:18,  1.63it/s]
 66%|██████▌   | 7307/11049 [1:15:14<38:16,  1.63it/s]
                                                      
{'loss': 0.2178, 'grad_norm': 0.589346706867218, 'learning_rate': 3.105571112349819e-06, 'epoch': 1.98}

 66%|██████▌   | 7307/11049 [1:15:15<38:16,  1.63it/s]
 66%|██████▌   | 7308/11049 [1:15:15<38:15,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.55281001329422, 'learning_rate': 3.10410933728432e-06, 'epoch': 1.98}

 66%|██████▌   | 7308/11049 [1:15:15<38:15,  1.63it/s]
 66%|██████▌   | 7309/11049 [1:15:16<38:14,  1.63it/s]
                                                      
{'loss': 0.219, 'grad_norm': 0.6006186604499817, 'learning_rate': 3.102647751449174e-06, 'epoch': 1.98}

 66%|██████▌   | 7309/11049 [1:15:16<38:14,  1.63it/s]
 66%|██████▌   | 7310/11049 [1:15:16<38:13,  1.63it/s]
                                                      
{'loss': 0.1812, 'grad_norm': 0.502402126789093, 'learning_rate': 3.101186354990261e-06, 'epoch': 1.98}

 66%|██████▌   | 7310/11049 [1:15:16<38:13,  1.63it/s]
 66%|██████▌   | 7311/11049 [1:15:17<38:14,  1.63it/s]
                                                      
{'loss': 0.1554, 'grad_norm': 0.5114145874977112, 'learning_rate': 3.099725148053447e-06, 'epoch': 1.99}

 66%|██████▌   | 7311/11049 [1:15:17<38:14,  1.63it/s]
 66%|██████▌   | 7312/11049 [1:15:18<38:11,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.478100061416626, 'learning_rate': 3.098264130784574e-06, 'epoch': 1.99}

 66%|██████▌   | 7312/11049 [1:15:18<38:11,  1.63it/s]
 66%|██████▌   | 7313/11049 [1:15:18<38:10,  1.63it/s]
                                                      
{'loss': 0.2438, 'grad_norm': 0.6223754286766052, 'learning_rate': 3.096803303329469e-06, 'epoch': 1.99}

 66%|██████▌   | 7313/11049 [1:15:18<38:10,  1.63it/s]
 66%|██████▌   | 7314/11049 [1:15:19<38:10,  1.63it/s]
                                                      
{'loss': 0.2227, 'grad_norm': 0.5605348348617554, 'learning_rate': 3.0953426658339364e-06, 'epoch': 1.99}

 66%|██████▌   | 7314/11049 [1:15:19<38:10,  1.63it/s]
 66%|██████▌   | 7315/11049 [1:15:19<38:09,  1.63it/s]
                                                      
{'loss': 0.2238, 'grad_norm': 0.6102259755134583, 'learning_rate': 3.0938822184437654e-06, 'epoch': 1.99}

 66%|██████▌   | 7315/11049 [1:15:19<38:09,  1.63it/s]
 66%|██████▌   | 7316/11049 [1:15:20<38:14,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.55083167552948, 'learning_rate': 3.0924219613047237e-06, 'epoch': 1.99}

 66%|██████▌   | 7316/11049 [1:15:20<38:14,  1.63it/s]
 66%|██████▌   | 7317/11049 [1:15:21<38:11,  1.63it/s]
                                                      
{'loss': 0.1721, 'grad_norm': 0.4869617521762848, 'learning_rate': 3.090961894562561e-06, 'epoch': 1.99}

 66%|██████▌   | 7317/11049 [1:15:21<38:11,  1.63it/s]
 66%|██████▌   | 7318/11049 [1:15:21<38:10,  1.63it/s]
                                                      
{'loss': 0.203, 'grad_norm': 0.5631552934646606, 'learning_rate': 3.0895020183630054e-06, 'epoch': 1.99}

 66%|██████▌   | 7318/11049 [1:15:21<38:10,  1.63it/s]
 66%|██████▌   | 7319/11049 [1:15:22<38:09,  1.63it/s]
                                                      
{'loss': 0.1925, 'grad_norm': 0.5125401616096497, 'learning_rate': 3.0880423328517723e-06, 'epoch': 1.99}

 66%|██████▌   | 7319/11049 [1:15:22<38:09,  1.63it/s]
 66%|██████▋   | 7320/11049 [1:15:22<38:07,  1.63it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.5706225037574768, 'learning_rate': 3.0865828381745515e-06, 'epoch': 1.99}

 66%|██████▋   | 7320/11049 [1:15:23<38:07,  1.63it/s]
 66%|██████▋   | 7321/11049 [1:15:23<38:08,  1.63it/s]
                                                      
{'loss': 0.2243, 'grad_norm': 0.5576979517936707, 'learning_rate': 3.0851235344770176e-06, 'epoch': 1.99}

 66%|██████▋   | 7321/11049 [1:15:23<38:08,  1.63it/s]
 66%|██████▋   | 7322/11049 [1:15:24<38:06,  1.63it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.508560061454773, 'learning_rate': 3.083664421904824e-06, 'epoch': 1.99}

 66%|██████▋   | 7322/11049 [1:15:24<38:06,  1.63it/s]
 66%|██████▋   | 7323/11049 [1:15:24<38:06,  1.63it/s]
                                                      
{'loss': 0.1917, 'grad_norm': 0.5213317275047302, 'learning_rate': 3.0822055006036045e-06, 'epoch': 1.99}

 66%|██████▋   | 7323/11049 [1:15:24<38:06,  1.63it/s]
 66%|██████▋   | 7324/11049 [1:15:25<38:05,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5954374074935913, 'learning_rate': 3.080746770718978e-06, 'epoch': 1.99}

 66%|██████▋   | 7324/11049 [1:15:25<38:05,  1.63it/s]
 66%|██████▋   | 7325/11049 [1:15:25<38:04,  1.63it/s]
                                                      
{'loss': 0.1909, 'grad_norm': 0.49230921268463135, 'learning_rate': 3.07928823239654e-06, 'epoch': 1.99}

 66%|██████▋   | 7325/11049 [1:15:26<38:04,  1.63it/s]
 66%|██████▋   | 7326/11049 [1:15:26<38:06,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.4857725501060486, 'learning_rate': 3.077829885781869e-06, 'epoch': 1.99}

 66%|██████▋   | 7326/11049 [1:15:26<38:06,  1.63it/s]
 66%|██████▋   | 7327/11049 [1:15:27<38:04,  1.63it/s]
                                                      
{'loss': 0.1822, 'grad_norm': 0.503585159778595, 'learning_rate': 3.0763717310205223e-06, 'epoch': 1.99}

 66%|██████▋   | 7327/11049 [1:15:27<38:04,  1.63it/s]
 66%|██████▋   | 7328/11049 [1:15:27<38:04,  1.63it/s]
                                                      
{'loss': 0.2484, 'grad_norm': 0.5932443141937256, 'learning_rate': 3.0749137682580418e-06, 'epoch': 1.99}

 66%|██████▋   | 7328/11049 [1:15:27<38:04,  1.63it/s]
 66%|██████▋   | 7329/11049 [1:15:28<38:03,  1.63it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.5016605854034424, 'learning_rate': 3.073455997639946e-06, 'epoch': 1.99}

 66%|██████▋   | 7329/11049 [1:15:28<38:03,  1.63it/s]
 66%|██████▋   | 7330/11049 [1:15:29<38:01,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.515565812587738, 'learning_rate': 3.0719984193117368e-06, 'epoch': 1.99}

 66%|██████▋   | 7330/11049 [1:15:29<38:01,  1.63it/s]
 66%|██████▋   | 7331/11049 [1:15:29<38:03,  1.63it/s]
                                                      
{'loss': 0.2329, 'grad_norm': 0.6027389764785767, 'learning_rate': 3.0705410334188957e-06, 'epoch': 1.99}

 66%|██████▋   | 7331/11049 [1:15:29<38:03,  1.63it/s]
 66%|██████▋   | 7332/11049 [1:15:30<38:01,  1.63it/s]
                                                      
{'loss': 0.1513, 'grad_norm': 0.5160517692565918, 'learning_rate': 3.069083840106887e-06, 'epoch': 1.99}

 66%|██████▋   | 7332/11049 [1:15:30<38:01,  1.63it/s]
 66%|██████▋   | 7333/11049 [1:15:30<37:59,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.4944804012775421, 'learning_rate': 3.0676268395211532e-06, 'epoch': 1.99}

 66%|██████▋   | 7333/11049 [1:15:31<37:59,  1.63it/s]
 66%|██████▋   | 7334/11049 [1:15:31<37:59,  1.63it/s]
                                                      
{'loss': 0.2561, 'grad_norm': 0.6761361956596375, 'learning_rate': 3.0661700318071193e-06, 'epoch': 1.99}

 66%|██████▋   | 7334/11049 [1:15:31<37:59,  1.63it/s]
 66%|██████▋   | 7335/11049 [1:15:32<37:58,  1.63it/s]
                                                      
{'loss': 0.165, 'grad_norm': 0.5015007853507996, 'learning_rate': 3.064713417110188e-06, 'epoch': 1.99}

 66%|██████▋   | 7335/11049 [1:15:32<37:58,  1.63it/s]
 66%|██████▋   | 7336/11049 [1:15:32<37:57,  1.63it/s]
                                                      
{'loss': 0.2519, 'grad_norm': 0.5562114715576172, 'learning_rate': 3.06325699557575e-06, 'epoch': 1.99}

 66%|██████▋   | 7336/11049 [1:15:32<37:57,  1.63it/s]
 66%|██████▋   | 7337/11049 [1:15:33<37:55,  1.63it/s]
                                                      
{'loss': 0.2611, 'grad_norm': 0.6428337693214417, 'learning_rate': 3.0618007673491673e-06, 'epoch': 1.99}

 66%|██████▋   | 7337/11049 [1:15:33<37:55,  1.63it/s]
 66%|██████▋   | 7338/11049 [1:15:33<37:55,  1.63it/s]
                                                      
{'loss': 0.2412, 'grad_norm': 0.5978606939315796, 'learning_rate': 3.0603447325757895e-06, 'epoch': 1.99}

 66%|██████▋   | 7338/11049 [1:15:34<37:55,  1.63it/s]
 66%|██████▋   | 7339/11049 [1:15:34<37:56,  1.63it/s]
                                                      
{'loss': 0.2123, 'grad_norm': 0.5649425387382507, 'learning_rate': 3.058888891400942e-06, 'epoch': 1.99}

 66%|██████▋   | 7339/11049 [1:15:34<37:56,  1.63it/s]
 66%|██████▋   | 7340/11049 [1:15:35<37:54,  1.63it/s]
                                                      
{'loss': 0.167, 'grad_norm': 0.4832721948623657, 'learning_rate': 3.057433243969938e-06, 'epoch': 1.99}

 66%|██████▋   | 7340/11049 [1:15:35<37:54,  1.63it/s]
 66%|██████▋   | 7341/11049 [1:15:35<37:55,  1.63it/s]
                                                      
{'loss': 0.1573, 'grad_norm': 0.4727836549282074, 'learning_rate': 3.055977790428065e-06, 'epoch': 1.99}

 66%|██████▋   | 7341/11049 [1:15:35<37:55,  1.63it/s]
 66%|██████▋   | 7342/11049 [1:15:36<37:54,  1.63it/s]
                                                      
{'loss': 0.1668, 'grad_norm': 0.4732992649078369, 'learning_rate': 3.0545225309205918e-06, 'epoch': 1.99}

 66%|██████▋   | 7342/11049 [1:15:36<37:54,  1.63it/s]
 66%|██████▋   | 7343/11049 [1:15:37<37:53,  1.63it/s]
                                                      
{'loss': 0.2016, 'grad_norm': 0.6672752499580383, 'learning_rate': 3.053067465592767e-06, 'epoch': 1.99}

 66%|██████▋   | 7343/11049 [1:15:37<37:53,  1.63it/s]
 66%|██████▋   | 7344/11049 [1:15:37<37:52,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.5368146896362305, 'learning_rate': 3.051612594589826e-06, 'epoch': 1.99}

 66%|██████▋   | 7344/11049 [1:15:37<37:52,  1.63it/s]
 66%|██████▋   | 7345/11049 [1:15:38<37:52,  1.63it/s]
                                                      
{'loss': 0.1612, 'grad_norm': 0.44726380705833435, 'learning_rate': 3.0501579180569795e-06, 'epoch': 1.99}

 66%|██████▋   | 7345/11049 [1:15:38<37:52,  1.63it/s]
 66%|██████▋   | 7346/11049 [1:15:38<38:05,  1.62it/s]
                                                      
{'loss': 0.244, 'grad_norm': 0.60413658618927, 'learning_rate': 3.0487034361394207e-06, 'epoch': 1.99}

 66%|██████▋   | 7346/11049 [1:15:39<38:05,  1.62it/s]
 66%|██████▋   | 7347/11049 [1:15:39<38:00,  1.62it/s]
                                                      
{'loss': 0.173, 'grad_norm': 0.4859291613101959, 'learning_rate': 3.0472491489823175e-06, 'epoch': 1.99}

 66%|██████▋   | 7347/11049 [1:15:39<38:00,  1.62it/s]
 67%|██████▋   | 7348/11049 [1:15:40<37:56,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.5853214859962463, 'learning_rate': 3.0457950567308297e-06, 'epoch': 2.0}

 67%|██████▋   | 7348/11049 [1:15:40<37:56,  1.63it/s]
 67%|██████▋   | 7349/11049 [1:15:40<37:54,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.5553367137908936, 'learning_rate': 3.0443411595300894e-06, 'epoch': 2.0}

 67%|██████▋   | 7349/11049 [1:15:40<37:54,  1.63it/s]
 67%|██████▋   | 7350/11049 [1:15:41<37:52,  1.63it/s]
                                                      
{'loss': 0.1623, 'grad_norm': 0.4955652058124542, 'learning_rate': 3.04288745752521e-06, 'epoch': 2.0}

 67%|██████▋   | 7350/11049 [1:15:41<37:52,  1.63it/s]
 67%|██████▋   | 7351/11049 [1:15:41<37:51,  1.63it/s]
                                                      
{'loss': 0.1911, 'grad_norm': 0.5094325542449951, 'learning_rate': 3.0414339508612867e-06, 'epoch': 2.0}

 67%|██████▋   | 7351/11049 [1:15:42<37:51,  1.63it/s]
 67%|██████▋   | 7352/11049 [1:15:42<37:50,  1.63it/s]
                                                      
{'loss': 0.2043, 'grad_norm': 0.5707689523696899, 'learning_rate': 3.0399806396833975e-06, 'epoch': 2.0}

 67%|██████▋   | 7352/11049 [1:15:42<37:50,  1.63it/s]
 67%|██████▋   | 7353/11049 [1:15:43<37:51,  1.63it/s]
                                                      
{'loss': 0.2742, 'grad_norm': 0.734606921672821, 'learning_rate': 3.0385275241365965e-06, 'epoch': 2.0}

 67%|██████▋   | 7353/11049 [1:15:43<37:51,  1.63it/s]
 67%|██████▋   | 7354/11049 [1:15:43<37:51,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.5552176833152771, 'learning_rate': 3.0370746043659207e-06, 'epoch': 2.0}

 67%|██████▋   | 7354/11049 [1:15:43<37:51,  1.63it/s]
 67%|██████▋   | 7355/11049 [1:15:44<37:47,  1.63it/s]
                                                      
{'loss': 0.1777, 'grad_norm': 0.517145574092865, 'learning_rate': 3.035621880516386e-06, 'epoch': 2.0}

 67%|██████▋   | 7355/11049 [1:15:44<37:47,  1.63it/s]
 67%|██████▋   | 7356/11049 [1:15:45<37:47,  1.63it/s]
                                                      
{'loss': 0.2878, 'grad_norm': 0.6938214898109436, 'learning_rate': 3.0341693527329917e-06, 'epoch': 2.0}

 67%|██████▋   | 7356/11049 [1:15:45<37:47,  1.63it/s]
 67%|██████▋   | 7357/11049 [1:15:45<37:46,  1.63it/s]
                                                      
{'loss': 0.1863, 'grad_norm': 0.5149708390235901, 'learning_rate': 3.0327170211607165e-06, 'epoch': 2.0}

 67%|██████▋   | 7357/11049 [1:15:45<37:46,  1.63it/s]
 67%|██████▋   | 7358/11049 [1:15:46<37:48,  1.63it/s]
                                                      
{'loss': 0.2281, 'grad_norm': 0.5917575359344482, 'learning_rate': 3.0312648859445172e-06, 'epoch': 2.0}

 67%|██████▋   | 7358/11049 [1:15:46<37:48,  1.63it/s]
 67%|██████▋   | 7359/11049 [1:15:46<37:48,  1.63it/s]
                                                      
{'loss': 0.2505, 'grad_norm': 0.6339805126190186, 'learning_rate': 3.0298129472293315e-06, 'epoch': 2.0}

 67%|██████▋   | 7359/11049 [1:15:47<37:48,  1.63it/s]
 67%|██████▋   | 7360/11049 [1:15:47<37:46,  1.63it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.6548477411270142, 'learning_rate': 3.0283612051600806e-06, 'epoch': 2.0}

 67%|██████▋   | 7360/11049 [1:15:47<37:46,  1.63it/s]
 67%|██████▋   | 7361/11049 [1:15:48<37:43,  1.63it/s]
                                                      
{'loss': 0.1339, 'grad_norm': 0.44005557894706726, 'learning_rate': 3.0269096598816636e-06, 'epoch': 2.0}

 67%|██████▋   | 7361/11049 [1:15:48<37:43,  1.63it/s]
 67%|██████▋   | 7362/11049 [1:15:48<37:42,  1.63it/s]
                                                      
{'loss': 0.1579, 'grad_norm': 0.4391493797302246, 'learning_rate': 3.02545831153896e-06, 'epoch': 2.0}

 67%|██████▋   | 7362/11049 [1:15:48<37:42,  1.63it/s]
 67%|██████▋   | 7363/11049 [1:15:49<37:45,  1.63it/s]
                                                      
{'loss': 0.2115, 'grad_norm': 0.5544379949569702, 'learning_rate': 3.0240071602768293e-06, 'epoch': 2.0}

 67%|██████▋   | 7363/11049 [1:15:49<37:45,  1.63it/s]
 67%|██████▋   | 7364/11049 [1:15:49<37:46,  1.63it/s]
                                                      
{'loss': 0.2389, 'grad_norm': 0.7674424052238464, 'learning_rate': 3.0225562062401138e-06, 'epoch': 2.0}

 67%|██████▋   | 7364/11049 [1:15:50<37:46,  1.63it/s]
 67%|██████▋   | 7365/11049 [1:15:50<37:45,  1.63it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.4759654700756073, 'learning_rate': 3.0211054495736335e-06, 'epoch': 2.0}

 67%|██████▋   | 7365/11049 [1:15:50<37:45,  1.63it/s]
 67%|██████▋   | 7366/11049 [1:15:51<37:40,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.5041380524635315, 'learning_rate': 3.01965489042219e-06, 'epoch': 2.0}

 67%|██████▋   | 7366/11049 [1:15:51<37:40,  1.63it/s]
 67%|██████▋   | 7367/11049 [1:15:51<37:43,  1.63it/s]
                                                      
{'loss': 0.1329, 'grad_norm': 0.40792691707611084, 'learning_rate': 3.0182045289305628e-06, 'epoch': 2.0}

 67%|██████▋   | 7367/11049 [1:15:51<37:43,  1.63it/s]
 67%|██████▋   | 7368/11049 [1:15:52<37:41,  1.63it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.46466580033302307, 'learning_rate': 3.016754365243516e-06, 'epoch': 2.0}

 67%|██████▋   | 7368/11049 [1:15:52<37:41,  1.63it/s]
 67%|██████▋   | 7369/11049 [1:15:53<37:42,  1.63it/s]
                                                      
{'loss': 0.2187, 'grad_norm': 0.5307930111885071, 'learning_rate': 3.015304399505791e-06, 'epoch': 2.0}

 67%|██████▋   | 7369/11049 [1:15:53<37:42,  1.63it/s]
 67%|██████▋   | 7370/11049 [1:15:53<37:39,  1.63it/s]
                                                      
{'loss': 0.1364, 'grad_norm': 0.4089759588241577, 'learning_rate': 3.0138546318621096e-06, 'epoch': 2.0}

 67%|██████▋   | 7370/11049 [1:15:53<37:39,  1.63it/s]
 67%|██████▋   | 7371/11049 [1:15:54<37:38,  1.63it/s]
                                                      
{'loss': 0.1491, 'grad_norm': 0.4011343717575073, 'learning_rate': 3.0124050624571734e-06, 'epoch': 2.0}

 67%|██████▋   | 7371/11049 [1:15:54<37:38,  1.63it/s]
 67%|██████▋   | 7372/11049 [1:15:54<37:36,  1.63it/s]
                                                      
{'loss': 0.1325, 'grad_norm': 0.3960643708705902, 'learning_rate': 3.010955691435668e-06, 'epoch': 2.0}

 67%|██████▋   | 7372/11049 [1:15:54<37:36,  1.63it/s]
 67%|██████▋   | 7373/11049 [1:15:55<37:39,  1.63it/s]
                                                      
{'loss': 0.1625, 'grad_norm': 0.46291884779930115, 'learning_rate': 3.0095065189422533e-06, 'epoch': 2.0}

 67%|██████▋   | 7373/11049 [1:15:55<37:39,  1.63it/s]
 67%|██████▋   | 7374/11049 [1:15:56<37:40,  1.63it/s]
                                                      
{'loss': 0.1421, 'grad_norm': 0.4086967408657074, 'learning_rate': 3.0080575451215743e-06, 'epoch': 2.0}

 67%|██████▋   | 7374/11049 [1:15:56<37:40,  1.63it/s]
 67%|██████▋   | 7375/11049 [1:15:56<37:39,  1.63it/s]
                                                      
{'loss': 0.185, 'grad_norm': 0.457817941904068, 'learning_rate': 3.0066087701182513e-06, 'epoch': 2.0}

 67%|██████▋   | 7375/11049 [1:15:56<37:39,  1.63it/s]
 67%|██████▋   | 7376/11049 [1:15:57<37:36,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.5215354561805725, 'learning_rate': 3.0051601940768905e-06, 'epoch': 2.0}

 67%|██████▋   | 7376/11049 [1:15:57<37:36,  1.63it/s]
 67%|██████▋   | 7377/11049 [1:15:57<37:35,  1.63it/s]
                                                      
{'loss': 0.1926, 'grad_norm': 0.458914190530777, 'learning_rate': 3.0037118171420764e-06, 'epoch': 2.0}

 67%|██████▋   | 7377/11049 [1:15:58<37:35,  1.63it/s]
 67%|██████▋   | 7378/11049 [1:15:58<37:34,  1.63it/s]
                                                      
{'loss': 0.1994, 'grad_norm': 0.5841654539108276, 'learning_rate': 3.0022636394583706e-06, 'epoch': 2.0}

 67%|██████▋   | 7378/11049 [1:15:58<37:34,  1.63it/s]
 67%|██████▋   | 7379/11049 [1:15:59<37:36,  1.63it/s]
                                                      
{'loss': 0.1577, 'grad_norm': 0.42668282985687256, 'learning_rate': 3.0008156611703143e-06, 'epoch': 2.0}

 67%|██████▋   | 7379/11049 [1:15:59<37:36,  1.63it/s]
 67%|██████▋   | 7380/11049 [1:15:59<37:33,  1.63it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.4585818350315094, 'learning_rate': 2.9993678824224363e-06, 'epoch': 2.0}

 67%|██████▋   | 7380/11049 [1:15:59<37:33,  1.63it/s]
 67%|██████▋   | 7381/11049 [1:16:00<37:33,  1.63it/s]
                                                      
{'loss': 0.1403, 'grad_norm': 0.6475199460983276, 'learning_rate': 2.9979203033592387e-06, 'epoch': 2.0}

 67%|██████▋   | 7381/11049 [1:16:00<37:33,  1.63it/s]
 67%|██████▋   | 7382/11049 [1:16:01<37:31,  1.63it/s]
                                                      
{'loss': 0.1596, 'grad_norm': 0.5136994123458862, 'learning_rate': 2.9964729241252068e-06, 'epoch': 2.0}

 67%|██████▋   | 7382/11049 [1:16:01<37:31,  1.63it/s]
 67%|██████▋   | 7383/11049 [1:16:01<37:32,  1.63it/s]
                                                      
{'loss': 0.165, 'grad_norm': 0.5111579895019531, 'learning_rate': 2.995025744864799e-06, 'epoch': 2.0}

 67%|██████▋   | 7383/11049 [1:16:01<37:32,  1.63it/s]
 67%|██████▋   | 7384/11049 [1:16:02<37:34,  1.63it/s]
                                                      
{'loss': 0.1772, 'grad_norm': 0.5842382311820984, 'learning_rate': 2.993578765722467e-06, 'epoch': 2.0}

 67%|██████▋   | 7384/11049 [1:16:02<37:34,  1.63it/s]
 67%|██████▋   | 7385/11049 [1:16:02<37:33,  1.63it/s]
                                                      
{'loss': 0.1377, 'grad_norm': 0.462384432554245, 'learning_rate': 2.9921319868426304e-06, 'epoch': 2.01}

 67%|██████▋   | 7385/11049 [1:16:02<37:33,  1.63it/s]
 67%|██████▋   | 7386/11049 [1:16:03<37:30,  1.63it/s]
                                                      
{'loss': 0.1645, 'grad_norm': 0.4686374068260193, 'learning_rate': 2.9906854083696947e-06, 'epoch': 2.01}

 67%|██████▋   | 7386/11049 [1:16:03<37:30,  1.63it/s]
 67%|██████▋   | 7387/11049 [1:16:04<37:30,  1.63it/s]
                                                      
{'loss': 0.1693, 'grad_norm': 0.5471047759056091, 'learning_rate': 2.9892390304480436e-06, 'epoch': 2.01}

 67%|██████▋   | 7387/11049 [1:16:04<37:30,  1.63it/s]
 67%|██████▋   | 7388/11049 [1:16:04<37:31,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.5646350383758545, 'learning_rate': 2.9877928532220414e-06, 'epoch': 2.01}

 67%|██████▋   | 7388/11049 [1:16:04<37:31,  1.63it/s]
 67%|██████▋   | 7389/11049 [1:16:05<37:32,  1.63it/s]
                                                      
{'loss': 0.1478, 'grad_norm': 0.47730812430381775, 'learning_rate': 2.986346876836033e-06, 'epoch': 2.01}

 67%|██████▋   | 7389/11049 [1:16:05<37:32,  1.63it/s]
 67%|██████▋   | 7390/11049 [1:16:05<37:29,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.5366231203079224, 'learning_rate': 2.9849011014343408e-06, 'epoch': 2.01}

 67%|██████▋   | 7390/11049 [1:16:06<37:29,  1.63it/s]
 67%|██████▋   | 7391/11049 [1:16:06<37:27,  1.63it/s]
                                                      
{'loss': 0.1308, 'grad_norm': 0.4430941045284271, 'learning_rate': 2.9834555271612696e-06, 'epoch': 2.01}

 67%|██████▋   | 7391/11049 [1:16:06<37:27,  1.63it/s]
 67%|██████▋   | 7392/11049 [1:16:07<37:25,  1.63it/s]
                                                      
{'loss': 0.1672, 'grad_norm': 0.5667116641998291, 'learning_rate': 2.982010154161104e-06, 'epoch': 2.01}

 67%|██████▋   | 7392/11049 [1:16:07<37:25,  1.63it/s]
 67%|██████▋   | 7393/11049 [1:16:07<37:23,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.5485019087791443, 'learning_rate': 2.9805649825781073e-06, 'epoch': 2.01}

 67%|██████▋   | 7393/11049 [1:16:07<37:23,  1.63it/s]
 67%|██████▋   | 7394/11049 [1:16:08<37:23,  1.63it/s]
                                                      
{'loss': 0.1337, 'grad_norm': 0.4708690345287323, 'learning_rate': 2.9791200125565233e-06, 'epoch': 2.01}

 67%|██████▋   | 7394/11049 [1:16:08<37:23,  1.63it/s]
 67%|██████▋   | 7395/11049 [1:16:08<37:22,  1.63it/s]
                                                      
{'loss': 0.1486, 'grad_norm': 0.46480801701545715, 'learning_rate': 2.977675244240574e-06, 'epoch': 2.01}

 67%|██████▋   | 7395/11049 [1:16:09<37:22,  1.63it/s]
 67%|██████▋   | 7396/11049 [1:16:09<37:22,  1.63it/s]
                                                      
{'loss': 0.1527, 'grad_norm': 0.526841402053833, 'learning_rate': 2.976230677774466e-06, 'epoch': 2.01}

 67%|██████▋   | 7396/11049 [1:16:09<37:22,  1.63it/s]
 67%|██████▋   | 7397/11049 [1:16:10<37:21,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.464465856552124, 'learning_rate': 2.9747863133023803e-06, 'epoch': 2.01}

 67%|██████▋   | 7397/11049 [1:16:10<37:21,  1.63it/s]
 67%|██████▋   | 7398/11049 [1:16:10<37:20,  1.63it/s]
                                                      
{'loss': 0.1815, 'grad_norm': 0.4668034315109253, 'learning_rate': 2.973342150968481e-06, 'epoch': 2.01}

 67%|██████▋   | 7398/11049 [1:16:10<37:20,  1.63it/s]
 67%|██████▋   | 7399/11049 [1:16:11<37:22,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.5530046224594116, 'learning_rate': 2.9718981909169096e-06, 'epoch': 2.01}

 67%|██████▋   | 7399/11049 [1:16:11<37:22,  1.63it/s]
 67%|██████▋   | 7400/11049 [1:16:12<37:20,  1.63it/s]
                                                      
{'loss': 0.1509, 'grad_norm': 0.4543229043483734, 'learning_rate': 2.970454433291792e-06, 'epoch': 2.01}

 67%|██████▋   | 7400/11049 [1:16:12<37:20,  1.63it/s]
 67%|██████▋   | 7401/11049 [1:16:12<37:18,  1.63it/s]
                                                      
{'loss': 0.1279, 'grad_norm': 0.4733215272426605, 'learning_rate': 2.9690108782372282e-06, 'epoch': 2.01}

 67%|██████▋   | 7401/11049 [1:16:12<37:18,  1.63it/s]
 67%|██████▋   | 7402/11049 [1:16:13<37:17,  1.63it/s]
                                                      
{'loss': 0.1533, 'grad_norm': 0.5298015475273132, 'learning_rate': 2.9675675258973014e-06, 'epoch': 2.01}

 67%|██████▋   | 7402/11049 [1:16:13<37:17,  1.63it/s]
 67%|██████▋   | 7403/11049 [1:16:13<37:16,  1.63it/s]
                                                      
{'loss': 0.1901, 'grad_norm': 0.5493053197860718, 'learning_rate': 2.9661243764160725e-06, 'epoch': 2.01}

 67%|██████▋   | 7403/11049 [1:16:14<37:16,  1.63it/s]
 67%|██████▋   | 7404/11049 [1:16:14<37:16,  1.63it/s]
                                                      
{'loss': 0.2086, 'grad_norm': 0.5253100395202637, 'learning_rate': 2.964681429937586e-06, 'epoch': 2.01}

 67%|██████▋   | 7404/11049 [1:16:14<37:16,  1.63it/s]
 67%|██████▋   | 7405/11049 [1:16:15<37:14,  1.63it/s]
                                                      
{'loss': 0.1302, 'grad_norm': 0.48552247881889343, 'learning_rate': 2.963238686605861e-06, 'epoch': 2.01}

 67%|██████▋   | 7405/11049 [1:16:15<37:14,  1.63it/s]
 67%|██████▋   | 7406/11049 [1:16:15<37:16,  1.63it/s]
                                                      
{'loss': 0.1524, 'grad_norm': 0.5885249376296997, 'learning_rate': 2.9617961465649e-06, 'epoch': 2.01}

 67%|██████▋   | 7406/11049 [1:16:15<37:16,  1.63it/s]
 67%|██████▋   | 7407/11049 [1:16:16<37:15,  1.63it/s]
                                                      
{'loss': 0.1372, 'grad_norm': 0.5228785872459412, 'learning_rate': 2.960353809958683e-06, 'epoch': 2.01}

 67%|██████▋   | 7407/11049 [1:16:16<37:15,  1.63it/s]
 67%|██████▋   | 7408/11049 [1:16:16<37:13,  1.63it/s]
                                                      
{'loss': 0.1644, 'grad_norm': 0.5222159624099731, 'learning_rate': 2.9589116769311744e-06, 'epoch': 2.01}

 67%|██████▋   | 7408/11049 [1:16:17<37:13,  1.63it/s]
 67%|██████▋   | 7409/11049 [1:16:17<37:16,  1.63it/s]
                                                      
{'loss': 0.1599, 'grad_norm': 0.5872891545295715, 'learning_rate': 2.957469747626311e-06, 'epoch': 2.01}

 67%|██████▋   | 7409/11049 [1:16:17<37:16,  1.63it/s]
 67%|██████▋   | 7410/11049 [1:16:18<37:14,  1.63it/s]
                                                      
{'loss': 0.1731, 'grad_norm': 0.5226697325706482, 'learning_rate': 2.9560280221880133e-06, 'epoch': 2.01}

 67%|██████▋   | 7410/11049 [1:16:18<37:14,  1.63it/s]
 67%|██████▋   | 7411/11049 [1:16:18<37:12,  1.63it/s]
                                                      
{'loss': 0.16, 'grad_norm': 0.5494641065597534, 'learning_rate': 2.9545865007601805e-06, 'epoch': 2.01}

 67%|██████▋   | 7411/11049 [1:16:18<37:12,  1.63it/s]
 67%|██████▋   | 7412/11049 [1:16:19<37:11,  1.63it/s]
                                                      
{'loss': 0.1228, 'grad_norm': 0.45477455854415894, 'learning_rate': 2.953145183486695e-06, 'epoch': 2.01}

 67%|██████▋   | 7412/11049 [1:16:19<37:11,  1.63it/s]
 67%|██████▋   | 7413/11049 [1:16:20<37:10,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.7209212779998779, 'learning_rate': 2.951704070511414e-06, 'epoch': 2.01}

 67%|██████▋   | 7413/11049 [1:16:20<37:10,  1.63it/s]
 67%|██████▋   | 7414/11049 [1:16:20<37:12,  1.63it/s]
                                                      
{'loss': 0.1422, 'grad_norm': 0.5299177765846252, 'learning_rate': 2.950263161978176e-06, 'epoch': 2.01}

 67%|██████▋   | 7414/11049 [1:16:20<37:12,  1.63it/s]
 67%|██████▋   | 7415/11049 [1:16:21<37:10,  1.63it/s]
                                                      
{'loss': 0.1722, 'grad_norm': 0.6101042032241821, 'learning_rate': 2.9488224580307977e-06, 'epoch': 2.01}

 67%|██████▋   | 7415/11049 [1:16:21<37:10,  1.63it/s]
 67%|██████▋   | 7416/11049 [1:16:21<37:09,  1.63it/s]
                                                      
{'loss': 0.1884, 'grad_norm': 0.5889443755149841, 'learning_rate': 2.9473819588130796e-06, 'epoch': 2.01}

 67%|██████▋   | 7416/11049 [1:16:22<37:09,  1.63it/s]
 67%|██████▋   | 7417/11049 [1:16:22<37:08,  1.63it/s]
                                                      
{'loss': 0.1696, 'grad_norm': 0.6209092140197754, 'learning_rate': 2.945941664468799e-06, 'epoch': 2.01}

 67%|██████▋   | 7417/11049 [1:16:22<37:08,  1.63it/s]
 67%|██████▋   | 7418/11049 [1:16:23<37:07,  1.63it/s]
                                                      
{'loss': 0.1633, 'grad_norm': 0.5564054250717163, 'learning_rate': 2.944501575141712e-06, 'epoch': 2.01}

 67%|██████▋   | 7418/11049 [1:16:23<37:07,  1.63it/s]
 67%|██████▋   | 7419/11049 [1:16:23<37:08,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.7085732221603394, 'learning_rate': 2.9430616909755515e-06, 'epoch': 2.01}

 67%|██████▋   | 7419/11049 [1:16:23<37:08,  1.63it/s]
 67%|██████▋   | 7420/11049 [1:16:24<37:06,  1.63it/s]
                                                      
{'loss': 0.1704, 'grad_norm': 0.6023923754692078, 'learning_rate': 2.94162201211404e-06, 'epoch': 2.01}

 67%|██████▋   | 7420/11049 [1:16:24<37:06,  1.63it/s]
 67%|██████▋   | 7421/11049 [1:16:24<37:07,  1.63it/s]
                                                      
{'loss': 0.1598, 'grad_norm': 0.5759689807891846, 'learning_rate': 2.9401825387008687e-06, 'epoch': 2.01}

 67%|██████▋   | 7421/11049 [1:16:25<37:07,  1.63it/s]
 67%|██████▋   | 7422/11049 [1:16:25<37:05,  1.63it/s]
                                                      
{'loss': 0.1546, 'grad_norm': 0.5523250102996826, 'learning_rate': 2.938743270879715e-06, 'epoch': 2.02}

 67%|██████▋   | 7422/11049 [1:16:25<37:05,  1.63it/s]
 67%|██████▋   | 7423/11049 [1:16:26<37:04,  1.63it/s]
                                                      
{'loss': 0.1414, 'grad_norm': 0.6058295369148254, 'learning_rate': 2.9373042087942304e-06, 'epoch': 2.02}

 67%|██████▋   | 7423/11049 [1:16:26<37:04,  1.63it/s]
 67%|██████▋   | 7424/11049 [1:16:26<37:04,  1.63it/s]
                                                      
{'loss': 0.1367, 'grad_norm': 0.4740842580795288, 'learning_rate': 2.9358653525880516e-06, 'epoch': 2.02}

 67%|██████▋   | 7424/11049 [1:16:26<37:04,  1.63it/s]
 67%|██████▋   | 7425/11049 [1:16:27<37:03,  1.63it/s]
                                                      
{'loss': 0.1423, 'grad_norm': 0.477967232465744, 'learning_rate': 2.9344267024047906e-06, 'epoch': 2.02}

 67%|██████▋   | 7425/11049 [1:16:27<37:03,  1.63it/s]
 67%|██████▋   | 7426/11049 [1:16:28<37:02,  1.63it/s]
                                                      
{'loss': 0.1381, 'grad_norm': 0.5471366047859192, 'learning_rate': 2.9329882583880407e-06, 'epoch': 2.02}

 67%|██████▋   | 7426/11049 [1:16:28<37:02,  1.63it/s]
 67%|██████▋   | 7427/11049 [1:16:28<37:01,  1.63it/s]
                                                      
{'loss': 0.154, 'grad_norm': 0.46645209193229675, 'learning_rate': 2.9315500206813736e-06, 'epoch': 2.02}

 67%|██████▋   | 7427/11049 [1:16:28<37:01,  1.63it/s]
 67%|██████▋   | 7428/11049 [1:16:29<37:02,  1.63it/s]
                                                      
{'loss': 0.1564, 'grad_norm': 0.5688437819480896, 'learning_rate': 2.9301119894283415e-06, 'epoch': 2.02}

 67%|██████▋   | 7428/11049 [1:16:29<37:02,  1.63it/s]
 67%|██████▋   | 7429/11049 [1:16:29<37:03,  1.63it/s]
                                                      
{'loss': 0.1623, 'grad_norm': 0.5798467397689819, 'learning_rate': 2.9286741647724757e-06, 'epoch': 2.02}

 67%|██████▋   | 7429/11049 [1:16:29<37:03,  1.63it/s]
 67%|██████▋   | 7430/11049 [1:16:30<37:03,  1.63it/s]
                                                      
{'loss': 0.1321, 'grad_norm': 0.5011100769042969, 'learning_rate': 2.927236546857286e-06, 'epoch': 2.02}

 67%|██████▋   | 7430/11049 [1:16:30<37:03,  1.63it/s]
 67%|██████▋   | 7431/11049 [1:16:31<37:02,  1.63it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.6086922883987427, 'learning_rate': 2.9257991358262615e-06, 'epoch': 2.02}

 67%|██████▋   | 7431/11049 [1:16:31<37:02,  1.63it/s]
 67%|██████▋   | 7432/11049 [1:16:31<37:00,  1.63it/s]
                                                      
{'loss': 0.1261, 'grad_norm': 0.495392382144928, 'learning_rate': 2.9243619318228734e-06, 'epoch': 2.02}

 67%|██████▋   | 7432/11049 [1:16:31<37:00,  1.63it/s]
 67%|██████▋   | 7433/11049 [1:16:32<36:58,  1.63it/s]
                                                      
{'loss': 0.1699, 'grad_norm': 0.6271982789039612, 'learning_rate': 2.9229249349905686e-06, 'epoch': 2.02}

 67%|██████▋   | 7433/11049 [1:16:32<36:58,  1.63it/s]
 67%|██████▋   | 7434/11049 [1:16:32<37:01,  1.63it/s]
                                                      
{'loss': 0.1651, 'grad_norm': 0.5742979049682617, 'learning_rate': 2.9214881454727752e-06, 'epoch': 2.02}

 67%|██████▋   | 7434/11049 [1:16:33<37:01,  1.63it/s]
 67%|██████▋   | 7435/11049 [1:16:33<36:58,  1.63it/s]
                                                      
{'loss': 0.1538, 'grad_norm': 0.5230900645256042, 'learning_rate': 2.9200515634129e-06, 'epoch': 2.02}

 67%|██████▋   | 7435/11049 [1:16:33<36:58,  1.63it/s]
 67%|██████▋   | 7436/11049 [1:16:34<36:57,  1.63it/s]
                                                      
{'loss': 0.1307, 'grad_norm': 0.4569925367832184, 'learning_rate': 2.9186151889543303e-06, 'epoch': 2.02}

 67%|██████▋   | 7436/11049 [1:16:34<36:57,  1.63it/s]
 67%|██████▋   | 7437/11049 [1:16:34<36:56,  1.63it/s]
                                                      
{'loss': 0.1377, 'grad_norm': 0.5581437349319458, 'learning_rate': 2.9171790222404313e-06, 'epoch': 2.02}

 67%|██████▋   | 7437/11049 [1:16:34<36:56,  1.63it/s]
 67%|██████▋   | 7438/11049 [1:16:35<36:53,  1.63it/s]
                                                      
{'loss': 0.1729, 'grad_norm': 0.586520254611969, 'learning_rate': 2.915743063414548e-06, 'epoch': 2.02}

 67%|██████▋   | 7438/11049 [1:16:35<36:53,  1.63it/s]
 67%|██████▋   | 7439/11049 [1:16:35<36:57,  1.63it/s]
                                                      
{'loss': 0.1385, 'grad_norm': 0.5522556304931641, 'learning_rate': 2.9143073126200015e-06, 'epoch': 2.02}

 67%|██████▋   | 7439/11049 [1:16:36<36:57,  1.63it/s]
 67%|██████▋   | 7440/11049 [1:16:36<36:55,  1.63it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.561783492565155, 'learning_rate': 2.912871770000102e-06, 'epoch': 2.02}

 67%|██████▋   | 7440/11049 [1:16:36<36:55,  1.63it/s]
 67%|██████▋   | 7441/11049 [1:16:37<36:53,  1.63it/s]
                                                      
{'loss': 0.127, 'grad_norm': 0.5111886858940125, 'learning_rate': 2.9114364356981274e-06, 'epoch': 2.02}

 67%|██████▋   | 7441/11049 [1:16:37<36:53,  1.63it/s]
 67%|██████▋   | 7442/11049 [1:16:37<36:51,  1.63it/s]
                                                      
{'loss': 0.17, 'grad_norm': 0.6469058394432068, 'learning_rate': 2.9100013098573397e-06, 'epoch': 2.02}

 67%|██████▋   | 7442/11049 [1:16:37<36:51,  1.63it/s]
 67%|██████▋   | 7443/11049 [1:16:38<36:51,  1.63it/s]
                                                      
{'loss': 0.164, 'grad_norm': 0.6255285143852234, 'learning_rate': 2.908566392620982e-06, 'epoch': 2.02}

 67%|██████▋   | 7443/11049 [1:16:38<36:51,  1.63it/s]
 67%|██████▋   | 7444/11049 [1:16:39<36:55,  1.63it/s]
                                                      
{'loss': 0.1734, 'grad_norm': 0.610497772693634, 'learning_rate': 2.907131684132273e-06, 'epoch': 2.02}

 67%|██████▋   | 7444/11049 [1:16:39<36:55,  1.63it/s]
 67%|██████▋   | 7445/11049 [1:16:39<36:53,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.6674953699111938, 'learning_rate': 2.9056971845344116e-06, 'epoch': 2.02}

 67%|██████▋   | 7445/11049 [1:16:39<36:53,  1.63it/s]
 67%|██████▋   | 7446/11049 [1:16:40<36:52,  1.63it/s]
                                                      
{'loss': 0.161, 'grad_norm': 0.571325957775116, 'learning_rate': 2.904262893970578e-06, 'epoch': 2.02}

 67%|██████▋   | 7446/11049 [1:16:40<36:52,  1.63it/s]
 67%|██████▋   | 7447/11049 [1:16:40<36:50,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.61981600522995, 'learning_rate': 2.9028288125839266e-06, 'epoch': 2.02}

 67%|██████▋   | 7447/11049 [1:16:41<36:50,  1.63it/s]
 67%|██████▋   | 7448/11049 [1:16:41<36:48,  1.63it/s]
                                                      
{'loss': 0.188, 'grad_norm': 0.6835089921951294, 'learning_rate': 2.901394940517599e-06, 'epoch': 2.02}

 67%|██████▋   | 7448/11049 [1:16:41<36:48,  1.63it/s]
 67%|██████▋   | 7449/11049 [1:16:42<36:50,  1.63it/s]
                                                      
{'loss': 0.1217, 'grad_norm': 0.4739052355289459, 'learning_rate': 2.8999612779147086e-06, 'epoch': 2.02}

 67%|██████▋   | 7449/11049 [1:16:42<36:50,  1.63it/s]
 67%|██████▋   | 7450/11049 [1:16:42<36:49,  1.63it/s]
                                                      
{'loss': 0.2105, 'grad_norm': 0.6432633399963379, 'learning_rate': 2.89852782491835e-06, 'epoch': 2.02}

 67%|██████▋   | 7450/11049 [1:16:42<36:49,  1.63it/s]
 67%|██████▋   | 7451/11049 [1:16:43<36:47,  1.63it/s]
                                                      
{'loss': 0.1898, 'grad_norm': 0.6047874093055725, 'learning_rate': 2.8970945816715983e-06, 'epoch': 2.02}

 67%|██████▋   | 7451/11049 [1:16:43<36:47,  1.63it/s]
 67%|██████▋   | 7452/11049 [1:16:43<36:46,  1.63it/s]
                                                      
{'loss': 0.1653, 'grad_norm': 0.677969217300415, 'learning_rate': 2.895661548317506e-06, 'epoch': 2.02}

 67%|██████▋   | 7452/11049 [1:16:44<36:46,  1.63it/s]
 67%|██████▋   | 7453/11049 [1:16:44<36:46,  1.63it/s]
                                                      
{'loss': 0.1503, 'grad_norm': 0.5743423700332642, 'learning_rate': 2.894228724999105e-06, 'epoch': 2.02}

 67%|██████▋   | 7453/11049 [1:16:44<36:46,  1.63it/s]
 67%|██████▋   | 7454/11049 [1:16:45<36:56,  1.62it/s]
                                                      
{'loss': 0.1698, 'grad_norm': 0.6221936345100403, 'learning_rate': 2.892796111859408e-06, 'epoch': 2.02}

 67%|██████▋   | 7454/11049 [1:16:45<36:56,  1.62it/s]
 67%|██████▋   | 7455/11049 [1:16:45<36:52,  1.62it/s]
                                                      
{'loss': 0.1405, 'grad_norm': 0.49924927949905396, 'learning_rate': 2.8913637090414016e-06, 'epoch': 2.02}

 67%|██████▋   | 7455/11049 [1:16:45<36:52,  1.62it/s]
 67%|██████▋   | 7456/11049 [1:16:46<36:49,  1.63it/s]
                                                      
{'loss': 0.133, 'grad_norm': 0.5269980430603027, 'learning_rate': 2.8899315166880597e-06, 'epoch': 2.02}

 67%|██████▋   | 7456/11049 [1:16:46<36:49,  1.63it/s]
 67%|██████▋   | 7457/11049 [1:16:47<36:46,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.5923631191253662, 'learning_rate': 2.8884995349423286e-06, 'epoch': 2.02}

 67%|██████▋   | 7457/11049 [1:16:47<36:46,  1.63it/s]
 67%|██████▋   | 7458/11049 [1:16:47<36:47,  1.63it/s]
                                                      
{'loss': 0.1221, 'grad_norm': 0.49488282203674316, 'learning_rate': 2.8870677639471356e-06, 'epoch': 2.02}

 67%|██████▋   | 7458/11049 [1:16:47<36:47,  1.63it/s]
 68%|██████▊   | 7459/11049 [1:16:48<36:46,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.5452131628990173, 'learning_rate': 2.885636203845387e-06, 'epoch': 2.03}

 68%|██████▊   | 7459/11049 [1:16:48<36:46,  1.63it/s]
 68%|██████▊   | 7460/11049 [1:16:48<36:44,  1.63it/s]
                                                      
{'loss': 0.1877, 'grad_norm': 0.602075457572937, 'learning_rate': 2.8842048547799673e-06, 'epoch': 2.03}

 68%|██████▊   | 7460/11049 [1:16:49<36:44,  1.63it/s]
 68%|██████▊   | 7461/11049 [1:16:49<36:46,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.7086789608001709, 'learning_rate': 2.882773716893741e-06, 'epoch': 2.03}

 68%|██████▊   | 7461/11049 [1:16:49<36:46,  1.63it/s]
 68%|██████▊   | 7462/11049 [1:16:50<36:44,  1.63it/s]
                                                      
{'loss': 0.1663, 'grad_norm': 0.5959527492523193, 'learning_rate': 2.881342790329551e-06, 'epoch': 2.03}

 68%|██████▊   | 7462/11049 [1:16:50<36:44,  1.63it/s]
 68%|██████▊   | 7463/11049 [1:16:50<36:45,  1.63it/s]
                                                      
{'loss': 0.137, 'grad_norm': 0.547584056854248, 'learning_rate': 2.879912075230218e-06, 'epoch': 2.03}

 68%|██████▊   | 7463/11049 [1:16:50<36:45,  1.63it/s]
 68%|██████▊   | 7464/11049 [1:16:51<36:44,  1.63it/s]
                                                      
{'loss': 0.1511, 'grad_norm': 0.5433058142662048, 'learning_rate': 2.8784815717385456e-06, 'epoch': 2.03}

 68%|██████▊   | 7464/11049 [1:16:51<36:44,  1.63it/s]
 68%|██████▊   | 7465/11049 [1:16:51<36:43,  1.63it/s]
                                                      
{'loss': 0.139, 'grad_norm': 0.5295354723930359, 'learning_rate': 2.877051279997312e-06, 'epoch': 2.03}

 68%|██████▊   | 7465/11049 [1:16:52<36:43,  1.63it/s]
 68%|██████▊   | 7466/11049 [1:16:52<36:40,  1.63it/s]
                                                      
{'loss': 0.1589, 'grad_norm': 0.661585807800293, 'learning_rate': 2.8756212001492763e-06, 'epoch': 2.03}

 68%|██████▊   | 7466/11049 [1:16:52<36:40,  1.63it/s]
 68%|██████▊   | 7467/11049 [1:16:53<36:38,  1.63it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.7104830145835876, 'learning_rate': 2.8741913323371727e-06, 'epoch': 2.03}

 68%|██████▊   | 7467/11049 [1:16:53<36:38,  1.63it/s]
 68%|██████▊   | 7468/11049 [1:16:53<36:40,  1.63it/s]
                                                      
{'loss': 0.105, 'grad_norm': 0.4679616689682007, 'learning_rate': 2.8727616767037223e-06, 'epoch': 2.03}

 68%|██████▊   | 7468/11049 [1:16:53<36:40,  1.63it/s]
 68%|██████▊   | 7469/11049 [1:16:54<36:38,  1.63it/s]
                                                      
{'loss': 0.1482, 'grad_norm': 0.6218867301940918, 'learning_rate': 2.871332233391621e-06, 'epoch': 2.03}

 68%|██████▊   | 7469/11049 [1:16:54<36:38,  1.63it/s]
 68%|██████▊   | 7470/11049 [1:16:55<36:37,  1.63it/s]
                                                      
{'loss': 0.1807, 'grad_norm': 0.6550718545913696, 'learning_rate': 2.869903002543537e-06, 'epoch': 2.03}

 68%|██████▊   | 7470/11049 [1:16:55<36:37,  1.63it/s]
 68%|██████▊   | 7471/11049 [1:16:55<36:39,  1.63it/s]
                                                      
{'loss': 0.1719, 'grad_norm': 0.6220753788948059, 'learning_rate': 2.8684739843021237e-06, 'epoch': 2.03}

 68%|██████▊   | 7471/11049 [1:16:55<36:39,  1.63it/s]
 68%|██████▊   | 7472/11049 [1:16:56<36:37,  1.63it/s]
                                                      
{'loss': 0.143, 'grad_norm': 0.5549589991569519, 'learning_rate': 2.8670451788100164e-06, 'epoch': 2.03}

 68%|██████▊   | 7472/11049 [1:16:56<36:37,  1.63it/s]
 68%|██████▊   | 7473/11049 [1:16:56<36:37,  1.63it/s]
                                                      
{'loss': 0.1357, 'grad_norm': 0.49247828125953674, 'learning_rate': 2.8656165862098227e-06, 'epoch': 2.03}

 68%|██████▊   | 7473/11049 [1:16:57<36:37,  1.63it/s]
 68%|██████▊   | 7474/11049 [1:16:57<36:34,  1.63it/s]
                                                      
{'loss': 0.131, 'grad_norm': 0.46172794699668884, 'learning_rate': 2.8641882066441336e-06, 'epoch': 2.03}

 68%|██████▊   | 7474/11049 [1:16:57<36:34,  1.63it/s]
 68%|██████▊   | 7475/11049 [1:16:58<36:32,  1.63it/s]
                                                      
{'loss': 0.1427, 'grad_norm': 0.5091198086738586, 'learning_rate': 2.862760040255513e-06, 'epoch': 2.03}

 68%|██████▊   | 7475/11049 [1:16:58<36:32,  1.63it/s]
 68%|██████▊   | 7476/11049 [1:16:58<36:34,  1.63it/s]
                                                      
{'loss': 0.108, 'grad_norm': 0.44586554169654846, 'learning_rate': 2.8613320871865112e-06, 'epoch': 2.03}

 68%|██████▊   | 7476/11049 [1:16:58<36:34,  1.63it/s]
 68%|██████▊   | 7477/11049 [1:16:59<36:33,  1.63it/s]
                                                      
{'loss': 0.1908, 'grad_norm': 0.5556299686431885, 'learning_rate': 2.8599043475796523e-06, 'epoch': 2.03}

 68%|██████▊   | 7477/11049 [1:16:59<36:33,  1.63it/s]
 68%|██████▊   | 7478/11049 [1:16:59<36:32,  1.63it/s]
                                                      
{'loss': 0.2021, 'grad_norm': 0.6649784445762634, 'learning_rate': 2.85847682157744e-06, 'epoch': 2.03}

 68%|██████▊   | 7478/11049 [1:17:00<36:32,  1.63it/s]
 68%|██████▊   | 7479/11049 [1:17:00<36:34,  1.63it/s]
                                                      
{'loss': 0.1561, 'grad_norm': 0.45774945616722107, 'learning_rate': 2.857049509322356e-06, 'epoch': 2.03}

 68%|██████▊   | 7479/11049 [1:17:00<36:34,  1.63it/s]
 68%|██████▊   | 7480/11049 [1:17:01<36:32,  1.63it/s]
                                                      
{'loss': 0.1805, 'grad_norm': 0.6240257024765015, 'learning_rate': 2.8556224109568626e-06, 'epoch': 2.03}

 68%|██████▊   | 7480/11049 [1:17:01<36:32,  1.63it/s]
 68%|██████▊   | 7481/11049 [1:17:01<36:30,  1.63it/s]
                                                      
{'loss': 0.1218, 'grad_norm': 0.4881155490875244, 'learning_rate': 2.854195526623399e-06, 'epoch': 2.03}

 68%|██████▊   | 7481/11049 [1:17:01<36:30,  1.63it/s]
 68%|██████▊   | 7482/11049 [1:17:02<36:29,  1.63it/s]
                                                      
{'loss': 0.17, 'grad_norm': 0.5815509557723999, 'learning_rate': 2.852768856464383e-06, 'epoch': 2.03}

 68%|██████▊   | 7482/11049 [1:17:02<36:29,  1.63it/s]
 68%|██████▊   | 7483/11049 [1:17:03<36:32,  1.63it/s]
                                                      
{'loss': 0.1842, 'grad_norm': 0.6199473142623901, 'learning_rate': 2.851342400622211e-06, 'epoch': 2.03}

 68%|██████▊   | 7483/11049 [1:17:03<36:32,  1.63it/s]
 68%|██████▊   | 7484/11049 [1:17:03<36:30,  1.63it/s]
                                                      
{'loss': 0.1577, 'grad_norm': 0.6313196420669556, 'learning_rate': 2.849916159239262e-06, 'epoch': 2.03}

 68%|██████▊   | 7484/11049 [1:17:03<36:30,  1.63it/s]
 68%|██████▊   | 7485/11049 [1:17:04<36:30,  1.63it/s]
                                                      
{'loss': 0.1291, 'grad_norm': 0.5145053267478943, 'learning_rate': 2.8484901324578883e-06, 'epoch': 2.03}

 68%|██████▊   | 7485/11049 [1:17:04<36:30,  1.63it/s]
 68%|██████▊   | 7486/11049 [1:17:04<36:28,  1.63it/s]
                                                      
{'loss': 0.1501, 'grad_norm': 0.5644158720970154, 'learning_rate': 2.847064320420423e-06, 'epoch': 2.03}

 68%|██████▊   | 7486/11049 [1:17:04<36:28,  1.63it/s]
 68%|██████▊   | 7487/11049 [1:17:05<36:27,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.5315853357315063, 'learning_rate': 2.8456387232691768e-06, 'epoch': 2.03}

 68%|██████▊   | 7487/11049 [1:17:05<36:27,  1.63it/s]
 68%|██████▊   | 7488/11049 [1:17:06<36:26,  1.63it/s]
                                                      
{'loss': 0.1273, 'grad_norm': 0.5225476622581482, 'learning_rate': 2.84421334114644e-06, 'epoch': 2.03}

 68%|██████▊   | 7488/11049 [1:17:06<36:26,  1.63it/s]
 68%|██████▊   | 7489/11049 [1:17:06<36:25,  1.63it/s]
                                                      
{'loss': 0.2318, 'grad_norm': 0.6306865811347961, 'learning_rate': 2.8427881741944824e-06, 'epoch': 2.03}

 68%|██████▊   | 7489/11049 [1:17:06<36:25,  1.63it/s]
 68%|██████▊   | 7490/11049 [1:17:07<36:22,  1.63it/s]
                                                      
{'loss': 0.1574, 'grad_norm': 0.5719394683837891, 'learning_rate': 2.8413632225555492e-06, 'epoch': 2.03}

 68%|██████▊   | 7490/11049 [1:17:07<36:22,  1.63it/s]
 68%|██████▊   | 7491/11049 [1:17:07<36:21,  1.63it/s]
                                                      
{'loss': 0.2782, 'grad_norm': 0.6565862894058228, 'learning_rate': 2.839938486371865e-06, 'epoch': 2.03}

 68%|██████▊   | 7491/11049 [1:17:08<36:21,  1.63it/s]
 68%|██████▊   | 7492/11049 [1:17:08<36:22,  1.63it/s]
                                                      
{'loss': 0.1448, 'grad_norm': 0.4936724007129669, 'learning_rate': 2.8385139657856376e-06, 'epoch': 2.03}

 68%|██████▊   | 7492/11049 [1:17:08<36:22,  1.63it/s]
 68%|██████▊   | 7493/11049 [1:17:09<36:24,  1.63it/s]
                                                      
{'loss': 0.2014, 'grad_norm': 0.6235551834106445, 'learning_rate': 2.8370896609390475e-06, 'epoch': 2.03}

 68%|██████▊   | 7493/11049 [1:17:09<36:24,  1.63it/s]
 68%|██████▊   | 7494/11049 [1:17:09<36:22,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.5558314919471741, 'learning_rate': 2.835665571974256e-06, 'epoch': 2.03}

 68%|██████▊   | 7494/11049 [1:17:09<36:22,  1.63it/s]
 68%|██████▊   | 7495/11049 [1:17:10<36:20,  1.63it/s]
                                                      
{'loss': 0.1593, 'grad_norm': 0.5647324919700623, 'learning_rate': 2.834241699033402e-06, 'epoch': 2.04}

 68%|██████▊   | 7495/11049 [1:17:10<36:20,  1.63it/s]
 68%|██████▊   | 7496/11049 [1:17:11<36:18,  1.63it/s]
                                                      
{'loss': 0.1642, 'grad_norm': 0.6633020639419556, 'learning_rate': 2.8328180422586036e-06, 'epoch': 2.04}

 68%|██████▊   | 7496/11049 [1:17:11<36:18,  1.63it/s]
 68%|██████▊   | 7497/11049 [1:17:11<36:17,  1.63it/s]
                                                      
{'loss': 0.1442, 'grad_norm': 0.5968464612960815, 'learning_rate': 2.8313946017919575e-06, 'epoch': 2.04}

 68%|██████▊   | 7497/11049 [1:17:11<36:17,  1.63it/s]
 68%|██████▊   | 7498/11049 [1:17:12<36:19,  1.63it/s]
                                                      
{'loss': 0.1441, 'grad_norm': 0.48022130131721497, 'learning_rate': 2.8299713777755377e-06, 'epoch': 2.04}

 68%|██████▊   | 7498/11049 [1:17:12<36:19,  1.63it/s]
 68%|██████▊   | 7499/11049 [1:17:12<36:18,  1.63it/s]
                                                      
{'loss': 0.1528, 'grad_norm': 0.5675448179244995, 'learning_rate': 2.8285483703513984e-06, 'epoch': 2.04}

 68%|██████▊   | 7499/11049 [1:17:12<36:18,  1.63it/s]
 68%|██████▊   | 7500/11049 [1:17:13<36:17,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.5758956074714661, 'learning_rate': 2.8271255796615676e-06, 'epoch': 2.04}

 68%|██████▊   | 7500/11049 [1:17:13<36:17,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.35it/s]

 31%|███       | 4/13 [00:00<00:01,  8.38it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.78it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.41it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.17it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.01it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.74it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]
                                                      

                                               
{'eval_loss': 0.5453055500984192, 'eval_runtime': 1.9545, 'eval_samples_per_second': 102.329, 'eval_steps_per_second': 6.651, 'epoch': 2.04}

 68%|██████▊   | 7500/11049 [1:17:15<36:17,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.75it/s]

                                               
 68%|██████▊   | 7501/11049 [1:17:16<1:11:04,  1.20s/it]
                                                        
{'loss': 0.1486, 'grad_norm': 0.49489858746528625, 'learning_rate': 2.8257030058480605e-06, 'epoch': 2.04}

 68%|██████▊   | 7501/11049 [1:17:16<1:11:04,  1.20s/it]
 68%|██████▊   | 7502/11049 [1:17:16<1:00:36,  1.03s/it]
                                                        
{'loss': 0.1709, 'grad_norm': 0.5307255387306213, 'learning_rate': 2.824280649052863e-06, 'epoch': 2.04}

 68%|██████▊   | 7502/11049 [1:17:16<1:00:36,  1.03s/it]
 68%|██████▊   | 7503/11049 [1:17:17<53:21,  1.11it/s]  
                                                      
{'loss': 0.1698, 'grad_norm': 0.6127946376800537, 'learning_rate': 2.8228585094179407e-06, 'epoch': 2.04}

 68%|██████▊   | 7503/11049 [1:17:17<53:21,  1.11it/s]
 68%|██████▊   | 7504/11049 [1:17:17<48:12,  1.23it/s]
                                                      
{'loss': 0.133, 'grad_norm': 0.5438689589500427, 'learning_rate': 2.821436587085238e-06, 'epoch': 2.04}

 68%|██████▊   | 7504/11049 [1:17:18<48:12,  1.23it/s]
 68%|██████▊   | 7505/11049 [1:17:18<44:36,  1.32it/s]
                                                      
{'loss': 0.132, 'grad_norm': 0.7096009254455566, 'learning_rate': 2.820014882196683e-06, 'epoch': 2.04}

 68%|██████▊   | 7505/11049 [1:17:18<44:36,  1.32it/s]
 68%|██████▊   | 7506/11049 [1:17:19<42:05,  1.40it/s]
                                                      
{'loss': 0.1814, 'grad_norm': 0.7003347873687744, 'learning_rate': 2.818593394894171e-06, 'epoch': 2.04}

 68%|██████▊   | 7506/11049 [1:17:19<42:05,  1.40it/s]
 68%|██████▊   | 7507/11049 [1:17:19<40:18,  1.46it/s]
                                                      
{'loss': 0.1584, 'grad_norm': 0.6724780201911926, 'learning_rate': 2.817172125319585e-06, 'epoch': 2.04}

 68%|██████▊   | 7507/11049 [1:17:19<40:18,  1.46it/s]
 68%|██████▊   | 7508/11049 [1:17:20<39:06,  1.51it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.6501981616020203, 'learning_rate': 2.815751073614781e-06, 'epoch': 2.04}

 68%|██████▊   | 7508/11049 [1:17:20<39:06,  1.51it/s]
 68%|██████▊   | 7509/11049 [1:17:20<38:12,  1.54it/s]
                                                      
{'loss': 0.1789, 'grad_norm': 0.48974502086639404, 'learning_rate': 2.8143302399215977e-06, 'epoch': 2.04}

 68%|██████▊   | 7509/11049 [1:17:21<38:12,  1.54it/s]
 68%|██████▊   | 7510/11049 [1:17:21<37:36,  1.57it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.626045823097229, 'learning_rate': 2.8129096243818488e-06, 'epoch': 2.04}

 68%|██████▊   | 7510/11049 [1:17:21<37:36,  1.57it/s]
 68%|██████▊   | 7511/11049 [1:17:22<37:10,  1.59it/s]
                                                      
{'loss': 0.17, 'grad_norm': 0.7434432506561279, 'learning_rate': 2.8114892271373274e-06, 'epoch': 2.04}

 68%|██████▊   | 7511/11049 [1:17:22<37:10,  1.59it/s]
 68%|██████▊   | 7512/11049 [1:17:22<36:51,  1.60it/s]
                                                      
{'loss': 0.1798, 'grad_norm': 0.5732214450836182, 'learning_rate': 2.810069048329801e-06, 'epoch': 2.04}

 68%|██████▊   | 7512/11049 [1:17:22<36:51,  1.60it/s]
 68%|██████▊   | 7513/11049 [1:17:23<36:39,  1.61it/s]
                                                      
{'loss': 0.166, 'grad_norm': 0.6552669405937195, 'learning_rate': 2.808649088101024e-06, 'epoch': 2.04}

 68%|██████▊   | 7513/11049 [1:17:23<36:39,  1.61it/s]
 68%|██████▊   | 7514/11049 [1:17:24<36:28,  1.61it/s]
                                                      
{'loss': 0.1375, 'grad_norm': 0.5911526083946228, 'learning_rate': 2.807229346592722e-06, 'epoch': 2.04}

 68%|██████▊   | 7514/11049 [1:17:24<36:28,  1.61it/s]
 68%|██████▊   | 7515/11049 [1:17:24<36:21,  1.62it/s]
                                                      
{'loss': 0.1382, 'grad_norm': 0.5596385598182678, 'learning_rate': 2.805809823946602e-06, 'epoch': 2.04}

 68%|██████▊   | 7515/11049 [1:17:24<36:21,  1.62it/s]
 68%|██████▊   | 7516/11049 [1:17:25<36:19,  1.62it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.620966911315918, 'learning_rate': 2.8043905203043408e-06, 'epoch': 2.04}

 68%|██████▊   | 7516/11049 [1:17:25<36:19,  1.62it/s]
 68%|██████▊   | 7517/11049 [1:17:25<36:14,  1.62it/s]
                                                      
{'loss': 0.1558, 'grad_norm': 0.5180531740188599, 'learning_rate': 2.802971435807608e-06, 'epoch': 2.04}

 68%|██████▊   | 7517/11049 [1:17:25<36:14,  1.62it/s]
 68%|██████▊   | 7518/11049 [1:17:26<36:10,  1.63it/s]
                                                      
{'loss': 0.1354, 'grad_norm': 0.4987334609031677, 'learning_rate': 2.8015525705980405e-06, 'epoch': 2.04}

 68%|██████▊   | 7518/11049 [1:17:26<36:10,  1.63it/s]
 68%|██████▊   | 7519/11049 [1:17:27<36:09,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.5888611674308777, 'learning_rate': 2.8001339248172567e-06, 'epoch': 2.04}

 68%|██████▊   | 7519/11049 [1:17:27<36:09,  1.63it/s]
 68%|██████▊   | 7520/11049 [1:17:27<36:07,  1.63it/s]
                                                      
{'loss': 0.1632, 'grad_norm': 0.5798434019088745, 'learning_rate': 2.79871549860685e-06, 'epoch': 2.04}

 68%|██████▊   | 7520/11049 [1:17:27<36:07,  1.63it/s]
 68%|██████▊   | 7521/11049 [1:17:28<36:05,  1.63it/s]
                                                      
{'loss': 0.1316, 'grad_norm': 0.5342763066291809, 'learning_rate': 2.7972972921083997e-06, 'epoch': 2.04}

 68%|██████▊   | 7521/11049 [1:17:28<36:05,  1.63it/s]
 68%|██████▊   | 7522/11049 [1:17:28<36:03,  1.63it/s]
                                                      
{'loss': 0.1895, 'grad_norm': 0.8307772874832153, 'learning_rate': 2.7958793054634558e-06, 'epoch': 2.04}

 68%|██████▊   | 7522/11049 [1:17:29<36:03,  1.63it/s]
 68%|██████▊   | 7523/11049 [1:17:29<36:02,  1.63it/s]
                                                      
{'loss': 0.1527, 'grad_norm': 0.5699916481971741, 'learning_rate': 2.794461538813548e-06, 'epoch': 2.04}

 68%|██████▊   | 7523/11049 [1:17:29<36:02,  1.63it/s]
 68%|██████▊   | 7524/11049 [1:17:30<36:01,  1.63it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.6067183017730713, 'learning_rate': 2.7930439923001856e-06, 'epoch': 2.04}

 68%|██████▊   | 7524/11049 [1:17:30<36:01,  1.63it/s]
 68%|██████▊   | 7525/11049 [1:17:30<36:02,  1.63it/s]
                                                      
{'loss': 0.1294, 'grad_norm': 0.4794156551361084, 'learning_rate': 2.791626666064855e-06, 'epoch': 2.04}

 68%|██████▊   | 7525/11049 [1:17:30<36:02,  1.63it/s]
 68%|██████▊   | 7526/11049 [1:17:31<36:01,  1.63it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.5578081607818604, 'learning_rate': 2.79020956024902e-06, 'epoch': 2.04}

 68%|██████▊   | 7526/11049 [1:17:31<36:01,  1.63it/s]
 68%|██████▊   | 7527/11049 [1:17:31<36:01,  1.63it/s]
                                                      
{'loss': 0.1874, 'grad_norm': 0.6463996171951294, 'learning_rate': 2.788792674994123e-06, 'epoch': 2.04}

 68%|██████▊   | 7527/11049 [1:17:32<36:01,  1.63it/s]
 68%|██████▊   | 7528/11049 [1:17:32<35:59,  1.63it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.5229950547218323, 'learning_rate': 2.7873760104415835e-06, 'epoch': 2.04}

 68%|██████▊   | 7528/11049 [1:17:32<35:59,  1.63it/s]
 68%|██████▊   | 7529/11049 [1:17:33<35:58,  1.63it/s]
                                                      
{'loss': 0.1317, 'grad_norm': 0.48368051648139954, 'learning_rate': 2.7859595667328027e-06, 'epoch': 2.04}

 68%|██████▊   | 7529/11049 [1:17:33<35:58,  1.63it/s]
 68%|██████▊   | 7530/11049 [1:17:33<35:57,  1.63it/s]
                                                      
{'loss': 0.2265, 'grad_norm': 0.6629126071929932, 'learning_rate': 2.784543344009156e-06, 'epoch': 2.04}

 68%|██████▊   | 7530/11049 [1:17:33<35:57,  1.63it/s]
 68%|██████▊   | 7531/11049 [1:17:34<35:57,  1.63it/s]
                                                      
{'loss': 0.1681, 'grad_norm': 0.6084034442901611, 'learning_rate': 2.783127342411997e-06, 'epoch': 2.04}

 68%|██████▊   | 7531/11049 [1:17:34<35:57,  1.63it/s]
 68%|██████▊   | 7532/11049 [1:17:35<35:56,  1.63it/s]
                                                      
{'loss': 0.218, 'grad_norm': 0.7160765528678894, 'learning_rate': 2.7817115620826583e-06, 'epoch': 2.05}

 68%|██████▊   | 7532/11049 [1:17:35<35:56,  1.63it/s]
 68%|██████▊   | 7533/11049 [1:17:35<35:55,  1.63it/s]
                                                      
{'loss': 0.1512, 'grad_norm': 0.5671347379684448, 'learning_rate': 2.7802960031624494e-06, 'epoch': 2.05}

 68%|██████▊   | 7533/11049 [1:17:35<35:55,  1.63it/s]
 68%|██████▊   | 7534/11049 [1:17:36<35:56,  1.63it/s]
                                                      
{'loss': 0.1923, 'grad_norm': 0.6557936668395996, 'learning_rate': 2.778880665792659e-06, 'epoch': 2.05}

 68%|██████▊   | 7534/11049 [1:17:36<35:56,  1.63it/s]
 68%|██████▊   | 7535/11049 [1:17:36<35:54,  1.63it/s]
                                                      
{'loss': 0.1915, 'grad_norm': 0.6083025932312012, 'learning_rate': 2.7774655501145543e-06, 'epoch': 2.05}

 68%|██████▊   | 7535/11049 [1:17:37<35:54,  1.63it/s]
 68%|██████▊   | 7536/11049 [1:17:37<35:53,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.5556460618972778, 'learning_rate': 2.7760506562693744e-06, 'epoch': 2.05}

 68%|██████▊   | 7536/11049 [1:17:37<35:53,  1.63it/s]
 68%|██████▊   | 7537/11049 [1:17:38<35:53,  1.63it/s]
                                                      
{'loss': 0.1618, 'grad_norm': 0.5455260872840881, 'learning_rate': 2.7746359843983466e-06, 'epoch': 2.05}

 68%|██████▊   | 7537/11049 [1:17:38<35:53,  1.63it/s]
 68%|██████▊   | 7538/11049 [1:17:38<35:52,  1.63it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.5751376152038574, 'learning_rate': 2.7732215346426684e-06, 'epoch': 2.05}

 68%|██████▊   | 7538/11049 [1:17:38<35:52,  1.63it/s]
 68%|██████▊   | 7539/11049 [1:17:39<35:52,  1.63it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.5689675211906433, 'learning_rate': 2.771807307143517e-06, 'epoch': 2.05}

 68%|██████▊   | 7539/11049 [1:17:39<35:52,  1.63it/s]
 68%|██████▊   | 7540/11049 [1:17:39<35:51,  1.63it/s]
                                                      
{'loss': 0.1696, 'grad_norm': 0.6676743030548096, 'learning_rate': 2.7703933020420453e-06, 'epoch': 2.05}

 68%|██████▊   | 7540/11049 [1:17:40<35:51,  1.63it/s]
 68%|██████▊   | 7541/11049 [1:17:40<35:52,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.5971739888191223, 'learning_rate': 2.7689795194793923e-06, 'epoch': 2.05}

 68%|██████▊   | 7541/11049 [1:17:40<35:52,  1.63it/s]
 68%|██████▊   | 7542/11049 [1:17:41<35:51,  1.63it/s]
                                                      
{'loss': 0.1792, 'grad_norm': 0.5826861262321472, 'learning_rate': 2.767565959596663e-06, 'epoch': 2.05}

 68%|██████▊   | 7542/11049 [1:17:41<35:51,  1.63it/s]
 68%|██████▊   | 7543/11049 [1:17:41<35:50,  1.63it/s]
                                                      
{'loss': 0.1228, 'grad_norm': 0.504976749420166, 'learning_rate': 2.7661526225349485e-06, 'epoch': 2.05}

 68%|██████▊   | 7543/11049 [1:17:41<35:50,  1.63it/s]
 68%|██████▊   | 7544/11049 [1:17:42<35:50,  1.63it/s]
                                                      
{'loss': 0.1434, 'grad_norm': 0.5417882800102234, 'learning_rate': 2.764739508435312e-06, 'epoch': 2.05}

 68%|██████▊   | 7544/11049 [1:17:42<35:50,  1.63it/s]
 68%|██████▊   | 7545/11049 [1:17:43<35:48,  1.63it/s]
                                                      
{'loss': 0.205, 'grad_norm': 0.7033422589302063, 'learning_rate': 2.7633266174388018e-06, 'epoch': 2.05}

 68%|██████▊   | 7545/11049 [1:17:43<35:48,  1.63it/s]
 68%|██████▊   | 7546/11049 [1:17:43<35:47,  1.63it/s]
                                                      
{'loss': 0.1635, 'grad_norm': 0.5627731084823608, 'learning_rate': 2.761913949686438e-06, 'epoch': 2.05}

 68%|██████▊   | 7546/11049 [1:17:43<35:47,  1.63it/s]
 68%|██████▊   | 7547/11049 [1:17:44<35:47,  1.63it/s]
                                                      
{'loss': 0.1427, 'grad_norm': 0.5925949811935425, 'learning_rate': 2.7605015053192195e-06, 'epoch': 2.05}

 68%|██████▊   | 7547/11049 [1:17:44<35:47,  1.63it/s]
 68%|██████▊   | 7548/11049 [1:17:44<35:47,  1.63it/s]
                                                      
{'loss': 0.1751, 'grad_norm': 0.6751151084899902, 'learning_rate': 2.759089284478123e-06, 'epoch': 2.05}

 68%|██████▊   | 7548/11049 [1:17:44<35:47,  1.63it/s]
 68%|██████▊   | 7549/11049 [1:17:45<35:46,  1.63it/s]
                                                      
{'loss': 0.1286, 'grad_norm': 0.4479855000972748, 'learning_rate': 2.7576772873041058e-06, 'epoch': 2.05}

 68%|██████▊   | 7549/11049 [1:17:45<35:46,  1.63it/s]
 68%|██████▊   | 7550/11049 [1:17:46<35:45,  1.63it/s]
                                                      
{'loss': 0.1494, 'grad_norm': 0.5333449840545654, 'learning_rate': 2.756265513938099e-06, 'epoch': 2.05}

 68%|██████▊   | 7550/11049 [1:17:46<35:45,  1.63it/s]
 68%|██████▊   | 7551/11049 [1:17:46<35:44,  1.63it/s]
                                                      
{'loss': 0.1574, 'grad_norm': 0.5298091769218445, 'learning_rate': 2.754853964521015e-06, 'epoch': 2.05}

 68%|██████▊   | 7551/11049 [1:17:46<35:44,  1.63it/s]
 68%|██████▊   | 7552/11049 [1:17:47<35:43,  1.63it/s]
                                                      
{'loss': 0.1591, 'grad_norm': 0.5882877707481384, 'learning_rate': 2.753442639193735e-06, 'epoch': 2.05}

 68%|██████▊   | 7552/11049 [1:17:47<35:43,  1.63it/s]
 68%|██████▊   | 7553/11049 [1:17:47<35:43,  1.63it/s]
                                                      
{'loss': 0.1413, 'grad_norm': 0.5382235050201416, 'learning_rate': 2.7520315380971313e-06, 'epoch': 2.05}

 68%|██████▊   | 7553/11049 [1:17:48<35:43,  1.63it/s]
 68%|██████▊   | 7554/11049 [1:17:48<35:44,  1.63it/s]
                                                      
{'loss': 0.1477, 'grad_norm': 0.5613353252410889, 'learning_rate': 2.7506206613720443e-06, 'epoch': 2.05}

 68%|██████▊   | 7554/11049 [1:17:48<35:44,  1.63it/s]
 68%|██████▊   | 7555/11049 [1:17:49<35:43,  1.63it/s]
                                                      
{'loss': 0.1556, 'grad_norm': 0.5880038738250732, 'learning_rate': 2.7492100091592956e-06, 'epoch': 2.05}

 68%|██████▊   | 7555/11049 [1:17:49<35:43,  1.63it/s]
 68%|██████▊   | 7556/11049 [1:17:49<35:46,  1.63it/s]
                                                      
{'loss': 0.1713, 'grad_norm': 0.5834230184555054, 'learning_rate': 2.747799581599681e-06, 'epoch': 2.05}

 68%|██████▊   | 7556/11049 [1:17:49<35:46,  1.63it/s]
 68%|██████▊   | 7557/11049 [1:17:50<35:43,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.6112551689147949, 'learning_rate': 2.74638937883398e-06, 'epoch': 2.05}

 68%|██████▊   | 7557/11049 [1:17:50<35:43,  1.63it/s]
 68%|██████▊   | 7558/11049 [1:17:51<35:43,  1.63it/s]
                                                      
{'loss': 0.1192, 'grad_norm': 0.4689249098300934, 'learning_rate': 2.7449794010029452e-06, 'epoch': 2.05}

 68%|██████▊   | 7558/11049 [1:17:51<35:43,  1.63it/s]
 68%|██████▊   | 7559/11049 [1:17:51<35:41,  1.63it/s]
                                                      
{'loss': 0.1281, 'grad_norm': 0.5042110681533813, 'learning_rate': 2.743569648247307e-06, 'epoch': 2.05}

 68%|██████▊   | 7559/11049 [1:17:51<35:41,  1.63it/s]
 68%|██████▊   | 7560/11049 [1:17:52<35:41,  1.63it/s]
                                                      
{'loss': 0.1803, 'grad_norm': 0.6432666182518005, 'learning_rate': 2.742160120707773e-06, 'epoch': 2.05}

 68%|██████▊   | 7560/11049 [1:17:52<35:41,  1.63it/s]
 68%|██████▊   | 7561/11049 [1:17:52<35:39,  1.63it/s]
                                                      
{'loss': 0.211, 'grad_norm': 0.6431674361228943, 'learning_rate': 2.740750818525031e-06, 'epoch': 2.05}

 68%|██████▊   | 7561/11049 [1:17:52<35:39,  1.63it/s]
 68%|██████▊   | 7562/11049 [1:17:53<35:38,  1.63it/s]
                                                      
{'loss': 0.1595, 'grad_norm': 0.5414161682128906, 'learning_rate': 2.739341741839743e-06, 'epoch': 2.05}

 68%|██████▊   | 7562/11049 [1:17:53<35:38,  1.63it/s]
 68%|██████▊   | 7563/11049 [1:17:54<35:37,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.6094110012054443, 'learning_rate': 2.7379328907925507e-06, 'epoch': 2.05}

 68%|██████▊   | 7563/11049 [1:17:54<35:37,  1.63it/s]
 68%|██████▊   | 7564/11049 [1:17:54<35:37,  1.63it/s]
                                                      
{'loss': 0.1061, 'grad_norm': 0.4451059103012085, 'learning_rate': 2.736524265524071e-06, 'epoch': 2.05}

 68%|██████▊   | 7564/11049 [1:17:54<35:37,  1.63it/s]
 68%|██████▊   | 7565/11049 [1:17:55<35:35,  1.63it/s]
                                                      
{'loss': 0.1487, 'grad_norm': 0.5703655481338501, 'learning_rate': 2.735115866174904e-06, 'epoch': 2.05}

 68%|██████▊   | 7565/11049 [1:17:55<35:35,  1.63it/s]
 68%|██████▊   | 7566/11049 [1:17:55<35:35,  1.63it/s]
                                                      
{'loss': 0.1574, 'grad_norm': 0.5762612819671631, 'learning_rate': 2.7337076928856197e-06, 'epoch': 2.05}

 68%|██████▊   | 7566/11049 [1:17:56<35:35,  1.63it/s]
 68%|██████▊   | 7567/11049 [1:17:56<35:34,  1.63it/s]
                                                      
{'loss': 0.1549, 'grad_norm': 0.5501008033752441, 'learning_rate': 2.7322997457967716e-06, 'epoch': 2.05}

 68%|██████▊   | 7567/11049 [1:17:56<35:34,  1.63it/s]
 68%|██████▊   | 7568/11049 [1:17:57<35:37,  1.63it/s]
                                                      
{'loss': 0.1645, 'grad_norm': 0.6818904876708984, 'learning_rate': 2.730892025048885e-06, 'epoch': 2.05}

 68%|██████▊   | 7568/11049 [1:17:57<35:37,  1.63it/s]
 69%|██████▊   | 7569/11049 [1:17:57<35:36,  1.63it/s]
                                                      
{'loss': 0.1555, 'grad_norm': 0.584440290927887, 'learning_rate': 2.729484530782468e-06, 'epoch': 2.06}

 69%|██████▊   | 7569/11049 [1:17:57<35:36,  1.63it/s]
 69%|██████▊   | 7570/11049 [1:17:58<35:34,  1.63it/s]
                                                      
{'loss': 0.1085, 'grad_norm': 0.42953237891197205, 'learning_rate': 2.7280772631380024e-06, 'epoch': 2.06}

 69%|██████▊   | 7570/11049 [1:17:58<35:34,  1.63it/s]
 69%|██████▊   | 7571/11049 [1:17:58<35:34,  1.63it/s]
                                                      
{'loss': 0.165, 'grad_norm': 0.8373416066169739, 'learning_rate': 2.7266702222559486e-06, 'epoch': 2.06}

 69%|██████▊   | 7571/11049 [1:17:59<35:34,  1.63it/s]
 69%|██████▊   | 7572/11049 [1:17:59<35:33,  1.63it/s]
                                                      
{'loss': 0.1516, 'grad_norm': 0.5737202167510986, 'learning_rate': 2.7252634082767437e-06, 'epoch': 2.06}

 69%|██████▊   | 7572/11049 [1:17:59<35:33,  1.63it/s]
 69%|██████▊   | 7573/11049 [1:18:00<35:32,  1.63it/s]
                                                      
{'loss': 0.1565, 'grad_norm': 0.5678466558456421, 'learning_rate': 2.723856821340806e-06, 'epoch': 2.06}

 69%|██████▊   | 7573/11049 [1:18:00<35:32,  1.63it/s]
 69%|██████▊   | 7574/11049 [1:18:00<35:30,  1.63it/s]
                                                      
{'loss': 0.1623, 'grad_norm': 0.5987668633460999, 'learning_rate': 2.722450461588526e-06, 'epoch': 2.06}

 69%|██████▊   | 7574/11049 [1:18:00<35:30,  1.63it/s]
 69%|██████▊   | 7575/11049 [1:18:01<35:30,  1.63it/s]
                                                      
{'loss': 0.1781, 'grad_norm': 0.7016186118125916, 'learning_rate': 2.7210443291602744e-06, 'epoch': 2.06}

 69%|██████▊   | 7575/11049 [1:18:01<35:30,  1.63it/s]
 69%|██████▊   | 7576/11049 [1:18:02<35:30,  1.63it/s]
                                                      
{'loss': 0.1827, 'grad_norm': 0.6805641651153564, 'learning_rate': 2.719638424196396e-06, 'epoch': 2.06}

 69%|██████▊   | 7576/11049 [1:18:02<35:30,  1.63it/s]
 69%|██████▊   | 7577/11049 [1:18:02<35:29,  1.63it/s]
                                                      
{'loss': 0.1874, 'grad_norm': 0.6915347576141357, 'learning_rate': 2.7182327468372206e-06, 'epoch': 2.06}

 69%|██████▊   | 7577/11049 [1:18:02<35:29,  1.63it/s]
 69%|██████▊   | 7578/11049 [1:18:03<35:28,  1.63it/s]
                                                      
{'loss': 0.1598, 'grad_norm': 0.5801991820335388, 'learning_rate': 2.7168272972230447e-06, 'epoch': 2.06}

 69%|██████▊   | 7578/11049 [1:18:03<35:28,  1.63it/s]
 69%|██████▊   | 7579/11049 [1:18:03<35:27,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.6299846172332764, 'learning_rate': 2.7154220754941484e-06, 'epoch': 2.06}

 69%|██████▊   | 7579/11049 [1:18:04<35:27,  1.63it/s]
 69%|██████▊   | 7580/11049 [1:18:04<35:26,  1.63it/s]
                                                      
{'loss': 0.152, 'grad_norm': 0.5658166408538818, 'learning_rate': 2.714017081790787e-06, 'epoch': 2.06}

 69%|██████▊   | 7580/11049 [1:18:04<35:26,  1.63it/s]
 69%|██████▊   | 7581/11049 [1:18:05<35:26,  1.63it/s]
                                                      
{'loss': 0.1885, 'grad_norm': 0.673917829990387, 'learning_rate': 2.712612316253199e-06, 'epoch': 2.06}

 69%|██████▊   | 7581/11049 [1:18:05<35:26,  1.63it/s]
 69%|██████▊   | 7582/11049 [1:18:05<35:25,  1.63it/s]
                                                      
{'loss': 0.1265, 'grad_norm': 0.4806521534919739, 'learning_rate': 2.711207779021591e-06, 'epoch': 2.06}

 69%|██████▊   | 7582/11049 [1:18:05<35:25,  1.63it/s]
 69%|██████▊   | 7583/11049 [1:18:06<35:25,  1.63it/s]
                                                      
{'loss': 0.1248, 'grad_norm': 0.5178508758544922, 'learning_rate': 2.709803470236152e-06, 'epoch': 2.06}

 69%|██████▊   | 7583/11049 [1:18:06<35:25,  1.63it/s]
 69%|██████▊   | 7584/11049 [1:18:06<35:25,  1.63it/s]
                                                      
{'loss': 0.1346, 'grad_norm': 0.5315431356430054, 'learning_rate': 2.7083993900370453e-06, 'epoch': 2.06}

 69%|██████▊   | 7584/11049 [1:18:07<35:25,  1.63it/s]
 69%|██████▊   | 7585/11049 [1:18:07<35:25,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.5343867540359497, 'learning_rate': 2.7069955385644164e-06, 'epoch': 2.06}

 69%|██████▊   | 7585/11049 [1:18:07<35:25,  1.63it/s]
 69%|██████▊   | 7586/11049 [1:18:08<35:23,  1.63it/s]
                                                      
{'loss': 0.1921, 'grad_norm': 0.6430707573890686, 'learning_rate': 2.705591915958386e-06, 'epoch': 2.06}

 69%|██████▊   | 7586/11049 [1:18:08<35:23,  1.63it/s]
 69%|██████▊   | 7587/11049 [1:18:08<35:23,  1.63it/s]
                                                      
{'loss': 0.1109, 'grad_norm': 0.4123125970363617, 'learning_rate': 2.7041885223590458e-06, 'epoch': 2.06}

 69%|██████▊   | 7587/11049 [1:18:08<35:23,  1.63it/s]
 69%|██████▊   | 7588/11049 [1:18:09<35:22,  1.63it/s]
                                                      
{'loss': 0.1437, 'grad_norm': 0.5769960880279541, 'learning_rate': 2.7027853579064713e-06, 'epoch': 2.06}

 69%|██████▊   | 7588/11049 [1:18:09<35:22,  1.63it/s]
 69%|██████▊   | 7589/11049 [1:18:10<35:22,  1.63it/s]
                                                      
{'loss': 0.1698, 'grad_norm': 0.6596042513847351, 'learning_rate': 2.7013824227407147e-06, 'epoch': 2.06}

 69%|██████▊   | 7589/11049 [1:18:10<35:22,  1.63it/s]
 69%|██████▊   | 7590/11049 [1:18:10<35:22,  1.63it/s]
                                                      
{'loss': 0.1235, 'grad_norm': 0.4873080253601074, 'learning_rate': 2.699979717001805e-06, 'epoch': 2.06}

 69%|██████▊   | 7590/11049 [1:18:10<35:22,  1.63it/s]
 69%|██████▊   | 7591/11049 [1:18:11<35:21,  1.63it/s]
                                                      
{'loss': 0.1523, 'grad_norm': 0.5597915053367615, 'learning_rate': 2.698577240829745e-06, 'epoch': 2.06}

 69%|██████▊   | 7591/11049 [1:18:11<35:21,  1.63it/s]
 69%|██████▊   | 7592/11049 [1:18:11<35:21,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.5026404857635498, 'learning_rate': 2.6971749943645163e-06, 'epoch': 2.06}

 69%|██████▊   | 7592/11049 [1:18:11<35:21,  1.63it/s]
 69%|██████▊   | 7593/11049 [1:18:12<35:20,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.5848826766014099, 'learning_rate': 2.6957729777460817e-06, 'epoch': 2.06}

 69%|██████▊   | 7593/11049 [1:18:12<35:20,  1.63it/s]
 69%|██████▊   | 7594/11049 [1:18:13<35:20,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.6571342349052429, 'learning_rate': 2.694371191114376e-06, 'epoch': 2.06}

 69%|██████▊   | 7594/11049 [1:18:13<35:20,  1.63it/s]
 69%|██████▊   | 7595/11049 [1:18:13<35:19,  1.63it/s]
                                                      
{'loss': 0.1404, 'grad_norm': 0.6602638363838196, 'learning_rate': 2.6929696346093128e-06, 'epoch': 2.06}

 69%|██████▊   | 7595/11049 [1:18:13<35:19,  1.63it/s]
 69%|██████▊   | 7596/11049 [1:18:14<35:18,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5596904754638672, 'learning_rate': 2.6915683083707815e-06, 'epoch': 2.06}

 69%|██████▊   | 7596/11049 [1:18:14<35:18,  1.63it/s]
 69%|██████▉   | 7597/11049 [1:18:14<35:17,  1.63it/s]
                                                      
{'loss': 0.1365, 'grad_norm': 0.5553889274597168, 'learning_rate': 2.690167212538651e-06, 'epoch': 2.06}

 69%|██████▉   | 7597/11049 [1:18:15<35:17,  1.63it/s]
 69%|██████▉   | 7598/11049 [1:18:15<35:17,  1.63it/s]
                                                      
{'loss': 0.201, 'grad_norm': 0.7441397309303284, 'learning_rate': 2.6887663472527644e-06, 'epoch': 2.06}

 69%|██████▉   | 7598/11049 [1:18:15<35:17,  1.63it/s]
 69%|██████▉   | 7599/11049 [1:18:16<35:17,  1.63it/s]
                                                      
{'loss': 0.166, 'grad_norm': 0.702683687210083, 'learning_rate': 2.687365712652944e-06, 'epoch': 2.06}

 69%|██████▉   | 7599/11049 [1:18:16<35:17,  1.63it/s]
 69%|██████▉   | 7600/11049 [1:18:16<35:17,  1.63it/s]
                                                      
{'loss': 0.1511, 'grad_norm': 0.6415717601776123, 'learning_rate': 2.685965308878986e-06, 'epoch': 2.06}

 69%|██████▉   | 7600/11049 [1:18:16<35:17,  1.63it/s]
 69%|██████▉   | 7601/11049 [1:18:17<35:15,  1.63it/s]
                                                      
{'loss': 0.1557, 'grad_norm': 0.5754997730255127, 'learning_rate': 2.6845651360706703e-06, 'epoch': 2.06}

 69%|██████▉   | 7601/11049 [1:18:17<35:15,  1.63it/s]
 69%|██████▉   | 7602/11049 [1:18:17<35:15,  1.63it/s]
                                                      
{'loss': 0.1624, 'grad_norm': 0.5956347584724426, 'learning_rate': 2.6831651943677463e-06, 'epoch': 2.06}

 69%|██████▉   | 7602/11049 [1:18:18<35:15,  1.63it/s]
 69%|██████▉   | 7603/11049 [1:18:18<35:13,  1.63it/s]
                                                      
{'loss': 0.1969, 'grad_norm': 0.6347307562828064, 'learning_rate': 2.6817654839099443e-06, 'epoch': 2.06}

 69%|██████▉   | 7603/11049 [1:18:18<35:13,  1.63it/s]
 69%|██████▉   | 7604/11049 [1:18:19<35:12,  1.63it/s]
                                                      
{'loss': 0.1716, 'grad_norm': 0.5690134763717651, 'learning_rate': 2.68036600483697e-06, 'epoch': 2.06}

 69%|██████▉   | 7604/11049 [1:18:19<35:12,  1.63it/s]
 69%|██████▉   | 7605/11049 [1:18:19<35:12,  1.63it/s]
                                                      
{'loss': 0.1423, 'grad_norm': 0.531171441078186, 'learning_rate': 2.678966757288507e-06, 'epoch': 2.06}

 69%|██████▉   | 7605/11049 [1:18:19<35:12,  1.63it/s]
 69%|██████▉   | 7606/11049 [1:18:20<35:11,  1.63it/s]
                                                      
{'loss': 0.1097, 'grad_norm': 0.415814608335495, 'learning_rate': 2.677567741404214e-06, 'epoch': 2.07}

 69%|██████▉   | 7606/11049 [1:18:20<35:11,  1.63it/s]
 69%|██████▉   | 7607/11049 [1:18:21<35:10,  1.63it/s]
                                                      
{'loss': 0.144, 'grad_norm': 0.5008026957511902, 'learning_rate': 2.6761689573237295e-06, 'epoch': 2.07}

 69%|██████▉   | 7607/11049 [1:18:21<35:10,  1.63it/s]
 69%|██████▉   | 7608/11049 [1:18:21<35:09,  1.63it/s]
                                                      
{'loss': 0.1383, 'grad_norm': 0.4886530637741089, 'learning_rate': 2.674770405186664e-06, 'epoch': 2.07}

 69%|██████▉   | 7608/11049 [1:18:21<35:09,  1.63it/s]
 69%|██████▉   | 7609/11049 [1:18:22<35:09,  1.63it/s]
                                                      
{'loss': 0.131, 'grad_norm': 0.48499250411987305, 'learning_rate': 2.6733720851326127e-06, 'epoch': 2.07}

 69%|██████▉   | 7609/11049 [1:18:22<35:09,  1.63it/s]
 69%|██████▉   | 7610/11049 [1:18:22<35:08,  1.63it/s]
                                                      
{'loss': 0.1258, 'grad_norm': 0.5052603483200073, 'learning_rate': 2.6719739973011414e-06, 'epoch': 2.07}

 69%|██████▉   | 7610/11049 [1:18:23<35:08,  1.63it/s]
 69%|██████▉   | 7611/11049 [1:18:23<35:07,  1.63it/s]
                                                      
{'loss': 0.1796, 'grad_norm': 0.6310951113700867, 'learning_rate': 2.670576141831793e-06, 'epoch': 2.07}

 69%|██████▉   | 7611/11049 [1:18:23<35:07,  1.63it/s]
 69%|██████▉   | 7612/11049 [1:18:24<35:08,  1.63it/s]
                                                      
{'loss': 0.23, 'grad_norm': 0.730737566947937, 'learning_rate': 2.6691785188640905e-06, 'epoch': 2.07}

 69%|██████▉   | 7612/11049 [1:18:24<35:08,  1.63it/s]
 69%|██████▉   | 7613/11049 [1:18:24<35:06,  1.63it/s]
                                                      
{'loss': 0.1437, 'grad_norm': 0.49505335092544556, 'learning_rate': 2.6677811285375303e-06, 'epoch': 2.07}

 69%|██████▉   | 7613/11049 [1:18:24<35:06,  1.63it/s]
 69%|██████▉   | 7614/11049 [1:18:25<35:06,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.5865000486373901, 'learning_rate': 2.6663839709915877e-06, 'epoch': 2.07}

 69%|██████▉   | 7614/11049 [1:18:25<35:06,  1.63it/s]
 69%|██████▉   | 7615/11049 [1:18:25<35:05,  1.63it/s]
                                                      
{'loss': 0.1346, 'grad_norm': 0.4435933828353882, 'learning_rate': 2.6649870463657134e-06, 'epoch': 2.07}

 69%|██████▉   | 7615/11049 [1:18:26<35:05,  1.63it/s]
 69%|██████▉   | 7616/11049 [1:18:26<35:06,  1.63it/s]
                                                      
{'loss': 0.1814, 'grad_norm': 0.7064557671546936, 'learning_rate': 2.6635903547993346e-06, 'epoch': 2.07}

 69%|██████▉   | 7616/11049 [1:18:26<35:06,  1.63it/s]
 69%|██████▉   | 7617/11049 [1:18:27<35:04,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.493694543838501, 'learning_rate': 2.6621938964318593e-06, 'epoch': 2.07}

 69%|██████▉   | 7617/11049 [1:18:27<35:04,  1.63it/s]
 69%|██████▉   | 7618/11049 [1:18:27<35:03,  1.63it/s]
                                                      
{'loss': 0.1459, 'grad_norm': 0.5513491034507751, 'learning_rate': 2.6607976714026677e-06, 'epoch': 2.07}

 69%|██████▉   | 7618/11049 [1:18:27<35:03,  1.63it/s]
 69%|██████▉   | 7619/11049 [1:18:28<35:04,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.7085751891136169, 'learning_rate': 2.659401679851118e-06, 'epoch': 2.07}

 69%|██████▉   | 7619/11049 [1:18:28<35:04,  1.63it/s]
 69%|██████▉   | 7620/11049 [1:18:29<35:03,  1.63it/s]
                                                      
{'loss': 0.129, 'grad_norm': 0.5235562324523926, 'learning_rate': 2.6580059219165426e-06, 'epoch': 2.07}

 69%|██████▉   | 7620/11049 [1:18:29<35:03,  1.63it/s]
 69%|██████▉   | 7621/11049 [1:18:29<35:02,  1.63it/s]
                                                      
{'loss': 0.151, 'grad_norm': 0.4987693727016449, 'learning_rate': 2.6566103977382583e-06, 'epoch': 2.07}

 69%|██████▉   | 7621/11049 [1:18:29<35:02,  1.63it/s]
 69%|██████▉   | 7622/11049 [1:18:30<35:01,  1.63it/s]
                                                      
{'loss': 0.1614, 'grad_norm': 0.6789862513542175, 'learning_rate': 2.655215107455552e-06, 'epoch': 2.07}

 69%|██████▉   | 7622/11049 [1:18:30<35:01,  1.63it/s]
 69%|██████▉   | 7623/11049 [1:18:30<35:00,  1.63it/s]
                                                      
{'loss': 0.1442, 'grad_norm': 0.5889989733695984, 'learning_rate': 2.653820051207687e-06, 'epoch': 2.07}

 69%|██████▉   | 7623/11049 [1:18:30<35:00,  1.63it/s]
 69%|██████▉   | 7624/11049 [1:18:31<34:59,  1.63it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.5390520691871643, 'learning_rate': 2.6524252291339025e-06, 'epoch': 2.07}

 69%|██████▉   | 7624/11049 [1:18:31<34:59,  1.63it/s]
 69%|██████▉   | 7625/11049 [1:18:32<34:58,  1.63it/s]
                                                      
{'loss': 0.1444, 'grad_norm': 0.9343213438987732, 'learning_rate': 2.6510306413734223e-06, 'epoch': 2.07}

 69%|██████▉   | 7625/11049 [1:18:32<34:58,  1.63it/s]
 69%|██████▉   | 7626/11049 [1:18:32<34:56,  1.63it/s]
                                                      
{'loss': 0.1489, 'grad_norm': 0.5836066603660583, 'learning_rate': 2.6496362880654387e-06, 'epoch': 2.07}

 69%|██████▉   | 7626/11049 [1:18:32<34:56,  1.63it/s]
 69%|██████▉   | 7627/11049 [1:18:33<34:57,  1.63it/s]
                                                      
{'loss': 0.1378, 'grad_norm': 0.5279693007469177, 'learning_rate': 2.6482421693491236e-06, 'epoch': 2.07}

 69%|██████▉   | 7627/11049 [1:18:33<34:57,  1.63it/s]
 69%|██████▉   | 7628/11049 [1:18:33<34:58,  1.63it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.7554937601089478, 'learning_rate': 2.6468482853636223e-06, 'epoch': 2.07}

 69%|██████▉   | 7628/11049 [1:18:34<34:58,  1.63it/s]
 69%|██████▉   | 7629/11049 [1:18:34<34:56,  1.63it/s]
                                                      
{'loss': 0.1635, 'grad_norm': 0.5598932504653931, 'learning_rate': 2.6454546362480647e-06, 'epoch': 2.07}

 69%|██████▉   | 7629/11049 [1:18:34<34:56,  1.63it/s]
 69%|██████▉   | 7630/11049 [1:18:35<34:56,  1.63it/s]
                                                      
{'loss': 0.1414, 'grad_norm': 0.497137188911438, 'learning_rate': 2.6440612221415498e-06, 'epoch': 2.07}

 69%|██████▉   | 7630/11049 [1:18:35<34:56,  1.63it/s]
 69%|██████▉   | 7631/11049 [1:18:35<34:55,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.5551186800003052, 'learning_rate': 2.6426680431831543e-06, 'epoch': 2.07}

 69%|██████▉   | 7631/11049 [1:18:35<34:55,  1.63it/s]
 69%|██████▉   | 7632/11049 [1:18:36<34:55,  1.63it/s]
                                                      
{'loss': 0.134, 'grad_norm': 0.4860396683216095, 'learning_rate': 2.6412750995119327e-06, 'epoch': 2.07}

 69%|██████▉   | 7632/11049 [1:18:36<34:55,  1.63it/s]
 69%|██████▉   | 7633/11049 [1:18:36<34:55,  1.63it/s]
                                                      
{'loss': 0.1293, 'grad_norm': 0.45357394218444824, 'learning_rate': 2.6398823912669175e-06, 'epoch': 2.07}

 69%|██████▉   | 7633/11049 [1:18:37<34:55,  1.63it/s]
 69%|██████▉   | 7634/11049 [1:18:37<34:54,  1.63it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.5436519384384155, 'learning_rate': 2.638489918587114e-06, 'epoch': 2.07}

 69%|██████▉   | 7634/11049 [1:18:37<34:54,  1.63it/s]
 69%|██████▉   | 7635/11049 [1:18:38<34:53,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.6814112067222595, 'learning_rate': 2.6370976816115066e-06, 'epoch': 2.07}

 69%|██████▉   | 7635/11049 [1:18:38<34:53,  1.63it/s]
 69%|██████▉   | 7636/11049 [1:18:38<34:52,  1.63it/s]
                                                      
{'loss': 0.149, 'grad_norm': 0.5204775929450989, 'learning_rate': 2.635705680479055e-06, 'epoch': 2.07}

 69%|██████▉   | 7636/11049 [1:18:38<34:52,  1.63it/s]
 69%|██████▉   | 7637/11049 [1:18:39<34:52,  1.63it/s]
                                                      
{'loss': 0.1818, 'grad_norm': 0.593670666217804, 'learning_rate': 2.634313915328698e-06, 'epoch': 2.07}

 69%|██████▉   | 7637/11049 [1:18:39<34:52,  1.63it/s]
 69%|██████▉   | 7638/11049 [1:18:40<34:51,  1.63it/s]
                                                      
{'loss': 0.1643, 'grad_norm': 0.5526209473609924, 'learning_rate': 2.632922386299347e-06, 'epoch': 2.07}

 69%|██████▉   | 7638/11049 [1:18:40<34:51,  1.63it/s]
 69%|██████▉   | 7639/11049 [1:18:40<34:51,  1.63it/s]
                                                      
{'loss': 0.1521, 'grad_norm': 0.5403619408607483, 'learning_rate': 2.6315310935298925e-06, 'epoch': 2.07}

 69%|██████▉   | 7639/11049 [1:18:40<34:51,  1.63it/s]
 69%|██████▉   | 7640/11049 [1:18:41<34:50,  1.63it/s]
                                                      
{'loss': 0.1348, 'grad_norm': 0.5433885455131531, 'learning_rate': 2.6301400371592e-06, 'epoch': 2.07}

 69%|██████▉   | 7640/11049 [1:18:41<34:50,  1.63it/s]
 69%|██████▉   | 7641/11049 [1:18:41<34:50,  1.63it/s]
                                                      
{'loss': 0.1582, 'grad_norm': 0.5538585782051086, 'learning_rate': 2.6287492173261132e-06, 'epoch': 2.07}

 69%|██████▉   | 7641/11049 [1:18:42<34:50,  1.63it/s]
 69%|██████▉   | 7642/11049 [1:18:42<34:50,  1.63it/s]
                                                      
{'loss': 0.1354, 'grad_norm': 0.5466148257255554, 'learning_rate': 2.6273586341694486e-06, 'epoch': 2.07}

 69%|██████▉   | 7642/11049 [1:18:42<34:50,  1.63it/s]
 69%|██████▉   | 7643/11049 [1:18:43<34:50,  1.63it/s]
                                                      
{'loss': 0.1414, 'grad_norm': 0.5395418405532837, 'learning_rate': 2.625968287828003e-06, 'epoch': 2.08}

 69%|██████▉   | 7643/11049 [1:18:43<34:50,  1.63it/s]
 69%|██████▉   | 7644/11049 [1:18:43<34:49,  1.63it/s]
                                                      
{'loss': 0.1976, 'grad_norm': 0.6801400184631348, 'learning_rate': 2.6245781784405457e-06, 'epoch': 2.08}

 69%|██████▉   | 7644/11049 [1:18:43<34:49,  1.63it/s]
 69%|██████▉   | 7645/11049 [1:18:44<34:47,  1.63it/s]
                                                      
{'loss': 0.1509, 'grad_norm': 0.5442211031913757, 'learning_rate': 2.6231883061458284e-06, 'epoch': 2.08}

 69%|██████▉   | 7645/11049 [1:18:44<34:47,  1.63it/s]
 69%|██████▉   | 7646/11049 [1:18:44<34:47,  1.63it/s]
                                                      
{'loss': 0.1821, 'grad_norm': 0.5452951788902283, 'learning_rate': 2.6217986710825734e-06, 'epoch': 2.08}

 69%|██████▉   | 7646/11049 [1:18:45<34:47,  1.63it/s]
 69%|██████▉   | 7647/11049 [1:18:45<34:46,  1.63it/s]
                                                      
{'loss': 0.1628, 'grad_norm': 0.5598617196083069, 'learning_rate': 2.6204092733894814e-06, 'epoch': 2.08}

 69%|██████▉   | 7647/11049 [1:18:45<34:46,  1.63it/s]
 69%|██████▉   | 7648/11049 [1:18:46<34:45,  1.63it/s]
                                                      
{'loss': 0.1362, 'grad_norm': 0.5365062952041626, 'learning_rate': 2.6190201132052296e-06, 'epoch': 2.08}

 69%|██████▉   | 7648/11049 [1:18:46<34:45,  1.63it/s]
 69%|██████▉   | 7649/11049 [1:18:46<34:44,  1.63it/s]
                                                      
{'loss': 0.1385, 'grad_norm': 0.49435046315193176, 'learning_rate': 2.6176311906684704e-06, 'epoch': 2.08}

 69%|██████▉   | 7649/11049 [1:18:46<34:44,  1.63it/s]
 69%|██████▉   | 7650/11049 [1:18:47<34:44,  1.63it/s]
                                                      
{'loss': 0.1708, 'grad_norm': 0.6452330946922302, 'learning_rate': 2.616242505917834e-06, 'epoch': 2.08}

 69%|██████▉   | 7650/11049 [1:18:47<34:44,  1.63it/s]
 69%|██████▉   | 7651/11049 [1:18:48<34:43,  1.63it/s]
                                                      
{'loss': 0.1382, 'grad_norm': 0.5370437502861023, 'learning_rate': 2.614854059091926e-06, 'epoch': 2.08}

 69%|██████▉   | 7651/11049 [1:18:48<34:43,  1.63it/s]
 69%|██████▉   | 7652/11049 [1:18:48<34:43,  1.63it/s]
                                                      
{'loss': 0.1602, 'grad_norm': 0.695069432258606, 'learning_rate': 2.613465850329325e-06, 'epoch': 2.08}

 69%|██████▉   | 7652/11049 [1:18:48<34:43,  1.63it/s]
 69%|██████▉   | 7653/11049 [1:18:49<34:42,  1.63it/s]
                                                      
{'loss': 0.1807, 'grad_norm': 0.6791050434112549, 'learning_rate': 2.612077879768596e-06, 'epoch': 2.08}

 69%|██████▉   | 7653/11049 [1:18:49<34:42,  1.63it/s]
 69%|██████▉   | 7654/11049 [1:18:49<34:42,  1.63it/s]
                                                      
{'loss': 0.1674, 'grad_norm': 0.5953221321105957, 'learning_rate': 2.6106901475482694e-06, 'epoch': 2.08}

 69%|██████▉   | 7654/11049 [1:18:50<34:42,  1.63it/s]
 69%|██████▉   | 7655/11049 [1:18:50<34:41,  1.63it/s]
                                                      
{'loss': 0.1255, 'grad_norm': 0.4634787142276764, 'learning_rate': 2.6093026538068556e-06, 'epoch': 2.08}

 69%|██████▉   | 7655/11049 [1:18:50<34:41,  1.63it/s]
 69%|██████▉   | 7656/11049 [1:18:51<34:40,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.5529349446296692, 'learning_rate': 2.607915398682841e-06, 'epoch': 2.08}

 69%|██████▉   | 7656/11049 [1:18:51<34:40,  1.63it/s]
 69%|██████▉   | 7657/11049 [1:18:51<34:40,  1.63it/s]
                                                      
{'loss': 0.1353, 'grad_norm': 0.5029904842376709, 'learning_rate': 2.6065283823146916e-06, 'epoch': 2.08}

 69%|██████▉   | 7657/11049 [1:18:51<34:40,  1.63it/s]
 69%|██████▉   | 7658/11049 [1:18:52<34:40,  1.63it/s]
                                                      
{'loss': 0.1908, 'grad_norm': 0.6309143900871277, 'learning_rate': 2.605141604840846e-06, 'epoch': 2.08}

 69%|██████▉   | 7658/11049 [1:18:52<34:40,  1.63it/s]
 69%|██████▉   | 7659/11049 [1:18:52<34:39,  1.63it/s]
                                                      
{'loss': 0.1539, 'grad_norm': 0.5883976221084595, 'learning_rate': 2.603755066399718e-06, 'epoch': 2.08}

 69%|██████▉   | 7659/11049 [1:18:53<34:39,  1.63it/s]
 69%|██████▉   | 7660/11049 [1:18:53<34:39,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.5589971542358398, 'learning_rate': 2.602368767129696e-06, 'epoch': 2.08}

 69%|██████▉   | 7660/11049 [1:18:53<34:39,  1.63it/s]
 69%|██████▉   | 7661/11049 [1:18:54<34:39,  1.63it/s]
                                                      
{'loss': 0.1433, 'grad_norm': 0.528179943561554, 'learning_rate': 2.600982707169154e-06, 'epoch': 2.08}

 69%|██████▉   | 7661/11049 [1:18:54<34:39,  1.63it/s]
 69%|██████▉   | 7662/11049 [1:18:54<34:37,  1.63it/s]
                                                      
{'loss': 0.13, 'grad_norm': 0.5070511698722839, 'learning_rate': 2.5995968866564323e-06, 'epoch': 2.08}

 69%|██████▉   | 7662/11049 [1:18:54<34:37,  1.63it/s]
 69%|██████▉   | 7663/11049 [1:18:55<34:36,  1.63it/s]
                                                      
{'loss': 0.1431, 'grad_norm': 0.4967878758907318, 'learning_rate': 2.598211305729852e-06, 'epoch': 2.08}

 69%|██████▉   | 7663/11049 [1:18:55<34:36,  1.63it/s]
 69%|██████▉   | 7664/11049 [1:18:56<34:35,  1.63it/s]
                                                      
{'loss': 0.1189, 'grad_norm': 0.5203028321266174, 'learning_rate': 2.596825964527706e-06, 'epoch': 2.08}

 69%|██████▉   | 7664/11049 [1:18:56<34:35,  1.63it/s]
 69%|██████▉   | 7665/11049 [1:18:56<34:35,  1.63it/s]
                                                      
{'loss': 0.1929, 'grad_norm': 0.6352847814559937, 'learning_rate': 2.59544086318827e-06, 'epoch': 2.08}

 69%|██████▉   | 7665/11049 [1:18:56<34:35,  1.63it/s]
 69%|██████▉   | 7666/11049 [1:18:57<34:34,  1.63it/s]
                                                      
{'loss': 0.1501, 'grad_norm': 0.5602362155914307, 'learning_rate': 2.594056001849792e-06, 'epoch': 2.08}

 69%|██████▉   | 7666/11049 [1:18:57<34:34,  1.63it/s]
 69%|██████▉   | 7667/11049 [1:18:57<34:33,  1.63it/s]
                                                      
{'loss': 0.1619, 'grad_norm': 0.6253381967544556, 'learning_rate': 2.5926713806504935e-06, 'epoch': 2.08}

 69%|██████▉   | 7667/11049 [1:18:57<34:33,  1.63it/s]
 69%|██████▉   | 7668/11049 [1:18:58<34:34,  1.63it/s]
                                                      
{'loss': 0.172, 'grad_norm': 0.5858746767044067, 'learning_rate': 2.5912869997285767e-06, 'epoch': 2.08}

 69%|██████▉   | 7668/11049 [1:18:58<34:34,  1.63it/s]
 69%|██████▉   | 7669/11049 [1:18:59<34:32,  1.63it/s]
                                                      
{'loss': 0.1888, 'grad_norm': 0.771466851234436, 'learning_rate': 2.5899028592222164e-06, 'epoch': 2.08}

 69%|██████▉   | 7669/11049 [1:18:59<34:32,  1.63it/s]
 69%|██████▉   | 7670/11049 [1:18:59<34:31,  1.63it/s]
                                                      
{'loss': 0.1668, 'grad_norm': 0.5785294771194458, 'learning_rate': 2.588518959269566e-06, 'epoch': 2.08}

 69%|██████▉   | 7670/11049 [1:18:59<34:31,  1.63it/s]
 69%|██████▉   | 7671/11049 [1:19:00<34:32,  1.63it/s]
                                                      
{'loss': 0.1692, 'grad_norm': 0.5479029417037964, 'learning_rate': 2.5871353000087527e-06, 'epoch': 2.08}

 69%|██████▉   | 7671/11049 [1:19:00<34:32,  1.63it/s]
 69%|██████▉   | 7672/11049 [1:19:00<34:32,  1.63it/s]
                                                      
{'loss': 0.1873, 'grad_norm': 0.5976292490959167, 'learning_rate': 2.5857518815778795e-06, 'epoch': 2.08}

 69%|██████▉   | 7672/11049 [1:19:01<34:32,  1.63it/s]
 69%|██████▉   | 7673/11049 [1:19:01<34:31,  1.63it/s]
                                                      
{'loss': 0.1634, 'grad_norm': 0.6144110560417175, 'learning_rate': 2.5843687041150294e-06, 'epoch': 2.08}

 69%|██████▉   | 7673/11049 [1:19:01<34:31,  1.63it/s]
 69%|██████▉   | 7674/11049 [1:19:02<34:30,  1.63it/s]
                                                      
{'loss': 0.155, 'grad_norm': 0.5777512192726135, 'learning_rate': 2.582985767758257e-06, 'epoch': 2.08}

 69%|██████▉   | 7674/11049 [1:19:02<34:30,  1.63it/s]
 69%|██████▉   | 7675/11049 [1:19:02<34:29,  1.63it/s]
                                                      
{'loss': 0.1488, 'grad_norm': 0.5310946702957153, 'learning_rate': 2.5816030726455947e-06, 'epoch': 2.08}

 69%|██████▉   | 7675/11049 [1:19:02<34:29,  1.63it/s]
 69%|██████▉   | 7676/11049 [1:19:03<34:28,  1.63it/s]
                                                      
{'loss': 0.1383, 'grad_norm': 0.5485827922821045, 'learning_rate': 2.5802206189150496e-06, 'epoch': 2.08}

 69%|██████▉   | 7676/11049 [1:19:03<34:28,  1.63it/s]
 69%|██████▉   | 7677/11049 [1:19:03<34:27,  1.63it/s]
                                                      
{'loss': 0.1608, 'grad_norm': 0.642314612865448, 'learning_rate': 2.5788384067046056e-06, 'epoch': 2.08}

 69%|██████▉   | 7677/11049 [1:19:04<34:27,  1.63it/s]
 69%|██████▉   | 7678/11049 [1:19:04<34:26,  1.63it/s]
                                                      
{'loss': 0.1683, 'grad_norm': 0.6258785128593445, 'learning_rate': 2.5774564361522235e-06, 'epoch': 2.08}

 69%|██████▉   | 7678/11049 [1:19:04<34:26,  1.63it/s]
 69%|██████▉   | 7679/11049 [1:19:05<34:25,  1.63it/s]
                                                      
{'loss': 0.1373, 'grad_norm': 0.5753723978996277, 'learning_rate': 2.5760747073958376e-06, 'epoch': 2.08}

 69%|██████▉   | 7679/11049 [1:19:05<34:25,  1.63it/s]
 70%|██████▉   | 7680/11049 [1:19:05<34:25,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.6182743906974792, 'learning_rate': 2.57469322057336e-06, 'epoch': 2.09}

 70%|██████▉   | 7680/11049 [1:19:05<34:25,  1.63it/s]
 70%|██████▉   | 7681/11049 [1:19:06<34:25,  1.63it/s]
                                                      
{'loss': 0.2104, 'grad_norm': 0.6648699045181274, 'learning_rate': 2.5733119758226756e-06, 'epoch': 2.09}

 70%|██████▉   | 7681/11049 [1:19:06<34:25,  1.63it/s]
 70%|██████▉   | 7682/11049 [1:19:07<34:24,  1.63it/s]
                                                      
{'loss': 0.1495, 'grad_norm': 0.5219230651855469, 'learning_rate': 2.571930973281651e-06, 'epoch': 2.09}

 70%|██████▉   | 7682/11049 [1:19:07<34:24,  1.63it/s]
 70%|██████▉   | 7683/11049 [1:19:07<34:24,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.541660726070404, 'learning_rate': 2.570550213088125e-06, 'epoch': 2.09}

 70%|██████▉   | 7683/11049 [1:19:07<34:24,  1.63it/s]
 70%|██████▉   | 7684/11049 [1:19:08<34:24,  1.63it/s]
                                                      
{'loss': 0.137, 'grad_norm': 0.5065963864326477, 'learning_rate': 2.5691696953799106e-06, 'epoch': 2.09}

 70%|██████▉   | 7684/11049 [1:19:08<34:24,  1.63it/s]
 70%|██████▉   | 7685/11049 [1:19:08<34:23,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.6005091667175293, 'learning_rate': 2.5677894202947996e-06, 'epoch': 2.09}

 70%|██████▉   | 7685/11049 [1:19:09<34:23,  1.63it/s]
 70%|██████▉   | 7686/11049 [1:19:09<34:22,  1.63it/s]
                                                      
{'loss': 0.1621, 'grad_norm': 0.8094531893730164, 'learning_rate': 2.5664093879705574e-06, 'epoch': 2.09}

 70%|██████▉   | 7686/11049 [1:19:09<34:22,  1.63it/s]
 70%|██████▉   | 7687/11049 [1:19:10<34:22,  1.63it/s]
                                                      
{'loss': 0.1714, 'grad_norm': 0.5406697392463684, 'learning_rate': 2.5650295985449264e-06, 'epoch': 2.09}

 70%|██████▉   | 7687/11049 [1:19:10<34:22,  1.63it/s]
 70%|██████▉   | 7688/11049 [1:19:10<34:20,  1.63it/s]
                                                      
{'loss': 0.1506, 'grad_norm': 0.5261840224266052, 'learning_rate': 2.5636500521556247e-06, 'epoch': 2.09}

 70%|██████▉   | 7688/11049 [1:19:10<34:20,  1.63it/s]
 70%|██████▉   | 7689/11049 [1:19:11<34:20,  1.63it/s]
                                                      
{'loss': 0.1381, 'grad_norm': 0.5659665465354919, 'learning_rate': 2.5622707489403436e-06, 'epoch': 2.09}

 70%|██████▉   | 7689/11049 [1:19:11<34:20,  1.63it/s]
 70%|██████▉   | 7690/11049 [1:19:11<34:19,  1.63it/s]
                                                      
{'loss': 0.13, 'grad_norm': 0.5313687324523926, 'learning_rate': 2.5608916890367567e-06, 'epoch': 2.09}

 70%|██████▉   | 7690/11049 [1:19:12<34:19,  1.63it/s]
 70%|██████▉   | 7691/11049 [1:19:12<34:18,  1.63it/s]
                                                      
{'loss': 0.1556, 'grad_norm': 0.5492151379585266, 'learning_rate': 2.5595128725825074e-06, 'epoch': 2.09}

 70%|██████▉   | 7691/11049 [1:19:12<34:18,  1.63it/s]
 70%|██████▉   | 7692/11049 [1:19:13<34:18,  1.63it/s]
                                                      
{'loss': 0.185, 'grad_norm': 0.5839862823486328, 'learning_rate': 2.5581342997152157e-06, 'epoch': 2.09}

 70%|██████▉   | 7692/11049 [1:19:13<34:18,  1.63it/s]
 70%|██████▉   | 7693/11049 [1:19:13<34:17,  1.63it/s]
                                                      
{'loss': 0.1704, 'grad_norm': 0.6620041131973267, 'learning_rate': 2.5567559705724765e-06, 'epoch': 2.09}

 70%|██████▉   | 7693/11049 [1:19:13<34:17,  1.63it/s]
 70%|██████▉   | 7694/11049 [1:19:14<34:16,  1.63it/s]
                                                      
{'loss': 0.1336, 'grad_norm': 0.4732745885848999, 'learning_rate': 2.5553778852918683e-06, 'epoch': 2.09}

 70%|██████▉   | 7694/11049 [1:19:14<34:16,  1.63it/s]
 70%|██████▉   | 7695/11049 [1:19:15<34:16,  1.63it/s]
                                                      
{'loss': 0.1139, 'grad_norm': 0.45787566900253296, 'learning_rate': 2.5540000440109316e-06, 'epoch': 2.09}

 70%|██████▉   | 7695/11049 [1:19:15<34:16,  1.63it/s]
 70%|██████▉   | 7696/11049 [1:19:15<34:16,  1.63it/s]
                                                      
{'loss': 0.1485, 'grad_norm': 0.5636928677558899, 'learning_rate': 2.5526224468671934e-06, 'epoch': 2.09}

 70%|██████▉   | 7696/11049 [1:19:15<34:16,  1.63it/s]
 70%|██████▉   | 7697/11049 [1:19:16<34:15,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.5718493461608887, 'learning_rate': 2.5512450939981494e-06, 'epoch': 2.09}

 70%|██████▉   | 7697/11049 [1:19:16<34:15,  1.63it/s]
 70%|██████▉   | 7698/11049 [1:19:16<34:18,  1.63it/s]
                                                      
{'loss': 0.1127, 'grad_norm': 0.47707074880599976, 'learning_rate': 2.5498679855412796e-06, 'epoch': 2.09}

 70%|██████▉   | 7698/11049 [1:19:16<34:18,  1.63it/s]
 70%|██████▉   | 7699/11049 [1:19:17<34:16,  1.63it/s]
                                                      
{'loss': 0.189, 'grad_norm': 0.656202495098114, 'learning_rate': 2.5484911216340314e-06, 'epoch': 2.09}

 70%|██████▉   | 7699/11049 [1:19:17<34:16,  1.63it/s]
 70%|██████▉   | 7700/11049 [1:19:18<34:15,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.5575644373893738, 'learning_rate': 2.5471145024138307e-06, 'epoch': 2.09}

 70%|██████▉   | 7700/11049 [1:19:18<34:15,  1.63it/s]
 70%|██████▉   | 7701/11049 [1:19:18<34:14,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.5277137756347656, 'learning_rate': 2.5457381280180772e-06, 'epoch': 2.09}

 70%|██████▉   | 7701/11049 [1:19:18<34:14,  1.63it/s]
 70%|██████▉   | 7702/11049 [1:19:19<34:13,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.5912516117095947, 'learning_rate': 2.5443619985841518e-06, 'epoch': 2.09}

 70%|██████▉   | 7702/11049 [1:19:19<34:13,  1.63it/s]
 70%|██████▉   | 7703/11049 [1:19:19<34:12,  1.63it/s]
                                                      
{'loss': 0.1189, 'grad_norm': 0.5000214576721191, 'learning_rate': 2.542986114249405e-06, 'epoch': 2.09}

 70%|██████▉   | 7703/11049 [1:19:20<34:12,  1.63it/s]
 70%|██████▉   | 7704/11049 [1:19:20<34:12,  1.63it/s]
                                                      
{'loss': 0.1758, 'grad_norm': 0.5967326760292053, 'learning_rate': 2.5416104751511674e-06, 'epoch': 2.09}

 70%|██████▉   | 7704/11049 [1:19:20<34:12,  1.63it/s]
 70%|██████▉   | 7705/11049 [1:19:21<34:10,  1.63it/s]
                                                      
{'loss': 0.1815, 'grad_norm': 0.645206868648529, 'learning_rate': 2.5402350814267364e-06, 'epoch': 2.09}

 70%|██████▉   | 7705/11049 [1:19:21<34:10,  1.63it/s]
 70%|██████▉   | 7706/11049 [1:19:21<34:09,  1.63it/s]
                                                      
{'loss': 0.1141, 'grad_norm': 0.42564618587493896, 'learning_rate': 2.5388599332133966e-06, 'epoch': 2.09}

 70%|██████▉   | 7706/11049 [1:19:21<34:09,  1.63it/s]
 70%|██████▉   | 7707/11049 [1:19:22<34:09,  1.63it/s]
                                                      
{'loss': 0.2794, 'grad_norm': 0.7409762740135193, 'learning_rate': 2.537485030648401e-06, 'epoch': 2.09}

 70%|██████▉   | 7707/11049 [1:19:22<34:09,  1.63it/s]
 70%|██████▉   | 7708/11049 [1:19:22<34:08,  1.63it/s]
                                                      
{'loss': 0.1322, 'grad_norm': 0.6024580597877502, 'learning_rate': 2.5361103738689796e-06, 'epoch': 2.09}

 70%|██████▉   | 7708/11049 [1:19:23<34:08,  1.63it/s]
 70%|██████▉   | 7709/11049 [1:19:23<34:07,  1.63it/s]
                                                      
{'loss': 0.1948, 'grad_norm': 0.6759169697761536, 'learning_rate': 2.534735963012337e-06, 'epoch': 2.09}

 70%|██████▉   | 7709/11049 [1:19:23<34:07,  1.63it/s]
 70%|██████▉   | 7710/11049 [1:19:24<34:07,  1.63it/s]
                                                      
{'loss': 0.1837, 'grad_norm': 0.625901460647583, 'learning_rate': 2.5333617982156566e-06, 'epoch': 2.09}

 70%|██████▉   | 7710/11049 [1:19:24<34:07,  1.63it/s]
 70%|██████▉   | 7711/11049 [1:19:24<34:06,  1.63it/s]
                                                      
{'loss': 0.1339, 'grad_norm': 0.5761780142784119, 'learning_rate': 2.5319878796160947e-06, 'epoch': 2.09}

 70%|██████▉   | 7711/11049 [1:19:24<34:06,  1.63it/s]
 70%|██████▉   | 7712/11049 [1:19:25<34:06,  1.63it/s]
                                                      
{'loss': 0.1836, 'grad_norm': 0.8736531734466553, 'learning_rate': 2.5306142073507813e-06, 'epoch': 2.09}

 70%|██████▉   | 7712/11049 [1:19:25<34:06,  1.63it/s]
 70%|██████▉   | 7713/11049 [1:19:26<34:06,  1.63it/s]
                                                      
{'loss': 0.1388, 'grad_norm': 0.5070859789848328, 'learning_rate': 2.529240781556824e-06, 'epoch': 2.09}

 70%|██████▉   | 7713/11049 [1:19:26<34:06,  1.63it/s]
 70%|██████▉   | 7714/11049 [1:19:26<34:05,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.6026882529258728, 'learning_rate': 2.527867602371307e-06, 'epoch': 2.09}

 70%|██████▉   | 7714/11049 [1:19:26<34:05,  1.63it/s]
 70%|██████▉   | 7715/11049 [1:19:27<34:05,  1.63it/s]
                                                      
{'loss': 0.1326, 'grad_norm': 0.499054878950119, 'learning_rate': 2.5264946699312876e-06, 'epoch': 2.09}

 70%|██████▉   | 7715/11049 [1:19:27<34:05,  1.63it/s]
 70%|██████▉   | 7716/11049 [1:19:27<34:03,  1.63it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.5789380669593811, 'learning_rate': 2.5251219843737993e-06, 'epoch': 2.1}

 70%|██████▉   | 7716/11049 [1:19:28<34:03,  1.63it/s]
 70%|██████▉   | 7717/11049 [1:19:28<34:04,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.519347608089447, 'learning_rate': 2.5237495458358484e-06, 'epoch': 2.1}

 70%|██████▉   | 7717/11049 [1:19:28<34:04,  1.63it/s]
 70%|██████▉   | 7718/11049 [1:19:29<34:03,  1.63it/s]
                                                      
{'loss': 0.1545, 'grad_norm': 0.5802285671234131, 'learning_rate': 2.522377354454424e-06, 'epoch': 2.1}

 70%|██████▉   | 7718/11049 [1:19:29<34:03,  1.63it/s]
 70%|██████▉   | 7719/11049 [1:19:29<34:01,  1.63it/s]
                                                      
{'loss': 0.1436, 'grad_norm': 0.6048779487609863, 'learning_rate': 2.521005410366483e-06, 'epoch': 2.1}

 70%|██████▉   | 7719/11049 [1:19:29<34:01,  1.63it/s]
 70%|██████▉   | 7720/11049 [1:19:30<34:01,  1.63it/s]
                                                      
{'loss': 0.1919, 'grad_norm': 0.7152644991874695, 'learning_rate': 2.51963371370896e-06, 'epoch': 2.1}

 70%|██████▉   | 7720/11049 [1:19:30<34:01,  1.63it/s]
 70%|██████▉   | 7721/11049 [1:19:30<34:00,  1.63it/s]
                                                      
{'loss': 0.1533, 'grad_norm': 0.5741584897041321, 'learning_rate': 2.5182622646187648e-06, 'epoch': 2.1}

 70%|██████▉   | 7721/11049 [1:19:31<34:00,  1.63it/s]
 70%|██████▉   | 7722/11049 [1:19:31<33:59,  1.63it/s]
                                                      
{'loss': 0.142, 'grad_norm': 0.5524607300758362, 'learning_rate': 2.516891063232785e-06, 'epoch': 2.1}

 70%|██████▉   | 7722/11049 [1:19:31<33:59,  1.63it/s]
 70%|██████▉   | 7723/11049 [1:19:32<33:58,  1.63it/s]
                                                      
{'loss': 0.1608, 'grad_norm': 0.6348735094070435, 'learning_rate': 2.515520109687879e-06, 'epoch': 2.1}

 70%|██████▉   | 7723/11049 [1:19:32<33:58,  1.63it/s]
 70%|██████▉   | 7724/11049 [1:19:32<33:58,  1.63it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.549528956413269, 'learning_rate': 2.5141494041208837e-06, 'epoch': 2.1}

 70%|██████▉   | 7724/11049 [1:19:32<33:58,  1.63it/s]
 70%|██████▉   | 7725/11049 [1:19:33<33:58,  1.63it/s]
                                                      
{'loss': 0.1817, 'grad_norm': 0.6722843050956726, 'learning_rate': 2.512778946668608e-06, 'epoch': 2.1}

 70%|██████▉   | 7725/11049 [1:19:33<33:58,  1.63it/s]
 70%|██████▉   | 7726/11049 [1:19:34<33:58,  1.63it/s]
                                                      
{'loss': 0.1797, 'grad_norm': 0.6477420926094055, 'learning_rate': 2.511408737467843e-06, 'epoch': 2.1}

 70%|██████▉   | 7726/11049 [1:19:34<33:58,  1.63it/s]
 70%|██████▉   | 7727/11049 [1:19:34<34:02,  1.63it/s]
                                                      
{'loss': 0.1312, 'grad_norm': 0.5062553882598877, 'learning_rate': 2.510038776655347e-06, 'epoch': 2.1}

 70%|██████▉   | 7727/11049 [1:19:34<34:02,  1.63it/s]
 70%|██████▉   | 7728/11049 [1:19:35<34:00,  1.63it/s]
                                                      
{'loss': 0.19, 'grad_norm': 0.6597533226013184, 'learning_rate': 2.508669064367859e-06, 'epoch': 2.1}

 70%|██████▉   | 7728/11049 [1:19:35<34:00,  1.63it/s]
 70%|██████▉   | 7729/11049 [1:19:35<33:57,  1.63it/s]
                                                      
{'loss': 0.1408, 'grad_norm': 0.5405519008636475, 'learning_rate': 2.5072996007420868e-06, 'epoch': 2.1}

 70%|██████▉   | 7729/11049 [1:19:36<33:57,  1.63it/s]
 70%|██████▉   | 7730/11049 [1:19:36<33:55,  1.63it/s]
                                                      
{'loss': 0.1519, 'grad_norm': 0.5440692901611328, 'learning_rate': 2.5059303859147253e-06, 'epoch': 2.1}

 70%|██████▉   | 7730/11049 [1:19:36<33:55,  1.63it/s]
 70%|██████▉   | 7731/11049 [1:19:37<33:55,  1.63it/s]
                                                      
{'loss': 0.1522, 'grad_norm': 0.5357932448387146, 'learning_rate': 2.50456142002243e-06, 'epoch': 2.1}

 70%|██████▉   | 7731/11049 [1:19:37<33:55,  1.63it/s]
 70%|██████▉   | 7732/11049 [1:19:37<33:56,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.5882809162139893, 'learning_rate': 2.503192703201841e-06, 'epoch': 2.1}

 70%|██████▉   | 7732/11049 [1:19:37<33:56,  1.63it/s]
 70%|██████▉   | 7733/11049 [1:19:38<33:55,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.5875746607780457, 'learning_rate': 2.5018242355895682e-06, 'epoch': 2.1}

 70%|██████▉   | 7733/11049 [1:19:38<33:55,  1.63it/s]
 70%|██████▉   | 7734/11049 [1:19:38<33:54,  1.63it/s]
                                                      
{'loss': 0.1619, 'grad_norm': 0.5374001860618591, 'learning_rate': 2.5004560173222046e-06, 'epoch': 2.1}

 70%|██████▉   | 7734/11049 [1:19:39<33:54,  1.63it/s]
 70%|███████   | 7735/11049 [1:19:39<33:52,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5700627565383911, 'learning_rate': 2.499088048536311e-06, 'epoch': 2.1}

 70%|███████   | 7735/11049 [1:19:39<33:52,  1.63it/s]
 70%|███████   | 7736/11049 [1:19:40<33:51,  1.63it/s]
                                                      
{'loss': 0.1547, 'grad_norm': 0.5755413174629211, 'learning_rate': 2.4977203293684244e-06, 'epoch': 2.1}

 70%|███████   | 7736/11049 [1:19:40<33:51,  1.63it/s]
 70%|███████   | 7737/11049 [1:19:40<33:51,  1.63it/s]
                                                      
{'loss': 0.1314, 'grad_norm': 0.5223107933998108, 'learning_rate': 2.496352859955057e-06, 'epoch': 2.1}

 70%|███████   | 7737/11049 [1:19:40<33:51,  1.63it/s]
 70%|███████   | 7738/11049 [1:19:41<33:52,  1.63it/s]
                                                      
{'loss': 0.1727, 'grad_norm': 0.6775379776954651, 'learning_rate': 2.4949856404327007e-06, 'epoch': 2.1}

 70%|███████   | 7738/11049 [1:19:41<33:52,  1.63it/s]
 70%|███████   | 7739/11049 [1:19:42<33:52,  1.63it/s]
                                                      
{'loss': 0.1281, 'grad_norm': 0.5003021955490112, 'learning_rate': 2.4936186709378157e-06, 'epoch': 2.1}

 70%|███████   | 7739/11049 [1:19:42<33:52,  1.63it/s]
 70%|███████   | 7740/11049 [1:19:42<33:50,  1.63it/s]
                                                      
{'loss': 0.1763, 'grad_norm': 0.71608567237854, 'learning_rate': 2.4922519516068438e-06, 'epoch': 2.1}

 70%|███████   | 7740/11049 [1:19:42<33:50,  1.63it/s]
 70%|███████   | 7741/11049 [1:19:43<33:49,  1.63it/s]
                                                      
{'loss': 0.1845, 'grad_norm': 0.5716289281845093, 'learning_rate': 2.490885482576192e-06, 'epoch': 2.1}

 70%|███████   | 7741/11049 [1:19:43<33:49,  1.63it/s]
 70%|███████   | 7742/11049 [1:19:43<33:49,  1.63it/s]
                                                      
{'loss': 0.1424, 'grad_norm': 0.5203033685684204, 'learning_rate': 2.4895192639822547e-06, 'epoch': 2.1}

 70%|███████   | 7742/11049 [1:19:43<33:49,  1.63it/s]
 70%|███████   | 7743/11049 [1:19:44<33:47,  1.63it/s]
                                                      
{'loss': 0.1401, 'grad_norm': 0.5396039485931396, 'learning_rate': 2.4881532959613924e-06, 'epoch': 2.1}

 70%|███████   | 7743/11049 [1:19:44<33:47,  1.63it/s]
 70%|███████   | 7744/11049 [1:19:45<33:47,  1.63it/s]
                                                      
{'loss': 0.1665, 'grad_norm': 0.669733464717865, 'learning_rate': 2.486787578649944e-06, 'epoch': 2.1}

 70%|███████   | 7744/11049 [1:19:45<33:47,  1.63it/s]
 70%|███████   | 7745/11049 [1:19:45<33:46,  1.63it/s]
                                                      
{'loss': 0.1629, 'grad_norm': 0.6220657229423523, 'learning_rate': 2.4854221121842213e-06, 'epoch': 2.1}

 70%|███████   | 7745/11049 [1:19:45<33:46,  1.63it/s]
 70%|███████   | 7746/11049 [1:19:46<33:45,  1.63it/s]
                                                      
{'loss': 0.1525, 'grad_norm': 0.5035074949264526, 'learning_rate': 2.484056896700516e-06, 'epoch': 2.1}

 70%|███████   | 7746/11049 [1:19:46<33:45,  1.63it/s]
 70%|███████   | 7747/11049 [1:19:46<33:44,  1.63it/s]
                                                      
{'loss': 0.1585, 'grad_norm': 0.566805362701416, 'learning_rate': 2.48269193233509e-06, 'epoch': 2.1}

 70%|███████   | 7747/11049 [1:19:47<33:44,  1.63it/s]
 70%|███████   | 7748/11049 [1:19:47<33:43,  1.63it/s]
                                                      
{'loss': 0.1721, 'grad_norm': 0.6787189841270447, 'learning_rate': 2.4813272192241804e-06, 'epoch': 2.1}

 70%|███████   | 7748/11049 [1:19:47<33:43,  1.63it/s]
 70%|███████   | 7749/11049 [1:19:48<33:43,  1.63it/s]
                                                      
{'loss': 0.205, 'grad_norm': 0.7312430143356323, 'learning_rate': 2.4799627575040014e-06, 'epoch': 2.1}

 70%|███████   | 7749/11049 [1:19:48<33:43,  1.63it/s]
 70%|███████   | 7750/11049 [1:19:48<33:42,  1.63it/s]
                                                      
{'loss': 0.1742, 'grad_norm': 0.6402707099914551, 'learning_rate': 2.4785985473107406e-06, 'epoch': 2.1}

 70%|███████   | 7750/11049 [1:19:48<33:42,  1.63it/s]
 70%|███████   | 7751/11049 [1:19:49<33:42,  1.63it/s]
                                                      
{'loss': 0.1487, 'grad_norm': 0.5604779124259949, 'learning_rate': 2.4772345887805606e-06, 'epoch': 2.1}

 70%|███████   | 7751/11049 [1:19:49<33:42,  1.63it/s]
 70%|███████   | 7752/11049 [1:19:49<33:41,  1.63it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.5382101535797119, 'learning_rate': 2.475870882049599e-06, 'epoch': 2.1}

 70%|███████   | 7752/11049 [1:19:50<33:41,  1.63it/s]
 70%|███████   | 7753/11049 [1:19:50<33:40,  1.63it/s]
                                                      
{'loss': 0.2289, 'grad_norm': 0.7698666453361511, 'learning_rate': 2.4745074272539677e-06, 'epoch': 2.11}

 70%|███████   | 7753/11049 [1:19:50<33:40,  1.63it/s]
 70%|███████   | 7754/11049 [1:19:51<33:40,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.6168515682220459, 'learning_rate': 2.4731442245297564e-06, 'epoch': 2.11}

 70%|███████   | 7754/11049 [1:19:51<33:40,  1.63it/s]
 70%|███████   | 7755/11049 [1:19:51<33:38,  1.63it/s]
                                                      
{'loss': 0.1545, 'grad_norm': 0.5400118827819824, 'learning_rate': 2.471781274013027e-06, 'epoch': 2.11}

 70%|███████   | 7755/11049 [1:19:51<33:38,  1.63it/s]
 70%|███████   | 7756/11049 [1:19:52<33:38,  1.63it/s]
                                                      
{'loss': 0.1409, 'grad_norm': 0.5756479501724243, 'learning_rate': 2.4704185758398156e-06, 'epoch': 2.11}

 70%|███████   | 7756/11049 [1:19:52<33:38,  1.63it/s]
 70%|███████   | 7757/11049 [1:19:53<33:37,  1.63it/s]
                                                      
{'loss': 0.1665, 'grad_norm': 0.5491741299629211, 'learning_rate': 2.4690561301461357e-06, 'epoch': 2.11}

 70%|███████   | 7757/11049 [1:19:53<33:37,  1.63it/s]
 70%|███████   | 7758/11049 [1:19:53<33:37,  1.63it/s]
                                                      
{'loss': 0.1157, 'grad_norm': 0.42899182438850403, 'learning_rate': 2.4676939370679727e-06, 'epoch': 2.11}

 70%|███████   | 7758/11049 [1:19:53<33:37,  1.63it/s]
 70%|███████   | 7759/11049 [1:19:54<33:37,  1.63it/s]
                                                      
{'loss': 0.1567, 'grad_norm': 0.5670642256736755, 'learning_rate': 2.466331996741288e-06, 'epoch': 2.11}

 70%|███████   | 7759/11049 [1:19:54<33:37,  1.63it/s]
 70%|███████   | 7760/11049 [1:19:54<33:36,  1.63it/s]
                                                      
{'loss': 0.1458, 'grad_norm': 0.5623427033424377, 'learning_rate': 2.464970309302019e-06, 'epoch': 2.11}

 70%|███████   | 7760/11049 [1:19:55<33:36,  1.63it/s]
 70%|███████   | 7761/11049 [1:19:55<33:36,  1.63it/s]
                                                      
{'loss': 0.14, 'grad_norm': 0.49519461393356323, 'learning_rate': 2.4636088748860738e-06, 'epoch': 2.11}

 70%|███████   | 7761/11049 [1:19:55<33:36,  1.63it/s]
 70%|███████   | 7762/11049 [1:19:56<33:36,  1.63it/s]
                                                      
{'loss': 0.1543, 'grad_norm': 0.6395565867424011, 'learning_rate': 2.4622476936293425e-06, 'epoch': 2.11}

 70%|███████   | 7762/11049 [1:19:56<33:36,  1.63it/s]
 70%|███████   | 7763/11049 [1:19:56<33:35,  1.63it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.6137023568153381, 'learning_rate': 2.460886765667685e-06, 'epoch': 2.11}

 70%|███████   | 7763/11049 [1:19:56<33:35,  1.63it/s]
 70%|███████   | 7764/11049 [1:19:57<33:34,  1.63it/s]
                                                      
{'loss': 0.1499, 'grad_norm': 0.5206090211868286, 'learning_rate': 2.4595260911369345e-06, 'epoch': 2.11}

 70%|███████   | 7764/11049 [1:19:57<33:34,  1.63it/s]
 70%|███████   | 7765/11049 [1:19:57<33:33,  1.63it/s]
                                                      
{'loss': 0.1808, 'grad_norm': 0.6209218502044678, 'learning_rate': 2.458165670172901e-06, 'epoch': 2.11}

 70%|███████   | 7765/11049 [1:19:58<33:33,  1.63it/s]
 70%|███████   | 7766/11049 [1:19:58<33:32,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.5323307514190674, 'learning_rate': 2.456805502911373e-06, 'epoch': 2.11}

 70%|███████   | 7766/11049 [1:19:58<33:32,  1.63it/s]
 70%|███████   | 7767/11049 [1:19:59<33:32,  1.63it/s]
                                                      
{'loss': 0.1594, 'grad_norm': 0.600928783416748, 'learning_rate': 2.4554455894881056e-06, 'epoch': 2.11}

 70%|███████   | 7767/11049 [1:19:59<33:32,  1.63it/s]
 70%|███████   | 7768/11049 [1:19:59<33:32,  1.63it/s]
                                                      
{'loss': 0.1679, 'grad_norm': 0.5749139189720154, 'learning_rate': 2.4540859300388347e-06, 'epoch': 2.11}

 70%|███████   | 7768/11049 [1:19:59<33:32,  1.63it/s]
 70%|███████   | 7769/11049 [1:20:00<33:33,  1.63it/s]
                                                      
{'loss': 0.1308, 'grad_norm': 0.6034775972366333, 'learning_rate': 2.4527265246992667e-06, 'epoch': 2.11}

 70%|███████   | 7769/11049 [1:20:00<33:33,  1.63it/s]
 70%|███████   | 7770/11049 [1:20:01<33:34,  1.63it/s]
                                                      
{'loss': 0.164, 'grad_norm': 0.7654709815979004, 'learning_rate': 2.4513673736050886e-06, 'epoch': 2.11}

 70%|███████   | 7770/11049 [1:20:01<33:34,  1.63it/s]
 70%|███████   | 7771/11049 [1:20:01<33:32,  1.63it/s]
                                                      
{'loss': 0.2078, 'grad_norm': 0.6849666833877563, 'learning_rate': 2.4500084768919563e-06, 'epoch': 2.11}

 70%|███████   | 7771/11049 [1:20:01<33:32,  1.63it/s]
 70%|███████   | 7772/11049 [1:20:02<33:30,  1.63it/s]
                                                      
{'loss': 0.1558, 'grad_norm': 0.6472100019454956, 'learning_rate': 2.448649834695503e-06, 'epoch': 2.11}

 70%|███████   | 7772/11049 [1:20:02<33:30,  1.63it/s]
 70%|███████   | 7773/11049 [1:20:02<33:31,  1.63it/s]
                                                      
{'loss': 0.1273, 'grad_norm': 0.5888564586639404, 'learning_rate': 2.4472914471513333e-06, 'epoch': 2.11}

 70%|███████   | 7773/11049 [1:20:02<33:31,  1.63it/s]
 70%|███████   | 7774/11049 [1:20:03<33:30,  1.63it/s]
                                                      
{'loss': 0.1413, 'grad_norm': 0.5727775692939758, 'learning_rate': 2.445933314395033e-06, 'epoch': 2.11}

 70%|███████   | 7774/11049 [1:20:03<33:30,  1.63it/s]
 70%|███████   | 7775/11049 [1:20:04<33:29,  1.63it/s]
                                                      
{'loss': 0.1218, 'grad_norm': 0.44266477227211, 'learning_rate': 2.4445754365621572e-06, 'epoch': 2.11}

 70%|███████   | 7775/11049 [1:20:04<33:29,  1.63it/s]
 70%|███████   | 7776/11049 [1:20:04<33:28,  1.63it/s]
                                                      
{'loss': 0.1265, 'grad_norm': 0.4939563274383545, 'learning_rate': 2.4432178137882373e-06, 'epoch': 2.11}

 70%|███████   | 7776/11049 [1:20:04<33:28,  1.63it/s]
 70%|███████   | 7777/11049 [1:20:05<33:27,  1.63it/s]
                                                      
{'loss': 0.1456, 'grad_norm': 0.5245276689529419, 'learning_rate': 2.4418604462087743e-06, 'epoch': 2.11}

 70%|███████   | 7777/11049 [1:20:05<33:27,  1.63it/s]
 70%|███████   | 7778/11049 [1:20:05<33:26,  1.63it/s]
                                                      
{'loss': 0.1661, 'grad_norm': 0.5360852479934692, 'learning_rate': 2.4405033339592533e-06, 'epoch': 2.11}

 70%|███████   | 7778/11049 [1:20:06<33:26,  1.63it/s]
 70%|███████   | 7779/11049 [1:20:06<33:26,  1.63it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.5581949353218079, 'learning_rate': 2.439146477175126e-06, 'epoch': 2.11}

 70%|███████   | 7779/11049 [1:20:06<33:26,  1.63it/s]
 70%|███████   | 7780/11049 [1:20:07<33:25,  1.63it/s]
                                                      
{'loss': 0.1426, 'grad_norm': 0.5041980743408203, 'learning_rate': 2.4377898759918226e-06, 'epoch': 2.11}

 70%|███████   | 7780/11049 [1:20:07<33:25,  1.63it/s]
 70%|███████   | 7781/11049 [1:20:07<33:24,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.6528276205062866, 'learning_rate': 2.4364335305447446e-06, 'epoch': 2.11}

 70%|███████   | 7781/11049 [1:20:07<33:24,  1.63it/s]
 70%|███████   | 7782/11049 [1:20:08<33:23,  1.63it/s]
                                                      
{'loss': 0.1624, 'grad_norm': 0.5896682739257812, 'learning_rate': 2.435077440969273e-06, 'epoch': 2.11}

 70%|███████   | 7782/11049 [1:20:08<33:23,  1.63it/s]
 70%|███████   | 7783/11049 [1:20:09<33:22,  1.63it/s]
                                                      
{'loss': 0.1513, 'grad_norm': 0.6081940531730652, 'learning_rate': 2.4337216074007586e-06, 'epoch': 2.11}

 70%|███████   | 7783/11049 [1:20:09<33:22,  1.63it/s]
 70%|███████   | 7784/11049 [1:20:09<33:21,  1.63it/s]
                                                      
{'loss': 0.1673, 'grad_norm': 0.6435712575912476, 'learning_rate': 2.4323660299745285e-06, 'epoch': 2.11}

 70%|███████   | 7784/11049 [1:20:09<33:21,  1.63it/s]
 70%|███████   | 7785/11049 [1:20:10<33:21,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.6548761129379272, 'learning_rate': 2.4310107088258834e-06, 'epoch': 2.11}

 70%|███████   | 7785/11049 [1:20:10<33:21,  1.63it/s]
 70%|███████   | 7786/11049 [1:20:10<33:21,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.631157398223877, 'learning_rate': 2.429655644090099e-06, 'epoch': 2.11}

 70%|███████   | 7786/11049 [1:20:10<33:21,  1.63it/s]
 70%|███████   | 7787/11049 [1:20:11<33:20,  1.63it/s]
                                                      
{'loss': 0.128, 'grad_norm': 0.48515626788139343, 'learning_rate': 2.4283008359024262e-06, 'epoch': 2.11}

 70%|███████   | 7787/11049 [1:20:11<33:20,  1.63it/s]
 70%|███████   | 7788/11049 [1:20:12<33:20,  1.63it/s]
                                                      
{'loss': 0.1592, 'grad_norm': 0.6100701093673706, 'learning_rate': 2.426946284398089e-06, 'epoch': 2.11}

 70%|███████   | 7788/11049 [1:20:12<33:20,  1.63it/s]
 70%|███████   | 7789/11049 [1:20:12<33:20,  1.63it/s]
                                                      
{'loss': 0.1515, 'grad_norm': 0.6391586065292358, 'learning_rate': 2.425591989712284e-06, 'epoch': 2.11}

 70%|███████   | 7789/11049 [1:20:12<33:20,  1.63it/s]
 71%|███████   | 7790/11049 [1:20:13<33:19,  1.63it/s]
                                                      
{'loss': 0.149, 'grad_norm': 0.5661566853523254, 'learning_rate': 2.424237951980189e-06, 'epoch': 2.12}

 71%|███████   | 7790/11049 [1:20:13<33:19,  1.63it/s]
 71%|███████   | 7791/11049 [1:20:13<33:19,  1.63it/s]
                                                      
{'loss': 0.1362, 'grad_norm': 0.5214157104492188, 'learning_rate': 2.422884171336949e-06, 'epoch': 2.12}

 71%|███████   | 7791/11049 [1:20:14<33:19,  1.63it/s]
 71%|███████   | 7792/11049 [1:20:14<33:18,  1.63it/s]
                                                      
{'loss': 0.1408, 'grad_norm': 0.48107171058654785, 'learning_rate': 2.421530647917685e-06, 'epoch': 2.12}

 71%|███████   | 7792/11049 [1:20:14<33:18,  1.63it/s]
 71%|███████   | 7793/11049 [1:20:15<33:17,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.5710610151290894, 'learning_rate': 2.4201773818574956e-06, 'epoch': 2.12}

 71%|███████   | 7793/11049 [1:20:15<33:17,  1.63it/s]
 71%|███████   | 7794/11049 [1:20:15<33:16,  1.63it/s]
                                                      
{'loss': 0.1411, 'grad_norm': 0.5185607671737671, 'learning_rate': 2.4188243732914503e-06, 'epoch': 2.12}

 71%|███████   | 7794/11049 [1:20:15<33:16,  1.63it/s]
 71%|███████   | 7795/11049 [1:20:16<33:16,  1.63it/s]
                                                      
{'loss': 0.1584, 'grad_norm': 0.6274421215057373, 'learning_rate': 2.417471622354593e-06, 'epoch': 2.12}

 71%|███████   | 7795/11049 [1:20:16<33:16,  1.63it/s]
 71%|███████   | 7796/11049 [1:20:16<33:15,  1.63it/s]
                                                      
{'loss': 0.221, 'grad_norm': 0.6246038675308228, 'learning_rate': 2.4161191291819442e-06, 'epoch': 2.12}

 71%|███████   | 7796/11049 [1:20:17<33:15,  1.63it/s]
 71%|███████   | 7797/11049 [1:20:17<33:14,  1.63it/s]
                                                      
{'loss': 0.1518, 'grad_norm': 0.7213783860206604, 'learning_rate': 2.4147668939084943e-06, 'epoch': 2.12}

 71%|███████   | 7797/11049 [1:20:17<33:14,  1.63it/s]
 71%|███████   | 7798/11049 [1:20:18<33:15,  1.63it/s]
                                                      
{'loss': 0.1947, 'grad_norm': 0.6194698214530945, 'learning_rate': 2.413414916669216e-06, 'epoch': 2.12}

 71%|███████   | 7798/11049 [1:20:18<33:15,  1.63it/s]
 71%|███████   | 7799/11049 [1:20:18<33:14,  1.63it/s]
                                                      
{'loss': 0.1322, 'grad_norm': 0.6460458040237427, 'learning_rate': 2.4120631975990483e-06, 'epoch': 2.12}

 71%|███████   | 7799/11049 [1:20:18<33:14,  1.63it/s]
 71%|███████   | 7800/11049 [1:20:19<33:13,  1.63it/s]
                                                      
{'loss': 0.1996, 'grad_norm': 0.6431753039360046, 'learning_rate': 2.410711736832908e-06, 'epoch': 2.12}

 71%|███████   | 7800/11049 [1:20:19<33:13,  1.63it/s]
 71%|███████   | 7801/11049 [1:20:20<33:13,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.6149311661720276, 'learning_rate': 2.4093605345056833e-06, 'epoch': 2.12}

 71%|███████   | 7801/11049 [1:20:20<33:13,  1.63it/s]
 71%|███████   | 7802/11049 [1:20:20<33:11,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.7165424823760986, 'learning_rate': 2.408009590752244e-06, 'epoch': 2.12}

 71%|███████   | 7802/11049 [1:20:20<33:11,  1.63it/s]
 71%|███████   | 7803/11049 [1:20:21<33:11,  1.63it/s]
                                                      
{'loss': 0.1661, 'grad_norm': 0.6273658275604248, 'learning_rate': 2.4066589057074234e-06, 'epoch': 2.12}

 71%|███████   | 7803/11049 [1:20:21<33:11,  1.63it/s]
 71%|███████   | 7804/11049 [1:20:21<33:11,  1.63it/s]
                                                      
{'loss': 0.1981, 'grad_norm': 0.7254621386528015, 'learning_rate': 2.405308479506037e-06, 'epoch': 2.12}

 71%|███████   | 7804/11049 [1:20:22<33:11,  1.63it/s]
 71%|███████   | 7805/11049 [1:20:22<33:09,  1.63it/s]
                                                      
{'loss': 0.154, 'grad_norm': 0.5421803593635559, 'learning_rate': 2.4039583122828698e-06, 'epoch': 2.12}

 71%|███████   | 7805/11049 [1:20:22<33:09,  1.63it/s]
 71%|███████   | 7806/11049 [1:20:23<33:08,  1.63it/s]
                                                      
{'loss': 0.1621, 'grad_norm': 0.6325770020484924, 'learning_rate': 2.402608404172687e-06, 'epoch': 2.12}

 71%|███████   | 7806/11049 [1:20:23<33:08,  1.63it/s]
 71%|███████   | 7807/11049 [1:20:23<33:08,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.6141666769981384, 'learning_rate': 2.4012587553102205e-06, 'epoch': 2.12}

 71%|███████   | 7807/11049 [1:20:23<33:08,  1.63it/s]
 71%|███████   | 7808/11049 [1:20:24<33:07,  1.63it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.5850173830986023, 'learning_rate': 2.399909365830182e-06, 'epoch': 2.12}

 71%|███████   | 7808/11049 [1:20:24<33:07,  1.63it/s]
 71%|███████   | 7809/11049 [1:20:24<33:07,  1.63it/s]
                                                      
{'loss': 0.1303, 'grad_norm': 0.5664365291595459, 'learning_rate': 2.398560235867252e-06, 'epoch': 2.12}

 71%|███████   | 7809/11049 [1:20:25<33:07,  1.63it/s]
 71%|███████   | 7810/11049 [1:20:25<33:06,  1.63it/s]
                                                      
{'loss': 0.1493, 'grad_norm': 0.5672155618667603, 'learning_rate': 2.3972113655560925e-06, 'epoch': 2.12}

 71%|███████   | 7810/11049 [1:20:25<33:06,  1.63it/s]
 71%|███████   | 7811/11049 [1:20:26<33:06,  1.63it/s]
                                                      
{'loss': 0.1341, 'grad_norm': 0.49721580743789673, 'learning_rate': 2.3958627550313333e-06, 'epoch': 2.12}

 71%|███████   | 7811/11049 [1:20:26<33:06,  1.63it/s]
 71%|███████   | 7812/11049 [1:20:26<33:05,  1.63it/s]
                                                      
{'loss': 0.1468, 'grad_norm': 0.5445061326026917, 'learning_rate': 2.394514404427582e-06, 'epoch': 2.12}

 71%|███████   | 7812/11049 [1:20:26<33:05,  1.63it/s]
 71%|███████   | 7813/11049 [1:20:27<33:05,  1.63it/s]
                                                      
{'loss': 0.2045, 'grad_norm': 0.6352083086967468, 'learning_rate': 2.3931663138794132e-06, 'epoch': 2.12}

 71%|███████   | 7813/11049 [1:20:27<33:05,  1.63it/s]
 71%|███████   | 7814/11049 [1:20:28<33:05,  1.63it/s]
                                                      
{'loss': 0.1899, 'grad_norm': 0.6833287477493286, 'learning_rate': 2.391818483521386e-06, 'epoch': 2.12}

 71%|███████   | 7814/11049 [1:20:28<33:05,  1.63it/s]
 71%|███████   | 7815/11049 [1:20:28<33:04,  1.63it/s]
                                                      
{'loss': 0.1434, 'grad_norm': 0.5708213448524475, 'learning_rate': 2.390470913488027e-06, 'epoch': 2.12}

 71%|███████   | 7815/11049 [1:20:28<33:04,  1.63it/s]
 71%|███████   | 7816/11049 [1:20:29<33:03,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.5461247563362122, 'learning_rate': 2.3891236039138383e-06, 'epoch': 2.12}

 71%|███████   | 7816/11049 [1:20:29<33:03,  1.63it/s]
 71%|███████   | 7817/11049 [1:20:29<33:02,  1.63it/s]
                                                      
{'loss': 0.1611, 'grad_norm': 0.5504434108734131, 'learning_rate': 2.3877765549332936e-06, 'epoch': 2.12}

 71%|███████   | 7817/11049 [1:20:29<33:02,  1.63it/s]
 71%|███████   | 7818/11049 [1:20:30<33:01,  1.63it/s]
                                                      
{'loss': 0.1483, 'grad_norm': 0.8205106854438782, 'learning_rate': 2.386429766680848e-06, 'epoch': 2.12}

 71%|███████   | 7818/11049 [1:20:30<33:01,  1.63it/s]
 71%|███████   | 7819/11049 [1:20:31<33:00,  1.63it/s]
                                                      
{'loss': 0.1941, 'grad_norm': 0.6981064677238464, 'learning_rate': 2.385083239290921e-06, 'epoch': 2.12}

 71%|███████   | 7819/11049 [1:20:31<33:00,  1.63it/s]
 71%|███████   | 7820/11049 [1:20:31<33:00,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.6300432682037354, 'learning_rate': 2.383736972897914e-06, 'epoch': 2.12}

 71%|███████   | 7820/11049 [1:20:31<33:00,  1.63it/s]
 71%|███████   | 7821/11049 [1:20:32<32:59,  1.63it/s]
                                                      
{'loss': 0.1592, 'grad_norm': 0.5924825072288513, 'learning_rate': 2.3823909676361956e-06, 'epoch': 2.12}

 71%|███████   | 7821/11049 [1:20:32<32:59,  1.63it/s]
 71%|███████   | 7822/11049 [1:20:32<32:58,  1.63it/s]
                                                      
{'loss': 0.1928, 'grad_norm': 0.7356938719749451, 'learning_rate': 2.381045223640114e-06, 'epoch': 2.12}

 71%|███████   | 7822/11049 [1:20:33<32:58,  1.63it/s]
 71%|███████   | 7823/11049 [1:20:33<32:59,  1.63it/s]
                                                      
{'loss': 0.1458, 'grad_norm': 0.5270158052444458, 'learning_rate': 2.3796997410439878e-06, 'epoch': 2.12}

 71%|███████   | 7823/11049 [1:20:33<32:59,  1.63it/s]
 71%|███████   | 7824/11049 [1:20:34<32:57,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.5641570687294006, 'learning_rate': 2.378354519982111e-06, 'epoch': 2.12}

 71%|███████   | 7824/11049 [1:20:34<32:57,  1.63it/s]
 71%|███████   | 7825/11049 [1:20:34<32:57,  1.63it/s]
                                                      
{'loss': 0.1423, 'grad_norm': 0.5169790983200073, 'learning_rate': 2.3770095605887487e-06, 'epoch': 2.12}

 71%|███████   | 7825/11049 [1:20:34<32:57,  1.63it/s]
 71%|███████   | 7826/11049 [1:20:35<32:56,  1.63it/s]
                                                      
{'loss': 0.1505, 'grad_norm': 0.5346318483352661, 'learning_rate': 2.3756648629981476e-06, 'epoch': 2.12}

 71%|███████   | 7826/11049 [1:20:35<32:56,  1.63it/s]
 71%|███████   | 7827/11049 [1:20:35<32:55,  1.63it/s]
                                                      
{'loss': 0.1752, 'grad_norm': 0.570856511592865, 'learning_rate': 2.3743204273445196e-06, 'epoch': 2.13}

 71%|███████   | 7827/11049 [1:20:36<32:55,  1.63it/s]
 71%|███████   | 7828/11049 [1:20:36<32:55,  1.63it/s]
                                                      
{'loss': 0.1558, 'grad_norm': 0.5861226320266724, 'learning_rate': 2.3729762537620553e-06, 'epoch': 2.13}

 71%|███████   | 7828/11049 [1:20:36<32:55,  1.63it/s]
 71%|███████   | 7829/11049 [1:20:37<32:55,  1.63it/s]
                                                      
{'loss': 0.1402, 'grad_norm': 0.5485697388648987, 'learning_rate': 2.3716323423849164e-06, 'epoch': 2.13}

 71%|███████   | 7829/11049 [1:20:37<32:55,  1.63it/s]
 71%|███████   | 7830/11049 [1:20:37<32:53,  1.63it/s]
                                                      
{'loss': 0.1706, 'grad_norm': 0.5696080923080444, 'learning_rate': 2.3702886933472407e-06, 'epoch': 2.13}

 71%|███████   | 7830/11049 [1:20:37<32:53,  1.63it/s]
 71%|███████   | 7831/11049 [1:20:38<32:52,  1.63it/s]
                                                      
{'loss': 0.1469, 'grad_norm': 0.5456700325012207, 'learning_rate': 2.3689453067831384e-06, 'epoch': 2.13}

 71%|███████   | 7831/11049 [1:20:38<32:52,  1.63it/s]
 71%|███████   | 7832/11049 [1:20:39<32:52,  1.63it/s]
                                                      
{'loss': 0.1448, 'grad_norm': 0.5733981132507324, 'learning_rate': 2.3676021828266945e-06, 'epoch': 2.13}

 71%|███████   | 7832/11049 [1:20:39<32:52,  1.63it/s]
 71%|███████   | 7833/11049 [1:20:39<32:51,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.5763431787490845, 'learning_rate': 2.366259321611965e-06, 'epoch': 2.13}

 71%|███████   | 7833/11049 [1:20:39<32:51,  1.63it/s]
 71%|███████   | 7834/11049 [1:20:40<32:51,  1.63it/s]
                                                      
{'loss': 0.1401, 'grad_norm': 0.6279193162918091, 'learning_rate': 2.3649167232729854e-06, 'epoch': 2.13}

 71%|███████   | 7834/11049 [1:20:40<32:51,  1.63it/s]
 71%|███████   | 7835/11049 [1:20:40<32:50,  1.63it/s]
                                                      
{'loss': 0.1427, 'grad_norm': 0.5168713331222534, 'learning_rate': 2.36357438794376e-06, 'epoch': 2.13}

 71%|███████   | 7835/11049 [1:20:41<32:50,  1.63it/s]
 71%|███████   | 7836/11049 [1:20:41<32:50,  1.63it/s]
                                                      
{'loss': 0.1833, 'grad_norm': 0.6197770237922668, 'learning_rate': 2.362232315758268e-06, 'epoch': 2.13}

 71%|███████   | 7836/11049 [1:20:41<32:50,  1.63it/s]
 71%|███████   | 7837/11049 [1:20:42<32:49,  1.63it/s]
                                                      
{'loss': 0.1997, 'grad_norm': 0.610708475112915, 'learning_rate': 2.360890506850464e-06, 'epoch': 2.13}

 71%|███████   | 7837/11049 [1:20:42<32:49,  1.63it/s]
 71%|███████   | 7838/11049 [1:20:42<32:49,  1.63it/s]
                                                      
{'loss': 0.1695, 'grad_norm': 0.6108545660972595, 'learning_rate': 2.3595489613542733e-06, 'epoch': 2.13}

 71%|███████   | 7838/11049 [1:20:42<32:49,  1.63it/s]
 71%|███████   | 7839/11049 [1:20:43<32:48,  1.63it/s]
                                                      
{'loss': 0.1344, 'grad_norm': 0.4898942708969116, 'learning_rate': 2.358207679403597e-06, 'epoch': 2.13}

 71%|███████   | 7839/11049 [1:20:43<32:48,  1.63it/s]
 71%|███████   | 7840/11049 [1:20:43<32:48,  1.63it/s]
                                                      
{'loss': 0.1124, 'grad_norm': 0.4379987120628357, 'learning_rate': 2.3568666611323103e-06, 'epoch': 2.13}

 71%|███████   | 7840/11049 [1:20:44<32:48,  1.63it/s]
 71%|███████   | 7841/11049 [1:20:44<32:48,  1.63it/s]
                                                      
{'loss': 0.143, 'grad_norm': 0.5807754397392273, 'learning_rate': 2.3555259066742593e-06, 'epoch': 2.13}

 71%|███████   | 7841/11049 [1:20:44<32:48,  1.63it/s]
 71%|███████   | 7842/11049 [1:20:45<32:47,  1.63it/s]
                                                      
{'loss': 0.1706, 'grad_norm': 0.5398173928260803, 'learning_rate': 2.3541854161632684e-06, 'epoch': 2.13}

 71%|███████   | 7842/11049 [1:20:45<32:47,  1.63it/s]
 71%|███████   | 7843/11049 [1:20:45<32:46,  1.63it/s]
                                                      
{'loss': 0.1903, 'grad_norm': 0.6073026657104492, 'learning_rate': 2.352845189733132e-06, 'epoch': 2.13}

 71%|███████   | 7843/11049 [1:20:45<32:46,  1.63it/s]
 71%|███████   | 7844/11049 [1:20:46<32:45,  1.63it/s]
                                                      
{'loss': 0.1476, 'grad_norm': 0.5462750196456909, 'learning_rate': 2.3515052275176196e-06, 'epoch': 2.13}

 71%|███████   | 7844/11049 [1:20:46<32:45,  1.63it/s]
 71%|███████   | 7845/11049 [1:20:47<32:44,  1.63it/s]
                                                      
{'loss': 0.1506, 'grad_norm': 0.5445682406425476, 'learning_rate': 2.3501655296504715e-06, 'epoch': 2.13}

 71%|███████   | 7845/11049 [1:20:47<32:44,  1.63it/s]
 71%|███████   | 7846/11049 [1:20:47<32:43,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.6531516313552856, 'learning_rate': 2.3488260962654077e-06, 'epoch': 2.13}

 71%|███████   | 7846/11049 [1:20:47<32:43,  1.63it/s]
 71%|███████   | 7847/11049 [1:20:48<32:42,  1.63it/s]
                                                      
{'loss': 0.1461, 'grad_norm': 0.53423672914505, 'learning_rate': 2.3474869274961183e-06, 'epoch': 2.13}

 71%|███████   | 7847/11049 [1:20:48<32:42,  1.63it/s]
 71%|███████   | 7848/11049 [1:20:48<32:41,  1.63it/s]
                                                      
{'loss': 0.1784, 'grad_norm': 0.6086326837539673, 'learning_rate': 2.346148023476262e-06, 'epoch': 2.13}

 71%|███████   | 7848/11049 [1:20:48<32:41,  1.63it/s]
 71%|███████   | 7849/11049 [1:20:49<32:40,  1.63it/s]
                                                      
{'loss': 0.1464, 'grad_norm': 0.491192489862442, 'learning_rate': 2.3448093843394782e-06, 'epoch': 2.13}

 71%|███████   | 7849/11049 [1:20:49<32:40,  1.63it/s]
 71%|███████   | 7850/11049 [1:20:50<32:40,  1.63it/s]
                                                      
{'loss': 0.1835, 'grad_norm': 0.6200838088989258, 'learning_rate': 2.3434710102193787e-06, 'epoch': 2.13}

 71%|███████   | 7850/11049 [1:20:50<32:40,  1.63it/s]
 71%|███████   | 7851/11049 [1:20:50<32:40,  1.63it/s]
                                                      
{'loss': 0.1731, 'grad_norm': 0.6199689507484436, 'learning_rate': 2.3421329012495476e-06, 'epoch': 2.13}

 71%|███████   | 7851/11049 [1:20:50<32:40,  1.63it/s]
 71%|███████   | 7852/11049 [1:20:51<32:40,  1.63it/s]
                                                      
{'loss': 0.1348, 'grad_norm': 0.5556402206420898, 'learning_rate': 2.340795057563542e-06, 'epoch': 2.13}

 71%|███████   | 7852/11049 [1:20:51<32:40,  1.63it/s]
 71%|███████   | 7853/11049 [1:20:51<32:39,  1.63it/s]
                                                      
{'loss': 0.1477, 'grad_norm': 0.5475655198097229, 'learning_rate': 2.339457479294893e-06, 'epoch': 2.13}

 71%|███████   | 7853/11049 [1:20:52<32:39,  1.63it/s]
 71%|███████   | 7854/11049 [1:20:52<32:40,  1.63it/s]
                                                      
{'loss': 0.1552, 'grad_norm': 0.6959240436553955, 'learning_rate': 2.3381201665771037e-06, 'epoch': 2.13}

 71%|███████   | 7854/11049 [1:20:52<32:40,  1.63it/s]
 71%|███████   | 7855/11049 [1:20:53<32:39,  1.63it/s]
                                                      
{'loss': 0.1397, 'grad_norm': 0.4930882751941681, 'learning_rate': 2.3367831195436563e-06, 'epoch': 2.13}

 71%|███████   | 7855/11049 [1:20:53<32:39,  1.63it/s]
 71%|███████   | 7856/11049 [1:20:53<32:38,  1.63it/s]
                                                      
{'loss': 0.135, 'grad_norm': 0.5485427975654602, 'learning_rate': 2.3354463383280002e-06, 'epoch': 2.13}

 71%|███████   | 7856/11049 [1:20:53<32:38,  1.63it/s]
 71%|███████   | 7857/11049 [1:20:54<32:38,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.5441588163375854, 'learning_rate': 2.334109823063562e-06, 'epoch': 2.13}

 71%|███████   | 7857/11049 [1:20:54<32:38,  1.63it/s]
 71%|███████   | 7858/11049 [1:20:55<32:36,  1.63it/s]
                                                      
{'loss': 0.1259, 'grad_norm': 0.4898710250854492, 'learning_rate': 2.332773573883736e-06, 'epoch': 2.13}

 71%|███████   | 7858/11049 [1:20:55<32:36,  1.63it/s]
 71%|███████   | 7859/11049 [1:20:55<32:37,  1.63it/s]
                                                      
{'loss': 0.1232, 'grad_norm': 0.49716392159461975, 'learning_rate': 2.3314375909218997e-06, 'epoch': 2.13}

 71%|███████   | 7859/11049 [1:20:55<32:37,  1.63it/s]
 71%|███████   | 7860/11049 [1:20:56<32:35,  1.63it/s]
                                                      
{'loss': 0.1953, 'grad_norm': 0.6422408819198608, 'learning_rate': 2.3301018743113957e-06, 'epoch': 2.13}

 71%|███████   | 7860/11049 [1:20:56<32:35,  1.63it/s]
 71%|███████   | 7861/11049 [1:20:56<32:35,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.6291185617446899, 'learning_rate': 2.3287664241855436e-06, 'epoch': 2.13}

 71%|███████   | 7861/11049 [1:20:56<32:35,  1.63it/s]
 71%|███████   | 7862/11049 [1:20:57<32:34,  1.63it/s]
                                                      
{'loss': 0.1379, 'grad_norm': 0.5170008540153503, 'learning_rate': 2.3274312406776337e-06, 'epoch': 2.13}

 71%|███████   | 7862/11049 [1:20:57<32:34,  1.63it/s]
 71%|███████   | 7863/11049 [1:20:58<32:34,  1.63it/s]
                                                      
{'loss': 0.1635, 'grad_norm': 0.5451221466064453, 'learning_rate': 2.326096323920936e-06, 'epoch': 2.13}

 71%|███████   | 7863/11049 [1:20:58<32:34,  1.63it/s]
 71%|███████   | 7864/11049 [1:20:58<32:33,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.6858401894569397, 'learning_rate': 2.3247616740486873e-06, 'epoch': 2.14}

 71%|███████   | 7864/11049 [1:20:58<32:33,  1.63it/s]
 71%|███████   | 7865/11049 [1:20:59<32:32,  1.63it/s]
                                                      
{'loss': 0.2015, 'grad_norm': 0.7559204697608948, 'learning_rate': 2.3234272911940998e-06, 'epoch': 2.14}

 71%|███████   | 7865/11049 [1:20:59<32:32,  1.63it/s]
 71%|███████   | 7866/11049 [1:20:59<32:32,  1.63it/s]
                                                      
{'loss': 0.1594, 'grad_norm': 0.5445773601531982, 'learning_rate': 2.3220931754903597e-06, 'epoch': 2.14}

 71%|███████   | 7866/11049 [1:21:00<32:32,  1.63it/s]
 71%|███████   | 7867/11049 [1:21:00<32:32,  1.63it/s]
                                                      
{'loss': 0.1341, 'grad_norm': 0.5046249032020569, 'learning_rate': 2.3207593270706263e-06, 'epoch': 2.14}

 71%|███████   | 7867/11049 [1:21:00<32:32,  1.63it/s]
 71%|███████   | 7868/11049 [1:21:01<32:31,  1.63it/s]
                                                      
{'loss': 0.1904, 'grad_norm': 0.6832347512245178, 'learning_rate': 2.3194257460680318e-06, 'epoch': 2.14}

 71%|███████   | 7868/11049 [1:21:01<32:31,  1.63it/s]
 71%|███████   | 7869/11049 [1:21:01<32:36,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.7325772643089294, 'learning_rate': 2.3180924326156815e-06, 'epoch': 2.14}

 71%|███████   | 7869/11049 [1:21:01<32:36,  1.63it/s]
 71%|███████   | 7870/11049 [1:21:02<32:33,  1.63it/s]
                                                      
{'loss': 0.1396, 'grad_norm': 0.5477647185325623, 'learning_rate': 2.3167593868466537e-06, 'epoch': 2.14}

 71%|███████   | 7870/11049 [1:21:02<32:33,  1.63it/s]
 71%|███████   | 7871/11049 [1:21:02<32:32,  1.63it/s]
                                                      
{'loss': 0.1308, 'grad_norm': 0.48829662799835205, 'learning_rate': 2.3154266088940037e-06, 'epoch': 2.14}

 71%|███████   | 7871/11049 [1:21:03<32:32,  1.63it/s]
 71%|███████   | 7872/11049 [1:21:03<32:31,  1.63it/s]
                                                      
{'loss': 0.1887, 'grad_norm': 0.6913444399833679, 'learning_rate': 2.3140940988907555e-06, 'epoch': 2.14}

 71%|███████   | 7872/11049 [1:21:03<32:31,  1.63it/s]
 71%|███████▏  | 7873/11049 [1:21:04<32:29,  1.63it/s]
                                                      
{'loss': 0.1563, 'grad_norm': 0.6433345079421997, 'learning_rate': 2.312761856969908e-06, 'epoch': 2.14}

 71%|███████▏  | 7873/11049 [1:21:04<32:29,  1.63it/s]
 71%|███████▏  | 7874/11049 [1:21:04<32:29,  1.63it/s]
                                                      
{'loss': 0.1271, 'grad_norm': 0.5170812010765076, 'learning_rate': 2.311429883264433e-06, 'epoch': 2.14}

 71%|███████▏  | 7874/11049 [1:21:04<32:29,  1.63it/s]
 71%|███████▏  | 7875/11049 [1:21:05<32:27,  1.63it/s]
                                                      
{'loss': 0.1365, 'grad_norm': 0.5367127060890198, 'learning_rate': 2.3100981779072762e-06, 'epoch': 2.14}

 71%|███████▏  | 7875/11049 [1:21:05<32:27,  1.63it/s]
 71%|███████▏  | 7876/11049 [1:21:06<32:26,  1.63it/s]
                                                      
{'loss': 0.1264, 'grad_norm': 0.49047037959098816, 'learning_rate': 2.3087667410313565e-06, 'epoch': 2.14}

 71%|███████▏  | 7876/11049 [1:21:06<32:26,  1.63it/s]
 71%|███████▏  | 7877/11049 [1:21:06<32:25,  1.63it/s]
                                                      
{'loss': 0.1587, 'grad_norm': 0.6464732885360718, 'learning_rate': 2.3074355727695646e-06, 'epoch': 2.14}

 71%|███████▏  | 7877/11049 [1:21:06<32:25,  1.63it/s]
 71%|███████▏  | 7878/11049 [1:21:07<32:24,  1.63it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.5395886301994324, 'learning_rate': 2.306104673254765e-06, 'epoch': 2.14}

 71%|███████▏  | 7878/11049 [1:21:07<32:24,  1.63it/s]
 71%|███████▏  | 7879/11049 [1:21:07<32:26,  1.63it/s]
                                                      
{'loss': 0.14, 'grad_norm': 0.6413995027542114, 'learning_rate': 2.3047740426197986e-06, 'epoch': 2.14}

 71%|███████▏  | 7879/11049 [1:21:08<32:26,  1.63it/s]
 71%|███████▏  | 7880/11049 [1:21:08<32:24,  1.63it/s]
                                                      
{'loss': 0.1882, 'grad_norm': 0.6463823318481445, 'learning_rate': 2.3034436809974748e-06, 'epoch': 2.14}

 71%|███████▏  | 7880/11049 [1:21:08<32:24,  1.63it/s]
 71%|███████▏  | 7881/11049 [1:21:09<32:23,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.644447922706604, 'learning_rate': 2.302113588520578e-06, 'epoch': 2.14}

 71%|███████▏  | 7881/11049 [1:21:09<32:23,  1.63it/s]
 71%|███████▏  | 7882/11049 [1:21:09<32:22,  1.63it/s]
                                                      
{'loss': 0.1453, 'grad_norm': 0.5231788754463196, 'learning_rate': 2.3007837653218644e-06, 'epoch': 2.14}

 71%|███████▏  | 7882/11049 [1:21:09<32:22,  1.63it/s]
 71%|███████▏  | 7883/11049 [1:21:10<32:23,  1.63it/s]
                                                      
{'loss': 0.1575, 'grad_norm': 0.5876654982566833, 'learning_rate': 2.2994542115340706e-06, 'epoch': 2.14}

 71%|███████▏  | 7883/11049 [1:21:10<32:23,  1.63it/s]
 71%|███████▏  | 7884/11049 [1:21:10<32:22,  1.63it/s]
                                                      
{'loss': 0.1464, 'grad_norm': 0.5238949656486511, 'learning_rate': 2.298124927289894e-06, 'epoch': 2.14}

 71%|███████▏  | 7884/11049 [1:21:11<32:22,  1.63it/s]
 71%|███████▏  | 7885/11049 [1:21:11<32:21,  1.63it/s]
                                                      
{'loss': 0.1057, 'grad_norm': 0.4229654371738434, 'learning_rate': 2.296795912722014e-06, 'epoch': 2.14}

 71%|███████▏  | 7885/11049 [1:21:11<32:21,  1.63it/s]
 71%|███████▏  | 7886/11049 [1:21:12<32:20,  1.63it/s]
                                                      
{'loss': 0.153, 'grad_norm': 0.5314268469810486, 'learning_rate': 2.2954671679630785e-06, 'epoch': 2.14}

 71%|███████▏  | 7886/11049 [1:21:12<32:20,  1.63it/s]
 71%|███████▏  | 7887/11049 [1:21:12<32:19,  1.63it/s]
                                                      
{'loss': 0.1394, 'grad_norm': 0.4816981554031372, 'learning_rate': 2.2941386931457136e-06, 'epoch': 2.14}

 71%|███████▏  | 7887/11049 [1:21:12<32:19,  1.63it/s]
 71%|███████▏  | 7888/11049 [1:21:13<32:18,  1.63it/s]
                                                      
{'loss': 0.1498, 'grad_norm': 0.6542614102363586, 'learning_rate': 2.292810488402515e-06, 'epoch': 2.14}

 71%|███████▏  | 7888/11049 [1:21:13<32:18,  1.63it/s]
 71%|███████▏  | 7889/11049 [1:21:14<32:18,  1.63it/s]
                                                      
{'loss': 0.1276, 'grad_norm': 0.5291734337806702, 'learning_rate': 2.2914825538660507e-06, 'epoch': 2.14}

 71%|███████▏  | 7889/11049 [1:21:14<32:18,  1.63it/s]
 71%|███████▏  | 7890/11049 [1:21:14<32:17,  1.63it/s]
                                                      
{'loss': 0.1464, 'grad_norm': 0.5611540079116821, 'learning_rate': 2.290154889668862e-06, 'epoch': 2.14}

 71%|███████▏  | 7890/11049 [1:21:14<32:17,  1.63it/s]
 71%|███████▏  | 7891/11049 [1:21:15<32:16,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.6397609710693359, 'learning_rate': 2.2888274959434663e-06, 'epoch': 2.14}

 71%|███████▏  | 7891/11049 [1:21:15<32:16,  1.63it/s]
 71%|███████▏  | 7892/11049 [1:21:15<32:14,  1.63it/s]
                                                      
{'loss': 0.1583, 'grad_norm': 0.5939511656761169, 'learning_rate': 2.2875003728223515e-06, 'epoch': 2.14}

 71%|███████▏  | 7892/11049 [1:21:15<32:14,  1.63it/s]
 71%|███████▏  | 7893/11049 [1:21:16<32:15,  1.63it/s]
                                                      
{'loss': 0.1503, 'grad_norm': 0.5995180606842041, 'learning_rate': 2.2861735204379803e-06, 'epoch': 2.14}

 71%|███████▏  | 7893/11049 [1:21:16<32:15,  1.63it/s]
 71%|███████▏  | 7894/11049 [1:21:17<32:14,  1.63it/s]
                                                      
{'loss': 0.1782, 'grad_norm': 0.6416738629341125, 'learning_rate': 2.2848469389227813e-06, 'epoch': 2.14}

 71%|███████▏  | 7894/11049 [1:21:17<32:14,  1.63it/s]
 71%|███████▏  | 7895/11049 [1:21:17<32:13,  1.63it/s]
                                                      
{'loss': 0.1512, 'grad_norm': 0.5854738354682922, 'learning_rate': 2.2835206284091666e-06, 'epoch': 2.14}

 71%|███████▏  | 7895/11049 [1:21:17<32:13,  1.63it/s]
 71%|███████▏  | 7896/11049 [1:21:18<32:12,  1.63it/s]
                                                      
{'loss': 0.1663, 'grad_norm': 0.6252403259277344, 'learning_rate': 2.282194589029515e-06, 'epoch': 2.14}

 71%|███████▏  | 7896/11049 [1:21:18<32:12,  1.63it/s]
 71%|███████▏  | 7897/11049 [1:21:18<32:13,  1.63it/s]
                                                      
{'loss': 0.1458, 'grad_norm': 0.5294704437255859, 'learning_rate': 2.2808688209161797e-06, 'epoch': 2.14}

 71%|███████▏  | 7897/11049 [1:21:19<32:13,  1.63it/s]
 71%|███████▏  | 7898/11049 [1:21:19<32:13,  1.63it/s]
                                                      
{'loss': 0.1961, 'grad_norm': 0.507789134979248, 'learning_rate': 2.279543324201484e-06, 'epoch': 2.14}

 71%|███████▏  | 7898/11049 [1:21:19<32:13,  1.63it/s]
 71%|███████▏  | 7899/11049 [1:21:20<32:12,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.584809422492981, 'learning_rate': 2.2782180990177315e-06, 'epoch': 2.14}

 71%|███████▏  | 7899/11049 [1:21:20<32:12,  1.63it/s]
 71%|███████▏  | 7900/11049 [1:21:20<32:11,  1.63it/s]
                                                      
{'loss': 0.1397, 'grad_norm': 0.5594002604484558, 'learning_rate': 2.2768931454971916e-06, 'epoch': 2.14}

 71%|███████▏  | 7900/11049 [1:21:20<32:11,  1.63it/s]
 72%|███████▏  | 7901/11049 [1:21:21<32:11,  1.63it/s]
                                                      
{'loss': 0.1503, 'grad_norm': 0.6032090187072754, 'learning_rate': 2.2755684637721094e-06, 'epoch': 2.15}

 72%|███████▏  | 7901/11049 [1:21:21<32:11,  1.63it/s]
 72%|███████▏  | 7902/11049 [1:21:21<32:10,  1.63it/s]
                                                      
{'loss': 0.1374, 'grad_norm': 0.6077722311019897, 'learning_rate': 2.2742440539747014e-06, 'epoch': 2.15}

 72%|███████▏  | 7902/11049 [1:21:22<32:10,  1.63it/s]
 72%|███████▏  | 7903/11049 [1:21:22<32:11,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.5390639305114746, 'learning_rate': 2.272919916237159e-06, 'epoch': 2.15}

 72%|███████▏  | 7903/11049 [1:21:22<32:11,  1.63it/s]
 72%|███████▏  | 7904/11049 [1:21:23<32:09,  1.63it/s]
                                                      
{'loss': 0.1494, 'grad_norm': 0.5378691554069519, 'learning_rate': 2.271596050691645e-06, 'epoch': 2.15}

 72%|███████▏  | 7904/11049 [1:21:23<32:09,  1.63it/s]
 72%|███████▏  | 7905/11049 [1:21:23<32:09,  1.63it/s]
                                                      
{'loss': 0.1335, 'grad_norm': 0.5213028192520142, 'learning_rate': 2.2702724574702956e-06, 'epoch': 2.15}

 72%|███████▏  | 7905/11049 [1:21:23<32:09,  1.63it/s]
 72%|███████▏  | 7906/11049 [1:21:24<32:08,  1.63it/s]
                                                      
{'loss': 0.1555, 'grad_norm': 0.6377220153808594, 'learning_rate': 2.268949136705218e-06, 'epoch': 2.15}

 72%|███████▏  | 7906/11049 [1:21:24<32:08,  1.63it/s]
 72%|███████▏  | 7907/11049 [1:21:25<33:01,  1.59it/s]
                                                      
{'loss': 0.1648, 'grad_norm': 0.6213671565055847, 'learning_rate': 2.267626088528497e-06, 'epoch': 2.15}

 72%|███████▏  | 7907/11049 [1:21:25<33:01,  1.59it/s]
 72%|███████▏  | 7908/11049 [1:21:25<32:46,  1.60it/s]
                                                      
{'loss': 0.143, 'grad_norm': 0.5240007638931274, 'learning_rate': 2.266303313072186e-06, 'epoch': 2.15}

 72%|███████▏  | 7908/11049 [1:21:25<32:46,  1.60it/s]
 72%|███████▏  | 7909/11049 [1:21:26<32:35,  1.61it/s]
                                                      
{'loss': 0.1366, 'grad_norm': 0.5775078535079956, 'learning_rate': 2.2649808104683118e-06, 'epoch': 2.15}

 72%|███████▏  | 7909/11049 [1:21:26<32:35,  1.61it/s]
 72%|███████▏  | 7910/11049 [1:21:26<32:25,  1.61it/s]
                                                      
{'loss': 0.1469, 'grad_norm': 0.5975848436355591, 'learning_rate': 2.263658580848875e-06, 'epoch': 2.15}

 72%|███████▏  | 7910/11049 [1:21:27<32:25,  1.61it/s]
 72%|███████▏  | 7911/11049 [1:21:27<32:18,  1.62it/s]
                                                      
{'loss': 0.1605, 'grad_norm': 0.595415472984314, 'learning_rate': 2.262336624345847e-06, 'epoch': 2.15}

 72%|███████▏  | 7911/11049 [1:21:27<32:18,  1.62it/s]
 72%|███████▏  | 7912/11049 [1:21:28<32:14,  1.62it/s]
                                                      
{'loss': 0.1485, 'grad_norm': 0.5235577821731567, 'learning_rate': 2.2610149410911754e-06, 'epoch': 2.15}

 72%|███████▏  | 7912/11049 [1:21:28<32:14,  1.62it/s]
 72%|███████▏  | 7913/11049 [1:21:28<32:14,  1.62it/s]
                                                      
{'loss': 0.1685, 'grad_norm': 0.5542361736297607, 'learning_rate': 2.2596935312167766e-06, 'epoch': 2.15}

 72%|███████▏  | 7913/11049 [1:21:28<32:14,  1.62it/s]
 72%|███████▏  | 7914/11049 [1:21:29<32:10,  1.62it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.637082576751709, 'learning_rate': 2.2583723948545405e-06, 'epoch': 2.15}

 72%|███████▏  | 7914/11049 [1:21:29<32:10,  1.62it/s]
 72%|███████▏  | 7915/11049 [1:21:30<32:09,  1.62it/s]
                                                      
{'loss': 0.1962, 'grad_norm': 0.7813854813575745, 'learning_rate': 2.2570515321363345e-06, 'epoch': 2.15}

 72%|███████▏  | 7915/11049 [1:21:30<32:09,  1.62it/s]
 72%|███████▏  | 7916/11049 [1:21:30<32:05,  1.63it/s]
                                                      
{'loss': 0.1971, 'grad_norm': 0.7973605394363403, 'learning_rate': 2.2557309431939934e-06, 'epoch': 2.15}

 72%|███████▏  | 7916/11049 [1:21:30<32:05,  1.63it/s]
 72%|███████▏  | 7917/11049 [1:21:31<32:03,  1.63it/s]
                                                      
{'loss': 0.1774, 'grad_norm': 0.6274529695510864, 'learning_rate': 2.254410628159325e-06, 'epoch': 2.15}

 72%|███████▏  | 7917/11049 [1:21:31<32:03,  1.63it/s]
 72%|███████▏  | 7918/11049 [1:21:31<32:01,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.5609729290008545, 'learning_rate': 2.253090587164111e-06, 'epoch': 2.15}

 72%|███████▏  | 7918/11049 [1:21:32<32:01,  1.63it/s]
 72%|███████▏  | 7919/11049 [1:21:32<31:59,  1.63it/s]
                                                      
{'loss': 0.1576, 'grad_norm': 0.659168541431427, 'learning_rate': 2.2517708203401094e-06, 'epoch': 2.15}

 72%|███████▏  | 7919/11049 [1:21:32<31:59,  1.63it/s]
 72%|███████▏  | 7920/11049 [1:21:33<31:59,  1.63it/s]
                                                      
{'loss': 0.214, 'grad_norm': 0.7348192930221558, 'learning_rate': 2.250451327819043e-06, 'epoch': 2.15}

 72%|███████▏  | 7920/11049 [1:21:33<31:59,  1.63it/s]
 72%|███████▏  | 7921/11049 [1:21:33<31:59,  1.63it/s]
                                                      
{'loss': 0.1672, 'grad_norm': 0.541371762752533, 'learning_rate': 2.2491321097326125e-06, 'epoch': 2.15}

 72%|███████▏  | 7921/11049 [1:21:33<31:59,  1.63it/s]
 72%|███████▏  | 7922/11049 [1:21:34<31:58,  1.63it/s]
                                                      
{'loss': 0.1411, 'grad_norm': 0.5728204846382141, 'learning_rate': 2.2478131662124884e-06, 'epoch': 2.15}

 72%|███████▏  | 7922/11049 [1:21:34<31:58,  1.63it/s]
 72%|███████▏  | 7923/11049 [1:21:34<31:57,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.57636958360672, 'learning_rate': 2.2464944973903202e-06, 'epoch': 2.15}

 72%|███████▏  | 7923/11049 [1:21:35<31:57,  1.63it/s]
 72%|███████▏  | 7924/11049 [1:21:35<31:56,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.6008357405662537, 'learning_rate': 2.2451761033977217e-06, 'epoch': 2.15}

 72%|███████▏  | 7924/11049 [1:21:35<31:56,  1.63it/s]
 72%|███████▏  | 7925/11049 [1:21:36<31:55,  1.63it/s]
                                                      
{'loss': 0.11, 'grad_norm': 0.4714154601097107, 'learning_rate': 2.243857984366284e-06, 'epoch': 2.15}

 72%|███████▏  | 7925/11049 [1:21:36<31:55,  1.63it/s]
 72%|███████▏  | 7926/11049 [1:21:36<31:54,  1.63it/s]
                                                      
{'loss': 0.1235, 'grad_norm': 0.4415740370750427, 'learning_rate': 2.242540140427567e-06, 'epoch': 2.15}

 72%|███████▏  | 7926/11049 [1:21:36<31:54,  1.63it/s]
 72%|███████▏  | 7927/11049 [1:21:37<31:53,  1.63it/s]
                                                      
{'loss': 0.1497, 'grad_norm': 0.5473296046257019, 'learning_rate': 2.2412225717131103e-06, 'epoch': 2.15}

 72%|███████▏  | 7927/11049 [1:21:37<31:53,  1.63it/s]
 72%|███████▏  | 7928/11049 [1:21:38<31:53,  1.63it/s]
                                                      
{'loss': 0.1819, 'grad_norm': 0.6456573605537415, 'learning_rate': 2.2399052783544196e-06, 'epoch': 2.15}

 72%|███████▏  | 7928/11049 [1:21:38<31:53,  1.63it/s]
 72%|███████▏  | 7929/11049 [1:21:38<31:53,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.5726869106292725, 'learning_rate': 2.2385882604829763e-06, 'epoch': 2.15}

 72%|███████▏  | 7929/11049 [1:21:38<31:53,  1.63it/s]
 72%|███████▏  | 7930/11049 [1:21:39<31:52,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.633693277835846, 'learning_rate': 2.237271518230227e-06, 'epoch': 2.15}

 72%|███████▏  | 7930/11049 [1:21:39<31:52,  1.63it/s]
 72%|███████▏  | 7931/11049 [1:21:39<31:52,  1.63it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.6501745581626892, 'learning_rate': 2.2359550517276034e-06, 'epoch': 2.15}

 72%|███████▏  | 7931/11049 [1:21:39<31:52,  1.63it/s]
 72%|███████▏  | 7932/11049 [1:21:40<31:52,  1.63it/s]
                                                      
{'loss': 0.1538, 'grad_norm': 0.5689224600791931, 'learning_rate': 2.234638861106501e-06, 'epoch': 2.15}

 72%|███████▏  | 7932/11049 [1:21:40<31:52,  1.63it/s]
 72%|███████▏  | 7933/11049 [1:21:41<31:50,  1.63it/s]
                                                      
{'loss': 0.1259, 'grad_norm': 0.4647473096847534, 'learning_rate': 2.233322946498289e-06, 'epoch': 2.15}

 72%|███████▏  | 7933/11049 [1:21:41<31:50,  1.63it/s]
 72%|███████▏  | 7934/11049 [1:21:41<31:51,  1.63it/s]
                                                      
{'loss': 0.1264, 'grad_norm': 0.6296884417533875, 'learning_rate': 2.2320073080343093e-06, 'epoch': 2.15}

 72%|███████▏  | 7934/11049 [1:21:41<31:51,  1.63it/s]
 72%|███████▏  | 7935/11049 [1:21:42<31:50,  1.63it/s]
                                                      
{'loss': 0.1576, 'grad_norm': 0.595102846622467, 'learning_rate': 2.2306919458458793e-06, 'epoch': 2.15}

 72%|███████▏  | 7935/11049 [1:21:42<31:50,  1.63it/s]
 72%|███████▏  | 7936/11049 [1:21:42<31:49,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.5406274199485779, 'learning_rate': 2.2293768600642857e-06, 'epoch': 2.15}

 72%|███████▏  | 7936/11049 [1:21:43<31:49,  1.63it/s]
 72%|███████▏  | 7937/11049 [1:21:43<31:49,  1.63it/s]
                                                      
{'loss': 0.1339, 'grad_norm': 0.47432073950767517, 'learning_rate': 2.2280620508207873e-06, 'epoch': 2.16}

 72%|███████▏  | 7937/11049 [1:21:43<31:49,  1.63it/s]
 72%|███████▏  | 7938/11049 [1:21:44<31:48,  1.63it/s]
                                                      
{'loss': 0.1756, 'grad_norm': 0.7233158349990845, 'learning_rate': 2.226747518246616e-06, 'epoch': 2.16}

 72%|███████▏  | 7938/11049 [1:21:44<31:48,  1.63it/s]
 72%|███████▏  | 7939/11049 [1:21:44<31:47,  1.63it/s]
                                                      
{'loss': 0.1349, 'grad_norm': 0.46068570017814636, 'learning_rate': 2.2254332624729778e-06, 'epoch': 2.16}

 72%|███████▏  | 7939/11049 [1:21:44<31:47,  1.63it/s]
 72%|███████▏  | 7940/11049 [1:21:45<31:47,  1.63it/s]
                                                      
{'loss': 0.1285, 'grad_norm': 0.522070050239563, 'learning_rate': 2.224119283631048e-06, 'epoch': 2.16}

 72%|███████▏  | 7940/11049 [1:21:45<31:47,  1.63it/s]
 72%|███████▏  | 7941/11049 [1:21:45<31:47,  1.63it/s]
                                                      
{'loss': 0.154, 'grad_norm': 0.5396953821182251, 'learning_rate': 2.2228055818519774e-06, 'epoch': 2.16}

 72%|███████▏  | 7941/11049 [1:21:46<31:47,  1.63it/s]
 72%|███████▏  | 7942/11049 [1:21:46<31:47,  1.63it/s]
                                                      
{'loss': 0.1424, 'grad_norm': 0.652176558971405, 'learning_rate': 2.2214921572668845e-06, 'epoch': 2.16}

 72%|███████▏  | 7942/11049 [1:21:46<31:47,  1.63it/s]
 72%|███████▏  | 7943/11049 [1:21:47<31:47,  1.63it/s]
                                                      
{'loss': 0.1769, 'grad_norm': 0.6112795472145081, 'learning_rate': 2.2201790100068676e-06, 'epoch': 2.16}

 72%|███████▏  | 7943/11049 [1:21:47<31:47,  1.63it/s]
 72%|███████▏  | 7944/11049 [1:21:47<31:46,  1.63it/s]
                                                      
{'loss': 0.1762, 'grad_norm': 0.6156417727470398, 'learning_rate': 2.2188661402029902e-06, 'epoch': 2.16}

 72%|███████▏  | 7944/11049 [1:21:47<31:46,  1.63it/s]
 72%|███████▏  | 7945/11049 [1:21:48<31:44,  1.63it/s]
                                                      
{'loss': 0.1528, 'grad_norm': 0.5671159625053406, 'learning_rate': 2.2175535479862927e-06, 'epoch': 2.16}

 72%|███████▏  | 7945/11049 [1:21:48<31:44,  1.63it/s]
 72%|███████▏  | 7946/11049 [1:21:49<31:43,  1.63it/s]
                                                      
{'loss': 0.146, 'grad_norm': 0.548452615737915, 'learning_rate': 2.2162412334877843e-06, 'epoch': 2.16}

 72%|███████▏  | 7946/11049 [1:21:49<31:43,  1.63it/s]
 72%|███████▏  | 7947/11049 [1:21:49<31:42,  1.63it/s]
                                                      
{'loss': 0.1913, 'grad_norm': 0.5921102166175842, 'learning_rate': 2.214929196838449e-06, 'epoch': 2.16}

 72%|███████▏  | 7947/11049 [1:21:49<31:42,  1.63it/s]
 72%|███████▏  | 7948/11049 [1:21:50<31:41,  1.63it/s]
                                                      
{'loss': 0.1161, 'grad_norm': 0.4497779309749603, 'learning_rate': 2.2136174381692416e-06, 'epoch': 2.16}

 72%|███████▏  | 7948/11049 [1:21:50<31:41,  1.63it/s]
 72%|███████▏  | 7949/11049 [1:21:50<31:41,  1.63it/s]
                                                      
{'loss': 0.2001, 'grad_norm': 0.6547366976737976, 'learning_rate': 2.2123059576110905e-06, 'epoch': 2.16}

 72%|███████▏  | 7949/11049 [1:21:51<31:41,  1.63it/s]
 72%|███████▏  | 7950/11049 [1:21:51<31:40,  1.63it/s]
                                                      
{'loss': 0.1545, 'grad_norm': 0.6991328001022339, 'learning_rate': 2.210994755294893e-06, 'epoch': 2.16}

 72%|███████▏  | 7950/11049 [1:21:51<31:40,  1.63it/s]
 72%|███████▏  | 7951/11049 [1:21:52<31:39,  1.63it/s]
                                                      
{'loss': 0.1476, 'grad_norm': 0.46551695466041565, 'learning_rate': 2.2096838313515256e-06, 'epoch': 2.16}

 72%|███████▏  | 7951/11049 [1:21:52<31:39,  1.63it/s]
 72%|███████▏  | 7952/11049 [1:21:52<31:39,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.643650233745575, 'learning_rate': 2.208373185911831e-06, 'epoch': 2.16}

 72%|███████▏  | 7952/11049 [1:21:52<31:39,  1.63it/s]
 72%|███████▏  | 7953/11049 [1:21:53<31:38,  1.63it/s]
                                                      
{'loss': 0.1624, 'grad_norm': 0.610507607460022, 'learning_rate': 2.207062819106624e-06, 'epoch': 2.16}

 72%|███████▏  | 7953/11049 [1:21:53<31:38,  1.63it/s]
 72%|███████▏  | 7954/11049 [1:21:54<32:24,  1.59it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.9062334299087524, 'learning_rate': 2.2057527310666935e-06, 'epoch': 2.16}

 72%|███████▏  | 7954/11049 [1:21:54<32:24,  1.59it/s]
 72%|███████▏  | 7955/11049 [1:21:54<32:16,  1.60it/s]
                                                      
{'loss': 0.1746, 'grad_norm': 0.6827219724655151, 'learning_rate': 2.2044429219228057e-06, 'epoch': 2.16}

 72%|███████▏  | 7955/11049 [1:21:54<32:16,  1.60it/s]
 72%|███████▏  | 7956/11049 [1:21:55<32:03,  1.61it/s]
                                                      
{'loss': 0.1708, 'grad_norm': 0.620336651802063, 'learning_rate': 2.2031333918056874e-06, 'epoch': 2.16}

 72%|███████▏  | 7956/11049 [1:21:55<32:03,  1.61it/s]
 72%|███████▏  | 7957/11049 [1:21:55<31:56,  1.61it/s]
                                                      
{'loss': 0.1418, 'grad_norm': 0.5335673093795776, 'learning_rate': 2.2018241408460463e-06, 'epoch': 2.16}

 72%|███████▏  | 7957/11049 [1:21:55<31:56,  1.61it/s]
 72%|███████▏  | 7958/11049 [1:21:56<31:48,  1.62it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.6751265525817871, 'learning_rate': 2.2005151691745576e-06, 'epoch': 2.16}

 72%|███████▏  | 7958/11049 [1:21:56<31:48,  1.62it/s]
 72%|███████▏  | 7959/11049 [1:21:57<31:46,  1.62it/s]
                                                      
{'loss': 0.1487, 'grad_norm': 0.6063311696052551, 'learning_rate': 2.199206476921874e-06, 'epoch': 2.16}

 72%|███████▏  | 7959/11049 [1:21:57<31:46,  1.62it/s]
 72%|███████▏  | 7960/11049 [1:21:57<31:42,  1.62it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.6210785508155823, 'learning_rate': 2.197898064218616e-06, 'epoch': 2.16}

 72%|███████▏  | 7960/11049 [1:21:57<31:42,  1.62it/s]
 72%|███████▏  | 7961/11049 [1:21:58<31:39,  1.63it/s]
                                                      
{'loss': 0.1579, 'grad_norm': 0.5932931900024414, 'learning_rate': 2.1965899311953777e-06, 'epoch': 2.16}

 72%|███████▏  | 7961/11049 [1:21:58<31:39,  1.63it/s]
 72%|███████▏  | 7962/11049 [1:21:58<31:36,  1.63it/s]
                                                      
{'loss': 0.1723, 'grad_norm': 0.6264482140541077, 'learning_rate': 2.1952820779827218e-06, 'epoch': 2.16}

 72%|███████▏  | 7962/11049 [1:21:59<31:36,  1.63it/s]
 72%|███████▏  | 7963/11049 [1:21:59<31:36,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.7006704807281494, 'learning_rate': 2.193974504711191e-06, 'epoch': 2.16}

 72%|███████▏  | 7963/11049 [1:21:59<31:36,  1.63it/s]
 72%|███████▏  | 7964/11049 [1:22:00<31:33,  1.63it/s]
                                                      
{'loss': 0.1611, 'grad_norm': 0.6138566136360168, 'learning_rate': 2.1926672115112923e-06, 'epoch': 2.16}

 72%|███████▏  | 7964/11049 [1:22:00<31:33,  1.63it/s]
 72%|███████▏  | 7965/11049 [1:22:00<31:32,  1.63it/s]
                                                      
{'loss': 0.1411, 'grad_norm': 0.5008935928344727, 'learning_rate': 2.191360198513511e-06, 'epoch': 2.16}

 72%|███████▏  | 7965/11049 [1:22:00<31:32,  1.63it/s]
 72%|███████▏  | 7966/11049 [1:22:01<32:32,  1.58it/s]
                                                      
{'loss': 0.2177, 'grad_norm': 0.7043700218200684, 'learning_rate': 2.1900534658482943e-06, 'epoch': 2.16}

 72%|███████▏  | 7966/11049 [1:22:01<32:32,  1.58it/s]
 72%|███████▏  | 7967/11049 [1:22:02<32:21,  1.59it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.585929811000824, 'learning_rate': 2.188747013646074e-06, 'epoch': 2.16}

 72%|███████▏  | 7967/11049 [1:22:02<32:21,  1.59it/s]
 72%|███████▏  | 7968/11049 [1:22:02<32:07,  1.60it/s]
                                                      
{'loss': 0.1439, 'grad_norm': 0.5901780724525452, 'learning_rate': 2.1874408420372467e-06, 'epoch': 2.16}

 72%|███████▏  | 7968/11049 [1:22:02<32:07,  1.60it/s]
 72%|███████▏  | 7969/11049 [1:22:03<31:57,  1.61it/s]
                                                      
{'loss': 0.1598, 'grad_norm': 0.6196581721305847, 'learning_rate': 2.1861349511521817e-06, 'epoch': 2.16}

 72%|███████▏  | 7969/11049 [1:22:03<31:57,  1.61it/s]
 72%|███████▏  | 7970/11049 [1:22:03<31:47,  1.61it/s]
                                                      
{'loss': 0.1211, 'grad_norm': 0.551856517791748, 'learning_rate': 2.18482934112122e-06, 'epoch': 2.16}

 72%|███████▏  | 7970/11049 [1:22:04<31:47,  1.61it/s]
 72%|███████▏  | 7971/11049 [1:22:04<31:43,  1.62it/s]
                                                      
{'loss': 0.164, 'grad_norm': 0.5757789611816406, 'learning_rate': 2.1835240120746793e-06, 'epoch': 2.16}

 72%|███████▏  | 7971/11049 [1:22:04<31:43,  1.62it/s]
 72%|███████▏  | 7972/11049 [1:22:05<31:38,  1.62it/s]
                                                      
{'loss': 0.1108, 'grad_norm': 0.4903722107410431, 'learning_rate': 2.1822189641428426e-06, 'epoch': 2.16}

 72%|███████▏  | 7972/11049 [1:22:05<31:38,  1.62it/s]
 72%|███████▏  | 7973/11049 [1:22:05<31:35,  1.62it/s]
                                                      
{'loss': 0.1429, 'grad_norm': 0.5181775093078613, 'learning_rate': 2.1809141974559687e-06, 'epoch': 2.16}

 72%|███████▏  | 7973/11049 [1:22:05<31:35,  1.62it/s]
 72%|███████▏  | 7974/11049 [1:22:06<31:35,  1.62it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5739381313323975, 'learning_rate': 2.1796097121442873e-06, 'epoch': 2.17}

 72%|███████▏  | 7974/11049 [1:22:06<31:35,  1.62it/s]
 72%|███████▏  | 7975/11049 [1:22:06<31:31,  1.63it/s]
                                                      
{'loss': 0.146, 'grad_norm': 0.5438544750213623, 'learning_rate': 2.1783055083379996e-06, 'epoch': 2.17}

 72%|███████▏  | 7975/11049 [1:22:07<31:31,  1.63it/s]
 72%|███████▏  | 7976/11049 [1:22:07<31:38,  1.62it/s]
                                                      
{'loss': 0.1632, 'grad_norm': 0.5454402565956116, 'learning_rate': 2.17700158616728e-06, 'epoch': 2.17}

 72%|███████▏  | 7976/11049 [1:22:07<31:38,  1.62it/s]
 72%|███████▏  | 7977/11049 [1:22:08<31:34,  1.62it/s]
                                                      
{'loss': 0.1573, 'grad_norm': 0.5802708864212036, 'learning_rate': 2.1756979457622736e-06, 'epoch': 2.17}

 72%|███████▏  | 7977/11049 [1:22:08<31:34,  1.62it/s]
 72%|███████▏  | 7978/11049 [1:22:08<31:39,  1.62it/s]
                                                      
{'loss': 0.1806, 'grad_norm': 0.6504899263381958, 'learning_rate': 2.1743945872530954e-06, 'epoch': 2.17}

 72%|███████▏  | 7978/11049 [1:22:08<31:39,  1.62it/s]
 72%|███████▏  | 7979/11049 [1:22:09<31:36,  1.62it/s]
                                                      
{'loss': 0.1736, 'grad_norm': 0.6788812279701233, 'learning_rate': 2.1730915107698394e-06, 'epoch': 2.17}

 72%|███████▏  | 7979/11049 [1:22:09<31:36,  1.62it/s]
 72%|███████▏  | 7980/11049 [1:22:10<31:32,  1.62it/s]
                                                      
{'loss': 0.1656, 'grad_norm': 0.5630432367324829, 'learning_rate': 2.171788716442564e-06, 'epoch': 2.17}

 72%|███████▏  | 7980/11049 [1:22:10<31:32,  1.62it/s]
 72%|███████▏  | 7981/11049 [1:22:10<31:30,  1.62it/s]
                                                      
{'loss': 0.1446, 'grad_norm': 0.810772180557251, 'learning_rate': 2.1704862044013023e-06, 'epoch': 2.17}

 72%|███████▏  | 7981/11049 [1:22:10<31:30,  1.62it/s]
 72%|███████▏  | 7982/11049 [1:22:11<31:26,  1.63it/s]
                                                      
{'loss': 0.1495, 'grad_norm': 0.7731191515922546, 'learning_rate': 2.16918397477606e-06, 'epoch': 2.17}

 72%|███████▏  | 7982/11049 [1:22:11<31:26,  1.63it/s]
 72%|███████▏  | 7983/11049 [1:22:11<31:27,  1.62it/s]
                                                      
{'loss': 0.1284, 'grad_norm': 0.519645631313324, 'learning_rate': 2.1678820276968122e-06, 'epoch': 2.17}

 72%|███████▏  | 7983/11049 [1:22:12<31:27,  1.62it/s]
 72%|███████▏  | 7984/11049 [1:22:12<31:25,  1.63it/s]
                                                      
{'loss': 0.1606, 'grad_norm': 0.7004590034484863, 'learning_rate': 2.1665803632935085e-06, 'epoch': 2.17}

 72%|███████▏  | 7984/11049 [1:22:12<31:25,  1.63it/s]
 72%|███████▏  | 7985/11049 [1:22:13<31:23,  1.63it/s]
                                                      
{'loss': 0.14, 'grad_norm': 0.5144684910774231, 'learning_rate': 2.1652789816960677e-06, 'epoch': 2.17}

 72%|███████▏  | 7985/11049 [1:22:13<31:23,  1.63it/s]
 72%|███████▏  | 7986/11049 [1:22:13<31:22,  1.63it/s]
                                                      
{'loss': 0.1212, 'grad_norm': 0.6729407906532288, 'learning_rate': 2.1639778830343818e-06, 'epoch': 2.17}

 72%|███████▏  | 7986/11049 [1:22:13<31:22,  1.63it/s]
 72%|███████▏  | 7987/11049 [1:22:14<31:20,  1.63it/s]
                                                      
{'loss': 0.1453, 'grad_norm': 0.45984140038490295, 'learning_rate': 2.1626770674383162e-06, 'epoch': 2.17}

 72%|███████▏  | 7987/11049 [1:22:14<31:20,  1.63it/s]
 72%|███████▏  | 7988/11049 [1:22:14<31:20,  1.63it/s]
                                                      
{'loss': 0.1682, 'grad_norm': 0.5906698107719421, 'learning_rate': 2.161376535037706e-06, 'epoch': 2.17}

 72%|███████▏  | 7988/11049 [1:22:15<31:20,  1.63it/s]
 72%|███████▏  | 7989/11049 [1:22:15<31:20,  1.63it/s]
                                                      
{'loss': 0.1454, 'grad_norm': 0.5452436804771423, 'learning_rate': 2.160076285962357e-06, 'epoch': 2.17}

 72%|███████▏  | 7989/11049 [1:22:15<31:20,  1.63it/s]
 72%|███████▏  | 7990/11049 [1:22:16<31:18,  1.63it/s]
                                                      
{'loss': 0.1407, 'grad_norm': 0.5256117582321167, 'learning_rate': 2.1587763203420476e-06, 'epoch': 2.17}

 72%|███████▏  | 7990/11049 [1:22:16<31:18,  1.63it/s]
 72%|███████▏  | 7991/11049 [1:22:16<31:19,  1.63it/s]
                                                      
{'loss': 0.1564, 'grad_norm': 0.694689154624939, 'learning_rate': 2.157476638306533e-06, 'epoch': 2.17}

 72%|███████▏  | 7991/11049 [1:22:16<31:19,  1.63it/s]
 72%|███████▏  | 7992/11049 [1:22:17<31:16,  1.63it/s]
                                                      
{'loss': 0.1369, 'grad_norm': 0.5191003084182739, 'learning_rate': 2.1561772399855304e-06, 'epoch': 2.17}

 72%|███████▏  | 7992/11049 [1:22:17<31:16,  1.63it/s]
 72%|███████▏  | 7993/11049 [1:22:18<31:16,  1.63it/s]
                                                      
{'loss': 0.1862, 'grad_norm': 0.6055671572685242, 'learning_rate': 2.1548781255087353e-06, 'epoch': 2.17}

 72%|███████▏  | 7993/11049 [1:22:18<31:16,  1.63it/s]
 72%|███████▏  | 7994/11049 [1:22:18<31:15,  1.63it/s]
                                                      
{'loss': 0.1724, 'grad_norm': 0.5949435830116272, 'learning_rate': 2.153579295005812e-06, 'epoch': 2.17}

 72%|███████▏  | 7994/11049 [1:22:18<31:15,  1.63it/s]
 72%|███████▏  | 7995/11049 [1:22:19<31:13,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.543940007686615, 'learning_rate': 2.1522807486064012e-06, 'epoch': 2.17}

 72%|███████▏  | 7995/11049 [1:22:19<31:13,  1.63it/s]
 72%|███████▏  | 7996/11049 [1:22:19<31:12,  1.63it/s]
                                                      
{'loss': 0.1622, 'grad_norm': 0.5847434997558594, 'learning_rate': 2.1509824864401103e-06, 'epoch': 2.17}

 72%|███████▏  | 7996/11049 [1:22:20<31:12,  1.63it/s]
 72%|███████▏  | 7997/11049 [1:22:20<31:13,  1.63it/s]
                                                      
{'loss': 0.1957, 'grad_norm': 0.61440110206604, 'learning_rate': 2.149684508636519e-06, 'epoch': 2.17}

 72%|███████▏  | 7997/11049 [1:22:20<31:13,  1.63it/s]
 72%|███████▏  | 7998/11049 [1:22:21<31:11,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.6660614013671875, 'learning_rate': 2.148386815325179e-06, 'epoch': 2.17}

 72%|███████▏  | 7998/11049 [1:22:21<31:11,  1.63it/s]
 72%|███████▏  | 7999/11049 [1:22:21<31:11,  1.63it/s]
                                                      
{'loss': 0.1321, 'grad_norm': 0.48093459010124207, 'learning_rate': 2.147089406635616e-06, 'epoch': 2.17}

 72%|███████▏  | 7999/11049 [1:22:21<31:11,  1.63it/s]
 72%|███████▏  | 8000/11049 [1:22:22<31:09,  1.63it/s]
                                                      
{'loss': 0.1466, 'grad_norm': 0.5845262408256531, 'learning_rate': 2.1457922826973254e-06, 'epoch': 2.17}

 72%|███████▏  | 8000/11049 [1:22:22<31:09,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.28it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.550503134727478, 'eval_runtime': 1.953, 'eval_samples_per_second': 102.408, 'eval_steps_per_second': 6.657, 'epoch': 2.17}

 72%|███████▏  | 8000/11049 [1:22:24<31:09,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 72%|███████▏  | 8001/11049 [1:22:24<1:00:59,  1.20s/it]
                                                        
{'loss': 0.1525, 'grad_norm': 0.5578318238258362, 'learning_rate': 2.144495443639775e-06, 'epoch': 2.17}

 72%|███████▏  | 8001/11049 [1:22:25<1:00:59,  1.20s/it]
 72%|███████▏  | 8002/11049 [1:22:25<52:01,  1.02s/it]  
                                                      
{'loss': 0.1759, 'grad_norm': 0.5631985068321228, 'learning_rate': 2.1431988895923985e-06, 'epoch': 2.17}

 72%|███████▏  | 8002/11049 [1:22:25<52:01,  1.02s/it]
 72%|███████▏  | 8003/11049 [1:22:26<45:44,  1.11it/s]
                                                      
{'loss': 0.175, 'grad_norm': 0.6243707537651062, 'learning_rate': 2.14190262068461e-06, 'epoch': 2.17}

 72%|███████▏  | 8003/11049 [1:22:26<45:44,  1.11it/s]
 72%|███████▏  | 8004/11049 [1:22:26<41:20,  1.23it/s]
                                                      
{'loss': 0.1659, 'grad_norm': 0.6459827423095703, 'learning_rate': 2.140606637045791e-06, 'epoch': 2.17}

 72%|███████▏  | 8004/11049 [1:22:26<41:20,  1.23it/s]
 72%|███████▏  | 8005/11049 [1:22:27<38:15,  1.33it/s]
                                                      
{'loss': 0.1074, 'grad_norm': 0.4475533068180084, 'learning_rate': 2.1393109388052934e-06, 'epoch': 2.17}

 72%|███████▏  | 8005/11049 [1:22:27<38:15,  1.33it/s]
 72%|███████▏  | 8006/11049 [1:22:27<36:05,  1.41it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.5401248335838318, 'learning_rate': 2.1380155260924413e-06, 'epoch': 2.17}

 72%|███████▏  | 8006/11049 [1:22:28<36:05,  1.41it/s]
 72%|███████▏  | 8007/11049 [1:22:28<34:35,  1.47it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.7454427480697632, 'learning_rate': 2.1367203990365336e-06, 'epoch': 2.17}

 72%|███████▏  | 8007/11049 [1:22:28<34:35,  1.47it/s]
 72%|███████▏  | 8008/11049 [1:22:29<33:31,  1.51it/s]
                                                      
{'loss': 0.1297, 'grad_norm': 0.554304301738739, 'learning_rate': 2.135425557766836e-06, 'epoch': 2.17}

 72%|███████▏  | 8008/11049 [1:22:29<33:31,  1.51it/s]
 72%|███████▏  | 8009/11049 [1:22:29<32:47,  1.54it/s]
                                                      
{'loss': 0.1464, 'grad_norm': 0.5065463185310364, 'learning_rate': 2.134131002412588e-06, 'epoch': 2.17}

 72%|███████▏  | 8009/11049 [1:22:29<32:47,  1.54it/s]
 72%|███████▏  | 8010/11049 [1:22:30<32:17,  1.57it/s]
                                                      
{'loss': 0.1434, 'grad_norm': 0.5563693046569824, 'learning_rate': 2.1328367331030008e-06, 'epoch': 2.17}

 72%|███████▏  | 8010/11049 [1:22:30<32:17,  1.57it/s]
 73%|███████▎  | 8011/11049 [1:22:31<31:53,  1.59it/s]
                                                      
{'loss': 0.1725, 'grad_norm': 0.7105725407600403, 'learning_rate': 2.131542749967256e-06, 'epoch': 2.18}

 73%|███████▎  | 8011/11049 [1:22:31<31:53,  1.59it/s]
 73%|███████▎  | 8012/11049 [1:22:31<31:37,  1.60it/s]
                                                      
{'loss': 0.1596, 'grad_norm': 0.5931386351585388, 'learning_rate': 2.130249053134506e-06, 'epoch': 2.18}

 73%|███████▎  | 8012/11049 [1:22:31<31:37,  1.60it/s]
 73%|███████▎  | 8013/11049 [1:22:32<31:26,  1.61it/s]
                                                      
{'loss': 0.1218, 'grad_norm': 0.4804035425186157, 'learning_rate': 2.128955642733877e-06, 'epoch': 2.18}

 73%|███████▎  | 8013/11049 [1:22:32<31:26,  1.61it/s]
 73%|███████▎  | 8014/11049 [1:22:32<31:18,  1.62it/s]
                                                      
{'loss': 0.1406, 'grad_norm': 0.5136972069740295, 'learning_rate': 2.127662518894463e-06, 'epoch': 2.18}

 73%|███████▎  | 8014/11049 [1:22:33<31:18,  1.62it/s]
 73%|███████▎  | 8015/11049 [1:22:33<31:12,  1.62it/s]
                                                      
{'loss': 0.1913, 'grad_norm': 0.6640236377716064, 'learning_rate': 2.126369681745336e-06, 'epoch': 2.18}

 73%|███████▎  | 8015/11049 [1:22:33<31:12,  1.62it/s]
 73%|███████▎  | 8016/11049 [1:22:34<31:08,  1.62it/s]
                                                      
{'loss': 0.1801, 'grad_norm': 0.6348824501037598, 'learning_rate': 2.1250771314155323e-06, 'epoch': 2.18}

 73%|███████▎  | 8016/11049 [1:22:34<31:08,  1.62it/s]
 73%|███████▎  | 8017/11049 [1:22:34<31:04,  1.63it/s]
                                                      
{'loss': 0.1653, 'grad_norm': 0.7389658689498901, 'learning_rate': 2.1237848680340635e-06, 'epoch': 2.18}

 73%|███████▎  | 8017/11049 [1:22:34<31:04,  1.63it/s]
 73%|███████▎  | 8018/11049 [1:22:35<31:01,  1.63it/s]
                                                      
{'loss': 0.1596, 'grad_norm': 0.7004992365837097, 'learning_rate': 2.1224928917299096e-06, 'epoch': 2.18}

 73%|███████▎  | 8018/11049 [1:22:35<31:01,  1.63it/s]
 73%|███████▎  | 8019/11049 [1:22:35<31:00,  1.63it/s]
                                                      
{'loss': 0.1151, 'grad_norm': 0.4998925030231476, 'learning_rate': 2.121201202632026e-06, 'epoch': 2.18}

 73%|███████▎  | 8019/11049 [1:22:36<31:00,  1.63it/s]
 73%|███████▎  | 8020/11049 [1:22:36<30:58,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.6493034362792969, 'learning_rate': 2.119909800869336e-06, 'epoch': 2.18}

 73%|███████▎  | 8020/11049 [1:22:36<30:58,  1.63it/s]
 73%|███████▎  | 8021/11049 [1:22:37<30:57,  1.63it/s]
                                                      
{'loss': 0.1398, 'grad_norm': 0.5365573763847351, 'learning_rate': 2.118618686570735e-06, 'epoch': 2.18}

 73%|███████▎  | 8021/11049 [1:22:37<30:57,  1.63it/s]
 73%|███████▎  | 8022/11049 [1:22:37<30:56,  1.63it/s]
                                                      
{'loss': 0.1352, 'grad_norm': 0.5586501955986023, 'learning_rate': 2.11732785986509e-06, 'epoch': 2.18}

 73%|███████▎  | 8022/11049 [1:22:37<30:56,  1.63it/s]
 73%|███████▎  | 8023/11049 [1:22:38<30:56,  1.63it/s]
                                                      
{'loss': 0.1858, 'grad_norm': 0.7076822519302368, 'learning_rate': 2.1160373208812412e-06, 'epoch': 2.18}

 73%|███████▎  | 8023/11049 [1:22:38<30:56,  1.63it/s]
 73%|███████▎  | 8024/11049 [1:22:39<30:55,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.6146237254142761, 'learning_rate': 2.1147470697479977e-06, 'epoch': 2.18}

 73%|███████▎  | 8024/11049 [1:22:39<30:55,  1.63it/s]
 73%|███████▎  | 8025/11049 [1:22:39<30:54,  1.63it/s]
                                                      
{'loss': 0.1675, 'grad_norm': 0.555296003818512, 'learning_rate': 2.1134571065941396e-06, 'epoch': 2.18}

 73%|███████▎  | 8025/11049 [1:22:39<30:54,  1.63it/s]
 73%|███████▎  | 8026/11049 [1:22:40<30:54,  1.63it/s]
                                                      
{'loss': 0.1647, 'grad_norm': 0.5862215757369995, 'learning_rate': 2.1121674315484182e-06, 'epoch': 2.18}

 73%|███████▎  | 8026/11049 [1:22:40<30:54,  1.63it/s]
 73%|███████▎  | 8027/11049 [1:22:40<30:54,  1.63it/s]
                                                      
{'loss': 0.143, 'grad_norm': 0.556023895740509, 'learning_rate': 2.1108780447395622e-06, 'epoch': 2.18}

 73%|███████▎  | 8027/11049 [1:22:40<30:54,  1.63it/s]
 73%|███████▎  | 8028/11049 [1:22:41<30:53,  1.63it/s]
                                                      
{'loss': 0.1649, 'grad_norm': 0.5879091620445251, 'learning_rate': 2.1095889462962604e-06, 'epoch': 2.18}

 73%|███████▎  | 8028/11049 [1:22:41<30:53,  1.63it/s]
 73%|███████▎  | 8029/11049 [1:22:42<30:52,  1.63it/s]
                                                      
{'loss': 0.1291, 'grad_norm': 0.5705128908157349, 'learning_rate': 2.1083001363471813e-06, 'epoch': 2.18}

 73%|███████▎  | 8029/11049 [1:22:42<30:52,  1.63it/s]
 73%|███████▎  | 8030/11049 [1:22:42<30:51,  1.63it/s]
                                                      
{'loss': 0.0992, 'grad_norm': 0.43180420994758606, 'learning_rate': 2.1070116150209596e-06, 'epoch': 2.18}

 73%|███████▎  | 8030/11049 [1:22:42<30:51,  1.63it/s]
 73%|███████▎  | 8031/11049 [1:22:43<30:50,  1.63it/s]
                                                      
{'loss': 0.1684, 'grad_norm': 0.571727991104126, 'learning_rate': 2.1057233824462076e-06, 'epoch': 2.18}

 73%|███████▎  | 8031/11049 [1:22:43<30:50,  1.63it/s]
 73%|███████▎  | 8032/11049 [1:22:43<30:50,  1.63it/s]
                                                      
{'loss': 0.1411, 'grad_norm': 0.5014413595199585, 'learning_rate': 2.1044354387515026e-06, 'epoch': 2.18}

 73%|███████▎  | 8032/11049 [1:22:44<30:50,  1.63it/s]
 73%|███████▎  | 8033/11049 [1:22:44<30:49,  1.63it/s]
                                                      
{'loss': 0.2192, 'grad_norm': 0.8155120611190796, 'learning_rate': 2.103147784065396e-06, 'epoch': 2.18}

 73%|███████▎  | 8033/11049 [1:22:44<30:49,  1.63it/s]
 73%|███████▎  | 8034/11049 [1:22:45<30:48,  1.63it/s]
                                                      
{'loss': 0.1946, 'grad_norm': 0.6549694538116455, 'learning_rate': 2.101860418516409e-06, 'epoch': 2.18}

 73%|███████▎  | 8034/11049 [1:22:45<30:48,  1.63it/s]
 73%|███████▎  | 8035/11049 [1:22:45<30:47,  1.63it/s]
                                                      
{'loss': 0.1328, 'grad_norm': 0.5223433971405029, 'learning_rate': 2.1005733422330327e-06, 'epoch': 2.18}

 73%|███████▎  | 8035/11049 [1:22:45<30:47,  1.63it/s]
 73%|███████▎  | 8036/11049 [1:22:46<30:47,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.549079418182373, 'learning_rate': 2.0992865553437357e-06, 'epoch': 2.18}

 73%|███████▎  | 8036/11049 [1:22:46<30:47,  1.63it/s]
 73%|███████▎  | 8037/11049 [1:22:46<30:46,  1.63it/s]
                                                      
{'loss': 0.1444, 'grad_norm': 0.5501773357391357, 'learning_rate': 2.0980000579769523e-06, 'epoch': 2.18}

 73%|███████▎  | 8037/11049 [1:22:47<30:46,  1.63it/s]
 73%|███████▎  | 8038/11049 [1:22:47<30:46,  1.63it/s]
                                                      
{'loss': 0.1765, 'grad_norm': 0.6946486234664917, 'learning_rate': 2.0967138502610854e-06, 'epoch': 2.18}

 73%|███████▎  | 8038/11049 [1:22:47<30:46,  1.63it/s]
 73%|███████▎  | 8039/11049 [1:22:48<30:46,  1.63it/s]
                                                      
{'loss': 0.2269, 'grad_norm': 0.7291679978370667, 'learning_rate': 2.095427932324513e-06, 'epoch': 2.18}

 73%|███████▎  | 8039/11049 [1:22:48<30:46,  1.63it/s]
 73%|███████▎  | 8040/11049 [1:22:48<30:45,  1.63it/s]
                                                      
{'loss': 0.1626, 'grad_norm': 0.5416227579116821, 'learning_rate': 2.0941423042955867e-06, 'epoch': 2.18}

 73%|███████▎  | 8040/11049 [1:22:48<30:45,  1.63it/s]
 73%|███████▎  | 8041/11049 [1:22:49<30:44,  1.63it/s]
                                                      
{'loss': 0.1291, 'grad_norm': 0.5210809707641602, 'learning_rate': 2.092856966302624e-06, 'epoch': 2.18}

 73%|███████▎  | 8041/11049 [1:22:49<30:44,  1.63it/s]
 73%|███████▎  | 8042/11049 [1:22:50<30:44,  1.63it/s]
                                                      
{'loss': 0.132, 'grad_norm': 0.5595254898071289, 'learning_rate': 2.0915719184739158e-06, 'epoch': 2.18}

 73%|███████▎  | 8042/11049 [1:22:50<30:44,  1.63it/s]
 73%|███████▎  | 8043/11049 [1:22:50<30:43,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.6497281789779663, 'learning_rate': 2.0902871609377224e-06, 'epoch': 2.18}

 73%|███████▎  | 8043/11049 [1:22:50<30:43,  1.63it/s]
 73%|███████▎  | 8044/11049 [1:22:51<30:43,  1.63it/s]
                                                      
{'loss': 0.1932, 'grad_norm': 0.7812532186508179, 'learning_rate': 2.089002693822279e-06, 'epoch': 2.18}

 73%|███████▎  | 8044/11049 [1:22:51<30:43,  1.63it/s]
 73%|███████▎  | 8045/11049 [1:22:51<30:42,  1.63it/s]
                                                      
{'loss': 0.134, 'grad_norm': 0.4878575801849365, 'learning_rate': 2.0877185172557884e-06, 'epoch': 2.18}

 73%|███████▎  | 8045/11049 [1:22:52<30:42,  1.63it/s]
 73%|███████▎  | 8046/11049 [1:22:52<30:42,  1.63it/s]
                                                      
{'loss': 0.1403, 'grad_norm': 0.5279070734977722, 'learning_rate': 2.086434631366425e-06, 'epoch': 2.18}

 73%|███████▎  | 8046/11049 [1:22:52<30:42,  1.63it/s]
 73%|███████▎  | 8047/11049 [1:22:53<30:40,  1.63it/s]
                                                      
{'loss': 0.1265, 'grad_norm': 0.5281039476394653, 'learning_rate': 2.0851510362823345e-06, 'epoch': 2.18}

 73%|███████▎  | 8047/11049 [1:22:53<30:40,  1.63it/s]
 73%|███████▎  | 8048/11049 [1:22:53<30:40,  1.63it/s]
                                                      
{'loss': 0.1544, 'grad_norm': 0.5517246723175049, 'learning_rate': 2.0838677321316335e-06, 'epoch': 2.19}

 73%|███████▎  | 8048/11049 [1:22:53<30:40,  1.63it/s]
 73%|███████▎  | 8049/11049 [1:22:54<30:40,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.5285264253616333, 'learning_rate': 2.0825847190424096e-06, 'epoch': 2.19}

 73%|███████▎  | 8049/11049 [1:22:54<30:40,  1.63it/s]
 73%|███████▎  | 8050/11049 [1:22:54<30:39,  1.63it/s]
                                                      
{'loss': 0.135, 'grad_norm': 0.5281964540481567, 'learning_rate': 2.081301997142722e-06, 'epoch': 2.19}

 73%|███████▎  | 8050/11049 [1:22:55<30:39,  1.63it/s]
 73%|███████▎  | 8051/11049 [1:22:55<30:38,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.6530108451843262, 'learning_rate': 2.0800195665605965e-06, 'epoch': 2.19}

 73%|███████▎  | 8051/11049 [1:22:55<30:38,  1.63it/s]
 73%|███████▎  | 8052/11049 [1:22:56<30:38,  1.63it/s]
                                                      
{'loss': 0.1841, 'grad_norm': 0.6694579720497131, 'learning_rate': 2.078737427424039e-06, 'epoch': 2.19}

 73%|███████▎  | 8052/11049 [1:22:56<30:38,  1.63it/s]
 73%|███████▎  | 8053/11049 [1:22:56<30:37,  1.63it/s]
                                                      
{'loss': 0.1317, 'grad_norm': 0.49555444717407227, 'learning_rate': 2.0774555798610187e-06, 'epoch': 2.19}

 73%|███████▎  | 8053/11049 [1:22:56<30:37,  1.63it/s]
 73%|███████▎  | 8054/11049 [1:22:57<30:37,  1.63it/s]
                                                      
{'loss': 0.1997, 'grad_norm': 0.6160478591918945, 'learning_rate': 2.0761740239994773e-06, 'epoch': 2.19}

 73%|███████▎  | 8054/11049 [1:22:57<30:37,  1.63it/s]
 73%|███████▎  | 8055/11049 [1:22:58<30:37,  1.63it/s]
                                                      
{'loss': 0.1428, 'grad_norm': 0.49316152930259705, 'learning_rate': 2.074892759967328e-06, 'epoch': 2.19}

 73%|███████▎  | 8055/11049 [1:22:58<30:37,  1.63it/s]
 73%|███████▎  | 8056/11049 [1:22:58<30:36,  1.63it/s]
                                                      
{'loss': 0.1591, 'grad_norm': 0.6023992896080017, 'learning_rate': 2.073611787892455e-06, 'epoch': 2.19}

 73%|███████▎  | 8056/11049 [1:22:58<30:36,  1.63it/s]
 73%|███████▎  | 8057/11049 [1:22:59<30:35,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.5877740979194641, 'learning_rate': 2.072331107902713e-06, 'epoch': 2.19}

 73%|███████▎  | 8057/11049 [1:22:59<30:35,  1.63it/s]
 73%|███████▎  | 8058/11049 [1:22:59<30:34,  1.63it/s]
                                                      
{'loss': 0.2193, 'grad_norm': 0.8565975427627563, 'learning_rate': 2.071050720125928e-06, 'epoch': 2.19}

 73%|███████▎  | 8058/11049 [1:23:00<30:34,  1.63it/s]
 73%|███████▎  | 8059/11049 [1:23:00<30:34,  1.63it/s]
                                                      
{'loss': 0.1493, 'grad_norm': 0.5615714192390442, 'learning_rate': 2.069770624689894e-06, 'epoch': 2.19}

 73%|███████▎  | 8059/11049 [1:23:00<30:34,  1.63it/s]
 73%|███████▎  | 8060/11049 [1:23:01<30:34,  1.63it/s]
                                                      
{'loss': 0.1497, 'grad_norm': 0.5279108881950378, 'learning_rate': 2.0684908217223825e-06, 'epoch': 2.19}

 73%|███████▎  | 8060/11049 [1:23:01<30:34,  1.63it/s]
 73%|███████▎  | 8061/11049 [1:23:01<30:32,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.6772363781929016, 'learning_rate': 2.06721131135113e-06, 'epoch': 2.19}

 73%|███████▎  | 8061/11049 [1:23:01<30:32,  1.63it/s]
 73%|███████▎  | 8062/11049 [1:23:02<30:31,  1.63it/s]
                                                      
{'loss': 0.1649, 'grad_norm': 0.660081148147583, 'learning_rate': 2.0659320937038452e-06, 'epoch': 2.19}

 73%|███████▎  | 8062/11049 [1:23:02<30:31,  1.63it/s]
 73%|███████▎  | 8063/11049 [1:23:02<30:32,  1.63it/s]
                                                      
{'loss': 0.1458, 'grad_norm': 0.6525564789772034, 'learning_rate': 2.0646531689082076e-06, 'epoch': 2.19}

 73%|███████▎  | 8063/11049 [1:23:03<30:32,  1.63it/s]
 73%|███████▎  | 8064/11049 [1:23:03<30:30,  1.63it/s]
                                                      
{'loss': 0.1384, 'grad_norm': 0.5265145897865295, 'learning_rate': 2.063374537091868e-06, 'epoch': 2.19}

 73%|███████▎  | 8064/11049 [1:23:03<30:30,  1.63it/s]
 73%|███████▎  | 8065/11049 [1:23:04<30:30,  1.63it/s]
                                                      
{'loss': 0.1824, 'grad_norm': 0.6183146238327026, 'learning_rate': 2.0620961983824478e-06, 'epoch': 2.19}

 73%|███████▎  | 8065/11049 [1:23:04<30:30,  1.63it/s]
 73%|███████▎  | 8066/11049 [1:23:04<30:29,  1.63it/s]
                                                      
{'loss': 0.1421, 'grad_norm': 0.5657821893692017, 'learning_rate': 2.0608181529075382e-06, 'epoch': 2.19}

 73%|███████▎  | 8066/11049 [1:23:04<30:29,  1.63it/s]
 73%|███████▎  | 8067/11049 [1:23:05<30:28,  1.63it/s]
                                                      
{'loss': 0.1525, 'grad_norm': 0.5509465336799622, 'learning_rate': 2.059540400794701e-06, 'epoch': 2.19}

 73%|███████▎  | 8067/11049 [1:23:05<30:28,  1.63it/s]
 73%|███████▎  | 8068/11049 [1:23:06<30:28,  1.63it/s]
                                                      
{'loss': 0.1412, 'grad_norm': 0.5091978907585144, 'learning_rate': 2.0582629421714732e-06, 'epoch': 2.19}

 73%|███████▎  | 8068/11049 [1:23:06<30:28,  1.63it/s]
 73%|███████▎  | 8069/11049 [1:23:06<30:27,  1.63it/s]
                                                      
{'loss': 0.1829, 'grad_norm': 0.7558910846710205, 'learning_rate': 2.0569857771653573e-06, 'epoch': 2.19}

 73%|███████▎  | 8069/11049 [1:23:06<30:27,  1.63it/s]
 73%|███████▎  | 8070/11049 [1:23:07<30:26,  1.63it/s]
                                                      
{'loss': 0.1284, 'grad_norm': 0.48926299810409546, 'learning_rate': 2.055708905903827e-06, 'epoch': 2.19}

 73%|███████▎  | 8070/11049 [1:23:07<30:26,  1.63it/s]
 73%|███████▎  | 8071/11049 [1:23:07<30:25,  1.63it/s]
                                                      
{'loss': 0.153, 'grad_norm': 0.6676756739616394, 'learning_rate': 2.054432328514327e-06, 'epoch': 2.19}

 73%|███████▎  | 8071/11049 [1:23:07<30:25,  1.63it/s]
 73%|███████▎  | 8072/11049 [1:23:08<30:25,  1.63it/s]
                                                      
{'loss': 0.187, 'grad_norm': 0.696003258228302, 'learning_rate': 2.053156045124279e-06, 'epoch': 2.19}

 73%|███████▎  | 8072/11049 [1:23:08<30:25,  1.63it/s]
 73%|███████▎  | 8073/11049 [1:23:09<30:24,  1.63it/s]
                                                      
{'loss': 0.1526, 'grad_norm': 0.5902754664421082, 'learning_rate': 2.051880055861064e-06, 'epoch': 2.19}

 73%|███████▎  | 8073/11049 [1:23:09<30:24,  1.63it/s]
 73%|███████▎  | 8074/11049 [1:23:09<30:23,  1.63it/s]
                                                      
{'loss': 0.1628, 'grad_norm': 0.5942661762237549, 'learning_rate': 2.0506043608520415e-06, 'epoch': 2.19}

 73%|███████▎  | 8074/11049 [1:23:09<30:23,  1.63it/s]
 73%|███████▎  | 8075/11049 [1:23:10<30:23,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.6398152709007263, 'learning_rate': 2.0493289602245375e-06, 'epoch': 2.19}

 73%|███████▎  | 8075/11049 [1:23:10<30:23,  1.63it/s]
 73%|███████▎  | 8076/11049 [1:23:10<30:23,  1.63it/s]
                                                      
{'loss': 0.1645, 'grad_norm': 0.6258156299591064, 'learning_rate': 2.0480538541058554e-06, 'epoch': 2.19}

 73%|███████▎  | 8076/11049 [1:23:11<30:23,  1.63it/s]
 73%|███████▎  | 8077/11049 [1:23:11<30:23,  1.63it/s]
                                                      
{'loss': 0.1549, 'grad_norm': 0.5556119680404663, 'learning_rate': 2.0467790426232613e-06, 'epoch': 2.19}

 73%|███████▎  | 8077/11049 [1:23:11<30:23,  1.63it/s]
 73%|███████▎  | 8078/11049 [1:23:12<30:22,  1.63it/s]
                                                      
{'loss': 0.1802, 'grad_norm': 0.6491108536720276, 'learning_rate': 2.0455045259039963e-06, 'epoch': 2.19}

 73%|███████▎  | 8078/11049 [1:23:12<30:22,  1.63it/s]
 73%|███████▎  | 8079/11049 [1:23:12<30:20,  1.63it/s]
                                                      
{'loss': 0.1697, 'grad_norm': 0.910560667514801, 'learning_rate': 2.0442303040752687e-06, 'epoch': 2.19}

 73%|███████▎  | 8079/11049 [1:23:12<30:20,  1.63it/s]
 73%|███████▎  | 8080/11049 [1:23:13<30:19,  1.63it/s]
                                                      
{'loss': 0.1417, 'grad_norm': 0.5779915452003479, 'learning_rate': 2.042956377264263e-06, 'epoch': 2.19}

 73%|███████▎  | 8080/11049 [1:23:13<30:19,  1.63it/s]
 73%|███████▎  | 8081/11049 [1:23:13<30:19,  1.63it/s]
                                                      
{'loss': 0.178, 'grad_norm': 0.6091133952140808, 'learning_rate': 2.041682745598129e-06, 'epoch': 2.19}

 73%|███████▎  | 8081/11049 [1:23:14<30:19,  1.63it/s]
 73%|███████▎  | 8082/11049 [1:23:14<30:18,  1.63it/s]
                                                      
{'loss': 0.1566, 'grad_norm': 0.6267666220664978, 'learning_rate': 2.040409409203991e-06, 'epoch': 2.19}

 73%|███████▎  | 8082/11049 [1:23:14<30:18,  1.63it/s]
 73%|███████▎  | 8083/11049 [1:23:15<30:17,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.5324845910072327, 'learning_rate': 2.0391363682089367e-06, 'epoch': 2.19}

 73%|███████▎  | 8083/11049 [1:23:15<30:17,  1.63it/s]
 73%|███████▎  | 8084/11049 [1:23:15<30:17,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.5777976512908936, 'learning_rate': 2.037863622740034e-06, 'epoch': 2.19}

 73%|███████▎  | 8084/11049 [1:23:15<30:17,  1.63it/s]
 73%|███████▎  | 8085/11049 [1:23:16<30:17,  1.63it/s]
                                                      
{'loss': 0.1516, 'grad_norm': 0.5736372470855713, 'learning_rate': 2.036591172924315e-06, 'epoch': 2.2}

 73%|███████▎  | 8085/11049 [1:23:16<30:17,  1.63it/s]
 73%|███████▎  | 8086/11049 [1:23:17<30:16,  1.63it/s]
                                                      
{'loss': 0.1333, 'grad_norm': 0.55618816614151, 'learning_rate': 2.035319018888784e-06, 'epoch': 2.2}

 73%|███████▎  | 8086/11049 [1:23:17<30:16,  1.63it/s]
 73%|███████▎  | 8087/11049 [1:23:17<30:16,  1.63it/s]
                                                      
{'loss': 0.1456, 'grad_norm': 0.539520263671875, 'learning_rate': 2.034047160760414e-06, 'epoch': 2.2}

 73%|███████▎  | 8087/11049 [1:23:17<30:16,  1.63it/s]
 73%|███████▎  | 8088/11049 [1:23:18<30:16,  1.63it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.5583325028419495, 'learning_rate': 2.0327755986661533e-06, 'epoch': 2.2}

 73%|███████▎  | 8088/11049 [1:23:18<30:16,  1.63it/s]
 73%|███████▎  | 8089/11049 [1:23:18<30:16,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.5770419836044312, 'learning_rate': 2.0315043327329164e-06, 'epoch': 2.2}

 73%|███████▎  | 8089/11049 [1:23:19<30:16,  1.63it/s]
 73%|███████▎  | 8090/11049 [1:23:19<30:15,  1.63it/s]
                                                      
{'loss': 0.1817, 'grad_norm': 0.6593049168586731, 'learning_rate': 2.0302333630875896e-06, 'epoch': 2.2}

 73%|███████▎  | 8090/11049 [1:23:19<30:15,  1.63it/s]
 73%|███████▎  | 8091/11049 [1:23:20<30:14,  1.63it/s]
                                                      
{'loss': 0.1629, 'grad_norm': 0.5946105122566223, 'learning_rate': 2.0289626898570284e-06, 'epoch': 2.2}

 73%|███████▎  | 8091/11049 [1:23:20<30:14,  1.63it/s]
 73%|███████▎  | 8092/11049 [1:23:20<30:12,  1.63it/s]
                                                      
{'loss': 0.1524, 'grad_norm': 0.5679699778556824, 'learning_rate': 2.0276923131680603e-06, 'epoch': 2.2}

 73%|███████▎  | 8092/11049 [1:23:20<30:12,  1.63it/s]
 73%|███████▎  | 8093/11049 [1:23:21<30:12,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.7643866539001465, 'learning_rate': 2.0264222331474827e-06, 'epoch': 2.2}

 73%|███████▎  | 8093/11049 [1:23:21<30:12,  1.63it/s]
 73%|███████▎  | 8094/11049 [1:23:21<30:11,  1.63it/s]
                                                      
{'loss': 0.1203, 'grad_norm': 0.5076889991760254, 'learning_rate': 2.0251524499220626e-06, 'epoch': 2.2}

 73%|███████▎  | 8094/11049 [1:23:22<30:11,  1.63it/s]
 73%|███████▎  | 8095/11049 [1:23:22<30:10,  1.63it/s]
                                                      
{'loss': 0.1659, 'grad_norm': 0.6569969654083252, 'learning_rate': 2.023882963618537e-06, 'epoch': 2.2}

 73%|███████▎  | 8095/11049 [1:23:22<30:10,  1.63it/s]
 73%|███████▎  | 8096/11049 [1:23:23<30:10,  1.63it/s]
                                                      
{'loss': 0.1519, 'grad_norm': 0.6572198867797852, 'learning_rate': 2.022613774363618e-06, 'epoch': 2.2}

 73%|███████▎  | 8096/11049 [1:23:23<30:10,  1.63it/s]
 73%|███████▎  | 8097/11049 [1:23:23<30:09,  1.63it/s]
                                                      
{'loss': 0.1682, 'grad_norm': 0.6555247902870178, 'learning_rate': 2.0213448822839813e-06, 'epoch': 2.2}

 73%|███████▎  | 8097/11049 [1:23:23<30:09,  1.63it/s]
 73%|███████▎  | 8098/11049 [1:23:24<30:11,  1.63it/s]
                                                      
{'loss': 0.1614, 'grad_norm': 0.5762152671813965, 'learning_rate': 2.020076287506278e-06, 'epoch': 2.2}

 73%|███████▎  | 8098/11049 [1:23:24<30:11,  1.63it/s]
 73%|███████▎  | 8099/11049 [1:23:25<30:10,  1.63it/s]
                                                      
{'loss': 0.1485, 'grad_norm': 0.5528976321220398, 'learning_rate': 2.0188079901571263e-06, 'epoch': 2.2}

 73%|███████▎  | 8099/11049 [1:23:25<30:10,  1.63it/s]
 73%|███████▎  | 8100/11049 [1:23:25<30:09,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.6758781671524048, 'learning_rate': 2.017539990363116e-06, 'epoch': 2.2}

 73%|███████▎  | 8100/11049 [1:23:25<30:09,  1.63it/s]
 73%|███████▎  | 8101/11049 [1:23:26<30:08,  1.63it/s]
                                                      
{'loss': 0.1324, 'grad_norm': 0.5131196975708008, 'learning_rate': 2.0162722882508072e-06, 'epoch': 2.2}

 73%|███████▎  | 8101/11049 [1:23:26<30:08,  1.63it/s]
 73%|███████▎  | 8102/11049 [1:23:26<30:07,  1.63it/s]
                                                      
{'loss': 0.1461, 'grad_norm': 0.5295078158378601, 'learning_rate': 2.0150048839467306e-06, 'epoch': 2.2}

 73%|███████▎  | 8102/11049 [1:23:26<30:07,  1.63it/s]
 73%|███████▎  | 8103/11049 [1:23:27<30:06,  1.63it/s]
                                                      
{'loss': 0.1739, 'grad_norm': 0.514613151550293, 'learning_rate': 2.013737777577385e-06, 'epoch': 2.2}

 73%|███████▎  | 8103/11049 [1:23:27<30:06,  1.63it/s]
 73%|███████▎  | 8104/11049 [1:23:28<30:05,  1.63it/s]
                                                      
{'loss': 0.1561, 'grad_norm': 0.5827269554138184, 'learning_rate': 2.012470969269245e-06, 'epoch': 2.2}

 73%|███████▎  | 8104/11049 [1:23:28<30:05,  1.63it/s]
 73%|███████▎  | 8105/11049 [1:23:28<30:04,  1.63it/s]
                                                      
{'loss': 0.1647, 'grad_norm': 0.6271840333938599, 'learning_rate': 2.0112044591487497e-06, 'epoch': 2.2}

 73%|███████▎  | 8105/11049 [1:23:28<30:04,  1.63it/s]
 73%|███████▎  | 8106/11049 [1:23:29<30:04,  1.63it/s]
                                                      
{'loss': 0.1322, 'grad_norm': 0.5274651646614075, 'learning_rate': 2.00993824734231e-06, 'epoch': 2.2}

 73%|███████▎  | 8106/11049 [1:23:29<30:04,  1.63it/s]
 73%|███████▎  | 8107/11049 [1:23:29<30:04,  1.63it/s]
                                                      
{'loss': 0.1603, 'grad_norm': 0.6563460826873779, 'learning_rate': 2.0086723339763065e-06, 'epoch': 2.2}

 73%|███████▎  | 8107/11049 [1:23:30<30:04,  1.63it/s]
 73%|███████▎  | 8108/11049 [1:23:30<30:05,  1.63it/s]
                                                      
{'loss': 0.1438, 'grad_norm': 0.5549548864364624, 'learning_rate': 2.007406719177096e-06, 'epoch': 2.2}

 73%|███████▎  | 8108/11049 [1:23:30<30:05,  1.63it/s]
 73%|███████▎  | 8109/11049 [1:23:31<30:03,  1.63it/s]
                                                      
{'loss': 0.175, 'grad_norm': 0.5913416743278503, 'learning_rate': 2.0061414030709954e-06, 'epoch': 2.2}

 73%|███████▎  | 8109/11049 [1:23:31<30:03,  1.63it/s]
 73%|███████▎  | 8110/11049 [1:23:31<30:02,  1.63it/s]
                                                      
{'loss': 0.1191, 'grad_norm': 0.5397011041641235, 'learning_rate': 2.0048763857842986e-06, 'epoch': 2.2}

 73%|███████▎  | 8110/11049 [1:23:31<30:02,  1.63it/s]
 73%|███████▎  | 8111/11049 [1:23:32<30:01,  1.63it/s]
                                                      
{'loss': 0.1529, 'grad_norm': 0.588288426399231, 'learning_rate': 2.0036116674432653e-06, 'epoch': 2.2}

 73%|███████▎  | 8111/11049 [1:23:32<30:01,  1.63it/s]
 73%|███████▎  | 8112/11049 [1:23:32<30:02,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.6427394151687622, 'learning_rate': 2.0023472481741336e-06, 'epoch': 2.2}

 73%|███████▎  | 8112/11049 [1:23:33<30:02,  1.63it/s]
 73%|███████▎  | 8113/11049 [1:23:33<30:00,  1.63it/s]
                                                      
{'loss': 0.1408, 'grad_norm': 0.5803186297416687, 'learning_rate': 2.0010831281031025e-06, 'epoch': 2.2}

 73%|███████▎  | 8113/11049 [1:23:33<30:00,  1.63it/s]
 73%|███████▎  | 8114/11049 [1:23:34<29:59,  1.63it/s]
                                                      
{'loss': 0.1582, 'grad_norm': 0.6368802189826965, 'learning_rate': 1.9998193073563456e-06, 'epoch': 2.2}

 73%|███████▎  | 8114/11049 [1:23:34<29:59,  1.63it/s]
 73%|███████▎  | 8115/11049 [1:23:34<29:58,  1.63it/s]
                                                      
{'loss': 0.1548, 'grad_norm': 0.5931949019432068, 'learning_rate': 1.998555786060004e-06, 'epoch': 2.2}

 73%|███████▎  | 8115/11049 [1:23:34<29:58,  1.63it/s]
 73%|███████▎  | 8116/11049 [1:23:35<29:59,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.5878920555114746, 'learning_rate': 1.9972925643401947e-06, 'epoch': 2.2}

 73%|███████▎  | 8116/11049 [1:23:35<29:59,  1.63it/s]
 73%|███████▎  | 8117/11049 [1:23:36<29:59,  1.63it/s]
                                                      
{'loss': 0.1049, 'grad_norm': 0.45792779326438904, 'learning_rate': 1.9960296423229993e-06, 'epoch': 2.2}

 73%|███████▎  | 8117/11049 [1:23:36<29:59,  1.63it/s]
 73%|███████▎  | 8118/11049 [1:23:36<29:57,  1.63it/s]
                                                      
{'loss': 0.1081, 'grad_norm': 0.4487917423248291, 'learning_rate': 1.994767020134471e-06, 'epoch': 2.2}

 73%|███████▎  | 8118/11049 [1:23:36<29:57,  1.63it/s]
 73%|███████▎  | 8119/11049 [1:23:37<29:57,  1.63it/s]
                                                      
{'loss': 0.1328, 'grad_norm': 0.5235443711280823, 'learning_rate': 1.99350469790063e-06, 'epoch': 2.2}

 73%|███████▎  | 8119/11049 [1:23:37<29:57,  1.63it/s]
 73%|███████▎  | 8120/11049 [1:23:37<29:55,  1.63it/s]
                                                      
{'loss': 0.1632, 'grad_norm': 0.6193910837173462, 'learning_rate': 1.992242675747474e-06, 'epoch': 2.2}

 73%|███████▎  | 8120/11049 [1:23:38<29:55,  1.63it/s]
 73%|███████▎  | 8121/11049 [1:23:38<29:55,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.6547002196311951, 'learning_rate': 1.9909809538009644e-06, 'epoch': 2.2}

 73%|███████▎  | 8121/11049 [1:23:38<29:55,  1.63it/s]
 74%|███████▎  | 8122/11049 [1:23:39<29:54,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.6660476326942444, 'learning_rate': 1.989719532187035e-06, 'epoch': 2.21}

 74%|███████▎  | 8122/11049 [1:23:39<29:54,  1.63it/s]
 74%|███████▎  | 8123/11049 [1:23:39<29:54,  1.63it/s]
                                                      
{'loss': 0.1198, 'grad_norm': 0.4939056634902954, 'learning_rate': 1.9884584110315872e-06, 'epoch': 2.21}

 74%|███████▎  | 8123/11049 [1:23:39<29:54,  1.63it/s]
 74%|███████▎  | 8124/11049 [1:23:40<29:53,  1.63it/s]
                                                      
{'loss': 0.1187, 'grad_norm': 0.503097414970398, 'learning_rate': 1.9871975904604994e-06, 'epoch': 2.21}

 74%|███████▎  | 8124/11049 [1:23:40<29:53,  1.63it/s]
 74%|███████▎  | 8125/11049 [1:23:40<29:52,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.5923445820808411, 'learning_rate': 1.9859370705996116e-06, 'epoch': 2.21}

 74%|███████▎  | 8125/11049 [1:23:41<29:52,  1.63it/s]
 74%|███████▎  | 8126/11049 [1:23:41<29:52,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.5707494020462036, 'learning_rate': 1.9846768515747383e-06, 'epoch': 2.21}

 74%|███████▎  | 8126/11049 [1:23:41<29:52,  1.63it/s]
 74%|███████▎  | 8127/11049 [1:23:42<29:52,  1.63it/s]
                                                      
{'loss': 0.144, 'grad_norm': 0.5581793785095215, 'learning_rate': 1.983416933511663e-06, 'epoch': 2.21}

 74%|███████▎  | 8127/11049 [1:23:42<29:52,  1.63it/s]
 74%|███████▎  | 8128/11049 [1:23:42<29:51,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.6227990984916687, 'learning_rate': 1.982157316536138e-06, 'epoch': 2.21}

 74%|███████▎  | 8128/11049 [1:23:42<29:51,  1.63it/s]
 74%|███████▎  | 8129/11049 [1:23:43<29:50,  1.63it/s]
                                                      
{'loss': 0.167, 'grad_norm': 0.6831494569778442, 'learning_rate': 1.9808980007738877e-06, 'epoch': 2.21}

 74%|███████▎  | 8129/11049 [1:23:43<29:50,  1.63it/s]
 74%|███████▎  | 8130/11049 [1:23:44<29:49,  1.63it/s]
                                                      
{'loss': 0.1504, 'grad_norm': 0.6429036259651184, 'learning_rate': 1.979638986350605e-06, 'epoch': 2.21}

 74%|███████▎  | 8130/11049 [1:23:44<29:49,  1.63it/s]
 74%|███████▎  | 8131/11049 [1:23:44<29:49,  1.63it/s]
                                                      
{'loss': 0.1491, 'grad_norm': 0.5554088950157166, 'learning_rate': 1.9783802733919517e-06, 'epoch': 2.21}

 74%|███████▎  | 8131/11049 [1:23:44<29:49,  1.63it/s]
 74%|███████▎  | 8132/11049 [1:23:45<29:48,  1.63it/s]
                                                      
{'loss': 0.121, 'grad_norm': 0.5117802619934082, 'learning_rate': 1.9771218620235644e-06, 'epoch': 2.21}

 74%|███████▎  | 8132/11049 [1:23:45<29:48,  1.63it/s]
 74%|███████▎  | 8133/11049 [1:23:45<29:47,  1.63it/s]
                                                      
{'loss': 0.1707, 'grad_norm': 0.566317081451416, 'learning_rate': 1.9758637523710443e-06, 'epoch': 2.21}

 74%|███████▎  | 8133/11049 [1:23:46<29:47,  1.63it/s]
 74%|███████▎  | 8134/11049 [1:23:46<29:46,  1.63it/s]
                                                      
{'loss': 0.1886, 'grad_norm': 0.6212159395217896, 'learning_rate': 1.9746059445599642e-06, 'epoch': 2.21}

 74%|███████▎  | 8134/11049 [1:23:46<29:46,  1.63it/s]
 74%|███████▎  | 8135/11049 [1:23:47<29:46,  1.63it/s]
                                                      
{'loss': 0.1253, 'grad_norm': 0.46670007705688477, 'learning_rate': 1.973348438715867e-06, 'epoch': 2.21}

 74%|███████▎  | 8135/11049 [1:23:47<29:46,  1.63it/s]
 74%|███████▎  | 8136/11049 [1:23:47<29:46,  1.63it/s]
                                                      
{'loss': 0.1686, 'grad_norm': 0.5594848990440369, 'learning_rate': 1.972091234964265e-06, 'epoch': 2.21}

 74%|███████▎  | 8136/11049 [1:23:47<29:46,  1.63it/s]
 74%|███████▎  | 8137/11049 [1:23:48<29:45,  1.63it/s]
                                                      
{'loss': 0.1743, 'grad_norm': 0.659917414188385, 'learning_rate': 1.970834333430642e-06, 'epoch': 2.21}

 74%|███████▎  | 8137/11049 [1:23:48<29:45,  1.63it/s]
 74%|███████▎  | 8138/11049 [1:23:48<29:44,  1.63it/s]
                                                      
{'loss': 0.1887, 'grad_norm': 0.7569659352302551, 'learning_rate': 1.969577734240448e-06, 'epoch': 2.21}

 74%|███████▎  | 8138/11049 [1:23:49<29:44,  1.63it/s]
 74%|███████▎  | 8139/11049 [1:23:49<29:44,  1.63it/s]
                                                      
{'loss': 0.1387, 'grad_norm': 0.5135681629180908, 'learning_rate': 1.968321437519106e-06, 'epoch': 2.21}

 74%|███████▎  | 8139/11049 [1:23:49<29:44,  1.63it/s]
 74%|███████▎  | 8140/11049 [1:23:50<29:46,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.6428292393684387, 'learning_rate': 1.96706544339201e-06, 'epoch': 2.21}

 74%|███████▎  | 8140/11049 [1:23:50<29:46,  1.63it/s]
 74%|███████▎  | 8141/11049 [1:23:50<29:44,  1.63it/s]
                                                      
{'loss': 0.1852, 'grad_norm': 0.6192373633384705, 'learning_rate': 1.9658097519845197e-06, 'epoch': 2.21}

 74%|███████▎  | 8141/11049 [1:23:50<29:44,  1.63it/s]
 74%|███████▎  | 8142/11049 [1:23:51<29:44,  1.63it/s]
                                                      
{'loss': 0.1498, 'grad_norm': 0.6217491030693054, 'learning_rate': 1.9645543634219676e-06, 'epoch': 2.21}

 74%|███████▎  | 8142/11049 [1:23:51<29:44,  1.63it/s]
 74%|███████▎  | 8143/11049 [1:23:52<29:42,  1.63it/s]
                                                      
{'loss': 0.18, 'grad_norm': 0.6751193404197693, 'learning_rate': 1.9632992778296532e-06, 'epoch': 2.21}

 74%|███████▎  | 8143/11049 [1:23:52<29:42,  1.63it/s]
 74%|███████▎  | 8144/11049 [1:23:52<29:41,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.5831214785575867, 'learning_rate': 1.9620444953328528e-06, 'epoch': 2.21}

 74%|███████▎  | 8144/11049 [1:23:52<29:41,  1.63it/s]
 74%|███████▎  | 8145/11049 [1:23:53<29:40,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.5688906311988831, 'learning_rate': 1.960790016056801e-06, 'epoch': 2.21}

 74%|███████▎  | 8145/11049 [1:23:53<29:40,  1.63it/s]
 74%|███████▎  | 8146/11049 [1:23:53<29:40,  1.63it/s]
                                                      
{'loss': 0.1501, 'grad_norm': 0.5774426460266113, 'learning_rate': 1.959535840126711e-06, 'epoch': 2.21}

 74%|███████▎  | 8146/11049 [1:23:53<29:40,  1.63it/s]
 74%|███████▎  | 8147/11049 [1:23:54<29:39,  1.63it/s]
                                                      
{'loss': 0.1638, 'grad_norm': 0.5667875409126282, 'learning_rate': 1.9582819676677617e-06, 'epoch': 2.21}

 74%|███████▎  | 8147/11049 [1:23:54<29:39,  1.63it/s]
 74%|███████▎  | 8148/11049 [1:23:55<29:38,  1.63it/s]
                                                      
{'loss': 0.1134, 'grad_norm': 0.5428034663200378, 'learning_rate': 1.957028398805106e-06, 'epoch': 2.21}

 74%|███████▎  | 8148/11049 [1:23:55<29:38,  1.63it/s]
 74%|███████▍  | 8149/11049 [1:23:55<29:37,  1.63it/s]
                                                      
{'loss': 0.2172, 'grad_norm': 0.7373502254486084, 'learning_rate': 1.9557751336638615e-06, 'epoch': 2.21}

 74%|███████▍  | 8149/11049 [1:23:55<29:37,  1.63it/s]
 74%|███████▍  | 8150/11049 [1:23:56<29:37,  1.63it/s]
                                                      
{'loss': 0.1638, 'grad_norm': 0.7114164233207703, 'learning_rate': 1.954522172369119e-06, 'epoch': 2.21}

 74%|███████▍  | 8150/11049 [1:23:56<29:37,  1.63it/s]
 74%|███████▍  | 8151/11049 [1:23:56<29:37,  1.63it/s]
                                                      
{'loss': 0.2019, 'grad_norm': 0.7086969017982483, 'learning_rate': 1.9532695150459342e-06, 'epoch': 2.21}

 74%|███████▍  | 8151/11049 [1:23:57<29:37,  1.63it/s]
 74%|███████▍  | 8152/11049 [1:23:57<29:37,  1.63it/s]
                                                      
{'loss': 0.1127, 'grad_norm': 0.4423238933086395, 'learning_rate': 1.9520171618193396e-06, 'epoch': 2.21}

 74%|███████▍  | 8152/11049 [1:23:57<29:37,  1.63it/s]
 74%|███████▍  | 8153/11049 [1:23:58<29:36,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.597273588180542, 'learning_rate': 1.950765112814333e-06, 'epoch': 2.21}

 74%|███████▍  | 8153/11049 [1:23:58<29:36,  1.63it/s]
 74%|███████▍  | 8154/11049 [1:23:58<29:36,  1.63it/s]
                                                      
{'loss': 0.1683, 'grad_norm': 0.6211732625961304, 'learning_rate': 1.9495133681558832e-06, 'epoch': 2.21}

 74%|███████▍  | 8154/11049 [1:23:58<29:36,  1.63it/s]
 74%|███████▍  | 8155/11049 [1:23:59<29:36,  1.63it/s]
                                                      
{'loss': 0.15, 'grad_norm': 0.5485698580741882, 'learning_rate': 1.9482619279689224e-06, 'epoch': 2.21}

 74%|███████▍  | 8155/11049 [1:23:59<29:36,  1.63it/s]
 74%|███████▍  | 8156/11049 [1:23:59<29:35,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.7213507890701294, 'learning_rate': 1.9470107923783636e-06, 'epoch': 2.21}

 74%|███████▍  | 8156/11049 [1:24:00<29:35,  1.63it/s]
 74%|███████▍  | 8157/11049 [1:24:00<29:34,  1.63it/s]
                                                      
{'loss': 0.1167, 'grad_norm': 0.44719791412353516, 'learning_rate': 1.945759961509082e-06, 'epoch': 2.21}

 74%|███████▍  | 8157/11049 [1:24:00<29:34,  1.63it/s]
 74%|███████▍  | 8158/11049 [1:24:01<29:34,  1.63it/s]
                                                      
{'loss': 0.1566, 'grad_norm': 0.5475476980209351, 'learning_rate': 1.944509435485924e-06, 'epoch': 2.22}

 74%|███████▍  | 8158/11049 [1:24:01<29:34,  1.63it/s]
 74%|███████▍  | 8159/11049 [1:24:01<29:33,  1.63it/s]
                                                      
{'loss': 0.1346, 'grad_norm': 0.5637704730033875, 'learning_rate': 1.943259214433703e-06, 'epoch': 2.22}

 74%|███████▍  | 8159/11049 [1:24:01<29:33,  1.63it/s]
 74%|███████▍  | 8160/11049 [1:24:02<29:32,  1.63it/s]
                                                      
{'loss': 0.1599, 'grad_norm': 0.6248021125793457, 'learning_rate': 1.942009298477209e-06, 'epoch': 2.22}

 74%|███████▍  | 8160/11049 [1:24:02<29:32,  1.63it/s]
 74%|███████▍  | 8161/11049 [1:24:03<29:32,  1.63it/s]
                                                      
{'loss': 0.1284, 'grad_norm': 0.5006789565086365, 'learning_rate': 1.940759687741195e-06, 'epoch': 2.22}

 74%|███████▍  | 8161/11049 [1:24:03<29:32,  1.63it/s]
 74%|███████▍  | 8162/11049 [1:24:03<29:31,  1.63it/s]
                                                      
{'loss': 0.1619, 'grad_norm': 0.6677216291427612, 'learning_rate': 1.9395103823503853e-06, 'epoch': 2.22}

 74%|███████▍  | 8162/11049 [1:24:03<29:31,  1.63it/s]
 74%|███████▍  | 8163/11049 [1:24:04<29:30,  1.63it/s]
                                                      
{'loss': 0.1759, 'grad_norm': 0.6707497239112854, 'learning_rate': 1.938261382429475e-06, 'epoch': 2.22}

 74%|███████▍  | 8163/11049 [1:24:04<29:30,  1.63it/s]
 74%|███████▍  | 8164/11049 [1:24:04<29:29,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 1.9891682863235474, 'learning_rate': 1.9370126881031272e-06, 'epoch': 2.22}

 74%|███████▍  | 8164/11049 [1:24:05<29:29,  1.63it/s]
 74%|███████▍  | 8165/11049 [1:24:05<29:29,  1.63it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.5947622060775757, 'learning_rate': 1.935764299495974e-06, 'epoch': 2.22}

 74%|███████▍  | 8165/11049 [1:24:05<29:29,  1.63it/s]
 74%|███████▍  | 8166/11049 [1:24:06<29:28,  1.63it/s]
                                                      
{'loss': 0.1422, 'grad_norm': 0.5229673981666565, 'learning_rate': 1.93451621673262e-06, 'epoch': 2.22}

 74%|███████▍  | 8166/11049 [1:24:06<29:28,  1.63it/s]
 74%|███████▍  | 8167/11049 [1:24:06<29:28,  1.63it/s]
                                                      
{'loss': 0.1351, 'grad_norm': 0.7993563413619995, 'learning_rate': 1.9332684399376343e-06, 'epoch': 2.22}

 74%|███████▍  | 8167/11049 [1:24:06<29:28,  1.63it/s]
 74%|███████▍  | 8168/11049 [1:24:07<29:27,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.5404824018478394, 'learning_rate': 1.932020969235563e-06, 'epoch': 2.22}

 74%|███████▍  | 8168/11049 [1:24:07<29:27,  1.63it/s]
 74%|███████▍  | 8169/11049 [1:24:07<29:26,  1.63it/s]
                                                      
{'loss': 0.1145, 'grad_norm': 0.5105567574501038, 'learning_rate': 1.9307738047509147e-06, 'epoch': 2.22}

 74%|███████▍  | 8169/11049 [1:24:08<29:26,  1.63it/s]
 74%|███████▍  | 8170/11049 [1:24:08<29:25,  1.63it/s]
                                                      
{'loss': 0.1457, 'grad_norm': 0.5710360407829285, 'learning_rate': 1.9295269466081697e-06, 'epoch': 2.22}

 74%|███████▍  | 8170/11049 [1:24:08<29:25,  1.63it/s]
 74%|███████▍  | 8171/11049 [1:24:09<29:25,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.6279288530349731, 'learning_rate': 1.928280394931778e-06, 'epoch': 2.22}

 74%|███████▍  | 8171/11049 [1:24:09<29:25,  1.63it/s]
 74%|███████▍  | 8172/11049 [1:24:09<29:23,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.6142191886901855, 'learning_rate': 1.9270341498461593e-06, 'epoch': 2.22}

 74%|███████▍  | 8172/11049 [1:24:09<29:23,  1.63it/s]
 74%|███████▍  | 8173/11049 [1:24:10<29:23,  1.63it/s]
                                                      
{'loss': 0.1767, 'grad_norm': 0.6012387871742249, 'learning_rate': 1.925788211475702e-06, 'epoch': 2.22}

 74%|███████▍  | 8173/11049 [1:24:10<29:23,  1.63it/s]
 74%|███████▍  | 8174/11049 [1:24:11<29:23,  1.63it/s]
                                                      
{'loss': 0.1188, 'grad_norm': 0.47111907601356506, 'learning_rate': 1.9245425799447644e-06, 'epoch': 2.22}

 74%|███████▍  | 8174/11049 [1:24:11<29:23,  1.63it/s]
 74%|███████▍  | 8175/11049 [1:24:11<29:21,  1.63it/s]
                                                      
{'loss': 0.1729, 'grad_norm': 0.6375965476036072, 'learning_rate': 1.923297255377672e-06, 'epoch': 2.22}

 74%|███████▍  | 8175/11049 [1:24:11<29:21,  1.63it/s]
 74%|███████▍  | 8176/11049 [1:24:12<29:21,  1.63it/s]
                                                      
{'loss': 0.1804, 'grad_norm': 0.641364574432373, 'learning_rate': 1.9220522378987257e-06, 'epoch': 2.22}

 74%|███████▍  | 8176/11049 [1:24:12<29:21,  1.63it/s]
 74%|███████▍  | 8177/11049 [1:24:12<29:20,  1.63it/s]
                                                      
{'loss': 0.1704, 'grad_norm': 0.7038643956184387, 'learning_rate': 1.9208075276321887e-06, 'epoch': 2.22}

 74%|███████▍  | 8177/11049 [1:24:12<29:20,  1.63it/s]
 74%|███████▍  | 8178/11049 [1:24:13<29:19,  1.63it/s]
                                                      
{'loss': 0.1181, 'grad_norm': 0.5760676264762878, 'learning_rate': 1.9195631247022977e-06, 'epoch': 2.22}

 74%|███████▍  | 8178/11049 [1:24:13<29:19,  1.63it/s]
 74%|███████▍  | 8179/11049 [1:24:14<29:18,  1.63it/s]
                                                      
{'loss': 0.1548, 'grad_norm': 0.5373862385749817, 'learning_rate': 1.9183190292332553e-06, 'epoch': 2.22}

 74%|███████▍  | 8179/11049 [1:24:14<29:18,  1.63it/s]
 74%|███████▍  | 8180/11049 [1:24:14<29:18,  1.63it/s]
                                                      
{'loss': 0.1554, 'grad_norm': 0.5439378619194031, 'learning_rate': 1.917075241349241e-06, 'epoch': 2.22}

 74%|███████▍  | 8180/11049 [1:24:14<29:18,  1.63it/s]
 74%|███████▍  | 8181/11049 [1:24:15<29:17,  1.63it/s]
                                                      
{'loss': 0.1562, 'grad_norm': 0.5894949436187744, 'learning_rate': 1.9158317611743933e-06, 'epoch': 2.22}

 74%|███████▍  | 8181/11049 [1:24:15<29:17,  1.63it/s]
 74%|███████▍  | 8182/11049 [1:24:15<29:18,  1.63it/s]
                                                      
{'loss': 0.1418, 'grad_norm': 0.5972732901573181, 'learning_rate': 1.914588588832826e-06, 'epoch': 2.22}

 74%|███████▍  | 8182/11049 [1:24:16<29:18,  1.63it/s]
 74%|███████▍  | 8183/11049 [1:24:16<29:18,  1.63it/s]
                                                      
{'loss': 0.1502, 'grad_norm': 0.6361228823661804, 'learning_rate': 1.91334572444862e-06, 'epoch': 2.22}

 74%|███████▍  | 8183/11049 [1:24:16<29:18,  1.63it/s]
 74%|███████▍  | 8184/11049 [1:24:17<29:17,  1.63it/s]
                                                      
{'loss': 0.1442, 'grad_norm': 0.5484448671340942, 'learning_rate': 1.9121031681458298e-06, 'epoch': 2.22}

 74%|███████▍  | 8184/11049 [1:24:17<29:17,  1.63it/s]
 74%|███████▍  | 8185/11049 [1:24:17<29:16,  1.63it/s]
                                                      
{'loss': 0.1362, 'grad_norm': 0.5550402998924255, 'learning_rate': 1.910860920048474e-06, 'epoch': 2.22}

 74%|███████▍  | 8185/11049 [1:24:17<29:16,  1.63it/s]
 74%|███████▍  | 8186/11049 [1:24:18<29:15,  1.63it/s]
                                                      
{'loss': 0.1285, 'grad_norm': 0.45648378133773804, 'learning_rate': 1.9096189802805425e-06, 'epoch': 2.22}

 74%|███████▍  | 8186/11049 [1:24:18<29:15,  1.63it/s]
 74%|███████▍  | 8187/11049 [1:24:18<29:15,  1.63it/s]
                                                      
{'loss': 0.1635, 'grad_norm': 0.689866304397583, 'learning_rate': 1.908377348965993e-06, 'epoch': 2.22}

 74%|███████▍  | 8187/11049 [1:24:19<29:15,  1.63it/s]
 74%|███████▍  | 8188/11049 [1:24:19<29:13,  1.63it/s]
                                                      
{'loss': 0.1958, 'grad_norm': 0.629508376121521, 'learning_rate': 1.9071360262287569e-06, 'epoch': 2.22}

 74%|███████▍  | 8188/11049 [1:24:19<29:13,  1.63it/s]
 74%|███████▍  | 8189/11049 [1:24:20<29:13,  1.63it/s]
                                                      
{'loss': 0.126, 'grad_norm': 0.5840874314308167, 'learning_rate': 1.90589501219273e-06, 'epoch': 2.22}

 74%|███████▍  | 8189/11049 [1:24:20<29:13,  1.63it/s]
 74%|███████▍  | 8190/11049 [1:24:20<29:11,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.5619648098945618, 'learning_rate': 1.9046543069817796e-06, 'epoch': 2.22}

 74%|███████▍  | 8190/11049 [1:24:20<29:11,  1.63it/s]
 74%|███████▍  | 8191/11049 [1:24:21<29:12,  1.63it/s]
                                                      
{'loss': 0.1822, 'grad_norm': 0.7167410850524902, 'learning_rate': 1.903413910719738e-06, 'epoch': 2.22}

 74%|███████▍  | 8191/11049 [1:24:21<29:12,  1.63it/s]
 74%|███████▍  | 8192/11049 [1:24:22<29:11,  1.63it/s]
                                                      
{'loss': 0.1584, 'grad_norm': 0.5860905051231384, 'learning_rate': 1.9021738235304137e-06, 'epoch': 2.22}

 74%|███████▍  | 8192/11049 [1:24:22<29:11,  1.63it/s]
 74%|███████▍  | 8193/11049 [1:24:22<29:10,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.6146284341812134, 'learning_rate': 1.9009340455375803e-06, 'epoch': 2.22}

 74%|███████▍  | 8193/11049 [1:24:22<29:10,  1.63it/s]
 74%|███████▍  | 8194/11049 [1:24:23<29:11,  1.63it/s]
                                                      
{'loss': 0.1664, 'grad_norm': 0.6312873363494873, 'learning_rate': 1.8996945768649805e-06, 'epoch': 2.22}

 74%|███████▍  | 8194/11049 [1:24:23<29:11,  1.63it/s]
 74%|███████▍  | 8195/11049 [1:24:23<29:10,  1.63it/s]
                                                      
{'loss': 0.1775, 'grad_norm': 0.6465837955474854, 'learning_rate': 1.8984554176363245e-06, 'epoch': 2.23}

 74%|███████▍  | 8195/11049 [1:24:24<29:10,  1.63it/s]
 74%|███████▍  | 8196/11049 [1:24:24<29:09,  1.63it/s]
                                                      
{'loss': 0.155, 'grad_norm': 0.7245026230812073, 'learning_rate': 1.8972165679752986e-06, 'epoch': 2.23}

 74%|███████▍  | 8196/11049 [1:24:24<29:09,  1.63it/s]
 74%|███████▍  | 8197/11049 [1:24:25<29:09,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.5466570854187012, 'learning_rate': 1.89597802800555e-06, 'epoch': 2.23}

 74%|███████▍  | 8197/11049 [1:24:25<29:09,  1.63it/s]
 74%|███████▍  | 8198/11049 [1:24:25<29:08,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.7176969647407532, 'learning_rate': 1.8947397978506992e-06, 'epoch': 2.23}

 74%|███████▍  | 8198/11049 [1:24:25<29:08,  1.63it/s]
 74%|███████▍  | 8199/11049 [1:24:26<29:08,  1.63it/s]
                                                      
{'loss': 0.1452, 'grad_norm': 0.5195510387420654, 'learning_rate': 1.8935018776343344e-06, 'epoch': 2.23}

 74%|███████▍  | 8199/11049 [1:24:26<29:08,  1.63it/s]
 74%|███████▍  | 8200/11049 [1:24:26<29:07,  1.63it/s]
                                                      
{'loss': 0.1385, 'grad_norm': 0.5350362062454224, 'learning_rate': 1.8922642674800146e-06, 'epoch': 2.23}

 74%|███████▍  | 8200/11049 [1:24:27<29:07,  1.63it/s]
 74%|███████▍  | 8201/11049 [1:24:27<29:06,  1.63it/s]
                                                      
{'loss': 0.147, 'grad_norm': 0.5601245164871216, 'learning_rate': 1.8910269675112651e-06, 'epoch': 2.23}

 74%|███████▍  | 8201/11049 [1:24:27<29:06,  1.63it/s]
 74%|███████▍  | 8202/11049 [1:24:28<29:05,  1.63it/s]
                                                      
{'loss': 0.1537, 'grad_norm': 0.5515076518058777, 'learning_rate': 1.8897899778515833e-06, 'epoch': 2.23}

 74%|███████▍  | 8202/11049 [1:24:28<29:05,  1.63it/s]
 74%|███████▍  | 8203/11049 [1:24:28<29:14,  1.62it/s]
                                                      
{'loss': 0.1567, 'grad_norm': 0.6119542717933655, 'learning_rate': 1.888553298624431e-06, 'epoch': 2.23}

 74%|███████▍  | 8203/11049 [1:24:28<29:14,  1.62it/s]
 74%|███████▍  | 8204/11049 [1:24:29<29:11,  1.62it/s]
                                                      
{'loss': 0.176, 'grad_norm': 0.5248295068740845, 'learning_rate': 1.8873169299532469e-06, 'epoch': 2.23}

 74%|███████▍  | 8204/11049 [1:24:29<29:11,  1.62it/s]
 74%|███████▍  | 8205/11049 [1:24:30<29:08,  1.63it/s]
                                                      
{'loss': 0.1383, 'grad_norm': 0.5354459285736084, 'learning_rate': 1.8860808719614309e-06, 'epoch': 2.23}

 74%|███████▍  | 8205/11049 [1:24:30<29:08,  1.63it/s]
 74%|███████▍  | 8206/11049 [1:24:30<29:07,  1.63it/s]
                                                      
{'loss': 0.1516, 'grad_norm': 0.569139838218689, 'learning_rate': 1.884845124772356e-06, 'epoch': 2.23}

 74%|███████▍  | 8206/11049 [1:24:30<29:07,  1.63it/s]
 74%|███████▍  | 8207/11049 [1:24:31<29:05,  1.63it/s]
                                                      
{'loss': 0.1196, 'grad_norm': 0.5290717482566833, 'learning_rate': 1.8836096885093618e-06, 'epoch': 2.23}

 74%|███████▍  | 8207/11049 [1:24:31<29:05,  1.63it/s]
 74%|███████▍  | 8208/11049 [1:24:31<29:06,  1.63it/s]
                                                      
{'loss': 0.1878, 'grad_norm': 0.6272662281990051, 'learning_rate': 1.88237456329576e-06, 'epoch': 2.23}

 74%|███████▍  | 8208/11049 [1:24:32<29:06,  1.63it/s]
 74%|███████▍  | 8209/11049 [1:24:32<29:05,  1.63it/s]
                                                      
{'loss': 0.1456, 'grad_norm': 0.5998380184173584, 'learning_rate': 1.8811397492548283e-06, 'epoch': 2.23}

 74%|███████▍  | 8209/11049 [1:24:32<29:05,  1.63it/s]
 74%|███████▍  | 8210/11049 [1:24:33<29:03,  1.63it/s]
                                                      
{'loss': 0.1974, 'grad_norm': 0.6569170355796814, 'learning_rate': 1.8799052465098145e-06, 'epoch': 2.23}

 74%|███████▍  | 8210/11049 [1:24:33<29:03,  1.63it/s]
 74%|███████▍  | 8211/11049 [1:24:33<29:04,  1.63it/s]
                                                      
{'loss': 0.1395, 'grad_norm': 0.5937198996543884, 'learning_rate': 1.8786710551839354e-06, 'epoch': 2.23}

 74%|███████▍  | 8211/11049 [1:24:33<29:04,  1.63it/s]
 74%|███████▍  | 8212/11049 [1:24:34<29:02,  1.63it/s]
                                                      
{'loss': 0.1554, 'grad_norm': 0.5948657989501953, 'learning_rate': 1.877437175400375e-06, 'epoch': 2.23}

 74%|███████▍  | 8212/11049 [1:24:34<29:02,  1.63it/s]
 74%|███████▍  | 8213/11049 [1:24:34<29:10,  1.62it/s]
                                                      
{'loss': 0.1691, 'grad_norm': 0.5572772026062012, 'learning_rate': 1.8762036072822915e-06, 'epoch': 2.23}

 74%|███████▍  | 8213/11049 [1:24:35<29:10,  1.62it/s]
 74%|███████▍  | 8214/11049 [1:24:35<29:06,  1.62it/s]
                                                      
{'loss': 0.1362, 'grad_norm': 0.5303150415420532, 'learning_rate': 1.874970350952806e-06, 'epoch': 2.23}

 74%|███████▍  | 8214/11049 [1:24:35<29:06,  1.62it/s]
 74%|███████▍  | 8215/11049 [1:24:36<29:04,  1.62it/s]
                                                      
{'loss': 0.1351, 'grad_norm': 0.4972798526287079, 'learning_rate': 1.8737374065350111e-06, 'epoch': 2.23}

 74%|███████▍  | 8215/11049 [1:24:36<29:04,  1.62it/s]
 74%|███████▍  | 8216/11049 [1:24:36<29:01,  1.63it/s]
                                                      
{'loss': 0.1356, 'grad_norm': 0.5154492855072021, 'learning_rate': 1.8725047741519681e-06, 'epoch': 2.23}

 74%|███████▍  | 8216/11049 [1:24:36<29:01,  1.63it/s]
 74%|███████▍  | 8217/11049 [1:24:37<28:58,  1.63it/s]
                                                      
{'loss': 0.1515, 'grad_norm': 0.6018354296684265, 'learning_rate': 1.8712724539267069e-06, 'epoch': 2.23}

 74%|███████▍  | 8217/11049 [1:24:37<28:58,  1.63it/s]
 74%|███████▍  | 8218/11049 [1:24:38<29:00,  1.63it/s]
                                                      
{'loss': 0.1524, 'grad_norm': 0.5819239020347595, 'learning_rate': 1.8700404459822263e-06, 'epoch': 2.23}

 74%|███████▍  | 8218/11049 [1:24:38<29:00,  1.63it/s]
 74%|███████▍  | 8219/11049 [1:24:38<28:57,  1.63it/s]
                                                      
{'loss': 0.1496, 'grad_norm': 0.5699363350868225, 'learning_rate': 1.8688087504414937e-06, 'epoch': 2.23}

 74%|███████▍  | 8219/11049 [1:24:38<28:57,  1.63it/s]
 74%|███████▍  | 8220/11049 [1:24:39<28:56,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.6600843667984009, 'learning_rate': 1.867577367427445e-06, 'epoch': 2.23}

 74%|███████▍  | 8220/11049 [1:24:39<28:56,  1.63it/s]
 74%|███████▍  | 8221/11049 [1:24:39<28:55,  1.63it/s]
                                                      
{'loss': 0.1567, 'grad_norm': 0.5848161578178406, 'learning_rate': 1.8663462970629874e-06, 'epoch': 2.23}

 74%|███████▍  | 8221/11049 [1:24:40<28:55,  1.63it/s]
 74%|███████▍  | 8222/11049 [1:24:40<28:55,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.7863517999649048, 'learning_rate': 1.865115539470994e-06, 'epoch': 2.23}

 74%|███████▍  | 8222/11049 [1:24:40<28:55,  1.63it/s]
 74%|███████▍  | 8223/11049 [1:24:41<28:57,  1.63it/s]
                                                      
{'loss': 0.2002, 'grad_norm': 0.6485584378242493, 'learning_rate': 1.8638850947743082e-06, 'epoch': 2.23}

 74%|███████▍  | 8223/11049 [1:24:41<28:57,  1.63it/s]
 74%|███████▍  | 8224/11049 [1:24:41<28:55,  1.63it/s]
                                                      
{'loss': 0.1785, 'grad_norm': 0.6961727738380432, 'learning_rate': 1.8626549630957397e-06, 'epoch': 2.23}

 74%|███████▍  | 8224/11049 [1:24:41<28:55,  1.63it/s]
 74%|███████▍  | 8225/11049 [1:24:42<28:53,  1.63it/s]
                                                      
{'loss': 0.136, 'grad_norm': 0.646179735660553, 'learning_rate': 1.8614251445580717e-06, 'epoch': 2.23}

 74%|███████▍  | 8225/11049 [1:24:42<28:53,  1.63it/s]
 74%|███████▍  | 8226/11049 [1:24:42<28:52,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.6471432447433472, 'learning_rate': 1.8601956392840537e-06, 'epoch': 2.23}

 74%|███████▍  | 8226/11049 [1:24:43<28:52,  1.63it/s]
 74%|███████▍  | 8227/11049 [1:24:43<28:51,  1.63it/s]
                                                      
{'loss': 0.1404, 'grad_norm': 0.6123115420341492, 'learning_rate': 1.8589664473964009e-06, 'epoch': 2.23}

 74%|███████▍  | 8227/11049 [1:24:43<28:51,  1.63it/s]
 74%|███████▍  | 8228/11049 [1:24:44<28:52,  1.63it/s]
                                                      
{'loss': 0.1543, 'grad_norm': 0.5498403310775757, 'learning_rate': 1.857737569017799e-06, 'epoch': 2.23}

 74%|███████▍  | 8228/11049 [1:24:44<28:52,  1.63it/s]
 74%|███████▍  | 8229/11049 [1:24:44<28:51,  1.63it/s]
                                                      
{'loss': 0.1682, 'grad_norm': 0.7231660485267639, 'learning_rate': 1.8565090042709067e-06, 'epoch': 2.23}

 74%|███████▍  | 8229/11049 [1:24:44<28:51,  1.63it/s]
 74%|███████▍  | 8230/11049 [1:24:45<28:50,  1.63it/s]
                                                      
{'loss': 0.1599, 'grad_norm': 0.6941564679145813, 'learning_rate': 1.8552807532783467e-06, 'epoch': 2.23}

 74%|███████▍  | 8230/11049 [1:24:45<28:50,  1.63it/s]
 74%|███████▍  | 8231/11049 [1:24:46<28:48,  1.63it/s]
                                                      
{'loss': 0.1401, 'grad_norm': 0.54997318983078, 'learning_rate': 1.8540528161627124e-06, 'epoch': 2.23}

 74%|███████▍  | 8231/11049 [1:24:46<28:48,  1.63it/s]
 75%|███████▍  | 8232/11049 [1:24:46<28:47,  1.63it/s]
                                                      
{'loss': 0.1255, 'grad_norm': 0.521584689617157, 'learning_rate': 1.8528251930465623e-06, 'epoch': 2.24}

 75%|███████▍  | 8232/11049 [1:24:46<28:47,  1.63it/s]
 75%|███████▍  | 8233/11049 [1:24:47<28:49,  1.63it/s]
                                                      
{'loss': 0.1352, 'grad_norm': 0.5378681421279907, 'learning_rate': 1.8515978840524302e-06, 'epoch': 2.24}

 75%|███████▍  | 8233/11049 [1:24:47<28:49,  1.63it/s]
 75%|███████▍  | 8234/11049 [1:24:47<28:47,  1.63it/s]
                                                      
{'loss': 0.1437, 'grad_norm': 0.5341569185256958, 'learning_rate': 1.8503708893028133e-06, 'epoch': 2.24}

 75%|███████▍  | 8234/11049 [1:24:47<28:47,  1.63it/s]
 75%|███████▍  | 8235/11049 [1:24:48<28:46,  1.63it/s]
                                                      
{'loss': 0.1414, 'grad_norm': 0.5751400589942932, 'learning_rate': 1.849144208920179e-06, 'epoch': 2.24}

 75%|███████▍  | 8235/11049 [1:24:48<28:46,  1.63it/s]
 75%|███████▍  | 8236/11049 [1:24:49<28:46,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.5594658255577087, 'learning_rate': 1.8479178430269623e-06, 'epoch': 2.24}

 75%|███████▍  | 8236/11049 [1:24:49<28:46,  1.63it/s]
 75%|███████▍  | 8237/11049 [1:24:49<28:45,  1.63it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.707850456237793, 'learning_rate': 1.846691791745569e-06, 'epoch': 2.24}

 75%|███████▍  | 8237/11049 [1:24:49<28:45,  1.63it/s]
 75%|███████▍  | 8238/11049 [1:24:50<28:47,  1.63it/s]
                                                      
{'loss': 0.1488, 'grad_norm': 0.590981125831604, 'learning_rate': 1.8454660551983717e-06, 'epoch': 2.24}

 75%|███████▍  | 8238/11049 [1:24:50<28:47,  1.63it/s]
 75%|███████▍  | 8239/11049 [1:24:50<28:45,  1.63it/s]
                                                      
{'loss': 0.146, 'grad_norm': 0.5029578804969788, 'learning_rate': 1.8442406335077124e-06, 'epoch': 2.24}

 75%|███████▍  | 8239/11049 [1:24:51<28:45,  1.63it/s]
 75%|███████▍  | 8240/11049 [1:24:51<28:44,  1.63it/s]
                                                      
{'loss': 0.1553, 'grad_norm': 0.5884616374969482, 'learning_rate': 1.8430155267958994e-06, 'epoch': 2.24}

 75%|███████▍  | 8240/11049 [1:24:51<28:44,  1.63it/s]
 75%|███████▍  | 8241/11049 [1:24:52<28:43,  1.63it/s]
                                                      
{'loss': 0.1413, 'grad_norm': 0.5988674163818359, 'learning_rate': 1.8417907351852148e-06, 'epoch': 2.24}

 75%|███████▍  | 8241/11049 [1:24:52<28:43,  1.63it/s]
 75%|███████▍  | 8242/11049 [1:24:52<28:42,  1.63it/s]
                                                      
{'loss': 0.1237, 'grad_norm': 0.49581050872802734, 'learning_rate': 1.8405662587979046e-06, 'epoch': 2.24}

 75%|███████▍  | 8242/11049 [1:24:52<28:42,  1.63it/s]
 75%|███████▍  | 8243/11049 [1:24:53<28:45,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.5923452377319336, 'learning_rate': 1.8393420977561849e-06, 'epoch': 2.24}

 75%|███████▍  | 8243/11049 [1:24:53<28:45,  1.63it/s]
 75%|███████▍  | 8244/11049 [1:24:53<28:43,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.6152370572090149, 'learning_rate': 1.8381182521822406e-06, 'epoch': 2.24}

 75%|███████▍  | 8244/11049 [1:24:54<28:43,  1.63it/s]
 75%|███████▍  | 8245/11049 [1:24:54<28:41,  1.63it/s]
                                                      
{'loss': 0.1229, 'grad_norm': 0.4764684736728668, 'learning_rate': 1.8368947221982231e-06, 'epoch': 2.24}

 75%|███████▍  | 8245/11049 [1:24:54<28:41,  1.63it/s]
 75%|███████▍  | 8246/11049 [1:24:55<28:40,  1.63it/s]
                                                      
{'loss': 0.1385, 'grad_norm': 0.5835798978805542, 'learning_rate': 1.8356715079262554e-06, 'epoch': 2.24}

 75%|███████▍  | 8246/11049 [1:24:55<28:40,  1.63it/s]
 75%|███████▍  | 8247/11049 [1:24:55<28:39,  1.63it/s]
                                                      
{'loss': 0.1425, 'grad_norm': 0.5096156001091003, 'learning_rate': 1.8344486094884274e-06, 'epoch': 2.24}

 75%|███████▍  | 8247/11049 [1:24:55<28:39,  1.63it/s]
 75%|███████▍  | 8248/11049 [1:24:56<28:41,  1.63it/s]
                                                      
{'loss': 0.1611, 'grad_norm': 0.5551635026931763, 'learning_rate': 1.8332260270067948e-06, 'epoch': 2.24}

 75%|███████▍  | 8248/11049 [1:24:56<28:41,  1.63it/s]
 75%|███████▍  | 8249/11049 [1:24:57<28:39,  1.63it/s]
                                                      
{'loss': 0.1592, 'grad_norm': 0.6262074708938599, 'learning_rate': 1.832003760603389e-06, 'epoch': 2.24}

 75%|███████▍  | 8249/11049 [1:24:57<28:39,  1.63it/s]
 75%|███████▍  | 8250/11049 [1:24:57<28:38,  1.63it/s]
                                                      
{'loss': 0.1705, 'grad_norm': 0.8786519765853882, 'learning_rate': 1.8307818104002034e-06, 'epoch': 2.24}

 75%|███████▍  | 8250/11049 [1:24:57<28:38,  1.63it/s]
 75%|███████▍  | 8251/11049 [1:24:58<28:37,  1.63it/s]
                                                      
{'loss': 0.1709, 'grad_norm': 0.6181939840316772, 'learning_rate': 1.8295601765192017e-06, 'epoch': 2.24}

 75%|███████▍  | 8251/11049 [1:24:58<28:37,  1.63it/s]
 75%|███████▍  | 8252/11049 [1:24:58<28:36,  1.63it/s]
                                                      
{'loss': 0.1719, 'grad_norm': 0.5765987038612366, 'learning_rate': 1.828338859082316e-06, 'epoch': 2.24}

 75%|███████▍  | 8252/11049 [1:24:59<28:36,  1.63it/s]
 75%|███████▍  | 8253/11049 [1:24:59<28:37,  1.63it/s]
                                                      
{'loss': 0.1859, 'grad_norm': 0.631536602973938, 'learning_rate': 1.8271178582114468e-06, 'epoch': 2.24}

 75%|███████▍  | 8253/11049 [1:24:59<28:37,  1.63it/s]
 75%|███████▍  | 8254/11049 [1:25:00<28:36,  1.63it/s]
                                                      
{'loss': 0.1486, 'grad_norm': 0.5880929827690125, 'learning_rate': 1.8258971740284642e-06, 'epoch': 2.24}

 75%|███████▍  | 8254/11049 [1:25:00<28:36,  1.63it/s]
 75%|███████▍  | 8255/11049 [1:25:00<28:34,  1.63it/s]
                                                      
{'loss': 0.1471, 'grad_norm': 0.5772911906242371, 'learning_rate': 1.8246768066552046e-06, 'epoch': 2.24}

 75%|███████▍  | 8255/11049 [1:25:00<28:34,  1.63it/s]
 75%|███████▍  | 8256/11049 [1:25:01<28:34,  1.63it/s]
                                                      
{'loss': 0.1425, 'grad_norm': 0.5934391021728516, 'learning_rate': 1.823456756213472e-06, 'epoch': 2.24}

 75%|███████▍  | 8256/11049 [1:25:01<28:34,  1.63it/s]
 75%|███████▍  | 8257/11049 [1:25:01<28:32,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.6057237982749939, 'learning_rate': 1.8222370228250452e-06, 'epoch': 2.24}

 75%|███████▍  | 8257/11049 [1:25:02<28:32,  1.63it/s]
 75%|███████▍  | 8258/11049 [1:25:02<28:34,  1.63it/s]
                                                      
{'loss': 0.1673, 'grad_norm': 0.6367366313934326, 'learning_rate': 1.8210176066116642e-06, 'epoch': 2.24}

 75%|███████▍  | 8258/11049 [1:25:02<28:34,  1.63it/s]
 75%|███████▍  | 8259/11049 [1:25:03<28:33,  1.63it/s]
                                                      
{'loss': 0.1328, 'grad_norm': 0.5358869433403015, 'learning_rate': 1.8197985076950398e-06, 'epoch': 2.24}

 75%|███████▍  | 8259/11049 [1:25:03<28:33,  1.63it/s]
 75%|███████▍  | 8260/11049 [1:25:03<28:32,  1.63it/s]
                                                      
{'loss': 0.1454, 'grad_norm': 0.5603564381599426, 'learning_rate': 1.8185797261968502e-06, 'epoch': 2.24}

 75%|███████▍  | 8260/11049 [1:25:03<28:32,  1.63it/s]
 75%|███████▍  | 8261/11049 [1:25:04<28:31,  1.63it/s]
                                                      
{'loss': 0.1549, 'grad_norm': 0.595504105091095, 'learning_rate': 1.8173612622387454e-06, 'epoch': 2.24}

 75%|███████▍  | 8261/11049 [1:25:04<28:31,  1.63it/s]
 75%|███████▍  | 8262/11049 [1:25:05<28:31,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.6503071784973145, 'learning_rate': 1.816143115942342e-06, 'epoch': 2.24}

 75%|███████▍  | 8262/11049 [1:25:05<28:31,  1.63it/s]
 75%|███████▍  | 8263/11049 [1:25:05<28:32,  1.63it/s]
                                                      
{'loss': 0.1575, 'grad_norm': 0.6047177314758301, 'learning_rate': 1.8149252874292205e-06, 'epoch': 2.24}

 75%|███████▍  | 8263/11049 [1:25:05<28:32,  1.63it/s]
 75%|███████▍  | 8264/11049 [1:25:06<28:31,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.613868772983551, 'learning_rate': 1.8137077768209339e-06, 'epoch': 2.24}

 75%|███████▍  | 8264/11049 [1:25:06<28:31,  1.63it/s]
 75%|███████▍  | 8265/11049 [1:25:06<28:30,  1.63it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.5856286883354187, 'learning_rate': 1.8124905842390051e-06, 'epoch': 2.24}

 75%|███████▍  | 8265/11049 [1:25:07<28:30,  1.63it/s]
 75%|███████▍  | 8266/11049 [1:25:07<28:28,  1.63it/s]
                                                      
{'loss': 0.1331, 'grad_norm': 0.5026147365570068, 'learning_rate': 1.811273709804922e-06, 'epoch': 2.24}

 75%|███████▍  | 8266/11049 [1:25:07<28:28,  1.63it/s]
 75%|███████▍  | 8267/11049 [1:25:08<28:27,  1.63it/s]
                                                      
{'loss': 0.2143, 'grad_norm': 0.5992358922958374, 'learning_rate': 1.8100571536401423e-06, 'epoch': 2.24}

 75%|███████▍  | 8267/11049 [1:25:08<28:27,  1.63it/s]
 75%|███████▍  | 8268/11049 [1:25:08<28:29,  1.63it/s]
                                                      
{'loss': 0.1259, 'grad_norm': 0.5452057123184204, 'learning_rate': 1.808840915866089e-06, 'epoch': 2.24}

 75%|███████▍  | 8268/11049 [1:25:08<28:29,  1.63it/s]
 75%|███████▍  | 8269/11049 [1:25:09<28:28,  1.63it/s]
                                                      
{'loss': 0.1389, 'grad_norm': 0.5570020079612732, 'learning_rate': 1.8076249966041593e-06, 'epoch': 2.25}

 75%|███████▍  | 8269/11049 [1:25:09<28:28,  1.63it/s]
 75%|███████▍  | 8270/11049 [1:25:09<28:26,  1.63it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.5810472369194031, 'learning_rate': 1.806409395975714e-06, 'epoch': 2.25}

 75%|███████▍  | 8270/11049 [1:25:10<28:26,  1.63it/s]
 75%|███████▍  | 8271/11049 [1:25:10<28:25,  1.63it/s]
                                                      
{'loss': 0.1278, 'grad_norm': 0.5297630429267883, 'learning_rate': 1.8051941141020818e-06, 'epoch': 2.25}

 75%|███████▍  | 8271/11049 [1:25:10<28:25,  1.63it/s]
 75%|███████▍  | 8272/11049 [1:25:11<28:24,  1.63it/s]
                                                      
{'loss': 0.1763, 'grad_norm': 0.6624544262886047, 'learning_rate': 1.8039791511045623e-06, 'epoch': 2.25}

 75%|███████▍  | 8272/11049 [1:25:11<28:24,  1.63it/s]
 75%|███████▍  | 8273/11049 [1:25:11<28:24,  1.63it/s]
                                                      
{'loss': 0.1513, 'grad_norm': 0.6162399053573608, 'learning_rate': 1.8027645071044214e-06, 'epoch': 2.25}

 75%|███████▍  | 8273/11049 [1:25:11<28:24,  1.63it/s]
 75%|███████▍  | 8274/11049 [1:25:12<28:23,  1.63it/s]
                                                      
{'loss': 0.1159, 'grad_norm': 0.5451052188873291, 'learning_rate': 1.8015501822228937e-06, 'epoch': 2.25}

 75%|███████▍  | 8274/11049 [1:25:12<28:23,  1.63it/s]
 75%|███████▍  | 8275/11049 [1:25:13<28:22,  1.63it/s]
                                                      
{'loss': 0.1461, 'grad_norm': 0.558330774307251, 'learning_rate': 1.8003361765811822e-06, 'epoch': 2.25}

 75%|███████▍  | 8275/11049 [1:25:13<28:22,  1.63it/s]
 75%|███████▍  | 8276/11049 [1:25:13<28:21,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.6378210186958313, 'learning_rate': 1.7991224903004556e-06, 'epoch': 2.25}

 75%|███████▍  | 8276/11049 [1:25:13<28:21,  1.63it/s]
 75%|███████▍  | 8277/11049 [1:25:14<28:21,  1.63it/s]
                                                      
{'loss': 0.1682, 'grad_norm': 0.6096115112304688, 'learning_rate': 1.7979091235018564e-06, 'epoch': 2.25}

 75%|███████▍  | 8277/11049 [1:25:14<28:21,  1.63it/s]
 75%|███████▍  | 8278/11049 [1:25:14<28:23,  1.63it/s]
                                                      
{'loss': 0.1378, 'grad_norm': 0.5535282492637634, 'learning_rate': 1.79669607630649e-06, 'epoch': 2.25}

 75%|███████▍  | 8278/11049 [1:25:15<28:23,  1.63it/s]
 75%|███████▍  | 8279/11049 [1:25:15<28:21,  1.63it/s]
                                                      
{'loss': 0.1867, 'grad_norm': 0.5844287276268005, 'learning_rate': 1.7954833488354317e-06, 'epoch': 2.25}

 75%|███████▍  | 8279/11049 [1:25:15<28:21,  1.63it/s]
 75%|███████▍  | 8280/11049 [1:25:16<28:19,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.5893599987030029, 'learning_rate': 1.7942709412097254e-06, 'epoch': 2.25}

 75%|███████▍  | 8280/11049 [1:25:16<28:19,  1.63it/s]
 75%|███████▍  | 8281/11049 [1:25:16<28:20,  1.63it/s]
                                                      
{'loss': 0.1533, 'grad_norm': 0.6403529644012451, 'learning_rate': 1.7930588535503812e-06, 'epoch': 2.25}

 75%|███████▍  | 8281/11049 [1:25:16<28:20,  1.63it/s]
 75%|███████▍  | 8282/11049 [1:25:17<28:19,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.49818098545074463, 'learning_rate': 1.7918470859783793e-06, 'epoch': 2.25}

 75%|███████▍  | 8282/11049 [1:25:17<28:19,  1.63it/s]
 75%|███████▍  | 8283/11049 [1:25:17<28:20,  1.63it/s]
                                                      
{'loss': 0.1733, 'grad_norm': 0.6805192232131958, 'learning_rate': 1.7906356386146672e-06, 'epoch': 2.25}

 75%|███████▍  | 8283/11049 [1:25:18<28:20,  1.63it/s]
 75%|███████▍  | 8284/11049 [1:25:18<28:19,  1.63it/s]
                                                      
{'loss': 0.1438, 'grad_norm': 0.5472089648246765, 'learning_rate': 1.7894245115801583e-06, 'epoch': 2.25}

 75%|███████▍  | 8284/11049 [1:25:18<28:19,  1.63it/s]
 75%|███████▍  | 8285/11049 [1:25:19<28:17,  1.63it/s]
                                                      
{'loss': 0.1538, 'grad_norm': 0.5480870604515076, 'learning_rate': 1.7882137049957404e-06, 'epoch': 2.25}

 75%|███████▍  | 8285/11049 [1:25:19<28:17,  1.63it/s]
 75%|███████▍  | 8286/11049 [1:25:19<28:17,  1.63it/s]
                                                      
{'loss': 0.1809, 'grad_norm': 0.662311315536499, 'learning_rate': 1.7870032189822622e-06, 'epoch': 2.25}

 75%|███████▍  | 8286/11049 [1:25:19<28:17,  1.63it/s]
 75%|███████▌  | 8287/11049 [1:25:20<28:15,  1.63it/s]
                                                      
{'loss': 0.1726, 'grad_norm': 0.598587155342102, 'learning_rate': 1.7857930536605445e-06, 'epoch': 2.25}

 75%|███████▌  | 8287/11049 [1:25:20<28:15,  1.63it/s]
 75%|███████▌  | 8288/11049 [1:25:21<28:17,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.6534327268600464, 'learning_rate': 1.7845832091513737e-06, 'epoch': 2.25}

 75%|███████▌  | 8288/11049 [1:25:21<28:17,  1.63it/s]
 75%|███████▌  | 8289/11049 [1:25:21<28:15,  1.63it/s]
                                                      
{'loss': 0.1385, 'grad_norm': 0.515666663646698, 'learning_rate': 1.7833736855755063e-06, 'epoch': 2.25}

 75%|███████▌  | 8289/11049 [1:25:21<28:15,  1.63it/s]
 75%|███████▌  | 8290/11049 [1:25:22<28:13,  1.63it/s]
                                                      
{'loss': 0.1609, 'grad_norm': 0.6617957353591919, 'learning_rate': 1.782164483053665e-06, 'epoch': 2.25}

 75%|███████▌  | 8290/11049 [1:25:22<28:13,  1.63it/s]
 75%|███████▌  | 8291/11049 [1:25:22<28:12,  1.63it/s]
                                                      
{'loss': 0.1753, 'grad_norm': 0.6374020576477051, 'learning_rate': 1.7809556017065421e-06, 'epoch': 2.25}

 75%|███████▌  | 8291/11049 [1:25:22<28:12,  1.63it/s]
 75%|███████▌  | 8292/11049 [1:25:23<28:11,  1.63it/s]
                                                      
{'loss': 0.1287, 'grad_norm': 0.5933631658554077, 'learning_rate': 1.7797470416547945e-06, 'epoch': 2.25}

 75%|███████▌  | 8292/11049 [1:25:23<28:11,  1.63it/s]
 75%|███████▌  | 8293/11049 [1:25:24<28:13,  1.63it/s]
                                                      
{'loss': 0.1347, 'grad_norm': 0.5477489829063416, 'learning_rate': 1.7785388030190536e-06, 'epoch': 2.25}

 75%|███████▌  | 8293/11049 [1:25:24<28:13,  1.63it/s]
 75%|███████▌  | 8294/11049 [1:25:24<28:11,  1.63it/s]
                                                      
{'loss': 0.1365, 'grad_norm': 0.5640013217926025, 'learning_rate': 1.7773308859199123e-06, 'epoch': 2.25}

 75%|███████▌  | 8294/11049 [1:25:24<28:11,  1.63it/s]
 75%|███████▌  | 8295/11049 [1:25:25<28:10,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.6245635151863098, 'learning_rate': 1.7761232904779346e-06, 'epoch': 2.25}

 75%|███████▌  | 8295/11049 [1:25:25<28:10,  1.63it/s]
 75%|███████▌  | 8296/11049 [1:25:25<28:09,  1.63it/s]
                                                      
{'loss': 0.1478, 'grad_norm': 0.5542090535163879, 'learning_rate': 1.7749160168136493e-06, 'epoch': 2.25}

 75%|███████▌  | 8296/11049 [1:25:26<28:09,  1.63it/s]
 75%|███████▌  | 8297/11049 [1:25:26<28:08,  1.63it/s]
                                                      
{'loss': 0.2052, 'grad_norm': 0.7376143932342529, 'learning_rate': 1.7737090650475586e-06, 'epoch': 2.25}

 75%|███████▌  | 8297/11049 [1:25:26<28:08,  1.63it/s]
 75%|███████▌  | 8298/11049 [1:25:27<28:15,  1.62it/s]
                                                      
{'loss': 0.144, 'grad_norm': 0.5386838912963867, 'learning_rate': 1.7725024353001296e-06, 'epoch': 2.25}

 75%|███████▌  | 8298/11049 [1:25:27<28:15,  1.62it/s]
 75%|███████▌  | 8299/11049 [1:25:27<28:12,  1.63it/s]
                                                      
{'loss': 0.2102, 'grad_norm': 0.532778263092041, 'learning_rate': 1.7712961276917933e-06, 'epoch': 2.25}

 75%|███████▌  | 8299/11049 [1:25:27<28:12,  1.63it/s]
 75%|███████▌  | 8300/11049 [1:25:28<28:10,  1.63it/s]
                                                      
{'loss': 0.216, 'grad_norm': 0.737369179725647, 'learning_rate': 1.7700901423429529e-06, 'epoch': 2.25}

 75%|███████▌  | 8300/11049 [1:25:28<28:10,  1.63it/s]
 75%|███████▌  | 8301/11049 [1:25:29<28:07,  1.63it/s]
                                                      
{'loss': 0.1142, 'grad_norm': 0.49350735545158386, 'learning_rate': 1.7688844793739812e-06, 'epoch': 2.25}

 75%|███████▌  | 8301/11049 [1:25:29<28:07,  1.63it/s]
 75%|███████▌  | 8302/11049 [1:25:29<28:05,  1.63it/s]
                                                      
{'loss': 0.1817, 'grad_norm': 0.655933141708374, 'learning_rate': 1.7676791389052156e-06, 'epoch': 2.25}

 75%|███████▌  | 8302/11049 [1:25:29<28:05,  1.63it/s]
 75%|███████▌  | 8303/11049 [1:25:30<28:07,  1.63it/s]
                                                      
{'loss': 0.1103, 'grad_norm': 0.4034792184829712, 'learning_rate': 1.7664741210569615e-06, 'epoch': 2.25}

 75%|███████▌  | 8303/11049 [1:25:30<28:07,  1.63it/s]
 75%|███████▌  | 8304/11049 [1:25:30<28:05,  1.63it/s]
                                                      
{'loss': 0.1768, 'grad_norm': 0.6012088060379028, 'learning_rate': 1.7652694259494913e-06, 'epoch': 2.25}

 75%|███████▌  | 8304/11049 [1:25:30<28:05,  1.63it/s]
 75%|███████▌  | 8305/11049 [1:25:31<28:04,  1.63it/s]
                                                      
{'loss': 0.1355, 'grad_norm': 0.5280885100364685, 'learning_rate': 1.7640650537030496e-06, 'epoch': 2.25}

 75%|███████▌  | 8305/11049 [1:25:31<28:04,  1.63it/s]
 75%|███████▌  | 8306/11049 [1:25:32<28:02,  1.63it/s]
                                                      
{'loss': 0.1393, 'grad_norm': 0.5301481485366821, 'learning_rate': 1.7628610044378441e-06, 'epoch': 2.26}

 75%|███████▌  | 8306/11049 [1:25:32<28:02,  1.63it/s]
 75%|███████▌  | 8307/11049 [1:25:32<28:01,  1.63it/s]
                                                      
{'loss': 0.1746, 'grad_norm': 0.6457152366638184, 'learning_rate': 1.7616572782740544e-06, 'epoch': 2.26}

 75%|███████▌  | 8307/11049 [1:25:32<28:01,  1.63it/s]
 75%|███████▌  | 8308/11049 [1:25:33<28:03,  1.63it/s]
                                                      
{'loss': 0.2019, 'grad_norm': 0.7221462726593018, 'learning_rate': 1.760453875331819e-06, 'epoch': 2.26}

 75%|███████▌  | 8308/11049 [1:25:33<28:03,  1.63it/s]
 75%|███████▌  | 8309/11049 [1:25:33<28:03,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.6356194615364075, 'learning_rate': 1.7592507957312566e-06, 'epoch': 2.26}

 75%|███████▌  | 8309/11049 [1:25:34<28:03,  1.63it/s]
 75%|███████▌  | 8310/11049 [1:25:34<28:01,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.5982114672660828, 'learning_rate': 1.7580480395924454e-06, 'epoch': 2.26}

 75%|███████▌  | 8310/11049 [1:25:34<28:01,  1.63it/s]
 75%|███████▌  | 8311/11049 [1:25:35<28:01,  1.63it/s]
                                                      
{'loss': 0.118, 'grad_norm': 0.4774136543273926, 'learning_rate': 1.756845607035434e-06, 'epoch': 2.26}

 75%|███████▌  | 8311/11049 [1:25:35<28:01,  1.63it/s]
 75%|███████▌  | 8312/11049 [1:25:35<27:59,  1.63it/s]
                                                      
{'loss': 0.1446, 'grad_norm': 0.5250851511955261, 'learning_rate': 1.755643498180235e-06, 'epoch': 2.26}

 75%|███████▌  | 8312/11049 [1:25:35<27:59,  1.63it/s]
 75%|███████▌  | 8313/11049 [1:25:36<27:59,  1.63it/s]
                                                      
{'loss': 0.1753, 'grad_norm': 0.6649949550628662, 'learning_rate': 1.7544417131468373e-06, 'epoch': 2.26}

 75%|███████▌  | 8313/11049 [1:25:36<27:59,  1.63it/s]
 75%|███████▌  | 8314/11049 [1:25:36<28:00,  1.63it/s]
                                                      
{'loss': 0.1282, 'grad_norm': 0.5368984937667847, 'learning_rate': 1.7532402520551883e-06, 'epoch': 2.26}

 75%|███████▌  | 8314/11049 [1:25:37<28:00,  1.63it/s]
 75%|███████▌  | 8315/11049 [1:25:37<27:58,  1.63it/s]
                                                      
{'loss': 0.1698, 'grad_norm': 0.6157001256942749, 'learning_rate': 1.7520391150252082e-06, 'epoch': 2.26}

 75%|███████▌  | 8315/11049 [1:25:37<27:58,  1.63it/s]
 75%|███████▌  | 8316/11049 [1:25:38<27:59,  1.63it/s]
                                                      
{'loss': 0.2012, 'grad_norm': 0.7075066566467285, 'learning_rate': 1.7508383021767832e-06, 'epoch': 2.26}

 75%|███████▌  | 8316/11049 [1:25:38<27:59,  1.63it/s]
 75%|███████▌  | 8317/11049 [1:25:38<27:57,  1.63it/s]
                                                      
{'loss': 0.1275, 'grad_norm': 0.512173056602478, 'learning_rate': 1.7496378136297665e-06, 'epoch': 2.26}

 75%|███████▌  | 8317/11049 [1:25:38<27:57,  1.63it/s]
 75%|███████▌  | 8318/11049 [1:25:39<27:59,  1.63it/s]
                                                      
{'loss': 0.1997, 'grad_norm': 0.6894974708557129, 'learning_rate': 1.7484376495039812e-06, 'epoch': 2.26}

 75%|███████▌  | 8318/11049 [1:25:39<27:59,  1.63it/s]
 75%|███████▌  | 8319/11049 [1:25:40<27:59,  1.63it/s]
                                                      
{'loss': 0.1312, 'grad_norm': 0.4976571798324585, 'learning_rate': 1.7472378099192156e-06, 'epoch': 2.26}

 75%|███████▌  | 8319/11049 [1:25:40<27:59,  1.63it/s]
 75%|███████▌  | 8320/11049 [1:25:40<27:56,  1.63it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.5684154033660889, 'learning_rate': 1.7460382949952248e-06, 'epoch': 2.26}

 75%|███████▌  | 8320/11049 [1:25:40<27:56,  1.63it/s]
 75%|███████▌  | 8321/11049 [1:25:41<27:54,  1.63it/s]
                                                      
{'loss': 0.1278, 'grad_norm': 0.47366097569465637, 'learning_rate': 1.7448391048517378e-06, 'epoch': 2.26}

 75%|███████▌  | 8321/11049 [1:25:41<27:54,  1.63it/s]
 75%|███████▌  | 8322/11049 [1:25:41<27:53,  1.63it/s]
                                                      
{'loss': 0.114, 'grad_norm': 0.4750947654247284, 'learning_rate': 1.743640239608444e-06, 'epoch': 2.26}

 75%|███████▌  | 8322/11049 [1:25:42<27:53,  1.63it/s]
 75%|███████▌  | 8323/11049 [1:25:42<27:55,  1.63it/s]
                                                      
{'loss': 0.1446, 'grad_norm': 0.5917426347732544, 'learning_rate': 1.7424416993850036e-06, 'epoch': 2.26}

 75%|███████▌  | 8323/11049 [1:25:42<27:55,  1.63it/s]
 75%|███████▌  | 8324/11049 [1:25:43<27:57,  1.62it/s]
                                                      
{'loss': 0.1293, 'grad_norm': 0.5011542439460754, 'learning_rate': 1.7412434843010435e-06, 'epoch': 2.26}

 75%|███████▌  | 8324/11049 [1:25:43<27:57,  1.62it/s]
 75%|███████▌  | 8325/11049 [1:25:43<27:54,  1.63it/s]
                                                      
{'loss': 0.1531, 'grad_norm': 0.5988234877586365, 'learning_rate': 1.740045594476159e-06, 'epoch': 2.26}

 75%|███████▌  | 8325/11049 [1:25:43<27:54,  1.63it/s]
 75%|███████▌  | 8326/11049 [1:25:44<27:52,  1.63it/s]
                                                      
{'loss': 0.1873, 'grad_norm': 0.7193769812583923, 'learning_rate': 1.738848030029912e-06, 'epoch': 2.26}

 75%|███████▌  | 8326/11049 [1:25:44<27:52,  1.63it/s]
 75%|███████▌  | 8327/11049 [1:25:44<27:52,  1.63it/s]
                                                      
{'loss': 0.1395, 'grad_norm': 0.5042951703071594, 'learning_rate': 1.737650791081833e-06, 'epoch': 2.26}

 75%|███████▌  | 8327/11049 [1:25:45<27:52,  1.63it/s]
 75%|███████▌  | 8328/11049 [1:25:45<27:52,  1.63it/s]
                                                      
{'loss': 0.1419, 'grad_norm': 0.5324355363845825, 'learning_rate': 1.7364538777514168e-06, 'epoch': 2.26}

 75%|███████▌  | 8328/11049 [1:25:45<27:52,  1.63it/s]
 75%|███████▌  | 8329/11049 [1:25:46<27:51,  1.63it/s]
                                                      
{'loss': 0.1362, 'grad_norm': 0.4851216971874237, 'learning_rate': 1.7352572901581322e-06, 'epoch': 2.26}

 75%|███████▌  | 8329/11049 [1:25:46<27:51,  1.63it/s]
 75%|███████▌  | 8330/11049 [1:25:46<27:50,  1.63it/s]
                                                      
{'loss': 0.1294, 'grad_norm': 0.48536500334739685, 'learning_rate': 1.7340610284214098e-06, 'epoch': 2.26}

 75%|███████▌  | 8330/11049 [1:25:46<27:50,  1.63it/s]
 75%|███████▌  | 8331/11049 [1:25:47<27:48,  1.63it/s]
                                                      
{'loss': 0.1886, 'grad_norm': 0.661074697971344, 'learning_rate': 1.7328650926606495e-06, 'epoch': 2.26}

 75%|███████▌  | 8331/11049 [1:25:47<27:48,  1.63it/s]
 75%|███████▌  | 8332/11049 [1:25:48<27:47,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.5859931707382202, 'learning_rate': 1.7316694829952164e-06, 'epoch': 2.26}

 75%|███████▌  | 8332/11049 [1:25:48<27:47,  1.63it/s]
 75%|███████▌  | 8333/11049 [1:25:48<27:48,  1.63it/s]
                                                      
{'loss': 0.1204, 'grad_norm': 0.49980905652046204, 'learning_rate': 1.7304741995444506e-06, 'epoch': 2.26}

 75%|███████▌  | 8333/11049 [1:25:48<27:48,  1.63it/s]
 75%|███████▌  | 8334/11049 [1:25:49<27:49,  1.63it/s]
                                                      
{'loss': 0.1259, 'grad_norm': 0.5729235410690308, 'learning_rate': 1.7292792424276493e-06, 'epoch': 2.26}

 75%|███████▌  | 8334/11049 [1:25:49<27:49,  1.63it/s]
 75%|███████▌  | 8335/11049 [1:25:49<27:46,  1.63it/s]
                                                      
{'loss': 0.1511, 'grad_norm': 0.5561167597770691, 'learning_rate': 1.7280846117640843e-06, 'epoch': 2.26}

 75%|███████▌  | 8335/11049 [1:25:50<27:46,  1.63it/s]
 75%|███████▌  | 8336/11049 [1:25:50<27:46,  1.63it/s]
                                                      
{'loss': 0.1783, 'grad_norm': 0.6576854586601257, 'learning_rate': 1.7268903076729904e-06, 'epoch': 2.26}

 75%|███████▌  | 8336/11049 [1:25:50<27:46,  1.63it/s]
 75%|███████▌  | 8337/11049 [1:25:51<27:44,  1.63it/s]
                                                      
{'loss': 0.1426, 'grad_norm': 0.5716732144355774, 'learning_rate': 1.7256963302735752e-06, 'epoch': 2.26}

 75%|███████▌  | 8337/11049 [1:25:51<27:44,  1.63it/s]
 75%|███████▌  | 8338/11049 [1:25:51<27:46,  1.63it/s]
                                                      
{'loss': 0.1312, 'grad_norm': 0.5700515508651733, 'learning_rate': 1.724502679685009e-06, 'epoch': 2.26}

 75%|███████▌  | 8338/11049 [1:25:51<27:46,  1.63it/s]
 75%|███████▌  | 8339/11049 [1:25:52<27:45,  1.63it/s]
                                                      
{'loss': 0.1912, 'grad_norm': 0.6303852796554565, 'learning_rate': 1.7233093560264314e-06, 'epoch': 2.26}

 75%|███████▌  | 8339/11049 [1:25:52<27:45,  1.63it/s]
 75%|███████▌  | 8340/11049 [1:25:52<27:43,  1.63it/s]
                                                      
{'loss': 0.1659, 'grad_norm': 0.6367517113685608, 'learning_rate': 1.722116359416947e-06, 'epoch': 2.26}

 75%|███████▌  | 8340/11049 [1:25:53<27:43,  1.63it/s]
 75%|███████▌  | 8341/11049 [1:25:53<27:41,  1.63it/s]
                                                      
{'loss': 0.1634, 'grad_norm': 0.5504847764968872, 'learning_rate': 1.7209236899756333e-06, 'epoch': 2.26}

 75%|███████▌  | 8341/11049 [1:25:53<27:41,  1.63it/s]
 76%|███████▌  | 8342/11049 [1:25:54<27:41,  1.63it/s]
                                                      
{'loss': 0.1775, 'grad_norm': 0.580650806427002, 'learning_rate': 1.7197313478215293e-06, 'epoch': 2.27}

 76%|███████▌  | 8342/11049 [1:25:54<27:41,  1.63it/s]
 76%|███████▌  | 8343/11049 [1:25:54<27:44,  1.63it/s]
                                                      
{'loss': 0.1673, 'grad_norm': 0.6539347171783447, 'learning_rate': 1.7185393330736461e-06, 'epoch': 2.27}

 76%|███████▌  | 8343/11049 [1:25:54<27:44,  1.63it/s]
 76%|███████▌  | 8344/11049 [1:25:55<27:41,  1.63it/s]
                                                      
{'loss': 0.1795, 'grad_norm': 0.632594108581543, 'learning_rate': 1.717347645850954e-06, 'epoch': 2.27}

 76%|███████▌  | 8344/11049 [1:25:55<27:41,  1.63it/s]
 76%|███████▌  | 8345/11049 [1:25:56<27:39,  1.63it/s]
                                                      
{'loss': 0.13, 'grad_norm': 0.5480101108551025, 'learning_rate': 1.7161562862724018e-06, 'epoch': 2.27}

 76%|███████▌  | 8345/11049 [1:25:56<27:39,  1.63it/s]
 76%|███████▌  | 8346/11049 [1:25:56<27:39,  1.63it/s]
                                                      
{'loss': 0.1472, 'grad_norm': 0.5482389330863953, 'learning_rate': 1.7149652544568979e-06, 'epoch': 2.27}

 76%|███████▌  | 8346/11049 [1:25:56<27:39,  1.63it/s]
 76%|███████▌  | 8347/11049 [1:25:57<27:37,  1.63it/s]
                                                      
{'loss': 0.1451, 'grad_norm': 0.5659443140029907, 'learning_rate': 1.7137745505233205e-06, 'epoch': 2.27}

 76%|███████▌  | 8347/11049 [1:25:57<27:37,  1.63it/s]
 76%|███████▌  | 8348/11049 [1:25:57<27:37,  1.63it/s]
                                                      
{'loss': 0.1465, 'grad_norm': 0.6121643781661987, 'learning_rate': 1.7125841745905125e-06, 'epoch': 2.27}

 76%|███████▌  | 8348/11049 [1:25:57<27:37,  1.63it/s]
 76%|███████▌  | 8349/11049 [1:25:58<27:36,  1.63it/s]
                                                      
{'loss': 0.1583, 'grad_norm': 0.5926708579063416, 'learning_rate': 1.7113941267772905e-06, 'epoch': 2.27}

 76%|███████▌  | 8349/11049 [1:25:58<27:36,  1.63it/s]
 76%|███████▌  | 8350/11049 [1:25:59<27:35,  1.63it/s]
                                                      
{'loss': 0.2167, 'grad_norm': 0.7220140099525452, 'learning_rate': 1.7102044072024315e-06, 'epoch': 2.27}

 76%|███████▌  | 8350/11049 [1:25:59<27:35,  1.63it/s]
 76%|███████▌  | 8351/11049 [1:25:59<27:35,  1.63it/s]
                                                      
{'loss': 0.1743, 'grad_norm': 0.6276757717132568, 'learning_rate': 1.709015015984683e-06, 'epoch': 2.27}

 76%|███████▌  | 8351/11049 [1:25:59<27:35,  1.63it/s]
 76%|███████▌  | 8352/11049 [1:26:00<27:34,  1.63it/s]
                                                      
{'loss': 0.1363, 'grad_norm': 0.5782604813575745, 'learning_rate': 1.7078259532427588e-06, 'epoch': 2.27}

 76%|███████▌  | 8352/11049 [1:26:00<27:34,  1.63it/s]
 76%|███████▌  | 8353/11049 [1:26:00<27:36,  1.63it/s]
                                                      
{'loss': 0.1407, 'grad_norm': 0.5619516968727112, 'learning_rate': 1.70663721909534e-06, 'epoch': 2.27}

 76%|███████▌  | 8353/11049 [1:26:01<27:36,  1.63it/s]
 76%|███████▌  | 8354/11049 [1:26:01<27:34,  1.63it/s]
                                                      
{'loss': 0.2032, 'grad_norm': 0.7823924422264099, 'learning_rate': 1.705448813661076e-06, 'epoch': 2.27}

 76%|███████▌  | 8354/11049 [1:26:01<27:34,  1.63it/s]
 76%|███████▌  | 8355/11049 [1:26:02<27:33,  1.63it/s]
                                                      
{'loss': 0.1425, 'grad_norm': 0.5338935256004333, 'learning_rate': 1.7042607370585811e-06, 'epoch': 2.27}

 76%|███████▌  | 8355/11049 [1:26:02<27:33,  1.63it/s]
 76%|███████▌  | 8356/11049 [1:26:02<27:32,  1.63it/s]
                                                      
{'loss': 0.1434, 'grad_norm': 0.5273129940032959, 'learning_rate': 1.7030729894064373e-06, 'epoch': 2.27}

 76%|███████▌  | 8356/11049 [1:26:02<27:32,  1.63it/s]
 76%|███████▌  | 8357/11049 [1:26:03<27:31,  1.63it/s]
                                                      
{'loss': 0.1314, 'grad_norm': 0.5788148641586304, 'learning_rate': 1.7018855708231984e-06, 'epoch': 2.27}

 76%|███████▌  | 8357/11049 [1:26:03<27:31,  1.63it/s]
 76%|███████▌  | 8358/11049 [1:26:04<27:32,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.638477087020874, 'learning_rate': 1.7006984814273791e-06, 'epoch': 2.27}

 76%|███████▌  | 8358/11049 [1:26:04<27:32,  1.63it/s]
 76%|███████▌  | 8359/11049 [1:26:04<27:31,  1.63it/s]
                                                      
{'loss': 0.182, 'grad_norm': 0.6698648929595947, 'learning_rate': 1.699511721337464e-06, 'epoch': 2.27}

 76%|███████▌  | 8359/11049 [1:26:04<27:31,  1.63it/s]
 76%|███████▌  | 8360/11049 [1:26:05<27:30,  1.63it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.5479671359062195, 'learning_rate': 1.698325290671905e-06, 'epoch': 2.27}

 76%|███████▌  | 8360/11049 [1:26:05<27:30,  1.63it/s]
 76%|███████▌  | 8361/11049 [1:26:05<27:29,  1.63it/s]
                                                      
{'loss': 0.123, 'grad_norm': 0.5111842751502991, 'learning_rate': 1.6971391895491202e-06, 'epoch': 2.27}

 76%|███████▌  | 8361/11049 [1:26:05<27:29,  1.63it/s]
 76%|███████▌  | 8362/11049 [1:26:06<27:28,  1.63it/s]
                                                      
{'loss': 0.1513, 'grad_norm': 0.5378645062446594, 'learning_rate': 1.6959534180874953e-06, 'epoch': 2.27}

 76%|███████▌  | 8362/11049 [1:26:06<27:28,  1.63it/s]
 76%|███████▌  | 8363/11049 [1:26:07<27:30,  1.63it/s]
                                                      
{'loss': 0.1401, 'grad_norm': 0.5003219842910767, 'learning_rate': 1.6947679764053831e-06, 'epoch': 2.27}

 76%|███████▌  | 8363/11049 [1:26:07<27:30,  1.63it/s]
 76%|███████▌  | 8364/11049 [1:26:07<27:29,  1.63it/s]
                                                      
{'loss': 0.1463, 'grad_norm': 0.6288915872573853, 'learning_rate': 1.6935828646211022e-06, 'epoch': 2.27}

 76%|███████▌  | 8364/11049 [1:26:07<27:29,  1.63it/s]
 76%|███████▌  | 8365/11049 [1:26:08<27:27,  1.63it/s]
                                                      
{'loss': 0.1813, 'grad_norm': 0.6695075631141663, 'learning_rate': 1.6923980828529424e-06, 'epoch': 2.27}

 76%|███████▌  | 8365/11049 [1:26:08<27:27,  1.63it/s]
 76%|███████▌  | 8366/11049 [1:26:08<27:27,  1.63it/s]
                                                      
{'loss': 0.1758, 'grad_norm': 0.6451592445373535, 'learning_rate': 1.6912136312191562e-06, 'epoch': 2.27}

 76%|███████▌  | 8366/11049 [1:26:09<27:27,  1.63it/s]
 76%|███████▌  | 8367/11049 [1:26:09<27:27,  1.63it/s]
                                                      
{'loss': 0.1451, 'grad_norm': 0.5834389925003052, 'learning_rate': 1.690029509837965e-06, 'epoch': 2.27}

 76%|███████▌  | 8367/11049 [1:26:09<27:27,  1.63it/s]
 76%|███████▌  | 8368/11049 [1:26:10<27:30,  1.62it/s]
                                                      
{'loss': 0.1853, 'grad_norm': 0.6715351343154907, 'learning_rate': 1.6888457188275549e-06, 'epoch': 2.27}

 76%|███████▌  | 8368/11049 [1:26:10<27:30,  1.62it/s]
 76%|███████▌  | 8369/11049 [1:26:10<27:27,  1.63it/s]
                                                      
{'loss': 0.1825, 'grad_norm': 0.606208086013794, 'learning_rate': 1.6876622583060854e-06, 'epoch': 2.27}

 76%|███████▌  | 8369/11049 [1:26:10<27:27,  1.63it/s]
 76%|███████▌  | 8370/11049 [1:26:11<27:26,  1.63it/s]
                                                      
{'loss': 0.1542, 'grad_norm': 0.6342045068740845, 'learning_rate': 1.6864791283916748e-06, 'epoch': 2.27}

 76%|███████▌  | 8370/11049 [1:26:11<27:26,  1.63it/s]
 76%|███████▌  | 8371/11049 [1:26:11<27:24,  1.63it/s]
                                                      
{'loss': 0.1386, 'grad_norm': 0.5727235078811646, 'learning_rate': 1.6852963292024132e-06, 'epoch': 2.27}

 76%|███████▌  | 8371/11049 [1:26:12<27:24,  1.63it/s]
 76%|███████▌  | 8372/11049 [1:26:12<27:23,  1.63it/s]
                                                      
{'loss': 0.1637, 'grad_norm': 0.48947474360466003, 'learning_rate': 1.6841138608563556e-06, 'epoch': 2.27}

 76%|███████▌  | 8372/11049 [1:26:12<27:23,  1.63it/s]
 76%|███████▌  | 8373/11049 [1:26:13<27:24,  1.63it/s]
                                                      
{'loss': 0.213, 'grad_norm': 0.6729266047477722, 'learning_rate': 1.6829317234715276e-06, 'epoch': 2.27}

 76%|███████▌  | 8373/11049 [1:26:13<27:24,  1.63it/s]
 76%|███████▌  | 8374/11049 [1:26:13<27:22,  1.63it/s]
                                                      
{'loss': 0.1439, 'grad_norm': 0.5998575091362, 'learning_rate': 1.6817499171659186e-06, 'epoch': 2.27}

 76%|███████▌  | 8374/11049 [1:26:13<27:22,  1.63it/s]
 76%|███████▌  | 8375/11049 [1:26:14<27:20,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.6132214069366455, 'learning_rate': 1.6805684420574847e-06, 'epoch': 2.27}

 76%|███████▌  | 8375/11049 [1:26:14<27:20,  1.63it/s]
 76%|███████▌  | 8376/11049 [1:26:15<27:20,  1.63it/s]
                                                      
{'loss': 0.1601, 'grad_norm': 0.6005515456199646, 'learning_rate': 1.679387298264149e-06, 'epoch': 2.27}

 76%|███████▌  | 8376/11049 [1:26:15<27:20,  1.63it/s]
 76%|███████▌  | 8377/11049 [1:26:15<27:19,  1.63it/s]
                                                      
{'loss': 0.1491, 'grad_norm': 0.571901798248291, 'learning_rate': 1.678206485903805e-06, 'epoch': 2.27}

 76%|███████▌  | 8377/11049 [1:26:15<27:19,  1.63it/s]
 76%|███████▌  | 8378/11049 [1:26:16<27:19,  1.63it/s]
                                                      
{'loss': 0.1779, 'grad_norm': 0.6225916743278503, 'learning_rate': 1.6770260050943093e-06, 'epoch': 2.27}

 76%|███████▌  | 8378/11049 [1:26:16<27:19,  1.63it/s]
 76%|███████▌  | 8379/11049 [1:26:16<27:18,  1.63it/s]
                                                      
{'loss': 0.1914, 'grad_norm': 0.600023627281189, 'learning_rate': 1.675845855953488e-06, 'epoch': 2.28}

 76%|███████▌  | 8379/11049 [1:26:17<27:18,  1.63it/s]
 76%|███████▌  | 8380/11049 [1:26:17<27:17,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.5211473703384399, 'learning_rate': 1.674666038599128e-06, 'epoch': 2.28}

 76%|███████▌  | 8380/11049 [1:26:17<27:17,  1.63it/s]
 76%|███████▌  | 8381/11049 [1:26:18<27:16,  1.63it/s]
                                                      
{'loss': 0.1415, 'grad_norm': 0.5128268599510193, 'learning_rate': 1.673486553148993e-06, 'epoch': 2.28}

 76%|███████▌  | 8381/11049 [1:26:18<27:16,  1.63it/s]
 76%|███████▌  | 8382/11049 [1:26:18<27:16,  1.63it/s]
                                                      
{'loss': 0.2059, 'grad_norm': 0.6370213031768799, 'learning_rate': 1.672307399720806e-06, 'epoch': 2.28}

 76%|███████▌  | 8382/11049 [1:26:18<27:16,  1.63it/s]
 76%|███████▌  | 8383/11049 [1:26:19<27:17,  1.63it/s]
                                                      
{'loss': 0.1483, 'grad_norm': 0.5431011915206909, 'learning_rate': 1.67112857843226e-06, 'epoch': 2.28}

 76%|███████▌  | 8383/11049 [1:26:19<27:17,  1.63it/s]
 76%|███████▌  | 8384/11049 [1:26:19<27:16,  1.63it/s]
                                                      
{'loss': 0.1392, 'grad_norm': 0.5678338408470154, 'learning_rate': 1.6699500894010123e-06, 'epoch': 2.28}

 76%|███████▌  | 8384/11049 [1:26:20<27:16,  1.63it/s]
 76%|███████▌  | 8385/11049 [1:26:20<27:14,  1.63it/s]
                                                      
{'loss': 0.1737, 'grad_norm': 0.7064125537872314, 'learning_rate': 1.6687719327446917e-06, 'epoch': 2.28}

 76%|███████▌  | 8385/11049 [1:26:20<27:14,  1.63it/s]
 76%|███████▌  | 8386/11049 [1:26:21<27:13,  1.63it/s]
                                                      
{'loss': 0.1462, 'grad_norm': 0.5971304178237915, 'learning_rate': 1.6675941085808894e-06, 'epoch': 2.28}

 76%|███████▌  | 8386/11049 [1:26:21<27:13,  1.63it/s]
 76%|███████▌  | 8387/11049 [1:26:21<27:12,  1.63it/s]
                                                      
{'loss': 0.153, 'grad_norm': 0.5828694701194763, 'learning_rate': 1.6664166170271657e-06, 'epoch': 2.28}

 76%|███████▌  | 8387/11049 [1:26:21<27:12,  1.63it/s]
 76%|███████▌  | 8388/11049 [1:26:22<27:14,  1.63it/s]
                                                      
{'loss': 0.1399, 'grad_norm': 0.5411574244499207, 'learning_rate': 1.6652394582010455e-06, 'epoch': 2.28}

 76%|███████▌  | 8388/11049 [1:26:22<27:14,  1.63it/s]
 76%|███████▌  | 8389/11049 [1:26:23<27:12,  1.63it/s]
                                                      
{'loss': 0.2111, 'grad_norm': 0.6881314516067505, 'learning_rate': 1.6640626322200236e-06, 'epoch': 2.28}

 76%|███████▌  | 8389/11049 [1:26:23<27:12,  1.63it/s]
 76%|███████▌  | 8390/11049 [1:26:23<27:11,  1.63it/s]
                                                      
{'loss': 0.1489, 'grad_norm': 0.5335156917572021, 'learning_rate': 1.662886139201559e-06, 'epoch': 2.28}

 76%|███████▌  | 8390/11049 [1:26:23<27:11,  1.63it/s]
 76%|███████▌  | 8391/11049 [1:26:24<27:10,  1.63it/s]
                                                      
{'loss': 0.1438, 'grad_norm': 0.5672688484191895, 'learning_rate': 1.661709979263078e-06, 'epoch': 2.28}

 76%|███████▌  | 8391/11049 [1:26:24<27:10,  1.63it/s]
 76%|███████▌  | 8392/11049 [1:26:24<27:08,  1.63it/s]
                                                      
{'loss': 0.1481, 'grad_norm': 0.5718771815299988, 'learning_rate': 1.6605341525219754e-06, 'epoch': 2.28}

 76%|███████▌  | 8392/11049 [1:26:25<27:08,  1.63it/s]
 76%|███████▌  | 8393/11049 [1:26:25<27:17,  1.62it/s]
                                                      
{'loss': 0.142, 'grad_norm': 0.612191915512085, 'learning_rate': 1.6593586590956084e-06, 'epoch': 2.28}

 76%|███████▌  | 8393/11049 [1:26:25<27:17,  1.62it/s]
 76%|███████▌  | 8394/11049 [1:26:26<27:14,  1.62it/s]
                                                      
{'loss': 0.1522, 'grad_norm': 0.6066256761550903, 'learning_rate': 1.658183499101308e-06, 'epoch': 2.28}

 76%|███████▌  | 8394/11049 [1:26:26<27:14,  1.62it/s]
 76%|███████▌  | 8395/11049 [1:26:26<27:12,  1.63it/s]
                                                      
{'loss': 0.137, 'grad_norm': 0.5398562550544739, 'learning_rate': 1.6570086726563661e-06, 'epoch': 2.28}

 76%|███████▌  | 8395/11049 [1:26:26<27:12,  1.63it/s]
 76%|███████▌  | 8396/11049 [1:26:27<27:10,  1.63it/s]
                                                      
{'loss': 0.151, 'grad_norm': 0.5634176135063171, 'learning_rate': 1.6558341798780431e-06, 'epoch': 2.28}

 76%|███████▌  | 8396/11049 [1:26:27<27:10,  1.63it/s]
 76%|███████▌  | 8397/11049 [1:26:27<27:08,  1.63it/s]
                                                      
{'loss': 0.1553, 'grad_norm': 0.6004531383514404, 'learning_rate': 1.6546600208835655e-06, 'epoch': 2.28}

 76%|███████▌  | 8397/11049 [1:26:28<27:08,  1.63it/s]
 76%|███████▌  | 8398/11049 [1:26:28<27:10,  1.63it/s]
                                                      
{'loss': 0.1942, 'grad_norm': 0.6787988543510437, 'learning_rate': 1.6534861957901277e-06, 'epoch': 2.28}

 76%|███████▌  | 8398/11049 [1:26:28<27:10,  1.63it/s]
 76%|███████▌  | 8399/11049 [1:26:29<27:07,  1.63it/s]
                                                      
{'loss': 0.1584, 'grad_norm': 0.6121244430541992, 'learning_rate': 1.65231270471489e-06, 'epoch': 2.28}

 76%|███████▌  | 8399/11049 [1:26:29<27:07,  1.63it/s]
 76%|███████▌  | 8400/11049 [1:26:29<27:06,  1.63it/s]
                                                      
{'loss': 0.1837, 'grad_norm': 0.6855509877204895, 'learning_rate': 1.6511395477749792e-06, 'epoch': 2.28}

 76%|███████▌  | 8400/11049 [1:26:29<27:06,  1.63it/s]
 76%|███████▌  | 8401/11049 [1:26:30<27:06,  1.63it/s]
                                                      
{'loss': 0.1583, 'grad_norm': 0.5913326740264893, 'learning_rate': 1.6499667250874873e-06, 'epoch': 2.28}

 76%|███████▌  | 8401/11049 [1:26:30<27:06,  1.63it/s]
 76%|███████▌  | 8402/11049 [1:26:31<27:04,  1.63it/s]
                                                      
{'loss': 0.1368, 'grad_norm': 0.5147804617881775, 'learning_rate': 1.6487942367694787e-06, 'epoch': 2.28}

 76%|███████▌  | 8402/11049 [1:26:31<27:04,  1.63it/s]
 76%|███████▌  | 8403/11049 [1:26:31<27:04,  1.63it/s]
                                                      
{'loss': 0.2953, 'grad_norm': 0.9960676431655884, 'learning_rate': 1.647622082937978e-06, 'epoch': 2.28}

 76%|███████▌  | 8403/11049 [1:26:31<27:04,  1.63it/s]
 76%|███████▌  | 8404/11049 [1:26:32<27:04,  1.63it/s]
                                                      
{'loss': 0.1301, 'grad_norm': 0.5031755566596985, 'learning_rate': 1.6464502637099793e-06, 'epoch': 2.28}

 76%|███████▌  | 8404/11049 [1:26:32<27:04,  1.63it/s]
 76%|███████▌  | 8405/11049 [1:26:32<27:02,  1.63it/s]
                                                      
{'loss': 0.1447, 'grad_norm': 0.5762933492660522, 'learning_rate': 1.645278779202442e-06, 'epoch': 2.28}

 76%|███████▌  | 8405/11049 [1:26:32<27:02,  1.63it/s]
 76%|███████▌  | 8406/11049 [1:26:33<27:00,  1.63it/s]
                                                      
{'loss': 0.156, 'grad_norm': 0.7153913378715515, 'learning_rate': 1.6441076295322938e-06, 'epoch': 2.28}

 76%|███████▌  | 8406/11049 [1:26:33<27:00,  1.63it/s]
 76%|███████▌  | 8407/11049 [1:26:34<26:59,  1.63it/s]
                                                      
{'loss': 0.1435, 'grad_norm': 0.5766890645027161, 'learning_rate': 1.6429368148164283e-06, 'epoch': 2.28}

 76%|███████▌  | 8407/11049 [1:26:34<26:59,  1.63it/s]
 76%|███████▌  | 8408/11049 [1:26:34<26:59,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.6299124360084534, 'learning_rate': 1.641766335171704e-06, 'epoch': 2.28}

 76%|███████▌  | 8408/11049 [1:26:34<26:59,  1.63it/s]
 76%|███████▌  | 8409/11049 [1:26:35<26:58,  1.63it/s]
                                                      
{'loss': 0.1799, 'grad_norm': 0.5938787460327148, 'learning_rate': 1.640596190714947e-06, 'epoch': 2.28}

 76%|███████▌  | 8409/11049 [1:26:35<26:58,  1.63it/s]
 76%|███████▌  | 8410/11049 [1:26:35<26:58,  1.63it/s]
                                                      
{'loss': 0.1454, 'grad_norm': 0.5767030715942383, 'learning_rate': 1.639426381562953e-06, 'epoch': 2.28}

 76%|███████▌  | 8410/11049 [1:26:36<26:58,  1.63it/s]
 76%|███████▌  | 8411/11049 [1:26:36<26:58,  1.63it/s]
                                                      
{'loss': 0.1184, 'grad_norm': 0.4700973927974701, 'learning_rate': 1.6382569078324806e-06, 'epoch': 2.28}

 76%|███████▌  | 8411/11049 [1:26:36<26:58,  1.63it/s]
 76%|███████▌  | 8412/11049 [1:26:37<26:58,  1.63it/s]
                                                      
{'loss': 0.1478, 'grad_norm': 0.5426054000854492, 'learning_rate': 1.6370877696402554e-06, 'epoch': 2.28}

 76%|███████▌  | 8412/11049 [1:26:37<26:58,  1.63it/s]
 76%|███████▌  | 8413/11049 [1:26:37<26:57,  1.63it/s]
                                                      
{'loss': 0.1788, 'grad_norm': 0.7485825419425964, 'learning_rate': 1.635918967102968e-06, 'epoch': 2.28}

 76%|███████▌  | 8413/11049 [1:26:37<26:57,  1.63it/s]
 76%|███████▌  | 8414/11049 [1:26:38<26:56,  1.63it/s]
                                                      
{'loss': 0.1305, 'grad_norm': 0.497578501701355, 'learning_rate': 1.6347505003372815e-06, 'epoch': 2.28}

 76%|███████▌  | 8414/11049 [1:26:38<26:56,  1.63it/s]
 76%|███████▌  | 8415/11049 [1:26:38<26:55,  1.63it/s]
                                                      
{'loss': 0.1657, 'grad_norm': 0.5677443742752075, 'learning_rate': 1.6335823694598218e-06, 'epoch': 2.28}

 76%|███████▌  | 8415/11049 [1:26:39<26:55,  1.63it/s]
 76%|███████▌  | 8416/11049 [1:26:39<26:54,  1.63it/s]
                                                      
{'loss': 0.1617, 'grad_norm': 0.6585888266563416, 'learning_rate': 1.6324145745871768e-06, 'epoch': 2.29}

 76%|███████▌  | 8416/11049 [1:26:39<26:54,  1.63it/s]
 76%|███████▌  | 8417/11049 [1:26:40<26:53,  1.63it/s]
                                                      
{'loss': 0.1621, 'grad_norm': 0.6303524374961853, 'learning_rate': 1.631247115835905e-06, 'epoch': 2.29}

 76%|███████▌  | 8417/11049 [1:26:40<26:53,  1.63it/s]
 76%|███████▌  | 8418/11049 [1:26:40<26:53,  1.63it/s]
                                                      
{'loss': 0.1658, 'grad_norm': 0.7228988409042358, 'learning_rate': 1.6300799933225358e-06, 'epoch': 2.29}

 76%|███████▌  | 8418/11049 [1:26:40<26:53,  1.63it/s]
 76%|███████▌  | 8419/11049 [1:26:41<26:52,  1.63it/s]
                                                      
{'loss': 0.1662, 'grad_norm': 0.5983651280403137, 'learning_rate': 1.6289132071635578e-06, 'epoch': 2.29}

 76%|███████▌  | 8419/11049 [1:26:41<26:52,  1.63it/s]
 76%|███████▌  | 8420/11049 [1:26:42<26:51,  1.63it/s]
                                                      
{'loss': 0.1519, 'grad_norm': 0.5819565653800964, 'learning_rate': 1.627746757475429e-06, 'epoch': 2.29}

 76%|███████▌  | 8420/11049 [1:26:42<26:51,  1.63it/s]
 76%|███████▌  | 8421/11049 [1:26:42<26:50,  1.63it/s]
                                                      
{'loss': 0.171, 'grad_norm': 0.628540575504303, 'learning_rate': 1.626580644374573e-06, 'epoch': 2.29}

 76%|███████▌  | 8421/11049 [1:26:42<26:50,  1.63it/s]
 76%|███████▌  | 8422/11049 [1:26:43<26:50,  1.63it/s]
                                                      
{'loss': 0.1509, 'grad_norm': 0.5588104128837585, 'learning_rate': 1.6254148679773828e-06, 'epoch': 2.29}

 76%|███████▌  | 8422/11049 [1:26:43<26:50,  1.63it/s]
 76%|███████▌  | 8423/11049 [1:26:43<26:50,  1.63it/s]
                                                      
{'loss': 0.1637, 'grad_norm': 0.6081946492195129, 'learning_rate': 1.6242494284002142e-06, 'epoch': 2.29}

 76%|███████▌  | 8423/11049 [1:26:44<26:50,  1.63it/s]
 76%|███████▌  | 8424/11049 [1:26:44<26:49,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.5393409729003906, 'learning_rate': 1.6230843257593904e-06, 'epoch': 2.29}

 76%|███████▌  | 8424/11049 [1:26:44<26:49,  1.63it/s]
 76%|███████▋  | 8425/11049 [1:26:45<26:48,  1.63it/s]
                                                      
{'loss': 0.1275, 'grad_norm': 0.5057241320610046, 'learning_rate': 1.6219195601712011e-06, 'epoch': 2.29}

 76%|███████▋  | 8425/11049 [1:26:45<26:48,  1.63it/s]
 76%|███████▋  | 8426/11049 [1:26:45<26:48,  1.63it/s]
                                                      
{'loss': 0.1676, 'grad_norm': 0.6037322282791138, 'learning_rate': 1.6207551317519033e-06, 'epoch': 2.29}

 76%|███████▋  | 8426/11049 [1:26:45<26:48,  1.63it/s]
 76%|███████▋  | 8427/11049 [1:26:46<26:47,  1.63it/s]
                                                      
{'loss': 0.2007, 'grad_norm': 0.7505106925964355, 'learning_rate': 1.6195910406177185e-06, 'epoch': 2.29}

 76%|███████▋  | 8427/11049 [1:26:46<26:47,  1.63it/s]
 76%|███████▋  | 8428/11049 [1:26:46<26:47,  1.63it/s]
                                                      
{'loss': 0.1321, 'grad_norm': 0.573978841304779, 'learning_rate': 1.6184272868848362e-06, 'epoch': 2.29}

 76%|███████▋  | 8428/11049 [1:26:47<26:47,  1.63it/s]
 76%|███████▋  | 8429/11049 [1:26:47<26:49,  1.63it/s]
                                                      
{'loss': 0.1156, 'grad_norm': 0.4419057071208954, 'learning_rate': 1.61726387066941e-06, 'epoch': 2.29}

 76%|███████▋  | 8429/11049 [1:26:47<26:49,  1.63it/s]
 76%|███████▋  | 8430/11049 [1:26:48<26:48,  1.63it/s]
                                                      
{'loss': 0.1399, 'grad_norm': 0.5803470015525818, 'learning_rate': 1.6161007920875643e-06, 'epoch': 2.29}

 76%|███████▋  | 8430/11049 [1:26:48<26:48,  1.63it/s]
 76%|███████▋  | 8431/11049 [1:26:48<26:47,  1.63it/s]
                                                      
{'loss': 0.152, 'grad_norm': 0.6713011860847473, 'learning_rate': 1.6149380512553854e-06, 'epoch': 2.29}

 76%|███████▋  | 8431/11049 [1:26:48<26:47,  1.63it/s]
 76%|███████▋  | 8432/11049 [1:26:49<26:45,  1.63it/s]
                                                      
{'loss': 0.1485, 'grad_norm': 0.5449032187461853, 'learning_rate': 1.6137756482889273e-06, 'epoch': 2.29}

 76%|███████▋  | 8432/11049 [1:26:49<26:45,  1.63it/s]
 76%|███████▋  | 8433/11049 [1:26:50<26:44,  1.63it/s]
                                                      
{'loss': 0.1564, 'grad_norm': 0.6397559642791748, 'learning_rate': 1.6126135833042107e-06, 'epoch': 2.29}

 76%|███████▋  | 8433/11049 [1:26:50<26:44,  1.63it/s]
 76%|███████▋  | 8434/11049 [1:26:50<26:44,  1.63it/s]
                                                      
{'loss': 0.1843, 'grad_norm': 0.6468387246131897, 'learning_rate': 1.6114518564172215e-06, 'epoch': 2.29}

 76%|███████▋  | 8434/11049 [1:26:50<26:44,  1.63it/s]
 76%|███████▋  | 8435/11049 [1:26:51<26:42,  1.63it/s]
                                                      
{'loss': 0.1395, 'grad_norm': 0.4989222288131714, 'learning_rate': 1.6102904677439136e-06, 'epoch': 2.29}

 76%|███████▋  | 8435/11049 [1:26:51<26:42,  1.63it/s]
 76%|███████▋  | 8436/11049 [1:26:51<26:41,  1.63it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.584014356136322, 'learning_rate': 1.6091294174002053e-06, 'epoch': 2.29}

 76%|███████▋  | 8436/11049 [1:26:52<26:41,  1.63it/s]
 76%|███████▋  | 8437/11049 [1:26:52<26:41,  1.63it/s]
                                                      
{'loss': 0.1202, 'grad_norm': 0.47787100076675415, 'learning_rate': 1.607968705501981e-06, 'epoch': 2.29}

 76%|███████▋  | 8437/11049 [1:26:52<26:41,  1.63it/s]
 76%|███████▋  | 8438/11049 [1:26:53<26:41,  1.63it/s]
                                                      
{'loss': 0.1594, 'grad_norm': 0.6024457812309265, 'learning_rate': 1.6068083321650945e-06, 'epoch': 2.29}

 76%|███████▋  | 8438/11049 [1:26:53<26:41,  1.63it/s]
 76%|███████▋  | 8439/11049 [1:26:53<26:40,  1.63it/s]
                                                      
{'loss': 0.1681, 'grad_norm': 0.6087808609008789, 'learning_rate': 1.6056482975053633e-06, 'epoch': 2.29}

 76%|███████▋  | 8439/11049 [1:26:53<26:40,  1.63it/s]
 76%|███████▋  | 8440/11049 [1:26:54<26:40,  1.63it/s]
                                                      
{'loss': 0.1649, 'grad_norm': 0.5796208381652832, 'learning_rate': 1.6044886016385702e-06, 'epoch': 2.29}

 76%|███████▋  | 8440/11049 [1:26:54<26:40,  1.63it/s]
 76%|███████▋  | 8441/11049 [1:26:54<26:39,  1.63it/s]
                                                      
{'loss': 0.1637, 'grad_norm': 0.569863498210907, 'learning_rate': 1.603329244680466e-06, 'epoch': 2.29}

 76%|███████▋  | 8441/11049 [1:26:55<26:39,  1.63it/s]
 76%|███████▋  | 8442/11049 [1:26:55<26:39,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.6486663818359375, 'learning_rate': 1.602170226746767e-06, 'epoch': 2.29}

 76%|███████▋  | 8442/11049 [1:26:55<26:39,  1.63it/s]
 76%|███████▋  | 8443/11049 [1:26:56<26:38,  1.63it/s]
                                                      
{'loss': 0.1482, 'grad_norm': 0.6060296893119812, 'learning_rate': 1.6010115479531557e-06, 'epoch': 2.29}

 76%|███████▋  | 8443/11049 [1:26:56<26:38,  1.63it/s]
 76%|███████▋  | 8444/11049 [1:26:56<26:37,  1.63it/s]
                                                      
{'loss': 0.1891, 'grad_norm': 0.5401607751846313, 'learning_rate': 1.5998532084152808e-06, 'epoch': 2.29}

 76%|███████▋  | 8444/11049 [1:26:56<26:37,  1.63it/s]
 76%|███████▋  | 8445/11049 [1:26:57<26:36,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.637802004814148, 'learning_rate': 1.598695208248755e-06, 'epoch': 2.29}

 76%|███████▋  | 8445/11049 [1:26:57<26:36,  1.63it/s]
 76%|███████▋  | 8446/11049 [1:26:58<26:34,  1.63it/s]
                                                      
{'loss': 0.1525, 'grad_norm': 0.6103750467300415, 'learning_rate': 1.5975375475691628e-06, 'epoch': 2.29}

 76%|███████▋  | 8446/11049 [1:26:58<26:34,  1.63it/s]
 76%|███████▋  | 8447/11049 [1:26:58<26:34,  1.63it/s]
                                                      
{'loss': 0.1275, 'grad_norm': 0.4859590530395508, 'learning_rate': 1.5963802264920496e-06, 'epoch': 2.29}

 76%|███████▋  | 8447/11049 [1:26:58<26:34,  1.63it/s]
 76%|███████▋  | 8448/11049 [1:26:59<26:34,  1.63it/s]
                                                      
{'loss': 0.2176, 'grad_norm': 0.728939414024353, 'learning_rate': 1.5952232451329286e-06, 'epoch': 2.29}

 76%|███████▋  | 8448/11049 [1:26:59<26:34,  1.63it/s]
 76%|███████▋  | 8449/11049 [1:26:59<26:34,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.6266988515853882, 'learning_rate': 1.594066603607277e-06, 'epoch': 2.29}

 76%|███████▋  | 8449/11049 [1:26:59<26:34,  1.63it/s]
 76%|███████▋  | 8450/11049 [1:27:00<26:33,  1.63it/s]
                                                      
{'loss': 0.1613, 'grad_norm': 0.6860489249229431, 'learning_rate': 1.5929103020305441e-06, 'epoch': 2.29}

 76%|███████▋  | 8450/11049 [1:27:00<26:33,  1.63it/s]
 76%|███████▋  | 8451/11049 [1:27:01<26:32,  1.63it/s]
                                                      
{'loss': 0.1507, 'grad_norm': 0.6293909549713135, 'learning_rate': 1.5917543405181408e-06, 'epoch': 2.29}

 76%|███████▋  | 8451/11049 [1:27:01<26:32,  1.63it/s]
 76%|███████▋  | 8452/11049 [1:27:01<26:32,  1.63it/s]
                                                      
{'loss': 0.1445, 'grad_norm': 0.6051616668701172, 'learning_rate': 1.5905987191854411e-06, 'epoch': 2.29}

 76%|███████▋  | 8452/11049 [1:27:01<26:32,  1.63it/s]
 77%|███████▋  | 8453/11049 [1:27:02<26:32,  1.63it/s]
                                                      
{'loss': 0.1682, 'grad_norm': 0.6488270163536072, 'learning_rate': 1.589443438147789e-06, 'epoch': 2.3}

 77%|███████▋  | 8453/11049 [1:27:02<26:32,  1.63it/s]
 77%|███████▋  | 8454/11049 [1:27:02<26:32,  1.63it/s]
                                                      
{'loss': 0.1727, 'grad_norm': 0.7010993957519531, 'learning_rate': 1.588288497520497e-06, 'epoch': 2.3}

 77%|███████▋  | 8454/11049 [1:27:03<26:32,  1.63it/s]
 77%|███████▋  | 8455/11049 [1:27:03<26:32,  1.63it/s]
                                                      
{'loss': 0.1551, 'grad_norm': 0.553698718547821, 'learning_rate': 1.5871338974188388e-06, 'epoch': 2.3}

 77%|███████▋  | 8455/11049 [1:27:03<26:32,  1.63it/s]
 77%|███████▋  | 8456/11049 [1:27:04<26:32,  1.63it/s]
                                                      
{'loss': 0.1409, 'grad_norm': 0.5616575479507446, 'learning_rate': 1.5859796379580562e-06, 'epoch': 2.3}

 77%|███████▋  | 8456/11049 [1:27:04<26:32,  1.63it/s]
 77%|███████▋  | 8457/11049 [1:27:04<26:30,  1.63it/s]
                                                      
{'loss': 0.1837, 'grad_norm': 0.6575849652290344, 'learning_rate': 1.584825719253355e-06, 'epoch': 2.3}

 77%|███████▋  | 8457/11049 [1:27:04<26:30,  1.63it/s]
 77%|███████▋  | 8458/11049 [1:27:05<26:29,  1.63it/s]
                                                      
{'loss': 0.149, 'grad_norm': 0.565537691116333, 'learning_rate': 1.5836721414199124e-06, 'epoch': 2.3}

 77%|███████▋  | 8458/11049 [1:27:05<26:29,  1.63it/s]
 77%|███████▋  | 8459/11049 [1:27:05<26:29,  1.63it/s]
                                                      
{'loss': 0.1129, 'grad_norm': 0.4530937373638153, 'learning_rate': 1.5825189045728662e-06, 'epoch': 2.3}

 77%|███████▋  | 8459/11049 [1:27:06<26:29,  1.63it/s]
 77%|███████▋  | 8460/11049 [1:27:06<26:28,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.6630799770355225, 'learning_rate': 1.5813660088273214e-06, 'epoch': 2.3}

 77%|███████▋  | 8460/11049 [1:27:06<26:28,  1.63it/s]
 77%|███████▋  | 8461/11049 [1:27:07<26:27,  1.63it/s]
                                                      
{'loss': 0.1956, 'grad_norm': 0.7773380279541016, 'learning_rate': 1.5802134542983494e-06, 'epoch': 2.3}

 77%|███████▋  | 8461/11049 [1:27:07<26:27,  1.63it/s]
 77%|███████▋  | 8462/11049 [1:27:07<26:26,  1.63it/s]
                                                      
{'loss': 0.1405, 'grad_norm': 0.5712834000587463, 'learning_rate': 1.579061241100988e-06, 'epoch': 2.3}

 77%|███████▋  | 8462/11049 [1:27:07<26:26,  1.63it/s]
 77%|███████▋  | 8463/11049 [1:27:08<26:26,  1.63it/s]
                                                      
{'loss': 0.1539, 'grad_norm': 0.735120952129364, 'learning_rate': 1.5779093693502407e-06, 'epoch': 2.3}

 77%|███████▋  | 8463/11049 [1:27:08<26:26,  1.63it/s]
 77%|███████▋  | 8464/11049 [1:27:09<26:26,  1.63it/s]
                                                      
{'loss': 0.1577, 'grad_norm': 0.5695668458938599, 'learning_rate': 1.576757839161076e-06, 'epoch': 2.3}

 77%|███████▋  | 8464/11049 [1:27:09<26:26,  1.63it/s]
 77%|███████▋  | 8465/11049 [1:27:09<26:24,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.7967512607574463, 'learning_rate': 1.5756066506484285e-06, 'epoch': 2.3}

 77%|███████▋  | 8465/11049 [1:27:09<26:24,  1.63it/s]
 77%|███████▋  | 8466/11049 [1:27:10<26:24,  1.63it/s]
                                                      
{'loss': 0.1726, 'grad_norm': 0.6247627139091492, 'learning_rate': 1.5744558039272012e-06, 'epoch': 2.3}

 77%|███████▋  | 8466/11049 [1:27:10<26:24,  1.63it/s]
 77%|███████▋  | 8467/11049 [1:27:10<26:23,  1.63it/s]
                                                      
{'loss': 0.2231, 'grad_norm': 0.7087580561637878, 'learning_rate': 1.5733052991122606e-06, 'epoch': 2.3}

 77%|███████▋  | 8467/11049 [1:27:11<26:23,  1.63it/s]
 77%|███████▋  | 8468/11049 [1:27:11<26:22,  1.63it/s]
                                                      
{'loss': 0.1115, 'grad_norm': 0.4933576285839081, 'learning_rate': 1.572155136318439e-06, 'epoch': 2.3}

 77%|███████▋  | 8468/11049 [1:27:11<26:22,  1.63it/s]
 77%|███████▋  | 8469/11049 [1:27:12<26:21,  1.63it/s]
                                                      
{'loss': 0.1235, 'grad_norm': 0.4568175673484802, 'learning_rate': 1.5710053156605343e-06, 'epoch': 2.3}

 77%|███████▋  | 8469/11049 [1:27:12<26:21,  1.63it/s]
 77%|███████▋  | 8470/11049 [1:27:12<26:21,  1.63it/s]
                                                      
{'loss': 0.1448, 'grad_norm': 0.5887385010719299, 'learning_rate': 1.5698558372533124e-06, 'epoch': 2.3}

 77%|███████▋  | 8470/11049 [1:27:12<26:21,  1.63it/s]
 77%|███████▋  | 8471/11049 [1:27:13<26:21,  1.63it/s]
                                                      
{'loss': 0.1561, 'grad_norm': 0.5288458466529846, 'learning_rate': 1.5687067012115026e-06, 'epoch': 2.3}

 77%|███████▋  | 8471/11049 [1:27:13<26:21,  1.63it/s]
 77%|███████▋  | 8472/11049 [1:27:13<26:20,  1.63it/s]
                                                      
{'loss': 0.1439, 'grad_norm': 0.5699410438537598, 'learning_rate': 1.5675579076498015e-06, 'epoch': 2.3}

 77%|███████▋  | 8472/11049 [1:27:14<26:20,  1.63it/s]
 77%|███████▋  | 8473/11049 [1:27:14<26:18,  1.63it/s]
                                                      
{'loss': 0.1311, 'grad_norm': 0.6363035440444946, 'learning_rate': 1.5664094566828696e-06, 'epoch': 2.3}

 77%|███████▋  | 8473/11049 [1:27:14<26:18,  1.63it/s]
 77%|███████▋  | 8474/11049 [1:27:15<26:18,  1.63it/s]
                                                      
{'loss': 0.1734, 'grad_norm': 0.6565269827842712, 'learning_rate': 1.5652613484253376e-06, 'epoch': 2.3}

 77%|███████▋  | 8474/11049 [1:27:15<26:18,  1.63it/s]
 77%|███████▋  | 8475/11049 [1:27:15<26:17,  1.63it/s]
                                                      
{'loss': 0.1062, 'grad_norm': 0.4309229254722595, 'learning_rate': 1.5641135829917976e-06, 'epoch': 2.3}

 77%|███████▋  | 8475/11049 [1:27:15<26:17,  1.63it/s]
 77%|███████▋  | 8476/11049 [1:27:16<26:17,  1.63it/s]
                                                      
{'loss': 0.1589, 'grad_norm': 0.6401790380477905, 'learning_rate': 1.5629661604968094e-06, 'epoch': 2.3}

 77%|███████▋  | 8476/11049 [1:27:16<26:17,  1.63it/s]
 77%|███████▋  | 8477/11049 [1:27:17<26:16,  1.63it/s]
                                                      
{'loss': 0.1465, 'grad_norm': 0.5374053120613098, 'learning_rate': 1.5618190810548972e-06, 'epoch': 2.3}

 77%|███████▋  | 8477/11049 [1:27:17<26:16,  1.63it/s]
 77%|███████▋  | 8478/11049 [1:27:17<26:16,  1.63it/s]
                                                      
{'loss': 0.1618, 'grad_norm': 0.6625857353210449, 'learning_rate': 1.5606723447805527e-06, 'epoch': 2.3}

 77%|███████▋  | 8478/11049 [1:27:17<26:16,  1.63it/s]
 77%|███████▋  | 8479/11049 [1:27:18<26:15,  1.63it/s]
                                                      
{'loss': 0.1317, 'grad_norm': 0.48599642515182495, 'learning_rate': 1.5595259517882328e-06, 'epoch': 2.3}

 77%|███████▋  | 8479/11049 [1:27:18<26:15,  1.63it/s]
 77%|███████▋  | 8480/11049 [1:27:18<26:14,  1.63it/s]
                                                      
{'loss': 0.1306, 'grad_norm': 0.5118248462677002, 'learning_rate': 1.558379902192359e-06, 'epoch': 2.3}

 77%|███████▋  | 8480/11049 [1:27:18<26:14,  1.63it/s]
 77%|███████▋  | 8481/11049 [1:27:19<26:14,  1.63it/s]
                                                      
{'loss': 0.1881, 'grad_norm': 0.7166388630867004, 'learning_rate': 1.5572341961073185e-06, 'epoch': 2.3}

 77%|███████▋  | 8481/11049 [1:27:19<26:14,  1.63it/s]
 77%|███████▋  | 8482/11049 [1:27:20<26:13,  1.63it/s]
                                                      
{'loss': 0.1383, 'grad_norm': 0.52618408203125, 'learning_rate': 1.5560888336474678e-06, 'epoch': 2.3}

 77%|███████▋  | 8482/11049 [1:27:20<26:13,  1.63it/s]
 77%|███████▋  | 8483/11049 [1:27:20<26:13,  1.63it/s]
                                                      
{'loss': 0.1714, 'grad_norm': 0.6237035393714905, 'learning_rate': 1.5549438149271257e-06, 'epoch': 2.3}

 77%|███████▋  | 8483/11049 [1:27:20<26:13,  1.63it/s]
 77%|███████▋  | 8484/11049 [1:27:21<26:12,  1.63it/s]
                                                      
{'loss': 0.1228, 'grad_norm': 0.5548670887947083, 'learning_rate': 1.553799140060576e-06, 'epoch': 2.3}

 77%|███████▋  | 8484/11049 [1:27:21<26:12,  1.63it/s]
 77%|███████▋  | 8485/11049 [1:27:21<26:11,  1.63it/s]
                                                      
{'loss': 0.1199, 'grad_norm': 0.5055001378059387, 'learning_rate': 1.5526548091620696e-06, 'epoch': 2.3}

 77%|███████▋  | 8485/11049 [1:27:22<26:11,  1.63it/s]
 77%|███████▋  | 8486/11049 [1:27:22<26:11,  1.63it/s]
                                                      
{'loss': 0.1982, 'grad_norm': 0.7221011519432068, 'learning_rate': 1.5515108223458253e-06, 'epoch': 2.3}

 77%|███████▋  | 8486/11049 [1:27:22<26:11,  1.63it/s]
 77%|███████▋  | 8487/11049 [1:27:23<26:11,  1.63it/s]
                                                      
{'loss': 0.1776, 'grad_norm': 0.6477638483047485, 'learning_rate': 1.5503671797260257e-06, 'epoch': 2.3}

 77%|███████▋  | 8487/11049 [1:27:23<26:11,  1.63it/s]
 77%|███████▋  | 8488/11049 [1:27:23<26:10,  1.63it/s]
                                                      
{'loss': 0.1425, 'grad_norm': 0.5310701727867126, 'learning_rate': 1.5492238814168154e-06, 'epoch': 2.3}

 77%|███████▋  | 8488/11049 [1:27:23<26:10,  1.63it/s]
 77%|███████▋  | 8489/11049 [1:27:24<26:09,  1.63it/s]
                                                      
{'loss': 0.1866, 'grad_norm': 0.6346518397331238, 'learning_rate': 1.5480809275323073e-06, 'epoch': 2.3}

 77%|███████▋  | 8489/11049 [1:27:24<26:09,  1.63it/s]
 77%|███████▋  | 8490/11049 [1:27:24<26:08,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.6111799478530884, 'learning_rate': 1.5469383181865849e-06, 'epoch': 2.31}

 77%|███████▋  | 8490/11049 [1:27:25<26:08,  1.63it/s]
 77%|███████▋  | 8491/11049 [1:27:25<26:08,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.6239367723464966, 'learning_rate': 1.5457960534936905e-06, 'epoch': 2.31}

 77%|███████▋  | 8491/11049 [1:27:25<26:08,  1.63it/s]
 77%|███████▋  | 8492/11049 [1:27:26<26:08,  1.63it/s]
                                                      
{'loss': 0.1747, 'grad_norm': 0.6211966872215271, 'learning_rate': 1.5446541335676346e-06, 'epoch': 2.31}

 77%|███████▋  | 8492/11049 [1:27:26<26:08,  1.63it/s]
 77%|███████▋  | 8493/11049 [1:27:26<26:07,  1.63it/s]
                                                      
{'loss': 0.1617, 'grad_norm': 0.5755857825279236, 'learning_rate': 1.543512558522392e-06, 'epoch': 2.31}

 77%|███████▋  | 8493/11049 [1:27:26<26:07,  1.63it/s]
 77%|███████▋  | 8494/11049 [1:27:27<26:06,  1.63it/s]
                                                      
{'loss': 0.1906, 'grad_norm': 0.6492534279823303, 'learning_rate': 1.5423713284719066e-06, 'epoch': 2.31}

 77%|███████▋  | 8494/11049 [1:27:27<26:06,  1.63it/s]
 77%|███████▋  | 8495/11049 [1:27:28<26:05,  1.63it/s]
                                                      
{'loss': 0.1715, 'grad_norm': 0.5529235601425171, 'learning_rate': 1.5412304435300846e-06, 'epoch': 2.31}

 77%|███████▋  | 8495/11049 [1:27:28<26:05,  1.63it/s]
 77%|███████▋  | 8496/11049 [1:27:28<26:06,  1.63it/s]
                                                      
{'loss': 0.1613, 'grad_norm': 0.5826166868209839, 'learning_rate': 1.5400899038107986e-06, 'epoch': 2.31}

 77%|███████▋  | 8496/11049 [1:27:28<26:06,  1.63it/s]
 77%|███████▋  | 8497/11049 [1:27:29<26:05,  1.63it/s]
                                                      
{'loss': 0.1477, 'grad_norm': 0.5167511105537415, 'learning_rate': 1.5389497094278861e-06, 'epoch': 2.31}

 77%|███████▋  | 8497/11049 [1:27:29<26:05,  1.63it/s]
 77%|███████▋  | 8498/11049 [1:27:29<26:05,  1.63it/s]
                                                      
{'loss': 0.1523, 'grad_norm': 0.5922922492027283, 'learning_rate': 1.5378098604951514e-06, 'epoch': 2.31}

 77%|███████▋  | 8498/11049 [1:27:30<26:05,  1.63it/s]
 77%|███████▋  | 8499/11049 [1:27:30<26:05,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5403009653091431, 'learning_rate': 1.5366703571263635e-06, 'epoch': 2.31}

 77%|███████▋  | 8499/11049 [1:27:30<26:05,  1.63it/s]
 77%|███████▋  | 8500/11049 [1:27:31<26:04,  1.63it/s]
                                                      
{'loss': 0.1626, 'grad_norm': 0.5888908505439758, 'learning_rate': 1.5355311994352574e-06, 'epoch': 2.31}

 77%|███████▋  | 8500/11049 [1:27:31<26:04,  1.63it/s]

  0%|          | 0/13 [00:00<?, ?it/s]

 15%|█▌        | 2/13 [00:00<00:00, 13.26it/s]

 31%|███       | 4/13 [00:00<00:01,  8.40it/s]

 38%|███▊      | 5/13 [00:00<00:01,  7.80it/s]

 46%|████▌     | 6/13 [00:00<00:00,  7.42it/s]

 54%|█████▍    | 7/13 [00:00<00:00,  7.18it/s]

 62%|██████▏   | 8/13 [00:01<00:00,  7.02it/s]

 69%|██████▉   | 9/13 [00:01<00:00,  6.91it/s]

 77%|███████▋  | 10/13 [00:01<00:00,  6.83it/s]

 85%|████████▍ | 11/13 [00:01<00:00,  6.78it/s]

 92%|█████████▏| 12/13 [00:01<00:00,  6.75it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]
                                                      

                                               
{'eval_loss': 0.5491322875022888, 'eval_runtime': 1.9534, 'eval_samples_per_second': 102.385, 'eval_steps_per_second': 6.655, 'epoch': 2.31}

 77%|███████▋  | 8500/11049 [1:27:33<26:04,  1.63it/s]

100%|██████████| 13/13 [00:01<00:00,  6.76it/s]

                                               
 77%|███████▋  | 8501/11049 [1:27:33<51:01,  1.20s/it]
                                                      
{'loss': 0.1589, 'grad_norm': 0.6208034157752991, 'learning_rate': 1.534392387535531e-06, 'epoch': 2.31}

 77%|███████▋  | 8501/11049 [1:27:33<51:01,  1.20s/it]
 77%|███████▋  | 8502/11049 [1:27:34<43:29,  1.02s/it]
                                                      
{'loss': 0.1556, 'grad_norm': 0.5698168873786926, 'learning_rate': 1.5332539215408543e-06, 'epoch': 2.31}

 77%|███████▋  | 8502/11049 [1:27:34<43:29,  1.02s/it]
 77%|███████▋  | 8503/11049 [1:27:34<38:14,  1.11it/s]
                                                      
{'loss': 0.1484, 'grad_norm': 0.5787609815597534, 'learning_rate': 1.5321158015648557e-06, 'epoch': 2.31}

 77%|███████▋  | 8503/11049 [1:27:35<38:14,  1.11it/s]
 77%|███████▋  | 8504/11049 [1:27:35<34:34,  1.23it/s]
                                                      
{'loss': 0.1317, 'grad_norm': 0.5116350650787354, 'learning_rate': 1.5309780277211334e-06, 'epoch': 2.31}

 77%|███████▋  | 8504/11049 [1:27:35<34:34,  1.23it/s]
 77%|███████▋  | 8505/11049 [1:27:36<31:59,  1.33it/s]
                                                      
{'loss': 0.1593, 'grad_norm': 0.5911427736282349, 'learning_rate': 1.529840600123248e-06, 'epoch': 2.31}

 77%|███████▋  | 8505/11049 [1:27:36<31:59,  1.33it/s]
 77%|███████▋  | 8506/11049 [1:27:36<30:11,  1.40it/s]
                                                      
{'loss': 0.1641, 'grad_norm': 0.6052718758583069, 'learning_rate': 1.5287035188847277e-06, 'epoch': 2.31}

 77%|███████▋  | 8506/11049 [1:27:36<30:11,  1.40it/s]
 77%|███████▋  | 8507/11049 [1:27:37<28:54,  1.47it/s]
                                                      
{'loss': 0.1711, 'grad_norm': 0.612575113773346, 'learning_rate': 1.5275667841190655e-06, 'epoch': 2.31}

 77%|███████▋  | 8507/11049 [1:27:37<28:54,  1.47it/s]
 77%|███████▋  | 8508/11049 [1:27:37<28:00,  1.51it/s]
                                                      
{'loss': 0.1868, 'grad_norm': 0.6511251330375671, 'learning_rate': 1.5264303959397197e-06, 'epoch': 2.31}

 77%|███████▋  | 8508/11049 [1:27:38<28:00,  1.51it/s]
 77%|███████▋  | 8509/11049 [1:27:38<27:23,  1.55it/s]
                                                      
{'loss': 0.1613, 'grad_norm': 0.5953969955444336, 'learning_rate': 1.5252943544601128e-06, 'epoch': 2.31}

 77%|███████▋  | 8509/11049 [1:27:38<27:23,  1.55it/s]
 77%|███████▋  | 8510/11049 [1:27:39<26:57,  1.57it/s]
                                                      
{'loss': 0.1398, 'grad_norm': 0.5224390625953674, 'learning_rate': 1.524158659793637e-06, 'epoch': 2.31}

 77%|███████▋  | 8510/11049 [1:27:39<26:57,  1.57it/s]
 77%|███████▋  | 8511/11049 [1:27:39<26:38,  1.59it/s]
                                                      
{'loss': 0.1489, 'grad_norm': 0.5491414666175842, 'learning_rate': 1.5230233120536446e-06, 'epoch': 2.31}

 77%|███████▋  | 8511/11049 [1:27:39<26:38,  1.59it/s]
 77%|███████▋  | 8512/11049 [1:27:40<26:25,  1.60it/s]
                                                      
{'loss': 0.14, 'grad_norm': 0.6350457072257996, 'learning_rate': 1.5218883113534572e-06, 'epoch': 2.31}

 77%|███████▋  | 8512/11049 [1:27:40<26:25,  1.60it/s]
 77%|███████▋  | 8513/11049 [1:27:41<26:16,  1.61it/s]
                                                      
{'loss': 0.153, 'grad_norm': 0.5560262203216553, 'learning_rate': 1.5207536578063587e-06, 'epoch': 2.31}

 77%|███████▋  | 8513/11049 [1:27:41<26:16,  1.61it/s]
 77%|███████▋  | 8514/11049 [1:27:41<26:09,  1.62it/s]
                                                      
{'loss': 0.1427, 'grad_norm': 0.5814034342765808, 'learning_rate': 1.5196193515255996e-06, 'epoch': 2.31}

 77%|███████▋  | 8514/11049 [1:27:41<26:09,  1.62it/s]
 77%|███████▋  | 8515/11049 [1:27:42<26:04,  1.62it/s]
                                                      
{'loss': 0.1396, 'grad_norm': 0.5687140226364136, 'learning_rate': 1.518485392624397e-06, 'epoch': 2.31}

 77%|███████▋  | 8515/11049 [1:27:42<26:04,  1.62it/s]
 77%|███████▋  | 8516/11049 [1:27:42<26:00,  1.62it/s]
                                                      
{'loss': 0.1525, 'grad_norm': 0.6074162125587463, 'learning_rate': 1.5173517812159315e-06, 'epoch': 2.31}

 77%|███████▋  | 8516/11049 [1:27:43<26:00,  1.62it/s]
 77%|███████▋  | 8517/11049 [1:27:43<25:58,  1.62it/s]
                                                      
{'loss': 0.1399, 'grad_norm': 0.5389732718467712, 'learning_rate': 1.5162185174133492e-06, 'epoch': 2.31}

 77%|███████▋  | 8517/11049 [1:27:43<25:58,  1.62it/s]
 77%|███████▋  | 8518/11049 [1:27:44<25:56,  1.63it/s]
                                                      
{'loss': 0.1563, 'grad_norm': 0.5553683638572693, 'learning_rate': 1.5150856013297638e-06, 'epoch': 2.31}

 77%|███████▋  | 8518/11049 [1:27:44<25:56,  1.63it/s]
 77%|███████▋  | 8519/11049 [1:27:44<25:55,  1.63it/s]
                                                      
{'loss': 0.1654, 'grad_norm': 0.5982835292816162, 'learning_rate': 1.5139530330782515e-06, 'epoch': 2.31}

 77%|███████▋  | 8519/11049 [1:27:44<25:55,  1.63it/s]
 77%|███████▋  | 8520/11049 [1:27:45<25:53,  1.63it/s]
                                                      
{'loss': 0.1806, 'grad_norm': 0.6607706546783447, 'learning_rate': 1.5128208127718552e-06, 'epoch': 2.31}

 77%|███████▋  | 8520/11049 [1:27:45<25:53,  1.63it/s]
 77%|███████▋  | 8521/11049 [1:27:45<25:51,  1.63it/s]
                                                      
{'loss': 0.1617, 'grad_norm': 0.5846081376075745, 'learning_rate': 1.5116889405235807e-06, 'epoch': 2.31}

 77%|███████▋  | 8521/11049 [1:27:46<25:51,  1.63it/s]
 77%|███████▋  | 8522/11049 [1:27:46<25:52,  1.63it/s]
                                                      
{'loss': 0.1918, 'grad_norm': 0.5843491554260254, 'learning_rate': 1.5105574164464049e-06, 'epoch': 2.31}

 77%|███████▋  | 8522/11049 [1:27:46<25:52,  1.63it/s]
 77%|███████▋  | 8523/11049 [1:27:47<25:52,  1.63it/s]
                                                      
{'loss': 0.157, 'grad_norm': 0.5470932126045227, 'learning_rate': 1.509426240653265e-06, 'epoch': 2.31}

 77%|███████▋  | 8523/11049 [1:27:47<25:52,  1.63it/s]
 77%|███████▋  | 8524/11049 [1:27:47<25:50,  1.63it/s]
                                                      
{'loss': 0.1993, 'grad_norm': 0.7296537756919861, 'learning_rate': 1.508295413257062e-06, 'epoch': 2.31}

 77%|███████▋  | 8524/11049 [1:27:47<25:50,  1.63it/s]
 77%|███████▋  | 8525/11049 [1:27:48<25:50,  1.63it/s]
                                                      
{'loss': 0.1123, 'grad_norm': 0.44247427582740784, 'learning_rate': 1.5071649343706652e-06, 'epoch': 2.31}

 77%|███████▋  | 8525/11049 [1:27:48<25:50,  1.63it/s]
 77%|███████▋  | 8526/11049 [1:27:49<25:49,  1.63it/s]
                                                      
{'loss': 0.1697, 'grad_norm': 0.6859237551689148, 'learning_rate': 1.5060348041069107e-06, 'epoch': 2.31}

 77%|███████▋  | 8526/11049 [1:27:49<25:49,  1.63it/s]
 77%|███████▋  | 8527/11049 [1:27:49<25:47,  1.63it/s]
                                                      
{'loss': 0.1289, 'grad_norm': 0.5096915364265442, 'learning_rate': 1.5049050225785972e-06, 'epoch': 2.32}

 77%|███████▋  | 8527/11049 [1:27:49<25:47,  1.63it/s]
 77%|███████▋  | 8528/11049 [1:27:50<25:47,  1.63it/s]
                                                      
{'loss': 0.1774, 'grad_norm': 0.6625998020172119, 'learning_rate': 1.5037755898984885e-06, 'epoch': 2.32}

 77%|███████▋  | 8528/11049 [1:27:50<25:47,  1.63it/s]
 77%|███████▋  | 8529/11049 [1:27:50<25:46,  1.63it/s]
                                                      
{'loss': 0.134, 'grad_norm': 0.5077961683273315, 'learning_rate': 1.5026465061793122e-06, 'epoch': 2.32}

 77%|███████▋  | 8529/11049 [1:27:51<25:46,  1.63it/s]
 77%|███████▋  | 8530/11049 [1:27:51<25:46,  1.63it/s]
                                                      
{'loss': 0.1473, 'grad_norm': 0.5800626873970032, 'learning_rate': 1.501517771533767e-06, 'epoch': 2.32}

 77%|███████▋  | 8530/11049 [1:27:51<25:46,  1.63it/s]
 77%|███████▋  | 8531/11049 [1:27:52<25:44,  1.63it/s]
                                                      
{'loss': 0.137, 'grad_norm': 0.5790845155715942, 'learning_rate': 1.5003893860745106e-06, 'epoch': 2.32}

 77%|███████▋  | 8531/11049 [1:27:52<25:44,  1.63it/s]
 77%|███████▋  | 8532/11049 [1:27:52<25:44,  1.63it/s]
                                                      
{'loss': 0.1355, 'grad_norm': 0.5356542468070984, 'learning_rate': 1.4992613499141684e-06, 'epoch': 2.32}

 77%|███████▋  | 8532/11049 [1:27:52<25:44,  1.63it/s]
 77%|███████▋  | 8533/11049 [1:27:53<25:43,  1.63it/s]
                                                      
{'loss': 0.1619, 'grad_norm': 0.5865187644958496, 'learning_rate': 1.498133663165331e-06, 'epoch': 2.32}

 77%|███████▋  | 8533/11049 [1:27:53<25:43,  1.63it/s]
 77%|███████▋  | 8534/11049 [1:27:53<25:42,  1.63it/s]
                                                      
{'loss': 0.1723, 'grad_norm': 0.6647171378135681, 'learning_rate': 1.4970063259405526e-06, 'epoch': 2.32}

 77%|███████▋  | 8534/11049 [1:27:54<25:42,  1.63it/s]
 77%|███████▋  | 8535/11049 [1:27:54<25:42,  1.63it/s]
                                                      
{'loss': 0.1318, 'grad_norm': 0.5418614745140076, 'learning_rate': 1.4958793383523546e-06, 'epoch': 2.32}

 77%|███████▋  | 8535/11049 [1:27:54<25:42,  1.63it/s]
 77%|███████▋  | 8536/11049 [1:27:55<25:41,  1.63it/s]
                                                      
{'loss': 0.1233, 'grad_norm': 0.4652683138847351, 'learning_rate': 1.4947527005132224e-06, 'epoch': 2.32}

 77%|███████▋  | 8536/11049 [1:27:55<25:41,  1.63it/s]
 77%|███████▋  | 8537/11049 [1:27:55<25:40,  1.63it/s]
                                                      
{'loss': 0.1856, 'grad_norm': 0.6842949986457825, 'learning_rate': 1.4936264125356042e-06, 'epoch': 2.32}

 77%|███████▋  | 8537/11049 [1:27:55<25:40,  1.63it/s]
 77%|███████▋  | 8538/11049 [1:27:56<25:41,  1.63it/s]
                                                      
{'loss': 0.1652, 'grad_norm': 0.5974911451339722, 'learning_rate': 1.4925004745319195e-06, 'epoch': 2.32}

 77%|███████▋  | 8538/11049 [1:27:56<25:41,  1.63it/s]
 77%|███████▋  | 8539/11049 [1:27:57<25:40,  1.63it/s]
                                                      
{'loss': 0.1576, 'grad_norm': 0.6454868912696838, 'learning_rate': 1.4913748866145478e-06, 'epoch': 2.32}

 77%|███████▋  | 8539/11049 [1:27:57<25:40,  1.63it/s]
 77%|███████▋  | 8540/11049 [1:27:57<25:40,  1.63it/s]
                                                      
{'loss': 0.1212, 'grad_norm': 0.48538199067115784, 'learning_rate': 1.4902496488958346e-06, 'epoch': 2.32}

 77%|███████▋  | 8540/11049 [1:27:57<25:40,  1.63it/s]
 77%|███████▋  | 8541/11049 [1:27:58<25:38,  1.63it/s]
                                                      
{'loss': 0.1543, 'grad_norm': 0.5343666672706604, 'learning_rate': 1.4891247614880904e-06, 'epoch': 2.32}

 77%|███████▋  | 8541/11049 [1:27:58<25:38,  1.63it/s]
 77%|███████▋  | 8542/11049 [1:27:58<25:38,  1.63it/s]
                                                      
{'loss': 0.1607, 'grad_norm': 0.5225775241851807, 'learning_rate': 1.4880002245035917e-06, 'epoch': 2.32}

 77%|███████▋  | 8542/11049 [1:27:58<25:38,  1.63it/s]
 77%|███████▋  | 8543/11049 [1:27:59<25:37,  1.63it/s]
                                                      
{'loss': 0.131, 'grad_norm': 0.4802907407283783, 'learning_rate': 1.4868760380545788e-06, 'epoch': 2.32}

 77%|███████▋  | 8543/11049 [1:27:59<25:37,  1.63it/s]
 77%|███████▋  | 8544/11049 [1:28:00<25:36,  1.63it/s]
                                                      
{'loss': 0.1309, 'grad_norm': 0.49705201387405396, 'learning_rate': 1.4857522022532583e-06, 'epoch': 2.32}

 77%|███████▋  | 8544/11049 [1:28:00<25:36,  1.63it/s]
 77%|███████▋  | 8545/11049 [1:28:00<25:36,  1.63it/s]
                                                      
{'loss': 0.1519, 'grad_norm': 0.6509482264518738, 'learning_rate': 1.4846287172117996e-06, 'epoch': 2.32}

 77%|███████▋  | 8545/11049 [1:28:00<25:36,  1.63it/s]
 77%|███████▋  | 8546/11049 [1:28:01<25:35,  1.63it/s]
                                                      
{'loss': 0.1435, 'grad_norm': 0.5758345127105713, 'learning_rate': 1.4835055830423412e-06, 'epoch': 2.32}

 77%|███████▋  | 8546/11049 [1:28:01<25:35,  1.63it/s]
 77%|███████▋  | 8547/11049 [1:28:01<25:34,  1.63it/s]
                                                      
{'loss': 0.1368, 'grad_norm': 0.5585729479789734, 'learning_rate': 1.4823827998569828e-06, 'epoch': 2.32}

 77%|███████▋  | 8547/11049 [1:28:02<25:34,  1.63it/s]
 77%|███████▋  | 8548/11049 [1:28:02<25:33,  1.63it/s]
                                                      
{'loss': 0.1199, 'grad_norm': 0.4700539708137512, 'learning_rate': 1.48126036776779e-06, 'epoch': 2.32}

 77%|███████▋  | 8548/11049 [1:28:02<25:33,  1.63it/s]
 77%|███████▋  | 8549/11049 [1:28:03<25:33,  1.63it/s]
                                                      
{'loss': 0.1529, 'grad_norm': 0.6629021763801575, 'learning_rate': 1.4801382868867942e-06, 'epoch': 2.32}

 77%|███████▋  | 8549/11049 [1:28:03<25:33,  1.63it/s]
 77%|███████▋  | 8550/11049 [1:28:03<25:33,  1.63it/s]
                                                      
{'loss': 0.1697, 'grad_norm': 0.6036547422409058, 'learning_rate': 1.4790165573259901e-06, 'epoch': 2.32}

 77%|███████▋  | 8550/11049 [1:28:03<25:33,  1.63it/s]
 77%|███████▋  | 8551/11049 [1:28:04<25:33,  1.63it/s]
                                                      
{'loss': 0.1886, 'grad_norm': 0.6957660913467407, 'learning_rate': 1.47789517919734e-06, 'epoch': 2.32}

 77%|███████▋  | 8551/11049 [1:28:04<25:33,  1.63it/s]
 77%|███████▋  | 8552/11049 [1:28:04<25:31,  1.63it/s]
                                                      
{'loss': 0.1642, 'grad_norm': 0.5861278772354126, 'learning_rate': 1.4767741526127682e-06, 'epoch': 2.32}

 77%|███████▋  | 8552/11049 [1:28:05<25:31,  1.63it/s]
 77%|███████▋  | 8553/11049 [1:28:05<25:31,  1.63it/s]
                                                      
{'loss': 0.1314, 'grad_norm': 0.5075826644897461, 'learning_rate': 1.4756534776841642e-06, 'epoch': 2.32}

 77%|███████▋  | 8553/11049 [1:28:05<25:31,  1.63it/s]
 77%|███████▋  | 8554/11049 [1:28:06<25:31,  1.63it/s]
                                                      
{'loss': 0.1703, 'grad_norm': 0.5821376442909241, 'learning_rate': 1.4745331545233865e-06, 'epoch': 2.32}

 77%|███████▋  | 8554/11049 [1:28:06<25:31,  1.63it/s]
 77%|███████▋  | 8555/11049 [1:28:06<25:30,  1.63it/s]
                                                      
{'loss': 0.1394, 'grad_norm': 0.5130184292793274, 'learning_rate': 1.4734131832422538e-06, 'epoch': 2.32}

 77%|███████▋  | 8555/11049 [1:28:06<25:30,  1.63it/s]
 77%|███████▋  | 8556/11049 [1:28:07<25:29,  1.63it/s]
                                                      
{'loss': 0.1666, 'grad_norm': 0.6176965236663818, 'learning_rate': 1.4722935639525516e-06, 'epoch': 2.32}

 77%|███████▋  | 8556/11049 [1:28:07<25:29,  1.63it/s]
 77%|███████▋  | 8557/11049 [1:28:08<25:29,  1.63it/s]
                                                      
{'loss': 0.1371, 'grad_norm': 0.5681266188621521, 'learning_rate': 1.4711742967660286e-06, 'epoch': 2.32}

 77%|███████▋  | 8557/11049 [1:28:08<25:29,  1.63it/s]
 77%|███████▋  | 8558/11049 [1:28:08<25:28,  1.63it/s]
                                                      
{'loss': 0.1581, 'grad_norm': 0.5605348348617554, 'learning_rate': 1.4700553817944019e-06, 'epoch': 2.32}

 77%|███████▋  | 8558/11049 [1:28:08<25:28,  1.63it/s]
 77%|███████▋  | 8559/11049 [1:28:09<25:27,  1.63it/s]
                                                      
{'loss': 0.162, 'grad_norm': 0.5818426609039307, 'learning_rate': 1.4689368191493525e-06, 'epoch': 2.32}

 77%|███████▋  | 8559/11049 [1:28:09<25:27,  1.63it/s]
 77%|███████▋  | 8560/11049 [1:28:09<25:27,  1.63it/s]
                                                      
{'loss': 0.152, 'grad_norm': 0.5725645422935486, 'learning_rate': 1.4678186089425212e-06, 'epoch': 2.32}

 77%|███████▋  | 8560/11049 [1:28:10<25:27,  1.63it/s]
 77%|███████▋  | 8561/11049 [1:28:10<25:25,  1.63it/s]
                                                      
{'loss': 0.1952, 'grad_norm': 0.7750464081764221, 'learning_rate': 1.4667007512855174e-06, 'epoch': 2.32}

 77%|███████▋  | 8561/11049 [1:28:10<25:25,  1.63it/s]
 77%|███████▋  | 8562/11049 [1:28:11<25:25,  1.63it/s]
                                                      
{'loss': 0.1656, 'grad_norm': 0.6488786935806274, 'learning_rate': 1.4655832462899188e-06, 'epoch': 2.32}

 77%|███████▋  | 8562/11049 [1:28:11<25:25,  1.63it/s]
 78%|███████▊  | 8563/11049 [1:28:11<25:24,  1.63it/s]
                                                      
{'loss': 0.1757, 'grad_norm': 0.6110144257545471, 'learning_rate': 1.4644660940672628e-06, 'epoch': 2.33}

 78%|███████▊  | 8563/11049 [1:28:11<25:24,  1.63it/s]
 78%|███████▊  | 8564/11049 [1:28:12<25:23,  1.63it/s]
                                                      
{'loss': 0.1341, 'grad_norm': 0.4933154284954071, 'learning_rate': 1.4633492947290535e-06, 'epoch': 2.33}

 78%|███████▊  | 8564/11049 [1:28:12<25:23,  1.63it/s]
 78%|███████▊  | 8565/11049 [1:28:12<25:23,  1.63it/s]
                                                      
{'loss': 0.1282, 'grad_norm': 0.48267653584480286, 'learning_rate': 1.4622328483867587e-06, 'epoch': 2.33}

 78%|███████▊  | 8565/11049 [1:28:13<25:23,  1.63it/s]
 78%|███████▊  | 8566/11049 [1:28:13<25:23,  1.63it/s]
                                                      
{'loss': 0.1395, 'grad_norm': 0.5266100168228149, 'learning_rate': 1.4611167551518107e-06, 'epoch': 2.33}

 78%|███████▊  | 8566/11049 [1:28:13<25:23,  1.63it/s]
 78%|███████▊  | 8567/11049 [1:28:14<25:22,  1.63it/s]
                                                      
{'loss': 0.1523, 'grad_norm': 0.5716165900230408, 'learning_rate': 1.4600010151356114e-06, 'epoch': 2.33}

 78%|███████▊  | 8567/11049 [1:28:14<25:22,  1.63it/s]
 78%|███████▊  | 8568/11049 [1:28:14<25:21,  1.63it/s]
                                                      
{'loss': 0.1628, 'grad_norm': 0.611088752746582, 'learning_rate': 1.4588856284495228e-06, 'epoch': 2.33}

 78%|███████▊  | 8568/11049 [1:28:14<25:21,  1.63it/s]
 78%|███████▊  | 8569/11049 [1:28:15<25:20,  1.63it/s]
                                                      
{'loss': 0.1415, 'grad_norm': 0.5345529913902283, 'learning_rate': 1.4577705952048704e-06, 'epoch': 2.33}

 78%|███████▊  | 8569/11049 [1:28:15<25:20,  1.63it/s]
 78%|███████▊  | 8570/11049 [1:28:16<25:20,  1.63it/s]
                                                      
{'loss': 0.1896, 'grad_norm': 0.6447347402572632, 'learning_rate': 1.456655915512945e-06, 'epoch': 2.33}

 78%|███████▊  | 8570/11049 [1:28:16<25:20,  1.63it/s]
 78%|███████▊  | 8571/11049 [1:28:16<25:20,  1.63it/s]
                                                      
{'loss': 0.172, 'grad_norm': 0.6092621088027954, 'learning_rate': 1.4555415894850084e-06, 'epoch': 2.33}

 78%|███████▊  | 8571/11049 [1:28:16<25:20,  1.63it/s]
 78%|███████▊  | 8572/11049 [1:28:17<25:20,  1.63it/s]
                                                      
{'loss': 0.1673, 'grad_norm': 0.5956805348396301, 'learning_rate': 1.4544276172322796e-06, 'epoch': 2.33}

 78%|███████▊  | 8572/11049 [1:28:17<25:20,  1.63it/s]
 78%|███████▊  | 8573/11049 [1:28:17<25:19,  1.63it/s]
                                                      
{'loss': 0.2056, 'grad_norm': 0.7136529684066772, 'learning_rate': 1.4533139988659462e-06, 'epoch': 2.33}

 78%|███████▊  | 8573/11049 [1:28:18<25:19,  1.63it/s]
 78%|███████▊  | 8574/11049 [1:28:18<25:18,  1.63it/s]
                                                      
{'loss': 0.1278, 'grad_norm': 0.48781725764274597, 'learning_rate': 1.4522007344971566e-06, 'epoch': 2.33}

 78%|███████▊  | 8574/11049 [1:28:18<25:18,  1.63it/s]
 78%|███████▊  | 8575/11049 [1:28:19<25:18,  1.63it/s]
                                                      
{'loss': 0.1391, 'grad_norm': 0.5425506234169006, 'learning_rate': 1.4510878242370302e-06, 'epoch': 2.33}

 78%|███████▊  | 8575/11049 [1:28:19<25:18,  1.63it/s]
 78%|███████▊  | 8576/11049 [1:28:19<25:17,  1.63it/s]
                                                      
{'loss': 0.1905, 'grad_norm': 0.7399444580078125, 'learning_rate': 1.4499752681966467e-06, 'epoch': 2.33}

 78%|███████▊  | 8576/11049 [1:28:19<25:17,  1.63it/s]
 78%|███████▊  | 8577/11049 [1:28:20<25:17,  1.63it/s]
                                                      
{'loss': 0.1533, 'grad_norm': 0.6119254231452942, 'learning_rate': 1.4488630664870495e-06, 'epoch': 2.33}

 78%|███████▊  | 8577/11049 [1:28:20<25:17,  1.63it/s]
 78%|███████▊  | 8578/11049 [1:28:20<25:16,  1.63it/s]
                                                      
{'loss': 0.1836, 'grad_norm': 0.6561920642852783, 'learning_rate': 1.44775121921925e-06, 'epoch': 2.33}

 78%|███████▊  | 8578/11049 [1:28:21<25:16,  1.63it/s]
 78%|███████▊  | 8579/11049 [1:28:21<25:16,  1.63it/s]
                                                      
{'loss': 0.2314, 'grad_norm': 0.7016722559928894, 'learning_rate': 1.4466397265042215e-06, 'epoch': 2.33}

 78%|███████▊  | 8579/11049 [1:28:21<25:16,  1.63it/s]
 78%|███████▊  | 8580/11049 [1:28:22<25:16,  1.63it/s]
                                                      
{'loss': 0.1511, 'grad_norm': 0.5759789347648621, 'learning_rate': 1.4455285884529036e-06, 'epoch': 2.33}

 78%|███████▊  | 8580/11049 [1:28:22<25:16,  1.63it/s]
 78%|███████▊  | 8581/11049 [1:28:22<25:14,  1.63it/s]
                                                      
{'loss': 0.1522, 'grad_norm': 0.6395753026008606, 'learning_rate': 1.4444178051761991e-06, 'epoch': 2.33}

 78%|███████▊  | 8581/11049 [1:28:22<25:14,  1.63it/s]
 78%|███████▊  | 8582/11049 [1:28:23<25:13,  1.63it/s]
                                                      
{'loss': 0.1544, 'grad_norm': 0.5495280623435974, 'learning_rate': 1.4433073767849754e-06, 'epoch': 2.33}

 78%|███████▊  | 8582/11049 [1:28:23<25:13,  1.63it/s]
 78%|███████▊  | 8583/11049 [1:28:24<25:13,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.5808667540550232, 'learning_rate': 1.4421973033900682e-06, 'epoch': 2.33}

 78%|███████▊  | 8583/11049 [1:28:24<25:13,  1.63it/s]
 78%|███████▊  | 8584/11049 [1:28:24<25:12,  1.63it/s]
                                                      
{'loss': 0.1626, 'grad_norm': 0.5660806894302368, 'learning_rate': 1.4410875851022731e-06, 'epoch': 2.33}

 78%|███████▊  | 8584/11049 [1:28:24<25:12,  1.63it/s]
 78%|███████▊  | 8585/11049 [1:28:25<25:12,  1.63it/s]
                                                      
{'loss': 0.1208, 'grad_norm': 0.5811933279037476, 'learning_rate': 1.4399782220323515e-06, 'epoch': 2.33}

 78%|███████▊  | 8585/11049 [1:28:25<25:12,  1.63it/s]
 78%|███████▊  | 8586/11049 [1:28:25<25:12,  1.63it/s]
                                                      
{'loss': 0.1407, 'grad_norm': 0.5167320966720581, 'learning_rate': 1.438869214291031e-06, 'epoch': 2.33}

 78%|███████▊  | 8586/11049 [1:28:25<25:12,  1.63it/s]
 78%|███████▊  | 8587/11049 [1:28:26<25:10,  1.63it/s]
                                                      
{'loss': 0.1628, 'grad_norm': 0.6229787468910217, 'learning_rate': 1.4377605619890012e-06, 'epoch': 2.33}

 78%|███████▊  | 8587/11049 [1:28:26<25:10,  1.63it/s]
 78%|███████▊  | 8588/11049 [1:28:27<25:10,  1.63it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.6700026988983154, 'learning_rate': 1.4366522652369186e-06, 'epoch': 2.33}

 78%|███████▊  | 8588/11049 [1:28:27<25:10,  1.63it/s]
 78%|███████▊  | 8589/11049 [1:28:27<25:09,  1.63it/s]
                                                      
{'loss': 0.1268, 'grad_norm': 0.5503108501434326, 'learning_rate': 1.4355443241454026e-06, 'epoch': 2.33}

 78%|███████▊  | 8589/11049 [1:28:27<25:09,  1.63it/s]
 78%|███████▊  | 8590/11049 [1:28:28<25:08,  1.63it/s]
                                                      
{'loss': 0.1553, 'grad_norm': 0.5811002254486084, 'learning_rate': 1.4344367388250364e-06, 'epoch': 2.33}

 78%|███████▊  | 8590/11049 [1:28:28<25:08,  1.63it/s]
 78%|███████▊  | 8591/11049 [1:28:28<25:07,  1.63it/s]
                                                      
{'loss': 0.132, 'grad_norm': 0.515312135219574, 'learning_rate': 1.4333295093863714e-06, 'epoch': 2.33}

 78%|███████▊  | 8591/11049 [1:28:29<25:07,  1.63it/s]
 78%|███████▊  | 8592/11049 [1:28:29<25:06,  1.63it/s]
                                                      
{'loss': 0.1121, 'grad_norm': 0.44480037689208984, 'learning_rate': 1.4322226359399206e-06, 'epoch': 2.33}

 78%|███████▊  | 8592/11049 [1:28:29<25:06,  1.63it/s]
 78%|███████▊  | 8593/11049 [1:28:30<25:06,  1.63it/s]
                                                      
{'loss': 0.134, 'grad_norm': 0.4930947422981262, 'learning_rate': 1.4311161185961614e-06, 'epoch': 2.33}

 78%|███████▊  | 8593/11049 [1:28:30<25:06,  1.63it/s]
 78%|███████▊  | 8594/11049 [1:28:30<25:05,  1.63it/s]
                                                      
{'loss': 0.1531, 'grad_norm': 0.662965714931488, 'learning_rate': 1.4300099574655357e-06, 'epoch': 2.33}

 78%|███████▊  | 8594/11049 [1:28:30<25:05,  1.63it/s]
 78%|███████▊  | 8595/11049 [1:28:31<25:05,  1.63it/s]
                                                      
{'loss': 0.1862, 'grad_norm': 0.5631392598152161, 'learning_rate': 1.4289041526584512e-06, 'epoch': 2.33}

 78%|███████▊  | 8595/11049 [1:28:31<25:05,  1.63it/s]
 78%|███████▊  | 8596/11049 [1:28:31<25:04,  1.63it/s]
                                                      
{'loss': 0.1541, 'grad_norm': 0.56297767162323, 'learning_rate': 1.4277987042852787e-06, 'epoch': 2.33}

 78%|███████▊  | 8596/11049 [1:28:32<25:04,  1.63it/s]
 78%|███████▊  | 8597/11049 [1:28:32<25:04,  1.63it/s]
                                                      
{'loss': 0.1486, 'grad_norm': 0.5084378719329834, 'learning_rate': 1.426693612456354e-06, 'epoch': 2.33}

 78%|███████▊  | 8597/11049 [1:28:32<25:04,  1.63it/s]
 78%|███████▊  | 8598/11049 [1:28:33<25:03,  1.63it/s]
                                                      
{'loss': 0.1616, 'grad_norm': 0.5910356640815735, 'learning_rate': 1.4255888772819753e-06, 'epoch': 2.33}

 78%|███████▊  | 8598/11049 [1:28:33<25:03,  1.63it/s]
 78%|███████▊  | 8599/11049 [1:28:33<25:02,  1.63it/s]
                                                      
{'loss': 0.1623, 'grad_norm': 0.5865645408630371, 'learning_rate': 1.4244844988724104e-06, 'epoch': 2.33}

 78%|███████▊  | 8599/11049 [1:28:33<25:02,  1.63it/s]
 78%|███████▊  | 8600/11049 [1:28:34<25:02,  1.63it/s]
                                                      
{'loss': 0.1522, 'grad_norm': 0.5060887932777405, 'learning_rate': 1.4233804773378868e-06, 'epoch': 2.34}

 78%|███████▊  | 8600/11049 [1:28:34<25:02,  1.63it/s]
 78%|███████▊  | 8601/11049 [1:28:35<25:44,  1.59it/s]
                                                      
{'loss': 0.1413, 'grad_norm': 0.5794138312339783, 'learning_rate': 1.4222768127885977e-06, 'epoch': 2.34}

 78%|███████▊  | 8601/11049 [1:28:35<25:44,  1.59it/s]
 78%|███████▊  | 8602/11049 [1:28:35<25:30,  1.60it/s]
                                                      
{'loss': 0.1583, 'grad_norm': 0.5915778875350952, 'learning_rate': 1.4211735053346993e-06, 'epoch': 2.34}

 78%|███████▊  | 8602/11049 [1:28:35<25:30,  1.60it/s]
 78%|███████▊  | 8603/11049 [1:28:36<25:23,  1.61it/s]
                                                      
{'loss': 0.191, 'grad_norm': 0.6750567555427551, 'learning_rate': 1.4200705550863165e-06, 'epoch': 2.34}

 78%|███████▊  | 8603/11049 [1:28:36<25:23,  1.61it/s]
 78%|███████▊  | 8604/11049 [1:28:36<25:17,  1.61it/s]
                                                      
{'loss': 0.1456, 'grad_norm': 0.5935975909233093, 'learning_rate': 1.4189679621535352e-06, 'epoch': 2.34}

 78%|███████▊  | 8604/11049 [1:28:37<25:17,  1.61it/s]
 78%|███████▊  | 8605/11049 [1:28:37<25:10,  1.62it/s]
                                                      
{'loss': 0.1839, 'grad_norm': 0.5874063968658447, 'learning_rate': 1.417865726646404e-06, 'epoch': 2.34}

 78%|███████▊  | 8605/11049 [1:28:37<25:10,  1.62it/s]
 78%|███████▊  | 8606/11049 [1:28:38<25:08,  1.62it/s]
                                                      
{'loss': 0.1319, 'grad_norm': 0.5155820250511169, 'learning_rate': 1.4167638486749369e-06, 'epoch': 2.34}

 78%|███████▊  | 8606/11049 [1:28:38<25:08,  1.62it/s]
 78%|███████▊  | 8607/11049 [1:28:38<25:04,  1.62it/s]
                                                      
{'loss': 0.1514, 'grad_norm': 0.5992231369018555, 'learning_rate': 1.4156623283491171e-06, 'epoch': 2.34}

 78%|███████▊  | 8607/11049 [1:28:38<25:04,  1.62it/s]
 78%|███████▊  | 8608/11049 [1:28:39<25:04,  1.62it/s]
                                                      
{'loss': 0.1455, 'grad_norm': 0.601931095123291, 'learning_rate': 1.4145611657788866e-06, 'epoch': 2.34}

 78%|███████▊  | 8608/11049 [1:28:39<25:04,  1.62it/s]
 78%|███████▊  | 8609/11049 [1:28:40<25:02,  1.62it/s]
                                                      
{'loss': 0.1459, 'grad_norm': 0.5501323342323303, 'learning_rate': 1.4134603610741526e-06, 'epoch': 2.34}

 78%|███████▊  | 8609/11049 [1:28:40<25:02,  1.62it/s]
 78%|███████▊  | 8610/11049 [1:28:40<24:59,  1.63it/s]
                                                      
{'loss': 0.1535, 'grad_norm': 0.562897264957428, 'learning_rate': 1.412359914344786e-06, 'epoch': 2.34}

 78%|███████▊  | 8610/11049 [1:28:40<24:59,  1.63it/s]
 78%|███████▊  | 8611/11049 [1:28:41<24:58,  1.63it/s]
                                                      
{'loss': 0.1706, 'grad_norm': 0.5940181612968445, 'learning_rate': 1.4112598257006267e-06, 'epoch': 2.34}

 78%|███████▊  | 8611/11049 [1:28:41<24:58,  1.63it/s]
 78%|███████▊  | 8612/11049 [1:28:41<24:56,  1.63it/s]
                                                      
{'loss': 0.1341, 'grad_norm': 0.5811370611190796, 'learning_rate': 1.4101600952514738e-06, 'epoch': 2.34}

 78%|███████▊  | 8612/11049 [1:28:42<24:56,  1.63it/s]
 78%|███████▊  | 8613/11049 [1:28:42<24:57,  1.63it/s]
                                                      
{'loss': 0.2002, 'grad_norm': 0.6972641944885254, 'learning_rate': 1.4090607231070924e-06, 'epoch': 2.34}

 78%|███████▊  | 8613/11049 [1:28:42<24:57,  1.63it/s]
 78%|███████▊  | 8614/11049 [1:28:43<24:56,  1.63it/s]
                                                      
{'loss': 0.1261, 'grad_norm': 0.5397969484329224, 'learning_rate': 1.4079617093772113e-06, 'epoch': 2.34}

 78%|███████▊  | 8614/11049 [1:28:43<24:56,  1.63it/s]
 78%|███████▊  | 8615/11049 [1:28:43<24:55,  1.63it/s]
                                                      
{'loss': 0.1502, 'grad_norm': 0.5217072367668152, 'learning_rate': 1.406863054171524e-06, 'epoch': 2.34}

 78%|███████▊  | 8615/11049 [1:28:43<24:55,  1.63it/s]
 78%|███████▊  | 8616/11049 [1:28:44<24:54,  1.63it/s]
                                                      
{'loss': 0.1404, 'grad_norm': 0.5248201489448547, 'learning_rate': 1.4057647575996886e-06, 'epoch': 2.34}

 78%|███████▊  | 8616/11049 [1:28:44<24:54,  1.63it/s]
 78%|███████▊  | 8617/11049 [1:28:44<24:53,  1.63it/s]
                                                      
{'loss': 0.1565, 'grad_norm': 0.5767863392829895, 'learning_rate': 1.4046668197713259e-06, 'epoch': 2.34}

 78%|███████▊  | 8617/11049 [1:28:45<24:53,  1.63it/s]
 78%|███████▊  | 8618/11049 [1:28:45<24:54,  1.63it/s]
                                                      
{'loss': 0.1904, 'grad_norm': 0.7788520455360413, 'learning_rate': 1.4035692407960217e-06, 'epoch': 2.34}

 78%|███████▊  | 8618/11049 [1:28:45<24:54,  1.63it/s]
 78%|███████▊  | 8619/11049 [1:28:46<24:52,  1.63it/s]
                                                      
{'loss': 0.1808, 'grad_norm': 0.6450866460800171, 'learning_rate': 1.4024720207833287e-06, 'epoch': 2.34}

 78%|███████▊  | 8619/11049 [1:28:46<24:52,  1.63it/s]
 78%|███████▊  | 8620/11049 [1:28:46<24:51,  1.63it/s]
                                                      
{'loss': 0.1636, 'grad_norm': 0.6541178226470947, 'learning_rate': 1.40137515984276e-06, 'epoch': 2.34}

 78%|███████▊  | 8620/11049 [1:28:46<24:51,  1.63it/s]
 78%|███████▊  | 8621/11049 [1:28:47<24:51,  1.63it/s]
                                                      
{'loss': 0.1688, 'grad_norm': 0.6460602879524231, 'learning_rate': 1.4002786580837934e-06, 'epoch': 2.34}

 78%|███████▊  | 8621/11049 [1:28:47<24:51,  1.63it/s]
 78%|███████▊  | 8622/11049 [1:28:48<24:50,  1.63it/s]
                                                      
{'loss': 0.1458, 'grad_norm': 0.6091325283050537, 'learning_rate': 1.3991825156158729e-06, 'epoch': 2.34}

 78%|███████▊  | 8622/11049 [1:28:48<24:50,  1.63it/s]
 78%|███████▊  | 8623/11049 [1:28:48<24:52,  1.63it/s]
                                                      
{'loss': 0.1751, 'grad_norm': 0.6406018733978271, 'learning_rate': 1.3980867325484042e-06, 'epoch': 2.34}

 78%|███████▊  | 8623/11049 [1:28:48<24:52,  1.63it/s]
 78%|███████▊  | 8624/11049 [1:28:49<24:51,  1.63it/s]
                                                      
{'loss': 0.1744, 'grad_norm': 0.6552581787109375, 'learning_rate': 1.396991308990759e-06, 'epoch': 2.34}

 78%|███████▊  | 8624/11049 [1:28:49<24:51,  1.63it/s]
 78%|███████▊  | 8625/11049 [1:28:49<24:49,  1.63it/s]
                                                      
{'loss': 0.1399, 'grad_norm': 0.5567173957824707, 'learning_rate': 1.3958962450522711e-06, 'epoch': 2.34}

 78%|███████▊  | 8625/11049 [1:28:49<24:49,  1.63it/s]
 78%|███████▊  | 8626/11049 [1:28:50<24:49,  1.63it/s]
                                                      
{'loss': 0.174, 'grad_norm': 0.626884400844574, 'learning_rate': 1.3948015408422398e-06, 'epoch': 2.34}

 78%|███████▊  | 8626/11049 [1:28:50<24:49,  1.63it/s]
 78%|███████▊  | 8627/11049 [1:28:51<24:48,  1.63it/s]
                                                      
{'loss': 0.1289, 'grad_norm': 0.4724980890750885, 'learning_rate': 1.393707196469931e-06, 'epoch': 2.34}

 78%|███████▊  | 8627/11049 [1:28:51<24:48,  1.63it/s]
 78%|███████▊  | 8628/11049 [1:28:51<24:47,  1.63it/s]
                                                      
{'loss': 0.1644, 'grad_norm': 0.8175962567329407, 'learning_rate': 1.3926132120445707e-06, 'epoch': 2.34}

 78%|███████▊  | 8628/11049 [1:28:51<24:47,  1.63it/s]
 78%|███████▊  | 8629/11049 [1:28:52<24:45,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.5745538473129272, 'learning_rate': 1.3915195876753495e-06, 'epoch': 2.34}

 78%|███████▊  | 8629/11049 [1:28:52<24:45,  1.63it/s]
 78%|███████▊  | 8630/11049 [1:28:52<24:44,  1.63it/s]
                                                      
{'loss': 0.1339, 'grad_norm': 0.5012279748916626, 'learning_rate': 1.3904263234714238e-06, 'epoch': 2.34}

 78%|███████▊  | 8630/11049 [1:28:53<24:44,  1.63it/s]
 78%|███████▊  | 8631/11049 [1:28:53<24:45,  1.63it/s]
                                                      
{'loss': 0.1419, 'grad_norm': 0.5501984357833862, 'learning_rate': 1.3893334195419122e-06, 'epoch': 2.34}

 78%|███████▊  | 8631/11049 [1:28:53<24:45,  1.63it/s]
 78%|███████▊  | 8632/11049 [1:28:54<24:43,  1.63it/s]
                                                      
{'loss': 0.1536, 'grad_norm': 0.559971034526825, 'learning_rate': 1.3882408759958999e-06, 'epoch': 2.34}

 78%|███████▊  | 8632/11049 [1:28:54<24:43,  1.63it/s]
 78%|███████▊  | 8633/11049 [1:28:54<24:46,  1.63it/s]
                                                      
{'loss': 0.1901, 'grad_norm': 0.6686159372329712, 'learning_rate': 1.3871486929424326e-06, 'epoch': 2.34}

 78%|███████▊  | 8633/11049 [1:28:54<24:46,  1.63it/s]
 78%|███████▊  | 8634/11049 [1:28:55<24:44,  1.63it/s]
                                                      
{'loss': 0.1269, 'grad_norm': 0.5424582958221436, 'learning_rate': 1.386056870490522e-06, 'epoch': 2.34}

 78%|███████▊  | 8634/11049 [1:28:55<24:44,  1.63it/s]
 78%|███████▊  | 8635/11049 [1:28:56<24:42,  1.63it/s]
                                                      
{'loss': 0.1861, 'grad_norm': 0.7375528812408447, 'learning_rate': 1.384965408749146e-06, 'epoch': 2.34}

 78%|███████▊  | 8635/11049 [1:28:56<24:42,  1.63it/s]
 78%|███████▊  | 8636/11049 [1:28:56<24:42,  1.63it/s]
                                                      
{'loss': 0.121, 'grad_norm': 0.4845277667045593, 'learning_rate': 1.3838743078272427e-06, 'epoch': 2.34}

 78%|███████▊  | 8636/11049 [1:28:56<24:42,  1.63it/s]
 78%|███████▊  | 8637/11049 [1:28:57<24:41,  1.63it/s]
                                                      
{'loss': 0.1625, 'grad_norm': 0.5599804520606995, 'learning_rate': 1.3827835678337164e-06, 'epoch': 2.35}

 78%|███████▊  | 8637/11049 [1:28:57<24:41,  1.63it/s]
 78%|███████▊  | 8638/11049 [1:28:57<24:41,  1.63it/s]
                                                      
{'loss': 0.1552, 'grad_norm': 0.5666426420211792, 'learning_rate': 1.3816931888774326e-06, 'epoch': 2.35}

 78%|███████▊  | 8638/11049 [1:28:57<24:41,  1.63it/s]
 78%|███████▊  | 8639/11049 [1:28:58<24:40,  1.63it/s]
                                                      
{'loss': 0.1506, 'grad_norm': 0.5284912586212158, 'learning_rate': 1.3806031710672264e-06, 'epoch': 2.35}

 78%|███████▊  | 8639/11049 [1:28:58<24:40,  1.63it/s]
 78%|███████▊  | 8640/11049 [1:28:59<24:38,  1.63it/s]
                                                      
{'loss': 0.1318, 'grad_norm': 0.5294926762580872, 'learning_rate': 1.3795135145118927e-06, 'epoch': 2.35}

 78%|███████▊  | 8640/11049 [1:28:59<24:38,  1.63it/s]
 78%|███████▊  | 8641/11049 [1:28:59<24:37,  1.63it/s]
                                                      
{'loss': 0.1437, 'grad_norm': 0.6180323362350464, 'learning_rate': 1.3784242193201885e-06, 'epoch': 2.35}

 78%|███████▊  | 8641/11049 [1:28:59<24:37,  1.63it/s]
 78%|███████▊  | 8642/11049 [1:29:00<25:15,  1.59it/s]
                                                      
{'loss': 0.1451, 'grad_norm': 0.6375634670257568, 'learning_rate': 1.377335285600837e-06, 'epoch': 2.35}

 78%|███████▊  | 8642/11049 [1:29:00<25:15,  1.59it/s]
 78%|███████▊  | 8643/11049 [1:29:00<25:11,  1.59it/s]
                                                      
{'loss': 0.1463, 'grad_norm': 0.5573729276657104, 'learning_rate': 1.3762467134625285e-06, 'epoch': 2.35}

 78%|███████▊  | 8643/11049 [1:29:01<25:11,  1.59it/s]
 78%|███████▊  | 8644/11049 [1:29:01<24:59,  1.60it/s]
                                                      
{'loss': 0.114, 'grad_norm': 0.4580814242362976, 'learning_rate': 1.375158503013913e-06, 'epoch': 2.35}

 78%|███████▊  | 8644/11049 [1:29:01<24:59,  1.60it/s]
 78%|███████▊  | 8645/11049 [1:29:02<24:53,  1.61it/s]
                                                      
{'loss': 0.1721, 'grad_norm': 0.6632719039916992, 'learning_rate': 1.3740706543636056e-06, 'epoch': 2.35}

 78%|███████▊  | 8645/11049 [1:29:02<24:53,  1.61it/s]
 78%|███████▊  | 8646/11049 [1:29:02<24:48,  1.61it/s]
                                                      
{'loss': 0.149, 'grad_norm': 0.5674037337303162, 'learning_rate': 1.3729831676201832e-06, 'epoch': 2.35}

 78%|███████▊  | 8646/11049 [1:29:02<24:48,  1.61it/s]
 78%|███████▊  | 8647/11049 [1:29:03<24:43,  1.62it/s]
                                                      
{'loss': 0.1127, 'grad_norm': 0.4603267312049866, 'learning_rate': 1.371896042892193e-06, 'epoch': 2.35}

 78%|███████▊  | 8647/11049 [1:29:03<24:43,  1.62it/s]
 78%|███████▊  | 8648/11049 [1:29:04<24:44,  1.62it/s]
                                                      
{'loss': 0.1618, 'grad_norm': 0.6171126365661621, 'learning_rate': 1.370809280288139e-06, 'epoch': 2.35}

 78%|███████▊  | 8648/11049 [1:29:04<24:44,  1.62it/s]
 78%|███████▊  | 8649/11049 [1:29:04<24:40,  1.62it/s]
                                                      
{'loss': 0.1689, 'grad_norm': 0.7416496872901917, 'learning_rate': 1.369722879916493e-06, 'epoch': 2.35}

 78%|███████▊  | 8649/11049 [1:29:04<24:40,  1.62it/s]
 78%|███████▊  | 8650/11049 [1:29:05<24:37,  1.62it/s]
                                                      
{'loss': 0.1988, 'grad_norm': 0.6949034333229065, 'learning_rate': 1.3686368418856882e-06, 'epoch': 2.35}

 78%|███████▊  | 8650/11049 [1:29:05<24:37,  1.62it/s]
 78%|███████▊  | 8651/11049 [1:29:05<24:35,  1.63it/s]
                                                      
{'loss': 0.1627, 'grad_norm': 0.5565395951271057, 'learning_rate': 1.3675511663041235e-06, 'epoch': 2.35}

 78%|███████▊  | 8651/11049 [1:29:06<24:35,  1.63it/s]
 78%|███████▊  | 8652/11049 [1:29:06<24:33,  1.63it/s]
                                                      
{'loss': 0.1339, 'grad_norm': 0.48604199290275574, 'learning_rate': 1.3664658532801617e-06, 'epoch': 2.35}

 78%|███████▊  | 8652/11049 [1:29:06<24:33,  1.63it/s]
 78%|███████▊  | 8653/11049 [1:29:07<24:34,  1.62it/s]
                                                      
{'loss': 0.1615, 'grad_norm': 0.6755237579345703, 'learning_rate': 1.3653809029221276e-06, 'epoch': 2.35}

 78%|███████▊  | 8653/11049 [1:29:07<24:34,  1.62it/s]
 78%|███████▊  | 8654/11049 [1:29:07<24:32,  1.63it/s]
                                                      
{'loss': 0.2219, 'grad_norm': 0.7231707572937012, 'learning_rate': 1.3642963153383103e-06, 'epoch': 2.35}

 78%|███████▊  | 8654/11049 [1:29:07<24:32,  1.63it/s]
 78%|███████▊  | 8655/11049 [1:29:08<24:31,  1.63it/s]
                                                      
{'loss': 0.206, 'grad_norm': 0.8310089707374573, 'learning_rate': 1.3632120906369662e-06, 'epoch': 2.35}

 78%|███████▊  | 8655/11049 [1:29:08<24:31,  1.63it/s]
 78%|███████▊  | 8656/11049 [1:29:08<24:30,  1.63it/s]
                                                      
{'loss': 0.1861, 'grad_norm': 0.732280433177948, 'learning_rate': 1.362128228926311e-06, 'epoch': 2.35}

 78%|███████▊  | 8656/11049 [1:29:09<24:30,  1.63it/s]
 78%|███████▊  | 8657/11049 [1:29:09<24:29,  1.63it/s]
                                                      
{'loss': 0.1538, 'grad_norm': 0.5478379726409912, 'learning_rate': 1.3610447303145258e-06, 'epoch': 2.35}

 78%|███████▊  | 8657/11049 [1:29:09<24:29,  1.63it/s]
 78%|███████▊  | 8658/11049 [1:29:10<24:29,  1.63it/s]
                                                      
{'loss': 0.1347, 'grad_norm': 0.5377070903778076, 'learning_rate': 1.3599615949097554e-06, 'epoch': 2.35}

 78%|███████▊  | 8658/11049 [1:29:10<24:29,  1.63it/s]
 78%|███████▊  | 8659/11049 [1:29:10<24:27,  1.63it/s]
                                                      
{'loss': 0.1361, 'grad_norm': 0.5284850597381592, 'learning_rate': 1.3588788228201084e-06, 'epoch': 2.35}

 78%|███████▊  | 8659/11049 [1:29:10<24:27,  1.63it/s]
 78%|███████▊  | 8660/11049 [1:29:11<25:03,  1.59it/s]
                                                      
{'loss': 0.1667, 'grad_norm': 0.597614586353302, 'learning_rate': 1.3577964141536571e-06, 'epoch': 2.35}

 78%|███████▊  | 8660/11049 [1:29:11<25:03,  1.59it/s]
 78%|███████▊  | 8661/11049 [1:29:12<24:59,  1.59it/s]
                                                      
{'loss': 0.1987, 'grad_norm': 0.7183689475059509, 'learning_rate': 1.3567143690184382e-06, 'epoch': 2.35}

 78%|███████▊  | 8661/11049 [1:29:12<24:59,  1.59it/s]
 78%|███████▊  | 8662/11049 [1:29:12<24:47,  1.60it/s]
                                                      
{'loss': 0.1382, 'grad_norm': 0.5135778188705444, 'learning_rate': 1.3556326875224485e-06, 'epoch': 2.35}

 78%|███████▊  | 8662/11049 [1:29:12<24:47,  1.60it/s]
 78%|███████▊  | 8663/11049 [1:29:13<24:41,  1.61it/s]
                                                      
{'loss': 0.138, 'grad_norm': 0.5350017547607422, 'learning_rate': 1.3545513697736562e-06, 'epoch': 2.35}

 78%|███████▊  | 8663/11049 [1:29:13<24:41,  1.61it/s]
 78%|███████▊  | 8664/11049 [1:29:13<24:35,  1.62it/s]
                                                      
{'loss': 0.1876, 'grad_norm': 0.7028031349182129, 'learning_rate': 1.3534704158799861e-06, 'epoch': 2.35}

 78%|███████▊  | 8664/11049 [1:29:14<24:35,  1.62it/s]
 78%|███████▊  | 8665/11049 [1:29:14<24:31,  1.62it/s]
                                                      
{'loss': 0.1381, 'grad_norm': 0.6591993570327759, 'learning_rate': 1.352389825949329e-06, 'epoch': 2.35}

 78%|███████▊  | 8665/11049 [1:29:14<24:31,  1.62it/s]
 78%|███████▊  | 8666/11049 [1:29:15<24:28,  1.62it/s]
                                                      
{'loss': 0.1513, 'grad_norm': 0.6204719543457031, 'learning_rate': 1.3513096000895398e-06, 'epoch': 2.35}

 78%|███████▊  | 8666/11049 [1:29:15<24:28,  1.62it/s]
 78%|███████▊  | 8667/11049 [1:29:15<24:26,  1.62it/s]
                                                      
{'loss': 0.1687, 'grad_norm': 0.7340061664581299, 'learning_rate': 1.3502297384084368e-06, 'epoch': 2.35}

 78%|███████▊  | 8667/11049 [1:29:15<24:26,  1.62it/s]
 78%|███████▊  | 8668/11049 [1:29:16<24:27,  1.62it/s]
                                                      
{'loss': 0.168, 'grad_norm': 0.5647674202919006, 'learning_rate': 1.3491502410138007e-06, 'epoch': 2.35}

 78%|███████▊  | 8668/11049 [1:29:16<24:27,  1.62it/s]
 78%|███████▊  | 8669/11049 [1:29:17<24:25,  1.62it/s]
                                                      
{'loss': 0.173, 'grad_norm': 0.6839601397514343, 'learning_rate': 1.3480711080133785e-06, 'epoch': 2.35}

 78%|███████▊  | 8669/11049 [1:29:17<24:25,  1.62it/s]
 78%|███████▊  | 8670/11049 [1:29:17<24:24,  1.62it/s]
                                                      
{'loss': 0.1525, 'grad_norm': 0.6800884008407593, 'learning_rate': 1.3469923395148777e-06, 'epoch': 2.35}

 78%|███████▊  | 8670/11049 [1:29:17<24:24,  1.62it/s]
 78%|███████▊  | 8671/11049 [1:29:18<24:22,  1.63it/s]
                                                      
{'loss': 0.142, 'grad_norm': 0.5922407507896423, 'learning_rate': 1.3459139356259725e-06, 'epoch': 2.35}

 78%|███████▊  | 8671/11049 [1:29:18<24:22,  1.63it/s]
 78%|███████▊  | 8672/11049 [1:29:18<24:21,  1.63it/s]
                                                      
{'loss': 0.1193, 'grad_norm': 0.4573700726032257, 'learning_rate': 1.3448358964542996e-06, 'epoch': 2.35}

 78%|███████▊  | 8672/11049 [1:29:18<24:21,  1.63it/s]
 78%|███████▊  | 8673/11049 [1:29:19<24:19,  1.63it/s]
                                                      
{'loss': 0.1169, 'grad_norm': 0.4490795135498047, 'learning_rate': 1.3437582221074574e-06, 'epoch': 2.35}

 78%|███████▊  | 8673/11049 [1:29:19<24:19,  1.63it/s]
 79%|███████▊  | 8674/11049 [1:29:20<24:19,  1.63it/s]
                                                      
{'loss': 0.1578, 'grad_norm': 0.6945204138755798, 'learning_rate': 1.3426809126930096e-06, 'epoch': 2.36}

 79%|███████▊  | 8674/11049 [1:29:20<24:19,  1.63it/s]
 79%|███████▊  | 8675/11049 [1:29:20<24:16,  1.63it/s]
                                                      
{'loss': 0.1468, 'grad_norm': 0.5415352582931519, 'learning_rate': 1.3416039683184846e-06, 'epoch': 2.36}

 79%|███████▊  | 8675/11049 [1:29:20<24:16,  1.63it/s]
 79%|███████▊  | 8676/11049 [1:29:21<24:16,  1.63it/s]
                                                      
{'loss': 0.1402, 'grad_norm': 0.5342780947685242, 'learning_rate': 1.340527389091374e-06, 'epoch': 2.36}

 79%|███████▊  | 8676/11049 [1:29:21<24:16,  1.63it/s]
 79%|███████▊  | 8677/11049 [1:29:21<24:16,  1.63it/s]
                                                      
{'loss': 0.1651, 'grad_norm': 0.5900495052337646, 'learning_rate': 1.3394511751191291e-06, 'epoch': 2.36}

 79%|███████▊  | 8677/11049 [1:29:22<24:16,  1.63it/s]
 79%|███████▊  | 8678/11049 [1:29:22<24:17,  1.63it/s]
                                                      
{'loss': 0.1806, 'grad_norm': 0.6915639638900757, 'learning_rate': 1.3383753265091676e-06, 'epoch': 2.36}

 79%|███████▊  | 8678/11049 [1:29:22<24:17,  1.63it/s]
 79%|███████▊  | 8679/11049 [1:29:23<24:16,  1.63it/s]
                                                      
{'loss': 0.1094, 'grad_norm': 0.4533596336841583, 'learning_rate': 1.3372998433688734e-06, 'epoch': 2.36}

 79%|███████▊  | 8679/11049 [1:29:23<24:16,  1.63it/s]
 79%|███████▊  | 8680/11049 [1:29:23<24:14,  1.63it/s]
                                                      
{'loss': 0.1506, 'grad_norm': 0.5881527066230774, 'learning_rate': 1.33622472580559e-06, 'epoch': 2.36}

 79%|███████▊  | 8680/11049 [1:29:23<24:14,  1.63it/s]
 79%|███████▊  | 8681/11049 [1:29:24<24:20,  1.62it/s]
                                                      
{'loss': 0.1292, 'grad_norm': 0.5366240739822388, 'learning_rate': 1.3351499739266255e-06, 'epoch': 2.36}

 79%|███████▊  | 8681/11049 [1:29:24<24:20,  1.62it/s]
 79%|███████▊  | 8682/11049 [1:29:25<24:17,  1.62it/s]
                                                      
{'loss': 0.1469, 'grad_norm': 0.5772258043289185, 'learning_rate': 1.3340755878392508e-06, 'epoch': 2.36}

 79%|███████▊  | 8682/11049 [1:29:25<24:17,  1.62it/s]
 79%|███████▊  | 8683/11049 [1:29:25<24:18,  1.62it/s]
                                                      
{'loss': 0.1749, 'grad_norm': 0.6690792441368103, 'learning_rate': 1.3330015676507047e-06, 'epoch': 2.36}

 79%|███████▊  | 8683/11049 [1:29:25<24:18,  1.62it/s]
 79%|███████▊  | 8684/11049 [1:29:26<24:15,  1.62it/s]
                                                      
{'loss': 0.1256, 'grad_norm': 0.45219334959983826, 'learning_rate': 1.3319279134681829e-06, 'epoch': 2.36}

 79%|███████▊  | 8684/11049 [1:29:26<24:15,  1.62it/s]
 79%|███████▊  | 8685/11049 [1:29:26<24:12,  1.63it/s]
                                                      
{'loss': 0.1391, 'grad_norm': 0.6497101783752441, 'learning_rate': 1.330854625398849e-06, 'epoch': 2.36}

 79%|███████▊  | 8685/11049 [1:29:26<24:12,  1.63it/s]
 79%|███████▊  | 8686/11049 [1:29:27<24:13,  1.63it/s]
                                                      
{'loss': 0.1793, 'grad_norm': 0.6275880336761475, 'learning_rate': 1.329781703549828e-06, 'epoch': 2.36}

 79%|███████▊  | 8686/11049 [1:29:27<24:13,  1.63it/s]
 79%|███████▊  | 8687/11049 [1:29:28<24:11,  1.63it/s]
                                                      
{'loss': 0.134, 'grad_norm': 0.4998904764652252, 'learning_rate': 1.3287091480282094e-06, 'epoch': 2.36}

 79%|███████▊  | 8687/11049 [1:29:28<24:11,  1.63it/s]
 79%|███████▊  | 8688/11049 [1:29:28<24:11,  1.63it/s]
                                                      
{'loss': 0.1852, 'grad_norm': 0.6241470575332642, 'learning_rate': 1.327636958941046e-06, 'epoch': 2.36}

 79%|███████▊  | 8688/11049 [1:29:28<24:11,  1.63it/s]
 79%|███████▊  | 8689/11049 [1:29:29<24:10,  1.63it/s]
                                                      
{'loss': 0.1275, 'grad_norm': 0.514654278755188, 'learning_rate': 1.3265651363953536e-06, 'epoch': 2.36}

 79%|███████▊  | 8689/11049 [1:29:29<24:10,  1.63it/s]
 79%|███████▊  | 8690/11049 [1:29:29<24:08,  1.63it/s]
                                                      
{'loss': 0.1832, 'grad_norm': 0.5548108220100403, 'learning_rate': 1.3254936804981106e-06, 'epoch': 2.36}

 79%|███████▊  | 8690/11049 [1:29:30<24:08,  1.63it/s]
 79%|███████▊  | 8691/11049 [1:29:30<24:08,  1.63it/s]
                                                      
{'loss': 0.1359, 'grad_norm': 0.6828163266181946, 'learning_rate': 1.324422591356262e-06, 'epoch': 2.36}

 79%|███████▊  | 8691/11049 [1:29:30<24:08,  1.63it/s]
 79%|███████▊  | 8692/11049 [1:29:31<24:06,  1.63it/s]
                                                      
{'loss': 0.137, 'grad_norm': 0.5407160520553589, 'learning_rate': 1.3233518690767127e-06, 'epoch': 2.36}

 79%|███████▊  | 8692/11049 [1:29:31<24:06,  1.63it/s]
 79%|███████▊  | 8693/11049 [1:29:31<24:07,  1.63it/s]
                                                      
{'loss': 0.1559, 'grad_norm': 0.6349672079086304, 'learning_rate': 1.3222815137663336e-06, 'epoch': 2.36}

 79%|███████▊  | 8693/11049 [1:29:31<24:07,  1.63it/s]
 79%|███████▊  | 8694/11049 [1:29:32<24:06,  1.63it/s]
                                                      
{'loss': 0.1717, 'grad_norm': 0.5738680362701416, 'learning_rate': 1.3212115255319557e-06, 'epoch': 2.36}

 79%|███████▊  | 8694/11049 [1:29:32<24:06,  1.63it/s]
 79%|███████▊  | 8695/11049 [1:29:32<24:04,  1.63it/s]
                                                      
{'loss': 0.1403, 'grad_norm': 0.5710678100585938, 'learning_rate': 1.320141904480377e-06, 'epoch': 2.36}

 79%|███████▊  | 8695/11049 [1:29:33<24:04,  1.63it/s]
 79%|███████▊  | 8696/11049 [1:29:33<24:03,  1.63it/s]
                                                      
{'loss': 0.149, 'grad_norm': 0.612564742565155, 'learning_rate': 1.319072650718357e-06, 'epoch': 2.36}

 79%|███████▊  | 8696/11049 [1:29:33<24:03,  1.63it/s]
 79%|███████▊  | 8697/11049 [1:29:34<24:04,  1.63it/s]
                                                      
{'loss': 0.1286, 'grad_norm': 0.5296396017074585, 'learning_rate': 1.3180037643526184e-06, 'epoch': 2.36}

 79%|███████▊  | 8697/11049 [1:29:34<24:04,  1.63it/s]
 79%|███████▊  | 8698/11049 [1:29:34<24:09,  1.62it/s]
                                                      
{'loss': 0.1399, 'grad_norm': 0.5460180640220642, 'learning_rate': 1.3169352454898454e-06, 'epoch': 2.36}

 79%|███████▊  | 8698/11049 [1:29:34<24:09,  1.62it/s]
 79%|███████▊  | 8699/11049 [1:29:35<24:07,  1.62it/s]
                                                      
{'loss': 0.1655, 'grad_norm': 0.6578319072723389, 'learning_rate': 1.315867094236692e-06, 'epoch': 2.36}

 79%|███████▊  | 8699/11049 [1:29:35<24:07,  1.62it/s]
 79%|███████▊  | 8700/11049 [1:29:36<24:04,  1.63it/s]
                                                      
{'loss': 0.1407, 'grad_norm': 0.5727929472923279, 'learning_rate': 1.3147993106997692e-06, 'epoch': 2.36}

 79%|███████▊  | 8700/11049 [1:29:36<24:04,  1.63it/s]
 79%|███████▊  | 8701/11049 [1:29:36<24:02,  1.63it/s]
                                                      
{'loss': 0.1404, 'grad_norm': 0.5436253547668457, 'learning_rate': 1.3137318949856532e-06, 'epoch': 2.36}

 79%|███████▊  | 8701/11049 [1:29:36<24:02,  1.63it/s]
 79%|███████▉  | 8702/11049 [1:29:37<24:01,  1.63it/s]
                                                      
{'loss': 0.1463, 'grad_norm': 0.539260745048523, 'learning_rate': 1.312664847200884e-06, 'epoch': 2.36}

 79%|███████▉  | 8702/11049 [1:29:37<24:01,  1.63it/s]
 79%|███████▉  | 8703/11049 [1:29:37<24:02,  1.63it/s]
                                                      
{'loss': 0.1596, 'grad_norm': 0.6171416640281677, 'learning_rate': 1.311598167451964e-06, 'epoch': 2.36}

 79%|███████▉  | 8703/11049 [1:29:38<24:02,  1.63it/s]
 79%|███████▉  | 8704/11049 [1:29:38<23:59,  1.63it/s]
                                                      
{'loss': 0.1461, 'grad_norm': 0.6154151558876038, 'learning_rate': 1.3105318558453595e-06, 'epoch': 2.36}

 79%|███████▉  | 8704/11049 [1:29:38<23:59,  1.63it/s]

=== 训练超时终止 ===