├── LICENSE ├── README.md ├── complete_model.pth ├── fruit-classifier.ipynb ├── fruit-classifier.py ├── fruit_classifier_gpu.ipynb ├── model-state-dict.pth └── optimizer-state-dict.pth /LICENSE: -------------------------------------------------------------------------------- 1 | Apache License 2 | Version 2.0, January 2004 3 | http://www.apache.org/licenses/ 4 | 5 | TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 6 | 7 | 1. Definitions. 8 | 9 | "License" shall mean the terms and conditions for use, reproduction, 10 | and distribution as defined by Sections 1 through 9 of this document. 11 | 12 | "Licensor" shall mean the copyright owner or entity authorized by 13 | the copyright owner that is granting the License. 14 | 15 | "Legal Entity" shall mean the union of the acting entity and all 16 | other entities that control, are controlled by, or are under common 17 | control with that entity. For the purposes of this definition, 18 | "control" means (i) the power, direct or indirect, to cause the 19 | direction or management of such entity, whether by contract or 20 | otherwise, or (ii) ownership of fifty percent (50%) or more of the 21 | outstanding shares, or (iii) beneficial ownership of such entity. 22 | 23 | "You" (or "Your") shall mean an individual or Legal Entity 24 | exercising permissions granted by this License. 25 | 26 | "Source" form shall mean the preferred form for making modifications, 27 | including but not limited to software source code, documentation 28 | source, and configuration files. 29 | 30 | "Object" form shall mean any form resulting from mechanical 31 | transformation or translation of a Source form, including but 32 | not limited to compiled object code, generated documentation, 33 | and conversions to other media types. 34 | 35 | "Work" shall mean the work of authorship, whether in Source or 36 | Object form, made available under the License, as indicated by a 37 | copyright notice that is included in or attached to the work 38 | (an example is provided in the Appendix below). 39 | 40 | "Derivative Works" shall mean any work, whether in Source or Object 41 | form, that is based on (or derived from) the Work and for which the 42 | editorial revisions, annotations, elaborations, or other modifications 43 | represent, as a whole, an original work of authorship. For the purposes 44 | of this License, Derivative Works shall not include works that remain 45 | separable from, or merely link (or bind by name) to the interfaces of, 46 | the Work and Derivative Works thereof. 47 | 48 | "Contribution" shall mean any work of authorship, including 49 | the original version of the Work and any modifications or additions 50 | to that Work or Derivative Works thereof, that is intentionally 51 | submitted to Licensor for inclusion in the Work by the copyright owner 52 | or by an individual or Legal Entity authorized to submit on behalf of 53 | the copyright owner. For the purposes of this definition, "submitted" 54 | means any form of electronic, verbal, or written communication sent 55 | to the Licensor or its representatives, including but not limited to 56 | communication on electronic mailing lists, source code control systems, 57 | and issue tracking systems that are managed by, or on behalf of, the 58 | Licensor for the purpose of discussing and improving the Work, but 59 | excluding communication that is conspicuously marked or otherwise 60 | designated in writing by the copyright owner as "Not a Contribution." 61 | 62 | "Contributor" shall mean Licensor and any individual or Legal Entity 63 | on behalf of whom a Contribution has been received by Licensor and 64 | subsequently incorporated within the Work. 65 | 66 | 2. Grant of Copyright License. Subject to the terms and conditions of 67 | this License, each Contributor hereby grants to You a perpetual, 68 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable 69 | copyright license to reproduce, prepare Derivative Works of, 70 | publicly display, publicly perform, sublicense, and distribute the 71 | Work and such Derivative Works in Source or Object form. 72 | 73 | 3. Grant of Patent License. Subject to the terms and conditions of 74 | this License, each Contributor hereby grants to You a perpetual, 75 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable 76 | (except as stated in this section) patent license to make, have made, 77 | use, offer to sell, sell, import, and otherwise transfer the Work, 78 | where such license applies only to those patent claims licensable 79 | by such Contributor that are necessarily infringed by their 80 | Contribution(s) alone or by combination of their Contribution(s) 81 | with the Work to which such Contribution(s) was submitted. If You 82 | institute patent litigation against any entity (including a 83 | cross-claim or counterclaim in a lawsuit) alleging that the Work 84 | or a Contribution incorporated within the Work constitutes direct 85 | or contributory patent infringement, then any patent licenses 86 | granted to You under this License for that Work shall terminate 87 | as of the date such litigation is filed. 88 | 89 | 4. Redistribution. You may reproduce and distribute copies of the 90 | Work or Derivative Works thereof in any medium, with or without 91 | modifications, and in Source or Object form, provided that You 92 | meet the following conditions: 93 | 94 | (a) You must give any other recipients of the Work or 95 | Derivative Works a copy of this License; and 96 | 97 | (b) You must cause any modified files to carry prominent notices 98 | stating that You changed the files; and 99 | 100 | (c) You must retain, in the Source form of any Derivative Works 101 | that You distribute, all copyright, patent, trademark, and 102 | attribution notices from the Source form of the Work, 103 | excluding those notices that do not pertain to any part of 104 | the Derivative Works; and 105 | 106 | (d) If the Work includes a "NOTICE" text file as part of its 107 | distribution, then any Derivative Works that You distribute must 108 | include a readable copy of the attribution notices contained 109 | within such NOTICE file, excluding those notices that do not 110 | pertain to any part of the Derivative Works, in at least one 111 | of the following places: within a NOTICE text file distributed 112 | as part of the Derivative Works; within the Source form or 113 | documentation, if provided along with the Derivative Works; or, 114 | within a display generated by the Derivative Works, if and 115 | wherever such third-party notices normally appear. The contents 116 | of the NOTICE file are for informational purposes only and 117 | do not modify the License. You may add Your own attribution 118 | notices within Derivative Works that You distribute, alongside 119 | or as an addendum to the NOTICE text from the Work, provided 120 | that such additional attribution notices cannot be construed 121 | as modifying the License. 122 | 123 | You may add Your own copyright statement to Your modifications and 124 | may provide additional or different license terms and conditions 125 | for use, reproduction, or distribution of Your modifications, or 126 | for any such Derivative Works as a whole, provided Your use, 127 | reproduction, and distribution of the Work otherwise complies with 128 | the conditions stated in this License. 129 | 130 | 5. Submission of Contributions. Unless You explicitly state otherwise, 131 | any Contribution intentionally submitted for inclusion in the Work 132 | by You to the Licensor shall be under the terms and conditions of 133 | this License, without any additional terms or conditions. 134 | Notwithstanding the above, nothing herein shall supersede or modify 135 | the terms of any separate license agreement you may have executed 136 | with Licensor regarding such Contributions. 137 | 138 | 6. Trademarks. This License does not grant permission to use the trade 139 | names, trademarks, service marks, or product names of the Licensor, 140 | except as required for reasonable and customary use in describing the 141 | origin of the Work and reproducing the content of the NOTICE file. 142 | 143 | 7. Disclaimer of Warranty. Unless required by applicable law or 144 | agreed to in writing, Licensor provides the Work (and each 145 | Contributor provides its Contributions) on an "AS IS" BASIS, 146 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or 147 | implied, including, without limitation, any warranties or conditions 148 | of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A 149 | PARTICULAR PURPOSE. You are solely responsible for determining the 150 | appropriateness of using or redistributing the Work and assume any 151 | risks associated with Your exercise of permissions under this License. 152 | 153 | 8. Limitation of Liability. In no event and under no legal theory, 154 | whether in tort (including negligence), contract, or otherwise, 155 | unless required by applicable law (such as deliberate and grossly 156 | negligent acts) or agreed to in writing, shall any Contributor be 157 | liable to You for damages, including any direct, indirect, special, 158 | incidental, or consequential damages of any character arising as a 159 | result of this License or out of the use or inability to use the 160 | Work (including but not limited to damages for loss of goodwill, 161 | work stoppage, computer failure or malfunction, or any and all 162 | other commercial damages or losses), even if such Contributor 163 | has been advised of the possibility of such damages. 164 | 165 | 9. Accepting Warranty or Additional Liability. While redistributing 166 | the Work or Derivative Works thereof, You may choose to offer, 167 | and charge a fee for, acceptance of support, warranty, indemnity, 168 | or other liability obligations and/or rights consistent with this 169 | License. However, in accepting such obligations, You may act only 170 | on Your own behalf and on Your sole responsibility, not on behalf 171 | of any other Contributor, and only if You agree to indemnify, 172 | defend, and hold each Contributor harmless for any liability 173 | incurred by, or claims asserted against, such Contributor by reason 174 | of your accepting any such warranty or additional liability. 175 | 176 | END OF TERMS AND CONDITIONS 177 | 178 | APPENDIX: How to apply the Apache License to your work. 179 | 180 | To apply the Apache License to your work, attach the following 181 | boilerplate notice, with the fields enclosed by brackets "[]" 182 | replaced with your own identifying information. (Don't include 183 | the brackets!) The text should be enclosed in the appropriate 184 | comment syntax for the file format. We also recommend that a 185 | file or class name and description of purpose be included on the 186 | same "printed page" as the copyright notice for easier 187 | identification within third-party archives. 188 | 189 | Copyright [yyyy] [name of copyright owner] 190 | 191 | Licensed under the Apache License, Version 2.0 (the "License"); 192 | you may not use this file except in compliance with the License. 193 | You may obtain a copy of the License at 194 | 195 | http://www.apache.org/licenses/LICENSE-2.0 196 | 197 | Unless required by applicable law or agreed to in writing, software 198 | distributed under the License is distributed on an "AS IS" BASIS, 199 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 200 | See the License for the specific language governing permissions and 201 | limitations under the License. 202 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Fruit-Classifier-PyTorch 2 | A Machine Learning model that can detect fruit images. 3 | 4 | # Requirements 5 | pytorch==0.4.0 6 | torchvision 7 | 8 | # Dataset 9 | https://github.com/Horea94/Fruit-Images-Dataset 10 | 11 | # Contact 12 | Email: aaditkapoor2000@gmail.com 13 | 14 | # LICENSE 15 | Copyright 2020 Aadit Kapoor 16 | 17 | Licensed under the Apache License, Version 2.0 (the "License"); 18 | you may not use this file except in compliance with the License. 19 | You may obtain a copy of the License at 20 | 21 | http://www.apache.org/licenses/LICENSE-2.0 22 | 23 | Unless required by applicable law or agreed to in writing, software 24 | distributed under the License is distributed on an "AS IS" BASIS, 25 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 26 | See the License for the specific language governing permissions and 27 | limitations under the License. 28 | -------------------------------------------------------------------------------- /complete_model.pth: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/complete_model.pth -------------------------------------------------------------------------------- /fruit-classifier.ipynb: -------------------------------------------------------------------------------- 1 | { 2 | "cells": [ 3 | { 4 | "cell_type": "markdown", 5 | "metadata": {}, 6 | "source": [ 7 | "## Aim: To classifiy fruits images.\n", 8 | "### Dataset: Fruits360\n", 9 | "\n", 10 | "- Then to build an iOS app to use the machine learning model." 11 | ] 12 | }, 13 | { 14 | "cell_type": "code", 15 | "execution_count": 24, 16 | "metadata": {}, 17 | "outputs": [], 18 | "source": [ 19 | "# importing\n", 20 | "import random\n", 21 | "import pandas as pd\n", 22 | "import numpy as np\n", 23 | "import torchvision\n", 24 | "import torch\n", 25 | "from torch import nn\n", 26 | "from torch.autograd import Variable\n", 27 | "from sklearn.model_selection import train_test_split\n", 28 | "import torchvision.transforms as T\n", 29 | "from torchvision.datasets import ImageFolder\n", 30 | "import matplotlib.pyplot as plt\n", 31 | "import cv2\n", 32 | "from torch.utils.data import DataLoader\n", 33 | "from sklearn.metrics import accuracy_score" 34 | ] 35 | }, 36 | { 37 | "cell_type": "code", 38 | "execution_count": 25, 39 | "metadata": {}, 40 | "outputs": [], 41 | "source": [ 42 | "# Loading data\n", 43 | "transforms_train = T.Compose([T.ToTensor(),T.Normalize([0.5,0.5,0.5],[0.5,0.5,0.5])])\n", 44 | "image_data_train = ImageFolder(\"./fruits-360/Training\",transform=transforms_train)\n", 45 | "image_data_test = ImageFolder(\"./fruits-360/Validation\",transform=transforms_train)\n", 46 | "\n", 47 | "# Shuffling data and then collecting all the labels.\n", 48 | "random.shuffle(image_data_train.samples)\n", 49 | "random.shuffle(image_data_test.samples)" 50 | ] 51 | }, 52 | { 53 | "cell_type": "code", 54 | "execution_count": 26, 55 | "metadata": {}, 56 | "outputs": [], 57 | "source": [ 58 | "# Total classes\n", 59 | "classes_idx = image_data_train.class_to_idx\n", 60 | "classes = len(image_data_train.classes)\n", 61 | "len_train_data = len(image_data_train)\n", 62 | "len_test_data = len(image_data_test)\n", 63 | "\n", 64 | "\n", 65 | "def get_labels():\n", 66 | " labels_train = [] # All the labels\n", 67 | " labels_test = []\n", 68 | " for i in image_data_train.imgs:\n", 69 | " labels_train.append(i[1])\n", 70 | " \n", 71 | " for j in image_data_test.imgs:\n", 72 | " labels_test.append(j[1])\n", 73 | " \n", 74 | " return (labels_train, labels_test)\n", 75 | "\n", 76 | "labels_train, labels_test = get_labels()\n" 77 | ] 78 | }, 79 | { 80 | "cell_type": "code", 81 | "execution_count": 27, 82 | "metadata": {}, 83 | "outputs": [], 84 | "source": [ 85 | "train_loader = DataLoader(dataset=image_data_train,batch_size=100)\n", 86 | "test_loader = DataLoader(dataset=image_data_test,batch_size=100)" 87 | ] 88 | }, 89 | { 90 | "cell_type": "code", 91 | "execution_count": 37, 92 | "metadata": {}, 93 | "outputs": [ 94 | { 95 | "name": "stdout", 96 | "output_type": "stream", 97 | "text": [ 98 | "torch.Size([100, 3, 100, 100])\n" 99 | ] 100 | }, 101 | { 102 | "data": { 103 | "text/plain": [ 104 | "torch.Size([3, 100, 100])" 105 | ] 106 | }, 107 | "execution_count": 37, 108 | "metadata": {}, 109 | "output_type": "execute_result" 110 | } 111 | ], 112 | "source": [ 113 | "print (iter(train_loader).next()[0].shape)\n", 114 | "record = iter(train_loader).next()[0]" 115 | ] 116 | }, 117 | { 118 | "cell_type": "markdown", 119 | "metadata": {}, 120 | "source": [ 121 | "- We can see that the image is (batch_size, channel, image_height, image_width)" 122 | ] 123 | }, 124 | { 125 | "cell_type": "code", 126 | "execution_count": 3, 127 | "metadata": {}, 128 | "outputs": [], 129 | "source": [ 130 | "# Flatten Layer\n", 131 | "class Flatten(nn.Module):\n", 132 | " def forward(self, x):\n", 133 | " return x.view(x.size(0), -1)\n", 134 | "# Main Model\n", 135 | "class Model:\n", 136 | " def build_model(self):\n", 137 | " model = nn.Sequential(nn.Conv2d(3, 64, kernel_size=5, stride=1), nn.ReLU(),nn.MaxPool2d(2), nn.Conv2d(64, 64, kernel_size=7, stride=1),\n", 138 | " nn.ReLU(), nn.MaxPool2d(3), nn.Conv2d(64, 64, kernel_size=7), nn.ReLU(), nn.MaxPool2d(5), Flatten(), nn.Linear(64, 100), nn.ReLU(), nn.Linear(100, 65))\n", 139 | " return model" 140 | ] 141 | }, 142 | { 143 | "cell_type": "code", 144 | "execution_count": 4, 145 | "metadata": {}, 146 | "outputs": [ 147 | { 148 | "data": { 149 | "text/plain": [ 150 | "Sequential(\n", 151 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n", 152 | " (1): ReLU()\n", 153 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n", 154 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 155 | " (4): ReLU()\n", 156 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n", 157 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 158 | " (7): ReLU()\n", 159 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n", 160 | " (9): Flatten()\n", 161 | " (10): Linear(in_features=64, out_features=100, bias=True)\n", 162 | " (11): ReLU()\n", 163 | " (12): Linear(in_features=100, out_features=65, bias=True)\n", 164 | ")" 165 | ] 166 | }, 167 | "execution_count": 4, 168 | "metadata": {}, 169 | "output_type": "execute_result" 170 | } 171 | ], 172 | "source": [ 173 | "# Building \n", 174 | "model = Model()\n", 175 | "model = model.build_model()\n", 176 | "\n", 177 | "# Checking for GPU\n", 178 | "device = torch.device(\"cuda:0\" if torch.cuda.is_available() else \"cpu\")\n", 179 | "model.to(device)" 180 | ] 181 | }, 182 | { 183 | "cell_type": "code", 184 | "execution_count": 109, 185 | "metadata": {}, 186 | "outputs": [ 187 | { 188 | "name": "stdout", 189 | "output_type": "stream", 190 | "text": [ 191 | "Sequential(\n", 192 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n", 193 | " (1): ReLU()\n", 194 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n", 195 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 196 | " (4): ReLU()\n", 197 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n", 198 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 199 | " (7): ReLU()\n", 200 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n", 201 | " (9): Flatten()\n", 202 | " (10): Linear(in_features=64, out_features=100, bias=True)\n", 203 | " (11): ReLU()\n", 204 | " (12): Linear(in_features=100, out_features=65, bias=True)\n", 205 | ")\n", 206 | "62\n", 207 | "62\n" 208 | ] 209 | } 210 | ], 211 | "source": [ 212 | "print (model)\n", 213 | "print (labels_train[0])\n", 214 | "print (image_data_train.samples[0][1])" 215 | ] 216 | }, 217 | { 218 | "cell_type": "code", 219 | "execution_count": 151, 220 | "metadata": {}, 221 | "outputs": [], 222 | "source": [ 223 | "optimizer = torch.optim.Adagrad(model.parameters(), lr=0.01)\n", 224 | "criterion = nn.CrossEntropyLoss()" 225 | ] 226 | }, 227 | { 228 | "cell_type": "code", 229 | "execution_count": 152, 230 | "metadata": {}, 231 | "outputs": [], 232 | "source": [ 233 | "# Train the model\n", 234 | "def train(epochs):\n", 235 | " model.train()\n", 236 | " losses = []\n", 237 | " for epoch in range(1, epochs+1):\n", 238 | " print (\"epoch #\", epoch)\n", 239 | " current_loss = 0.0\n", 240 | " for feature, label in train_loader:\n", 241 | " x = Variable(feature, requires_grad=False).float().to(device)\n", 242 | " y = Variable(label, requires_grad=False).long().to(device)\n", 243 | " optimizer.zero_grad() # Zeroing the grads\n", 244 | " y_pred = model(x) # Calculating prediction\n", 245 | " correct = y_pred.max(1)[1].eq(y).sum()\n", 246 | " print (\"no. of correct items classified: \", correct.item())\n", 247 | " loss = criterion(y_pred, y) # Calculating loss (log_softmax already included)\n", 248 | " print (\"loss: \", loss.item())\n", 249 | " current_loss+=loss.item()\n", 250 | " loss.backward() # Gradient cal\n", 251 | " optimizer.step() # Changing weights\n", 252 | " losses.append(current_loss) # Only storing loss after every epoch\n", 253 | " return losses\n", 254 | "# Test the model\n", 255 | "def test():\n", 256 | " model.eval()\n", 257 | " with torch.no_grad():\n", 258 | " for feature, label in test_loader:\n", 259 | " pred = model(feature)\n", 260 | " print (\"acc: \", accuracy_score(labels_test, pred.max(1)[1].data.numpy()) * 100)\n", 261 | " loss = criterion(pred, label)\n", 262 | " print (\"loss: \", loss.item())" 263 | ] 264 | }, 265 | { 266 | "cell_type": "code", 267 | "execution_count": 6, 268 | "metadata": {}, 269 | "outputs": [ 270 | { 271 | "data": { 272 | "text/plain": [ 273 | "Sequential(\n", 274 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n", 275 | " (1): ReLU()\n", 276 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n", 277 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 278 | " (4): ReLU()\n", 279 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n", 280 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n", 281 | " (7): ReLU()\n", 282 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n", 283 | " (9): Flatten()\n", 284 | " (10): Linear(in_features=64, out_features=100, bias=True)\n", 285 | " (11): ReLU()\n", 286 | " (12): Linear(in_features=100, out_features=65, bias=True)\n", 287 | ")" 288 | ] 289 | }, 290 | "execution_count": 6, 291 | "metadata": {}, 292 | "output_type": "execute_result" 293 | } 294 | ], 295 | "source": [ 296 | "model" 297 | ] 298 | }, 299 | { 300 | "cell_type": "code", 301 | "execution_count": 15, 302 | "metadata": {}, 303 | "outputs": [], 304 | "source": [ 305 | "loaded_state_dict = torch.load(\"model-state-dict.pth\",map_location=\"cpu\")" 306 | ] 307 | }, 308 | { 309 | "cell_type": "code", 310 | "execution_count": 17, 311 | "metadata": {}, 312 | "outputs": [], 313 | "source": [ 314 | "model.load_state_dict(loaded_state_dict)" 315 | ] 316 | }, 317 | { 318 | "cell_type": "code", 319 | "execution_count": 18, 320 | "metadata": {}, 321 | "outputs": [ 322 | { 323 | "name": "stdout", 324 | "output_type": "stream", 325 | "text": [ 326 | "('0.weight', Parameter containing:\n", 327 | "tensor([[[[-0.0016, 0.0048, -0.0146, -0.1456, -0.1541],\n", 328 | " [-0.0630, 0.0308, 0.0080, -0.1073, -0.1134],\n", 329 | " [-0.1058, 0.0090, -0.1061, 0.0478, 0.0654],\n", 330 | " [ 0.0175, 0.0800, 0.0240, 0.0162, 0.0625],\n", 331 | " [ 0.0913, -0.0833, -0.0338, 0.0798, -0.0163]],\n", 332 | "\n", 333 | " [[ 0.0605, 0.0374, 0.0662, -0.1401, -0.0259],\n", 334 | " [ 0.0589, -0.1049, 0.0120, -0.0084, -0.1260],\n", 335 | " [-0.0768, -0.1128, -0.0596, 0.0139, 0.0571],\n", 336 | " [ 0.0931, -0.0645, -0.0827, 0.0600, 0.0205],\n", 337 | " [ 0.1170, 0.1265, -0.0124, -0.0439, 0.1113]],\n", 338 | "\n", 339 | " [[-0.0642, -0.0756, 0.0292, 0.0497, -0.1144],\n", 340 | " [ 0.0153, -0.0897, -0.0337, 0.0108, -0.1262],\n", 341 | " [ 0.0991, -0.0447, -0.0442, -0.0280, 0.0873],\n", 342 | " [-0.0269, 0.0825, -0.1120, -0.0491, -0.0136],\n", 343 | " [ 0.0866, -0.0420, 0.1009, 0.1126, 0.0893]]],\n", 344 | "\n", 345 | "\n", 346 | " [[[-0.0209, 0.0852, 0.0590, -0.0332, -0.0586],\n", 347 | " [ 0.0518, 0.1475, 0.0091, 0.0288, 0.0954],\n", 348 | " [ 0.0341, 0.0415, -0.0412, 0.0043, 0.1360],\n", 349 | " [ 0.1538, -0.0249, 0.0003, 0.1572, 0.0010],\n", 350 | " [ 0.0510, 0.0192, 0.1027, 0.1332, 0.0991]],\n", 351 | "\n", 352 | " [[ 0.0177, -0.0105, -0.0383, 0.0657, 0.0859],\n", 353 | " [-0.0725, -0.1320, -0.0927, -0.1090, -0.0635],\n", 354 | " [ 0.0969, -0.0837, -0.1208, 0.0329, -0.0886],\n", 355 | " [-0.0370, 0.0143, -0.0048, -0.0736, -0.0601],\n", 356 | " [-0.0365, -0.0917, -0.0431, -0.0236, -0.0755]],\n", 357 | "\n", 358 | " [[ 0.0102, -0.0525, 0.0135, -0.0179, -0.0234],\n", 359 | " [ 0.0643, -0.0145, 0.1480, 0.0188, 0.0504],\n", 360 | " [ 0.0169, -0.0020, 0.0158, -0.0133, -0.0076],\n", 361 | " [ 0.1242, -0.0200, 0.0480, 0.1099, 0.0300],\n", 362 | " [ 0.0524, -0.0310, 0.0239, 0.0870, 0.1372]]],\n", 363 | "\n", 364 | "\n", 365 | " [[[-0.0898, -0.0185, -0.0380, -0.0599, -0.0783],\n", 366 | " [ 0.0435, -0.0673, -0.0520, -0.0430, 0.0795],\n", 367 | " [-0.0218, -0.0063, 0.0079, 0.0160, 0.0481],\n", 368 | " [ 0.0058, 0.1550, 0.0125, 0.0755, 0.0940],\n", 369 | " [ 0.1355, 0.0955, 0.1428, 0.1401, 0.1735]],\n", 370 | "\n", 371 | " [[-0.1866, -0.1629, 0.0517, -0.0109, -0.1201],\n", 372 | " [-0.1588, -0.1707, -0.1438, 0.0682, 0.0742],\n", 373 | " [-0.0229, -0.1558, 0.0158, -0.1283, 0.0976],\n", 374 | " [-0.1197, -0.0310, -0.0727, 0.0966, -0.0852],\n", 375 | " [ 0.0389, 0.0312, 0.0191, 0.0596, 0.0384]],\n", 376 | "\n", 377 | " [[ 0.0068, 0.0797, -0.0105, 0.0056, 0.1451],\n", 378 | " [ 0.0565, -0.0742, -0.0368, 0.0914, 0.0443],\n", 379 | " [-0.0046, 0.1062, 0.0461, 0.1649, 0.1579],\n", 380 | " [ 0.1141, -0.0795, 0.1050, -0.0006, 0.0684],\n", 381 | " [-0.0832, -0.0160, 0.0237, 0.1942, 0.1150]]],\n", 382 | "\n", 383 | "\n", 384 | " ...,\n", 385 | "\n", 386 | "\n", 387 | " [[[-0.0482, -0.0629, -0.1348, -0.0321, -0.1168],\n", 388 | " [-0.0721, -0.0334, -0.0868, -0.0112, 0.0183],\n", 389 | " [ 0.0814, -0.0759, 0.0558, 0.0165, -0.1443],\n", 390 | " [ 0.0478, -0.1126, 0.0319, 0.0282, 0.0392],\n", 391 | " [-0.0818, 0.0456, 0.0469, 0.0682, -0.0889]],\n", 392 | "\n", 393 | " [[-0.0964, -0.0441, -0.0376, -0.1273, 0.0643],\n", 394 | " [-0.0678, 0.0213, -0.0184, 0.0526, 0.0937],\n", 395 | " [-0.0995, -0.0961, 0.0146, 0.0857, 0.0363],\n", 396 | " [-0.0216, -0.1249, 0.0229, -0.0659, -0.0795],\n", 397 | " [ 0.0812, -0.0560, -0.1054, -0.0096, 0.0889]],\n", 398 | "\n", 399 | " [[-0.0897, -0.1021, 0.0180, 0.0298, -0.0659],\n", 400 | " [ 0.0528, -0.1170, -0.0548, 0.0178, -0.0131],\n", 401 | " [ 0.0153, 0.0072, 0.0386, 0.0121, -0.1135],\n", 402 | " [-0.1317, 0.0072, -0.0720, 0.0915, -0.1055],\n", 403 | " [-0.1206, -0.0260, -0.1168, 0.0285, -0.1064]]],\n", 404 | "\n", 405 | "\n", 406 | " [[[ 0.0775, 0.0365, 0.0013, 0.0921, 0.1069],\n", 407 | " [-0.0504, -0.0125, -0.0210, 0.0183, 0.0713],\n", 408 | " [-0.0559, -0.0774, -0.1068, -0.0869, -0.0683],\n", 409 | " [-0.0192, 0.0008, 0.0784, 0.0213, -0.0400],\n", 410 | " [-0.0524, 0.0806, -0.0096, 0.0329, -0.0262]],\n", 411 | "\n", 412 | " [[ 0.0902, 0.0546, 0.0144, 0.1076, -0.0733],\n", 413 | " [ 0.0053, -0.0091, -0.0023, -0.0353, -0.0744],\n", 414 | " [ 0.0175, -0.0493, -0.0767, -0.0778, -0.0176],\n", 415 | " [ 0.0258, 0.0045, 0.0684, 0.0814, 0.0049],\n", 416 | " [-0.0952, 0.0733, 0.0422, 0.0057, -0.0058]],\n", 417 | "\n", 418 | " [[-0.0374, 0.0999, 0.0383, 0.0544, 0.1199],\n", 419 | " [-0.1001, -0.0429, 0.1261, -0.0481, -0.0135],\n", 420 | " [ 0.0285, 0.0622, -0.0188, 0.0707, -0.0995],\n", 421 | " [-0.0672, 0.1120, 0.0732, 0.0780, 0.0502],\n", 422 | " [-0.1165, 0.0694, 0.0052, -0.0275, 0.0033]]],\n", 423 | "\n", 424 | "\n", 425 | " [[[-0.0018, 0.1250, -0.0596, 0.0056, -0.0844],\n", 426 | " [ 0.0031, -0.0784, -0.0879, 0.1046, 0.0131],\n", 427 | " [ 0.0248, 0.1182, 0.0623, 0.1107, 0.0702],\n", 428 | " [-0.0020, -0.0631, 0.0097, -0.0636, -0.0109],\n", 429 | " [-0.0106, 0.1198, 0.0468, -0.0776, 0.0931]],\n", 430 | "\n", 431 | " [[ 0.0912, -0.0293, -0.1130, -0.1091, -0.1368],\n", 432 | " [-0.0486, -0.0580, -0.0293, 0.0825, 0.0432],\n", 433 | " [-0.0488, -0.0165, -0.0907, 0.1175, -0.1161],\n", 434 | " [-0.0058, 0.0306, -0.0454, 0.0105, 0.1014],\n", 435 | " [ 0.1089, 0.0913, 0.0672, 0.0102, 0.0053]],\n", 436 | "\n", 437 | " [[-0.0369, 0.1566, 0.0700, 0.0545, 0.0613],\n", 438 | " [ 0.0877, 0.0052, 0.0940, 0.1503, 0.0434],\n", 439 | " [-0.0281, 0.0453, 0.0012, 0.0196, -0.0414],\n", 440 | " [ 0.0855, -0.0163, 0.1347, 0.0424, 0.0502],\n", 441 | " [ 0.0874, 0.0372, 0.1193, 0.1401, 0.1866]]]]))\n", 442 | "('0.bias', Parameter containing:\n", 443 | "tensor([-0.0074, -0.0474, 0.0857, 0.1327, 0.0287, 0.1414, 0.1547,\n", 444 | " 0.0509, -0.0440, -0.0592, 0.0788, -0.0021, 0.0642, 0.1670,\n", 445 | " 0.0317, 0.0466, 0.1044, -0.0274, -0.0708, 0.0774, 0.0230,\n", 446 | " 0.0278, 0.1082, 0.1173, 0.0120, -0.0614, 0.0690, 0.0154,\n", 447 | " -0.0326, 0.0599, -0.0667, 0.0317, -0.0404, 0.1326, -0.0984,\n", 448 | " 0.0518, -0.0816, -0.0412, -0.0766, 0.0903, -0.0249, -0.0253,\n", 449 | " 0.2320, -0.0652, -0.0272, 0.0391, 0.0159, -0.0892, -0.0242,\n", 450 | " -0.0119, -0.0370, 0.1231, -0.0702, -0.0439, -0.0870, 0.0212,\n", 451 | " 0.1375, -0.1098, 0.0907, 0.0009, 0.0788, 0.0816, -0.1044,\n", 452 | " 0.0091]))\n", 453 | "('3.weight', Parameter containing:\n", 454 | "tensor([[[[-2.6779e-02, -1.2962e-02, -6.7731e-03, ..., -2.1328e-02,\n", 455 | " -1.5803e-02, -7.1797e-03],\n", 456 | " [-1.8022e-02, -2.3607e-03, -2.2527e-02, ..., -3.2269e-02,\n", 457 | " 1.1309e-02, 7.9132e-03],\n", 458 | " [-1.8926e-02, -1.6236e-02, -1.8413e-02, ..., 9.0630e-03,\n", 459 | " 9.2606e-03, 1.7090e-02],\n", 460 | " ...,\n", 461 | " [-3.7086e-03, -7.2559e-04, 1.0614e-02, ..., 6.1826e-04,\n", 462 | " -1.2080e-02, 4.3929e-04],\n", 463 | " [-2.3554e-02, -1.1957e-02, -6.5553e-03, ..., -1.1912e-02,\n", 464 | " -1.3815e-02, -2.2450e-03],\n", 465 | " [-2.0905e-02, -2.5623e-02, -3.3727e-02, ..., -8.8794e-03,\n", 466 | " 2.5970e-03, 8.4659e-04]],\n", 467 | "\n", 468 | " [[-1.0403e-02, 9.8815e-03, 1.3379e-02, ..., 1.6973e-02,\n", 469 | " -7.1956e-03, 4.0096e-03],\n", 470 | " [ 1.1212e-02, -1.4063e-02, 1.7008e-02, ..., -6.0592e-03,\n", 471 | " -1.2660e-02, -1.1657e-02],\n", 472 | " [-3.2382e-02, -4.0698e-03, 6.5229e-03, ..., -3.1508e-03,\n", 473 | " -3.7202e-02, -1.1686e-02],\n", 474 | " ...,\n", 475 | " [-9.1540e-03, 1.0237e-02, 1.6859e-02, ..., 8.6157e-03,\n", 476 | " -3.7181e-03, 9.6950e-03],\n", 477 | " [-1.7268e-02, 1.4214e-02, -1.1315e-02, ..., -8.8661e-03,\n", 478 | " -1.2371e-02, 6.7527e-03],\n", 479 | " [ 9.9682e-03, -1.3675e-02, -6.5624e-03, ..., 3.1749e-03,\n", 480 | " 9.4326e-03, -2.9477e-03]],\n", 481 | "\n", 482 | " [[-7.0483e-03, -3.1922e-02, -2.1498e-02, ..., -3.1507e-03,\n", 483 | " -3.0696e-02, -2.8737e-03],\n", 484 | " [-6.8231e-03, -1.3644e-02, -1.6670e-03, ..., -2.8231e-02,\n", 485 | " -3.1186e-02, -2.6410e-02],\n", 486 | " [-9.8460e-03, -3.6508e-02, -1.1149e-02, ..., -1.7134e-02,\n", 487 | " -3.2647e-02, -2.3700e-02],\n", 488 | " ...,\n", 489 | " [-5.7745e-04, 9.0411e-04, -1.4712e-02, ..., 1.3643e-02,\n", 490 | " -1.8622e-03, -1.3857e-02],\n", 491 | " [-3.7543e-02, 1.7850e-02, -2.0641e-03, ..., 5.8658e-03,\n", 492 | " 4.6741e-03, -8.6243e-03],\n", 493 | " [-3.3316e-02, -4.9936e-03, -1.4988e-02, ..., -8.6911e-05,\n", 494 | " -1.7218e-02, -2.7561e-03]],\n", 495 | "\n", 496 | " ...,\n", 497 | "\n", 498 | " [[ 1.5939e-02, -1.4361e-02, 1.4564e-02, ..., -8.7929e-03,\n", 499 | " -1.2084e-02, 1.2491e-02],\n", 500 | " [ 1.7160e-02, -6.9554e-03, 1.0544e-02, ..., -1.0389e-02,\n", 501 | " -4.2872e-03, -4.1053e-03],\n", 502 | " [-2.0027e-03, 1.0370e-02, 1.7050e-02, ..., -6.4324e-03,\n", 503 | " 1.6785e-02, 3.4043e-03],\n", 504 | " ...,\n", 505 | " [ 1.3323e-02, -3.4984e-03, -1.5882e-02, ..., -2.4456e-03,\n", 506 | " 2.4521e-03, 1.6473e-02],\n", 507 | " [-1.7732e-02, 1.5460e-02, 6.0378e-03, ..., -1.2608e-02,\n", 508 | " 1.7068e-02, 1.6477e-02],\n", 509 | " [ 7.6953e-03, 9.7408e-03, -5.5379e-03, ..., -1.6686e-03,\n", 510 | " -1.5905e-03, 1.2670e-02]],\n", 511 | "\n", 512 | " [[-2.7136e-02, -3.4884e-02, -3.1536e-02, ..., 8.7532e-03,\n", 513 | " 1.7536e-02, -8.5740e-03],\n", 514 | " [-3.2289e-02, -2.1074e-02, -2.7792e-03, ..., 1.3592e-03,\n", 515 | " 6.7092e-03, 8.8825e-03],\n", 516 | " [-2.4370e-03, -2.1794e-02, -1.4332e-02, ..., -2.6290e-03,\n", 517 | " -9.7182e-04, -1.3434e-02],\n", 518 | " ...,\n", 519 | " [-2.7251e-02, -5.9368e-03, -1.7157e-02, ..., 4.8391e-03,\n", 520 | " 1.3846e-02, -2.5880e-02],\n", 521 | " [-8.4309e-03, -9.7086e-03, -8.2329e-03, ..., -1.1860e-02,\n", 522 | " -1.2285e-02, 6.6090e-03],\n", 523 | " [-2.8973e-03, 9.6497e-03, 2.2892e-03, ..., 1.2426e-02,\n", 524 | " -9.8844e-03, -2.6804e-02]],\n", 525 | "\n", 526 | " [[-1.7853e-03, 1.4545e-02, 1.3259e-02, ..., 6.5922e-03,\n", 527 | " -5.1442e-03, -1.0759e-02],\n", 528 | " [ 1.4357e-02, 4.0669e-03, 1.0755e-02, ..., -1.3151e-02,\n", 529 | " 1.4049e-02, 1.1277e-03],\n", 530 | " [ 9.0401e-03, 1.0939e-02, -1.3673e-02, ..., -8.7622e-03,\n", 531 | " 5.9570e-04, -1.2833e-02],\n", 532 | " ...,\n", 533 | " [ 2.0013e-03, 6.9983e-03, 4.6257e-03, ..., -8.0778e-03,\n", 534 | " 1.2425e-02, -9.2927e-03],\n", 535 | " [ 1.3665e-02, -1.7009e-02, 3.3687e-03, ..., -4.1017e-03,\n", 536 | " -1.0301e-02, 1.4668e-02],\n", 537 | " [ 5.8163e-03, -2.8335e-06, 9.8780e-04, ..., 1.0928e-02,\n", 538 | " -1.1426e-02, -1.3808e-02]]],\n", 539 | "\n", 540 | "\n", 541 | " [[[-2.8145e-02, -1.8742e-02, -5.5234e-03, ..., 4.0994e-03,\n", 542 | " 2.8125e-04, -3.5711e-02],\n", 543 | " [-1.9029e-02, -3.9364e-03, -6.7715e-03, ..., -9.1552e-03,\n", 544 | " 1.5949e-02, 4.7563e-03],\n", 545 | " [-7.7093e-03, -3.4516e-02, -2.2431e-02, ..., -3.2317e-02,\n", 546 | " 9.8823e-03, 1.2922e-03],\n", 547 | " ...,\n", 548 | " [-2.9283e-02, -2.6186e-02, -1.6897e-02, ..., -4.7393e-03,\n", 549 | " -3.1830e-02, -1.0085e-02],\n", 550 | " [-3.5755e-02, -3.4435e-02, -1.2168e-02, ..., -2.0105e-02,\n", 551 | " -4.2665e-03, -2.0468e-02],\n", 552 | " [-3.3734e-02, -1.6996e-02, -9.8357e-03, ..., -2.9043e-02,\n", 553 | " -3.3291e-02, -1.3980e-02]],\n", 554 | "\n", 555 | " [[-6.3367e-03, -4.0852e-03, -1.3327e-02, ..., -6.2933e-03,\n", 556 | " 1.3628e-02, 8.6691e-03],\n", 557 | " [ 1.3802e-02, -7.2884e-03, -1.4474e-02, ..., 1.3953e-02,\n", 558 | " -5.3896e-03, 9.0456e-03],\n", 559 | " [-6.9317e-03, 1.6150e-02, 8.1835e-03, ..., -3.0702e-04,\n", 560 | " 1.3830e-02, -1.6633e-03],\n", 561 | " ...,\n", 562 | " [-8.3356e-04, -9.3114e-03, 7.4694e-03, ..., -1.2985e-02,\n", 563 | " -1.4350e-02, 4.2311e-03],\n", 564 | " [-5.0927e-03, 1.0877e-02, 4.0688e-03, ..., 9.2379e-03,\n", 565 | " -1.0290e-02, 1.0049e-02],\n", 566 | " [-9.4879e-03, 1.0646e-02, 1.3236e-02, ..., -9.2430e-03,\n", 567 | " -1.0380e-03, -1.4155e-02]],\n", 568 | "\n", 569 | " [[-3.6744e-02, -2.1535e-02, -3.1799e-02, ..., -1.4108e-02,\n", 570 | " 2.2022e-03, 1.5080e-02],\n", 571 | " [-2.9610e-02, -4.6011e-03, -1.4337e-02, ..., -8.4109e-03,\n", 572 | " 4.4273e-03, -2.2268e-02],\n", 573 | " [-1.1714e-02, -5.3899e-03, -1.1769e-02, ..., -2.0215e-02,\n", 574 | " -4.4180e-03, -9.1483e-03],\n", 575 | " ...,\n", 576 | " [-3.1818e-02, -2.7536e-02, -1.3271e-02, ..., -6.5540e-03,\n", 577 | " -7.9542e-03, -1.0677e-02],\n", 578 | " [-9.0505e-03, -3.1940e-02, -1.5119e-02, ..., -2.1554e-02,\n", 579 | " -1.0521e-02, -2.7976e-02],\n", 580 | " [-2.0902e-02, -3.2283e-03, -1.3045e-02, ..., -3.6176e-02,\n", 581 | " -2.9619e-02, -1.6289e-02]],\n", 582 | "\n", 583 | " ...,\n", 584 | "\n", 585 | " [[-1.4943e-02, 1.2392e-03, 1.6166e-02, ..., -1.1477e-02,\n", 586 | " -1.5734e-02, -1.2199e-02],\n", 587 | " [ 1.1283e-02, 1.1453e-03, 1.2160e-02, ..., 6.1564e-03,\n", 588 | " 3.5162e-03, -8.8078e-03],\n", 589 | " [ 1.5972e-02, 1.8743e-03, -1.4592e-02, ..., 7.7799e-03,\n", 590 | " -4.6349e-03, 3.2799e-03],\n", 591 | " ...,\n", 592 | " [ 8.4355e-03, -4.7946e-04, -1.7618e-02, ..., -1.6736e-02,\n", 593 | " -6.3067e-03, 6.9063e-03],\n", 594 | " [ 1.0057e-02, 5.4642e-03, 1.1619e-02, ..., 1.4251e-02,\n", 595 | " -8.2950e-03, 1.3677e-02],\n", 596 | " [ 3.1885e-03, -1.5601e-05, 1.7460e-02, ..., -1.1777e-02,\n", 597 | " -6.7834e-03, 3.3414e-03]],\n", 598 | "\n", 599 | " [[-3.0452e-02, -1.2080e-02, 1.0256e-02, ..., -3.0990e-02,\n", 600 | " 8.6174e-03, 1.6501e-03],\n", 601 | " [-5.2719e-04, -3.2968e-02, -2.6674e-02, ..., -1.6440e-02,\n", 602 | " -3.6365e-03, -3.2362e-02],\n", 603 | " [-2.7233e-02, -2.7331e-02, -3.5724e-02, ..., -9.7884e-03,\n", 604 | " -3.2167e-02, -9.0837e-03],\n", 605 | " ...,\n", 606 | " [-2.0292e-02, -3.3341e-03, -7.6577e-03, ..., 1.4283e-02,\n", 607 | " -1.4460e-03, -1.3133e-02],\n", 608 | " [-3.3671e-02, -1.4031e-02, -7.2689e-03, ..., 1.6328e-02,\n", 609 | " -7.3200e-03, -2.9146e-02],\n", 610 | " [-2.9474e-02, -2.9688e-02, -1.0572e-02, ..., -3.2480e-02,\n", 611 | " -1.3261e-02, -1.5741e-02]],\n", 612 | "\n", 613 | " [[-2.3804e-03, 5.5173e-03, -1.2740e-02, ..., -4.8662e-03,\n", 614 | " -7.2586e-03, 1.0922e-02],\n", 615 | " [-6.3082e-03, -9.7869e-03, -1.6668e-02, ..., -1.0346e-02,\n", 616 | " -7.1375e-04, -1.4136e-02],\n", 617 | " [-9.3555e-03, 5.5218e-03, 1.6871e-02, ..., -7.9774e-03,\n", 618 | " 1.0834e-02, 6.2287e-03],\n", 619 | " ...,\n", 620 | " [-1.0119e-02, -1.4812e-03, -2.6835e-03, ..., 5.7517e-03,\n", 621 | " 1.2835e-02, 8.3581e-03],\n", 622 | " [-1.7669e-02, -4.3534e-04, -1.3433e-02, ..., 1.3524e-02,\n", 623 | " 5.1122e-04, 1.2765e-02],\n", 624 | " [-1.2379e-02, -4.0298e-03, 1.3297e-02, ..., -9.6577e-03,\n", 625 | " -8.4847e-03, -1.0439e-02]]],\n", 626 | "\n", 627 | "\n", 628 | " [[[-2.2538e-03, -4.1233e-03, -1.0215e-02, ..., -2.4550e-03,\n", 629 | " -2.0032e-02, -2.6995e-02],\n", 630 | " [-3.4619e-02, -1.8392e-02, -2.5360e-02, ..., -1.4965e-02,\n", 631 | " -1.0830e-02, -3.1260e-02],\n", 632 | " [-1.0557e-02, -2.3744e-02, 1.6909e-03, ..., -6.7882e-03,\n", 633 | " 1.5083e-03, -1.6190e-02],\n", 634 | " ...,\n", 635 | " [-1.7339e-03, 6.6879e-03, -9.7566e-03, ..., 1.1324e-02,\n", 636 | " -2.9404e-02, 1.9570e-02],\n", 637 | " [ 1.0242e-02, -9.2871e-03, -9.3168e-03, ..., -1.3156e-02,\n", 638 | " -1.4865e-02, -1.1270e-02],\n", 639 | " [ 1.9390e-02, -8.4842e-03, 9.8267e-03, ..., 4.0320e-03,\n", 640 | " -2.6696e-02, -1.6334e-02]],\n", 641 | "\n", 642 | " [[-9.2508e-03, -1.1350e-02, -1.7665e-02, ..., 4.3904e-03,\n", 643 | " 2.7492e-03, -5.2415e-03],\n", 644 | " [-8.4670e-03, -7.3156e-03, -1.9307e-02, ..., -2.3375e-02,\n", 645 | " -1.0639e-02, -1.7652e-02],\n", 646 | " [-2.3184e-02, -1.7577e-02, -6.0105e-03, ..., 4.4489e-03,\n", 647 | " -2.6661e-02, 3.8427e-03],\n", 648 | " ...,\n", 649 | " [-7.8044e-03, -1.7909e-02, 2.7993e-03, ..., -1.1152e-03,\n", 650 | " 7.6839e-03, -1.1714e-02],\n", 651 | " [-9.9899e-03, 2.4783e-03, -3.1628e-03, ..., -1.6662e-02,\n", 652 | " -1.4662e-02, 6.5154e-03],\n", 653 | " [-1.4905e-02, -1.5384e-02, -1.1265e-02, ..., -4.1862e-03,\n", 654 | " -1.9127e-03, -2.4848e-02]],\n", 655 | "\n", 656 | " [[ 3.4846e-03, 8.0098e-03, 1.7443e-02, ..., 1.2480e-02,\n", 657 | " -1.2735e-02, 8.6934e-03],\n", 658 | " [-8.2303e-03, -1.7087e-02, -1.0395e-02, ..., -1.6124e-02,\n", 659 | " 7.0822e-03, -3.8555e-04],\n", 660 | " [-5.2301e-03, 4.9656e-03, 9.1322e-03, ..., -3.9297e-03,\n", 661 | " -1.1945e-02, -3.1185e-03],\n", 662 | " ...,\n", 663 | " [ 1.0450e-02, 1.8954e-02, 2.9704e-03, ..., 1.4643e-02,\n", 664 | " 1.6012e-02, -3.2929e-03],\n", 665 | " [ 1.0485e-02, 7.6941e-03, 7.7856e-03, ..., 6.2871e-03,\n", 666 | " 7.3308e-03, 1.3855e-02],\n", 667 | " [-1.3529e-02, -2.3717e-03, -1.4512e-02, ..., 1.0026e-02,\n", 668 | " -1.6163e-02, -5.7107e-03]],\n", 669 | "\n", 670 | " ...,\n", 671 | "\n", 672 | " [[-1.4811e-02, -2.7844e-02, -2.0868e-02, ..., -2.6010e-02,\n", 673 | " -2.7611e-02, 6.3969e-03],\n", 674 | " [-2.2012e-03, -1.9145e-02, -1.9199e-02, ..., -2.0287e-02,\n", 675 | " -2.2382e-02, -2.2633e-03],\n", 676 | " [-1.0251e-02, -1.5751e-02, -2.7219e-02, ..., 2.9438e-03,\n", 677 | " -2.6035e-02, -2.6711e-02],\n", 678 | " ...,\n", 679 | " [-3.0947e-04, 5.9995e-03, 2.1770e-05, ..., -1.0780e-02,\n", 680 | " 4.2132e-03, 3.1212e-03],\n", 681 | " [-1.9642e-02, -1.5439e-02, -1.3787e-02, ..., -2.8270e-02,\n", 682 | " -8.3740e-03, -6.7641e-03],\n", 683 | " [-6.7095e-03, -1.8616e-02, -2.7250e-02, ..., -2.8718e-02,\n", 684 | " -2.0472e-02, 4.0441e-04]],\n", 685 | "\n", 686 | " [[-2.8262e-02, -7.3320e-03, -1.9765e-02, ..., -8.0278e-03,\n", 687 | " 1.7557e-02, 1.8543e-02],\n", 688 | " [-1.7225e-02, -1.3504e-02, -2.6834e-02, ..., -2.0847e-02,\n", 689 | " -3.4311e-03, 8.1041e-03],\n", 690 | " [-2.3213e-02, 8.8160e-03, 1.5753e-02, ..., -1.5599e-02,\n", 691 | " -2.2783e-02, 1.7687e-03],\n", 692 | " ...,\n", 693 | " [-1.2956e-02, -3.4006e-02, -1.7315e-02, ..., -6.5962e-03,\n", 694 | " -3.2383e-02, 1.5012e-02],\n", 695 | " [ 1.8599e-02, -1.7383e-02, -1.5422e-02, ..., -9.3824e-03,\n", 696 | " -1.5369e-02, -2.1481e-02],\n", 697 | " [-3.9189e-04, -1.3674e-02, -2.4964e-02, ..., -9.4626e-03,\n", 698 | " -1.0716e-02, -1.9111e-03]],\n", 699 | "\n", 700 | " [[-2.4925e-02, -1.9391e-03, 1.8677e-03, ..., -7.9364e-03,\n", 701 | " -1.1269e-02, -1.0375e-02],\n", 702 | " [-2.2959e-02, 1.3838e-03, -5.1879e-03, ..., -2.0389e-02,\n", 703 | " 1.8722e-04, -2.2228e-02],\n", 704 | " [-2.5972e-02, -1.9240e-02, -1.4870e-02, ..., -1.1329e-02,\n", 705 | " -1.0629e-02, -1.2778e-03],\n", 706 | " ...,\n", 707 | " [ 4.6231e-03, -9.8229e-03, -1.6067e-02, ..., -1.4338e-02,\n", 708 | " 1.0771e-03, -1.4400e-02],\n", 709 | " [-1.5673e-02, -4.5755e-03, -1.2823e-02, ..., -1.7801e-02,\n", 710 | " 2.3182e-03, -1.8283e-02],\n", 711 | " [ 2.1563e-03, -5.6639e-03, 6.3025e-03, ..., -1.9270e-02,\n", 712 | " -2.7177e-02, 1.7473e-04]]],\n", 713 | "\n", 714 | "\n", 715 | " ...,\n", 716 | "\n", 717 | "\n", 718 | " [[[ 7.6536e-03, -1.8783e-03, 1.8841e-02, ..., -8.4884e-03,\n", 719 | " -2.2051e-03, -5.5705e-03],\n", 720 | " [-1.1814e-02, -1.4657e-02, 1.1615e-02, ..., -3.1463e-03,\n", 721 | " -3.4147e-02, -2.1097e-02],\n", 722 | " [ 1.7014e-02, -1.1913e-03, -1.3618e-02, ..., -2.0940e-02,\n", 723 | " -1.9440e-02, -3.0029e-02],\n", 724 | " ...,\n", 725 | " [ 1.0215e-02, 1.5527e-02, -6.3834e-03, ..., 6.0160e-03,\n", 726 | " -1.6559e-02, -2.9295e-03],\n", 727 | " [ 1.0632e-02, -1.1926e-02, -1.3686e-03, ..., 1.6902e-02,\n", 728 | " -1.0786e-02, -2.5942e-02],\n", 729 | " [ 3.9939e-03, -3.3778e-02, -1.2943e-02, ..., 1.9375e-03,\n", 730 | " -2.5962e-02, -2.6246e-02]],\n", 731 | "\n", 732 | " [[-1.8836e-02, -1.2895e-02, -2.8608e-02, ..., -1.1196e-02,\n", 733 | " -1.9619e-02, -3.0789e-02],\n", 734 | " [-3.1237e-02, -3.7592e-02, -8.0640e-03, ..., -2.0608e-02,\n", 735 | " -7.0762e-03, -3.3432e-02],\n", 736 | " [-3.4544e-02, -3.1376e-02, -1.8247e-02, ..., -4.2953e-03,\n", 737 | " -2.5268e-02, -3.7524e-02],\n", 738 | " ...,\n", 739 | " [-2.0865e-02, -2.8106e-02, -4.8804e-03, ..., 4.9353e-03,\n", 740 | " -9.5544e-03, -3.9235e-04],\n", 741 | " [-2.0468e-02, -4.8933e-03, -2.7534e-02, ..., -1.2462e-02,\n", 742 | " -2.6990e-02, -7.4737e-03],\n", 743 | " [-2.3287e-02, -2.4754e-02, -2.8761e-02, ..., -1.5842e-02,\n", 744 | " -2.1052e-02, -3.2656e-02]],\n", 745 | "\n", 746 | " [[ 8.0048e-04, 2.2151e-03, 1.5473e-02, ..., -1.2530e-02,\n", 747 | " -1.6299e-02, -3.9971e-03],\n", 748 | " [-1.7649e-02, 6.1190e-03, 5.3151e-03, ..., -2.9324e-02,\n", 749 | " -1.8867e-02, -3.1613e-02],\n", 750 | " [-3.7128e-02, -3.5173e-02, -3.1409e-02, ..., -2.0030e-02,\n", 751 | " -3.2676e-03, -3.1105e-02],\n", 752 | " ...,\n", 753 | " [-2.1572e-02, -3.5458e-02, -2.1744e-02, ..., -4.4794e-03,\n", 754 | " -4.9605e-03, -2.9795e-02],\n", 755 | " [-1.9600e-02, -1.8060e-02, -2.9290e-02, ..., -1.0334e-02,\n", 756 | " -2.3278e-02, -2.6473e-02],\n", 757 | " [-3.4211e-02, -5.7403e-03, -3.1517e-02, ..., -2.5251e-02,\n", 758 | " -2.8706e-02, -3.5840e-02]],\n", 759 | "\n", 760 | " ...,\n", 761 | "\n", 762 | " [[ 1.1339e-02, -1.7595e-02, 3.8017e-03, ..., 2.5522e-03,\n", 763 | " -1.7517e-02, 4.3034e-03],\n", 764 | " [ 9.7192e-03, 1.5814e-02, 5.0818e-03, ..., 1.2481e-02,\n", 765 | " -3.0841e-02, 3.4227e-03],\n", 766 | " [-1.1800e-02, 4.6344e-03, 2.4301e-03, ..., -3.6808e-02,\n", 767 | " -3.3497e-02, -2.8690e-02],\n", 768 | " ...,\n", 769 | " [ 3.6129e-03, -1.1561e-02, -3.0395e-02, ..., -1.2388e-02,\n", 770 | " -9.4928e-03, -1.5173e-03],\n", 771 | " [-1.1360e-02, -4.0666e-03, -2.0922e-02, ..., 8.6673e-04,\n", 772 | " -1.3469e-02, -4.8741e-03],\n", 773 | " [ 5.7896e-03, -1.7382e-02, -7.8392e-03, ..., -2.3734e-03,\n", 774 | " -1.1630e-02, -7.0134e-03]],\n", 775 | "\n", 776 | " [[-3.2164e-02, -6.2788e-03, 1.3968e-02, ..., 3.6180e-03,\n", 777 | " -1.0840e-02, -2.7565e-02],\n", 778 | " [-2.6980e-02, -2.4073e-02, 1.0033e-03, ..., -2.5264e-04,\n", 779 | " -5.5285e-03, -1.2939e-02],\n", 780 | " [ 2.1923e-04, -1.4998e-03, -2.6163e-02, ..., -4.7604e-03,\n", 781 | " 9.5060e-03, 2.7361e-03],\n", 782 | " ...,\n", 783 | " [-1.5853e-02, 1.8252e-02, -1.6496e-02, ..., -3.9139e-03,\n", 784 | " -2.4966e-02, -3.1966e-03],\n", 785 | " [-2.7687e-02, -2.8252e-02, 1.8075e-03, ..., -2.1508e-02,\n", 786 | " 3.0193e-03, -1.8301e-02],\n", 787 | " [ 3.9693e-03, 1.4852e-02, 6.8361e-03, ..., -2.5844e-02,\n", 788 | " -1.3109e-02, -2.7742e-02]],\n", 789 | "\n", 790 | " [[ 1.9207e-03, -1.1992e-02, 1.2561e-02, ..., -2.8050e-02,\n", 791 | " -2.8156e-02, -3.3904e-02],\n", 792 | " [ 1.7325e-02, 1.1727e-02, 4.4550e-03, ..., -2.3177e-02,\n", 793 | " -3.0512e-02, -1.1348e-02],\n", 794 | " [ 1.2288e-02, 3.4642e-04, -2.0631e-02, ..., -9.7264e-03,\n", 795 | " -1.9462e-02, -9.1786e-03],\n", 796 | " ...,\n", 797 | " [-1.4261e-02, -1.8814e-02, -9.2540e-03, ..., -6.0748e-03,\n", 798 | " -1.2992e-02, 4.8125e-04],\n", 799 | " [-1.3841e-02, -2.1739e-02, -1.6609e-02, ..., -3.4722e-03,\n", 800 | " -3.2457e-03, 1.4795e-02],\n", 801 | " [-4.3364e-03, -8.1214e-03, -1.2953e-02, ..., -9.9520e-03,\n", 802 | " 3.6117e-03, -7.1621e-03]]],\n", 803 | "\n", 804 | "\n", 805 | " [[[-2.1822e-02, -1.6658e-02, -7.6389e-03, ..., -2.2257e-02,\n", 806 | " 7.1451e-03, -1.5845e-03],\n", 807 | " [ 1.1925e-03, -3.5487e-03, -1.8371e-02, ..., 1.0235e-02,\n", 808 | " -2.0721e-02, 7.1239e-03],\n", 809 | " [-1.4366e-02, 7.3110e-03, -9.1615e-04, ..., -5.8821e-03,\n", 810 | " 1.5872e-02, 2.1394e-02],\n", 811 | " ...,\n", 812 | " [-3.5594e-03, 6.8701e-03, -1.0854e-02, ..., -2.3067e-02,\n", 813 | " -3.2157e-03, -1.1290e-02],\n", 814 | " [ 2.6806e-02, 3.3598e-04, -1.0921e-02, ..., -1.1420e-02,\n", 815 | " 4.6863e-03, 6.0898e-03],\n", 816 | " [ 3.0626e-03, -1.7101e-02, -5.4114e-03, ..., -1.0365e-02,\n", 817 | " -1.0822e-02, -2.6236e-02]],\n", 818 | "\n", 819 | " [[-1.3101e-02, -1.3059e-02, 7.6095e-03, ..., -1.1628e-02,\n", 820 | " -2.6642e-02, -6.9455e-03],\n", 821 | " [-2.5564e-02, -1.5327e-02, 4.0728e-03, ..., -2.5864e-02,\n", 822 | " -2.2147e-02, 4.5925e-03],\n", 823 | " [-8.2005e-03, 5.9101e-03, -6.4722e-03, ..., -1.4526e-02,\n", 824 | " -4.1891e-03, -1.5764e-02],\n", 825 | " ...,\n", 826 | " [-2.6733e-02, -2.7073e-02, -1.7734e-02, ..., -1.5771e-02,\n", 827 | " -8.3647e-04, 5.2966e-03],\n", 828 | " [ 7.4729e-03, -2.3610e-02, -1.9502e-02, ..., -1.5676e-02,\n", 829 | " 1.1866e-03, 4.3461e-04],\n", 830 | " [-2.7914e-03, -3.7813e-03, -2.0831e-02, ..., -1.0264e-02,\n", 831 | " 8.9520e-04, -2.4958e-02]],\n", 832 | "\n", 833 | " [[-6.4742e-03, -1.8906e-02, -5.6844e-03, ..., 7.3853e-03,\n", 834 | " 2.2777e-03, -6.9292e-03],\n", 835 | " [ 2.8477e-03, 2.0978e-03, 3.7272e-03, ..., -7.4928e-03,\n", 836 | " 1.6647e-02, 1.2275e-02],\n", 837 | " [ 1.1717e-02, -4.8451e-04, 2.7634e-02, ..., -6.2747e-03,\n", 838 | " -7.3154e-03, 4.8498e-04],\n", 839 | " ...,\n", 840 | " [ 1.0360e-02, 2.0931e-02, 1.1289e-02, ..., 3.9727e-03,\n", 841 | " -1.4086e-02, 1.7404e-02],\n", 842 | " [-2.5335e-03, -2.7018e-03, 1.6044e-02, ..., -3.9768e-03,\n", 843 | " -1.3957e-02, -1.4771e-02],\n", 844 | " [ 1.6544e-02, 2.1240e-02, 1.7475e-02, ..., -2.5158e-02,\n", 845 | " -1.9777e-02, -1.7363e-04]],\n", 846 | "\n", 847 | " ...,\n", 848 | "\n", 849 | " [[ 1.4401e-02, 1.2646e-03, -1.3304e-02, ..., 7.7538e-03,\n", 850 | " -1.9440e-02, -2.1017e-02],\n", 851 | " [ 1.6771e-02, -2.3978e-04, -5.0331e-03, ..., -7.6139e-03,\n", 852 | " -2.1629e-04, 6.4135e-03],\n", 853 | " [ 6.8014e-03, 9.8460e-03, -7.2331e-03, ..., -7.9818e-03,\n", 854 | " 3.1137e-03, -2.2293e-02],\n", 855 | " ...,\n", 856 | " [-1.4249e-02, 2.2670e-03, -2.0135e-02, ..., -1.9543e-04,\n", 857 | " 9.2510e-04, -3.7952e-03],\n", 858 | " [ 2.5527e-02, 3.9357e-03, -2.0599e-02, ..., -1.2822e-02,\n", 859 | " -2.0320e-02, 5.3710e-03],\n", 860 | " [ 2.4788e-02, -5.9360e-03, -1.9608e-02, ..., -8.5284e-03,\n", 861 | " -5.3702e-03, 2.7787e-03]],\n", 862 | "\n", 863 | " [[-1.3842e-02, 9.3919e-04, 1.0927e-02, ..., -2.3249e-02,\n", 864 | " 2.1997e-02, -2.7843e-03],\n", 865 | " [-1.8800e-02, 3.3210e-03, -5.7883e-03, ..., -3.2548e-02,\n", 866 | " 1.0355e-02, -7.5103e-05],\n", 867 | " [ 8.8634e-04, -2.7359e-02, 9.0961e-04, ..., -8.1291e-03,\n", 868 | " -3.1408e-04, -5.1685e-03],\n", 869 | " ...,\n", 870 | " [-2.1556e-02, 7.1239e-04, -2.7186e-02, ..., -2.6574e-02,\n", 871 | " -1.7427e-02, -7.3701e-03],\n", 872 | " [ 1.7685e-02, 1.9347e-03, -2.5782e-03, ..., -1.3726e-02,\n", 873 | " -1.9573e-02, -3.1529e-05],\n", 874 | " [ 1.6412e-02, -2.5740e-02, 1.9379e-03, ..., -2.6090e-02,\n", 875 | " -7.1123e-04, 1.2818e-02]],\n", 876 | "\n", 877 | " [[-2.5872e-02, -1.1990e-02, -1.4029e-02, ..., 4.0431e-03,\n", 878 | " 9.0229e-04, -1.4076e-02],\n", 879 | " [-1.9221e-02, -2.4752e-02, -1.5499e-02, ..., -7.9520e-03,\n", 880 | " -7.1294e-03, -4.3111e-03],\n", 881 | " [ 3.4378e-03, -1.3511e-02, -1.3479e-02, ..., -1.0406e-02,\n", 882 | " -9.2696e-03, -5.8095e-03],\n", 883 | " ...,\n", 884 | " [ 5.9763e-03, -6.7900e-04, -2.3468e-02, ..., 7.2678e-03,\n", 885 | " -2.4124e-02, 5.2814e-03],\n", 886 | " [-2.6482e-02, -1.1136e-02, -2.3210e-02, ..., -2.3877e-03,\n", 887 | " -9.3244e-03, -1.3438e-02],\n", 888 | " [-1.4087e-02, 8.4801e-04, 4.2950e-03, ..., -2.6069e-02,\n", 889 | " 5.7832e-03, -1.9748e-02]]],\n", 890 | "\n", 891 | "\n", 892 | " [[[-1.2947e-02, -1.3831e-02, -6.6514e-03, ..., 1.1251e-02,\n", 893 | " -2.7273e-03, -2.9318e-04],\n", 894 | " [ 1.6319e-02, -4.2163e-03, 9.5971e-04, ..., 8.7225e-03,\n", 895 | " 3.4388e-03, -4.2100e-03],\n", 896 | " [-8.9748e-03, 6.1063e-03, -1.0801e-03, ..., 5.1986e-03,\n", 897 | " 8.0231e-03, -2.8249e-02],\n", 898 | " ...,\n", 899 | " [-3.6449e-03, -2.3086e-03, -2.5649e-02, ..., -1.1459e-02,\n", 900 | " -5.9115e-03, 5.8053e-03],\n", 901 | " [-3.4264e-02, -3.3125e-02, -3.9721e-03, ..., -1.2224e-02,\n", 902 | " 1.9460e-02, -5.8133e-03],\n", 903 | " [-3.4569e-02, -3.0598e-02, -3.6949e-02, ..., 5.6422e-03,\n", 904 | " -3.6649e-03, 8.9027e-05]],\n", 905 | "\n", 906 | " [[-2.5274e-02, -2.2699e-02, -2.4185e-02, ..., -1.9850e-02,\n", 907 | " -1.6500e-02, -2.5491e-02],\n", 908 | " [-2.0654e-03, -1.8466e-02, -1.2426e-02, ..., 1.5545e-03,\n", 909 | " -1.6919e-02, -6.4482e-03],\n", 910 | " [-2.1573e-03, 3.2694e-03, -8.2869e-04, ..., -1.9123e-02,\n", 911 | " -3.0052e-02, -6.3218e-03],\n", 912 | " ...,\n", 913 | " [-2.0544e-02, -1.8392e-02, -1.7850e-02, ..., -1.2365e-02,\n", 914 | " -1.7570e-02, -2.4573e-02],\n", 915 | " [-3.4599e-02, -1.4640e-02, -3.5621e-02, ..., -2.3353e-02,\n", 916 | " -1.7889e-02, -3.3007e-02],\n", 917 | " [-2.4938e-02, -5.0069e-03, -2.1860e-02, ..., -2.3937e-02,\n", 918 | " -1.6531e-02, -2.4050e-02]],\n", 919 | "\n", 920 | " [[ 1.8155e-02, -3.6595e-04, 2.9583e-03, ..., -1.4410e-02,\n", 921 | " 1.0625e-02, 1.4375e-03],\n", 922 | " [-4.8929e-03, -8.0628e-03, 1.1450e-02, ..., -1.5520e-02,\n", 923 | " 1.3821e-02, -1.5309e-02],\n", 924 | " [ 1.1759e-02, -3.2002e-03, -1.5472e-02, ..., -9.7236e-03,\n", 925 | " 4.4048e-04, 1.5701e-02],\n", 926 | " ...,\n", 927 | " [ 3.1347e-03, -1.0985e-02, -3.2569e-02, ..., -9.3643e-03,\n", 928 | " 4.0229e-03, -4.7593e-03],\n", 929 | " [-1.4315e-02, -1.1992e-02, 1.4437e-02, ..., -9.9650e-03,\n", 930 | " 1.5973e-03, 1.9719e-03],\n", 931 | " [-1.6013e-02, 2.7376e-03, 1.3703e-02, ..., 4.5032e-03,\n", 932 | " -8.3267e-03, -1.5758e-02]],\n", 933 | "\n", 934 | " ...,\n", 935 | "\n", 936 | " [[-1.6352e-02, -7.9971e-03, -3.6600e-04, ..., -2.4343e-02,\n", 937 | " 4.1341e-03, -1.2726e-02],\n", 938 | " [-7.5895e-03, -2.5708e-02, 6.5365e-05, ..., -1.3495e-03,\n", 939 | " -5.5134e-03, -1.8683e-02],\n", 940 | " [-1.0314e-02, -9.2459e-03, -5.5137e-03, ..., -1.4481e-02,\n", 941 | " -9.4491e-03, -1.8040e-02],\n", 942 | " ...,\n", 943 | " [-3.3748e-02, -2.9064e-02, -5.2415e-03, ..., -8.1776e-03,\n", 944 | " -1.4581e-02, -2.4246e-02],\n", 945 | " [-6.7054e-03, -6.5064e-03, -5.5634e-03, ..., -1.8302e-02,\n", 946 | " -1.3915e-02, -1.9616e-02],\n", 947 | " [-1.2851e-02, -3.7664e-02, -7.9373e-03, ..., -1.1542e-02,\n", 948 | " -2.7742e-02, -1.2360e-02]],\n", 949 | "\n", 950 | " [[ 5.9764e-03, 1.1124e-02, 3.3182e-03, ..., 1.0216e-02,\n", 951 | " -1.5117e-02, 1.3690e-02],\n", 952 | " [ 4.9395e-04, -7.5153e-03, 8.6296e-03, ..., 8.1994e-03,\n", 953 | " 7.1977e-03, 2.5272e-03],\n", 954 | " [-3.7261e-03, -2.5792e-03, -3.5059e-02, ..., 1.6435e-02,\n", 955 | " 1.1533e-02, -5.8290e-03],\n", 956 | " ...,\n", 957 | " [-1.1111e-02, -1.8693e-02, -3.3552e-02, ..., -1.2267e-02,\n", 958 | " 8.4279e-04, -3.2727e-02],\n", 959 | " [-3.3329e-02, -2.4417e-02, -3.4563e-03, ..., -3.7300e-03,\n", 960 | " -4.3485e-03, -2.6191e-03],\n", 961 | " [-2.4551e-02, -2.3301e-02, -5.5629e-03, ..., -2.4263e-02,\n", 962 | " -7.4279e-03, -5.4921e-03]],\n", 963 | "\n", 964 | " [[-1.8330e-02, -3.5020e-02, -4.5647e-03, ..., -1.6847e-02,\n", 965 | " -1.8493e-02, -2.4594e-02],\n", 966 | " [-4.1776e-03, -2.8195e-02, -1.9245e-02, ..., -2.0432e-02,\n", 967 | " -4.7981e-03, -1.4396e-02],\n", 968 | " [-1.4868e-02, -1.7694e-02, -2.6225e-02, ..., -3.2991e-03,\n", 969 | " -3.6838e-03, -4.8610e-03],\n", 970 | " ...,\n", 971 | " [-2.5331e-03, -4.7969e-03, -2.0132e-02, ..., -4.7765e-03,\n", 972 | " -5.7052e-03, -4.8429e-03],\n", 973 | " [-3.4539e-03, -3.3050e-02, -1.4698e-02, ..., -1.2370e-02,\n", 974 | " -2.3638e-02, -2.4548e-02],\n", 975 | " [-1.5635e-02, -3.4954e-02, -1.7280e-02, ..., -1.2131e-02,\n", 976 | " -2.3583e-02, -1.5356e-02]]]]))\n", 977 | "('3.bias', Parameter containing:\n", 978 | "tensor(1.00000e-02 *\n", 979 | " [-1.0348, -0.6432, -2.8054, 0.4010, 0.0355, -1.6032, -2.2993,\n", 980 | " -1.0429, -0.9652, 0.4127, -1.8207, -1.2974, -0.3693, 0.1035,\n", 981 | " -3.5085, 0.2993, -1.0232, -0.8651, 0.9668, -2.0374, -0.7152,\n", 982 | " 0.3597, -1.8070, 0.8926, -3.2788, -0.0156, -1.5564, -1.5726,\n", 983 | " -0.7210, 4.4880, -0.0121, -2.9784, -1.1779, -1.4455, 1.3124,\n", 984 | " 1.3883, -2.0414, -0.6788, -0.2914, 4.7307, 0.1653, -0.8118,\n", 985 | " -0.6951, -1.2998, 1.0289, 1.4498, -0.9608, -2.2262, -1.0067,\n", 986 | " 0.1164, 1.2346, -1.9317, -0.8354, -0.7387, -0.8948, -0.9721,\n", 987 | " -0.1986, -0.8877, -0.2728, -1.8956, -1.8667, -3.1181, -1.0578,\n", 988 | " -0.4842]))\n", 989 | "('6.weight', Parameter containing:\n", 990 | "tensor([[[[-6.6457e-03, -1.4171e-02, -2.9045e-03, ..., -1.8137e-02,\n", 991 | " -2.4039e-02, 6.8482e-03],\n", 992 | " [ 7.1761e-03, -4.3415e-04, -3.1281e-03, ..., -2.2076e-02,\n", 993 | " 3.7009e-03, -2.6765e-02],\n", 994 | " [ 1.5630e-03, -1.9424e-03, 9.1876e-04, ..., -1.7380e-02,\n", 995 | " 7.2866e-03, -1.5511e-02],\n", 996 | " ...,\n", 997 | " [-6.0648e-03, -7.3269e-03, -1.2549e-02, ..., -5.2128e-03,\n", 998 | " -8.3172e-03, -1.7570e-02],\n", 999 | " [-7.9316e-03, -2.4722e-02, 2.5008e-03, ..., -2.3667e-02,\n", 1000 | " -2.3427e-02, -1.3126e-02],\n", 1001 | " [-6.7987e-03, -1.5110e-02, -8.4143e-03, ..., -1.4240e-04,\n", 1002 | " -1.7958e-02, 8.3597e-04]],\n", 1003 | "\n", 1004 | " [[-7.3525e-03, 7.4036e-03, 4.3098e-04, ..., -1.5146e-02,\n", 1005 | " 7.1143e-03, 6.2732e-04],\n", 1006 | " [ 1.6696e-02, -6.1884e-03, -1.7679e-02, ..., 3.8439e-03,\n", 1007 | " -1.2341e-02, -1.3297e-02],\n", 1008 | " [ 2.2285e-02, -7.4451e-03, 9.5357e-03, ..., 5.9170e-03,\n", 1009 | " -1.4165e-02, 5.7909e-03],\n", 1010 | " ...,\n", 1011 | " [ 8.5605e-03, 1.5439e-03, 3.1369e-03, ..., 2.6004e-02,\n", 1012 | " 1.6715e-02, -6.2791e-03],\n", 1013 | " [-2.9113e-03, -5.9755e-03, 2.4794e-02, ..., 1.4971e-02,\n", 1014 | " 2.4299e-02, 4.9134e-03],\n", 1015 | " [ 8.1300e-03, 2.7531e-02, 2.3008e-02, ..., 2.6274e-02,\n", 1016 | " 2.3459e-02, 8.4176e-03]],\n", 1017 | "\n", 1018 | " [[ 1.6915e-03, 1.5662e-02, -2.1010e-02, ..., -2.5390e-02,\n", 1019 | " -1.8454e-02, -2.5313e-03],\n", 1020 | " [-2.4235e-03, -1.7186e-02, -1.6349e-02, ..., -1.0117e-02,\n", 1021 | " -2.0963e-03, 4.7621e-03],\n", 1022 | " [ 5.7097e-03, -5.0673e-03, -1.0786e-02, ..., -2.2081e-02,\n", 1023 | " -1.2243e-02, -1.6443e-02],\n", 1024 | " ...,\n", 1025 | " [ 1.8973e-04, 5.9129e-03, 2.4763e-02, ..., -1.0624e-02,\n", 1026 | " 2.7799e-02, 1.7528e-02],\n", 1027 | " [ 1.5302e-02, 1.1425e-02, 1.0583e-03, ..., -2.5907e-02,\n", 1028 | " -6.2298e-03, 2.6912e-02],\n", 1029 | " [ 1.3923e-03, 3.1232e-03, 2.4442e-02, ..., 4.6041e-03,\n", 1030 | " 1.3593e-03, 3.2995e-04]],\n", 1031 | "\n", 1032 | " ...,\n", 1033 | "\n", 1034 | " [[ 2.5818e-02, -2.5142e-03, 1.4200e-03, ..., -2.1599e-03,\n", 1035 | " -2.2257e-03, -1.5570e-02],\n", 1036 | " [ 1.1808e-02, 5.1975e-03, -1.2687e-02, ..., -9.0135e-03,\n", 1037 | " -1.0521e-02, -7.2020e-03],\n", 1038 | " [ 2.6967e-02, 1.1292e-02, 4.3858e-03, ..., -1.5487e-02,\n", 1039 | " -7.1060e-03, -2.4728e-02],\n", 1040 | " ...,\n", 1041 | " [ 6.9493e-03, -7.3873e-03, -1.4296e-03, ..., -1.5632e-03,\n", 1042 | " -9.1091e-03, -1.7611e-02],\n", 1043 | " [-8.2599e-03, -1.2565e-02, -9.7295e-04, ..., -1.3228e-02,\n", 1044 | " -2.3057e-02, 2.0873e-03],\n", 1045 | " [ 2.5067e-02, 2.2780e-02, -2.1365e-02, ..., -2.5433e-02,\n", 1046 | " -1.2683e-02, -1.1745e-02]],\n", 1047 | "\n", 1048 | " [[ 5.5638e-04, -1.4176e-02, -2.1675e-02, ..., 6.9348e-03,\n", 1049 | " -2.5002e-02, -7.3456e-03],\n", 1050 | " [-2.0352e-02, 6.1517e-03, -1.1137e-02, ..., -1.0299e-02,\n", 1051 | " -7.1797e-03, -1.7937e-02],\n", 1052 | " [-2.4783e-02, 7.8138e-03, -8.3013e-03, ..., -7.0645e-03,\n", 1053 | " 5.7574e-03, -6.3606e-03],\n", 1054 | " ...,\n", 1055 | " [-8.1102e-03, 5.2446e-04, 1.3026e-02, ..., 3.2308e-04,\n", 1056 | " -6.0556e-03, -2.3312e-02],\n", 1057 | " [-1.9393e-02, -1.0644e-02, -1.3462e-02, ..., -2.9526e-03,\n", 1058 | " -1.1095e-02, -4.4025e-03],\n", 1059 | " [-2.0711e-02, -1.2897e-02, -2.3291e-02, ..., -2.2207e-02,\n", 1060 | " -2.4636e-02, -9.8060e-03]],\n", 1061 | "\n", 1062 | " [[-2.7536e-02, 2.2127e-04, -2.0344e-02, ..., -2.6237e-02,\n", 1063 | " -1.6757e-02, -1.0473e-02],\n", 1064 | " [ 2.9774e-03, -3.4460e-03, 4.1607e-04, ..., -1.8696e-02,\n", 1065 | " -1.7803e-02, -1.5318e-02],\n", 1066 | " [-6.8567e-03, -5.4140e-03, -2.2211e-03, ..., -1.5153e-02,\n", 1067 | " -9.4086e-03, -2.4556e-02],\n", 1068 | " ...,\n", 1069 | " [-2.0466e-02, -1.5368e-02, -1.3362e-03, ..., -1.2661e-02,\n", 1070 | " -2.7657e-02, -2.6702e-02],\n", 1071 | " [-1.6134e-04, -5.4864e-03, -6.9648e-03, ..., -8.6749e-03,\n", 1072 | " -1.6099e-02, -1.1674e-02],\n", 1073 | " [-3.9682e-03, -2.1888e-04, -1.8551e-02, ..., 3.1419e-03,\n", 1074 | " -1.6960e-02, -3.9024e-03]]],\n", 1075 | "\n", 1076 | "\n", 1077 | " [[[ 2.6815e-03, 2.7600e-03, -2.3110e-02, ..., -6.3854e-03,\n", 1078 | " 6.4987e-03, 1.1546e-03],\n", 1079 | " [-1.9149e-02, 2.1954e-03, -2.2608e-02, ..., 1.9906e-03,\n", 1080 | " -9.6423e-03, -1.6311e-02],\n", 1081 | " [-4.5714e-04, -6.5635e-03, -1.8411e-02, ..., 2.6722e-02,\n", 1082 | " -1.0920e-02, -2.1461e-02],\n", 1083 | " ...,\n", 1084 | " [ 6.3454e-03, -7.8911e-03, -2.8480e-03, ..., -1.6411e-02,\n", 1085 | " 6.4979e-03, -6.4111e-03],\n", 1086 | " [-2.7195e-02, -2.6426e-02, 6.3926e-03, ..., 7.5039e-03,\n", 1087 | " 1.6723e-02, -2.7925e-03],\n", 1088 | " [-9.6588e-03, -1.8814e-03, -3.7692e-03, ..., -2.3274e-02,\n", 1089 | " -3.0475e-04, -2.4586e-02]],\n", 1090 | "\n", 1091 | " [[-1.9053e-02, -1.4415e-02, -3.9138e-04, ..., -2.2224e-02,\n", 1092 | " -2.5606e-02, -2.7464e-03],\n", 1093 | " [ 3.4185e-03, 6.5735e-04, -6.7643e-03, ..., 3.8953e-03,\n", 1094 | " -2.2330e-02, 3.5497e-04],\n", 1095 | " [-1.7709e-03, -2.3377e-02, -6.9347e-03, ..., -1.8656e-02,\n", 1096 | " -1.9381e-02, -6.5882e-03],\n", 1097 | " ...,\n", 1098 | " [ 7.6387e-03, -2.6929e-02, -7.6107e-04, ..., -2.7788e-02,\n", 1099 | " -1.9311e-02, -2.3376e-02],\n", 1100 | " [-1.8804e-02, -1.5826e-02, -2.3658e-02, ..., -4.7362e-03,\n", 1101 | " -3.9745e-03, -2.0802e-02],\n", 1102 | " [-2.3835e-02, -2.0257e-03, 6.2832e-03, ..., -1.6132e-02,\n", 1103 | " -2.4613e-02, -1.9445e-02]],\n", 1104 | "\n", 1105 | " [[ 3.7441e-03, -2.8301e-04, -2.1012e-02, ..., -2.1116e-02,\n", 1106 | " -1.9632e-02, 4.1838e-03],\n", 1107 | " [ 5.3022e-03, -1.0277e-02, 4.0184e-03, ..., 1.8427e-03,\n", 1108 | " -1.7806e-02, -5.5921e-03],\n", 1109 | " [-2.4765e-02, -1.2122e-02, -3.3981e-03, ..., -2.7065e-03,\n", 1110 | " 7.5494e-03, -8.5881e-03],\n", 1111 | " ...,\n", 1112 | " [-2.5949e-03, -1.2332e-02, -9.9704e-04, ..., 6.1100e-03,\n", 1113 | " -2.1041e-02, 1.5915e-03],\n", 1114 | " [-2.9155e-03, -1.2471e-03, 2.3624e-03, ..., -4.0809e-04,\n", 1115 | " 2.2107e-03, 5.9018e-03],\n", 1116 | " [-2.7314e-02, -8.8494e-03, 3.4153e-03, ..., 1.9356e-03,\n", 1117 | " -2.2871e-02, -1.3754e-02]],\n", 1118 | "\n", 1119 | " ...,\n", 1120 | "\n", 1121 | " [[-1.4542e-02, -1.1539e-02, 8.9263e-05, ..., -7.3279e-03,\n", 1122 | " -2.6264e-02, -1.3329e-02],\n", 1123 | " [-2.7454e-02, 3.3421e-03, -2.5765e-02, ..., -1.0423e-02,\n", 1124 | " -2.6844e-02, 7.3982e-03],\n", 1125 | " [-2.3613e-02, -1.3673e-02, -1.8357e-02, ..., -1.7721e-02,\n", 1126 | " -8.5604e-03, -2.2132e-02],\n", 1127 | " ...,\n", 1128 | " [-2.6013e-02, -3.6969e-03, 2.5747e-03, ..., -3.1840e-03,\n", 1129 | " -1.5127e-02, -5.5397e-03],\n", 1130 | " [-1.4254e-02, -2.5712e-02, -1.9869e-02, ..., -1.7686e-02,\n", 1131 | " 4.4819e-03, -9.8499e-03],\n", 1132 | " [-8.2287e-03, -2.6694e-02, -2.0531e-02, ..., -1.7120e-03,\n", 1133 | " -2.0798e-02, -1.7615e-02]],\n", 1134 | "\n", 1135 | " [[-1.1641e-02, 1.9956e-03, 1.1898e-02, ..., 3.6846e-03,\n", 1136 | " 1.1974e-02, -4.5329e-04],\n", 1137 | " [-2.5668e-02, 1.7122e-02, 1.7507e-02, ..., 9.9175e-03,\n", 1138 | " 2.5714e-02, -7.6476e-04],\n", 1139 | " [-1.7509e-02, 4.3558e-03, 7.5123e-04, ..., -1.4198e-03,\n", 1140 | " 2.5469e-03, 2.4452e-03],\n", 1141 | " ...,\n", 1142 | " [-4.9957e-03, 2.1021e-02, 1.2628e-02, ..., 5.9583e-03,\n", 1143 | " -8.1602e-04, 5.6060e-03],\n", 1144 | " [ 9.3684e-03, -3.8993e-03, -7.4301e-03, ..., 2.5262e-02,\n", 1145 | " -1.1567e-02, -2.2611e-02],\n", 1146 | " [ 1.5262e-02, 8.9769e-03, 9.7152e-03, ..., -7.4974e-03,\n", 1147 | " -4.8129e-03, 5.6780e-03]],\n", 1148 | "\n", 1149 | " [[ 2.3000e-03, -2.4523e-02, 6.6512e-03, ..., -2.7391e-02,\n", 1150 | " 6.8425e-03, -2.7274e-03],\n", 1151 | " [-7.4881e-03, -2.6908e-02, -1.0024e-02, ..., 6.7545e-03,\n", 1152 | " -1.3386e-02, -2.3434e-02],\n", 1153 | " [-1.5010e-03, -1.7844e-03, -1.2954e-02, ..., -1.4116e-02,\n", 1154 | " -5.1217e-03, -8.3684e-03],\n", 1155 | " ...,\n", 1156 | " [-2.3182e-02, -1.3679e-02, -2.6907e-02, ..., 7.7890e-03,\n", 1157 | " 5.6772e-03, -2.3604e-03],\n", 1158 | " [-1.3363e-02, 3.2209e-03, -2.5748e-02, ..., -2.0797e-02,\n", 1159 | " -1.4555e-02, -1.4172e-02],\n", 1160 | " [-1.8342e-03, -1.0991e-02, -1.9722e-02, ..., -1.5551e-02,\n", 1161 | " -1.0138e-02, -1.0672e-02]]],\n", 1162 | "\n", 1163 | "\n", 1164 | " [[[ 1.0803e-02, 4.7048e-03, 1.6983e-02, ..., 4.1527e-03,\n", 1165 | " 2.2373e-02, 5.4560e-04],\n", 1166 | " [ 6.3237e-03, 2.1544e-02, 1.7252e-02, ..., -2.2766e-03,\n", 1167 | " 1.3347e-02, -4.3080e-03],\n", 1168 | " [ 2.6734e-02, 2.6813e-02, 6.2577e-03, ..., 2.1421e-02,\n", 1169 | " -3.0671e-03, 2.6876e-02],\n", 1170 | " ...,\n", 1171 | " [ 3.8466e-03, 1.4918e-02, 9.1837e-04, ..., 1.4482e-02,\n", 1172 | " -2.3947e-02, 2.3661e-02],\n", 1173 | " [-5.0735e-03, 1.9258e-02, 7.1542e-03, ..., 2.7190e-02,\n", 1174 | " -2.4411e-02, 2.2396e-02],\n", 1175 | " [ 5.5550e-03, 2.6562e-03, 2.5110e-02, ..., 1.3546e-02,\n", 1176 | " 6.1975e-03, 1.0409e-02]],\n", 1177 | "\n", 1178 | " [[-1.1136e-02, 6.9883e-03, 3.0030e-03, ..., -5.5232e-04,\n", 1179 | " -1.7540e-02, -2.3302e-02],\n", 1180 | " [-1.4507e-02, 3.2926e-03, -2.3579e-02, ..., -1.3034e-02,\n", 1181 | " -1.0693e-02, -1.6482e-02],\n", 1182 | " [-1.4580e-02, -9.5563e-03, -6.7839e-03, ..., -1.4063e-02,\n", 1183 | " -1.8502e-02, -2.5409e-02],\n", 1184 | " ...,\n", 1185 | " [-1.0305e-02, 6.6265e-03, -6.3571e-03, ..., -1.4248e-02,\n", 1186 | " -1.3378e-03, -2.7316e-02],\n", 1187 | " [-2.7698e-02, 5.9108e-03, -2.4755e-02, ..., -1.2901e-02,\n", 1188 | " -1.3346e-02, -1.8909e-02],\n", 1189 | " [-7.2682e-03, 2.3862e-03, 7.2970e-03, ..., -1.9567e-03,\n", 1190 | " 2.5399e-03, -1.2041e-02]],\n", 1191 | "\n", 1192 | " [[ 9.3208e-04, -2.4150e-02, -8.2703e-03, ..., -9.9188e-03,\n", 1193 | " -2.7008e-02, -6.4440e-03],\n", 1194 | " [-2.8552e-03, -2.5445e-02, -1.7352e-03, ..., -5.3413e-03,\n", 1195 | " 3.9580e-03, -1.5058e-02],\n", 1196 | " [-2.2481e-02, -7.4268e-03, -1.6228e-02, ..., 6.2900e-03,\n", 1197 | " -4.6813e-03, -2.2208e-02],\n", 1198 | " ...,\n", 1199 | " [-2.2341e-02, 1.4652e-03, -6.4600e-03, ..., -1.5374e-02,\n", 1200 | " -2.3160e-02, -3.9129e-03],\n", 1201 | " [-1.1384e-02, -2.0828e-02, 5.7455e-03, ..., -1.1452e-02,\n", 1202 | " -7.6033e-03, 7.8521e-03],\n", 1203 | " [-1.1966e-03, -1.0845e-02, -9.7271e-04, ..., -9.2989e-03,\n", 1204 | " -8.6757e-03, -2.6281e-02]],\n", 1205 | "\n", 1206 | " ...,\n", 1207 | "\n", 1208 | " [[-1.3458e-02, -7.7781e-03, -2.3052e-02, ..., 2.8025e-03,\n", 1209 | " -7.8977e-03, -3.7936e-03],\n", 1210 | " [-1.1218e-02, -1.6381e-02, 6.8840e-03, ..., 3.5669e-03,\n", 1211 | " -2.7674e-02, -3.5688e-03],\n", 1212 | " [-8.9585e-03, -1.2310e-02, -2.2705e-02, ..., -9.7054e-03,\n", 1213 | " -2.3737e-03, -6.4271e-04],\n", 1214 | " ...,\n", 1215 | " [ 3.4600e-03, -9.8721e-04, 2.1120e-02, ..., -2.6087e-02,\n", 1216 | " -4.4846e-03, -5.2615e-03],\n", 1217 | " [ 8.7108e-04, -8.7200e-03, 1.5654e-02, ..., -9.8368e-03,\n", 1218 | " -1.5175e-02, 1.6077e-03],\n", 1219 | " [ 3.6899e-03, -1.1976e-02, -3.6526e-03, ..., 1.2364e-04,\n", 1220 | " -1.8276e-02, -2.1552e-02]],\n", 1221 | "\n", 1222 | " [[ 2.5739e-03, 3.8341e-03, 4.8284e-03, ..., 1.5254e-02,\n", 1223 | " -1.8352e-02, -1.8539e-02],\n", 1224 | " [-1.0978e-03, 3.0958e-03, -2.1609e-02, ..., -1.6518e-02,\n", 1225 | " 1.1658e-02, -1.6776e-02],\n", 1226 | " [ 2.3345e-02, 1.4186e-02, 7.7396e-03, ..., 2.4179e-02,\n", 1227 | " 7.5861e-03, 1.4574e-03],\n", 1228 | " ...,\n", 1229 | " [ 9.2825e-03, 3.2912e-03, 1.9568e-03, ..., -1.0460e-03,\n", 1230 | " -4.2239e-04, 2.6380e-03],\n", 1231 | " [ 2.2806e-02, 2.7072e-02, 1.1315e-02, ..., 5.2665e-03,\n", 1232 | " 3.7033e-04, 2.7828e-02],\n", 1233 | " [ 2.7164e-02, 1.1026e-03, 2.7055e-03, ..., 1.7518e-02,\n", 1234 | " 2.3056e-02, -6.8682e-03]],\n", 1235 | "\n", 1236 | " [[-1.4881e-02, -5.9023e-03, -1.9649e-02, ..., -4.1369e-04,\n", 1237 | " -1.3280e-02, -2.6200e-02],\n", 1238 | " [-2.6755e-02, -2.1669e-02, 4.5764e-03, ..., -7.8507e-03,\n", 1239 | " 6.4255e-03, 9.9325e-03],\n", 1240 | " [-8.6054e-03, -7.6855e-03, 5.8127e-03, ..., 2.5860e-02,\n", 1241 | " 6.4223e-03, 3.5202e-03],\n", 1242 | " ...,\n", 1243 | " [-6.3107e-03, 4.4912e-03, -7.6356e-03, ..., 2.1135e-02,\n", 1244 | " -1.6345e-03, 5.7075e-03],\n", 1245 | " [ 3.9341e-03, 1.1165e-02, -7.7545e-03, ..., 1.0315e-02,\n", 1246 | " -4.8345e-03, 1.4341e-02],\n", 1247 | " [ 1.8492e-02, 1.3883e-02, 1.0993e-02, ..., 3.8087e-03,\n", 1248 | " 2.1333e-02, 5.9169e-03]]],\n", 1249 | "\n", 1250 | "\n", 1251 | " ...,\n", 1252 | "\n", 1253 | "\n", 1254 | " [[[-1.7079e-02, -2.3652e-02, 1.7911e-02, ..., -1.2363e-02,\n", 1255 | " 2.8492e-03, 7.0113e-03],\n", 1256 | " [ 1.6031e-03, -2.7487e-02, -1.1339e-03, ..., -2.4735e-02,\n", 1257 | " 1.1502e-02, 1.2130e-02],\n", 1258 | " [-5.5296e-04, -2.5571e-02, -6.1638e-04, ..., 1.6285e-02,\n", 1259 | " 1.5937e-02, 6.5888e-03],\n", 1260 | " ...,\n", 1261 | " [-5.1860e-04, -5.0372e-03, 8.0611e-03, ..., -1.0326e-03,\n", 1262 | " -1.7013e-02, 6.6016e-03],\n", 1263 | " [-1.2407e-02, -7.1872e-03, 2.0173e-02, ..., 2.6709e-02,\n", 1264 | " 2.6810e-02, -2.2917e-02],\n", 1265 | " [-4.1939e-03, 1.3234e-02, 7.8543e-03, ..., 5.6746e-03,\n", 1266 | " -1.7797e-02, 4.2977e-03]],\n", 1267 | "\n", 1268 | " [[-5.5146e-03, -1.6946e-02, -6.5365e-03, ..., -2.4159e-02,\n", 1269 | " -2.6040e-02, -9.4051e-03],\n", 1270 | " [ 7.1273e-03, -4.6073e-03, -8.6110e-03, ..., 1.7259e-03,\n", 1271 | " -3.6051e-03, 2.7651e-03],\n", 1272 | " [-1.9700e-02, -2.6362e-02, -9.3747e-03, ..., -2.6163e-03,\n", 1273 | " -1.9860e-02, -4.4046e-04],\n", 1274 | " ...,\n", 1275 | " [-1.1889e-02, -9.4752e-03, -2.4356e-02, ..., -2.3420e-02,\n", 1276 | " -2.0885e-02, -1.9287e-02],\n", 1277 | " [-2.6928e-02, -2.4612e-02, 4.7622e-03, ..., -1.5503e-02,\n", 1278 | " -2.4363e-02, 7.5888e-03],\n", 1279 | " [-1.5518e-02, -2.3157e-02, -1.0659e-03, ..., -2.4205e-02,\n", 1280 | " -9.6639e-03, -2.3377e-02]],\n", 1281 | "\n", 1282 | " [[-2.6864e-02, -2.4899e-02, -2.2055e-03, ..., -1.4565e-02,\n", 1283 | " -8.2756e-03, -2.1349e-02],\n", 1284 | " [-1.9350e-02, -2.6102e-02, -7.5557e-03, ..., -2.6522e-02,\n", 1285 | " -2.1705e-02, -2.3488e-02],\n", 1286 | " [ 6.7886e-03, -2.0861e-02, -7.1895e-03, ..., -2.0731e-02,\n", 1287 | " -1.6870e-02, -1.9063e-02],\n", 1288 | " ...,\n", 1289 | " [-8.5981e-03, -1.5810e-02, -2.1077e-02, ..., 1.8970e-02,\n", 1290 | " -7.3123e-03, 6.5245e-03],\n", 1291 | " [-1.9654e-02, -2.7379e-02, -1.4654e-02, ..., 1.7281e-02,\n", 1292 | " -2.6117e-02, -9.2734e-03],\n", 1293 | " [-1.7851e-02, -7.7316e-03, 4.3901e-03, ..., -3.3982e-03,\n", 1294 | " 5.3714e-03, 4.5850e-03]],\n", 1295 | "\n", 1296 | " ...,\n", 1297 | "\n", 1298 | " [[ 7.6055e-03, -9.5157e-03, -2.1007e-02, ..., 2.3747e-03,\n", 1299 | " 5.1110e-03, -2.7625e-02],\n", 1300 | " [-1.3811e-02, 5.6590e-03, 1.1003e-04, ..., -1.8449e-02,\n", 1301 | " -8.6538e-04, 1.8602e-03],\n", 1302 | " [ 1.5298e-03, 5.9226e-03, -1.5929e-02, ..., -7.0295e-03,\n", 1303 | " -6.9297e-03, -3.3335e-04],\n", 1304 | " ...,\n", 1305 | " [-8.5364e-03, 5.2309e-04, -2.4532e-02, ..., -2.7381e-02,\n", 1306 | " -2.3954e-02, -7.8353e-04],\n", 1307 | " [-1.2966e-02, -9.3232e-04, -1.1649e-02, ..., 7.2251e-03,\n", 1308 | " -2.4828e-02, -7.1678e-03],\n", 1309 | " [-2.7845e-02, -7.3668e-03, -1.3037e-02, ..., -2.5463e-03,\n", 1310 | " -1.1670e-02, 6.9228e-04]],\n", 1311 | "\n", 1312 | " [[ 4.2987e-03, -1.3866e-02, -3.0098e-04, ..., -2.0312e-02,\n", 1313 | " -2.6673e-02, -7.5054e-03],\n", 1314 | " [-2.5288e-02, -2.7234e-02, -3.2072e-03, ..., -1.6922e-03,\n", 1315 | " 5.1159e-03, 1.8809e-03],\n", 1316 | " [-7.8404e-03, -2.4190e-02, -5.6545e-03, ..., -9.9718e-03,\n", 1317 | " 2.2418e-03, -1.8270e-03],\n", 1318 | " ...,\n", 1319 | " [-2.1183e-02, -1.7935e-02, -1.2816e-02, ..., -4.2227e-03,\n", 1320 | " 3.4619e-03, -5.6836e-03],\n", 1321 | " [ 5.1959e-03, 1.4082e-03, -1.8438e-02, ..., 5.0958e-03,\n", 1322 | " -4.6172e-03, -1.0442e-02],\n", 1323 | " [ 3.1867e-03, 1.6476e-02, -2.3770e-03, ..., -1.1497e-03,\n", 1324 | " -5.9099e-03, -1.2312e-05]],\n", 1325 | "\n", 1326 | " [[-4.6278e-03, -1.7988e-02, -1.4015e-02, ..., -7.2963e-03,\n", 1327 | " -1.5966e-02, -2.2753e-02],\n", 1328 | " [-2.2051e-02, -1.8920e-02, -2.3424e-02, ..., -1.3496e-02,\n", 1329 | " -4.3788e-03, -1.8417e-02],\n", 1330 | " [ 6.6881e-03, -2.0990e-03, -1.6915e-02, ..., -1.0629e-02,\n", 1331 | " -1.8865e-02, -2.7226e-02],\n", 1332 | " ...,\n", 1333 | " [-2.1795e-02, -9.9422e-03, 1.1856e-03, ..., -1.4233e-02,\n", 1334 | " -5.5066e-03, -1.3657e-03],\n", 1335 | " [-9.7043e-03, -1.9177e-02, -1.1190e-02, ..., 6.3276e-03,\n", 1336 | " 3.6512e-03, -4.3879e-04],\n", 1337 | " [-3.5802e-03, -1.2609e-02, 3.3233e-03, ..., 6.7619e-04,\n", 1338 | " 4.9258e-03, 3.0377e-03]]],\n", 1339 | "\n", 1340 | "\n", 1341 | " [[[-7.1877e-03, -1.5681e-02, -1.6549e-02, ..., 9.0503e-03,\n", 1342 | " 2.6306e-02, -2.6235e-03],\n", 1343 | " [-2.3821e-02, -8.0970e-03, -7.9879e-03, ..., -2.6150e-02,\n", 1344 | " -1.9651e-02, -2.1417e-02],\n", 1345 | " [ 1.0182e-02, 2.1408e-02, -1.7475e-02, ..., -3.8979e-03,\n", 1346 | " -8.5626e-03, -2.2207e-02],\n", 1347 | " ...,\n", 1348 | " [ 1.2065e-02, -3.3887e-03, -2.4597e-02, ..., -7.3119e-03,\n", 1349 | " 5.5528e-04, -2.4736e-02],\n", 1350 | " [ 6.9064e-03, -1.4728e-03, -7.0641e-03, ..., -5.9020e-03,\n", 1351 | " -1.9837e-03, 9.0277e-04],\n", 1352 | " [ 3.5109e-03, 8.2354e-03, 1.1213e-02, ..., 2.2563e-03,\n", 1353 | " -2.5394e-03, -4.8740e-04]],\n", 1354 | "\n", 1355 | " [[ 1.4663e-02, -2.5992e-02, 6.7058e-03, ..., 1.3753e-03,\n", 1356 | " -1.5902e-02, -3.0446e-04],\n", 1357 | " [-1.5684e-02, 1.5662e-03, 1.4345e-04, ..., 3.9895e-03,\n", 1358 | " -1.3194e-02, -1.8605e-02],\n", 1359 | " [-1.2445e-02, -1.7827e-02, -3.9375e-03, ..., 5.2872e-03,\n", 1360 | " -1.1453e-03, 6.0658e-03],\n", 1361 | " ...,\n", 1362 | " [ 1.9661e-02, -2.8060e-03, 5.9395e-03, ..., -1.0668e-02,\n", 1363 | " -1.9702e-02, -1.1407e-02],\n", 1364 | " [-5.6370e-03, -8.0981e-03, -9.2554e-03, ..., 4.9647e-03,\n", 1365 | " 6.1075e-03, -2.8991e-03],\n", 1366 | " [-3.0469e-04, 9.4089e-03, -3.9601e-03, ..., -1.7853e-02,\n", 1367 | " -2.6795e-02, -1.4895e-03]],\n", 1368 | "\n", 1369 | " [[-1.0753e-02, 1.3153e-02, -7.8495e-03, ..., -6.2965e-03,\n", 1370 | " -6.8527e-03, -4.3924e-03],\n", 1371 | " [ 2.5400e-03, -2.6458e-02, 3.5085e-03, ..., -2.7219e-02,\n", 1372 | " -1.2093e-02, 4.6735e-03],\n", 1373 | " [-1.0301e-02, -2.7772e-02, -2.2750e-02, ..., -7.2343e-03,\n", 1374 | " -5.1331e-04, 2.2712e-03],\n", 1375 | " ...,\n", 1376 | " [-1.7714e-02, -3.8750e-03, 5.8806e-03, ..., 1.6281e-02,\n", 1377 | " -2.3514e-03, 1.7316e-02],\n", 1378 | " [-1.8493e-02, -1.9961e-02, -1.1608e-02, ..., 2.9879e-03,\n", 1379 | " -1.2182e-02, 1.6411e-03],\n", 1380 | " [-3.9716e-03, -2.7665e-02, -1.9828e-02, ..., -6.4639e-03,\n", 1381 | " -9.6503e-03, 5.3992e-04]],\n", 1382 | "\n", 1383 | " ...,\n", 1384 | "\n", 1385 | " [[ 1.6866e-02, 2.1281e-02, -1.9741e-02, ..., -1.8323e-02,\n", 1386 | " -2.5315e-02, -2.2827e-02],\n", 1387 | " [ 1.2587e-02, -2.1247e-02, -1.3705e-02, ..., 4.2168e-04,\n", 1388 | " 4.2513e-03, -1.8466e-02],\n", 1389 | " [-2.4485e-02, -1.5450e-02, -1.6921e-02, ..., 3.0821e-03,\n", 1390 | " -1.4335e-02, 5.8570e-03],\n", 1391 | " ...,\n", 1392 | " [-7.2738e-03, -4.1662e-03, -1.5849e-02, ..., 5.0289e-04,\n", 1393 | " -7.0477e-03, -1.7925e-02],\n", 1394 | " [-3.5463e-03, -1.9288e-02, -1.6590e-02, ..., -4.3331e-03,\n", 1395 | " 4.0621e-03, -1.3745e-02],\n", 1396 | " [ 2.4187e-02, 1.1818e-02, -1.6819e-02, ..., -2.5773e-02,\n", 1397 | " -7.9688e-03, -1.2778e-02]],\n", 1398 | "\n", 1399 | " [[-2.6345e-02, -2.2053e-02, -1.0640e-02, ..., -1.8684e-02,\n", 1400 | " -1.4214e-02, -6.4522e-03],\n", 1401 | " [-1.3135e-02, -1.2603e-02, 2.7860e-03, ..., -1.1153e-02,\n", 1402 | " -2.6949e-02, -1.9304e-02],\n", 1403 | " [ 6.7585e-03, 2.1437e-03, -2.2104e-02, ..., -2.6568e-02,\n", 1404 | " -1.2645e-02, -4.9750e-03],\n", 1405 | " ...,\n", 1406 | " [ 9.7202e-05, 2.2102e-02, -1.1010e-02, ..., -2.9561e-03,\n", 1407 | " -1.6349e-02, -8.2710e-03],\n", 1408 | " [ 1.4986e-02, -2.2819e-03, 1.5725e-02, ..., -2.8215e-03,\n", 1409 | " -8.3108e-04, 7.6056e-03],\n", 1410 | " [ 1.5228e-02, 1.1487e-02, -2.5822e-02, ..., 9.8976e-03,\n", 1411 | " -2.6789e-02, -4.1409e-03]],\n", 1412 | "\n", 1413 | " [[-2.9711e-03, -1.4094e-02, 3.8414e-03, ..., -2.0743e-02,\n", 1414 | " -9.5010e-03, -2.3399e-02],\n", 1415 | " [-5.2331e-04, -6.4809e-03, -2.0062e-02, ..., 7.0671e-03,\n", 1416 | " -1.0242e-02, -1.8892e-02],\n", 1417 | " [-1.8418e-02, -1.2636e-02, 2.0545e-03, ..., -1.7045e-03,\n", 1418 | " -1.2336e-02, -2.4090e-02],\n", 1419 | " ...,\n", 1420 | " [-7.5012e-03, 3.8512e-03, -2.6576e-02, ..., -2.0135e-02,\n", 1421 | " -1.1112e-02, -2.2840e-02],\n", 1422 | " [-9.6134e-03, -2.5728e-02, -1.8202e-02, ..., 6.0040e-04,\n", 1423 | " 7.6143e-03, -7.5557e-03],\n", 1424 | " [ 5.8229e-03, -3.4572e-03, -1.0796e-02, ..., -1.7034e-04,\n", 1425 | " -2.3383e-02, -8.9818e-03]]],\n", 1426 | "\n", 1427 | "\n", 1428 | " [[[-2.3425e-02, -7.5719e-03, 9.8183e-03, ..., -7.3464e-03,\n", 1429 | " 1.0208e-02, 2.6022e-02],\n", 1430 | " [ 1.9817e-02, 2.0486e-03, 7.5612e-03, ..., 2.3252e-02,\n", 1431 | " 3.6919e-03, 2.4617e-02],\n", 1432 | " [ 1.5216e-02, 7.6164e-03, 1.2121e-02, ..., -2.5427e-02,\n", 1433 | " 5.9616e-03, -1.5313e-02],\n", 1434 | " ...,\n", 1435 | " [-1.8953e-02, -2.7664e-02, -8.3372e-04, ..., -1.1394e-02,\n", 1436 | " -3.9599e-03, -1.0342e-03],\n", 1437 | " [-1.6751e-02, -2.0885e-02, -1.7630e-02, ..., -1.6645e-03,\n", 1438 | " -2.3710e-02, -1.7802e-02],\n", 1439 | " [-6.0117e-03, 3.8652e-03, -2.6424e-02, ..., -2.2235e-02,\n", 1440 | " -1.6443e-03, -2.7785e-02]],\n", 1441 | "\n", 1442 | " [[-4.1271e-03, 4.0829e-03, 3.4600e-03, ..., -2.2573e-02,\n", 1443 | " -1.6629e-02, -3.0176e-03],\n", 1444 | " [ 2.0742e-02, -8.8202e-03, -2.5944e-02, ..., 2.3755e-02,\n", 1445 | " -6.2048e-03, 1.5848e-02],\n", 1446 | " [ 6.0385e-03, 9.0078e-03, 1.1106e-02, ..., -2.3429e-02,\n", 1447 | " 6.0346e-03, 2.3764e-02],\n", 1448 | " ...,\n", 1449 | " [-3.2518e-03, 1.1081e-02, -2.9847e-03, ..., 2.1810e-03,\n", 1450 | " 2.1432e-02, 1.4721e-02],\n", 1451 | " [ 2.4611e-03, 2.6107e-02, -1.9289e-03, ..., 1.3872e-02,\n", 1452 | " 2.3297e-03, -1.8788e-03],\n", 1453 | " [ 2.1329e-02, 1.6712e-03, 2.4485e-02, ..., 1.1636e-02,\n", 1454 | " 9.4464e-03, 2.6383e-02]],\n", 1455 | "\n", 1456 | " [[-2.0996e-02, 6.0790e-03, -8.0994e-03, ..., 3.8938e-03,\n", 1457 | " -1.3891e-03, 7.1402e-03],\n", 1458 | " [-7.0939e-03, 6.2268e-03, -1.4198e-02, ..., -5.2488e-03,\n", 1459 | " 1.4681e-02, 1.2842e-02],\n", 1460 | " [ 4.9848e-03, -2.7536e-03, -2.2892e-02, ..., 3.7270e-03,\n", 1461 | " 2.0247e-02, 1.3076e-02],\n", 1462 | " ...,\n", 1463 | " [-1.8175e-03, 1.1675e-02, 1.6029e-02, ..., 3.0613e-03,\n", 1464 | " 1.4126e-03, -1.0311e-03],\n", 1465 | " [ 1.1964e-02, -2.5340e-03, 2.3853e-02, ..., 6.0123e-03,\n", 1466 | " 1.8182e-02, 4.9782e-03],\n", 1467 | " [ 2.6864e-02, -6.5097e-03, 1.3913e-02, ..., -5.3833e-03,\n", 1468 | " 1.0168e-03, 3.6364e-03]],\n", 1469 | "\n", 1470 | " ...,\n", 1471 | "\n", 1472 | " [[-2.2790e-02, -2.2155e-02, 2.9486e-03, ..., -4.1600e-04,\n", 1473 | " -9.5766e-05, -9.7980e-03],\n", 1474 | " [ 2.8710e-04, -8.9594e-03, -2.1569e-03, ..., 3.8048e-03,\n", 1475 | " -9.6475e-03, -1.3285e-02],\n", 1476 | " [-1.6881e-03, -2.4389e-02, -2.6588e-02, ..., -1.8146e-02,\n", 1477 | " -2.5774e-02, -1.9062e-02],\n", 1478 | " ...,\n", 1479 | " [ 6.1846e-03, -2.6508e-02, -2.3966e-02, ..., -8.0941e-03,\n", 1480 | " -1.7214e-03, -1.8662e-02],\n", 1481 | " [-2.4548e-02, 2.0505e-02, -1.8847e-02, ..., -1.8596e-02,\n", 1482 | " -2.2775e-02, -1.5670e-02],\n", 1483 | " [-6.7244e-03, 1.5245e-02, 2.6767e-03, ..., -9.2259e-04,\n", 1484 | " -1.3007e-02, 3.1601e-03]],\n", 1485 | "\n", 1486 | " [[-2.3199e-02, -8.7317e-03, -3.8718e-03, ..., 7.0642e-03,\n", 1487 | " -2.6819e-02, -2.3488e-02],\n", 1488 | " [-2.7719e-02, 1.8092e-03, -4.2290e-03, ..., -3.7541e-03,\n", 1489 | " 2.3110e-02, -5.9336e-03],\n", 1490 | " [-1.3882e-02, -9.4410e-03, 7.1976e-03, ..., 6.1983e-03,\n", 1491 | " 7.5404e-03, 2.6457e-02],\n", 1492 | " ...,\n", 1493 | " [-3.6166e-03, -1.9016e-02, 7.3500e-03, ..., -7.7176e-03,\n", 1494 | " -4.5644e-03, -7.5307e-03],\n", 1495 | " [-1.6041e-02, -1.3890e-03, -8.0973e-03, ..., -2.1373e-02,\n", 1496 | " -1.3475e-02, -1.5834e-02],\n", 1497 | " [-1.5544e-02, -5.1768e-04, 5.4445e-03, ..., -1.8930e-02,\n", 1498 | " -2.3949e-02, -5.7021e-03]],\n", 1499 | "\n", 1500 | " [[ 1.0378e-03, 8.1250e-04, -1.7659e-02, ..., 4.4009e-03,\n", 1501 | " -5.7019e-04, 5.7071e-03],\n", 1502 | " [-8.5712e-04, 5.3408e-03, -2.6760e-02, ..., -2.3124e-02,\n", 1503 | " -5.0353e-03, -1.1309e-02],\n", 1504 | " [ 2.5485e-02, -1.7972e-02, 3.4282e-03, ..., -4.4639e-03,\n", 1505 | " 1.3660e-03, -8.8214e-04],\n", 1506 | " ...,\n", 1507 | " [-9.1250e-03, -1.2143e-02, -1.7638e-03, ..., -2.3895e-02,\n", 1508 | " -2.5546e-02, 5.2568e-03],\n", 1509 | " [-1.0582e-02, 3.3731e-03, -2.1635e-02, ..., -1.5461e-02,\n", 1510 | " -8.5758e-03, -7.9359e-03],\n", 1511 | " [-1.5926e-02, -1.1710e-02, -1.3718e-02, ..., -1.8985e-02,\n", 1512 | " 1.9257e-03, -3.7265e-03]]]]))\n", 1513 | "('6.bias', Parameter containing:\n", 1514 | "tensor(1.00000e-02 *\n", 1515 | " [-0.6255, 4.9319, -3.6779, -2.9463, -2.5801, 0.8595, -1.0889,\n", 1516 | " 4.8599, 0.5028, 1.3037, -0.7622, 3.5637, 1.6952, -2.5448,\n", 1517 | " -0.1713, 1.7510, -3.0964, -0.9239, 2.0107, -1.5601, -4.1642,\n", 1518 | " -1.7541, -0.9685, 2.0369, -0.7735, 4.4888, 1.0942, -0.2250,\n", 1519 | " 1.5792, 1.1349, -1.6582, -1.1896, -1.3102, 4.1395, -0.1528,\n", 1520 | " -4.3832, -3.0477, 2.4790, -0.6793, -0.5944, -2.2985, 0.9787,\n", 1521 | " -1.1641, 0.8887, -2.2574, -0.9951, -1.2451, 2.0503, -7.5850,\n", 1522 | " -0.5772, -1.6409, 0.9793, -1.5066, 4.9639, -2.9812, -1.3580,\n", 1523 | " 0.0373, 1.6401, -0.9795, -2.6780, -0.8956, 3.6520, -1.1645,\n", 1524 | " 2.0801]))\n", 1525 | "('10.weight', Parameter containing:\n", 1526 | "tensor([[-7.5301e-02, -1.7809e-02, -3.9599e-02, ..., 7.6142e-02,\n", 1527 | " -1.0008e-01, -7.2872e-02],\n", 1528 | " [ 5.1972e-02, -1.6626e-01, 8.4465e-02, ..., -7.6805e-02,\n", 1529 | " -9.8366e-02, 6.6758e-02],\n", 1530 | " [-3.3718e-02, 1.3370e-01, -5.7192e-02, ..., -9.0067e-02,\n", 1531 | " 7.1618e-02, -2.5465e-02],\n", 1532 | " ...,\n", 1533 | " [ 6.2247e-02, 6.4090e-02, 8.5833e-02, ..., -1.2668e-02,\n", 1534 | " 1.3935e-02, -5.4030e-02],\n", 1535 | " [-2.3584e-01, 1.3796e-01, 8.0857e-02, ..., 1.2481e-01,\n", 1536 | " -4.7108e-02, -1.1746e-01],\n", 1537 | " [ 1.1030e-01, -4.2672e-02, 2.4807e-02, ..., 3.9567e-02,\n", 1538 | " -5.2033e-02, 5.8760e-02]]))\n", 1539 | "('10.bias', Parameter containing:\n", 1540 | "tensor([-0.0170, -0.0177, 0.0905, 0.0724, 0.0496, 0.0758, 0.0863,\n", 1541 | " -0.0121, -0.1114, -0.1325, 0.0691, 0.0418, 0.0570, 0.0775,\n", 1542 | " 0.1363, -0.0270, 0.0533, -0.0383, -0.0989, 0.0183, 0.0397,\n", 1543 | " 0.1140, 0.0707, 0.0802, 0.0219, -0.0462, -0.0971, -0.0339,\n", 1544 | " 0.0596, 0.1036, -0.0411, -0.0024, 0.0568, 0.0786, -0.0063,\n", 1545 | " -0.1060, 0.0394, -0.1205, 0.0189, -0.0318, 0.0170, -0.1569,\n", 1546 | " 0.1222, -0.0652, -0.0800, -0.1372, -0.0851, -0.1614, -0.0519,\n", 1547 | " -0.1048, 0.1035, -0.0287, -0.0404, -0.1073, 0.0188, 0.1039,\n", 1548 | " -0.0469, 0.0518, 0.0717, 0.0868, 0.0811, 0.0636, 0.0492,\n", 1549 | " -0.0230, -0.0766, -0.0199, 0.0445, -0.0969, 0.0910, -0.0910,\n", 1550 | " 0.0038, -0.0456, 0.0315, -0.0613, -0.0293, -0.0596, 0.0228,\n", 1551 | " -0.0958, 0.1407, -0.0356, -0.0213, -0.0660, 0.0504, 0.0503,\n", 1552 | " -0.0463, 0.0843, 0.0917, 0.0356, -0.0272, -0.1018, -0.0236,\n", 1553 | " -0.1267, -0.0688, 0.0875, 0.0440, -0.0899, 0.0881, 0.0511,\n", 1554 | " 0.1372, -0.0741]))\n", 1555 | "('12.weight', Parameter containing:\n", 1556 | "tensor([[-0.0017, -0.0766, 0.0924, ..., 0.0853, -0.0931, -0.1333],\n", 1557 | " [-0.1053, 0.0104, 0.0136, ..., -0.0441, -0.0201, 0.0947],\n", 1558 | " [ 0.0697, 0.0490, -0.0532, ..., -0.0319, 0.1249, -0.0447],\n", 1559 | " ...,\n", 1560 | " [-0.0374, -0.0541, 0.0537, ..., 0.0963, 0.0487, 0.0269],\n", 1561 | " [ 0.0725, 0.0446, -0.0674, ..., -0.0942, 0.0055, -0.0619],\n", 1562 | " [-0.0330, 0.0317, -0.0500, ..., -0.0020, -0.0695, -0.1809]]))\n", 1563 | "('12.bias', Parameter containing:\n", 1564 | "tensor([-0.0489, 0.1297, -0.0611, 0.0806, -0.0072, -0.0580, -0.0646,\n", 1565 | " 0.0661, -0.0694, -0.0294, -0.0115, -0.0775, 0.0346, -0.0762,\n", 1566 | " -0.1076, 0.0488, -0.1113, -0.0511, -0.0543, 0.0004, -0.0727,\n", 1567 | " -0.0120, -0.1211, 0.1344, -0.0039, 0.0428, 0.0673, 0.1046,\n", 1568 | " 0.0122, -0.0327, -0.0499, 0.0923, -0.1074, -0.0446, 0.0439,\n", 1569 | " -0.1016, -0.0942, -0.1311, -0.0221, 0.1263, 0.0584, -0.0257,\n", 1570 | " -0.0426, 0.0923, 0.0596, 0.0151, 0.0068, -0.0514, -0.0368,\n", 1571 | " -0.0243, 0.0778, 0.0376, 0.0819, -0.0541, 0.0811, 0.0558,\n", 1572 | " -0.0639, 0.0004, 0.0526, -0.0735, 0.0347, -0.0209, -0.0446,\n", 1573 | " -0.1415, -0.0052]))\n" 1574 | ] 1575 | } 1576 | ], 1577 | "source": [ 1578 | "for name in model.named_parameters():\n", 1579 | " print (name)" 1580 | ] 1581 | }, 1582 | { 1583 | "cell_type": "code", 1584 | "execution_count": 31, 1585 | "metadata": {}, 1586 | "outputs": [], 1587 | "source": [ 1588 | "first = record[0].view(1, 3,100,100)" 1589 | ] 1590 | }, 1591 | { 1592 | "cell_type": "code", 1593 | "execution_count": 32, 1594 | "metadata": {}, 1595 | "outputs": [ 1596 | { 1597 | "data": { 1598 | "text/plain": [ 1599 | "torch.Size([1, 3, 100, 100])" 1600 | ] 1601 | }, 1602 | "execution_count": 32, 1603 | "metadata": {}, 1604 | "output_type": "execute_result" 1605 | } 1606 | ], 1607 | "source": [ 1608 | "first.shape" 1609 | ] 1610 | }, 1611 | { 1612 | "cell_type": "code", 1613 | "execution_count": 34, 1614 | "metadata": {}, 1615 | "outputs": [ 1616 | { 1617 | "data": { 1618 | "text/plain": [ 1619 | "tensor([ 50])" 1620 | ] 1621 | }, 1622 | "execution_count": 34, 1623 | "metadata": {}, 1624 | "output_type": "execute_result" 1625 | } 1626 | ], 1627 | "source": [ 1628 | "model(first).max(1)[1]" 1629 | ] 1630 | }, 1631 | { 1632 | "cell_type": "code", 1633 | "execution_count": 38, 1634 | "metadata": {}, 1635 | "outputs": [ 1636 | { 1637 | "data": { 1638 | "text/plain": [ 1639 | "50" 1640 | ] 1641 | }, 1642 | "execution_count": 38, 1643 | "metadata": {}, 1644 | "output_type": "execute_result" 1645 | } 1646 | ], 1647 | "source": [ 1648 | "labels_train[0]" 1649 | ] 1650 | }, 1651 | { 1652 | "cell_type": "code", 1653 | "execution_count": 39, 1654 | "metadata": {}, 1655 | "outputs": [], 1656 | "source": [ 1657 | "record = iter(test_loader).next()[0][0]" 1658 | ] 1659 | }, 1660 | { 1661 | "cell_type": "code", 1662 | "execution_count": 41, 1663 | "metadata": {}, 1664 | "outputs": [], 1665 | "source": [ 1666 | "first = record.view(1, 3,100,100)" 1667 | ] 1668 | }, 1669 | { 1670 | "cell_type": "code", 1671 | "execution_count": 42, 1672 | "metadata": {}, 1673 | "outputs": [ 1674 | { 1675 | "data": { 1676 | "text/plain": [ 1677 | "tensor([ 26])" 1678 | ] 1679 | }, 1680 | "execution_count": 42, 1681 | "metadata": {}, 1682 | "output_type": "execute_result" 1683 | } 1684 | ], 1685 | "source": [ 1686 | "model(first).max(1)[1]" 1687 | ] 1688 | }, 1689 | { 1690 | "cell_type": "code", 1691 | "execution_count": 43, 1692 | "metadata": {}, 1693 | "outputs": [ 1694 | { 1695 | "data": { 1696 | "text/plain": [ 1697 | "44" 1698 | ] 1699 | }, 1700 | "execution_count": 43, 1701 | "metadata": {}, 1702 | "output_type": "execute_result" 1703 | } 1704 | ], 1705 | "source": [ 1706 | "labels_test[0]" 1707 | ] 1708 | }, 1709 | { 1710 | "cell_type": "code", 1711 | "execution_count": 52, 1712 | "metadata": {}, 1713 | "outputs": [ 1714 | { 1715 | "data": { 1716 | "text/plain": [ 1717 | "OrderedDict([('0.weight',\n", 1718 | " tensor([[[[-0.0016, 0.0048, -0.0146, -0.1456, -0.1541],\n", 1719 | " [-0.0630, 0.0308, 0.0080, -0.1073, -0.1134],\n", 1720 | " [-0.1058, 0.0090, -0.1061, 0.0478, 0.0654],\n", 1721 | " [ 0.0175, 0.0800, 0.0240, 0.0162, 0.0625],\n", 1722 | " [ 0.0913, -0.0833, -0.0338, 0.0798, -0.0163]],\n", 1723 | " \n", 1724 | " [[ 0.0605, 0.0374, 0.0662, -0.1401, -0.0259],\n", 1725 | " [ 0.0589, -0.1049, 0.0120, -0.0084, -0.1260],\n", 1726 | " [-0.0768, -0.1128, -0.0596, 0.0139, 0.0571],\n", 1727 | " [ 0.0931, -0.0645, -0.0827, 0.0600, 0.0205],\n", 1728 | " [ 0.1170, 0.1265, -0.0124, -0.0439, 0.1113]],\n", 1729 | " \n", 1730 | " [[-0.0642, -0.0756, 0.0292, 0.0497, -0.1144],\n", 1731 | " [ 0.0153, -0.0897, -0.0337, 0.0108, -0.1262],\n", 1732 | " [ 0.0991, -0.0447, -0.0442, -0.0280, 0.0873],\n", 1733 | " [-0.0269, 0.0825, -0.1120, -0.0491, -0.0136],\n", 1734 | " [ 0.0866, -0.0420, 0.1009, 0.1126, 0.0893]]],\n", 1735 | " \n", 1736 | " \n", 1737 | " [[[-0.0209, 0.0852, 0.0590, -0.0332, -0.0586],\n", 1738 | " [ 0.0518, 0.1475, 0.0091, 0.0288, 0.0954],\n", 1739 | " [ 0.0341, 0.0415, -0.0412, 0.0043, 0.1360],\n", 1740 | " [ 0.1538, -0.0249, 0.0003, 0.1572, 0.0010],\n", 1741 | " [ 0.0510, 0.0192, 0.1027, 0.1332, 0.0991]],\n", 1742 | " \n", 1743 | " [[ 0.0177, -0.0105, -0.0383, 0.0657, 0.0859],\n", 1744 | " [-0.0725, -0.1320, -0.0927, -0.1090, -0.0635],\n", 1745 | " [ 0.0969, -0.0837, -0.1208, 0.0329, -0.0886],\n", 1746 | " [-0.0370, 0.0143, -0.0048, -0.0736, -0.0601],\n", 1747 | " [-0.0365, -0.0917, -0.0431, -0.0236, -0.0755]],\n", 1748 | " \n", 1749 | " [[ 0.0102, -0.0525, 0.0135, -0.0179, -0.0234],\n", 1750 | " [ 0.0643, -0.0145, 0.1480, 0.0188, 0.0504],\n", 1751 | " [ 0.0169, -0.0020, 0.0158, -0.0133, -0.0076],\n", 1752 | " [ 0.1242, -0.0200, 0.0480, 0.1099, 0.0300],\n", 1753 | " [ 0.0524, -0.0310, 0.0239, 0.0870, 0.1372]]],\n", 1754 | " \n", 1755 | " \n", 1756 | " [[[-0.0898, -0.0185, -0.0380, -0.0599, -0.0783],\n", 1757 | " [ 0.0435, -0.0673, -0.0520, -0.0430, 0.0795],\n", 1758 | " [-0.0218, -0.0063, 0.0079, 0.0160, 0.0481],\n", 1759 | " [ 0.0058, 0.1550, 0.0125, 0.0755, 0.0940],\n", 1760 | " [ 0.1355, 0.0955, 0.1428, 0.1401, 0.1735]],\n", 1761 | " \n", 1762 | " [[-0.1866, -0.1629, 0.0517, -0.0109, -0.1201],\n", 1763 | " [-0.1588, -0.1707, -0.1438, 0.0682, 0.0742],\n", 1764 | " [-0.0229, -0.1558, 0.0158, -0.1283, 0.0976],\n", 1765 | " [-0.1197, -0.0310, -0.0727, 0.0966, -0.0852],\n", 1766 | " [ 0.0389, 0.0312, 0.0191, 0.0596, 0.0384]],\n", 1767 | " \n", 1768 | " [[ 0.0068, 0.0797, -0.0105, 0.0056, 0.1451],\n", 1769 | " [ 0.0565, -0.0742, -0.0368, 0.0914, 0.0443],\n", 1770 | " [-0.0046, 0.1062, 0.0461, 0.1649, 0.1579],\n", 1771 | " [ 0.1141, -0.0795, 0.1050, -0.0006, 0.0684],\n", 1772 | " [-0.0832, -0.0160, 0.0237, 0.1942, 0.1150]]],\n", 1773 | " \n", 1774 | " \n", 1775 | " ...,\n", 1776 | " \n", 1777 | " \n", 1778 | " [[[-0.0482, -0.0629, -0.1348, -0.0321, -0.1168],\n", 1779 | " [-0.0721, -0.0334, -0.0868, -0.0112, 0.0183],\n", 1780 | " [ 0.0814, -0.0759, 0.0558, 0.0165, -0.1443],\n", 1781 | " [ 0.0478, -0.1126, 0.0319, 0.0282, 0.0392],\n", 1782 | " [-0.0818, 0.0456, 0.0469, 0.0682, -0.0889]],\n", 1783 | " \n", 1784 | " [[-0.0964, -0.0441, -0.0376, -0.1273, 0.0643],\n", 1785 | " [-0.0678, 0.0213, -0.0184, 0.0526, 0.0937],\n", 1786 | " [-0.0995, -0.0961, 0.0146, 0.0857, 0.0363],\n", 1787 | " [-0.0216, -0.1249, 0.0229, -0.0659, -0.0795],\n", 1788 | " [ 0.0812, -0.0560, -0.1054, -0.0096, 0.0889]],\n", 1789 | " \n", 1790 | " [[-0.0897, -0.1021, 0.0180, 0.0298, -0.0659],\n", 1791 | " [ 0.0528, -0.1170, -0.0548, 0.0178, -0.0131],\n", 1792 | " [ 0.0153, 0.0072, 0.0386, 0.0121, -0.1135],\n", 1793 | " [-0.1317, 0.0072, -0.0720, 0.0915, -0.1055],\n", 1794 | " [-0.1206, -0.0260, -0.1168, 0.0285, -0.1064]]],\n", 1795 | " \n", 1796 | " \n", 1797 | " [[[ 0.0775, 0.0365, 0.0013, 0.0921, 0.1069],\n", 1798 | " [-0.0504, -0.0125, -0.0210, 0.0183, 0.0713],\n", 1799 | " [-0.0559, -0.0774, -0.1068, -0.0869, -0.0683],\n", 1800 | " [-0.0192, 0.0008, 0.0784, 0.0213, -0.0400],\n", 1801 | " [-0.0524, 0.0806, -0.0096, 0.0329, -0.0262]],\n", 1802 | " \n", 1803 | " [[ 0.0902, 0.0546, 0.0144, 0.1076, -0.0733],\n", 1804 | " [ 0.0053, -0.0091, -0.0023, -0.0353, -0.0744],\n", 1805 | " [ 0.0175, -0.0493, -0.0767, -0.0778, -0.0176],\n", 1806 | " [ 0.0258, 0.0045, 0.0684, 0.0814, 0.0049],\n", 1807 | " [-0.0952, 0.0733, 0.0422, 0.0057, -0.0058]],\n", 1808 | " \n", 1809 | " [[-0.0374, 0.0999, 0.0383, 0.0544, 0.1199],\n", 1810 | " [-0.1001, -0.0429, 0.1261, -0.0481, -0.0135],\n", 1811 | " [ 0.0285, 0.0622, -0.0188, 0.0707, -0.0995],\n", 1812 | " [-0.0672, 0.1120, 0.0732, 0.0780, 0.0502],\n", 1813 | " [-0.1165, 0.0694, 0.0052, -0.0275, 0.0033]]],\n", 1814 | " \n", 1815 | " \n", 1816 | " [[[-0.0018, 0.1250, -0.0596, 0.0056, -0.0844],\n", 1817 | " [ 0.0031, -0.0784, -0.0879, 0.1046, 0.0131],\n", 1818 | " [ 0.0248, 0.1182, 0.0623, 0.1107, 0.0702],\n", 1819 | " [-0.0020, -0.0631, 0.0097, -0.0636, -0.0109],\n", 1820 | " [-0.0106, 0.1198, 0.0468, -0.0776, 0.0931]],\n", 1821 | " \n", 1822 | " [[ 0.0912, -0.0293, -0.1130, -0.1091, -0.1368],\n", 1823 | " [-0.0486, -0.0580, -0.0293, 0.0825, 0.0432],\n", 1824 | " [-0.0488, -0.0165, -0.0907, 0.1175, -0.1161],\n", 1825 | " [-0.0058, 0.0306, -0.0454, 0.0105, 0.1014],\n", 1826 | " [ 0.1089, 0.0913, 0.0672, 0.0102, 0.0053]],\n", 1827 | " \n", 1828 | " [[-0.0369, 0.1566, 0.0700, 0.0545, 0.0613],\n", 1829 | " [ 0.0877, 0.0052, 0.0940, 0.1503, 0.0434],\n", 1830 | " [-0.0281, 0.0453, 0.0012, 0.0196, -0.0414],\n", 1831 | " [ 0.0855, -0.0163, 0.1347, 0.0424, 0.0502],\n", 1832 | " [ 0.0874, 0.0372, 0.1193, 0.1401, 0.1866]]]])),\n", 1833 | " ('0.bias',\n", 1834 | " tensor([-0.0074, -0.0474, 0.0857, 0.1327, 0.0287, 0.1414, 0.1547,\n", 1835 | " 0.0509, -0.0440, -0.0592, 0.0788, -0.0021, 0.0642, 0.1670,\n", 1836 | " 0.0317, 0.0466, 0.1044, -0.0274, -0.0708, 0.0774, 0.0230,\n", 1837 | " 0.0278, 0.1082, 0.1173, 0.0120, -0.0614, 0.0690, 0.0154,\n", 1838 | " -0.0326, 0.0599, -0.0667, 0.0317, -0.0404, 0.1326, -0.0984,\n", 1839 | " 0.0518, -0.0816, -0.0412, -0.0766, 0.0903, -0.0249, -0.0253,\n", 1840 | " 0.2320, -0.0652, -0.0272, 0.0391, 0.0159, -0.0892, -0.0242,\n", 1841 | " -0.0119, -0.0370, 0.1231, -0.0702, -0.0439, -0.0870, 0.0212,\n", 1842 | " 0.1375, -0.1098, 0.0907, 0.0009, 0.0788, 0.0816, -0.1044,\n", 1843 | " 0.0091])),\n", 1844 | " ('3.weight',\n", 1845 | " tensor([[[[-2.6779e-02, -1.2962e-02, -6.7731e-03, ..., -2.1328e-02,\n", 1846 | " -1.5803e-02, -7.1797e-03],\n", 1847 | " [-1.8022e-02, -2.3607e-03, -2.2527e-02, ..., -3.2269e-02,\n", 1848 | " 1.1309e-02, 7.9132e-03],\n", 1849 | " [-1.8926e-02, -1.6236e-02, -1.8413e-02, ..., 9.0630e-03,\n", 1850 | " 9.2606e-03, 1.7090e-02],\n", 1851 | " ...,\n", 1852 | " [-3.7086e-03, -7.2559e-04, 1.0614e-02, ..., 6.1826e-04,\n", 1853 | " -1.2080e-02, 4.3929e-04],\n", 1854 | " [-2.3554e-02, -1.1957e-02, -6.5553e-03, ..., -1.1912e-02,\n", 1855 | " -1.3815e-02, -2.2450e-03],\n", 1856 | " [-2.0905e-02, -2.5623e-02, -3.3727e-02, ..., -8.8794e-03,\n", 1857 | " 2.5970e-03, 8.4659e-04]],\n", 1858 | " \n", 1859 | " [[-1.0403e-02, 9.8815e-03, 1.3379e-02, ..., 1.6973e-02,\n", 1860 | " -7.1956e-03, 4.0096e-03],\n", 1861 | " [ 1.1212e-02, -1.4063e-02, 1.7008e-02, ..., -6.0592e-03,\n", 1862 | " -1.2660e-02, -1.1657e-02],\n", 1863 | " [-3.2382e-02, -4.0698e-03, 6.5229e-03, ..., -3.1508e-03,\n", 1864 | " -3.7202e-02, -1.1686e-02],\n", 1865 | " ...,\n", 1866 | " [-9.1540e-03, 1.0237e-02, 1.6859e-02, ..., 8.6157e-03,\n", 1867 | " -3.7181e-03, 9.6950e-03],\n", 1868 | " [-1.7268e-02, 1.4214e-02, -1.1315e-02, ..., -8.8661e-03,\n", 1869 | " -1.2371e-02, 6.7527e-03],\n", 1870 | " [ 9.9682e-03, -1.3675e-02, -6.5624e-03, ..., 3.1749e-03,\n", 1871 | " 9.4326e-03, -2.9477e-03]],\n", 1872 | " \n", 1873 | " [[-7.0483e-03, -3.1922e-02, -2.1498e-02, ..., -3.1507e-03,\n", 1874 | " -3.0696e-02, -2.8737e-03],\n", 1875 | " [-6.8231e-03, -1.3644e-02, -1.6670e-03, ..., -2.8231e-02,\n", 1876 | " -3.1186e-02, -2.6410e-02],\n", 1877 | " [-9.8460e-03, -3.6508e-02, -1.1149e-02, ..., -1.7134e-02,\n", 1878 | " -3.2647e-02, -2.3700e-02],\n", 1879 | " ...,\n", 1880 | " [-5.7745e-04, 9.0411e-04, -1.4712e-02, ..., 1.3643e-02,\n", 1881 | " -1.8622e-03, -1.3857e-02],\n", 1882 | " [-3.7543e-02, 1.7850e-02, -2.0641e-03, ..., 5.8658e-03,\n", 1883 | " 4.6741e-03, -8.6243e-03],\n", 1884 | " [-3.3316e-02, -4.9936e-03, -1.4988e-02, ..., -8.6911e-05,\n", 1885 | " -1.7218e-02, -2.7561e-03]],\n", 1886 | " \n", 1887 | " ...,\n", 1888 | " \n", 1889 | " [[ 1.5939e-02, -1.4361e-02, 1.4564e-02, ..., -8.7929e-03,\n", 1890 | " -1.2084e-02, 1.2491e-02],\n", 1891 | " [ 1.7160e-02, -6.9554e-03, 1.0544e-02, ..., -1.0389e-02,\n", 1892 | " -4.2872e-03, -4.1053e-03],\n", 1893 | " [-2.0027e-03, 1.0370e-02, 1.7050e-02, ..., -6.4324e-03,\n", 1894 | " 1.6785e-02, 3.4043e-03],\n", 1895 | " ...,\n", 1896 | " [ 1.3323e-02, -3.4984e-03, -1.5882e-02, ..., -2.4456e-03,\n", 1897 | " 2.4521e-03, 1.6473e-02],\n", 1898 | " [-1.7732e-02, 1.5460e-02, 6.0378e-03, ..., -1.2608e-02,\n", 1899 | " 1.7068e-02, 1.6477e-02],\n", 1900 | " [ 7.6953e-03, 9.7408e-03, -5.5379e-03, ..., -1.6686e-03,\n", 1901 | " -1.5905e-03, 1.2670e-02]],\n", 1902 | " \n", 1903 | " [[-2.7136e-02, -3.4884e-02, -3.1536e-02, ..., 8.7532e-03,\n", 1904 | " 1.7536e-02, -8.5740e-03],\n", 1905 | " [-3.2289e-02, -2.1074e-02, -2.7792e-03, ..., 1.3592e-03,\n", 1906 | " 6.7092e-03, 8.8825e-03],\n", 1907 | " [-2.4370e-03, -2.1794e-02, -1.4332e-02, ..., -2.6290e-03,\n", 1908 | " -9.7182e-04, -1.3434e-02],\n", 1909 | " ...,\n", 1910 | " [-2.7251e-02, -5.9368e-03, -1.7157e-02, ..., 4.8391e-03,\n", 1911 | " 1.3846e-02, -2.5880e-02],\n", 1912 | " [-8.4309e-03, -9.7086e-03, -8.2329e-03, ..., -1.1860e-02,\n", 1913 | " -1.2285e-02, 6.6090e-03],\n", 1914 | " [-2.8973e-03, 9.6497e-03, 2.2892e-03, ..., 1.2426e-02,\n", 1915 | " -9.8844e-03, -2.6804e-02]],\n", 1916 | " \n", 1917 | " [[-1.7853e-03, 1.4545e-02, 1.3259e-02, ..., 6.5922e-03,\n", 1918 | " -5.1442e-03, -1.0759e-02],\n", 1919 | " [ 1.4357e-02, 4.0669e-03, 1.0755e-02, ..., -1.3151e-02,\n", 1920 | " 1.4049e-02, 1.1277e-03],\n", 1921 | " [ 9.0401e-03, 1.0939e-02, -1.3673e-02, ..., -8.7622e-03,\n", 1922 | " 5.9570e-04, -1.2833e-02],\n", 1923 | " ...,\n", 1924 | " [ 2.0013e-03, 6.9983e-03, 4.6257e-03, ..., -8.0778e-03,\n", 1925 | " 1.2425e-02, -9.2927e-03],\n", 1926 | " [ 1.3665e-02, -1.7009e-02, 3.3687e-03, ..., -4.1017e-03,\n", 1927 | " -1.0301e-02, 1.4668e-02],\n", 1928 | " [ 5.8163e-03, -2.8335e-06, 9.8780e-04, ..., 1.0928e-02,\n", 1929 | " -1.1426e-02, -1.3808e-02]]],\n", 1930 | " \n", 1931 | " \n", 1932 | " [[[-2.8145e-02, -1.8742e-02, -5.5234e-03, ..., 4.0994e-03,\n", 1933 | " 2.8125e-04, -3.5711e-02],\n", 1934 | " [-1.9029e-02, -3.9364e-03, -6.7715e-03, ..., -9.1552e-03,\n", 1935 | " 1.5949e-02, 4.7563e-03],\n", 1936 | " [-7.7093e-03, -3.4516e-02, -2.2431e-02, ..., -3.2317e-02,\n", 1937 | " 9.8823e-03, 1.2922e-03],\n", 1938 | " ...,\n", 1939 | " [-2.9283e-02, -2.6186e-02, -1.6897e-02, ..., -4.7393e-03,\n", 1940 | " -3.1830e-02, -1.0085e-02],\n", 1941 | " [-3.5755e-02, -3.4435e-02, -1.2168e-02, ..., -2.0105e-02,\n", 1942 | " -4.2665e-03, -2.0468e-02],\n", 1943 | " [-3.3734e-02, -1.6996e-02, -9.8357e-03, ..., -2.9043e-02,\n", 1944 | " -3.3291e-02, -1.3980e-02]],\n", 1945 | " \n", 1946 | " [[-6.3367e-03, -4.0852e-03, -1.3327e-02, ..., -6.2933e-03,\n", 1947 | " 1.3628e-02, 8.6691e-03],\n", 1948 | " [ 1.3802e-02, -7.2884e-03, -1.4474e-02, ..., 1.3953e-02,\n", 1949 | " -5.3896e-03, 9.0456e-03],\n", 1950 | " [-6.9317e-03, 1.6150e-02, 8.1835e-03, ..., -3.0702e-04,\n", 1951 | " 1.3830e-02, -1.6633e-03],\n", 1952 | " ...,\n", 1953 | " [-8.3356e-04, -9.3114e-03, 7.4694e-03, ..., -1.2985e-02,\n", 1954 | " -1.4350e-02, 4.2311e-03],\n", 1955 | " [-5.0927e-03, 1.0877e-02, 4.0688e-03, ..., 9.2379e-03,\n", 1956 | " -1.0290e-02, 1.0049e-02],\n", 1957 | " [-9.4879e-03, 1.0646e-02, 1.3236e-02, ..., -9.2430e-03,\n", 1958 | " -1.0380e-03, -1.4155e-02]],\n", 1959 | " \n", 1960 | " [[-3.6744e-02, -2.1535e-02, -3.1799e-02, ..., -1.4108e-02,\n", 1961 | " 2.2022e-03, 1.5080e-02],\n", 1962 | " [-2.9610e-02, -4.6011e-03, -1.4337e-02, ..., -8.4109e-03,\n", 1963 | " 4.4273e-03, -2.2268e-02],\n", 1964 | " [-1.1714e-02, -5.3899e-03, -1.1769e-02, ..., -2.0215e-02,\n", 1965 | " -4.4180e-03, -9.1483e-03],\n", 1966 | " ...,\n", 1967 | " [-3.1818e-02, -2.7536e-02, -1.3271e-02, ..., -6.5540e-03,\n", 1968 | " -7.9542e-03, -1.0677e-02],\n", 1969 | " [-9.0505e-03, -3.1940e-02, -1.5119e-02, ..., -2.1554e-02,\n", 1970 | " -1.0521e-02, -2.7976e-02],\n", 1971 | " [-2.0902e-02, -3.2283e-03, -1.3045e-02, ..., -3.6176e-02,\n", 1972 | " -2.9619e-02, -1.6289e-02]],\n", 1973 | " \n", 1974 | " ...,\n", 1975 | " \n", 1976 | " [[-1.4943e-02, 1.2392e-03, 1.6166e-02, ..., -1.1477e-02,\n", 1977 | " -1.5734e-02, -1.2199e-02],\n", 1978 | " [ 1.1283e-02, 1.1453e-03, 1.2160e-02, ..., 6.1564e-03,\n", 1979 | " 3.5162e-03, -8.8078e-03],\n", 1980 | " [ 1.5972e-02, 1.8743e-03, -1.4592e-02, ..., 7.7799e-03,\n", 1981 | " -4.6349e-03, 3.2799e-03],\n", 1982 | " ...,\n", 1983 | " [ 8.4355e-03, -4.7946e-04, -1.7618e-02, ..., -1.6736e-02,\n", 1984 | " -6.3067e-03, 6.9063e-03],\n", 1985 | " [ 1.0057e-02, 5.4642e-03, 1.1619e-02, ..., 1.4251e-02,\n", 1986 | " -8.2950e-03, 1.3677e-02],\n", 1987 | " [ 3.1885e-03, -1.5601e-05, 1.7460e-02, ..., -1.1777e-02,\n", 1988 | " -6.7834e-03, 3.3414e-03]],\n", 1989 | " \n", 1990 | " [[-3.0452e-02, -1.2080e-02, 1.0256e-02, ..., -3.0990e-02,\n", 1991 | " 8.6174e-03, 1.6501e-03],\n", 1992 | " [-5.2719e-04, -3.2968e-02, -2.6674e-02, ..., -1.6440e-02,\n", 1993 | " -3.6365e-03, -3.2362e-02],\n", 1994 | " [-2.7233e-02, -2.7331e-02, -3.5724e-02, ..., -9.7884e-03,\n", 1995 | " -3.2167e-02, -9.0837e-03],\n", 1996 | " ...,\n", 1997 | " [-2.0292e-02, -3.3341e-03, -7.6577e-03, ..., 1.4283e-02,\n", 1998 | " -1.4460e-03, -1.3133e-02],\n", 1999 | " [-3.3671e-02, -1.4031e-02, -7.2689e-03, ..., 1.6328e-02,\n", 2000 | " -7.3200e-03, -2.9146e-02],\n", 2001 | " [-2.9474e-02, -2.9688e-02, -1.0572e-02, ..., -3.2480e-02,\n", 2002 | " -1.3261e-02, -1.5741e-02]],\n", 2003 | " \n", 2004 | " [[-2.3804e-03, 5.5173e-03, -1.2740e-02, ..., -4.8662e-03,\n", 2005 | " -7.2586e-03, 1.0922e-02],\n", 2006 | " [-6.3082e-03, -9.7869e-03, -1.6668e-02, ..., -1.0346e-02,\n", 2007 | " -7.1375e-04, -1.4136e-02],\n", 2008 | " [-9.3555e-03, 5.5218e-03, 1.6871e-02, ..., -7.9774e-03,\n", 2009 | " 1.0834e-02, 6.2287e-03],\n", 2010 | " ...,\n", 2011 | " [-1.0119e-02, -1.4812e-03, -2.6835e-03, ..., 5.7517e-03,\n", 2012 | " 1.2835e-02, 8.3581e-03],\n", 2013 | " [-1.7669e-02, -4.3534e-04, -1.3433e-02, ..., 1.3524e-02,\n", 2014 | " 5.1122e-04, 1.2765e-02],\n", 2015 | " [-1.2379e-02, -4.0298e-03, 1.3297e-02, ..., -9.6577e-03,\n", 2016 | " -8.4847e-03, -1.0439e-02]]],\n", 2017 | " \n", 2018 | " \n", 2019 | " [[[-2.2538e-03, -4.1233e-03, -1.0215e-02, ..., -2.4550e-03,\n", 2020 | " -2.0032e-02, -2.6995e-02],\n", 2021 | " [-3.4619e-02, -1.8392e-02, -2.5360e-02, ..., -1.4965e-02,\n", 2022 | " -1.0830e-02, -3.1260e-02],\n", 2023 | " [-1.0557e-02, -2.3744e-02, 1.6909e-03, ..., -6.7882e-03,\n", 2024 | " 1.5083e-03, -1.6190e-02],\n", 2025 | " ...,\n", 2026 | " [-1.7339e-03, 6.6879e-03, -9.7566e-03, ..., 1.1324e-02,\n", 2027 | " -2.9404e-02, 1.9570e-02],\n", 2028 | " [ 1.0242e-02, -9.2871e-03, -9.3168e-03, ..., -1.3156e-02,\n", 2029 | " -1.4865e-02, -1.1270e-02],\n", 2030 | " [ 1.9390e-02, -8.4842e-03, 9.8267e-03, ..., 4.0320e-03,\n", 2031 | " -2.6696e-02, -1.6334e-02]],\n", 2032 | " \n", 2033 | " [[-9.2508e-03, -1.1350e-02, -1.7665e-02, ..., 4.3904e-03,\n", 2034 | " 2.7492e-03, -5.2415e-03],\n", 2035 | " [-8.4670e-03, -7.3156e-03, -1.9307e-02, ..., -2.3375e-02,\n", 2036 | " -1.0639e-02, -1.7652e-02],\n", 2037 | " [-2.3184e-02, -1.7577e-02, -6.0105e-03, ..., 4.4489e-03,\n", 2038 | " -2.6661e-02, 3.8427e-03],\n", 2039 | " ...,\n", 2040 | " [-7.8044e-03, -1.7909e-02, 2.7993e-03, ..., -1.1152e-03,\n", 2041 | " 7.6839e-03, -1.1714e-02],\n", 2042 | " [-9.9899e-03, 2.4783e-03, -3.1628e-03, ..., -1.6662e-02,\n", 2043 | " -1.4662e-02, 6.5154e-03],\n", 2044 | " [-1.4905e-02, -1.5384e-02, -1.1265e-02, ..., -4.1862e-03,\n", 2045 | " -1.9127e-03, -2.4848e-02]],\n", 2046 | " \n", 2047 | " [[ 3.4846e-03, 8.0098e-03, 1.7443e-02, ..., 1.2480e-02,\n", 2048 | " -1.2735e-02, 8.6934e-03],\n", 2049 | " [-8.2303e-03, -1.7087e-02, -1.0395e-02, ..., -1.6124e-02,\n", 2050 | " 7.0822e-03, -3.8555e-04],\n", 2051 | " [-5.2301e-03, 4.9656e-03, 9.1322e-03, ..., -3.9297e-03,\n", 2052 | " -1.1945e-02, -3.1185e-03],\n", 2053 | " ...,\n", 2054 | " [ 1.0450e-02, 1.8954e-02, 2.9704e-03, ..., 1.4643e-02,\n", 2055 | " 1.6012e-02, -3.2929e-03],\n", 2056 | " [ 1.0485e-02, 7.6941e-03, 7.7856e-03, ..., 6.2871e-03,\n", 2057 | " 7.3308e-03, 1.3855e-02],\n", 2058 | " [-1.3529e-02, -2.3717e-03, -1.4512e-02, ..., 1.0026e-02,\n", 2059 | " -1.6163e-02, -5.7107e-03]],\n", 2060 | " \n", 2061 | " ...,\n", 2062 | " \n", 2063 | " [[-1.4811e-02, -2.7844e-02, -2.0868e-02, ..., -2.6010e-02,\n", 2064 | " -2.7611e-02, 6.3969e-03],\n", 2065 | " [-2.2012e-03, -1.9145e-02, -1.9199e-02, ..., -2.0287e-02,\n", 2066 | " -2.2382e-02, -2.2633e-03],\n", 2067 | " [-1.0251e-02, -1.5751e-02, -2.7219e-02, ..., 2.9438e-03,\n", 2068 | " -2.6035e-02, -2.6711e-02],\n", 2069 | " ...,\n", 2070 | " [-3.0947e-04, 5.9995e-03, 2.1770e-05, ..., -1.0780e-02,\n", 2071 | " 4.2132e-03, 3.1212e-03],\n", 2072 | " [-1.9642e-02, -1.5439e-02, -1.3787e-02, ..., -2.8270e-02,\n", 2073 | " -8.3740e-03, -6.7641e-03],\n", 2074 | " [-6.7095e-03, -1.8616e-02, -2.7250e-02, ..., -2.8718e-02,\n", 2075 | " -2.0472e-02, 4.0441e-04]],\n", 2076 | " \n", 2077 | " [[-2.8262e-02, -7.3320e-03, -1.9765e-02, ..., -8.0278e-03,\n", 2078 | " 1.7557e-02, 1.8543e-02],\n", 2079 | " [-1.7225e-02, -1.3504e-02, -2.6834e-02, ..., -2.0847e-02,\n", 2080 | " -3.4311e-03, 8.1041e-03],\n", 2081 | " [-2.3213e-02, 8.8160e-03, 1.5753e-02, ..., -1.5599e-02,\n", 2082 | " -2.2783e-02, 1.7687e-03],\n", 2083 | " ...,\n", 2084 | " [-1.2956e-02, -3.4006e-02, -1.7315e-02, ..., -6.5962e-03,\n", 2085 | " -3.2383e-02, 1.5012e-02],\n", 2086 | " [ 1.8599e-02, -1.7383e-02, -1.5422e-02, ..., -9.3824e-03,\n", 2087 | " -1.5369e-02, -2.1481e-02],\n", 2088 | " [-3.9189e-04, -1.3674e-02, -2.4964e-02, ..., -9.4626e-03,\n", 2089 | " -1.0716e-02, -1.9111e-03]],\n", 2090 | " \n", 2091 | " [[-2.4925e-02, -1.9391e-03, 1.8677e-03, ..., -7.9364e-03,\n", 2092 | " -1.1269e-02, -1.0375e-02],\n", 2093 | " [-2.2959e-02, 1.3838e-03, -5.1879e-03, ..., -2.0389e-02,\n", 2094 | " 1.8722e-04, -2.2228e-02],\n", 2095 | " [-2.5972e-02, -1.9240e-02, -1.4870e-02, ..., -1.1329e-02,\n", 2096 | " -1.0629e-02, -1.2778e-03],\n", 2097 | " ...,\n", 2098 | " [ 4.6231e-03, -9.8229e-03, -1.6067e-02, ..., -1.4338e-02,\n", 2099 | " 1.0771e-03, -1.4400e-02],\n", 2100 | " [-1.5673e-02, -4.5755e-03, -1.2823e-02, ..., -1.7801e-02,\n", 2101 | " 2.3182e-03, -1.8283e-02],\n", 2102 | " [ 2.1563e-03, -5.6639e-03, 6.3025e-03, ..., -1.9270e-02,\n", 2103 | " -2.7177e-02, 1.7473e-04]]],\n", 2104 | " \n", 2105 | " \n", 2106 | " ...,\n", 2107 | " \n", 2108 | " \n", 2109 | " [[[ 7.6536e-03, -1.8783e-03, 1.8841e-02, ..., -8.4884e-03,\n", 2110 | " -2.2051e-03, -5.5705e-03],\n", 2111 | " [-1.1814e-02, -1.4657e-02, 1.1615e-02, ..., -3.1463e-03,\n", 2112 | " -3.4147e-02, -2.1097e-02],\n", 2113 | " [ 1.7014e-02, -1.1913e-03, -1.3618e-02, ..., -2.0940e-02,\n", 2114 | " -1.9440e-02, -3.0029e-02],\n", 2115 | " ...,\n", 2116 | " [ 1.0215e-02, 1.5527e-02, -6.3834e-03, ..., 6.0160e-03,\n", 2117 | " -1.6559e-02, -2.9295e-03],\n", 2118 | " [ 1.0632e-02, -1.1926e-02, -1.3686e-03, ..., 1.6902e-02,\n", 2119 | " -1.0786e-02, -2.5942e-02],\n", 2120 | " [ 3.9939e-03, -3.3778e-02, -1.2943e-02, ..., 1.9375e-03,\n", 2121 | " -2.5962e-02, -2.6246e-02]],\n", 2122 | " \n", 2123 | " [[-1.8836e-02, -1.2895e-02, -2.8608e-02, ..., -1.1196e-02,\n", 2124 | " -1.9619e-02, -3.0789e-02],\n", 2125 | " [-3.1237e-02, -3.7592e-02, -8.0640e-03, ..., -2.0608e-02,\n", 2126 | " -7.0762e-03, -3.3432e-02],\n", 2127 | " [-3.4544e-02, -3.1376e-02, -1.8247e-02, ..., -4.2953e-03,\n", 2128 | " -2.5268e-02, -3.7524e-02],\n", 2129 | " ...,\n", 2130 | " [-2.0865e-02, -2.8106e-02, -4.8804e-03, ..., 4.9353e-03,\n", 2131 | " -9.5544e-03, -3.9235e-04],\n", 2132 | " [-2.0468e-02, -4.8933e-03, -2.7534e-02, ..., -1.2462e-02,\n", 2133 | " -2.6990e-02, -7.4737e-03],\n", 2134 | " [-2.3287e-02, -2.4754e-02, -2.8761e-02, ..., -1.5842e-02,\n", 2135 | " -2.1052e-02, -3.2656e-02]],\n", 2136 | " \n", 2137 | " [[ 8.0048e-04, 2.2151e-03, 1.5473e-02, ..., -1.2530e-02,\n", 2138 | " -1.6299e-02, -3.9971e-03],\n", 2139 | " [-1.7649e-02, 6.1190e-03, 5.3151e-03, ..., -2.9324e-02,\n", 2140 | " -1.8867e-02, -3.1613e-02],\n", 2141 | " [-3.7128e-02, -3.5173e-02, -3.1409e-02, ..., -2.0030e-02,\n", 2142 | " -3.2676e-03, -3.1105e-02],\n", 2143 | " ...,\n", 2144 | " [-2.1572e-02, -3.5458e-02, -2.1744e-02, ..., -4.4794e-03,\n", 2145 | " -4.9605e-03, -2.9795e-02],\n", 2146 | " [-1.9600e-02, -1.8060e-02, -2.9290e-02, ..., -1.0334e-02,\n", 2147 | " -2.3278e-02, -2.6473e-02],\n", 2148 | " [-3.4211e-02, -5.7403e-03, -3.1517e-02, ..., -2.5251e-02,\n", 2149 | " -2.8706e-02, -3.5840e-02]],\n", 2150 | " \n", 2151 | " ...,\n", 2152 | " \n", 2153 | " [[ 1.1339e-02, -1.7595e-02, 3.8017e-03, ..., 2.5522e-03,\n", 2154 | " -1.7517e-02, 4.3034e-03],\n", 2155 | " [ 9.7192e-03, 1.5814e-02, 5.0818e-03, ..., 1.2481e-02,\n", 2156 | " -3.0841e-02, 3.4227e-03],\n", 2157 | " [-1.1800e-02, 4.6344e-03, 2.4301e-03, ..., -3.6808e-02,\n", 2158 | " -3.3497e-02, -2.8690e-02],\n", 2159 | " ...,\n", 2160 | " [ 3.6129e-03, -1.1561e-02, -3.0395e-02, ..., -1.2388e-02,\n", 2161 | " -9.4928e-03, -1.5173e-03],\n", 2162 | " [-1.1360e-02, -4.0666e-03, -2.0922e-02, ..., 8.6673e-04,\n", 2163 | " -1.3469e-02, -4.8741e-03],\n", 2164 | " [ 5.7896e-03, -1.7382e-02, -7.8392e-03, ..., -2.3734e-03,\n", 2165 | " -1.1630e-02, -7.0134e-03]],\n", 2166 | " \n", 2167 | " [[-3.2164e-02, -6.2788e-03, 1.3968e-02, ..., 3.6180e-03,\n", 2168 | " -1.0840e-02, -2.7565e-02],\n", 2169 | " [-2.6980e-02, -2.4073e-02, 1.0033e-03, ..., -2.5264e-04,\n", 2170 | " -5.5285e-03, -1.2939e-02],\n", 2171 | " [ 2.1923e-04, -1.4998e-03, -2.6163e-02, ..., -4.7604e-03,\n", 2172 | " 9.5060e-03, 2.7361e-03],\n", 2173 | " ...,\n", 2174 | " [-1.5853e-02, 1.8252e-02, -1.6496e-02, ..., -3.9139e-03,\n", 2175 | " -2.4966e-02, -3.1966e-03],\n", 2176 | " [-2.7687e-02, -2.8252e-02, 1.8075e-03, ..., -2.1508e-02,\n", 2177 | " 3.0193e-03, -1.8301e-02],\n", 2178 | " [ 3.9693e-03, 1.4852e-02, 6.8361e-03, ..., -2.5844e-02,\n", 2179 | " -1.3109e-02, -2.7742e-02]],\n", 2180 | " \n", 2181 | " [[ 1.9207e-03, -1.1992e-02, 1.2561e-02, ..., -2.8050e-02,\n", 2182 | " -2.8156e-02, -3.3904e-02],\n", 2183 | " [ 1.7325e-02, 1.1727e-02, 4.4550e-03, ..., -2.3177e-02,\n", 2184 | " -3.0512e-02, -1.1348e-02],\n", 2185 | " [ 1.2288e-02, 3.4642e-04, -2.0631e-02, ..., -9.7264e-03,\n", 2186 | " -1.9462e-02, -9.1786e-03],\n", 2187 | " ...,\n", 2188 | " [-1.4261e-02, -1.8814e-02, -9.2540e-03, ..., -6.0748e-03,\n", 2189 | " -1.2992e-02, 4.8125e-04],\n", 2190 | " [-1.3841e-02, -2.1739e-02, -1.6609e-02, ..., -3.4722e-03,\n", 2191 | " -3.2457e-03, 1.4795e-02],\n", 2192 | " [-4.3364e-03, -8.1214e-03, -1.2953e-02, ..., -9.9520e-03,\n", 2193 | " 3.6117e-03, -7.1621e-03]]],\n", 2194 | " \n", 2195 | " \n", 2196 | " [[[-2.1822e-02, -1.6658e-02, -7.6389e-03, ..., -2.2257e-02,\n", 2197 | " 7.1451e-03, -1.5845e-03],\n", 2198 | " [ 1.1925e-03, -3.5487e-03, -1.8371e-02, ..., 1.0235e-02,\n", 2199 | " -2.0721e-02, 7.1239e-03],\n", 2200 | " [-1.4366e-02, 7.3110e-03, -9.1615e-04, ..., -5.8821e-03,\n", 2201 | " 1.5872e-02, 2.1394e-02],\n", 2202 | " ...,\n", 2203 | " [-3.5594e-03, 6.8701e-03, -1.0854e-02, ..., -2.3067e-02,\n", 2204 | " -3.2157e-03, -1.1290e-02],\n", 2205 | " [ 2.6806e-02, 3.3598e-04, -1.0921e-02, ..., -1.1420e-02,\n", 2206 | " 4.6863e-03, 6.0898e-03],\n", 2207 | " [ 3.0626e-03, -1.7101e-02, -5.4114e-03, ..., -1.0365e-02,\n", 2208 | " -1.0822e-02, -2.6236e-02]],\n", 2209 | " \n", 2210 | " [[-1.3101e-02, -1.3059e-02, 7.6095e-03, ..., -1.1628e-02,\n", 2211 | " -2.6642e-02, -6.9455e-03],\n", 2212 | " [-2.5564e-02, -1.5327e-02, 4.0728e-03, ..., -2.5864e-02,\n", 2213 | " -2.2147e-02, 4.5925e-03],\n", 2214 | " [-8.2005e-03, 5.9101e-03, -6.4722e-03, ..., -1.4526e-02,\n", 2215 | " -4.1891e-03, -1.5764e-02],\n", 2216 | " ...,\n", 2217 | " [-2.6733e-02, -2.7073e-02, -1.7734e-02, ..., -1.5771e-02,\n", 2218 | " -8.3647e-04, 5.2966e-03],\n", 2219 | " [ 7.4729e-03, -2.3610e-02, -1.9502e-02, ..., -1.5676e-02,\n", 2220 | " 1.1866e-03, 4.3461e-04],\n", 2221 | " [-2.7914e-03, -3.7813e-03, -2.0831e-02, ..., -1.0264e-02,\n", 2222 | " 8.9520e-04, -2.4958e-02]],\n", 2223 | " \n", 2224 | " [[-6.4742e-03, -1.8906e-02, -5.6844e-03, ..., 7.3853e-03,\n", 2225 | " 2.2777e-03, -6.9292e-03],\n", 2226 | " [ 2.8477e-03, 2.0978e-03, 3.7272e-03, ..., -7.4928e-03,\n", 2227 | " 1.6647e-02, 1.2275e-02],\n", 2228 | " [ 1.1717e-02, -4.8451e-04, 2.7634e-02, ..., -6.2747e-03,\n", 2229 | " -7.3154e-03, 4.8498e-04],\n", 2230 | " ...,\n", 2231 | " [ 1.0360e-02, 2.0931e-02, 1.1289e-02, ..., 3.9727e-03,\n", 2232 | " -1.4086e-02, 1.7404e-02],\n", 2233 | " [-2.5335e-03, -2.7018e-03, 1.6044e-02, ..., -3.9768e-03,\n", 2234 | " -1.3957e-02, -1.4771e-02],\n", 2235 | " [ 1.6544e-02, 2.1240e-02, 1.7475e-02, ..., -2.5158e-02,\n", 2236 | " -1.9777e-02, -1.7363e-04]],\n", 2237 | " \n", 2238 | " ...,\n", 2239 | " \n", 2240 | " [[ 1.4401e-02, 1.2646e-03, -1.3304e-02, ..., 7.7538e-03,\n", 2241 | " -1.9440e-02, -2.1017e-02],\n", 2242 | " [ 1.6771e-02, -2.3978e-04, -5.0331e-03, ..., -7.6139e-03,\n", 2243 | " -2.1629e-04, 6.4135e-03],\n", 2244 | " [ 6.8014e-03, 9.8460e-03, -7.2331e-03, ..., -7.9818e-03,\n", 2245 | " 3.1137e-03, -2.2293e-02],\n", 2246 | " ...,\n", 2247 | " [-1.4249e-02, 2.2670e-03, -2.0135e-02, ..., -1.9543e-04,\n", 2248 | " 9.2510e-04, -3.7952e-03],\n", 2249 | " [ 2.5527e-02, 3.9357e-03, -2.0599e-02, ..., -1.2822e-02,\n", 2250 | " -2.0320e-02, 5.3710e-03],\n", 2251 | " [ 2.4788e-02, -5.9360e-03, -1.9608e-02, ..., -8.5284e-03,\n", 2252 | " -5.3702e-03, 2.7787e-03]],\n", 2253 | " \n", 2254 | " [[-1.3842e-02, 9.3919e-04, 1.0927e-02, ..., -2.3249e-02,\n", 2255 | " 2.1997e-02, -2.7843e-03],\n", 2256 | " [-1.8800e-02, 3.3210e-03, -5.7883e-03, ..., -3.2548e-02,\n", 2257 | " 1.0355e-02, -7.5103e-05],\n", 2258 | " [ 8.8634e-04, -2.7359e-02, 9.0961e-04, ..., -8.1291e-03,\n", 2259 | " -3.1408e-04, -5.1685e-03],\n", 2260 | " ...,\n", 2261 | " [-2.1556e-02, 7.1239e-04, -2.7186e-02, ..., -2.6574e-02,\n", 2262 | " -1.7427e-02, -7.3701e-03],\n", 2263 | " [ 1.7685e-02, 1.9347e-03, -2.5782e-03, ..., -1.3726e-02,\n", 2264 | " -1.9573e-02, -3.1529e-05],\n", 2265 | " [ 1.6412e-02, -2.5740e-02, 1.9379e-03, ..., -2.6090e-02,\n", 2266 | " -7.1123e-04, 1.2818e-02]],\n", 2267 | " \n", 2268 | " [[-2.5872e-02, -1.1990e-02, -1.4029e-02, ..., 4.0431e-03,\n", 2269 | " 9.0229e-04, -1.4076e-02],\n", 2270 | " [-1.9221e-02, -2.4752e-02, -1.5499e-02, ..., -7.9520e-03,\n", 2271 | " -7.1294e-03, -4.3111e-03],\n", 2272 | " [ 3.4378e-03, -1.3511e-02, -1.3479e-02, ..., -1.0406e-02,\n", 2273 | " -9.2696e-03, -5.8095e-03],\n", 2274 | " ...,\n", 2275 | " [ 5.9763e-03, -6.7900e-04, -2.3468e-02, ..., 7.2678e-03,\n", 2276 | " -2.4124e-02, 5.2814e-03],\n", 2277 | " [-2.6482e-02, -1.1136e-02, -2.3210e-02, ..., -2.3877e-03,\n", 2278 | " -9.3244e-03, -1.3438e-02],\n", 2279 | " [-1.4087e-02, 8.4801e-04, 4.2950e-03, ..., -2.6069e-02,\n", 2280 | " 5.7832e-03, -1.9748e-02]]],\n", 2281 | " \n", 2282 | " \n", 2283 | " [[[-1.2947e-02, -1.3831e-02, -6.6514e-03, ..., 1.1251e-02,\n", 2284 | " -2.7273e-03, -2.9318e-04],\n", 2285 | " [ 1.6319e-02, -4.2163e-03, 9.5971e-04, ..., 8.7225e-03,\n", 2286 | " 3.4388e-03, -4.2100e-03],\n", 2287 | " [-8.9748e-03, 6.1063e-03, -1.0801e-03, ..., 5.1986e-03,\n", 2288 | " 8.0231e-03, -2.8249e-02],\n", 2289 | " ...,\n", 2290 | " [-3.6449e-03, -2.3086e-03, -2.5649e-02, ..., -1.1459e-02,\n", 2291 | " -5.9115e-03, 5.8053e-03],\n", 2292 | " [-3.4264e-02, -3.3125e-02, -3.9721e-03, ..., -1.2224e-02,\n", 2293 | " 1.9460e-02, -5.8133e-03],\n", 2294 | " [-3.4569e-02, -3.0598e-02, -3.6949e-02, ..., 5.6422e-03,\n", 2295 | " -3.6649e-03, 8.9027e-05]],\n", 2296 | " \n", 2297 | " [[-2.5274e-02, -2.2699e-02, -2.4185e-02, ..., -1.9850e-02,\n", 2298 | " -1.6500e-02, -2.5491e-02],\n", 2299 | " [-2.0654e-03, -1.8466e-02, -1.2426e-02, ..., 1.5545e-03,\n", 2300 | " -1.6919e-02, -6.4482e-03],\n", 2301 | " [-2.1573e-03, 3.2694e-03, -8.2869e-04, ..., -1.9123e-02,\n", 2302 | " -3.0052e-02, -6.3218e-03],\n", 2303 | " ...,\n", 2304 | " [-2.0544e-02, -1.8392e-02, -1.7850e-02, ..., -1.2365e-02,\n", 2305 | " -1.7570e-02, -2.4573e-02],\n", 2306 | " [-3.4599e-02, -1.4640e-02, -3.5621e-02, ..., -2.3353e-02,\n", 2307 | " -1.7889e-02, -3.3007e-02],\n", 2308 | " [-2.4938e-02, -5.0069e-03, -2.1860e-02, ..., -2.3937e-02,\n", 2309 | " -1.6531e-02, -2.4050e-02]],\n", 2310 | " \n", 2311 | " [[ 1.8155e-02, -3.6595e-04, 2.9583e-03, ..., -1.4410e-02,\n", 2312 | " 1.0625e-02, 1.4375e-03],\n", 2313 | " [-4.8929e-03, -8.0628e-03, 1.1450e-02, ..., -1.5520e-02,\n", 2314 | " 1.3821e-02, -1.5309e-02],\n", 2315 | " [ 1.1759e-02, -3.2002e-03, -1.5472e-02, ..., -9.7236e-03,\n", 2316 | " 4.4048e-04, 1.5701e-02],\n", 2317 | " ...,\n", 2318 | " [ 3.1347e-03, -1.0985e-02, -3.2569e-02, ..., -9.3643e-03,\n", 2319 | " 4.0229e-03, -4.7593e-03],\n", 2320 | " [-1.4315e-02, -1.1992e-02, 1.4437e-02, ..., -9.9650e-03,\n", 2321 | " 1.5973e-03, 1.9719e-03],\n", 2322 | " [-1.6013e-02, 2.7376e-03, 1.3703e-02, ..., 4.5032e-03,\n", 2323 | " -8.3267e-03, -1.5758e-02]],\n", 2324 | " \n", 2325 | " ...,\n", 2326 | " \n", 2327 | " [[-1.6352e-02, -7.9971e-03, -3.6600e-04, ..., -2.4343e-02,\n", 2328 | " 4.1341e-03, -1.2726e-02],\n", 2329 | " [-7.5895e-03, -2.5708e-02, 6.5365e-05, ..., -1.3495e-03,\n", 2330 | " -5.5134e-03, -1.8683e-02],\n", 2331 | " [-1.0314e-02, -9.2459e-03, -5.5137e-03, ..., -1.4481e-02,\n", 2332 | " -9.4491e-03, -1.8040e-02],\n", 2333 | " ...,\n", 2334 | " [-3.3748e-02, -2.9064e-02, -5.2415e-03, ..., -8.1776e-03,\n", 2335 | " -1.4581e-02, -2.4246e-02],\n", 2336 | " [-6.7054e-03, -6.5064e-03, -5.5634e-03, ..., -1.8302e-02,\n", 2337 | " -1.3915e-02, -1.9616e-02],\n", 2338 | " [-1.2851e-02, -3.7664e-02, -7.9373e-03, ..., -1.1542e-02,\n", 2339 | " -2.7742e-02, -1.2360e-02]],\n", 2340 | " \n", 2341 | " [[ 5.9764e-03, 1.1124e-02, 3.3182e-03, ..., 1.0216e-02,\n", 2342 | " -1.5117e-02, 1.3690e-02],\n", 2343 | " [ 4.9395e-04, -7.5153e-03, 8.6296e-03, ..., 8.1994e-03,\n", 2344 | " 7.1977e-03, 2.5272e-03],\n", 2345 | " [-3.7261e-03, -2.5792e-03, -3.5059e-02, ..., 1.6435e-02,\n", 2346 | " 1.1533e-02, -5.8290e-03],\n", 2347 | " ...,\n", 2348 | " [-1.1111e-02, -1.8693e-02, -3.3552e-02, ..., -1.2267e-02,\n", 2349 | " 8.4279e-04, -3.2727e-02],\n", 2350 | " [-3.3329e-02, -2.4417e-02, -3.4563e-03, ..., -3.7300e-03,\n", 2351 | " -4.3485e-03, -2.6191e-03],\n", 2352 | " [-2.4551e-02, -2.3301e-02, -5.5629e-03, ..., -2.4263e-02,\n", 2353 | " -7.4279e-03, -5.4921e-03]],\n", 2354 | " \n", 2355 | " [[-1.8330e-02, -3.5020e-02, -4.5647e-03, ..., -1.6847e-02,\n", 2356 | " -1.8493e-02, -2.4594e-02],\n", 2357 | " [-4.1776e-03, -2.8195e-02, -1.9245e-02, ..., -2.0432e-02,\n", 2358 | " -4.7981e-03, -1.4396e-02],\n", 2359 | " [-1.4868e-02, -1.7694e-02, -2.6225e-02, ..., -3.2991e-03,\n", 2360 | " -3.6838e-03, -4.8610e-03],\n", 2361 | " ...,\n", 2362 | " [-2.5331e-03, -4.7969e-03, -2.0132e-02, ..., -4.7765e-03,\n", 2363 | " -5.7052e-03, -4.8429e-03],\n", 2364 | " [-3.4539e-03, -3.3050e-02, -1.4698e-02, ..., -1.2370e-02,\n", 2365 | " -2.3638e-02, -2.4548e-02],\n", 2366 | " [-1.5635e-02, -3.4954e-02, -1.7280e-02, ..., -1.2131e-02,\n", 2367 | " -2.3583e-02, -1.5356e-02]]]])),\n", 2368 | " ('3.bias', tensor(1.00000e-02 *\n", 2369 | " [-1.0348, -0.6432, -2.8054, 0.4010, 0.0355, -1.6032, -2.2993,\n", 2370 | " -1.0429, -0.9652, 0.4127, -1.8207, -1.2974, -0.3693, 0.1035,\n", 2371 | " -3.5085, 0.2993, -1.0232, -0.8651, 0.9668, -2.0374, -0.7152,\n", 2372 | " 0.3597, -1.8070, 0.8926, -3.2788, -0.0156, -1.5564, -1.5726,\n", 2373 | " -0.7210, 4.4880, -0.0121, -2.9784, -1.1779, -1.4455, 1.3124,\n", 2374 | " 1.3883, -2.0414, -0.6788, -0.2914, 4.7307, 0.1653, -0.8118,\n", 2375 | " -0.6951, -1.2998, 1.0289, 1.4498, -0.9608, -2.2262, -1.0067,\n", 2376 | " 0.1164, 1.2346, -1.9317, -0.8354, -0.7387, -0.8948, -0.9721,\n", 2377 | " -0.1986, -0.8877, -0.2728, -1.8956, -1.8667, -3.1181, -1.0578,\n", 2378 | " -0.4842])),\n", 2379 | " ('6.weight',\n", 2380 | " tensor([[[[-6.6457e-03, -1.4171e-02, -2.9045e-03, ..., -1.8137e-02,\n", 2381 | " -2.4039e-02, 6.8482e-03],\n", 2382 | " [ 7.1761e-03, -4.3415e-04, -3.1281e-03, ..., -2.2076e-02,\n", 2383 | " 3.7009e-03, -2.6765e-02],\n", 2384 | " [ 1.5630e-03, -1.9424e-03, 9.1876e-04, ..., -1.7380e-02,\n", 2385 | " 7.2866e-03, -1.5511e-02],\n", 2386 | " ...,\n", 2387 | " [-6.0648e-03, -7.3269e-03, -1.2549e-02, ..., -5.2128e-03,\n", 2388 | " -8.3172e-03, -1.7570e-02],\n", 2389 | " [-7.9316e-03, -2.4722e-02, 2.5008e-03, ..., -2.3667e-02,\n", 2390 | " -2.3427e-02, -1.3126e-02],\n", 2391 | " [-6.7987e-03, -1.5110e-02, -8.4143e-03, ..., -1.4240e-04,\n", 2392 | " -1.7958e-02, 8.3597e-04]],\n", 2393 | " \n", 2394 | " [[-7.3525e-03, 7.4036e-03, 4.3098e-04, ..., -1.5146e-02,\n", 2395 | " 7.1143e-03, 6.2732e-04],\n", 2396 | " [ 1.6696e-02, -6.1884e-03, -1.7679e-02, ..., 3.8439e-03,\n", 2397 | " -1.2341e-02, -1.3297e-02],\n", 2398 | " [ 2.2285e-02, -7.4451e-03, 9.5357e-03, ..., 5.9170e-03,\n", 2399 | " -1.4165e-02, 5.7909e-03],\n", 2400 | " ...,\n", 2401 | " [ 8.5605e-03, 1.5439e-03, 3.1369e-03, ..., 2.6004e-02,\n", 2402 | " 1.6715e-02, -6.2791e-03],\n", 2403 | " [-2.9113e-03, -5.9755e-03, 2.4794e-02, ..., 1.4971e-02,\n", 2404 | " 2.4299e-02, 4.9134e-03],\n", 2405 | " [ 8.1300e-03, 2.7531e-02, 2.3008e-02, ..., 2.6274e-02,\n", 2406 | " 2.3459e-02, 8.4176e-03]],\n", 2407 | " \n", 2408 | " [[ 1.6915e-03, 1.5662e-02, -2.1010e-02, ..., -2.5390e-02,\n", 2409 | " -1.8454e-02, -2.5313e-03],\n", 2410 | " [-2.4235e-03, -1.7186e-02, -1.6349e-02, ..., -1.0117e-02,\n", 2411 | " -2.0963e-03, 4.7621e-03],\n", 2412 | " [ 5.7097e-03, -5.0673e-03, -1.0786e-02, ..., -2.2081e-02,\n", 2413 | " -1.2243e-02, -1.6443e-02],\n", 2414 | " ...,\n", 2415 | " [ 1.8973e-04, 5.9129e-03, 2.4763e-02, ..., -1.0624e-02,\n", 2416 | " 2.7799e-02, 1.7528e-02],\n", 2417 | " [ 1.5302e-02, 1.1425e-02, 1.0583e-03, ..., -2.5907e-02,\n", 2418 | " -6.2298e-03, 2.6912e-02],\n", 2419 | " [ 1.3923e-03, 3.1232e-03, 2.4442e-02, ..., 4.6041e-03,\n", 2420 | " 1.3593e-03, 3.2995e-04]],\n", 2421 | " \n", 2422 | " ...,\n", 2423 | " \n", 2424 | " [[ 2.5818e-02, -2.5142e-03, 1.4200e-03, ..., -2.1599e-03,\n", 2425 | " -2.2257e-03, -1.5570e-02],\n", 2426 | " [ 1.1808e-02, 5.1975e-03, -1.2687e-02, ..., -9.0135e-03,\n", 2427 | " -1.0521e-02, -7.2020e-03],\n", 2428 | " [ 2.6967e-02, 1.1292e-02, 4.3858e-03, ..., -1.5487e-02,\n", 2429 | " -7.1060e-03, -2.4728e-02],\n", 2430 | " ...,\n", 2431 | " [ 6.9493e-03, -7.3873e-03, -1.4296e-03, ..., -1.5632e-03,\n", 2432 | " -9.1091e-03, -1.7611e-02],\n", 2433 | " [-8.2599e-03, -1.2565e-02, -9.7295e-04, ..., -1.3228e-02,\n", 2434 | " -2.3057e-02, 2.0873e-03],\n", 2435 | " [ 2.5067e-02, 2.2780e-02, -2.1365e-02, ..., -2.5433e-02,\n", 2436 | " -1.2683e-02, -1.1745e-02]],\n", 2437 | " \n", 2438 | " [[ 5.5638e-04, -1.4176e-02, -2.1675e-02, ..., 6.9348e-03,\n", 2439 | " -2.5002e-02, -7.3456e-03],\n", 2440 | " [-2.0352e-02, 6.1517e-03, -1.1137e-02, ..., -1.0299e-02,\n", 2441 | " -7.1797e-03, -1.7937e-02],\n", 2442 | " [-2.4783e-02, 7.8138e-03, -8.3013e-03, ..., -7.0645e-03,\n", 2443 | " 5.7574e-03, -6.3606e-03],\n", 2444 | " ...,\n", 2445 | " [-8.1102e-03, 5.2446e-04, 1.3026e-02, ..., 3.2308e-04,\n", 2446 | " -6.0556e-03, -2.3312e-02],\n", 2447 | " [-1.9393e-02, -1.0644e-02, -1.3462e-02, ..., -2.9526e-03,\n", 2448 | " -1.1095e-02, -4.4025e-03],\n", 2449 | " [-2.0711e-02, -1.2897e-02, -2.3291e-02, ..., -2.2207e-02,\n", 2450 | " -2.4636e-02, -9.8060e-03]],\n", 2451 | " \n", 2452 | " [[-2.7536e-02, 2.2127e-04, -2.0344e-02, ..., -2.6237e-02,\n", 2453 | " -1.6757e-02, -1.0473e-02],\n", 2454 | " [ 2.9774e-03, -3.4460e-03, 4.1607e-04, ..., -1.8696e-02,\n", 2455 | " -1.7803e-02, -1.5318e-02],\n", 2456 | " [-6.8567e-03, -5.4140e-03, -2.2211e-03, ..., -1.5153e-02,\n", 2457 | " -9.4086e-03, -2.4556e-02],\n", 2458 | " ...,\n", 2459 | " [-2.0466e-02, -1.5368e-02, -1.3362e-03, ..., -1.2661e-02,\n", 2460 | " -2.7657e-02, -2.6702e-02],\n", 2461 | " [-1.6134e-04, -5.4864e-03, -6.9648e-03, ..., -8.6749e-03,\n", 2462 | " -1.6099e-02, -1.1674e-02],\n", 2463 | " [-3.9682e-03, -2.1888e-04, -1.8551e-02, ..., 3.1419e-03,\n", 2464 | " -1.6960e-02, -3.9024e-03]]],\n", 2465 | " \n", 2466 | " \n", 2467 | " [[[ 2.6815e-03, 2.7600e-03, -2.3110e-02, ..., -6.3854e-03,\n", 2468 | " 6.4987e-03, 1.1546e-03],\n", 2469 | " [-1.9149e-02, 2.1954e-03, -2.2608e-02, ..., 1.9906e-03,\n", 2470 | " -9.6423e-03, -1.6311e-02],\n", 2471 | " [-4.5714e-04, -6.5635e-03, -1.8411e-02, ..., 2.6722e-02,\n", 2472 | " -1.0920e-02, -2.1461e-02],\n", 2473 | " ...,\n", 2474 | " [ 6.3454e-03, -7.8911e-03, -2.8480e-03, ..., -1.6411e-02,\n", 2475 | " 6.4979e-03, -6.4111e-03],\n", 2476 | " [-2.7195e-02, -2.6426e-02, 6.3926e-03, ..., 7.5039e-03,\n", 2477 | " 1.6723e-02, -2.7925e-03],\n", 2478 | " [-9.6588e-03, -1.8814e-03, -3.7692e-03, ..., -2.3274e-02,\n", 2479 | " -3.0475e-04, -2.4586e-02]],\n", 2480 | " \n", 2481 | " [[-1.9053e-02, -1.4415e-02, -3.9138e-04, ..., -2.2224e-02,\n", 2482 | " -2.5606e-02, -2.7464e-03],\n", 2483 | " [ 3.4185e-03, 6.5735e-04, -6.7643e-03, ..., 3.8953e-03,\n", 2484 | " -2.2330e-02, 3.5497e-04],\n", 2485 | " [-1.7709e-03, -2.3377e-02, -6.9347e-03, ..., -1.8656e-02,\n", 2486 | " -1.9381e-02, -6.5882e-03],\n", 2487 | " ...,\n", 2488 | " [ 7.6387e-03, -2.6929e-02, -7.6107e-04, ..., -2.7788e-02,\n", 2489 | " -1.9311e-02, -2.3376e-02],\n", 2490 | " [-1.8804e-02, -1.5826e-02, -2.3658e-02, ..., -4.7362e-03,\n", 2491 | " -3.9745e-03, -2.0802e-02],\n", 2492 | " [-2.3835e-02, -2.0257e-03, 6.2832e-03, ..., -1.6132e-02,\n", 2493 | " -2.4613e-02, -1.9445e-02]],\n", 2494 | " \n", 2495 | " [[ 3.7441e-03, -2.8301e-04, -2.1012e-02, ..., -2.1116e-02,\n", 2496 | " -1.9632e-02, 4.1838e-03],\n", 2497 | " [ 5.3022e-03, -1.0277e-02, 4.0184e-03, ..., 1.8427e-03,\n", 2498 | " -1.7806e-02, -5.5921e-03],\n", 2499 | " [-2.4765e-02, -1.2122e-02, -3.3981e-03, ..., -2.7065e-03,\n", 2500 | " 7.5494e-03, -8.5881e-03],\n", 2501 | " ...,\n", 2502 | " [-2.5949e-03, -1.2332e-02, -9.9704e-04, ..., 6.1100e-03,\n", 2503 | " -2.1041e-02, 1.5915e-03],\n", 2504 | " [-2.9155e-03, -1.2471e-03, 2.3624e-03, ..., -4.0809e-04,\n", 2505 | " 2.2107e-03, 5.9018e-03],\n", 2506 | " [-2.7314e-02, -8.8494e-03, 3.4153e-03, ..., 1.9356e-03,\n", 2507 | " -2.2871e-02, -1.3754e-02]],\n", 2508 | " \n", 2509 | " ...,\n", 2510 | " \n", 2511 | " [[-1.4542e-02, -1.1539e-02, 8.9263e-05, ..., -7.3279e-03,\n", 2512 | " -2.6264e-02, -1.3329e-02],\n", 2513 | " [-2.7454e-02, 3.3421e-03, -2.5765e-02, ..., -1.0423e-02,\n", 2514 | " -2.6844e-02, 7.3982e-03],\n", 2515 | " [-2.3613e-02, -1.3673e-02, -1.8357e-02, ..., -1.7721e-02,\n", 2516 | " -8.5604e-03, -2.2132e-02],\n", 2517 | " ...,\n", 2518 | " [-2.6013e-02, -3.6969e-03, 2.5747e-03, ..., -3.1840e-03,\n", 2519 | " -1.5127e-02, -5.5397e-03],\n", 2520 | " [-1.4254e-02, -2.5712e-02, -1.9869e-02, ..., -1.7686e-02,\n", 2521 | " 4.4819e-03, -9.8499e-03],\n", 2522 | " [-8.2287e-03, -2.6694e-02, -2.0531e-02, ..., -1.7120e-03,\n", 2523 | " -2.0798e-02, -1.7615e-02]],\n", 2524 | " \n", 2525 | " [[-1.1641e-02, 1.9956e-03, 1.1898e-02, ..., 3.6846e-03,\n", 2526 | " 1.1974e-02, -4.5329e-04],\n", 2527 | " [-2.5668e-02, 1.7122e-02, 1.7507e-02, ..., 9.9175e-03,\n", 2528 | " 2.5714e-02, -7.6476e-04],\n", 2529 | " [-1.7509e-02, 4.3558e-03, 7.5123e-04, ..., -1.4198e-03,\n", 2530 | " 2.5469e-03, 2.4452e-03],\n", 2531 | " ...,\n", 2532 | " [-4.9957e-03, 2.1021e-02, 1.2628e-02, ..., 5.9583e-03,\n", 2533 | " -8.1602e-04, 5.6060e-03],\n", 2534 | " [ 9.3684e-03, -3.8993e-03, -7.4301e-03, ..., 2.5262e-02,\n", 2535 | " -1.1567e-02, -2.2611e-02],\n", 2536 | " [ 1.5262e-02, 8.9769e-03, 9.7152e-03, ..., -7.4974e-03,\n", 2537 | " -4.8129e-03, 5.6780e-03]],\n", 2538 | " \n", 2539 | " [[ 2.3000e-03, -2.4523e-02, 6.6512e-03, ..., -2.7391e-02,\n", 2540 | " 6.8425e-03, -2.7274e-03],\n", 2541 | " [-7.4881e-03, -2.6908e-02, -1.0024e-02, ..., 6.7545e-03,\n", 2542 | " -1.3386e-02, -2.3434e-02],\n", 2543 | " [-1.5010e-03, -1.7844e-03, -1.2954e-02, ..., -1.4116e-02,\n", 2544 | " -5.1217e-03, -8.3684e-03],\n", 2545 | " ...,\n", 2546 | " [-2.3182e-02, -1.3679e-02, -2.6907e-02, ..., 7.7890e-03,\n", 2547 | " 5.6772e-03, -2.3604e-03],\n", 2548 | " [-1.3363e-02, 3.2209e-03, -2.5748e-02, ..., -2.0797e-02,\n", 2549 | " -1.4555e-02, -1.4172e-02],\n", 2550 | " [-1.8342e-03, -1.0991e-02, -1.9722e-02, ..., -1.5551e-02,\n", 2551 | " -1.0138e-02, -1.0672e-02]]],\n", 2552 | " \n", 2553 | " \n", 2554 | " [[[ 1.0803e-02, 4.7048e-03, 1.6983e-02, ..., 4.1527e-03,\n", 2555 | " 2.2373e-02, 5.4560e-04],\n", 2556 | " [ 6.3237e-03, 2.1544e-02, 1.7252e-02, ..., -2.2766e-03,\n", 2557 | " 1.3347e-02, -4.3080e-03],\n", 2558 | " [ 2.6734e-02, 2.6813e-02, 6.2577e-03, ..., 2.1421e-02,\n", 2559 | " -3.0671e-03, 2.6876e-02],\n", 2560 | " ...,\n", 2561 | " [ 3.8466e-03, 1.4918e-02, 9.1837e-04, ..., 1.4482e-02,\n", 2562 | " -2.3947e-02, 2.3661e-02],\n", 2563 | " [-5.0735e-03, 1.9258e-02, 7.1542e-03, ..., 2.7190e-02,\n", 2564 | " -2.4411e-02, 2.2396e-02],\n", 2565 | " [ 5.5550e-03, 2.6562e-03, 2.5110e-02, ..., 1.3546e-02,\n", 2566 | " 6.1975e-03, 1.0409e-02]],\n", 2567 | " \n", 2568 | " [[-1.1136e-02, 6.9883e-03, 3.0030e-03, ..., -5.5232e-04,\n", 2569 | " -1.7540e-02, -2.3302e-02],\n", 2570 | " [-1.4507e-02, 3.2926e-03, -2.3579e-02, ..., -1.3034e-02,\n", 2571 | " -1.0693e-02, -1.6482e-02],\n", 2572 | " [-1.4580e-02, -9.5563e-03, -6.7839e-03, ..., -1.4063e-02,\n", 2573 | " -1.8502e-02, -2.5409e-02],\n", 2574 | " ...,\n", 2575 | " [-1.0305e-02, 6.6265e-03, -6.3571e-03, ..., -1.4248e-02,\n", 2576 | " -1.3378e-03, -2.7316e-02],\n", 2577 | " [-2.7698e-02, 5.9108e-03, -2.4755e-02, ..., -1.2901e-02,\n", 2578 | " -1.3346e-02, -1.8909e-02],\n", 2579 | " [-7.2682e-03, 2.3862e-03, 7.2970e-03, ..., -1.9567e-03,\n", 2580 | " 2.5399e-03, -1.2041e-02]],\n", 2581 | " \n", 2582 | " [[ 9.3208e-04, -2.4150e-02, -8.2703e-03, ..., -9.9188e-03,\n", 2583 | " -2.7008e-02, -6.4440e-03],\n", 2584 | " [-2.8552e-03, -2.5445e-02, -1.7352e-03, ..., -5.3413e-03,\n", 2585 | " 3.9580e-03, -1.5058e-02],\n", 2586 | " [-2.2481e-02, -7.4268e-03, -1.6228e-02, ..., 6.2900e-03,\n", 2587 | " -4.6813e-03, -2.2208e-02],\n", 2588 | " ...,\n", 2589 | " [-2.2341e-02, 1.4652e-03, -6.4600e-03, ..., -1.5374e-02,\n", 2590 | " -2.3160e-02, -3.9129e-03],\n", 2591 | " [-1.1384e-02, -2.0828e-02, 5.7455e-03, ..., -1.1452e-02,\n", 2592 | " -7.6033e-03, 7.8521e-03],\n", 2593 | " [-1.1966e-03, -1.0845e-02, -9.7271e-04, ..., -9.2989e-03,\n", 2594 | " -8.6757e-03, -2.6281e-02]],\n", 2595 | " \n", 2596 | " ...,\n", 2597 | " \n", 2598 | " [[-1.3458e-02, -7.7781e-03, -2.3052e-02, ..., 2.8025e-03,\n", 2599 | " -7.8977e-03, -3.7936e-03],\n", 2600 | " [-1.1218e-02, -1.6381e-02, 6.8840e-03, ..., 3.5669e-03,\n", 2601 | " -2.7674e-02, -3.5688e-03],\n", 2602 | " [-8.9585e-03, -1.2310e-02, -2.2705e-02, ..., -9.7054e-03,\n", 2603 | " -2.3737e-03, -6.4271e-04],\n", 2604 | " ...,\n", 2605 | " [ 3.4600e-03, -9.8721e-04, 2.1120e-02, ..., -2.6087e-02,\n", 2606 | " -4.4846e-03, -5.2615e-03],\n", 2607 | " [ 8.7108e-04, -8.7200e-03, 1.5654e-02, ..., -9.8368e-03,\n", 2608 | " -1.5175e-02, 1.6077e-03],\n", 2609 | " [ 3.6899e-03, -1.1976e-02, -3.6526e-03, ..., 1.2364e-04,\n", 2610 | " -1.8276e-02, -2.1552e-02]],\n", 2611 | " \n", 2612 | " [[ 2.5739e-03, 3.8341e-03, 4.8284e-03, ..., 1.5254e-02,\n", 2613 | " -1.8352e-02, -1.8539e-02],\n", 2614 | " [-1.0978e-03, 3.0958e-03, -2.1609e-02, ..., -1.6518e-02,\n", 2615 | " 1.1658e-02, -1.6776e-02],\n", 2616 | " [ 2.3345e-02, 1.4186e-02, 7.7396e-03, ..., 2.4179e-02,\n", 2617 | " 7.5861e-03, 1.4574e-03],\n", 2618 | " ...,\n", 2619 | " [ 9.2825e-03, 3.2912e-03, 1.9568e-03, ..., -1.0460e-03,\n", 2620 | " -4.2239e-04, 2.6380e-03],\n", 2621 | " [ 2.2806e-02, 2.7072e-02, 1.1315e-02, ..., 5.2665e-03,\n", 2622 | " 3.7033e-04, 2.7828e-02],\n", 2623 | " [ 2.7164e-02, 1.1026e-03, 2.7055e-03, ..., 1.7518e-02,\n", 2624 | " 2.3056e-02, -6.8682e-03]],\n", 2625 | " \n", 2626 | " [[-1.4881e-02, -5.9023e-03, -1.9649e-02, ..., -4.1369e-04,\n", 2627 | " -1.3280e-02, -2.6200e-02],\n", 2628 | " [-2.6755e-02, -2.1669e-02, 4.5764e-03, ..., -7.8507e-03,\n", 2629 | " 6.4255e-03, 9.9325e-03],\n", 2630 | " [-8.6054e-03, -7.6855e-03, 5.8127e-03, ..., 2.5860e-02,\n", 2631 | " 6.4223e-03, 3.5202e-03],\n", 2632 | " ...,\n", 2633 | " [-6.3107e-03, 4.4912e-03, -7.6356e-03, ..., 2.1135e-02,\n", 2634 | " -1.6345e-03, 5.7075e-03],\n", 2635 | " [ 3.9341e-03, 1.1165e-02, -7.7545e-03, ..., 1.0315e-02,\n", 2636 | " -4.8345e-03, 1.4341e-02],\n", 2637 | " [ 1.8492e-02, 1.3883e-02, 1.0993e-02, ..., 3.8087e-03,\n", 2638 | " 2.1333e-02, 5.9169e-03]]],\n", 2639 | " \n", 2640 | " \n", 2641 | " ...,\n", 2642 | " \n", 2643 | " \n", 2644 | " [[[-1.7079e-02, -2.3652e-02, 1.7911e-02, ..., -1.2363e-02,\n", 2645 | " 2.8492e-03, 7.0113e-03],\n", 2646 | " [ 1.6031e-03, -2.7487e-02, -1.1339e-03, ..., -2.4735e-02,\n", 2647 | " 1.1502e-02, 1.2130e-02],\n", 2648 | " [-5.5296e-04, -2.5571e-02, -6.1638e-04, ..., 1.6285e-02,\n", 2649 | " 1.5937e-02, 6.5888e-03],\n", 2650 | " ...,\n", 2651 | " [-5.1860e-04, -5.0372e-03, 8.0611e-03, ..., -1.0326e-03,\n", 2652 | " -1.7013e-02, 6.6016e-03],\n", 2653 | " [-1.2407e-02, -7.1872e-03, 2.0173e-02, ..., 2.6709e-02,\n", 2654 | " 2.6810e-02, -2.2917e-02],\n", 2655 | " [-4.1939e-03, 1.3234e-02, 7.8543e-03, ..., 5.6746e-03,\n", 2656 | " -1.7797e-02, 4.2977e-03]],\n", 2657 | " \n", 2658 | " [[-5.5146e-03, -1.6946e-02, -6.5365e-03, ..., -2.4159e-02,\n", 2659 | " -2.6040e-02, -9.4051e-03],\n", 2660 | " [ 7.1273e-03, -4.6073e-03, -8.6110e-03, ..., 1.7259e-03,\n", 2661 | " -3.6051e-03, 2.7651e-03],\n", 2662 | " [-1.9700e-02, -2.6362e-02, -9.3747e-03, ..., -2.6163e-03,\n", 2663 | " -1.9860e-02, -4.4046e-04],\n", 2664 | " ...,\n", 2665 | " [-1.1889e-02, -9.4752e-03, -2.4356e-02, ..., -2.3420e-02,\n", 2666 | " -2.0885e-02, -1.9287e-02],\n", 2667 | " [-2.6928e-02, -2.4612e-02, 4.7622e-03, ..., -1.5503e-02,\n", 2668 | " -2.4363e-02, 7.5888e-03],\n", 2669 | " [-1.5518e-02, -2.3157e-02, -1.0659e-03, ..., -2.4205e-02,\n", 2670 | " -9.6639e-03, -2.3377e-02]],\n", 2671 | " \n", 2672 | " [[-2.6864e-02, -2.4899e-02, -2.2055e-03, ..., -1.4565e-02,\n", 2673 | " -8.2756e-03, -2.1349e-02],\n", 2674 | " [-1.9350e-02, -2.6102e-02, -7.5557e-03, ..., -2.6522e-02,\n", 2675 | " -2.1705e-02, -2.3488e-02],\n", 2676 | " [ 6.7886e-03, -2.0861e-02, -7.1895e-03, ..., -2.0731e-02,\n", 2677 | " -1.6870e-02, -1.9063e-02],\n", 2678 | " ...,\n", 2679 | " [-8.5981e-03, -1.5810e-02, -2.1077e-02, ..., 1.8970e-02,\n", 2680 | " -7.3123e-03, 6.5245e-03],\n", 2681 | " [-1.9654e-02, -2.7379e-02, -1.4654e-02, ..., 1.7281e-02,\n", 2682 | " -2.6117e-02, -9.2734e-03],\n", 2683 | " [-1.7851e-02, -7.7316e-03, 4.3901e-03, ..., -3.3982e-03,\n", 2684 | " 5.3714e-03, 4.5850e-03]],\n", 2685 | " \n", 2686 | " ...,\n", 2687 | " \n", 2688 | " [[ 7.6055e-03, -9.5157e-03, -2.1007e-02, ..., 2.3747e-03,\n", 2689 | " 5.1110e-03, -2.7625e-02],\n", 2690 | " [-1.3811e-02, 5.6590e-03, 1.1003e-04, ..., -1.8449e-02,\n", 2691 | " -8.6538e-04, 1.8602e-03],\n", 2692 | " [ 1.5298e-03, 5.9226e-03, -1.5929e-02, ..., -7.0295e-03,\n", 2693 | " -6.9297e-03, -3.3335e-04],\n", 2694 | " ...,\n", 2695 | " [-8.5364e-03, 5.2309e-04, -2.4532e-02, ..., -2.7381e-02,\n", 2696 | " -2.3954e-02, -7.8353e-04],\n", 2697 | " [-1.2966e-02, -9.3232e-04, -1.1649e-02, ..., 7.2251e-03,\n", 2698 | " -2.4828e-02, -7.1678e-03],\n", 2699 | " [-2.7845e-02, -7.3668e-03, -1.3037e-02, ..., -2.5463e-03,\n", 2700 | " -1.1670e-02, 6.9228e-04]],\n", 2701 | " \n", 2702 | " [[ 4.2987e-03, -1.3866e-02, -3.0098e-04, ..., -2.0312e-02,\n", 2703 | " -2.6673e-02, -7.5054e-03],\n", 2704 | " [-2.5288e-02, -2.7234e-02, -3.2072e-03, ..., -1.6922e-03,\n", 2705 | " 5.1159e-03, 1.8809e-03],\n", 2706 | " [-7.8404e-03, -2.4190e-02, -5.6545e-03, ..., -9.9718e-03,\n", 2707 | " 2.2418e-03, -1.8270e-03],\n", 2708 | " ...,\n", 2709 | " [-2.1183e-02, -1.7935e-02, -1.2816e-02, ..., -4.2227e-03,\n", 2710 | " 3.4619e-03, -5.6836e-03],\n", 2711 | " [ 5.1959e-03, 1.4082e-03, -1.8438e-02, ..., 5.0958e-03,\n", 2712 | " -4.6172e-03, -1.0442e-02],\n", 2713 | " [ 3.1867e-03, 1.6476e-02, -2.3770e-03, ..., -1.1497e-03,\n", 2714 | " -5.9099e-03, -1.2312e-05]],\n", 2715 | " \n", 2716 | " [[-4.6278e-03, -1.7988e-02, -1.4015e-02, ..., -7.2963e-03,\n", 2717 | " -1.5966e-02, -2.2753e-02],\n", 2718 | " [-2.2051e-02, -1.8920e-02, -2.3424e-02, ..., -1.3496e-02,\n", 2719 | " -4.3788e-03, -1.8417e-02],\n", 2720 | " [ 6.6881e-03, -2.0990e-03, -1.6915e-02, ..., -1.0629e-02,\n", 2721 | " -1.8865e-02, -2.7226e-02],\n", 2722 | " ...,\n", 2723 | " [-2.1795e-02, -9.9422e-03, 1.1856e-03, ..., -1.4233e-02,\n", 2724 | " -5.5066e-03, -1.3657e-03],\n", 2725 | " [-9.7043e-03, -1.9177e-02, -1.1190e-02, ..., 6.3276e-03,\n", 2726 | " 3.6512e-03, -4.3879e-04],\n", 2727 | " [-3.5802e-03, -1.2609e-02, 3.3233e-03, ..., 6.7619e-04,\n", 2728 | " 4.9258e-03, 3.0377e-03]]],\n", 2729 | " \n", 2730 | " \n", 2731 | " [[[-7.1877e-03, -1.5681e-02, -1.6549e-02, ..., 9.0503e-03,\n", 2732 | " 2.6306e-02, -2.6235e-03],\n", 2733 | " [-2.3821e-02, -8.0970e-03, -7.9879e-03, ..., -2.6150e-02,\n", 2734 | " -1.9651e-02, -2.1417e-02],\n", 2735 | " [ 1.0182e-02, 2.1408e-02, -1.7475e-02, ..., -3.8979e-03,\n", 2736 | " -8.5626e-03, -2.2207e-02],\n", 2737 | " ...,\n", 2738 | " [ 1.2065e-02, -3.3887e-03, -2.4597e-02, ..., -7.3119e-03,\n", 2739 | " 5.5528e-04, -2.4736e-02],\n", 2740 | " [ 6.9064e-03, -1.4728e-03, -7.0641e-03, ..., -5.9020e-03,\n", 2741 | " -1.9837e-03, 9.0277e-04],\n", 2742 | " [ 3.5109e-03, 8.2354e-03, 1.1213e-02, ..., 2.2563e-03,\n", 2743 | " -2.5394e-03, -4.8740e-04]],\n", 2744 | " \n", 2745 | " [[ 1.4663e-02, -2.5992e-02, 6.7058e-03, ..., 1.3753e-03,\n", 2746 | " -1.5902e-02, -3.0446e-04],\n", 2747 | " [-1.5684e-02, 1.5662e-03, 1.4345e-04, ..., 3.9895e-03,\n", 2748 | " -1.3194e-02, -1.8605e-02],\n", 2749 | " [-1.2445e-02, -1.7827e-02, -3.9375e-03, ..., 5.2872e-03,\n", 2750 | " -1.1453e-03, 6.0658e-03],\n", 2751 | " ...,\n", 2752 | " [ 1.9661e-02, -2.8060e-03, 5.9395e-03, ..., -1.0668e-02,\n", 2753 | " -1.9702e-02, -1.1407e-02],\n", 2754 | " [-5.6370e-03, -8.0981e-03, -9.2554e-03, ..., 4.9647e-03,\n", 2755 | " 6.1075e-03, -2.8991e-03],\n", 2756 | " [-3.0469e-04, 9.4089e-03, -3.9601e-03, ..., -1.7853e-02,\n", 2757 | " -2.6795e-02, -1.4895e-03]],\n", 2758 | " \n", 2759 | " [[-1.0753e-02, 1.3153e-02, -7.8495e-03, ..., -6.2965e-03,\n", 2760 | " -6.8527e-03, -4.3924e-03],\n", 2761 | " [ 2.5400e-03, -2.6458e-02, 3.5085e-03, ..., -2.7219e-02,\n", 2762 | " -1.2093e-02, 4.6735e-03],\n", 2763 | " [-1.0301e-02, -2.7772e-02, -2.2750e-02, ..., -7.2343e-03,\n", 2764 | " -5.1331e-04, 2.2712e-03],\n", 2765 | " ...,\n", 2766 | " [-1.7714e-02, -3.8750e-03, 5.8806e-03, ..., 1.6281e-02,\n", 2767 | " -2.3514e-03, 1.7316e-02],\n", 2768 | " [-1.8493e-02, -1.9961e-02, -1.1608e-02, ..., 2.9879e-03,\n", 2769 | " -1.2182e-02, 1.6411e-03],\n", 2770 | " [-3.9716e-03, -2.7665e-02, -1.9828e-02, ..., -6.4639e-03,\n", 2771 | " -9.6503e-03, 5.3992e-04]],\n", 2772 | " \n", 2773 | " ...,\n", 2774 | " \n", 2775 | " [[ 1.6866e-02, 2.1281e-02, -1.9741e-02, ..., -1.8323e-02,\n", 2776 | " -2.5315e-02, -2.2827e-02],\n", 2777 | " [ 1.2587e-02, -2.1247e-02, -1.3705e-02, ..., 4.2168e-04,\n", 2778 | " 4.2513e-03, -1.8466e-02],\n", 2779 | " [-2.4485e-02, -1.5450e-02, -1.6921e-02, ..., 3.0821e-03,\n", 2780 | " -1.4335e-02, 5.8570e-03],\n", 2781 | " ...,\n", 2782 | " [-7.2738e-03, -4.1662e-03, -1.5849e-02, ..., 5.0289e-04,\n", 2783 | " -7.0477e-03, -1.7925e-02],\n", 2784 | " [-3.5463e-03, -1.9288e-02, -1.6590e-02, ..., -4.3331e-03,\n", 2785 | " 4.0621e-03, -1.3745e-02],\n", 2786 | " [ 2.4187e-02, 1.1818e-02, -1.6819e-02, ..., -2.5773e-02,\n", 2787 | " -7.9688e-03, -1.2778e-02]],\n", 2788 | " \n", 2789 | " [[-2.6345e-02, -2.2053e-02, -1.0640e-02, ..., -1.8684e-02,\n", 2790 | " -1.4214e-02, -6.4522e-03],\n", 2791 | " [-1.3135e-02, -1.2603e-02, 2.7860e-03, ..., -1.1153e-02,\n", 2792 | " -2.6949e-02, -1.9304e-02],\n", 2793 | " [ 6.7585e-03, 2.1437e-03, -2.2104e-02, ..., -2.6568e-02,\n", 2794 | " -1.2645e-02, -4.9750e-03],\n", 2795 | " ...,\n", 2796 | " [ 9.7202e-05, 2.2102e-02, -1.1010e-02, ..., -2.9561e-03,\n", 2797 | " -1.6349e-02, -8.2710e-03],\n", 2798 | " [ 1.4986e-02, -2.2819e-03, 1.5725e-02, ..., -2.8215e-03,\n", 2799 | " -8.3108e-04, 7.6056e-03],\n", 2800 | " [ 1.5228e-02, 1.1487e-02, -2.5822e-02, ..., 9.8976e-03,\n", 2801 | " -2.6789e-02, -4.1409e-03]],\n", 2802 | " \n", 2803 | " [[-2.9711e-03, -1.4094e-02, 3.8414e-03, ..., -2.0743e-02,\n", 2804 | " -9.5010e-03, -2.3399e-02],\n", 2805 | " [-5.2331e-04, -6.4809e-03, -2.0062e-02, ..., 7.0671e-03,\n", 2806 | " -1.0242e-02, -1.8892e-02],\n", 2807 | " [-1.8418e-02, -1.2636e-02, 2.0545e-03, ..., -1.7045e-03,\n", 2808 | " -1.2336e-02, -2.4090e-02],\n", 2809 | " ...,\n", 2810 | " [-7.5012e-03, 3.8512e-03, -2.6576e-02, ..., -2.0135e-02,\n", 2811 | " -1.1112e-02, -2.2840e-02],\n", 2812 | " [-9.6134e-03, -2.5728e-02, -1.8202e-02, ..., 6.0040e-04,\n", 2813 | " 7.6143e-03, -7.5557e-03],\n", 2814 | " [ 5.8229e-03, -3.4572e-03, -1.0796e-02, ..., -1.7034e-04,\n", 2815 | " -2.3383e-02, -8.9818e-03]]],\n", 2816 | " \n", 2817 | " \n", 2818 | " [[[-2.3425e-02, -7.5719e-03, 9.8183e-03, ..., -7.3464e-03,\n", 2819 | " 1.0208e-02, 2.6022e-02],\n", 2820 | " [ 1.9817e-02, 2.0486e-03, 7.5612e-03, ..., 2.3252e-02,\n", 2821 | " 3.6919e-03, 2.4617e-02],\n", 2822 | " [ 1.5216e-02, 7.6164e-03, 1.2121e-02, ..., -2.5427e-02,\n", 2823 | " 5.9616e-03, -1.5313e-02],\n", 2824 | " ...,\n", 2825 | " [-1.8953e-02, -2.7664e-02, -8.3372e-04, ..., -1.1394e-02,\n", 2826 | " -3.9599e-03, -1.0342e-03],\n", 2827 | " [-1.6751e-02, -2.0885e-02, -1.7630e-02, ..., -1.6645e-03,\n", 2828 | " -2.3710e-02, -1.7802e-02],\n", 2829 | " [-6.0117e-03, 3.8652e-03, -2.6424e-02, ..., -2.2235e-02,\n", 2830 | " -1.6443e-03, -2.7785e-02]],\n", 2831 | " \n", 2832 | " [[-4.1271e-03, 4.0829e-03, 3.4600e-03, ..., -2.2573e-02,\n", 2833 | " -1.6629e-02, -3.0176e-03],\n", 2834 | " [ 2.0742e-02, -8.8202e-03, -2.5944e-02, ..., 2.3755e-02,\n", 2835 | " -6.2048e-03, 1.5848e-02],\n", 2836 | " [ 6.0385e-03, 9.0078e-03, 1.1106e-02, ..., -2.3429e-02,\n", 2837 | " 6.0346e-03, 2.3764e-02],\n", 2838 | " ...,\n", 2839 | " [-3.2518e-03, 1.1081e-02, -2.9847e-03, ..., 2.1810e-03,\n", 2840 | " 2.1432e-02, 1.4721e-02],\n", 2841 | " [ 2.4611e-03, 2.6107e-02, -1.9289e-03, ..., 1.3872e-02,\n", 2842 | " 2.3297e-03, -1.8788e-03],\n", 2843 | " [ 2.1329e-02, 1.6712e-03, 2.4485e-02, ..., 1.1636e-02,\n", 2844 | " 9.4464e-03, 2.6383e-02]],\n", 2845 | " \n", 2846 | " [[-2.0996e-02, 6.0790e-03, -8.0994e-03, ..., 3.8938e-03,\n", 2847 | " -1.3891e-03, 7.1402e-03],\n", 2848 | " [-7.0939e-03, 6.2268e-03, -1.4198e-02, ..., -5.2488e-03,\n", 2849 | " 1.4681e-02, 1.2842e-02],\n", 2850 | " [ 4.9848e-03, -2.7536e-03, -2.2892e-02, ..., 3.7270e-03,\n", 2851 | " 2.0247e-02, 1.3076e-02],\n", 2852 | " ...,\n", 2853 | " [-1.8175e-03, 1.1675e-02, 1.6029e-02, ..., 3.0613e-03,\n", 2854 | " 1.4126e-03, -1.0311e-03],\n", 2855 | " [ 1.1964e-02, -2.5340e-03, 2.3853e-02, ..., 6.0123e-03,\n", 2856 | " 1.8182e-02, 4.9782e-03],\n", 2857 | " [ 2.6864e-02, -6.5097e-03, 1.3913e-02, ..., -5.3833e-03,\n", 2858 | " 1.0168e-03, 3.6364e-03]],\n", 2859 | " \n", 2860 | " ...,\n", 2861 | " \n", 2862 | " [[-2.2790e-02, -2.2155e-02, 2.9486e-03, ..., -4.1600e-04,\n", 2863 | " -9.5766e-05, -9.7980e-03],\n", 2864 | " [ 2.8710e-04, -8.9594e-03, -2.1569e-03, ..., 3.8048e-03,\n", 2865 | " -9.6475e-03, -1.3285e-02],\n", 2866 | " [-1.6881e-03, -2.4389e-02, -2.6588e-02, ..., -1.8146e-02,\n", 2867 | " -2.5774e-02, -1.9062e-02],\n", 2868 | " ...,\n", 2869 | " [ 6.1846e-03, -2.6508e-02, -2.3966e-02, ..., -8.0941e-03,\n", 2870 | " -1.7214e-03, -1.8662e-02],\n", 2871 | " [-2.4548e-02, 2.0505e-02, -1.8847e-02, ..., -1.8596e-02,\n", 2872 | " -2.2775e-02, -1.5670e-02],\n", 2873 | " [-6.7244e-03, 1.5245e-02, 2.6767e-03, ..., -9.2259e-04,\n", 2874 | " -1.3007e-02, 3.1601e-03]],\n", 2875 | " \n", 2876 | " [[-2.3199e-02, -8.7317e-03, -3.8718e-03, ..., 7.0642e-03,\n", 2877 | " -2.6819e-02, -2.3488e-02],\n", 2878 | " [-2.7719e-02, 1.8092e-03, -4.2290e-03, ..., -3.7541e-03,\n", 2879 | " 2.3110e-02, -5.9336e-03],\n", 2880 | " [-1.3882e-02, -9.4410e-03, 7.1976e-03, ..., 6.1983e-03,\n", 2881 | " 7.5404e-03, 2.6457e-02],\n", 2882 | " ...,\n", 2883 | " [-3.6166e-03, -1.9016e-02, 7.3500e-03, ..., -7.7176e-03,\n", 2884 | " -4.5644e-03, -7.5307e-03],\n", 2885 | " [-1.6041e-02, -1.3890e-03, -8.0973e-03, ..., -2.1373e-02,\n", 2886 | " -1.3475e-02, -1.5834e-02],\n", 2887 | " [-1.5544e-02, -5.1768e-04, 5.4445e-03, ..., -1.8930e-02,\n", 2888 | " -2.3949e-02, -5.7021e-03]],\n", 2889 | " \n", 2890 | " [[ 1.0378e-03, 8.1250e-04, -1.7659e-02, ..., 4.4009e-03,\n", 2891 | " -5.7019e-04, 5.7071e-03],\n", 2892 | " [-8.5712e-04, 5.3408e-03, -2.6760e-02, ..., -2.3124e-02,\n", 2893 | " -5.0353e-03, -1.1309e-02],\n", 2894 | " [ 2.5485e-02, -1.7972e-02, 3.4282e-03, ..., -4.4639e-03,\n", 2895 | " 1.3660e-03, -8.8214e-04],\n", 2896 | " ...,\n", 2897 | " [-9.1250e-03, -1.2143e-02, -1.7638e-03, ..., -2.3895e-02,\n", 2898 | " -2.5546e-02, 5.2568e-03],\n", 2899 | " [-1.0582e-02, 3.3731e-03, -2.1635e-02, ..., -1.5461e-02,\n", 2900 | " -8.5758e-03, -7.9359e-03],\n", 2901 | " [-1.5926e-02, -1.1710e-02, -1.3718e-02, ..., -1.8985e-02,\n", 2902 | " 1.9257e-03, -3.7265e-03]]]])),\n", 2903 | " ('6.bias', tensor(1.00000e-02 *\n", 2904 | " [-0.6255, 4.9319, -3.6779, -2.9463, -2.5801, 0.8595, -1.0889,\n", 2905 | " 4.8599, 0.5028, 1.3037, -0.7622, 3.5637, 1.6952, -2.5448,\n", 2906 | " -0.1713, 1.7510, -3.0964, -0.9239, 2.0107, -1.5601, -4.1642,\n", 2907 | " -1.7541, -0.9685, 2.0369, -0.7735, 4.4888, 1.0942, -0.2250,\n", 2908 | " 1.5792, 1.1349, -1.6582, -1.1896, -1.3102, 4.1395, -0.1528,\n", 2909 | " -4.3832, -3.0477, 2.4790, -0.6793, -0.5944, -2.2985, 0.9787,\n", 2910 | " -1.1641, 0.8887, -2.2574, -0.9951, -1.2451, 2.0503, -7.5850,\n", 2911 | " -0.5772, -1.6409, 0.9793, -1.5066, 4.9639, -2.9812, -1.3580,\n", 2912 | " 0.0373, 1.6401, -0.9795, -2.6780, -0.8956, 3.6520, -1.1645,\n", 2913 | " 2.0801])),\n", 2914 | " ('10.weight',\n", 2915 | " tensor([[-7.5301e-02, -1.7809e-02, -3.9599e-02, ..., 7.6142e-02,\n", 2916 | " -1.0008e-01, -7.2872e-02],\n", 2917 | " [ 5.1972e-02, -1.6626e-01, 8.4465e-02, ..., -7.6805e-02,\n", 2918 | " -9.8366e-02, 6.6758e-02],\n", 2919 | " [-3.3718e-02, 1.3370e-01, -5.7192e-02, ..., -9.0067e-02,\n", 2920 | " 7.1618e-02, -2.5465e-02],\n", 2921 | " ...,\n", 2922 | " [ 6.2247e-02, 6.4090e-02, 8.5833e-02, ..., -1.2668e-02,\n", 2923 | " 1.3935e-02, -5.4030e-02],\n", 2924 | " [-2.3584e-01, 1.3796e-01, 8.0857e-02, ..., 1.2481e-01,\n", 2925 | " -4.7108e-02, -1.1746e-01],\n", 2926 | " [ 1.1030e-01, -4.2672e-02, 2.4807e-02, ..., 3.9567e-02,\n", 2927 | " -5.2033e-02, 5.8760e-02]])),\n", 2928 | " ('10.bias',\n", 2929 | " tensor([-0.0170, -0.0177, 0.0905, 0.0724, 0.0496, 0.0758, 0.0863,\n", 2930 | " -0.0121, -0.1114, -0.1325, 0.0691, 0.0418, 0.0570, 0.0775,\n", 2931 | " 0.1363, -0.0270, 0.0533, -0.0383, -0.0989, 0.0183, 0.0397,\n", 2932 | " 0.1140, 0.0707, 0.0802, 0.0219, -0.0462, -0.0971, -0.0339,\n", 2933 | " 0.0596, 0.1036, -0.0411, -0.0024, 0.0568, 0.0786, -0.0063,\n", 2934 | " -0.1060, 0.0394, -0.1205, 0.0189, -0.0318, 0.0170, -0.1569,\n", 2935 | " 0.1222, -0.0652, -0.0800, -0.1372, -0.0851, -0.1614, -0.0519,\n", 2936 | " -0.1048, 0.1035, -0.0287, -0.0404, -0.1073, 0.0188, 0.1039,\n", 2937 | " -0.0469, 0.0518, 0.0717, 0.0868, 0.0811, 0.0636, 0.0492,\n", 2938 | " -0.0230, -0.0766, -0.0199, 0.0445, -0.0969, 0.0910, -0.0910,\n", 2939 | " 0.0038, -0.0456, 0.0315, -0.0613, -0.0293, -0.0596, 0.0228,\n", 2940 | " -0.0958, 0.1407, -0.0356, -0.0213, -0.0660, 0.0504, 0.0503,\n", 2941 | " -0.0463, 0.0843, 0.0917, 0.0356, -0.0272, -0.1018, -0.0236,\n", 2942 | " -0.1267, -0.0688, 0.0875, 0.0440, -0.0899, 0.0881, 0.0511,\n", 2943 | " 0.1372, -0.0741])),\n", 2944 | " ('12.weight',\n", 2945 | " tensor([[-0.0017, -0.0766, 0.0924, ..., 0.0853, -0.0931, -0.1333],\n", 2946 | " [-0.1053, 0.0104, 0.0136, ..., -0.0441, -0.0201, 0.0947],\n", 2947 | " [ 0.0697, 0.0490, -0.0532, ..., -0.0319, 0.1249, -0.0447],\n", 2948 | " ...,\n", 2949 | " [-0.0374, -0.0541, 0.0537, ..., 0.0963, 0.0487, 0.0269],\n", 2950 | " [ 0.0725, 0.0446, -0.0674, ..., -0.0942, 0.0055, -0.0619],\n", 2951 | " [-0.0330, 0.0317, -0.0500, ..., -0.0020, -0.0695, -0.1809]])),\n", 2952 | " ('12.bias',\n", 2953 | " tensor([-0.0489, 0.1297, -0.0611, 0.0806, -0.0072, -0.0580, -0.0646,\n", 2954 | " 0.0661, -0.0694, -0.0294, -0.0115, -0.0775, 0.0346, -0.0762,\n", 2955 | " -0.1076, 0.0488, -0.1113, -0.0511, -0.0543, 0.0004, -0.0727,\n", 2956 | " -0.0120, -0.1211, 0.1344, -0.0039, 0.0428, 0.0673, 0.1046,\n", 2957 | " 0.0122, -0.0327, -0.0499, 0.0923, -0.1074, -0.0446, 0.0439,\n", 2958 | " -0.1016, -0.0942, -0.1311, -0.0221, 0.1263, 0.0584, -0.0257,\n", 2959 | " -0.0426, 0.0923, 0.0596, 0.0151, 0.0068, -0.0514, -0.0368,\n", 2960 | " -0.0243, 0.0778, 0.0376, 0.0819, -0.0541, 0.0811, 0.0558,\n", 2961 | " -0.0639, 0.0004, 0.0526, -0.0735, 0.0347, -0.0209, -0.0446,\n", 2962 | " -0.1415, -0.0052]))])" 2963 | ] 2964 | }, 2965 | "execution_count": 52, 2966 | "metadata": {}, 2967 | "output_type": "execute_result" 2968 | } 2969 | ], 2970 | "source": [ 2971 | "model.state_dict()" 2972 | ] 2973 | }, 2974 | { 2975 | "cell_type": "code", 2976 | "execution_count": null, 2977 | "metadata": {}, 2978 | "outputs": [], 2979 | "source": [] 2980 | }, 2981 | { 2982 | "cell_type": "code", 2983 | "execution_count": null, 2984 | "metadata": {}, 2985 | "outputs": [], 2986 | "source": [] 2987 | } 2988 | ], 2989 | "metadata": { 2990 | "kernelspec": { 2991 | "display_name": "Python 3", 2992 | "language": "python", 2993 | "name": "python3" 2994 | }, 2995 | "language_info": { 2996 | "codemirror_mode": { 2997 | "name": "ipython", 2998 | "version": 3 2999 | }, 3000 | "file_extension": ".py", 3001 | "mimetype": "text/x-python", 3002 | "name": "python", 3003 | "nbconvert_exporter": "python", 3004 | "pygments_lexer": "ipython3", 3005 | "version": "3.6.5" 3006 | } 3007 | }, 3008 | "nbformat": 4, 3009 | "nbformat_minor": 2 3010 | } 3011 | -------------------------------------------------------------------------------- /fruit-classifier.py: -------------------------------------------------------------------------------- 1 | 2 | # coding: utf-8 3 | 4 | # ## Aim: To classifiy fruits images. 5 | # ### Dataset: Fruits360 6 | # 7 | # - Then to build an iOS app to use the machine learning model. 8 | 9 | # In[85]: 10 | 11 | 12 | # importing 13 | import random 14 | import pandas as pd 15 | import numpy as np 16 | import torchvision 17 | import torch 18 | from torch import nn 19 | from torch.autograd import Variable 20 | from sklearn.model_selection import train_test_split 21 | import torchvision.transforms as T 22 | from torchvision.datasets import ImageFolder 23 | import matplotlib.pyplot as plt 24 | import cv2 25 | from torch.utils.data import DataLoader 26 | from sklearn.metrics import accuracy_score 27 | 28 | 29 | # In[99]: 30 | 31 | 32 | # Loading data 33 | transforms_train = T.Compose([T.ToTensor(),T.Normalize([0.5,0.5,0.5],[0.5,0.5,0.5])]) 34 | image_data_train = ImageFolder("./fruits-360/Training",transform=transforms_train) 35 | image_data_test = ImageFolder("./fruits-360/Validation",transform=transforms_train) 36 | 37 | # Shuffling data and then collecting all the labels. 38 | random.shuffle(image_data_train.samples) 39 | random.shuffle(image_data_test.samples) 40 | 41 | 42 | # In[100]: 43 | 44 | 45 | # Total classes 46 | classes_idx = image_data_train.class_to_idx 47 | classes = len(image_data_train.classes) 48 | len_train_data = len(image_data_train) 49 | len_test_data = len(image_data_test) 50 | 51 | 52 | def get_labels(): 53 | labels_train = [] # All the labels 54 | labels_test = [] 55 | for i in image_data_train.imgs: 56 | labels_train.append(i[1]) 57 | 58 | for j in image_data_test.imgs: 59 | labels_test.append(j[1]) 60 | 61 | return (labels_train, labels_test) 62 | 63 | labels_train, labels_test = get_labels() 64 | 65 | 66 | # In[101]: 67 | 68 | 69 | train_loader = DataLoader(dataset=image_data_train,batch_size=100) 70 | test_loader = DataLoader(dataset=image_data_test,batch_size=100) 71 | 72 | 73 | # In[102]: 74 | 75 | 76 | print (iter(train_loader).next()[0].shape) 77 | record = iter(train_loader).next()[0] 78 | 79 | 80 | # - We can see that the image is (batch_size, channel, image_height, image_width) 81 | 82 | # In[103]: 83 | 84 | 85 | # Flatten Layer 86 | class Flatten(nn.Module): 87 | def forward(self, x): 88 | return x.view(x.size(0), -1) 89 | # Main Model 90 | class Model: 91 | def build_model(self): 92 | model = nn.Sequential(nn.Conv2d(3, 64, kernel_size=5, stride=1), nn.ReLU(),nn.MaxPool2d(2), nn.Conv2d(64, 64, kernel_size=7, stride=1), 93 | nn.ReLU(), nn.MaxPool2d(3), nn.Conv2d(64, 64, kernel_size=7), nn.ReLU(), nn.MaxPool2d(5), Flatten(), nn.Linear(64, 100), nn.ReLU(), nn.Linear(100, 65)) 94 | return model 95 | 96 | 97 | # In[104]: 98 | 99 | 100 | # Building 101 | model = Model() 102 | model = model.build_model() 103 | 104 | 105 | # In[109]: 106 | 107 | 108 | print (model) 109 | print (labels_train[0]) 110 | print (image_data_train.samples[0][1]) 111 | 112 | 113 | # In[107]: 114 | 115 | 116 | optimizer = torch.optim.Adagrad(model.parameters(), lr=0.01) 117 | criterion = nn.CrossEntropyLoss() 118 | 119 | 120 | # In[124]: 121 | 122 | 123 | # Train the model 124 | def train(epochs): 125 | model.train() 126 | losses = [] 127 | for epoch in range(1, epochs+1): 128 | print ("epoch #", epoch) 129 | current_loss = 0.0 130 | for feature, label in train_loader: 131 | x = Variable(feature, requires_grad=False).float() 132 | y = Variable(label, requires_grad=False).long() 133 | optimizer.zero_grad() # Zeroing the grads 134 | y_pred = model(x) # Calculating prediction 135 | correct = y_pred.max(1)[1].eq(y).sum() 136 | print ("no. of correct items classified: ", correct.item()) 137 | loss = criterion(y_pred, y) # Calculating loss (log_softmax already included) 138 | print ("loss: ", loss.item()) 139 | current_loss+=loss.item() 140 | loss.backward() # Gradient cal 141 | optimizer.step() # Changing weights 142 | losses.append(current_loss) # Only storing loss after every epoch 143 | return losses 144 | # Test the model 145 | def test(): 146 | model.eval() 147 | with torch.no_grad(): 148 | for feature, label in test_loader: 149 | pred = model(feature) 150 | print ("acc: ", accuracy_score(labels_test, pred.max(1)[1].data.numpy()) * 100) 151 | loss = criterion(pred, label) 152 | print ("loss: ", loss.item()) 153 | 154 | 155 | # In[125]: 156 | 157 | 158 | # Training 159 | train(100) 160 | 161 | 162 | # In[130]: 163 | 164 | 165 | list(model.named_parameters()) 166 | 167 | 168 | # In[132]: 169 | 170 | 171 | len(labels_train) 172 | 173 | -------------------------------------------------------------------------------- /model-state-dict.pth: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/model-state-dict.pth -------------------------------------------------------------------------------- /optimizer-state-dict.pth: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/optimizer-state-dict.pth --------------------------------------------------------------------------------