├── LICENSE
├── README.md
├── complete_model.pth
├── fruit-classifier.ipynb
├── fruit-classifier.py
├── fruit_classifier_gpu.ipynb
├── model-state-dict.pth
└── optimizer-state-dict.pth
/LICENSE:
--------------------------------------------------------------------------------
1 | Apache License
2 | Version 2.0, January 2004
3 | http://www.apache.org/licenses/
4 |
5 | TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6 |
7 | 1. Definitions.
8 |
9 | "License" shall mean the terms and conditions for use, reproduction,
10 | and distribution as defined by Sections 1 through 9 of this document.
11 |
12 | "Licensor" shall mean the copyright owner or entity authorized by
13 | the copyright owner that is granting the License.
14 |
15 | "Legal Entity" shall mean the union of the acting entity and all
16 | other entities that control, are controlled by, or are under common
17 | control with that entity. For the purposes of this definition,
18 | "control" means (i) the power, direct or indirect, to cause the
19 | direction or management of such entity, whether by contract or
20 | otherwise, or (ii) ownership of fifty percent (50%) or more of the
21 | outstanding shares, or (iii) beneficial ownership of such entity.
22 |
23 | "You" (or "Your") shall mean an individual or Legal Entity
24 | exercising permissions granted by this License.
25 |
26 | "Source" form shall mean the preferred form for making modifications,
27 | including but not limited to software source code, documentation
28 | source, and configuration files.
29 |
30 | "Object" form shall mean any form resulting from mechanical
31 | transformation or translation of a Source form, including but
32 | not limited to compiled object code, generated documentation,
33 | and conversions to other media types.
34 |
35 | "Work" shall mean the work of authorship, whether in Source or
36 | Object form, made available under the License, as indicated by a
37 | copyright notice that is included in or attached to the work
38 | (an example is provided in the Appendix below).
39 |
40 | "Derivative Works" shall mean any work, whether in Source or Object
41 | form, that is based on (or derived from) the Work and for which the
42 | editorial revisions, annotations, elaborations, or other modifications
43 | represent, as a whole, an original work of authorship. For the purposes
44 | of this License, Derivative Works shall not include works that remain
45 | separable from, or merely link (or bind by name) to the interfaces of,
46 | the Work and Derivative Works thereof.
47 |
48 | "Contribution" shall mean any work of authorship, including
49 | the original version of the Work and any modifications or additions
50 | to that Work or Derivative Works thereof, that is intentionally
51 | submitted to Licensor for inclusion in the Work by the copyright owner
52 | or by an individual or Legal Entity authorized to submit on behalf of
53 | the copyright owner. For the purposes of this definition, "submitted"
54 | means any form of electronic, verbal, or written communication sent
55 | to the Licensor or its representatives, including but not limited to
56 | communication on electronic mailing lists, source code control systems,
57 | and issue tracking systems that are managed by, or on behalf of, the
58 | Licensor for the purpose of discussing and improving the Work, but
59 | excluding communication that is conspicuously marked or otherwise
60 | designated in writing by the copyright owner as "Not a Contribution."
61 |
62 | "Contributor" shall mean Licensor and any individual or Legal Entity
63 | on behalf of whom a Contribution has been received by Licensor and
64 | subsequently incorporated within the Work.
65 |
66 | 2. Grant of Copyright License. Subject to the terms and conditions of
67 | this License, each Contributor hereby grants to You a perpetual,
68 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69 | copyright license to reproduce, prepare Derivative Works of,
70 | publicly display, publicly perform, sublicense, and distribute the
71 | Work and such Derivative Works in Source or Object form.
72 |
73 | 3. Grant of Patent License. Subject to the terms and conditions of
74 | this License, each Contributor hereby grants to You a perpetual,
75 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76 | (except as stated in this section) patent license to make, have made,
77 | use, offer to sell, sell, import, and otherwise transfer the Work,
78 | where such license applies only to those patent claims licensable
79 | by such Contributor that are necessarily infringed by their
80 | Contribution(s) alone or by combination of their Contribution(s)
81 | with the Work to which such Contribution(s) was submitted. If You
82 | institute patent litigation against any entity (including a
83 | cross-claim or counterclaim in a lawsuit) alleging that the Work
84 | or a Contribution incorporated within the Work constitutes direct
85 | or contributory patent infringement, then any patent licenses
86 | granted to You under this License for that Work shall terminate
87 | as of the date such litigation is filed.
88 |
89 | 4. Redistribution. You may reproduce and distribute copies of the
90 | Work or Derivative Works thereof in any medium, with or without
91 | modifications, and in Source or Object form, provided that You
92 | meet the following conditions:
93 |
94 | (a) You must give any other recipients of the Work or
95 | Derivative Works a copy of this License; and
96 |
97 | (b) You must cause any modified files to carry prominent notices
98 | stating that You changed the files; and
99 |
100 | (c) You must retain, in the Source form of any Derivative Works
101 | that You distribute, all copyright, patent, trademark, and
102 | attribution notices from the Source form of the Work,
103 | excluding those notices that do not pertain to any part of
104 | the Derivative Works; and
105 |
106 | (d) If the Work includes a "NOTICE" text file as part of its
107 | distribution, then any Derivative Works that You distribute must
108 | include a readable copy of the attribution notices contained
109 | within such NOTICE file, excluding those notices that do not
110 | pertain to any part of the Derivative Works, in at least one
111 | of the following places: within a NOTICE text file distributed
112 | as part of the Derivative Works; within the Source form or
113 | documentation, if provided along with the Derivative Works; or,
114 | within a display generated by the Derivative Works, if and
115 | wherever such third-party notices normally appear. The contents
116 | of the NOTICE file are for informational purposes only and
117 | do not modify the License. You may add Your own attribution
118 | notices within Derivative Works that You distribute, alongside
119 | or as an addendum to the NOTICE text from the Work, provided
120 | that such additional attribution notices cannot be construed
121 | as modifying the License.
122 |
123 | You may add Your own copyright statement to Your modifications and
124 | may provide additional or different license terms and conditions
125 | for use, reproduction, or distribution of Your modifications, or
126 | for any such Derivative Works as a whole, provided Your use,
127 | reproduction, and distribution of the Work otherwise complies with
128 | the conditions stated in this License.
129 |
130 | 5. Submission of Contributions. Unless You explicitly state otherwise,
131 | any Contribution intentionally submitted for inclusion in the Work
132 | by You to the Licensor shall be under the terms and conditions of
133 | this License, without any additional terms or conditions.
134 | Notwithstanding the above, nothing herein shall supersede or modify
135 | the terms of any separate license agreement you may have executed
136 | with Licensor regarding such Contributions.
137 |
138 | 6. Trademarks. This License does not grant permission to use the trade
139 | names, trademarks, service marks, or product names of the Licensor,
140 | except as required for reasonable and customary use in describing the
141 | origin of the Work and reproducing the content of the NOTICE file.
142 |
143 | 7. Disclaimer of Warranty. Unless required by applicable law or
144 | agreed to in writing, Licensor provides the Work (and each
145 | Contributor provides its Contributions) on an "AS IS" BASIS,
146 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147 | implied, including, without limitation, any warranties or conditions
148 | of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149 | PARTICULAR PURPOSE. You are solely responsible for determining the
150 | appropriateness of using or redistributing the Work and assume any
151 | risks associated with Your exercise of permissions under this License.
152 |
153 | 8. Limitation of Liability. In no event and under no legal theory,
154 | whether in tort (including negligence), contract, or otherwise,
155 | unless required by applicable law (such as deliberate and grossly
156 | negligent acts) or agreed to in writing, shall any Contributor be
157 | liable to You for damages, including any direct, indirect, special,
158 | incidental, or consequential damages of any character arising as a
159 | result of this License or out of the use or inability to use the
160 | Work (including but not limited to damages for loss of goodwill,
161 | work stoppage, computer failure or malfunction, or any and all
162 | other commercial damages or losses), even if such Contributor
163 | has been advised of the possibility of such damages.
164 |
165 | 9. Accepting Warranty or Additional Liability. While redistributing
166 | the Work or Derivative Works thereof, You may choose to offer,
167 | and charge a fee for, acceptance of support, warranty, indemnity,
168 | or other liability obligations and/or rights consistent with this
169 | License. However, in accepting such obligations, You may act only
170 | on Your own behalf and on Your sole responsibility, not on behalf
171 | of any other Contributor, and only if You agree to indemnify,
172 | defend, and hold each Contributor harmless for any liability
173 | incurred by, or claims asserted against, such Contributor by reason
174 | of your accepting any such warranty or additional liability.
175 |
176 | END OF TERMS AND CONDITIONS
177 |
178 | APPENDIX: How to apply the Apache License to your work.
179 |
180 | To apply the Apache License to your work, attach the following
181 | boilerplate notice, with the fields enclosed by brackets "[]"
182 | replaced with your own identifying information. (Don't include
183 | the brackets!) The text should be enclosed in the appropriate
184 | comment syntax for the file format. We also recommend that a
185 | file or class name and description of purpose be included on the
186 | same "printed page" as the copyright notice for easier
187 | identification within third-party archives.
188 |
189 | Copyright [yyyy] [name of copyright owner]
190 |
191 | Licensed under the Apache License, Version 2.0 (the "License");
192 | you may not use this file except in compliance with the License.
193 | You may obtain a copy of the License at
194 |
195 | http://www.apache.org/licenses/LICENSE-2.0
196 |
197 | Unless required by applicable law or agreed to in writing, software
198 | distributed under the License is distributed on an "AS IS" BASIS,
199 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200 | See the License for the specific language governing permissions and
201 | limitations under the License.
202 |
--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
1 | # Fruit-Classifier-PyTorch
2 | A Machine Learning model that can detect fruit images.
3 |
4 | # Requirements
5 | pytorch==0.4.0
6 | torchvision
7 |
8 | # Dataset
9 | https://github.com/Horea94/Fruit-Images-Dataset
10 |
11 | # Contact
12 | Email: aaditkapoor2000@gmail.com
13 |
14 | # LICENSE
15 | Copyright 2020 Aadit Kapoor
16 |
17 | Licensed under the Apache License, Version 2.0 (the "License");
18 | you may not use this file except in compliance with the License.
19 | You may obtain a copy of the License at
20 |
21 | http://www.apache.org/licenses/LICENSE-2.0
22 |
23 | Unless required by applicable law or agreed to in writing, software
24 | distributed under the License is distributed on an "AS IS" BASIS,
25 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
26 | See the License for the specific language governing permissions and
27 | limitations under the License.
28 |
--------------------------------------------------------------------------------
/complete_model.pth:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/complete_model.pth
--------------------------------------------------------------------------------
/fruit-classifier.ipynb:
--------------------------------------------------------------------------------
1 | {
2 | "cells": [
3 | {
4 | "cell_type": "markdown",
5 | "metadata": {},
6 | "source": [
7 | "## Aim: To classifiy fruits images.\n",
8 | "### Dataset: Fruits360\n",
9 | "\n",
10 | "- Then to build an iOS app to use the machine learning model."
11 | ]
12 | },
13 | {
14 | "cell_type": "code",
15 | "execution_count": 24,
16 | "metadata": {},
17 | "outputs": [],
18 | "source": [
19 | "# importing\n",
20 | "import random\n",
21 | "import pandas as pd\n",
22 | "import numpy as np\n",
23 | "import torchvision\n",
24 | "import torch\n",
25 | "from torch import nn\n",
26 | "from torch.autograd import Variable\n",
27 | "from sklearn.model_selection import train_test_split\n",
28 | "import torchvision.transforms as T\n",
29 | "from torchvision.datasets import ImageFolder\n",
30 | "import matplotlib.pyplot as plt\n",
31 | "import cv2\n",
32 | "from torch.utils.data import DataLoader\n",
33 | "from sklearn.metrics import accuracy_score"
34 | ]
35 | },
36 | {
37 | "cell_type": "code",
38 | "execution_count": 25,
39 | "metadata": {},
40 | "outputs": [],
41 | "source": [
42 | "# Loading data\n",
43 | "transforms_train = T.Compose([T.ToTensor(),T.Normalize([0.5,0.5,0.5],[0.5,0.5,0.5])])\n",
44 | "image_data_train = ImageFolder(\"./fruits-360/Training\",transform=transforms_train)\n",
45 | "image_data_test = ImageFolder(\"./fruits-360/Validation\",transform=transforms_train)\n",
46 | "\n",
47 | "# Shuffling data and then collecting all the labels.\n",
48 | "random.shuffle(image_data_train.samples)\n",
49 | "random.shuffle(image_data_test.samples)"
50 | ]
51 | },
52 | {
53 | "cell_type": "code",
54 | "execution_count": 26,
55 | "metadata": {},
56 | "outputs": [],
57 | "source": [
58 | "# Total classes\n",
59 | "classes_idx = image_data_train.class_to_idx\n",
60 | "classes = len(image_data_train.classes)\n",
61 | "len_train_data = len(image_data_train)\n",
62 | "len_test_data = len(image_data_test)\n",
63 | "\n",
64 | "\n",
65 | "def get_labels():\n",
66 | " labels_train = [] # All the labels\n",
67 | " labels_test = []\n",
68 | " for i in image_data_train.imgs:\n",
69 | " labels_train.append(i[1])\n",
70 | " \n",
71 | " for j in image_data_test.imgs:\n",
72 | " labels_test.append(j[1])\n",
73 | " \n",
74 | " return (labels_train, labels_test)\n",
75 | "\n",
76 | "labels_train, labels_test = get_labels()\n"
77 | ]
78 | },
79 | {
80 | "cell_type": "code",
81 | "execution_count": 27,
82 | "metadata": {},
83 | "outputs": [],
84 | "source": [
85 | "train_loader = DataLoader(dataset=image_data_train,batch_size=100)\n",
86 | "test_loader = DataLoader(dataset=image_data_test,batch_size=100)"
87 | ]
88 | },
89 | {
90 | "cell_type": "code",
91 | "execution_count": 37,
92 | "metadata": {},
93 | "outputs": [
94 | {
95 | "name": "stdout",
96 | "output_type": "stream",
97 | "text": [
98 | "torch.Size([100, 3, 100, 100])\n"
99 | ]
100 | },
101 | {
102 | "data": {
103 | "text/plain": [
104 | "torch.Size([3, 100, 100])"
105 | ]
106 | },
107 | "execution_count": 37,
108 | "metadata": {},
109 | "output_type": "execute_result"
110 | }
111 | ],
112 | "source": [
113 | "print (iter(train_loader).next()[0].shape)\n",
114 | "record = iter(train_loader).next()[0]"
115 | ]
116 | },
117 | {
118 | "cell_type": "markdown",
119 | "metadata": {},
120 | "source": [
121 | "- We can see that the image is (batch_size, channel, image_height, image_width)"
122 | ]
123 | },
124 | {
125 | "cell_type": "code",
126 | "execution_count": 3,
127 | "metadata": {},
128 | "outputs": [],
129 | "source": [
130 | "# Flatten Layer\n",
131 | "class Flatten(nn.Module):\n",
132 | " def forward(self, x):\n",
133 | " return x.view(x.size(0), -1)\n",
134 | "# Main Model\n",
135 | "class Model:\n",
136 | " def build_model(self):\n",
137 | " model = nn.Sequential(nn.Conv2d(3, 64, kernel_size=5, stride=1), nn.ReLU(),nn.MaxPool2d(2), nn.Conv2d(64, 64, kernel_size=7, stride=1),\n",
138 | " nn.ReLU(), nn.MaxPool2d(3), nn.Conv2d(64, 64, kernel_size=7), nn.ReLU(), nn.MaxPool2d(5), Flatten(), nn.Linear(64, 100), nn.ReLU(), nn.Linear(100, 65))\n",
139 | " return model"
140 | ]
141 | },
142 | {
143 | "cell_type": "code",
144 | "execution_count": 4,
145 | "metadata": {},
146 | "outputs": [
147 | {
148 | "data": {
149 | "text/plain": [
150 | "Sequential(\n",
151 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n",
152 | " (1): ReLU()\n",
153 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
154 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
155 | " (4): ReLU()\n",
156 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n",
157 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
158 | " (7): ReLU()\n",
159 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n",
160 | " (9): Flatten()\n",
161 | " (10): Linear(in_features=64, out_features=100, bias=True)\n",
162 | " (11): ReLU()\n",
163 | " (12): Linear(in_features=100, out_features=65, bias=True)\n",
164 | ")"
165 | ]
166 | },
167 | "execution_count": 4,
168 | "metadata": {},
169 | "output_type": "execute_result"
170 | }
171 | ],
172 | "source": [
173 | "# Building \n",
174 | "model = Model()\n",
175 | "model = model.build_model()\n",
176 | "\n",
177 | "# Checking for GPU\n",
178 | "device = torch.device(\"cuda:0\" if torch.cuda.is_available() else \"cpu\")\n",
179 | "model.to(device)"
180 | ]
181 | },
182 | {
183 | "cell_type": "code",
184 | "execution_count": 109,
185 | "metadata": {},
186 | "outputs": [
187 | {
188 | "name": "stdout",
189 | "output_type": "stream",
190 | "text": [
191 | "Sequential(\n",
192 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n",
193 | " (1): ReLU()\n",
194 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
195 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
196 | " (4): ReLU()\n",
197 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n",
198 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
199 | " (7): ReLU()\n",
200 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n",
201 | " (9): Flatten()\n",
202 | " (10): Linear(in_features=64, out_features=100, bias=True)\n",
203 | " (11): ReLU()\n",
204 | " (12): Linear(in_features=100, out_features=65, bias=True)\n",
205 | ")\n",
206 | "62\n",
207 | "62\n"
208 | ]
209 | }
210 | ],
211 | "source": [
212 | "print (model)\n",
213 | "print (labels_train[0])\n",
214 | "print (image_data_train.samples[0][1])"
215 | ]
216 | },
217 | {
218 | "cell_type": "code",
219 | "execution_count": 151,
220 | "metadata": {},
221 | "outputs": [],
222 | "source": [
223 | "optimizer = torch.optim.Adagrad(model.parameters(), lr=0.01)\n",
224 | "criterion = nn.CrossEntropyLoss()"
225 | ]
226 | },
227 | {
228 | "cell_type": "code",
229 | "execution_count": 152,
230 | "metadata": {},
231 | "outputs": [],
232 | "source": [
233 | "# Train the model\n",
234 | "def train(epochs):\n",
235 | " model.train()\n",
236 | " losses = []\n",
237 | " for epoch in range(1, epochs+1):\n",
238 | " print (\"epoch #\", epoch)\n",
239 | " current_loss = 0.0\n",
240 | " for feature, label in train_loader:\n",
241 | " x = Variable(feature, requires_grad=False).float().to(device)\n",
242 | " y = Variable(label, requires_grad=False).long().to(device)\n",
243 | " optimizer.zero_grad() # Zeroing the grads\n",
244 | " y_pred = model(x) # Calculating prediction\n",
245 | " correct = y_pred.max(1)[1].eq(y).sum()\n",
246 | " print (\"no. of correct items classified: \", correct.item())\n",
247 | " loss = criterion(y_pred, y) # Calculating loss (log_softmax already included)\n",
248 | " print (\"loss: \", loss.item())\n",
249 | " current_loss+=loss.item()\n",
250 | " loss.backward() # Gradient cal\n",
251 | " optimizer.step() # Changing weights\n",
252 | " losses.append(current_loss) # Only storing loss after every epoch\n",
253 | " return losses\n",
254 | "# Test the model\n",
255 | "def test():\n",
256 | " model.eval()\n",
257 | " with torch.no_grad():\n",
258 | " for feature, label in test_loader:\n",
259 | " pred = model(feature)\n",
260 | " print (\"acc: \", accuracy_score(labels_test, pred.max(1)[1].data.numpy()) * 100)\n",
261 | " loss = criterion(pred, label)\n",
262 | " print (\"loss: \", loss.item())"
263 | ]
264 | },
265 | {
266 | "cell_type": "code",
267 | "execution_count": 6,
268 | "metadata": {},
269 | "outputs": [
270 | {
271 | "data": {
272 | "text/plain": [
273 | "Sequential(\n",
274 | " (0): Conv2d(3, 64, kernel_size=(5, 5), stride=(1, 1))\n",
275 | " (1): ReLU()\n",
276 | " (2): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)\n",
277 | " (3): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
278 | " (4): ReLU()\n",
279 | " (5): MaxPool2d(kernel_size=3, stride=3, padding=0, dilation=1, ceil_mode=False)\n",
280 | " (6): Conv2d(64, 64, kernel_size=(7, 7), stride=(1, 1))\n",
281 | " (7): ReLU()\n",
282 | " (8): MaxPool2d(kernel_size=5, stride=5, padding=0, dilation=1, ceil_mode=False)\n",
283 | " (9): Flatten()\n",
284 | " (10): Linear(in_features=64, out_features=100, bias=True)\n",
285 | " (11): ReLU()\n",
286 | " (12): Linear(in_features=100, out_features=65, bias=True)\n",
287 | ")"
288 | ]
289 | },
290 | "execution_count": 6,
291 | "metadata": {},
292 | "output_type": "execute_result"
293 | }
294 | ],
295 | "source": [
296 | "model"
297 | ]
298 | },
299 | {
300 | "cell_type": "code",
301 | "execution_count": 15,
302 | "metadata": {},
303 | "outputs": [],
304 | "source": [
305 | "loaded_state_dict = torch.load(\"model-state-dict.pth\",map_location=\"cpu\")"
306 | ]
307 | },
308 | {
309 | "cell_type": "code",
310 | "execution_count": 17,
311 | "metadata": {},
312 | "outputs": [],
313 | "source": [
314 | "model.load_state_dict(loaded_state_dict)"
315 | ]
316 | },
317 | {
318 | "cell_type": "code",
319 | "execution_count": 18,
320 | "metadata": {},
321 | "outputs": [
322 | {
323 | "name": "stdout",
324 | "output_type": "stream",
325 | "text": [
326 | "('0.weight', Parameter containing:\n",
327 | "tensor([[[[-0.0016, 0.0048, -0.0146, -0.1456, -0.1541],\n",
328 | " [-0.0630, 0.0308, 0.0080, -0.1073, -0.1134],\n",
329 | " [-0.1058, 0.0090, -0.1061, 0.0478, 0.0654],\n",
330 | " [ 0.0175, 0.0800, 0.0240, 0.0162, 0.0625],\n",
331 | " [ 0.0913, -0.0833, -0.0338, 0.0798, -0.0163]],\n",
332 | "\n",
333 | " [[ 0.0605, 0.0374, 0.0662, -0.1401, -0.0259],\n",
334 | " [ 0.0589, -0.1049, 0.0120, -0.0084, -0.1260],\n",
335 | " [-0.0768, -0.1128, -0.0596, 0.0139, 0.0571],\n",
336 | " [ 0.0931, -0.0645, -0.0827, 0.0600, 0.0205],\n",
337 | " [ 0.1170, 0.1265, -0.0124, -0.0439, 0.1113]],\n",
338 | "\n",
339 | " [[-0.0642, -0.0756, 0.0292, 0.0497, -0.1144],\n",
340 | " [ 0.0153, -0.0897, -0.0337, 0.0108, -0.1262],\n",
341 | " [ 0.0991, -0.0447, -0.0442, -0.0280, 0.0873],\n",
342 | " [-0.0269, 0.0825, -0.1120, -0.0491, -0.0136],\n",
343 | " [ 0.0866, -0.0420, 0.1009, 0.1126, 0.0893]]],\n",
344 | "\n",
345 | "\n",
346 | " [[[-0.0209, 0.0852, 0.0590, -0.0332, -0.0586],\n",
347 | " [ 0.0518, 0.1475, 0.0091, 0.0288, 0.0954],\n",
348 | " [ 0.0341, 0.0415, -0.0412, 0.0043, 0.1360],\n",
349 | " [ 0.1538, -0.0249, 0.0003, 0.1572, 0.0010],\n",
350 | " [ 0.0510, 0.0192, 0.1027, 0.1332, 0.0991]],\n",
351 | "\n",
352 | " [[ 0.0177, -0.0105, -0.0383, 0.0657, 0.0859],\n",
353 | " [-0.0725, -0.1320, -0.0927, -0.1090, -0.0635],\n",
354 | " [ 0.0969, -0.0837, -0.1208, 0.0329, -0.0886],\n",
355 | " [-0.0370, 0.0143, -0.0048, -0.0736, -0.0601],\n",
356 | " [-0.0365, -0.0917, -0.0431, -0.0236, -0.0755]],\n",
357 | "\n",
358 | " [[ 0.0102, -0.0525, 0.0135, -0.0179, -0.0234],\n",
359 | " [ 0.0643, -0.0145, 0.1480, 0.0188, 0.0504],\n",
360 | " [ 0.0169, -0.0020, 0.0158, -0.0133, -0.0076],\n",
361 | " [ 0.1242, -0.0200, 0.0480, 0.1099, 0.0300],\n",
362 | " [ 0.0524, -0.0310, 0.0239, 0.0870, 0.1372]]],\n",
363 | "\n",
364 | "\n",
365 | " [[[-0.0898, -0.0185, -0.0380, -0.0599, -0.0783],\n",
366 | " [ 0.0435, -0.0673, -0.0520, -0.0430, 0.0795],\n",
367 | " [-0.0218, -0.0063, 0.0079, 0.0160, 0.0481],\n",
368 | " [ 0.0058, 0.1550, 0.0125, 0.0755, 0.0940],\n",
369 | " [ 0.1355, 0.0955, 0.1428, 0.1401, 0.1735]],\n",
370 | "\n",
371 | " [[-0.1866, -0.1629, 0.0517, -0.0109, -0.1201],\n",
372 | " [-0.1588, -0.1707, -0.1438, 0.0682, 0.0742],\n",
373 | " [-0.0229, -0.1558, 0.0158, -0.1283, 0.0976],\n",
374 | " [-0.1197, -0.0310, -0.0727, 0.0966, -0.0852],\n",
375 | " [ 0.0389, 0.0312, 0.0191, 0.0596, 0.0384]],\n",
376 | "\n",
377 | " [[ 0.0068, 0.0797, -0.0105, 0.0056, 0.1451],\n",
378 | " [ 0.0565, -0.0742, -0.0368, 0.0914, 0.0443],\n",
379 | " [-0.0046, 0.1062, 0.0461, 0.1649, 0.1579],\n",
380 | " [ 0.1141, -0.0795, 0.1050, -0.0006, 0.0684],\n",
381 | " [-0.0832, -0.0160, 0.0237, 0.1942, 0.1150]]],\n",
382 | "\n",
383 | "\n",
384 | " ...,\n",
385 | "\n",
386 | "\n",
387 | " [[[-0.0482, -0.0629, -0.1348, -0.0321, -0.1168],\n",
388 | " [-0.0721, -0.0334, -0.0868, -0.0112, 0.0183],\n",
389 | " [ 0.0814, -0.0759, 0.0558, 0.0165, -0.1443],\n",
390 | " [ 0.0478, -0.1126, 0.0319, 0.0282, 0.0392],\n",
391 | " [-0.0818, 0.0456, 0.0469, 0.0682, -0.0889]],\n",
392 | "\n",
393 | " [[-0.0964, -0.0441, -0.0376, -0.1273, 0.0643],\n",
394 | " [-0.0678, 0.0213, -0.0184, 0.0526, 0.0937],\n",
395 | " [-0.0995, -0.0961, 0.0146, 0.0857, 0.0363],\n",
396 | " [-0.0216, -0.1249, 0.0229, -0.0659, -0.0795],\n",
397 | " [ 0.0812, -0.0560, -0.1054, -0.0096, 0.0889]],\n",
398 | "\n",
399 | " [[-0.0897, -0.1021, 0.0180, 0.0298, -0.0659],\n",
400 | " [ 0.0528, -0.1170, -0.0548, 0.0178, -0.0131],\n",
401 | " [ 0.0153, 0.0072, 0.0386, 0.0121, -0.1135],\n",
402 | " [-0.1317, 0.0072, -0.0720, 0.0915, -0.1055],\n",
403 | " [-0.1206, -0.0260, -0.1168, 0.0285, -0.1064]]],\n",
404 | "\n",
405 | "\n",
406 | " [[[ 0.0775, 0.0365, 0.0013, 0.0921, 0.1069],\n",
407 | " [-0.0504, -0.0125, -0.0210, 0.0183, 0.0713],\n",
408 | " [-0.0559, -0.0774, -0.1068, -0.0869, -0.0683],\n",
409 | " [-0.0192, 0.0008, 0.0784, 0.0213, -0.0400],\n",
410 | " [-0.0524, 0.0806, -0.0096, 0.0329, -0.0262]],\n",
411 | "\n",
412 | " [[ 0.0902, 0.0546, 0.0144, 0.1076, -0.0733],\n",
413 | " [ 0.0053, -0.0091, -0.0023, -0.0353, -0.0744],\n",
414 | " [ 0.0175, -0.0493, -0.0767, -0.0778, -0.0176],\n",
415 | " [ 0.0258, 0.0045, 0.0684, 0.0814, 0.0049],\n",
416 | " [-0.0952, 0.0733, 0.0422, 0.0057, -0.0058]],\n",
417 | "\n",
418 | " [[-0.0374, 0.0999, 0.0383, 0.0544, 0.1199],\n",
419 | " [-0.1001, -0.0429, 0.1261, -0.0481, -0.0135],\n",
420 | " [ 0.0285, 0.0622, -0.0188, 0.0707, -0.0995],\n",
421 | " [-0.0672, 0.1120, 0.0732, 0.0780, 0.0502],\n",
422 | " [-0.1165, 0.0694, 0.0052, -0.0275, 0.0033]]],\n",
423 | "\n",
424 | "\n",
425 | " [[[-0.0018, 0.1250, -0.0596, 0.0056, -0.0844],\n",
426 | " [ 0.0031, -0.0784, -0.0879, 0.1046, 0.0131],\n",
427 | " [ 0.0248, 0.1182, 0.0623, 0.1107, 0.0702],\n",
428 | " [-0.0020, -0.0631, 0.0097, -0.0636, -0.0109],\n",
429 | " [-0.0106, 0.1198, 0.0468, -0.0776, 0.0931]],\n",
430 | "\n",
431 | " [[ 0.0912, -0.0293, -0.1130, -0.1091, -0.1368],\n",
432 | " [-0.0486, -0.0580, -0.0293, 0.0825, 0.0432],\n",
433 | " [-0.0488, -0.0165, -0.0907, 0.1175, -0.1161],\n",
434 | " [-0.0058, 0.0306, -0.0454, 0.0105, 0.1014],\n",
435 | " [ 0.1089, 0.0913, 0.0672, 0.0102, 0.0053]],\n",
436 | "\n",
437 | " [[-0.0369, 0.1566, 0.0700, 0.0545, 0.0613],\n",
438 | " [ 0.0877, 0.0052, 0.0940, 0.1503, 0.0434],\n",
439 | " [-0.0281, 0.0453, 0.0012, 0.0196, -0.0414],\n",
440 | " [ 0.0855, -0.0163, 0.1347, 0.0424, 0.0502],\n",
441 | " [ 0.0874, 0.0372, 0.1193, 0.1401, 0.1866]]]]))\n",
442 | "('0.bias', Parameter containing:\n",
443 | "tensor([-0.0074, -0.0474, 0.0857, 0.1327, 0.0287, 0.1414, 0.1547,\n",
444 | " 0.0509, -0.0440, -0.0592, 0.0788, -0.0021, 0.0642, 0.1670,\n",
445 | " 0.0317, 0.0466, 0.1044, -0.0274, -0.0708, 0.0774, 0.0230,\n",
446 | " 0.0278, 0.1082, 0.1173, 0.0120, -0.0614, 0.0690, 0.0154,\n",
447 | " -0.0326, 0.0599, -0.0667, 0.0317, -0.0404, 0.1326, -0.0984,\n",
448 | " 0.0518, -0.0816, -0.0412, -0.0766, 0.0903, -0.0249, -0.0253,\n",
449 | " 0.2320, -0.0652, -0.0272, 0.0391, 0.0159, -0.0892, -0.0242,\n",
450 | " -0.0119, -0.0370, 0.1231, -0.0702, -0.0439, -0.0870, 0.0212,\n",
451 | " 0.1375, -0.1098, 0.0907, 0.0009, 0.0788, 0.0816, -0.1044,\n",
452 | " 0.0091]))\n",
453 | "('3.weight', Parameter containing:\n",
454 | "tensor([[[[-2.6779e-02, -1.2962e-02, -6.7731e-03, ..., -2.1328e-02,\n",
455 | " -1.5803e-02, -7.1797e-03],\n",
456 | " [-1.8022e-02, -2.3607e-03, -2.2527e-02, ..., -3.2269e-02,\n",
457 | " 1.1309e-02, 7.9132e-03],\n",
458 | " [-1.8926e-02, -1.6236e-02, -1.8413e-02, ..., 9.0630e-03,\n",
459 | " 9.2606e-03, 1.7090e-02],\n",
460 | " ...,\n",
461 | " [-3.7086e-03, -7.2559e-04, 1.0614e-02, ..., 6.1826e-04,\n",
462 | " -1.2080e-02, 4.3929e-04],\n",
463 | " [-2.3554e-02, -1.1957e-02, -6.5553e-03, ..., -1.1912e-02,\n",
464 | " -1.3815e-02, -2.2450e-03],\n",
465 | " [-2.0905e-02, -2.5623e-02, -3.3727e-02, ..., -8.8794e-03,\n",
466 | " 2.5970e-03, 8.4659e-04]],\n",
467 | "\n",
468 | " [[-1.0403e-02, 9.8815e-03, 1.3379e-02, ..., 1.6973e-02,\n",
469 | " -7.1956e-03, 4.0096e-03],\n",
470 | " [ 1.1212e-02, -1.4063e-02, 1.7008e-02, ..., -6.0592e-03,\n",
471 | " -1.2660e-02, -1.1657e-02],\n",
472 | " [-3.2382e-02, -4.0698e-03, 6.5229e-03, ..., -3.1508e-03,\n",
473 | " -3.7202e-02, -1.1686e-02],\n",
474 | " ...,\n",
475 | " [-9.1540e-03, 1.0237e-02, 1.6859e-02, ..., 8.6157e-03,\n",
476 | " -3.7181e-03, 9.6950e-03],\n",
477 | " [-1.7268e-02, 1.4214e-02, -1.1315e-02, ..., -8.8661e-03,\n",
478 | " -1.2371e-02, 6.7527e-03],\n",
479 | " [ 9.9682e-03, -1.3675e-02, -6.5624e-03, ..., 3.1749e-03,\n",
480 | " 9.4326e-03, -2.9477e-03]],\n",
481 | "\n",
482 | " [[-7.0483e-03, -3.1922e-02, -2.1498e-02, ..., -3.1507e-03,\n",
483 | " -3.0696e-02, -2.8737e-03],\n",
484 | " [-6.8231e-03, -1.3644e-02, -1.6670e-03, ..., -2.8231e-02,\n",
485 | " -3.1186e-02, -2.6410e-02],\n",
486 | " [-9.8460e-03, -3.6508e-02, -1.1149e-02, ..., -1.7134e-02,\n",
487 | " -3.2647e-02, -2.3700e-02],\n",
488 | " ...,\n",
489 | " [-5.7745e-04, 9.0411e-04, -1.4712e-02, ..., 1.3643e-02,\n",
490 | " -1.8622e-03, -1.3857e-02],\n",
491 | " [-3.7543e-02, 1.7850e-02, -2.0641e-03, ..., 5.8658e-03,\n",
492 | " 4.6741e-03, -8.6243e-03],\n",
493 | " [-3.3316e-02, -4.9936e-03, -1.4988e-02, ..., -8.6911e-05,\n",
494 | " -1.7218e-02, -2.7561e-03]],\n",
495 | "\n",
496 | " ...,\n",
497 | "\n",
498 | " [[ 1.5939e-02, -1.4361e-02, 1.4564e-02, ..., -8.7929e-03,\n",
499 | " -1.2084e-02, 1.2491e-02],\n",
500 | " [ 1.7160e-02, -6.9554e-03, 1.0544e-02, ..., -1.0389e-02,\n",
501 | " -4.2872e-03, -4.1053e-03],\n",
502 | " [-2.0027e-03, 1.0370e-02, 1.7050e-02, ..., -6.4324e-03,\n",
503 | " 1.6785e-02, 3.4043e-03],\n",
504 | " ...,\n",
505 | " [ 1.3323e-02, -3.4984e-03, -1.5882e-02, ..., -2.4456e-03,\n",
506 | " 2.4521e-03, 1.6473e-02],\n",
507 | " [-1.7732e-02, 1.5460e-02, 6.0378e-03, ..., -1.2608e-02,\n",
508 | " 1.7068e-02, 1.6477e-02],\n",
509 | " [ 7.6953e-03, 9.7408e-03, -5.5379e-03, ..., -1.6686e-03,\n",
510 | " -1.5905e-03, 1.2670e-02]],\n",
511 | "\n",
512 | " [[-2.7136e-02, -3.4884e-02, -3.1536e-02, ..., 8.7532e-03,\n",
513 | " 1.7536e-02, -8.5740e-03],\n",
514 | " [-3.2289e-02, -2.1074e-02, -2.7792e-03, ..., 1.3592e-03,\n",
515 | " 6.7092e-03, 8.8825e-03],\n",
516 | " [-2.4370e-03, -2.1794e-02, -1.4332e-02, ..., -2.6290e-03,\n",
517 | " -9.7182e-04, -1.3434e-02],\n",
518 | " ...,\n",
519 | " [-2.7251e-02, -5.9368e-03, -1.7157e-02, ..., 4.8391e-03,\n",
520 | " 1.3846e-02, -2.5880e-02],\n",
521 | " [-8.4309e-03, -9.7086e-03, -8.2329e-03, ..., -1.1860e-02,\n",
522 | " -1.2285e-02, 6.6090e-03],\n",
523 | " [-2.8973e-03, 9.6497e-03, 2.2892e-03, ..., 1.2426e-02,\n",
524 | " -9.8844e-03, -2.6804e-02]],\n",
525 | "\n",
526 | " [[-1.7853e-03, 1.4545e-02, 1.3259e-02, ..., 6.5922e-03,\n",
527 | " -5.1442e-03, -1.0759e-02],\n",
528 | " [ 1.4357e-02, 4.0669e-03, 1.0755e-02, ..., -1.3151e-02,\n",
529 | " 1.4049e-02, 1.1277e-03],\n",
530 | " [ 9.0401e-03, 1.0939e-02, -1.3673e-02, ..., -8.7622e-03,\n",
531 | " 5.9570e-04, -1.2833e-02],\n",
532 | " ...,\n",
533 | " [ 2.0013e-03, 6.9983e-03, 4.6257e-03, ..., -8.0778e-03,\n",
534 | " 1.2425e-02, -9.2927e-03],\n",
535 | " [ 1.3665e-02, -1.7009e-02, 3.3687e-03, ..., -4.1017e-03,\n",
536 | " -1.0301e-02, 1.4668e-02],\n",
537 | " [ 5.8163e-03, -2.8335e-06, 9.8780e-04, ..., 1.0928e-02,\n",
538 | " -1.1426e-02, -1.3808e-02]]],\n",
539 | "\n",
540 | "\n",
541 | " [[[-2.8145e-02, -1.8742e-02, -5.5234e-03, ..., 4.0994e-03,\n",
542 | " 2.8125e-04, -3.5711e-02],\n",
543 | " [-1.9029e-02, -3.9364e-03, -6.7715e-03, ..., -9.1552e-03,\n",
544 | " 1.5949e-02, 4.7563e-03],\n",
545 | " [-7.7093e-03, -3.4516e-02, -2.2431e-02, ..., -3.2317e-02,\n",
546 | " 9.8823e-03, 1.2922e-03],\n",
547 | " ...,\n",
548 | " [-2.9283e-02, -2.6186e-02, -1.6897e-02, ..., -4.7393e-03,\n",
549 | " -3.1830e-02, -1.0085e-02],\n",
550 | " [-3.5755e-02, -3.4435e-02, -1.2168e-02, ..., -2.0105e-02,\n",
551 | " -4.2665e-03, -2.0468e-02],\n",
552 | " [-3.3734e-02, -1.6996e-02, -9.8357e-03, ..., -2.9043e-02,\n",
553 | " -3.3291e-02, -1.3980e-02]],\n",
554 | "\n",
555 | " [[-6.3367e-03, -4.0852e-03, -1.3327e-02, ..., -6.2933e-03,\n",
556 | " 1.3628e-02, 8.6691e-03],\n",
557 | " [ 1.3802e-02, -7.2884e-03, -1.4474e-02, ..., 1.3953e-02,\n",
558 | " -5.3896e-03, 9.0456e-03],\n",
559 | " [-6.9317e-03, 1.6150e-02, 8.1835e-03, ..., -3.0702e-04,\n",
560 | " 1.3830e-02, -1.6633e-03],\n",
561 | " ...,\n",
562 | " [-8.3356e-04, -9.3114e-03, 7.4694e-03, ..., -1.2985e-02,\n",
563 | " -1.4350e-02, 4.2311e-03],\n",
564 | " [-5.0927e-03, 1.0877e-02, 4.0688e-03, ..., 9.2379e-03,\n",
565 | " -1.0290e-02, 1.0049e-02],\n",
566 | " [-9.4879e-03, 1.0646e-02, 1.3236e-02, ..., -9.2430e-03,\n",
567 | " -1.0380e-03, -1.4155e-02]],\n",
568 | "\n",
569 | " [[-3.6744e-02, -2.1535e-02, -3.1799e-02, ..., -1.4108e-02,\n",
570 | " 2.2022e-03, 1.5080e-02],\n",
571 | " [-2.9610e-02, -4.6011e-03, -1.4337e-02, ..., -8.4109e-03,\n",
572 | " 4.4273e-03, -2.2268e-02],\n",
573 | " [-1.1714e-02, -5.3899e-03, -1.1769e-02, ..., -2.0215e-02,\n",
574 | " -4.4180e-03, -9.1483e-03],\n",
575 | " ...,\n",
576 | " [-3.1818e-02, -2.7536e-02, -1.3271e-02, ..., -6.5540e-03,\n",
577 | " -7.9542e-03, -1.0677e-02],\n",
578 | " [-9.0505e-03, -3.1940e-02, -1.5119e-02, ..., -2.1554e-02,\n",
579 | " -1.0521e-02, -2.7976e-02],\n",
580 | " [-2.0902e-02, -3.2283e-03, -1.3045e-02, ..., -3.6176e-02,\n",
581 | " -2.9619e-02, -1.6289e-02]],\n",
582 | "\n",
583 | " ...,\n",
584 | "\n",
585 | " [[-1.4943e-02, 1.2392e-03, 1.6166e-02, ..., -1.1477e-02,\n",
586 | " -1.5734e-02, -1.2199e-02],\n",
587 | " [ 1.1283e-02, 1.1453e-03, 1.2160e-02, ..., 6.1564e-03,\n",
588 | " 3.5162e-03, -8.8078e-03],\n",
589 | " [ 1.5972e-02, 1.8743e-03, -1.4592e-02, ..., 7.7799e-03,\n",
590 | " -4.6349e-03, 3.2799e-03],\n",
591 | " ...,\n",
592 | " [ 8.4355e-03, -4.7946e-04, -1.7618e-02, ..., -1.6736e-02,\n",
593 | " -6.3067e-03, 6.9063e-03],\n",
594 | " [ 1.0057e-02, 5.4642e-03, 1.1619e-02, ..., 1.4251e-02,\n",
595 | " -8.2950e-03, 1.3677e-02],\n",
596 | " [ 3.1885e-03, -1.5601e-05, 1.7460e-02, ..., -1.1777e-02,\n",
597 | " -6.7834e-03, 3.3414e-03]],\n",
598 | "\n",
599 | " [[-3.0452e-02, -1.2080e-02, 1.0256e-02, ..., -3.0990e-02,\n",
600 | " 8.6174e-03, 1.6501e-03],\n",
601 | " [-5.2719e-04, -3.2968e-02, -2.6674e-02, ..., -1.6440e-02,\n",
602 | " -3.6365e-03, -3.2362e-02],\n",
603 | " [-2.7233e-02, -2.7331e-02, -3.5724e-02, ..., -9.7884e-03,\n",
604 | " -3.2167e-02, -9.0837e-03],\n",
605 | " ...,\n",
606 | " [-2.0292e-02, -3.3341e-03, -7.6577e-03, ..., 1.4283e-02,\n",
607 | " -1.4460e-03, -1.3133e-02],\n",
608 | " [-3.3671e-02, -1.4031e-02, -7.2689e-03, ..., 1.6328e-02,\n",
609 | " -7.3200e-03, -2.9146e-02],\n",
610 | " [-2.9474e-02, -2.9688e-02, -1.0572e-02, ..., -3.2480e-02,\n",
611 | " -1.3261e-02, -1.5741e-02]],\n",
612 | "\n",
613 | " [[-2.3804e-03, 5.5173e-03, -1.2740e-02, ..., -4.8662e-03,\n",
614 | " -7.2586e-03, 1.0922e-02],\n",
615 | " [-6.3082e-03, -9.7869e-03, -1.6668e-02, ..., -1.0346e-02,\n",
616 | " -7.1375e-04, -1.4136e-02],\n",
617 | " [-9.3555e-03, 5.5218e-03, 1.6871e-02, ..., -7.9774e-03,\n",
618 | " 1.0834e-02, 6.2287e-03],\n",
619 | " ...,\n",
620 | " [-1.0119e-02, -1.4812e-03, -2.6835e-03, ..., 5.7517e-03,\n",
621 | " 1.2835e-02, 8.3581e-03],\n",
622 | " [-1.7669e-02, -4.3534e-04, -1.3433e-02, ..., 1.3524e-02,\n",
623 | " 5.1122e-04, 1.2765e-02],\n",
624 | " [-1.2379e-02, -4.0298e-03, 1.3297e-02, ..., -9.6577e-03,\n",
625 | " -8.4847e-03, -1.0439e-02]]],\n",
626 | "\n",
627 | "\n",
628 | " [[[-2.2538e-03, -4.1233e-03, -1.0215e-02, ..., -2.4550e-03,\n",
629 | " -2.0032e-02, -2.6995e-02],\n",
630 | " [-3.4619e-02, -1.8392e-02, -2.5360e-02, ..., -1.4965e-02,\n",
631 | " -1.0830e-02, -3.1260e-02],\n",
632 | " [-1.0557e-02, -2.3744e-02, 1.6909e-03, ..., -6.7882e-03,\n",
633 | " 1.5083e-03, -1.6190e-02],\n",
634 | " ...,\n",
635 | " [-1.7339e-03, 6.6879e-03, -9.7566e-03, ..., 1.1324e-02,\n",
636 | " -2.9404e-02, 1.9570e-02],\n",
637 | " [ 1.0242e-02, -9.2871e-03, -9.3168e-03, ..., -1.3156e-02,\n",
638 | " -1.4865e-02, -1.1270e-02],\n",
639 | " [ 1.9390e-02, -8.4842e-03, 9.8267e-03, ..., 4.0320e-03,\n",
640 | " -2.6696e-02, -1.6334e-02]],\n",
641 | "\n",
642 | " [[-9.2508e-03, -1.1350e-02, -1.7665e-02, ..., 4.3904e-03,\n",
643 | " 2.7492e-03, -5.2415e-03],\n",
644 | " [-8.4670e-03, -7.3156e-03, -1.9307e-02, ..., -2.3375e-02,\n",
645 | " -1.0639e-02, -1.7652e-02],\n",
646 | " [-2.3184e-02, -1.7577e-02, -6.0105e-03, ..., 4.4489e-03,\n",
647 | " -2.6661e-02, 3.8427e-03],\n",
648 | " ...,\n",
649 | " [-7.8044e-03, -1.7909e-02, 2.7993e-03, ..., -1.1152e-03,\n",
650 | " 7.6839e-03, -1.1714e-02],\n",
651 | " [-9.9899e-03, 2.4783e-03, -3.1628e-03, ..., -1.6662e-02,\n",
652 | " -1.4662e-02, 6.5154e-03],\n",
653 | " [-1.4905e-02, -1.5384e-02, -1.1265e-02, ..., -4.1862e-03,\n",
654 | " -1.9127e-03, -2.4848e-02]],\n",
655 | "\n",
656 | " [[ 3.4846e-03, 8.0098e-03, 1.7443e-02, ..., 1.2480e-02,\n",
657 | " -1.2735e-02, 8.6934e-03],\n",
658 | " [-8.2303e-03, -1.7087e-02, -1.0395e-02, ..., -1.6124e-02,\n",
659 | " 7.0822e-03, -3.8555e-04],\n",
660 | " [-5.2301e-03, 4.9656e-03, 9.1322e-03, ..., -3.9297e-03,\n",
661 | " -1.1945e-02, -3.1185e-03],\n",
662 | " ...,\n",
663 | " [ 1.0450e-02, 1.8954e-02, 2.9704e-03, ..., 1.4643e-02,\n",
664 | " 1.6012e-02, -3.2929e-03],\n",
665 | " [ 1.0485e-02, 7.6941e-03, 7.7856e-03, ..., 6.2871e-03,\n",
666 | " 7.3308e-03, 1.3855e-02],\n",
667 | " [-1.3529e-02, -2.3717e-03, -1.4512e-02, ..., 1.0026e-02,\n",
668 | " -1.6163e-02, -5.7107e-03]],\n",
669 | "\n",
670 | " ...,\n",
671 | "\n",
672 | " [[-1.4811e-02, -2.7844e-02, -2.0868e-02, ..., -2.6010e-02,\n",
673 | " -2.7611e-02, 6.3969e-03],\n",
674 | " [-2.2012e-03, -1.9145e-02, -1.9199e-02, ..., -2.0287e-02,\n",
675 | " -2.2382e-02, -2.2633e-03],\n",
676 | " [-1.0251e-02, -1.5751e-02, -2.7219e-02, ..., 2.9438e-03,\n",
677 | " -2.6035e-02, -2.6711e-02],\n",
678 | " ...,\n",
679 | " [-3.0947e-04, 5.9995e-03, 2.1770e-05, ..., -1.0780e-02,\n",
680 | " 4.2132e-03, 3.1212e-03],\n",
681 | " [-1.9642e-02, -1.5439e-02, -1.3787e-02, ..., -2.8270e-02,\n",
682 | " -8.3740e-03, -6.7641e-03],\n",
683 | " [-6.7095e-03, -1.8616e-02, -2.7250e-02, ..., -2.8718e-02,\n",
684 | " -2.0472e-02, 4.0441e-04]],\n",
685 | "\n",
686 | " [[-2.8262e-02, -7.3320e-03, -1.9765e-02, ..., -8.0278e-03,\n",
687 | " 1.7557e-02, 1.8543e-02],\n",
688 | " [-1.7225e-02, -1.3504e-02, -2.6834e-02, ..., -2.0847e-02,\n",
689 | " -3.4311e-03, 8.1041e-03],\n",
690 | " [-2.3213e-02, 8.8160e-03, 1.5753e-02, ..., -1.5599e-02,\n",
691 | " -2.2783e-02, 1.7687e-03],\n",
692 | " ...,\n",
693 | " [-1.2956e-02, -3.4006e-02, -1.7315e-02, ..., -6.5962e-03,\n",
694 | " -3.2383e-02, 1.5012e-02],\n",
695 | " [ 1.8599e-02, -1.7383e-02, -1.5422e-02, ..., -9.3824e-03,\n",
696 | " -1.5369e-02, -2.1481e-02],\n",
697 | " [-3.9189e-04, -1.3674e-02, -2.4964e-02, ..., -9.4626e-03,\n",
698 | " -1.0716e-02, -1.9111e-03]],\n",
699 | "\n",
700 | " [[-2.4925e-02, -1.9391e-03, 1.8677e-03, ..., -7.9364e-03,\n",
701 | " -1.1269e-02, -1.0375e-02],\n",
702 | " [-2.2959e-02, 1.3838e-03, -5.1879e-03, ..., -2.0389e-02,\n",
703 | " 1.8722e-04, -2.2228e-02],\n",
704 | " [-2.5972e-02, -1.9240e-02, -1.4870e-02, ..., -1.1329e-02,\n",
705 | " -1.0629e-02, -1.2778e-03],\n",
706 | " ...,\n",
707 | " [ 4.6231e-03, -9.8229e-03, -1.6067e-02, ..., -1.4338e-02,\n",
708 | " 1.0771e-03, -1.4400e-02],\n",
709 | " [-1.5673e-02, -4.5755e-03, -1.2823e-02, ..., -1.7801e-02,\n",
710 | " 2.3182e-03, -1.8283e-02],\n",
711 | " [ 2.1563e-03, -5.6639e-03, 6.3025e-03, ..., -1.9270e-02,\n",
712 | " -2.7177e-02, 1.7473e-04]]],\n",
713 | "\n",
714 | "\n",
715 | " ...,\n",
716 | "\n",
717 | "\n",
718 | " [[[ 7.6536e-03, -1.8783e-03, 1.8841e-02, ..., -8.4884e-03,\n",
719 | " -2.2051e-03, -5.5705e-03],\n",
720 | " [-1.1814e-02, -1.4657e-02, 1.1615e-02, ..., -3.1463e-03,\n",
721 | " -3.4147e-02, -2.1097e-02],\n",
722 | " [ 1.7014e-02, -1.1913e-03, -1.3618e-02, ..., -2.0940e-02,\n",
723 | " -1.9440e-02, -3.0029e-02],\n",
724 | " ...,\n",
725 | " [ 1.0215e-02, 1.5527e-02, -6.3834e-03, ..., 6.0160e-03,\n",
726 | " -1.6559e-02, -2.9295e-03],\n",
727 | " [ 1.0632e-02, -1.1926e-02, -1.3686e-03, ..., 1.6902e-02,\n",
728 | " -1.0786e-02, -2.5942e-02],\n",
729 | " [ 3.9939e-03, -3.3778e-02, -1.2943e-02, ..., 1.9375e-03,\n",
730 | " -2.5962e-02, -2.6246e-02]],\n",
731 | "\n",
732 | " [[-1.8836e-02, -1.2895e-02, -2.8608e-02, ..., -1.1196e-02,\n",
733 | " -1.9619e-02, -3.0789e-02],\n",
734 | " [-3.1237e-02, -3.7592e-02, -8.0640e-03, ..., -2.0608e-02,\n",
735 | " -7.0762e-03, -3.3432e-02],\n",
736 | " [-3.4544e-02, -3.1376e-02, -1.8247e-02, ..., -4.2953e-03,\n",
737 | " -2.5268e-02, -3.7524e-02],\n",
738 | " ...,\n",
739 | " [-2.0865e-02, -2.8106e-02, -4.8804e-03, ..., 4.9353e-03,\n",
740 | " -9.5544e-03, -3.9235e-04],\n",
741 | " [-2.0468e-02, -4.8933e-03, -2.7534e-02, ..., -1.2462e-02,\n",
742 | " -2.6990e-02, -7.4737e-03],\n",
743 | " [-2.3287e-02, -2.4754e-02, -2.8761e-02, ..., -1.5842e-02,\n",
744 | " -2.1052e-02, -3.2656e-02]],\n",
745 | "\n",
746 | " [[ 8.0048e-04, 2.2151e-03, 1.5473e-02, ..., -1.2530e-02,\n",
747 | " -1.6299e-02, -3.9971e-03],\n",
748 | " [-1.7649e-02, 6.1190e-03, 5.3151e-03, ..., -2.9324e-02,\n",
749 | " -1.8867e-02, -3.1613e-02],\n",
750 | " [-3.7128e-02, -3.5173e-02, -3.1409e-02, ..., -2.0030e-02,\n",
751 | " -3.2676e-03, -3.1105e-02],\n",
752 | " ...,\n",
753 | " [-2.1572e-02, -3.5458e-02, -2.1744e-02, ..., -4.4794e-03,\n",
754 | " -4.9605e-03, -2.9795e-02],\n",
755 | " [-1.9600e-02, -1.8060e-02, -2.9290e-02, ..., -1.0334e-02,\n",
756 | " -2.3278e-02, -2.6473e-02],\n",
757 | " [-3.4211e-02, -5.7403e-03, -3.1517e-02, ..., -2.5251e-02,\n",
758 | " -2.8706e-02, -3.5840e-02]],\n",
759 | "\n",
760 | " ...,\n",
761 | "\n",
762 | " [[ 1.1339e-02, -1.7595e-02, 3.8017e-03, ..., 2.5522e-03,\n",
763 | " -1.7517e-02, 4.3034e-03],\n",
764 | " [ 9.7192e-03, 1.5814e-02, 5.0818e-03, ..., 1.2481e-02,\n",
765 | " -3.0841e-02, 3.4227e-03],\n",
766 | " [-1.1800e-02, 4.6344e-03, 2.4301e-03, ..., -3.6808e-02,\n",
767 | " -3.3497e-02, -2.8690e-02],\n",
768 | " ...,\n",
769 | " [ 3.6129e-03, -1.1561e-02, -3.0395e-02, ..., -1.2388e-02,\n",
770 | " -9.4928e-03, -1.5173e-03],\n",
771 | " [-1.1360e-02, -4.0666e-03, -2.0922e-02, ..., 8.6673e-04,\n",
772 | " -1.3469e-02, -4.8741e-03],\n",
773 | " [ 5.7896e-03, -1.7382e-02, -7.8392e-03, ..., -2.3734e-03,\n",
774 | " -1.1630e-02, -7.0134e-03]],\n",
775 | "\n",
776 | " [[-3.2164e-02, -6.2788e-03, 1.3968e-02, ..., 3.6180e-03,\n",
777 | " -1.0840e-02, -2.7565e-02],\n",
778 | " [-2.6980e-02, -2.4073e-02, 1.0033e-03, ..., -2.5264e-04,\n",
779 | " -5.5285e-03, -1.2939e-02],\n",
780 | " [ 2.1923e-04, -1.4998e-03, -2.6163e-02, ..., -4.7604e-03,\n",
781 | " 9.5060e-03, 2.7361e-03],\n",
782 | " ...,\n",
783 | " [-1.5853e-02, 1.8252e-02, -1.6496e-02, ..., -3.9139e-03,\n",
784 | " -2.4966e-02, -3.1966e-03],\n",
785 | " [-2.7687e-02, -2.8252e-02, 1.8075e-03, ..., -2.1508e-02,\n",
786 | " 3.0193e-03, -1.8301e-02],\n",
787 | " [ 3.9693e-03, 1.4852e-02, 6.8361e-03, ..., -2.5844e-02,\n",
788 | " -1.3109e-02, -2.7742e-02]],\n",
789 | "\n",
790 | " [[ 1.9207e-03, -1.1992e-02, 1.2561e-02, ..., -2.8050e-02,\n",
791 | " -2.8156e-02, -3.3904e-02],\n",
792 | " [ 1.7325e-02, 1.1727e-02, 4.4550e-03, ..., -2.3177e-02,\n",
793 | " -3.0512e-02, -1.1348e-02],\n",
794 | " [ 1.2288e-02, 3.4642e-04, -2.0631e-02, ..., -9.7264e-03,\n",
795 | " -1.9462e-02, -9.1786e-03],\n",
796 | " ...,\n",
797 | " [-1.4261e-02, -1.8814e-02, -9.2540e-03, ..., -6.0748e-03,\n",
798 | " -1.2992e-02, 4.8125e-04],\n",
799 | " [-1.3841e-02, -2.1739e-02, -1.6609e-02, ..., -3.4722e-03,\n",
800 | " -3.2457e-03, 1.4795e-02],\n",
801 | " [-4.3364e-03, -8.1214e-03, -1.2953e-02, ..., -9.9520e-03,\n",
802 | " 3.6117e-03, -7.1621e-03]]],\n",
803 | "\n",
804 | "\n",
805 | " [[[-2.1822e-02, -1.6658e-02, -7.6389e-03, ..., -2.2257e-02,\n",
806 | " 7.1451e-03, -1.5845e-03],\n",
807 | " [ 1.1925e-03, -3.5487e-03, -1.8371e-02, ..., 1.0235e-02,\n",
808 | " -2.0721e-02, 7.1239e-03],\n",
809 | " [-1.4366e-02, 7.3110e-03, -9.1615e-04, ..., -5.8821e-03,\n",
810 | " 1.5872e-02, 2.1394e-02],\n",
811 | " ...,\n",
812 | " [-3.5594e-03, 6.8701e-03, -1.0854e-02, ..., -2.3067e-02,\n",
813 | " -3.2157e-03, -1.1290e-02],\n",
814 | " [ 2.6806e-02, 3.3598e-04, -1.0921e-02, ..., -1.1420e-02,\n",
815 | " 4.6863e-03, 6.0898e-03],\n",
816 | " [ 3.0626e-03, -1.7101e-02, -5.4114e-03, ..., -1.0365e-02,\n",
817 | " -1.0822e-02, -2.6236e-02]],\n",
818 | "\n",
819 | " [[-1.3101e-02, -1.3059e-02, 7.6095e-03, ..., -1.1628e-02,\n",
820 | " -2.6642e-02, -6.9455e-03],\n",
821 | " [-2.5564e-02, -1.5327e-02, 4.0728e-03, ..., -2.5864e-02,\n",
822 | " -2.2147e-02, 4.5925e-03],\n",
823 | " [-8.2005e-03, 5.9101e-03, -6.4722e-03, ..., -1.4526e-02,\n",
824 | " -4.1891e-03, -1.5764e-02],\n",
825 | " ...,\n",
826 | " [-2.6733e-02, -2.7073e-02, -1.7734e-02, ..., -1.5771e-02,\n",
827 | " -8.3647e-04, 5.2966e-03],\n",
828 | " [ 7.4729e-03, -2.3610e-02, -1.9502e-02, ..., -1.5676e-02,\n",
829 | " 1.1866e-03, 4.3461e-04],\n",
830 | " [-2.7914e-03, -3.7813e-03, -2.0831e-02, ..., -1.0264e-02,\n",
831 | " 8.9520e-04, -2.4958e-02]],\n",
832 | "\n",
833 | " [[-6.4742e-03, -1.8906e-02, -5.6844e-03, ..., 7.3853e-03,\n",
834 | " 2.2777e-03, -6.9292e-03],\n",
835 | " [ 2.8477e-03, 2.0978e-03, 3.7272e-03, ..., -7.4928e-03,\n",
836 | " 1.6647e-02, 1.2275e-02],\n",
837 | " [ 1.1717e-02, -4.8451e-04, 2.7634e-02, ..., -6.2747e-03,\n",
838 | " -7.3154e-03, 4.8498e-04],\n",
839 | " ...,\n",
840 | " [ 1.0360e-02, 2.0931e-02, 1.1289e-02, ..., 3.9727e-03,\n",
841 | " -1.4086e-02, 1.7404e-02],\n",
842 | " [-2.5335e-03, -2.7018e-03, 1.6044e-02, ..., -3.9768e-03,\n",
843 | " -1.3957e-02, -1.4771e-02],\n",
844 | " [ 1.6544e-02, 2.1240e-02, 1.7475e-02, ..., -2.5158e-02,\n",
845 | " -1.9777e-02, -1.7363e-04]],\n",
846 | "\n",
847 | " ...,\n",
848 | "\n",
849 | " [[ 1.4401e-02, 1.2646e-03, -1.3304e-02, ..., 7.7538e-03,\n",
850 | " -1.9440e-02, -2.1017e-02],\n",
851 | " [ 1.6771e-02, -2.3978e-04, -5.0331e-03, ..., -7.6139e-03,\n",
852 | " -2.1629e-04, 6.4135e-03],\n",
853 | " [ 6.8014e-03, 9.8460e-03, -7.2331e-03, ..., -7.9818e-03,\n",
854 | " 3.1137e-03, -2.2293e-02],\n",
855 | " ...,\n",
856 | " [-1.4249e-02, 2.2670e-03, -2.0135e-02, ..., -1.9543e-04,\n",
857 | " 9.2510e-04, -3.7952e-03],\n",
858 | " [ 2.5527e-02, 3.9357e-03, -2.0599e-02, ..., -1.2822e-02,\n",
859 | " -2.0320e-02, 5.3710e-03],\n",
860 | " [ 2.4788e-02, -5.9360e-03, -1.9608e-02, ..., -8.5284e-03,\n",
861 | " -5.3702e-03, 2.7787e-03]],\n",
862 | "\n",
863 | " [[-1.3842e-02, 9.3919e-04, 1.0927e-02, ..., -2.3249e-02,\n",
864 | " 2.1997e-02, -2.7843e-03],\n",
865 | " [-1.8800e-02, 3.3210e-03, -5.7883e-03, ..., -3.2548e-02,\n",
866 | " 1.0355e-02, -7.5103e-05],\n",
867 | " [ 8.8634e-04, -2.7359e-02, 9.0961e-04, ..., -8.1291e-03,\n",
868 | " -3.1408e-04, -5.1685e-03],\n",
869 | " ...,\n",
870 | " [-2.1556e-02, 7.1239e-04, -2.7186e-02, ..., -2.6574e-02,\n",
871 | " -1.7427e-02, -7.3701e-03],\n",
872 | " [ 1.7685e-02, 1.9347e-03, -2.5782e-03, ..., -1.3726e-02,\n",
873 | " -1.9573e-02, -3.1529e-05],\n",
874 | " [ 1.6412e-02, -2.5740e-02, 1.9379e-03, ..., -2.6090e-02,\n",
875 | " -7.1123e-04, 1.2818e-02]],\n",
876 | "\n",
877 | " [[-2.5872e-02, -1.1990e-02, -1.4029e-02, ..., 4.0431e-03,\n",
878 | " 9.0229e-04, -1.4076e-02],\n",
879 | " [-1.9221e-02, -2.4752e-02, -1.5499e-02, ..., -7.9520e-03,\n",
880 | " -7.1294e-03, -4.3111e-03],\n",
881 | " [ 3.4378e-03, -1.3511e-02, -1.3479e-02, ..., -1.0406e-02,\n",
882 | " -9.2696e-03, -5.8095e-03],\n",
883 | " ...,\n",
884 | " [ 5.9763e-03, -6.7900e-04, -2.3468e-02, ..., 7.2678e-03,\n",
885 | " -2.4124e-02, 5.2814e-03],\n",
886 | " [-2.6482e-02, -1.1136e-02, -2.3210e-02, ..., -2.3877e-03,\n",
887 | " -9.3244e-03, -1.3438e-02],\n",
888 | " [-1.4087e-02, 8.4801e-04, 4.2950e-03, ..., -2.6069e-02,\n",
889 | " 5.7832e-03, -1.9748e-02]]],\n",
890 | "\n",
891 | "\n",
892 | " [[[-1.2947e-02, -1.3831e-02, -6.6514e-03, ..., 1.1251e-02,\n",
893 | " -2.7273e-03, -2.9318e-04],\n",
894 | " [ 1.6319e-02, -4.2163e-03, 9.5971e-04, ..., 8.7225e-03,\n",
895 | " 3.4388e-03, -4.2100e-03],\n",
896 | " [-8.9748e-03, 6.1063e-03, -1.0801e-03, ..., 5.1986e-03,\n",
897 | " 8.0231e-03, -2.8249e-02],\n",
898 | " ...,\n",
899 | " [-3.6449e-03, -2.3086e-03, -2.5649e-02, ..., -1.1459e-02,\n",
900 | " -5.9115e-03, 5.8053e-03],\n",
901 | " [-3.4264e-02, -3.3125e-02, -3.9721e-03, ..., -1.2224e-02,\n",
902 | " 1.9460e-02, -5.8133e-03],\n",
903 | " [-3.4569e-02, -3.0598e-02, -3.6949e-02, ..., 5.6422e-03,\n",
904 | " -3.6649e-03, 8.9027e-05]],\n",
905 | "\n",
906 | " [[-2.5274e-02, -2.2699e-02, -2.4185e-02, ..., -1.9850e-02,\n",
907 | " -1.6500e-02, -2.5491e-02],\n",
908 | " [-2.0654e-03, -1.8466e-02, -1.2426e-02, ..., 1.5545e-03,\n",
909 | " -1.6919e-02, -6.4482e-03],\n",
910 | " [-2.1573e-03, 3.2694e-03, -8.2869e-04, ..., -1.9123e-02,\n",
911 | " -3.0052e-02, -6.3218e-03],\n",
912 | " ...,\n",
913 | " [-2.0544e-02, -1.8392e-02, -1.7850e-02, ..., -1.2365e-02,\n",
914 | " -1.7570e-02, -2.4573e-02],\n",
915 | " [-3.4599e-02, -1.4640e-02, -3.5621e-02, ..., -2.3353e-02,\n",
916 | " -1.7889e-02, -3.3007e-02],\n",
917 | " [-2.4938e-02, -5.0069e-03, -2.1860e-02, ..., -2.3937e-02,\n",
918 | " -1.6531e-02, -2.4050e-02]],\n",
919 | "\n",
920 | " [[ 1.8155e-02, -3.6595e-04, 2.9583e-03, ..., -1.4410e-02,\n",
921 | " 1.0625e-02, 1.4375e-03],\n",
922 | " [-4.8929e-03, -8.0628e-03, 1.1450e-02, ..., -1.5520e-02,\n",
923 | " 1.3821e-02, -1.5309e-02],\n",
924 | " [ 1.1759e-02, -3.2002e-03, -1.5472e-02, ..., -9.7236e-03,\n",
925 | " 4.4048e-04, 1.5701e-02],\n",
926 | " ...,\n",
927 | " [ 3.1347e-03, -1.0985e-02, -3.2569e-02, ..., -9.3643e-03,\n",
928 | " 4.0229e-03, -4.7593e-03],\n",
929 | " [-1.4315e-02, -1.1992e-02, 1.4437e-02, ..., -9.9650e-03,\n",
930 | " 1.5973e-03, 1.9719e-03],\n",
931 | " [-1.6013e-02, 2.7376e-03, 1.3703e-02, ..., 4.5032e-03,\n",
932 | " -8.3267e-03, -1.5758e-02]],\n",
933 | "\n",
934 | " ...,\n",
935 | "\n",
936 | " [[-1.6352e-02, -7.9971e-03, -3.6600e-04, ..., -2.4343e-02,\n",
937 | " 4.1341e-03, -1.2726e-02],\n",
938 | " [-7.5895e-03, -2.5708e-02, 6.5365e-05, ..., -1.3495e-03,\n",
939 | " -5.5134e-03, -1.8683e-02],\n",
940 | " [-1.0314e-02, -9.2459e-03, -5.5137e-03, ..., -1.4481e-02,\n",
941 | " -9.4491e-03, -1.8040e-02],\n",
942 | " ...,\n",
943 | " [-3.3748e-02, -2.9064e-02, -5.2415e-03, ..., -8.1776e-03,\n",
944 | " -1.4581e-02, -2.4246e-02],\n",
945 | " [-6.7054e-03, -6.5064e-03, -5.5634e-03, ..., -1.8302e-02,\n",
946 | " -1.3915e-02, -1.9616e-02],\n",
947 | " [-1.2851e-02, -3.7664e-02, -7.9373e-03, ..., -1.1542e-02,\n",
948 | " -2.7742e-02, -1.2360e-02]],\n",
949 | "\n",
950 | " [[ 5.9764e-03, 1.1124e-02, 3.3182e-03, ..., 1.0216e-02,\n",
951 | " -1.5117e-02, 1.3690e-02],\n",
952 | " [ 4.9395e-04, -7.5153e-03, 8.6296e-03, ..., 8.1994e-03,\n",
953 | " 7.1977e-03, 2.5272e-03],\n",
954 | " [-3.7261e-03, -2.5792e-03, -3.5059e-02, ..., 1.6435e-02,\n",
955 | " 1.1533e-02, -5.8290e-03],\n",
956 | " ...,\n",
957 | " [-1.1111e-02, -1.8693e-02, -3.3552e-02, ..., -1.2267e-02,\n",
958 | " 8.4279e-04, -3.2727e-02],\n",
959 | " [-3.3329e-02, -2.4417e-02, -3.4563e-03, ..., -3.7300e-03,\n",
960 | " -4.3485e-03, -2.6191e-03],\n",
961 | " [-2.4551e-02, -2.3301e-02, -5.5629e-03, ..., -2.4263e-02,\n",
962 | " -7.4279e-03, -5.4921e-03]],\n",
963 | "\n",
964 | " [[-1.8330e-02, -3.5020e-02, -4.5647e-03, ..., -1.6847e-02,\n",
965 | " -1.8493e-02, -2.4594e-02],\n",
966 | " [-4.1776e-03, -2.8195e-02, -1.9245e-02, ..., -2.0432e-02,\n",
967 | " -4.7981e-03, -1.4396e-02],\n",
968 | " [-1.4868e-02, -1.7694e-02, -2.6225e-02, ..., -3.2991e-03,\n",
969 | " -3.6838e-03, -4.8610e-03],\n",
970 | " ...,\n",
971 | " [-2.5331e-03, -4.7969e-03, -2.0132e-02, ..., -4.7765e-03,\n",
972 | " -5.7052e-03, -4.8429e-03],\n",
973 | " [-3.4539e-03, -3.3050e-02, -1.4698e-02, ..., -1.2370e-02,\n",
974 | " -2.3638e-02, -2.4548e-02],\n",
975 | " [-1.5635e-02, -3.4954e-02, -1.7280e-02, ..., -1.2131e-02,\n",
976 | " -2.3583e-02, -1.5356e-02]]]]))\n",
977 | "('3.bias', Parameter containing:\n",
978 | "tensor(1.00000e-02 *\n",
979 | " [-1.0348, -0.6432, -2.8054, 0.4010, 0.0355, -1.6032, -2.2993,\n",
980 | " -1.0429, -0.9652, 0.4127, -1.8207, -1.2974, -0.3693, 0.1035,\n",
981 | " -3.5085, 0.2993, -1.0232, -0.8651, 0.9668, -2.0374, -0.7152,\n",
982 | " 0.3597, -1.8070, 0.8926, -3.2788, -0.0156, -1.5564, -1.5726,\n",
983 | " -0.7210, 4.4880, -0.0121, -2.9784, -1.1779, -1.4455, 1.3124,\n",
984 | " 1.3883, -2.0414, -0.6788, -0.2914, 4.7307, 0.1653, -0.8118,\n",
985 | " -0.6951, -1.2998, 1.0289, 1.4498, -0.9608, -2.2262, -1.0067,\n",
986 | " 0.1164, 1.2346, -1.9317, -0.8354, -0.7387, -0.8948, -0.9721,\n",
987 | " -0.1986, -0.8877, -0.2728, -1.8956, -1.8667, -3.1181, -1.0578,\n",
988 | " -0.4842]))\n",
989 | "('6.weight', Parameter containing:\n",
990 | "tensor([[[[-6.6457e-03, -1.4171e-02, -2.9045e-03, ..., -1.8137e-02,\n",
991 | " -2.4039e-02, 6.8482e-03],\n",
992 | " [ 7.1761e-03, -4.3415e-04, -3.1281e-03, ..., -2.2076e-02,\n",
993 | " 3.7009e-03, -2.6765e-02],\n",
994 | " [ 1.5630e-03, -1.9424e-03, 9.1876e-04, ..., -1.7380e-02,\n",
995 | " 7.2866e-03, -1.5511e-02],\n",
996 | " ...,\n",
997 | " [-6.0648e-03, -7.3269e-03, -1.2549e-02, ..., -5.2128e-03,\n",
998 | " -8.3172e-03, -1.7570e-02],\n",
999 | " [-7.9316e-03, -2.4722e-02, 2.5008e-03, ..., -2.3667e-02,\n",
1000 | " -2.3427e-02, -1.3126e-02],\n",
1001 | " [-6.7987e-03, -1.5110e-02, -8.4143e-03, ..., -1.4240e-04,\n",
1002 | " -1.7958e-02, 8.3597e-04]],\n",
1003 | "\n",
1004 | " [[-7.3525e-03, 7.4036e-03, 4.3098e-04, ..., -1.5146e-02,\n",
1005 | " 7.1143e-03, 6.2732e-04],\n",
1006 | " [ 1.6696e-02, -6.1884e-03, -1.7679e-02, ..., 3.8439e-03,\n",
1007 | " -1.2341e-02, -1.3297e-02],\n",
1008 | " [ 2.2285e-02, -7.4451e-03, 9.5357e-03, ..., 5.9170e-03,\n",
1009 | " -1.4165e-02, 5.7909e-03],\n",
1010 | " ...,\n",
1011 | " [ 8.5605e-03, 1.5439e-03, 3.1369e-03, ..., 2.6004e-02,\n",
1012 | " 1.6715e-02, -6.2791e-03],\n",
1013 | " [-2.9113e-03, -5.9755e-03, 2.4794e-02, ..., 1.4971e-02,\n",
1014 | " 2.4299e-02, 4.9134e-03],\n",
1015 | " [ 8.1300e-03, 2.7531e-02, 2.3008e-02, ..., 2.6274e-02,\n",
1016 | " 2.3459e-02, 8.4176e-03]],\n",
1017 | "\n",
1018 | " [[ 1.6915e-03, 1.5662e-02, -2.1010e-02, ..., -2.5390e-02,\n",
1019 | " -1.8454e-02, -2.5313e-03],\n",
1020 | " [-2.4235e-03, -1.7186e-02, -1.6349e-02, ..., -1.0117e-02,\n",
1021 | " -2.0963e-03, 4.7621e-03],\n",
1022 | " [ 5.7097e-03, -5.0673e-03, -1.0786e-02, ..., -2.2081e-02,\n",
1023 | " -1.2243e-02, -1.6443e-02],\n",
1024 | " ...,\n",
1025 | " [ 1.8973e-04, 5.9129e-03, 2.4763e-02, ..., -1.0624e-02,\n",
1026 | " 2.7799e-02, 1.7528e-02],\n",
1027 | " [ 1.5302e-02, 1.1425e-02, 1.0583e-03, ..., -2.5907e-02,\n",
1028 | " -6.2298e-03, 2.6912e-02],\n",
1029 | " [ 1.3923e-03, 3.1232e-03, 2.4442e-02, ..., 4.6041e-03,\n",
1030 | " 1.3593e-03, 3.2995e-04]],\n",
1031 | "\n",
1032 | " ...,\n",
1033 | "\n",
1034 | " [[ 2.5818e-02, -2.5142e-03, 1.4200e-03, ..., -2.1599e-03,\n",
1035 | " -2.2257e-03, -1.5570e-02],\n",
1036 | " [ 1.1808e-02, 5.1975e-03, -1.2687e-02, ..., -9.0135e-03,\n",
1037 | " -1.0521e-02, -7.2020e-03],\n",
1038 | " [ 2.6967e-02, 1.1292e-02, 4.3858e-03, ..., -1.5487e-02,\n",
1039 | " -7.1060e-03, -2.4728e-02],\n",
1040 | " ...,\n",
1041 | " [ 6.9493e-03, -7.3873e-03, -1.4296e-03, ..., -1.5632e-03,\n",
1042 | " -9.1091e-03, -1.7611e-02],\n",
1043 | " [-8.2599e-03, -1.2565e-02, -9.7295e-04, ..., -1.3228e-02,\n",
1044 | " -2.3057e-02, 2.0873e-03],\n",
1045 | " [ 2.5067e-02, 2.2780e-02, -2.1365e-02, ..., -2.5433e-02,\n",
1046 | " -1.2683e-02, -1.1745e-02]],\n",
1047 | "\n",
1048 | " [[ 5.5638e-04, -1.4176e-02, -2.1675e-02, ..., 6.9348e-03,\n",
1049 | " -2.5002e-02, -7.3456e-03],\n",
1050 | " [-2.0352e-02, 6.1517e-03, -1.1137e-02, ..., -1.0299e-02,\n",
1051 | " -7.1797e-03, -1.7937e-02],\n",
1052 | " [-2.4783e-02, 7.8138e-03, -8.3013e-03, ..., -7.0645e-03,\n",
1053 | " 5.7574e-03, -6.3606e-03],\n",
1054 | " ...,\n",
1055 | " [-8.1102e-03, 5.2446e-04, 1.3026e-02, ..., 3.2308e-04,\n",
1056 | " -6.0556e-03, -2.3312e-02],\n",
1057 | " [-1.9393e-02, -1.0644e-02, -1.3462e-02, ..., -2.9526e-03,\n",
1058 | " -1.1095e-02, -4.4025e-03],\n",
1059 | " [-2.0711e-02, -1.2897e-02, -2.3291e-02, ..., -2.2207e-02,\n",
1060 | " -2.4636e-02, -9.8060e-03]],\n",
1061 | "\n",
1062 | " [[-2.7536e-02, 2.2127e-04, -2.0344e-02, ..., -2.6237e-02,\n",
1063 | " -1.6757e-02, -1.0473e-02],\n",
1064 | " [ 2.9774e-03, -3.4460e-03, 4.1607e-04, ..., -1.8696e-02,\n",
1065 | " -1.7803e-02, -1.5318e-02],\n",
1066 | " [-6.8567e-03, -5.4140e-03, -2.2211e-03, ..., -1.5153e-02,\n",
1067 | " -9.4086e-03, -2.4556e-02],\n",
1068 | " ...,\n",
1069 | " [-2.0466e-02, -1.5368e-02, -1.3362e-03, ..., -1.2661e-02,\n",
1070 | " -2.7657e-02, -2.6702e-02],\n",
1071 | " [-1.6134e-04, -5.4864e-03, -6.9648e-03, ..., -8.6749e-03,\n",
1072 | " -1.6099e-02, -1.1674e-02],\n",
1073 | " [-3.9682e-03, -2.1888e-04, -1.8551e-02, ..., 3.1419e-03,\n",
1074 | " -1.6960e-02, -3.9024e-03]]],\n",
1075 | "\n",
1076 | "\n",
1077 | " [[[ 2.6815e-03, 2.7600e-03, -2.3110e-02, ..., -6.3854e-03,\n",
1078 | " 6.4987e-03, 1.1546e-03],\n",
1079 | " [-1.9149e-02, 2.1954e-03, -2.2608e-02, ..., 1.9906e-03,\n",
1080 | " -9.6423e-03, -1.6311e-02],\n",
1081 | " [-4.5714e-04, -6.5635e-03, -1.8411e-02, ..., 2.6722e-02,\n",
1082 | " -1.0920e-02, -2.1461e-02],\n",
1083 | " ...,\n",
1084 | " [ 6.3454e-03, -7.8911e-03, -2.8480e-03, ..., -1.6411e-02,\n",
1085 | " 6.4979e-03, -6.4111e-03],\n",
1086 | " [-2.7195e-02, -2.6426e-02, 6.3926e-03, ..., 7.5039e-03,\n",
1087 | " 1.6723e-02, -2.7925e-03],\n",
1088 | " [-9.6588e-03, -1.8814e-03, -3.7692e-03, ..., -2.3274e-02,\n",
1089 | " -3.0475e-04, -2.4586e-02]],\n",
1090 | "\n",
1091 | " [[-1.9053e-02, -1.4415e-02, -3.9138e-04, ..., -2.2224e-02,\n",
1092 | " -2.5606e-02, -2.7464e-03],\n",
1093 | " [ 3.4185e-03, 6.5735e-04, -6.7643e-03, ..., 3.8953e-03,\n",
1094 | " -2.2330e-02, 3.5497e-04],\n",
1095 | " [-1.7709e-03, -2.3377e-02, -6.9347e-03, ..., -1.8656e-02,\n",
1096 | " -1.9381e-02, -6.5882e-03],\n",
1097 | " ...,\n",
1098 | " [ 7.6387e-03, -2.6929e-02, -7.6107e-04, ..., -2.7788e-02,\n",
1099 | " -1.9311e-02, -2.3376e-02],\n",
1100 | " [-1.8804e-02, -1.5826e-02, -2.3658e-02, ..., -4.7362e-03,\n",
1101 | " -3.9745e-03, -2.0802e-02],\n",
1102 | " [-2.3835e-02, -2.0257e-03, 6.2832e-03, ..., -1.6132e-02,\n",
1103 | " -2.4613e-02, -1.9445e-02]],\n",
1104 | "\n",
1105 | " [[ 3.7441e-03, -2.8301e-04, -2.1012e-02, ..., -2.1116e-02,\n",
1106 | " -1.9632e-02, 4.1838e-03],\n",
1107 | " [ 5.3022e-03, -1.0277e-02, 4.0184e-03, ..., 1.8427e-03,\n",
1108 | " -1.7806e-02, -5.5921e-03],\n",
1109 | " [-2.4765e-02, -1.2122e-02, -3.3981e-03, ..., -2.7065e-03,\n",
1110 | " 7.5494e-03, -8.5881e-03],\n",
1111 | " ...,\n",
1112 | " [-2.5949e-03, -1.2332e-02, -9.9704e-04, ..., 6.1100e-03,\n",
1113 | " -2.1041e-02, 1.5915e-03],\n",
1114 | " [-2.9155e-03, -1.2471e-03, 2.3624e-03, ..., -4.0809e-04,\n",
1115 | " 2.2107e-03, 5.9018e-03],\n",
1116 | " [-2.7314e-02, -8.8494e-03, 3.4153e-03, ..., 1.9356e-03,\n",
1117 | " -2.2871e-02, -1.3754e-02]],\n",
1118 | "\n",
1119 | " ...,\n",
1120 | "\n",
1121 | " [[-1.4542e-02, -1.1539e-02, 8.9263e-05, ..., -7.3279e-03,\n",
1122 | " -2.6264e-02, -1.3329e-02],\n",
1123 | " [-2.7454e-02, 3.3421e-03, -2.5765e-02, ..., -1.0423e-02,\n",
1124 | " -2.6844e-02, 7.3982e-03],\n",
1125 | " [-2.3613e-02, -1.3673e-02, -1.8357e-02, ..., -1.7721e-02,\n",
1126 | " -8.5604e-03, -2.2132e-02],\n",
1127 | " ...,\n",
1128 | " [-2.6013e-02, -3.6969e-03, 2.5747e-03, ..., -3.1840e-03,\n",
1129 | " -1.5127e-02, -5.5397e-03],\n",
1130 | " [-1.4254e-02, -2.5712e-02, -1.9869e-02, ..., -1.7686e-02,\n",
1131 | " 4.4819e-03, -9.8499e-03],\n",
1132 | " [-8.2287e-03, -2.6694e-02, -2.0531e-02, ..., -1.7120e-03,\n",
1133 | " -2.0798e-02, -1.7615e-02]],\n",
1134 | "\n",
1135 | " [[-1.1641e-02, 1.9956e-03, 1.1898e-02, ..., 3.6846e-03,\n",
1136 | " 1.1974e-02, -4.5329e-04],\n",
1137 | " [-2.5668e-02, 1.7122e-02, 1.7507e-02, ..., 9.9175e-03,\n",
1138 | " 2.5714e-02, -7.6476e-04],\n",
1139 | " [-1.7509e-02, 4.3558e-03, 7.5123e-04, ..., -1.4198e-03,\n",
1140 | " 2.5469e-03, 2.4452e-03],\n",
1141 | " ...,\n",
1142 | " [-4.9957e-03, 2.1021e-02, 1.2628e-02, ..., 5.9583e-03,\n",
1143 | " -8.1602e-04, 5.6060e-03],\n",
1144 | " [ 9.3684e-03, -3.8993e-03, -7.4301e-03, ..., 2.5262e-02,\n",
1145 | " -1.1567e-02, -2.2611e-02],\n",
1146 | " [ 1.5262e-02, 8.9769e-03, 9.7152e-03, ..., -7.4974e-03,\n",
1147 | " -4.8129e-03, 5.6780e-03]],\n",
1148 | "\n",
1149 | " [[ 2.3000e-03, -2.4523e-02, 6.6512e-03, ..., -2.7391e-02,\n",
1150 | " 6.8425e-03, -2.7274e-03],\n",
1151 | " [-7.4881e-03, -2.6908e-02, -1.0024e-02, ..., 6.7545e-03,\n",
1152 | " -1.3386e-02, -2.3434e-02],\n",
1153 | " [-1.5010e-03, -1.7844e-03, -1.2954e-02, ..., -1.4116e-02,\n",
1154 | " -5.1217e-03, -8.3684e-03],\n",
1155 | " ...,\n",
1156 | " [-2.3182e-02, -1.3679e-02, -2.6907e-02, ..., 7.7890e-03,\n",
1157 | " 5.6772e-03, -2.3604e-03],\n",
1158 | " [-1.3363e-02, 3.2209e-03, -2.5748e-02, ..., -2.0797e-02,\n",
1159 | " -1.4555e-02, -1.4172e-02],\n",
1160 | " [-1.8342e-03, -1.0991e-02, -1.9722e-02, ..., -1.5551e-02,\n",
1161 | " -1.0138e-02, -1.0672e-02]]],\n",
1162 | "\n",
1163 | "\n",
1164 | " [[[ 1.0803e-02, 4.7048e-03, 1.6983e-02, ..., 4.1527e-03,\n",
1165 | " 2.2373e-02, 5.4560e-04],\n",
1166 | " [ 6.3237e-03, 2.1544e-02, 1.7252e-02, ..., -2.2766e-03,\n",
1167 | " 1.3347e-02, -4.3080e-03],\n",
1168 | " [ 2.6734e-02, 2.6813e-02, 6.2577e-03, ..., 2.1421e-02,\n",
1169 | " -3.0671e-03, 2.6876e-02],\n",
1170 | " ...,\n",
1171 | " [ 3.8466e-03, 1.4918e-02, 9.1837e-04, ..., 1.4482e-02,\n",
1172 | " -2.3947e-02, 2.3661e-02],\n",
1173 | " [-5.0735e-03, 1.9258e-02, 7.1542e-03, ..., 2.7190e-02,\n",
1174 | " -2.4411e-02, 2.2396e-02],\n",
1175 | " [ 5.5550e-03, 2.6562e-03, 2.5110e-02, ..., 1.3546e-02,\n",
1176 | " 6.1975e-03, 1.0409e-02]],\n",
1177 | "\n",
1178 | " [[-1.1136e-02, 6.9883e-03, 3.0030e-03, ..., -5.5232e-04,\n",
1179 | " -1.7540e-02, -2.3302e-02],\n",
1180 | " [-1.4507e-02, 3.2926e-03, -2.3579e-02, ..., -1.3034e-02,\n",
1181 | " -1.0693e-02, -1.6482e-02],\n",
1182 | " [-1.4580e-02, -9.5563e-03, -6.7839e-03, ..., -1.4063e-02,\n",
1183 | " -1.8502e-02, -2.5409e-02],\n",
1184 | " ...,\n",
1185 | " [-1.0305e-02, 6.6265e-03, -6.3571e-03, ..., -1.4248e-02,\n",
1186 | " -1.3378e-03, -2.7316e-02],\n",
1187 | " [-2.7698e-02, 5.9108e-03, -2.4755e-02, ..., -1.2901e-02,\n",
1188 | " -1.3346e-02, -1.8909e-02],\n",
1189 | " [-7.2682e-03, 2.3862e-03, 7.2970e-03, ..., -1.9567e-03,\n",
1190 | " 2.5399e-03, -1.2041e-02]],\n",
1191 | "\n",
1192 | " [[ 9.3208e-04, -2.4150e-02, -8.2703e-03, ..., -9.9188e-03,\n",
1193 | " -2.7008e-02, -6.4440e-03],\n",
1194 | " [-2.8552e-03, -2.5445e-02, -1.7352e-03, ..., -5.3413e-03,\n",
1195 | " 3.9580e-03, -1.5058e-02],\n",
1196 | " [-2.2481e-02, -7.4268e-03, -1.6228e-02, ..., 6.2900e-03,\n",
1197 | " -4.6813e-03, -2.2208e-02],\n",
1198 | " ...,\n",
1199 | " [-2.2341e-02, 1.4652e-03, -6.4600e-03, ..., -1.5374e-02,\n",
1200 | " -2.3160e-02, -3.9129e-03],\n",
1201 | " [-1.1384e-02, -2.0828e-02, 5.7455e-03, ..., -1.1452e-02,\n",
1202 | " -7.6033e-03, 7.8521e-03],\n",
1203 | " [-1.1966e-03, -1.0845e-02, -9.7271e-04, ..., -9.2989e-03,\n",
1204 | " -8.6757e-03, -2.6281e-02]],\n",
1205 | "\n",
1206 | " ...,\n",
1207 | "\n",
1208 | " [[-1.3458e-02, -7.7781e-03, -2.3052e-02, ..., 2.8025e-03,\n",
1209 | " -7.8977e-03, -3.7936e-03],\n",
1210 | " [-1.1218e-02, -1.6381e-02, 6.8840e-03, ..., 3.5669e-03,\n",
1211 | " -2.7674e-02, -3.5688e-03],\n",
1212 | " [-8.9585e-03, -1.2310e-02, -2.2705e-02, ..., -9.7054e-03,\n",
1213 | " -2.3737e-03, -6.4271e-04],\n",
1214 | " ...,\n",
1215 | " [ 3.4600e-03, -9.8721e-04, 2.1120e-02, ..., -2.6087e-02,\n",
1216 | " -4.4846e-03, -5.2615e-03],\n",
1217 | " [ 8.7108e-04, -8.7200e-03, 1.5654e-02, ..., -9.8368e-03,\n",
1218 | " -1.5175e-02, 1.6077e-03],\n",
1219 | " [ 3.6899e-03, -1.1976e-02, -3.6526e-03, ..., 1.2364e-04,\n",
1220 | " -1.8276e-02, -2.1552e-02]],\n",
1221 | "\n",
1222 | " [[ 2.5739e-03, 3.8341e-03, 4.8284e-03, ..., 1.5254e-02,\n",
1223 | " -1.8352e-02, -1.8539e-02],\n",
1224 | " [-1.0978e-03, 3.0958e-03, -2.1609e-02, ..., -1.6518e-02,\n",
1225 | " 1.1658e-02, -1.6776e-02],\n",
1226 | " [ 2.3345e-02, 1.4186e-02, 7.7396e-03, ..., 2.4179e-02,\n",
1227 | " 7.5861e-03, 1.4574e-03],\n",
1228 | " ...,\n",
1229 | " [ 9.2825e-03, 3.2912e-03, 1.9568e-03, ..., -1.0460e-03,\n",
1230 | " -4.2239e-04, 2.6380e-03],\n",
1231 | " [ 2.2806e-02, 2.7072e-02, 1.1315e-02, ..., 5.2665e-03,\n",
1232 | " 3.7033e-04, 2.7828e-02],\n",
1233 | " [ 2.7164e-02, 1.1026e-03, 2.7055e-03, ..., 1.7518e-02,\n",
1234 | " 2.3056e-02, -6.8682e-03]],\n",
1235 | "\n",
1236 | " [[-1.4881e-02, -5.9023e-03, -1.9649e-02, ..., -4.1369e-04,\n",
1237 | " -1.3280e-02, -2.6200e-02],\n",
1238 | " [-2.6755e-02, -2.1669e-02, 4.5764e-03, ..., -7.8507e-03,\n",
1239 | " 6.4255e-03, 9.9325e-03],\n",
1240 | " [-8.6054e-03, -7.6855e-03, 5.8127e-03, ..., 2.5860e-02,\n",
1241 | " 6.4223e-03, 3.5202e-03],\n",
1242 | " ...,\n",
1243 | " [-6.3107e-03, 4.4912e-03, -7.6356e-03, ..., 2.1135e-02,\n",
1244 | " -1.6345e-03, 5.7075e-03],\n",
1245 | " [ 3.9341e-03, 1.1165e-02, -7.7545e-03, ..., 1.0315e-02,\n",
1246 | " -4.8345e-03, 1.4341e-02],\n",
1247 | " [ 1.8492e-02, 1.3883e-02, 1.0993e-02, ..., 3.8087e-03,\n",
1248 | " 2.1333e-02, 5.9169e-03]]],\n",
1249 | "\n",
1250 | "\n",
1251 | " ...,\n",
1252 | "\n",
1253 | "\n",
1254 | " [[[-1.7079e-02, -2.3652e-02, 1.7911e-02, ..., -1.2363e-02,\n",
1255 | " 2.8492e-03, 7.0113e-03],\n",
1256 | " [ 1.6031e-03, -2.7487e-02, -1.1339e-03, ..., -2.4735e-02,\n",
1257 | " 1.1502e-02, 1.2130e-02],\n",
1258 | " [-5.5296e-04, -2.5571e-02, -6.1638e-04, ..., 1.6285e-02,\n",
1259 | " 1.5937e-02, 6.5888e-03],\n",
1260 | " ...,\n",
1261 | " [-5.1860e-04, -5.0372e-03, 8.0611e-03, ..., -1.0326e-03,\n",
1262 | " -1.7013e-02, 6.6016e-03],\n",
1263 | " [-1.2407e-02, -7.1872e-03, 2.0173e-02, ..., 2.6709e-02,\n",
1264 | " 2.6810e-02, -2.2917e-02],\n",
1265 | " [-4.1939e-03, 1.3234e-02, 7.8543e-03, ..., 5.6746e-03,\n",
1266 | " -1.7797e-02, 4.2977e-03]],\n",
1267 | "\n",
1268 | " [[-5.5146e-03, -1.6946e-02, -6.5365e-03, ..., -2.4159e-02,\n",
1269 | " -2.6040e-02, -9.4051e-03],\n",
1270 | " [ 7.1273e-03, -4.6073e-03, -8.6110e-03, ..., 1.7259e-03,\n",
1271 | " -3.6051e-03, 2.7651e-03],\n",
1272 | " [-1.9700e-02, -2.6362e-02, -9.3747e-03, ..., -2.6163e-03,\n",
1273 | " -1.9860e-02, -4.4046e-04],\n",
1274 | " ...,\n",
1275 | " [-1.1889e-02, -9.4752e-03, -2.4356e-02, ..., -2.3420e-02,\n",
1276 | " -2.0885e-02, -1.9287e-02],\n",
1277 | " [-2.6928e-02, -2.4612e-02, 4.7622e-03, ..., -1.5503e-02,\n",
1278 | " -2.4363e-02, 7.5888e-03],\n",
1279 | " [-1.5518e-02, -2.3157e-02, -1.0659e-03, ..., -2.4205e-02,\n",
1280 | " -9.6639e-03, -2.3377e-02]],\n",
1281 | "\n",
1282 | " [[-2.6864e-02, -2.4899e-02, -2.2055e-03, ..., -1.4565e-02,\n",
1283 | " -8.2756e-03, -2.1349e-02],\n",
1284 | " [-1.9350e-02, -2.6102e-02, -7.5557e-03, ..., -2.6522e-02,\n",
1285 | " -2.1705e-02, -2.3488e-02],\n",
1286 | " [ 6.7886e-03, -2.0861e-02, -7.1895e-03, ..., -2.0731e-02,\n",
1287 | " -1.6870e-02, -1.9063e-02],\n",
1288 | " ...,\n",
1289 | " [-8.5981e-03, -1.5810e-02, -2.1077e-02, ..., 1.8970e-02,\n",
1290 | " -7.3123e-03, 6.5245e-03],\n",
1291 | " [-1.9654e-02, -2.7379e-02, -1.4654e-02, ..., 1.7281e-02,\n",
1292 | " -2.6117e-02, -9.2734e-03],\n",
1293 | " [-1.7851e-02, -7.7316e-03, 4.3901e-03, ..., -3.3982e-03,\n",
1294 | " 5.3714e-03, 4.5850e-03]],\n",
1295 | "\n",
1296 | " ...,\n",
1297 | "\n",
1298 | " [[ 7.6055e-03, -9.5157e-03, -2.1007e-02, ..., 2.3747e-03,\n",
1299 | " 5.1110e-03, -2.7625e-02],\n",
1300 | " [-1.3811e-02, 5.6590e-03, 1.1003e-04, ..., -1.8449e-02,\n",
1301 | " -8.6538e-04, 1.8602e-03],\n",
1302 | " [ 1.5298e-03, 5.9226e-03, -1.5929e-02, ..., -7.0295e-03,\n",
1303 | " -6.9297e-03, -3.3335e-04],\n",
1304 | " ...,\n",
1305 | " [-8.5364e-03, 5.2309e-04, -2.4532e-02, ..., -2.7381e-02,\n",
1306 | " -2.3954e-02, -7.8353e-04],\n",
1307 | " [-1.2966e-02, -9.3232e-04, -1.1649e-02, ..., 7.2251e-03,\n",
1308 | " -2.4828e-02, -7.1678e-03],\n",
1309 | " [-2.7845e-02, -7.3668e-03, -1.3037e-02, ..., -2.5463e-03,\n",
1310 | " -1.1670e-02, 6.9228e-04]],\n",
1311 | "\n",
1312 | " [[ 4.2987e-03, -1.3866e-02, -3.0098e-04, ..., -2.0312e-02,\n",
1313 | " -2.6673e-02, -7.5054e-03],\n",
1314 | " [-2.5288e-02, -2.7234e-02, -3.2072e-03, ..., -1.6922e-03,\n",
1315 | " 5.1159e-03, 1.8809e-03],\n",
1316 | " [-7.8404e-03, -2.4190e-02, -5.6545e-03, ..., -9.9718e-03,\n",
1317 | " 2.2418e-03, -1.8270e-03],\n",
1318 | " ...,\n",
1319 | " [-2.1183e-02, -1.7935e-02, -1.2816e-02, ..., -4.2227e-03,\n",
1320 | " 3.4619e-03, -5.6836e-03],\n",
1321 | " [ 5.1959e-03, 1.4082e-03, -1.8438e-02, ..., 5.0958e-03,\n",
1322 | " -4.6172e-03, -1.0442e-02],\n",
1323 | " [ 3.1867e-03, 1.6476e-02, -2.3770e-03, ..., -1.1497e-03,\n",
1324 | " -5.9099e-03, -1.2312e-05]],\n",
1325 | "\n",
1326 | " [[-4.6278e-03, -1.7988e-02, -1.4015e-02, ..., -7.2963e-03,\n",
1327 | " -1.5966e-02, -2.2753e-02],\n",
1328 | " [-2.2051e-02, -1.8920e-02, -2.3424e-02, ..., -1.3496e-02,\n",
1329 | " -4.3788e-03, -1.8417e-02],\n",
1330 | " [ 6.6881e-03, -2.0990e-03, -1.6915e-02, ..., -1.0629e-02,\n",
1331 | " -1.8865e-02, -2.7226e-02],\n",
1332 | " ...,\n",
1333 | " [-2.1795e-02, -9.9422e-03, 1.1856e-03, ..., -1.4233e-02,\n",
1334 | " -5.5066e-03, -1.3657e-03],\n",
1335 | " [-9.7043e-03, -1.9177e-02, -1.1190e-02, ..., 6.3276e-03,\n",
1336 | " 3.6512e-03, -4.3879e-04],\n",
1337 | " [-3.5802e-03, -1.2609e-02, 3.3233e-03, ..., 6.7619e-04,\n",
1338 | " 4.9258e-03, 3.0377e-03]]],\n",
1339 | "\n",
1340 | "\n",
1341 | " [[[-7.1877e-03, -1.5681e-02, -1.6549e-02, ..., 9.0503e-03,\n",
1342 | " 2.6306e-02, -2.6235e-03],\n",
1343 | " [-2.3821e-02, -8.0970e-03, -7.9879e-03, ..., -2.6150e-02,\n",
1344 | " -1.9651e-02, -2.1417e-02],\n",
1345 | " [ 1.0182e-02, 2.1408e-02, -1.7475e-02, ..., -3.8979e-03,\n",
1346 | " -8.5626e-03, -2.2207e-02],\n",
1347 | " ...,\n",
1348 | " [ 1.2065e-02, -3.3887e-03, -2.4597e-02, ..., -7.3119e-03,\n",
1349 | " 5.5528e-04, -2.4736e-02],\n",
1350 | " [ 6.9064e-03, -1.4728e-03, -7.0641e-03, ..., -5.9020e-03,\n",
1351 | " -1.9837e-03, 9.0277e-04],\n",
1352 | " [ 3.5109e-03, 8.2354e-03, 1.1213e-02, ..., 2.2563e-03,\n",
1353 | " -2.5394e-03, -4.8740e-04]],\n",
1354 | "\n",
1355 | " [[ 1.4663e-02, -2.5992e-02, 6.7058e-03, ..., 1.3753e-03,\n",
1356 | " -1.5902e-02, -3.0446e-04],\n",
1357 | " [-1.5684e-02, 1.5662e-03, 1.4345e-04, ..., 3.9895e-03,\n",
1358 | " -1.3194e-02, -1.8605e-02],\n",
1359 | " [-1.2445e-02, -1.7827e-02, -3.9375e-03, ..., 5.2872e-03,\n",
1360 | " -1.1453e-03, 6.0658e-03],\n",
1361 | " ...,\n",
1362 | " [ 1.9661e-02, -2.8060e-03, 5.9395e-03, ..., -1.0668e-02,\n",
1363 | " -1.9702e-02, -1.1407e-02],\n",
1364 | " [-5.6370e-03, -8.0981e-03, -9.2554e-03, ..., 4.9647e-03,\n",
1365 | " 6.1075e-03, -2.8991e-03],\n",
1366 | " [-3.0469e-04, 9.4089e-03, -3.9601e-03, ..., -1.7853e-02,\n",
1367 | " -2.6795e-02, -1.4895e-03]],\n",
1368 | "\n",
1369 | " [[-1.0753e-02, 1.3153e-02, -7.8495e-03, ..., -6.2965e-03,\n",
1370 | " -6.8527e-03, -4.3924e-03],\n",
1371 | " [ 2.5400e-03, -2.6458e-02, 3.5085e-03, ..., -2.7219e-02,\n",
1372 | " -1.2093e-02, 4.6735e-03],\n",
1373 | " [-1.0301e-02, -2.7772e-02, -2.2750e-02, ..., -7.2343e-03,\n",
1374 | " -5.1331e-04, 2.2712e-03],\n",
1375 | " ...,\n",
1376 | " [-1.7714e-02, -3.8750e-03, 5.8806e-03, ..., 1.6281e-02,\n",
1377 | " -2.3514e-03, 1.7316e-02],\n",
1378 | " [-1.8493e-02, -1.9961e-02, -1.1608e-02, ..., 2.9879e-03,\n",
1379 | " -1.2182e-02, 1.6411e-03],\n",
1380 | " [-3.9716e-03, -2.7665e-02, -1.9828e-02, ..., -6.4639e-03,\n",
1381 | " -9.6503e-03, 5.3992e-04]],\n",
1382 | "\n",
1383 | " ...,\n",
1384 | "\n",
1385 | " [[ 1.6866e-02, 2.1281e-02, -1.9741e-02, ..., -1.8323e-02,\n",
1386 | " -2.5315e-02, -2.2827e-02],\n",
1387 | " [ 1.2587e-02, -2.1247e-02, -1.3705e-02, ..., 4.2168e-04,\n",
1388 | " 4.2513e-03, -1.8466e-02],\n",
1389 | " [-2.4485e-02, -1.5450e-02, -1.6921e-02, ..., 3.0821e-03,\n",
1390 | " -1.4335e-02, 5.8570e-03],\n",
1391 | " ...,\n",
1392 | " [-7.2738e-03, -4.1662e-03, -1.5849e-02, ..., 5.0289e-04,\n",
1393 | " -7.0477e-03, -1.7925e-02],\n",
1394 | " [-3.5463e-03, -1.9288e-02, -1.6590e-02, ..., -4.3331e-03,\n",
1395 | " 4.0621e-03, -1.3745e-02],\n",
1396 | " [ 2.4187e-02, 1.1818e-02, -1.6819e-02, ..., -2.5773e-02,\n",
1397 | " -7.9688e-03, -1.2778e-02]],\n",
1398 | "\n",
1399 | " [[-2.6345e-02, -2.2053e-02, -1.0640e-02, ..., -1.8684e-02,\n",
1400 | " -1.4214e-02, -6.4522e-03],\n",
1401 | " [-1.3135e-02, -1.2603e-02, 2.7860e-03, ..., -1.1153e-02,\n",
1402 | " -2.6949e-02, -1.9304e-02],\n",
1403 | " [ 6.7585e-03, 2.1437e-03, -2.2104e-02, ..., -2.6568e-02,\n",
1404 | " -1.2645e-02, -4.9750e-03],\n",
1405 | " ...,\n",
1406 | " [ 9.7202e-05, 2.2102e-02, -1.1010e-02, ..., -2.9561e-03,\n",
1407 | " -1.6349e-02, -8.2710e-03],\n",
1408 | " [ 1.4986e-02, -2.2819e-03, 1.5725e-02, ..., -2.8215e-03,\n",
1409 | " -8.3108e-04, 7.6056e-03],\n",
1410 | " [ 1.5228e-02, 1.1487e-02, -2.5822e-02, ..., 9.8976e-03,\n",
1411 | " -2.6789e-02, -4.1409e-03]],\n",
1412 | "\n",
1413 | " [[-2.9711e-03, -1.4094e-02, 3.8414e-03, ..., -2.0743e-02,\n",
1414 | " -9.5010e-03, -2.3399e-02],\n",
1415 | " [-5.2331e-04, -6.4809e-03, -2.0062e-02, ..., 7.0671e-03,\n",
1416 | " -1.0242e-02, -1.8892e-02],\n",
1417 | " [-1.8418e-02, -1.2636e-02, 2.0545e-03, ..., -1.7045e-03,\n",
1418 | " -1.2336e-02, -2.4090e-02],\n",
1419 | " ...,\n",
1420 | " [-7.5012e-03, 3.8512e-03, -2.6576e-02, ..., -2.0135e-02,\n",
1421 | " -1.1112e-02, -2.2840e-02],\n",
1422 | " [-9.6134e-03, -2.5728e-02, -1.8202e-02, ..., 6.0040e-04,\n",
1423 | " 7.6143e-03, -7.5557e-03],\n",
1424 | " [ 5.8229e-03, -3.4572e-03, -1.0796e-02, ..., -1.7034e-04,\n",
1425 | " -2.3383e-02, -8.9818e-03]]],\n",
1426 | "\n",
1427 | "\n",
1428 | " [[[-2.3425e-02, -7.5719e-03, 9.8183e-03, ..., -7.3464e-03,\n",
1429 | " 1.0208e-02, 2.6022e-02],\n",
1430 | " [ 1.9817e-02, 2.0486e-03, 7.5612e-03, ..., 2.3252e-02,\n",
1431 | " 3.6919e-03, 2.4617e-02],\n",
1432 | " [ 1.5216e-02, 7.6164e-03, 1.2121e-02, ..., -2.5427e-02,\n",
1433 | " 5.9616e-03, -1.5313e-02],\n",
1434 | " ...,\n",
1435 | " [-1.8953e-02, -2.7664e-02, -8.3372e-04, ..., -1.1394e-02,\n",
1436 | " -3.9599e-03, -1.0342e-03],\n",
1437 | " [-1.6751e-02, -2.0885e-02, -1.7630e-02, ..., -1.6645e-03,\n",
1438 | " -2.3710e-02, -1.7802e-02],\n",
1439 | " [-6.0117e-03, 3.8652e-03, -2.6424e-02, ..., -2.2235e-02,\n",
1440 | " -1.6443e-03, -2.7785e-02]],\n",
1441 | "\n",
1442 | " [[-4.1271e-03, 4.0829e-03, 3.4600e-03, ..., -2.2573e-02,\n",
1443 | " -1.6629e-02, -3.0176e-03],\n",
1444 | " [ 2.0742e-02, -8.8202e-03, -2.5944e-02, ..., 2.3755e-02,\n",
1445 | " -6.2048e-03, 1.5848e-02],\n",
1446 | " [ 6.0385e-03, 9.0078e-03, 1.1106e-02, ..., -2.3429e-02,\n",
1447 | " 6.0346e-03, 2.3764e-02],\n",
1448 | " ...,\n",
1449 | " [-3.2518e-03, 1.1081e-02, -2.9847e-03, ..., 2.1810e-03,\n",
1450 | " 2.1432e-02, 1.4721e-02],\n",
1451 | " [ 2.4611e-03, 2.6107e-02, -1.9289e-03, ..., 1.3872e-02,\n",
1452 | " 2.3297e-03, -1.8788e-03],\n",
1453 | " [ 2.1329e-02, 1.6712e-03, 2.4485e-02, ..., 1.1636e-02,\n",
1454 | " 9.4464e-03, 2.6383e-02]],\n",
1455 | "\n",
1456 | " [[-2.0996e-02, 6.0790e-03, -8.0994e-03, ..., 3.8938e-03,\n",
1457 | " -1.3891e-03, 7.1402e-03],\n",
1458 | " [-7.0939e-03, 6.2268e-03, -1.4198e-02, ..., -5.2488e-03,\n",
1459 | " 1.4681e-02, 1.2842e-02],\n",
1460 | " [ 4.9848e-03, -2.7536e-03, -2.2892e-02, ..., 3.7270e-03,\n",
1461 | " 2.0247e-02, 1.3076e-02],\n",
1462 | " ...,\n",
1463 | " [-1.8175e-03, 1.1675e-02, 1.6029e-02, ..., 3.0613e-03,\n",
1464 | " 1.4126e-03, -1.0311e-03],\n",
1465 | " [ 1.1964e-02, -2.5340e-03, 2.3853e-02, ..., 6.0123e-03,\n",
1466 | " 1.8182e-02, 4.9782e-03],\n",
1467 | " [ 2.6864e-02, -6.5097e-03, 1.3913e-02, ..., -5.3833e-03,\n",
1468 | " 1.0168e-03, 3.6364e-03]],\n",
1469 | "\n",
1470 | " ...,\n",
1471 | "\n",
1472 | " [[-2.2790e-02, -2.2155e-02, 2.9486e-03, ..., -4.1600e-04,\n",
1473 | " -9.5766e-05, -9.7980e-03],\n",
1474 | " [ 2.8710e-04, -8.9594e-03, -2.1569e-03, ..., 3.8048e-03,\n",
1475 | " -9.6475e-03, -1.3285e-02],\n",
1476 | " [-1.6881e-03, -2.4389e-02, -2.6588e-02, ..., -1.8146e-02,\n",
1477 | " -2.5774e-02, -1.9062e-02],\n",
1478 | " ...,\n",
1479 | " [ 6.1846e-03, -2.6508e-02, -2.3966e-02, ..., -8.0941e-03,\n",
1480 | " -1.7214e-03, -1.8662e-02],\n",
1481 | " [-2.4548e-02, 2.0505e-02, -1.8847e-02, ..., -1.8596e-02,\n",
1482 | " -2.2775e-02, -1.5670e-02],\n",
1483 | " [-6.7244e-03, 1.5245e-02, 2.6767e-03, ..., -9.2259e-04,\n",
1484 | " -1.3007e-02, 3.1601e-03]],\n",
1485 | "\n",
1486 | " [[-2.3199e-02, -8.7317e-03, -3.8718e-03, ..., 7.0642e-03,\n",
1487 | " -2.6819e-02, -2.3488e-02],\n",
1488 | " [-2.7719e-02, 1.8092e-03, -4.2290e-03, ..., -3.7541e-03,\n",
1489 | " 2.3110e-02, -5.9336e-03],\n",
1490 | " [-1.3882e-02, -9.4410e-03, 7.1976e-03, ..., 6.1983e-03,\n",
1491 | " 7.5404e-03, 2.6457e-02],\n",
1492 | " ...,\n",
1493 | " [-3.6166e-03, -1.9016e-02, 7.3500e-03, ..., -7.7176e-03,\n",
1494 | " -4.5644e-03, -7.5307e-03],\n",
1495 | " [-1.6041e-02, -1.3890e-03, -8.0973e-03, ..., -2.1373e-02,\n",
1496 | " -1.3475e-02, -1.5834e-02],\n",
1497 | " [-1.5544e-02, -5.1768e-04, 5.4445e-03, ..., -1.8930e-02,\n",
1498 | " -2.3949e-02, -5.7021e-03]],\n",
1499 | "\n",
1500 | " [[ 1.0378e-03, 8.1250e-04, -1.7659e-02, ..., 4.4009e-03,\n",
1501 | " -5.7019e-04, 5.7071e-03],\n",
1502 | " [-8.5712e-04, 5.3408e-03, -2.6760e-02, ..., -2.3124e-02,\n",
1503 | " -5.0353e-03, -1.1309e-02],\n",
1504 | " [ 2.5485e-02, -1.7972e-02, 3.4282e-03, ..., -4.4639e-03,\n",
1505 | " 1.3660e-03, -8.8214e-04],\n",
1506 | " ...,\n",
1507 | " [-9.1250e-03, -1.2143e-02, -1.7638e-03, ..., -2.3895e-02,\n",
1508 | " -2.5546e-02, 5.2568e-03],\n",
1509 | " [-1.0582e-02, 3.3731e-03, -2.1635e-02, ..., -1.5461e-02,\n",
1510 | " -8.5758e-03, -7.9359e-03],\n",
1511 | " [-1.5926e-02, -1.1710e-02, -1.3718e-02, ..., -1.8985e-02,\n",
1512 | " 1.9257e-03, -3.7265e-03]]]]))\n",
1513 | "('6.bias', Parameter containing:\n",
1514 | "tensor(1.00000e-02 *\n",
1515 | " [-0.6255, 4.9319, -3.6779, -2.9463, -2.5801, 0.8595, -1.0889,\n",
1516 | " 4.8599, 0.5028, 1.3037, -0.7622, 3.5637, 1.6952, -2.5448,\n",
1517 | " -0.1713, 1.7510, -3.0964, -0.9239, 2.0107, -1.5601, -4.1642,\n",
1518 | " -1.7541, -0.9685, 2.0369, -0.7735, 4.4888, 1.0942, -0.2250,\n",
1519 | " 1.5792, 1.1349, -1.6582, -1.1896, -1.3102, 4.1395, -0.1528,\n",
1520 | " -4.3832, -3.0477, 2.4790, -0.6793, -0.5944, -2.2985, 0.9787,\n",
1521 | " -1.1641, 0.8887, -2.2574, -0.9951, -1.2451, 2.0503, -7.5850,\n",
1522 | " -0.5772, -1.6409, 0.9793, -1.5066, 4.9639, -2.9812, -1.3580,\n",
1523 | " 0.0373, 1.6401, -0.9795, -2.6780, -0.8956, 3.6520, -1.1645,\n",
1524 | " 2.0801]))\n",
1525 | "('10.weight', Parameter containing:\n",
1526 | "tensor([[-7.5301e-02, -1.7809e-02, -3.9599e-02, ..., 7.6142e-02,\n",
1527 | " -1.0008e-01, -7.2872e-02],\n",
1528 | " [ 5.1972e-02, -1.6626e-01, 8.4465e-02, ..., -7.6805e-02,\n",
1529 | " -9.8366e-02, 6.6758e-02],\n",
1530 | " [-3.3718e-02, 1.3370e-01, -5.7192e-02, ..., -9.0067e-02,\n",
1531 | " 7.1618e-02, -2.5465e-02],\n",
1532 | " ...,\n",
1533 | " [ 6.2247e-02, 6.4090e-02, 8.5833e-02, ..., -1.2668e-02,\n",
1534 | " 1.3935e-02, -5.4030e-02],\n",
1535 | " [-2.3584e-01, 1.3796e-01, 8.0857e-02, ..., 1.2481e-01,\n",
1536 | " -4.7108e-02, -1.1746e-01],\n",
1537 | " [ 1.1030e-01, -4.2672e-02, 2.4807e-02, ..., 3.9567e-02,\n",
1538 | " -5.2033e-02, 5.8760e-02]]))\n",
1539 | "('10.bias', Parameter containing:\n",
1540 | "tensor([-0.0170, -0.0177, 0.0905, 0.0724, 0.0496, 0.0758, 0.0863,\n",
1541 | " -0.0121, -0.1114, -0.1325, 0.0691, 0.0418, 0.0570, 0.0775,\n",
1542 | " 0.1363, -0.0270, 0.0533, -0.0383, -0.0989, 0.0183, 0.0397,\n",
1543 | " 0.1140, 0.0707, 0.0802, 0.0219, -0.0462, -0.0971, -0.0339,\n",
1544 | " 0.0596, 0.1036, -0.0411, -0.0024, 0.0568, 0.0786, -0.0063,\n",
1545 | " -0.1060, 0.0394, -0.1205, 0.0189, -0.0318, 0.0170, -0.1569,\n",
1546 | " 0.1222, -0.0652, -0.0800, -0.1372, -0.0851, -0.1614, -0.0519,\n",
1547 | " -0.1048, 0.1035, -0.0287, -0.0404, -0.1073, 0.0188, 0.1039,\n",
1548 | " -0.0469, 0.0518, 0.0717, 0.0868, 0.0811, 0.0636, 0.0492,\n",
1549 | " -0.0230, -0.0766, -0.0199, 0.0445, -0.0969, 0.0910, -0.0910,\n",
1550 | " 0.0038, -0.0456, 0.0315, -0.0613, -0.0293, -0.0596, 0.0228,\n",
1551 | " -0.0958, 0.1407, -0.0356, -0.0213, -0.0660, 0.0504, 0.0503,\n",
1552 | " -0.0463, 0.0843, 0.0917, 0.0356, -0.0272, -0.1018, -0.0236,\n",
1553 | " -0.1267, -0.0688, 0.0875, 0.0440, -0.0899, 0.0881, 0.0511,\n",
1554 | " 0.1372, -0.0741]))\n",
1555 | "('12.weight', Parameter containing:\n",
1556 | "tensor([[-0.0017, -0.0766, 0.0924, ..., 0.0853, -0.0931, -0.1333],\n",
1557 | " [-0.1053, 0.0104, 0.0136, ..., -0.0441, -0.0201, 0.0947],\n",
1558 | " [ 0.0697, 0.0490, -0.0532, ..., -0.0319, 0.1249, -0.0447],\n",
1559 | " ...,\n",
1560 | " [-0.0374, -0.0541, 0.0537, ..., 0.0963, 0.0487, 0.0269],\n",
1561 | " [ 0.0725, 0.0446, -0.0674, ..., -0.0942, 0.0055, -0.0619],\n",
1562 | " [-0.0330, 0.0317, -0.0500, ..., -0.0020, -0.0695, -0.1809]]))\n",
1563 | "('12.bias', Parameter containing:\n",
1564 | "tensor([-0.0489, 0.1297, -0.0611, 0.0806, -0.0072, -0.0580, -0.0646,\n",
1565 | " 0.0661, -0.0694, -0.0294, -0.0115, -0.0775, 0.0346, -0.0762,\n",
1566 | " -0.1076, 0.0488, -0.1113, -0.0511, -0.0543, 0.0004, -0.0727,\n",
1567 | " -0.0120, -0.1211, 0.1344, -0.0039, 0.0428, 0.0673, 0.1046,\n",
1568 | " 0.0122, -0.0327, -0.0499, 0.0923, -0.1074, -0.0446, 0.0439,\n",
1569 | " -0.1016, -0.0942, -0.1311, -0.0221, 0.1263, 0.0584, -0.0257,\n",
1570 | " -0.0426, 0.0923, 0.0596, 0.0151, 0.0068, -0.0514, -0.0368,\n",
1571 | " -0.0243, 0.0778, 0.0376, 0.0819, -0.0541, 0.0811, 0.0558,\n",
1572 | " -0.0639, 0.0004, 0.0526, -0.0735, 0.0347, -0.0209, -0.0446,\n",
1573 | " -0.1415, -0.0052]))\n"
1574 | ]
1575 | }
1576 | ],
1577 | "source": [
1578 | "for name in model.named_parameters():\n",
1579 | " print (name)"
1580 | ]
1581 | },
1582 | {
1583 | "cell_type": "code",
1584 | "execution_count": 31,
1585 | "metadata": {},
1586 | "outputs": [],
1587 | "source": [
1588 | "first = record[0].view(1, 3,100,100)"
1589 | ]
1590 | },
1591 | {
1592 | "cell_type": "code",
1593 | "execution_count": 32,
1594 | "metadata": {},
1595 | "outputs": [
1596 | {
1597 | "data": {
1598 | "text/plain": [
1599 | "torch.Size([1, 3, 100, 100])"
1600 | ]
1601 | },
1602 | "execution_count": 32,
1603 | "metadata": {},
1604 | "output_type": "execute_result"
1605 | }
1606 | ],
1607 | "source": [
1608 | "first.shape"
1609 | ]
1610 | },
1611 | {
1612 | "cell_type": "code",
1613 | "execution_count": 34,
1614 | "metadata": {},
1615 | "outputs": [
1616 | {
1617 | "data": {
1618 | "text/plain": [
1619 | "tensor([ 50])"
1620 | ]
1621 | },
1622 | "execution_count": 34,
1623 | "metadata": {},
1624 | "output_type": "execute_result"
1625 | }
1626 | ],
1627 | "source": [
1628 | "model(first).max(1)[1]"
1629 | ]
1630 | },
1631 | {
1632 | "cell_type": "code",
1633 | "execution_count": 38,
1634 | "metadata": {},
1635 | "outputs": [
1636 | {
1637 | "data": {
1638 | "text/plain": [
1639 | "50"
1640 | ]
1641 | },
1642 | "execution_count": 38,
1643 | "metadata": {},
1644 | "output_type": "execute_result"
1645 | }
1646 | ],
1647 | "source": [
1648 | "labels_train[0]"
1649 | ]
1650 | },
1651 | {
1652 | "cell_type": "code",
1653 | "execution_count": 39,
1654 | "metadata": {},
1655 | "outputs": [],
1656 | "source": [
1657 | "record = iter(test_loader).next()[0][0]"
1658 | ]
1659 | },
1660 | {
1661 | "cell_type": "code",
1662 | "execution_count": 41,
1663 | "metadata": {},
1664 | "outputs": [],
1665 | "source": [
1666 | "first = record.view(1, 3,100,100)"
1667 | ]
1668 | },
1669 | {
1670 | "cell_type": "code",
1671 | "execution_count": 42,
1672 | "metadata": {},
1673 | "outputs": [
1674 | {
1675 | "data": {
1676 | "text/plain": [
1677 | "tensor([ 26])"
1678 | ]
1679 | },
1680 | "execution_count": 42,
1681 | "metadata": {},
1682 | "output_type": "execute_result"
1683 | }
1684 | ],
1685 | "source": [
1686 | "model(first).max(1)[1]"
1687 | ]
1688 | },
1689 | {
1690 | "cell_type": "code",
1691 | "execution_count": 43,
1692 | "metadata": {},
1693 | "outputs": [
1694 | {
1695 | "data": {
1696 | "text/plain": [
1697 | "44"
1698 | ]
1699 | },
1700 | "execution_count": 43,
1701 | "metadata": {},
1702 | "output_type": "execute_result"
1703 | }
1704 | ],
1705 | "source": [
1706 | "labels_test[0]"
1707 | ]
1708 | },
1709 | {
1710 | "cell_type": "code",
1711 | "execution_count": 52,
1712 | "metadata": {},
1713 | "outputs": [
1714 | {
1715 | "data": {
1716 | "text/plain": [
1717 | "OrderedDict([('0.weight',\n",
1718 | " tensor([[[[-0.0016, 0.0048, -0.0146, -0.1456, -0.1541],\n",
1719 | " [-0.0630, 0.0308, 0.0080, -0.1073, -0.1134],\n",
1720 | " [-0.1058, 0.0090, -0.1061, 0.0478, 0.0654],\n",
1721 | " [ 0.0175, 0.0800, 0.0240, 0.0162, 0.0625],\n",
1722 | " [ 0.0913, -0.0833, -0.0338, 0.0798, -0.0163]],\n",
1723 | " \n",
1724 | " [[ 0.0605, 0.0374, 0.0662, -0.1401, -0.0259],\n",
1725 | " [ 0.0589, -0.1049, 0.0120, -0.0084, -0.1260],\n",
1726 | " [-0.0768, -0.1128, -0.0596, 0.0139, 0.0571],\n",
1727 | " [ 0.0931, -0.0645, -0.0827, 0.0600, 0.0205],\n",
1728 | " [ 0.1170, 0.1265, -0.0124, -0.0439, 0.1113]],\n",
1729 | " \n",
1730 | " [[-0.0642, -0.0756, 0.0292, 0.0497, -0.1144],\n",
1731 | " [ 0.0153, -0.0897, -0.0337, 0.0108, -0.1262],\n",
1732 | " [ 0.0991, -0.0447, -0.0442, -0.0280, 0.0873],\n",
1733 | " [-0.0269, 0.0825, -0.1120, -0.0491, -0.0136],\n",
1734 | " [ 0.0866, -0.0420, 0.1009, 0.1126, 0.0893]]],\n",
1735 | " \n",
1736 | " \n",
1737 | " [[[-0.0209, 0.0852, 0.0590, -0.0332, -0.0586],\n",
1738 | " [ 0.0518, 0.1475, 0.0091, 0.0288, 0.0954],\n",
1739 | " [ 0.0341, 0.0415, -0.0412, 0.0043, 0.1360],\n",
1740 | " [ 0.1538, -0.0249, 0.0003, 0.1572, 0.0010],\n",
1741 | " [ 0.0510, 0.0192, 0.1027, 0.1332, 0.0991]],\n",
1742 | " \n",
1743 | " [[ 0.0177, -0.0105, -0.0383, 0.0657, 0.0859],\n",
1744 | " [-0.0725, -0.1320, -0.0927, -0.1090, -0.0635],\n",
1745 | " [ 0.0969, -0.0837, -0.1208, 0.0329, -0.0886],\n",
1746 | " [-0.0370, 0.0143, -0.0048, -0.0736, -0.0601],\n",
1747 | " [-0.0365, -0.0917, -0.0431, -0.0236, -0.0755]],\n",
1748 | " \n",
1749 | " [[ 0.0102, -0.0525, 0.0135, -0.0179, -0.0234],\n",
1750 | " [ 0.0643, -0.0145, 0.1480, 0.0188, 0.0504],\n",
1751 | " [ 0.0169, -0.0020, 0.0158, -0.0133, -0.0076],\n",
1752 | " [ 0.1242, -0.0200, 0.0480, 0.1099, 0.0300],\n",
1753 | " [ 0.0524, -0.0310, 0.0239, 0.0870, 0.1372]]],\n",
1754 | " \n",
1755 | " \n",
1756 | " [[[-0.0898, -0.0185, -0.0380, -0.0599, -0.0783],\n",
1757 | " [ 0.0435, -0.0673, -0.0520, -0.0430, 0.0795],\n",
1758 | " [-0.0218, -0.0063, 0.0079, 0.0160, 0.0481],\n",
1759 | " [ 0.0058, 0.1550, 0.0125, 0.0755, 0.0940],\n",
1760 | " [ 0.1355, 0.0955, 0.1428, 0.1401, 0.1735]],\n",
1761 | " \n",
1762 | " [[-0.1866, -0.1629, 0.0517, -0.0109, -0.1201],\n",
1763 | " [-0.1588, -0.1707, -0.1438, 0.0682, 0.0742],\n",
1764 | " [-0.0229, -0.1558, 0.0158, -0.1283, 0.0976],\n",
1765 | " [-0.1197, -0.0310, -0.0727, 0.0966, -0.0852],\n",
1766 | " [ 0.0389, 0.0312, 0.0191, 0.0596, 0.0384]],\n",
1767 | " \n",
1768 | " [[ 0.0068, 0.0797, -0.0105, 0.0056, 0.1451],\n",
1769 | " [ 0.0565, -0.0742, -0.0368, 0.0914, 0.0443],\n",
1770 | " [-0.0046, 0.1062, 0.0461, 0.1649, 0.1579],\n",
1771 | " [ 0.1141, -0.0795, 0.1050, -0.0006, 0.0684],\n",
1772 | " [-0.0832, -0.0160, 0.0237, 0.1942, 0.1150]]],\n",
1773 | " \n",
1774 | " \n",
1775 | " ...,\n",
1776 | " \n",
1777 | " \n",
1778 | " [[[-0.0482, -0.0629, -0.1348, -0.0321, -0.1168],\n",
1779 | " [-0.0721, -0.0334, -0.0868, -0.0112, 0.0183],\n",
1780 | " [ 0.0814, -0.0759, 0.0558, 0.0165, -0.1443],\n",
1781 | " [ 0.0478, -0.1126, 0.0319, 0.0282, 0.0392],\n",
1782 | " [-0.0818, 0.0456, 0.0469, 0.0682, -0.0889]],\n",
1783 | " \n",
1784 | " [[-0.0964, -0.0441, -0.0376, -0.1273, 0.0643],\n",
1785 | " [-0.0678, 0.0213, -0.0184, 0.0526, 0.0937],\n",
1786 | " [-0.0995, -0.0961, 0.0146, 0.0857, 0.0363],\n",
1787 | " [-0.0216, -0.1249, 0.0229, -0.0659, -0.0795],\n",
1788 | " [ 0.0812, -0.0560, -0.1054, -0.0096, 0.0889]],\n",
1789 | " \n",
1790 | " [[-0.0897, -0.1021, 0.0180, 0.0298, -0.0659],\n",
1791 | " [ 0.0528, -0.1170, -0.0548, 0.0178, -0.0131],\n",
1792 | " [ 0.0153, 0.0072, 0.0386, 0.0121, -0.1135],\n",
1793 | " [-0.1317, 0.0072, -0.0720, 0.0915, -0.1055],\n",
1794 | " [-0.1206, -0.0260, -0.1168, 0.0285, -0.1064]]],\n",
1795 | " \n",
1796 | " \n",
1797 | " [[[ 0.0775, 0.0365, 0.0013, 0.0921, 0.1069],\n",
1798 | " [-0.0504, -0.0125, -0.0210, 0.0183, 0.0713],\n",
1799 | " [-0.0559, -0.0774, -0.1068, -0.0869, -0.0683],\n",
1800 | " [-0.0192, 0.0008, 0.0784, 0.0213, -0.0400],\n",
1801 | " [-0.0524, 0.0806, -0.0096, 0.0329, -0.0262]],\n",
1802 | " \n",
1803 | " [[ 0.0902, 0.0546, 0.0144, 0.1076, -0.0733],\n",
1804 | " [ 0.0053, -0.0091, -0.0023, -0.0353, -0.0744],\n",
1805 | " [ 0.0175, -0.0493, -0.0767, -0.0778, -0.0176],\n",
1806 | " [ 0.0258, 0.0045, 0.0684, 0.0814, 0.0049],\n",
1807 | " [-0.0952, 0.0733, 0.0422, 0.0057, -0.0058]],\n",
1808 | " \n",
1809 | " [[-0.0374, 0.0999, 0.0383, 0.0544, 0.1199],\n",
1810 | " [-0.1001, -0.0429, 0.1261, -0.0481, -0.0135],\n",
1811 | " [ 0.0285, 0.0622, -0.0188, 0.0707, -0.0995],\n",
1812 | " [-0.0672, 0.1120, 0.0732, 0.0780, 0.0502],\n",
1813 | " [-0.1165, 0.0694, 0.0052, -0.0275, 0.0033]]],\n",
1814 | " \n",
1815 | " \n",
1816 | " [[[-0.0018, 0.1250, -0.0596, 0.0056, -0.0844],\n",
1817 | " [ 0.0031, -0.0784, -0.0879, 0.1046, 0.0131],\n",
1818 | " [ 0.0248, 0.1182, 0.0623, 0.1107, 0.0702],\n",
1819 | " [-0.0020, -0.0631, 0.0097, -0.0636, -0.0109],\n",
1820 | " [-0.0106, 0.1198, 0.0468, -0.0776, 0.0931]],\n",
1821 | " \n",
1822 | " [[ 0.0912, -0.0293, -0.1130, -0.1091, -0.1368],\n",
1823 | " [-0.0486, -0.0580, -0.0293, 0.0825, 0.0432],\n",
1824 | " [-0.0488, -0.0165, -0.0907, 0.1175, -0.1161],\n",
1825 | " [-0.0058, 0.0306, -0.0454, 0.0105, 0.1014],\n",
1826 | " [ 0.1089, 0.0913, 0.0672, 0.0102, 0.0053]],\n",
1827 | " \n",
1828 | " [[-0.0369, 0.1566, 0.0700, 0.0545, 0.0613],\n",
1829 | " [ 0.0877, 0.0052, 0.0940, 0.1503, 0.0434],\n",
1830 | " [-0.0281, 0.0453, 0.0012, 0.0196, -0.0414],\n",
1831 | " [ 0.0855, -0.0163, 0.1347, 0.0424, 0.0502],\n",
1832 | " [ 0.0874, 0.0372, 0.1193, 0.1401, 0.1866]]]])),\n",
1833 | " ('0.bias',\n",
1834 | " tensor([-0.0074, -0.0474, 0.0857, 0.1327, 0.0287, 0.1414, 0.1547,\n",
1835 | " 0.0509, -0.0440, -0.0592, 0.0788, -0.0021, 0.0642, 0.1670,\n",
1836 | " 0.0317, 0.0466, 0.1044, -0.0274, -0.0708, 0.0774, 0.0230,\n",
1837 | " 0.0278, 0.1082, 0.1173, 0.0120, -0.0614, 0.0690, 0.0154,\n",
1838 | " -0.0326, 0.0599, -0.0667, 0.0317, -0.0404, 0.1326, -0.0984,\n",
1839 | " 0.0518, -0.0816, -0.0412, -0.0766, 0.0903, -0.0249, -0.0253,\n",
1840 | " 0.2320, -0.0652, -0.0272, 0.0391, 0.0159, -0.0892, -0.0242,\n",
1841 | " -0.0119, -0.0370, 0.1231, -0.0702, -0.0439, -0.0870, 0.0212,\n",
1842 | " 0.1375, -0.1098, 0.0907, 0.0009, 0.0788, 0.0816, -0.1044,\n",
1843 | " 0.0091])),\n",
1844 | " ('3.weight',\n",
1845 | " tensor([[[[-2.6779e-02, -1.2962e-02, -6.7731e-03, ..., -2.1328e-02,\n",
1846 | " -1.5803e-02, -7.1797e-03],\n",
1847 | " [-1.8022e-02, -2.3607e-03, -2.2527e-02, ..., -3.2269e-02,\n",
1848 | " 1.1309e-02, 7.9132e-03],\n",
1849 | " [-1.8926e-02, -1.6236e-02, -1.8413e-02, ..., 9.0630e-03,\n",
1850 | " 9.2606e-03, 1.7090e-02],\n",
1851 | " ...,\n",
1852 | " [-3.7086e-03, -7.2559e-04, 1.0614e-02, ..., 6.1826e-04,\n",
1853 | " -1.2080e-02, 4.3929e-04],\n",
1854 | " [-2.3554e-02, -1.1957e-02, -6.5553e-03, ..., -1.1912e-02,\n",
1855 | " -1.3815e-02, -2.2450e-03],\n",
1856 | " [-2.0905e-02, -2.5623e-02, -3.3727e-02, ..., -8.8794e-03,\n",
1857 | " 2.5970e-03, 8.4659e-04]],\n",
1858 | " \n",
1859 | " [[-1.0403e-02, 9.8815e-03, 1.3379e-02, ..., 1.6973e-02,\n",
1860 | " -7.1956e-03, 4.0096e-03],\n",
1861 | " [ 1.1212e-02, -1.4063e-02, 1.7008e-02, ..., -6.0592e-03,\n",
1862 | " -1.2660e-02, -1.1657e-02],\n",
1863 | " [-3.2382e-02, -4.0698e-03, 6.5229e-03, ..., -3.1508e-03,\n",
1864 | " -3.7202e-02, -1.1686e-02],\n",
1865 | " ...,\n",
1866 | " [-9.1540e-03, 1.0237e-02, 1.6859e-02, ..., 8.6157e-03,\n",
1867 | " -3.7181e-03, 9.6950e-03],\n",
1868 | " [-1.7268e-02, 1.4214e-02, -1.1315e-02, ..., -8.8661e-03,\n",
1869 | " -1.2371e-02, 6.7527e-03],\n",
1870 | " [ 9.9682e-03, -1.3675e-02, -6.5624e-03, ..., 3.1749e-03,\n",
1871 | " 9.4326e-03, -2.9477e-03]],\n",
1872 | " \n",
1873 | " [[-7.0483e-03, -3.1922e-02, -2.1498e-02, ..., -3.1507e-03,\n",
1874 | " -3.0696e-02, -2.8737e-03],\n",
1875 | " [-6.8231e-03, -1.3644e-02, -1.6670e-03, ..., -2.8231e-02,\n",
1876 | " -3.1186e-02, -2.6410e-02],\n",
1877 | " [-9.8460e-03, -3.6508e-02, -1.1149e-02, ..., -1.7134e-02,\n",
1878 | " -3.2647e-02, -2.3700e-02],\n",
1879 | " ...,\n",
1880 | " [-5.7745e-04, 9.0411e-04, -1.4712e-02, ..., 1.3643e-02,\n",
1881 | " -1.8622e-03, -1.3857e-02],\n",
1882 | " [-3.7543e-02, 1.7850e-02, -2.0641e-03, ..., 5.8658e-03,\n",
1883 | " 4.6741e-03, -8.6243e-03],\n",
1884 | " [-3.3316e-02, -4.9936e-03, -1.4988e-02, ..., -8.6911e-05,\n",
1885 | " -1.7218e-02, -2.7561e-03]],\n",
1886 | " \n",
1887 | " ...,\n",
1888 | " \n",
1889 | " [[ 1.5939e-02, -1.4361e-02, 1.4564e-02, ..., -8.7929e-03,\n",
1890 | " -1.2084e-02, 1.2491e-02],\n",
1891 | " [ 1.7160e-02, -6.9554e-03, 1.0544e-02, ..., -1.0389e-02,\n",
1892 | " -4.2872e-03, -4.1053e-03],\n",
1893 | " [-2.0027e-03, 1.0370e-02, 1.7050e-02, ..., -6.4324e-03,\n",
1894 | " 1.6785e-02, 3.4043e-03],\n",
1895 | " ...,\n",
1896 | " [ 1.3323e-02, -3.4984e-03, -1.5882e-02, ..., -2.4456e-03,\n",
1897 | " 2.4521e-03, 1.6473e-02],\n",
1898 | " [-1.7732e-02, 1.5460e-02, 6.0378e-03, ..., -1.2608e-02,\n",
1899 | " 1.7068e-02, 1.6477e-02],\n",
1900 | " [ 7.6953e-03, 9.7408e-03, -5.5379e-03, ..., -1.6686e-03,\n",
1901 | " -1.5905e-03, 1.2670e-02]],\n",
1902 | " \n",
1903 | " [[-2.7136e-02, -3.4884e-02, -3.1536e-02, ..., 8.7532e-03,\n",
1904 | " 1.7536e-02, -8.5740e-03],\n",
1905 | " [-3.2289e-02, -2.1074e-02, -2.7792e-03, ..., 1.3592e-03,\n",
1906 | " 6.7092e-03, 8.8825e-03],\n",
1907 | " [-2.4370e-03, -2.1794e-02, -1.4332e-02, ..., -2.6290e-03,\n",
1908 | " -9.7182e-04, -1.3434e-02],\n",
1909 | " ...,\n",
1910 | " [-2.7251e-02, -5.9368e-03, -1.7157e-02, ..., 4.8391e-03,\n",
1911 | " 1.3846e-02, -2.5880e-02],\n",
1912 | " [-8.4309e-03, -9.7086e-03, -8.2329e-03, ..., -1.1860e-02,\n",
1913 | " -1.2285e-02, 6.6090e-03],\n",
1914 | " [-2.8973e-03, 9.6497e-03, 2.2892e-03, ..., 1.2426e-02,\n",
1915 | " -9.8844e-03, -2.6804e-02]],\n",
1916 | " \n",
1917 | " [[-1.7853e-03, 1.4545e-02, 1.3259e-02, ..., 6.5922e-03,\n",
1918 | " -5.1442e-03, -1.0759e-02],\n",
1919 | " [ 1.4357e-02, 4.0669e-03, 1.0755e-02, ..., -1.3151e-02,\n",
1920 | " 1.4049e-02, 1.1277e-03],\n",
1921 | " [ 9.0401e-03, 1.0939e-02, -1.3673e-02, ..., -8.7622e-03,\n",
1922 | " 5.9570e-04, -1.2833e-02],\n",
1923 | " ...,\n",
1924 | " [ 2.0013e-03, 6.9983e-03, 4.6257e-03, ..., -8.0778e-03,\n",
1925 | " 1.2425e-02, -9.2927e-03],\n",
1926 | " [ 1.3665e-02, -1.7009e-02, 3.3687e-03, ..., -4.1017e-03,\n",
1927 | " -1.0301e-02, 1.4668e-02],\n",
1928 | " [ 5.8163e-03, -2.8335e-06, 9.8780e-04, ..., 1.0928e-02,\n",
1929 | " -1.1426e-02, -1.3808e-02]]],\n",
1930 | " \n",
1931 | " \n",
1932 | " [[[-2.8145e-02, -1.8742e-02, -5.5234e-03, ..., 4.0994e-03,\n",
1933 | " 2.8125e-04, -3.5711e-02],\n",
1934 | " [-1.9029e-02, -3.9364e-03, -6.7715e-03, ..., -9.1552e-03,\n",
1935 | " 1.5949e-02, 4.7563e-03],\n",
1936 | " [-7.7093e-03, -3.4516e-02, -2.2431e-02, ..., -3.2317e-02,\n",
1937 | " 9.8823e-03, 1.2922e-03],\n",
1938 | " ...,\n",
1939 | " [-2.9283e-02, -2.6186e-02, -1.6897e-02, ..., -4.7393e-03,\n",
1940 | " -3.1830e-02, -1.0085e-02],\n",
1941 | " [-3.5755e-02, -3.4435e-02, -1.2168e-02, ..., -2.0105e-02,\n",
1942 | " -4.2665e-03, -2.0468e-02],\n",
1943 | " [-3.3734e-02, -1.6996e-02, -9.8357e-03, ..., -2.9043e-02,\n",
1944 | " -3.3291e-02, -1.3980e-02]],\n",
1945 | " \n",
1946 | " [[-6.3367e-03, -4.0852e-03, -1.3327e-02, ..., -6.2933e-03,\n",
1947 | " 1.3628e-02, 8.6691e-03],\n",
1948 | " [ 1.3802e-02, -7.2884e-03, -1.4474e-02, ..., 1.3953e-02,\n",
1949 | " -5.3896e-03, 9.0456e-03],\n",
1950 | " [-6.9317e-03, 1.6150e-02, 8.1835e-03, ..., -3.0702e-04,\n",
1951 | " 1.3830e-02, -1.6633e-03],\n",
1952 | " ...,\n",
1953 | " [-8.3356e-04, -9.3114e-03, 7.4694e-03, ..., -1.2985e-02,\n",
1954 | " -1.4350e-02, 4.2311e-03],\n",
1955 | " [-5.0927e-03, 1.0877e-02, 4.0688e-03, ..., 9.2379e-03,\n",
1956 | " -1.0290e-02, 1.0049e-02],\n",
1957 | " [-9.4879e-03, 1.0646e-02, 1.3236e-02, ..., -9.2430e-03,\n",
1958 | " -1.0380e-03, -1.4155e-02]],\n",
1959 | " \n",
1960 | " [[-3.6744e-02, -2.1535e-02, -3.1799e-02, ..., -1.4108e-02,\n",
1961 | " 2.2022e-03, 1.5080e-02],\n",
1962 | " [-2.9610e-02, -4.6011e-03, -1.4337e-02, ..., -8.4109e-03,\n",
1963 | " 4.4273e-03, -2.2268e-02],\n",
1964 | " [-1.1714e-02, -5.3899e-03, -1.1769e-02, ..., -2.0215e-02,\n",
1965 | " -4.4180e-03, -9.1483e-03],\n",
1966 | " ...,\n",
1967 | " [-3.1818e-02, -2.7536e-02, -1.3271e-02, ..., -6.5540e-03,\n",
1968 | " -7.9542e-03, -1.0677e-02],\n",
1969 | " [-9.0505e-03, -3.1940e-02, -1.5119e-02, ..., -2.1554e-02,\n",
1970 | " -1.0521e-02, -2.7976e-02],\n",
1971 | " [-2.0902e-02, -3.2283e-03, -1.3045e-02, ..., -3.6176e-02,\n",
1972 | " -2.9619e-02, -1.6289e-02]],\n",
1973 | " \n",
1974 | " ...,\n",
1975 | " \n",
1976 | " [[-1.4943e-02, 1.2392e-03, 1.6166e-02, ..., -1.1477e-02,\n",
1977 | " -1.5734e-02, -1.2199e-02],\n",
1978 | " [ 1.1283e-02, 1.1453e-03, 1.2160e-02, ..., 6.1564e-03,\n",
1979 | " 3.5162e-03, -8.8078e-03],\n",
1980 | " [ 1.5972e-02, 1.8743e-03, -1.4592e-02, ..., 7.7799e-03,\n",
1981 | " -4.6349e-03, 3.2799e-03],\n",
1982 | " ...,\n",
1983 | " [ 8.4355e-03, -4.7946e-04, -1.7618e-02, ..., -1.6736e-02,\n",
1984 | " -6.3067e-03, 6.9063e-03],\n",
1985 | " [ 1.0057e-02, 5.4642e-03, 1.1619e-02, ..., 1.4251e-02,\n",
1986 | " -8.2950e-03, 1.3677e-02],\n",
1987 | " [ 3.1885e-03, -1.5601e-05, 1.7460e-02, ..., -1.1777e-02,\n",
1988 | " -6.7834e-03, 3.3414e-03]],\n",
1989 | " \n",
1990 | " [[-3.0452e-02, -1.2080e-02, 1.0256e-02, ..., -3.0990e-02,\n",
1991 | " 8.6174e-03, 1.6501e-03],\n",
1992 | " [-5.2719e-04, -3.2968e-02, -2.6674e-02, ..., -1.6440e-02,\n",
1993 | " -3.6365e-03, -3.2362e-02],\n",
1994 | " [-2.7233e-02, -2.7331e-02, -3.5724e-02, ..., -9.7884e-03,\n",
1995 | " -3.2167e-02, -9.0837e-03],\n",
1996 | " ...,\n",
1997 | " [-2.0292e-02, -3.3341e-03, -7.6577e-03, ..., 1.4283e-02,\n",
1998 | " -1.4460e-03, -1.3133e-02],\n",
1999 | " [-3.3671e-02, -1.4031e-02, -7.2689e-03, ..., 1.6328e-02,\n",
2000 | " -7.3200e-03, -2.9146e-02],\n",
2001 | " [-2.9474e-02, -2.9688e-02, -1.0572e-02, ..., -3.2480e-02,\n",
2002 | " -1.3261e-02, -1.5741e-02]],\n",
2003 | " \n",
2004 | " [[-2.3804e-03, 5.5173e-03, -1.2740e-02, ..., -4.8662e-03,\n",
2005 | " -7.2586e-03, 1.0922e-02],\n",
2006 | " [-6.3082e-03, -9.7869e-03, -1.6668e-02, ..., -1.0346e-02,\n",
2007 | " -7.1375e-04, -1.4136e-02],\n",
2008 | " [-9.3555e-03, 5.5218e-03, 1.6871e-02, ..., -7.9774e-03,\n",
2009 | " 1.0834e-02, 6.2287e-03],\n",
2010 | " ...,\n",
2011 | " [-1.0119e-02, -1.4812e-03, -2.6835e-03, ..., 5.7517e-03,\n",
2012 | " 1.2835e-02, 8.3581e-03],\n",
2013 | " [-1.7669e-02, -4.3534e-04, -1.3433e-02, ..., 1.3524e-02,\n",
2014 | " 5.1122e-04, 1.2765e-02],\n",
2015 | " [-1.2379e-02, -4.0298e-03, 1.3297e-02, ..., -9.6577e-03,\n",
2016 | " -8.4847e-03, -1.0439e-02]]],\n",
2017 | " \n",
2018 | " \n",
2019 | " [[[-2.2538e-03, -4.1233e-03, -1.0215e-02, ..., -2.4550e-03,\n",
2020 | " -2.0032e-02, -2.6995e-02],\n",
2021 | " [-3.4619e-02, -1.8392e-02, -2.5360e-02, ..., -1.4965e-02,\n",
2022 | " -1.0830e-02, -3.1260e-02],\n",
2023 | " [-1.0557e-02, -2.3744e-02, 1.6909e-03, ..., -6.7882e-03,\n",
2024 | " 1.5083e-03, -1.6190e-02],\n",
2025 | " ...,\n",
2026 | " [-1.7339e-03, 6.6879e-03, -9.7566e-03, ..., 1.1324e-02,\n",
2027 | " -2.9404e-02, 1.9570e-02],\n",
2028 | " [ 1.0242e-02, -9.2871e-03, -9.3168e-03, ..., -1.3156e-02,\n",
2029 | " -1.4865e-02, -1.1270e-02],\n",
2030 | " [ 1.9390e-02, -8.4842e-03, 9.8267e-03, ..., 4.0320e-03,\n",
2031 | " -2.6696e-02, -1.6334e-02]],\n",
2032 | " \n",
2033 | " [[-9.2508e-03, -1.1350e-02, -1.7665e-02, ..., 4.3904e-03,\n",
2034 | " 2.7492e-03, -5.2415e-03],\n",
2035 | " [-8.4670e-03, -7.3156e-03, -1.9307e-02, ..., -2.3375e-02,\n",
2036 | " -1.0639e-02, -1.7652e-02],\n",
2037 | " [-2.3184e-02, -1.7577e-02, -6.0105e-03, ..., 4.4489e-03,\n",
2038 | " -2.6661e-02, 3.8427e-03],\n",
2039 | " ...,\n",
2040 | " [-7.8044e-03, -1.7909e-02, 2.7993e-03, ..., -1.1152e-03,\n",
2041 | " 7.6839e-03, -1.1714e-02],\n",
2042 | " [-9.9899e-03, 2.4783e-03, -3.1628e-03, ..., -1.6662e-02,\n",
2043 | " -1.4662e-02, 6.5154e-03],\n",
2044 | " [-1.4905e-02, -1.5384e-02, -1.1265e-02, ..., -4.1862e-03,\n",
2045 | " -1.9127e-03, -2.4848e-02]],\n",
2046 | " \n",
2047 | " [[ 3.4846e-03, 8.0098e-03, 1.7443e-02, ..., 1.2480e-02,\n",
2048 | " -1.2735e-02, 8.6934e-03],\n",
2049 | " [-8.2303e-03, -1.7087e-02, -1.0395e-02, ..., -1.6124e-02,\n",
2050 | " 7.0822e-03, -3.8555e-04],\n",
2051 | " [-5.2301e-03, 4.9656e-03, 9.1322e-03, ..., -3.9297e-03,\n",
2052 | " -1.1945e-02, -3.1185e-03],\n",
2053 | " ...,\n",
2054 | " [ 1.0450e-02, 1.8954e-02, 2.9704e-03, ..., 1.4643e-02,\n",
2055 | " 1.6012e-02, -3.2929e-03],\n",
2056 | " [ 1.0485e-02, 7.6941e-03, 7.7856e-03, ..., 6.2871e-03,\n",
2057 | " 7.3308e-03, 1.3855e-02],\n",
2058 | " [-1.3529e-02, -2.3717e-03, -1.4512e-02, ..., 1.0026e-02,\n",
2059 | " -1.6163e-02, -5.7107e-03]],\n",
2060 | " \n",
2061 | " ...,\n",
2062 | " \n",
2063 | " [[-1.4811e-02, -2.7844e-02, -2.0868e-02, ..., -2.6010e-02,\n",
2064 | " -2.7611e-02, 6.3969e-03],\n",
2065 | " [-2.2012e-03, -1.9145e-02, -1.9199e-02, ..., -2.0287e-02,\n",
2066 | " -2.2382e-02, -2.2633e-03],\n",
2067 | " [-1.0251e-02, -1.5751e-02, -2.7219e-02, ..., 2.9438e-03,\n",
2068 | " -2.6035e-02, -2.6711e-02],\n",
2069 | " ...,\n",
2070 | " [-3.0947e-04, 5.9995e-03, 2.1770e-05, ..., -1.0780e-02,\n",
2071 | " 4.2132e-03, 3.1212e-03],\n",
2072 | " [-1.9642e-02, -1.5439e-02, -1.3787e-02, ..., -2.8270e-02,\n",
2073 | " -8.3740e-03, -6.7641e-03],\n",
2074 | " [-6.7095e-03, -1.8616e-02, -2.7250e-02, ..., -2.8718e-02,\n",
2075 | " -2.0472e-02, 4.0441e-04]],\n",
2076 | " \n",
2077 | " [[-2.8262e-02, -7.3320e-03, -1.9765e-02, ..., -8.0278e-03,\n",
2078 | " 1.7557e-02, 1.8543e-02],\n",
2079 | " [-1.7225e-02, -1.3504e-02, -2.6834e-02, ..., -2.0847e-02,\n",
2080 | " -3.4311e-03, 8.1041e-03],\n",
2081 | " [-2.3213e-02, 8.8160e-03, 1.5753e-02, ..., -1.5599e-02,\n",
2082 | " -2.2783e-02, 1.7687e-03],\n",
2083 | " ...,\n",
2084 | " [-1.2956e-02, -3.4006e-02, -1.7315e-02, ..., -6.5962e-03,\n",
2085 | " -3.2383e-02, 1.5012e-02],\n",
2086 | " [ 1.8599e-02, -1.7383e-02, -1.5422e-02, ..., -9.3824e-03,\n",
2087 | " -1.5369e-02, -2.1481e-02],\n",
2088 | " [-3.9189e-04, -1.3674e-02, -2.4964e-02, ..., -9.4626e-03,\n",
2089 | " -1.0716e-02, -1.9111e-03]],\n",
2090 | " \n",
2091 | " [[-2.4925e-02, -1.9391e-03, 1.8677e-03, ..., -7.9364e-03,\n",
2092 | " -1.1269e-02, -1.0375e-02],\n",
2093 | " [-2.2959e-02, 1.3838e-03, -5.1879e-03, ..., -2.0389e-02,\n",
2094 | " 1.8722e-04, -2.2228e-02],\n",
2095 | " [-2.5972e-02, -1.9240e-02, -1.4870e-02, ..., -1.1329e-02,\n",
2096 | " -1.0629e-02, -1.2778e-03],\n",
2097 | " ...,\n",
2098 | " [ 4.6231e-03, -9.8229e-03, -1.6067e-02, ..., -1.4338e-02,\n",
2099 | " 1.0771e-03, -1.4400e-02],\n",
2100 | " [-1.5673e-02, -4.5755e-03, -1.2823e-02, ..., -1.7801e-02,\n",
2101 | " 2.3182e-03, -1.8283e-02],\n",
2102 | " [ 2.1563e-03, -5.6639e-03, 6.3025e-03, ..., -1.9270e-02,\n",
2103 | " -2.7177e-02, 1.7473e-04]]],\n",
2104 | " \n",
2105 | " \n",
2106 | " ...,\n",
2107 | " \n",
2108 | " \n",
2109 | " [[[ 7.6536e-03, -1.8783e-03, 1.8841e-02, ..., -8.4884e-03,\n",
2110 | " -2.2051e-03, -5.5705e-03],\n",
2111 | " [-1.1814e-02, -1.4657e-02, 1.1615e-02, ..., -3.1463e-03,\n",
2112 | " -3.4147e-02, -2.1097e-02],\n",
2113 | " [ 1.7014e-02, -1.1913e-03, -1.3618e-02, ..., -2.0940e-02,\n",
2114 | " -1.9440e-02, -3.0029e-02],\n",
2115 | " ...,\n",
2116 | " [ 1.0215e-02, 1.5527e-02, -6.3834e-03, ..., 6.0160e-03,\n",
2117 | " -1.6559e-02, -2.9295e-03],\n",
2118 | " [ 1.0632e-02, -1.1926e-02, -1.3686e-03, ..., 1.6902e-02,\n",
2119 | " -1.0786e-02, -2.5942e-02],\n",
2120 | " [ 3.9939e-03, -3.3778e-02, -1.2943e-02, ..., 1.9375e-03,\n",
2121 | " -2.5962e-02, -2.6246e-02]],\n",
2122 | " \n",
2123 | " [[-1.8836e-02, -1.2895e-02, -2.8608e-02, ..., -1.1196e-02,\n",
2124 | " -1.9619e-02, -3.0789e-02],\n",
2125 | " [-3.1237e-02, -3.7592e-02, -8.0640e-03, ..., -2.0608e-02,\n",
2126 | " -7.0762e-03, -3.3432e-02],\n",
2127 | " [-3.4544e-02, -3.1376e-02, -1.8247e-02, ..., -4.2953e-03,\n",
2128 | " -2.5268e-02, -3.7524e-02],\n",
2129 | " ...,\n",
2130 | " [-2.0865e-02, -2.8106e-02, -4.8804e-03, ..., 4.9353e-03,\n",
2131 | " -9.5544e-03, -3.9235e-04],\n",
2132 | " [-2.0468e-02, -4.8933e-03, -2.7534e-02, ..., -1.2462e-02,\n",
2133 | " -2.6990e-02, -7.4737e-03],\n",
2134 | " [-2.3287e-02, -2.4754e-02, -2.8761e-02, ..., -1.5842e-02,\n",
2135 | " -2.1052e-02, -3.2656e-02]],\n",
2136 | " \n",
2137 | " [[ 8.0048e-04, 2.2151e-03, 1.5473e-02, ..., -1.2530e-02,\n",
2138 | " -1.6299e-02, -3.9971e-03],\n",
2139 | " [-1.7649e-02, 6.1190e-03, 5.3151e-03, ..., -2.9324e-02,\n",
2140 | " -1.8867e-02, -3.1613e-02],\n",
2141 | " [-3.7128e-02, -3.5173e-02, -3.1409e-02, ..., -2.0030e-02,\n",
2142 | " -3.2676e-03, -3.1105e-02],\n",
2143 | " ...,\n",
2144 | " [-2.1572e-02, -3.5458e-02, -2.1744e-02, ..., -4.4794e-03,\n",
2145 | " -4.9605e-03, -2.9795e-02],\n",
2146 | " [-1.9600e-02, -1.8060e-02, -2.9290e-02, ..., -1.0334e-02,\n",
2147 | " -2.3278e-02, -2.6473e-02],\n",
2148 | " [-3.4211e-02, -5.7403e-03, -3.1517e-02, ..., -2.5251e-02,\n",
2149 | " -2.8706e-02, -3.5840e-02]],\n",
2150 | " \n",
2151 | " ...,\n",
2152 | " \n",
2153 | " [[ 1.1339e-02, -1.7595e-02, 3.8017e-03, ..., 2.5522e-03,\n",
2154 | " -1.7517e-02, 4.3034e-03],\n",
2155 | " [ 9.7192e-03, 1.5814e-02, 5.0818e-03, ..., 1.2481e-02,\n",
2156 | " -3.0841e-02, 3.4227e-03],\n",
2157 | " [-1.1800e-02, 4.6344e-03, 2.4301e-03, ..., -3.6808e-02,\n",
2158 | " -3.3497e-02, -2.8690e-02],\n",
2159 | " ...,\n",
2160 | " [ 3.6129e-03, -1.1561e-02, -3.0395e-02, ..., -1.2388e-02,\n",
2161 | " -9.4928e-03, -1.5173e-03],\n",
2162 | " [-1.1360e-02, -4.0666e-03, -2.0922e-02, ..., 8.6673e-04,\n",
2163 | " -1.3469e-02, -4.8741e-03],\n",
2164 | " [ 5.7896e-03, -1.7382e-02, -7.8392e-03, ..., -2.3734e-03,\n",
2165 | " -1.1630e-02, -7.0134e-03]],\n",
2166 | " \n",
2167 | " [[-3.2164e-02, -6.2788e-03, 1.3968e-02, ..., 3.6180e-03,\n",
2168 | " -1.0840e-02, -2.7565e-02],\n",
2169 | " [-2.6980e-02, -2.4073e-02, 1.0033e-03, ..., -2.5264e-04,\n",
2170 | " -5.5285e-03, -1.2939e-02],\n",
2171 | " [ 2.1923e-04, -1.4998e-03, -2.6163e-02, ..., -4.7604e-03,\n",
2172 | " 9.5060e-03, 2.7361e-03],\n",
2173 | " ...,\n",
2174 | " [-1.5853e-02, 1.8252e-02, -1.6496e-02, ..., -3.9139e-03,\n",
2175 | " -2.4966e-02, -3.1966e-03],\n",
2176 | " [-2.7687e-02, -2.8252e-02, 1.8075e-03, ..., -2.1508e-02,\n",
2177 | " 3.0193e-03, -1.8301e-02],\n",
2178 | " [ 3.9693e-03, 1.4852e-02, 6.8361e-03, ..., -2.5844e-02,\n",
2179 | " -1.3109e-02, -2.7742e-02]],\n",
2180 | " \n",
2181 | " [[ 1.9207e-03, -1.1992e-02, 1.2561e-02, ..., -2.8050e-02,\n",
2182 | " -2.8156e-02, -3.3904e-02],\n",
2183 | " [ 1.7325e-02, 1.1727e-02, 4.4550e-03, ..., -2.3177e-02,\n",
2184 | " -3.0512e-02, -1.1348e-02],\n",
2185 | " [ 1.2288e-02, 3.4642e-04, -2.0631e-02, ..., -9.7264e-03,\n",
2186 | " -1.9462e-02, -9.1786e-03],\n",
2187 | " ...,\n",
2188 | " [-1.4261e-02, -1.8814e-02, -9.2540e-03, ..., -6.0748e-03,\n",
2189 | " -1.2992e-02, 4.8125e-04],\n",
2190 | " [-1.3841e-02, -2.1739e-02, -1.6609e-02, ..., -3.4722e-03,\n",
2191 | " -3.2457e-03, 1.4795e-02],\n",
2192 | " [-4.3364e-03, -8.1214e-03, -1.2953e-02, ..., -9.9520e-03,\n",
2193 | " 3.6117e-03, -7.1621e-03]]],\n",
2194 | " \n",
2195 | " \n",
2196 | " [[[-2.1822e-02, -1.6658e-02, -7.6389e-03, ..., -2.2257e-02,\n",
2197 | " 7.1451e-03, -1.5845e-03],\n",
2198 | " [ 1.1925e-03, -3.5487e-03, -1.8371e-02, ..., 1.0235e-02,\n",
2199 | " -2.0721e-02, 7.1239e-03],\n",
2200 | " [-1.4366e-02, 7.3110e-03, -9.1615e-04, ..., -5.8821e-03,\n",
2201 | " 1.5872e-02, 2.1394e-02],\n",
2202 | " ...,\n",
2203 | " [-3.5594e-03, 6.8701e-03, -1.0854e-02, ..., -2.3067e-02,\n",
2204 | " -3.2157e-03, -1.1290e-02],\n",
2205 | " [ 2.6806e-02, 3.3598e-04, -1.0921e-02, ..., -1.1420e-02,\n",
2206 | " 4.6863e-03, 6.0898e-03],\n",
2207 | " [ 3.0626e-03, -1.7101e-02, -5.4114e-03, ..., -1.0365e-02,\n",
2208 | " -1.0822e-02, -2.6236e-02]],\n",
2209 | " \n",
2210 | " [[-1.3101e-02, -1.3059e-02, 7.6095e-03, ..., -1.1628e-02,\n",
2211 | " -2.6642e-02, -6.9455e-03],\n",
2212 | " [-2.5564e-02, -1.5327e-02, 4.0728e-03, ..., -2.5864e-02,\n",
2213 | " -2.2147e-02, 4.5925e-03],\n",
2214 | " [-8.2005e-03, 5.9101e-03, -6.4722e-03, ..., -1.4526e-02,\n",
2215 | " -4.1891e-03, -1.5764e-02],\n",
2216 | " ...,\n",
2217 | " [-2.6733e-02, -2.7073e-02, -1.7734e-02, ..., -1.5771e-02,\n",
2218 | " -8.3647e-04, 5.2966e-03],\n",
2219 | " [ 7.4729e-03, -2.3610e-02, -1.9502e-02, ..., -1.5676e-02,\n",
2220 | " 1.1866e-03, 4.3461e-04],\n",
2221 | " [-2.7914e-03, -3.7813e-03, -2.0831e-02, ..., -1.0264e-02,\n",
2222 | " 8.9520e-04, -2.4958e-02]],\n",
2223 | " \n",
2224 | " [[-6.4742e-03, -1.8906e-02, -5.6844e-03, ..., 7.3853e-03,\n",
2225 | " 2.2777e-03, -6.9292e-03],\n",
2226 | " [ 2.8477e-03, 2.0978e-03, 3.7272e-03, ..., -7.4928e-03,\n",
2227 | " 1.6647e-02, 1.2275e-02],\n",
2228 | " [ 1.1717e-02, -4.8451e-04, 2.7634e-02, ..., -6.2747e-03,\n",
2229 | " -7.3154e-03, 4.8498e-04],\n",
2230 | " ...,\n",
2231 | " [ 1.0360e-02, 2.0931e-02, 1.1289e-02, ..., 3.9727e-03,\n",
2232 | " -1.4086e-02, 1.7404e-02],\n",
2233 | " [-2.5335e-03, -2.7018e-03, 1.6044e-02, ..., -3.9768e-03,\n",
2234 | " -1.3957e-02, -1.4771e-02],\n",
2235 | " [ 1.6544e-02, 2.1240e-02, 1.7475e-02, ..., -2.5158e-02,\n",
2236 | " -1.9777e-02, -1.7363e-04]],\n",
2237 | " \n",
2238 | " ...,\n",
2239 | " \n",
2240 | " [[ 1.4401e-02, 1.2646e-03, -1.3304e-02, ..., 7.7538e-03,\n",
2241 | " -1.9440e-02, -2.1017e-02],\n",
2242 | " [ 1.6771e-02, -2.3978e-04, -5.0331e-03, ..., -7.6139e-03,\n",
2243 | " -2.1629e-04, 6.4135e-03],\n",
2244 | " [ 6.8014e-03, 9.8460e-03, -7.2331e-03, ..., -7.9818e-03,\n",
2245 | " 3.1137e-03, -2.2293e-02],\n",
2246 | " ...,\n",
2247 | " [-1.4249e-02, 2.2670e-03, -2.0135e-02, ..., -1.9543e-04,\n",
2248 | " 9.2510e-04, -3.7952e-03],\n",
2249 | " [ 2.5527e-02, 3.9357e-03, -2.0599e-02, ..., -1.2822e-02,\n",
2250 | " -2.0320e-02, 5.3710e-03],\n",
2251 | " [ 2.4788e-02, -5.9360e-03, -1.9608e-02, ..., -8.5284e-03,\n",
2252 | " -5.3702e-03, 2.7787e-03]],\n",
2253 | " \n",
2254 | " [[-1.3842e-02, 9.3919e-04, 1.0927e-02, ..., -2.3249e-02,\n",
2255 | " 2.1997e-02, -2.7843e-03],\n",
2256 | " [-1.8800e-02, 3.3210e-03, -5.7883e-03, ..., -3.2548e-02,\n",
2257 | " 1.0355e-02, -7.5103e-05],\n",
2258 | " [ 8.8634e-04, -2.7359e-02, 9.0961e-04, ..., -8.1291e-03,\n",
2259 | " -3.1408e-04, -5.1685e-03],\n",
2260 | " ...,\n",
2261 | " [-2.1556e-02, 7.1239e-04, -2.7186e-02, ..., -2.6574e-02,\n",
2262 | " -1.7427e-02, -7.3701e-03],\n",
2263 | " [ 1.7685e-02, 1.9347e-03, -2.5782e-03, ..., -1.3726e-02,\n",
2264 | " -1.9573e-02, -3.1529e-05],\n",
2265 | " [ 1.6412e-02, -2.5740e-02, 1.9379e-03, ..., -2.6090e-02,\n",
2266 | " -7.1123e-04, 1.2818e-02]],\n",
2267 | " \n",
2268 | " [[-2.5872e-02, -1.1990e-02, -1.4029e-02, ..., 4.0431e-03,\n",
2269 | " 9.0229e-04, -1.4076e-02],\n",
2270 | " [-1.9221e-02, -2.4752e-02, -1.5499e-02, ..., -7.9520e-03,\n",
2271 | " -7.1294e-03, -4.3111e-03],\n",
2272 | " [ 3.4378e-03, -1.3511e-02, -1.3479e-02, ..., -1.0406e-02,\n",
2273 | " -9.2696e-03, -5.8095e-03],\n",
2274 | " ...,\n",
2275 | " [ 5.9763e-03, -6.7900e-04, -2.3468e-02, ..., 7.2678e-03,\n",
2276 | " -2.4124e-02, 5.2814e-03],\n",
2277 | " [-2.6482e-02, -1.1136e-02, -2.3210e-02, ..., -2.3877e-03,\n",
2278 | " -9.3244e-03, -1.3438e-02],\n",
2279 | " [-1.4087e-02, 8.4801e-04, 4.2950e-03, ..., -2.6069e-02,\n",
2280 | " 5.7832e-03, -1.9748e-02]]],\n",
2281 | " \n",
2282 | " \n",
2283 | " [[[-1.2947e-02, -1.3831e-02, -6.6514e-03, ..., 1.1251e-02,\n",
2284 | " -2.7273e-03, -2.9318e-04],\n",
2285 | " [ 1.6319e-02, -4.2163e-03, 9.5971e-04, ..., 8.7225e-03,\n",
2286 | " 3.4388e-03, -4.2100e-03],\n",
2287 | " [-8.9748e-03, 6.1063e-03, -1.0801e-03, ..., 5.1986e-03,\n",
2288 | " 8.0231e-03, -2.8249e-02],\n",
2289 | " ...,\n",
2290 | " [-3.6449e-03, -2.3086e-03, -2.5649e-02, ..., -1.1459e-02,\n",
2291 | " -5.9115e-03, 5.8053e-03],\n",
2292 | " [-3.4264e-02, -3.3125e-02, -3.9721e-03, ..., -1.2224e-02,\n",
2293 | " 1.9460e-02, -5.8133e-03],\n",
2294 | " [-3.4569e-02, -3.0598e-02, -3.6949e-02, ..., 5.6422e-03,\n",
2295 | " -3.6649e-03, 8.9027e-05]],\n",
2296 | " \n",
2297 | " [[-2.5274e-02, -2.2699e-02, -2.4185e-02, ..., -1.9850e-02,\n",
2298 | " -1.6500e-02, -2.5491e-02],\n",
2299 | " [-2.0654e-03, -1.8466e-02, -1.2426e-02, ..., 1.5545e-03,\n",
2300 | " -1.6919e-02, -6.4482e-03],\n",
2301 | " [-2.1573e-03, 3.2694e-03, -8.2869e-04, ..., -1.9123e-02,\n",
2302 | " -3.0052e-02, -6.3218e-03],\n",
2303 | " ...,\n",
2304 | " [-2.0544e-02, -1.8392e-02, -1.7850e-02, ..., -1.2365e-02,\n",
2305 | " -1.7570e-02, -2.4573e-02],\n",
2306 | " [-3.4599e-02, -1.4640e-02, -3.5621e-02, ..., -2.3353e-02,\n",
2307 | " -1.7889e-02, -3.3007e-02],\n",
2308 | " [-2.4938e-02, -5.0069e-03, -2.1860e-02, ..., -2.3937e-02,\n",
2309 | " -1.6531e-02, -2.4050e-02]],\n",
2310 | " \n",
2311 | " [[ 1.8155e-02, -3.6595e-04, 2.9583e-03, ..., -1.4410e-02,\n",
2312 | " 1.0625e-02, 1.4375e-03],\n",
2313 | " [-4.8929e-03, -8.0628e-03, 1.1450e-02, ..., -1.5520e-02,\n",
2314 | " 1.3821e-02, -1.5309e-02],\n",
2315 | " [ 1.1759e-02, -3.2002e-03, -1.5472e-02, ..., -9.7236e-03,\n",
2316 | " 4.4048e-04, 1.5701e-02],\n",
2317 | " ...,\n",
2318 | " [ 3.1347e-03, -1.0985e-02, -3.2569e-02, ..., -9.3643e-03,\n",
2319 | " 4.0229e-03, -4.7593e-03],\n",
2320 | " [-1.4315e-02, -1.1992e-02, 1.4437e-02, ..., -9.9650e-03,\n",
2321 | " 1.5973e-03, 1.9719e-03],\n",
2322 | " [-1.6013e-02, 2.7376e-03, 1.3703e-02, ..., 4.5032e-03,\n",
2323 | " -8.3267e-03, -1.5758e-02]],\n",
2324 | " \n",
2325 | " ...,\n",
2326 | " \n",
2327 | " [[-1.6352e-02, -7.9971e-03, -3.6600e-04, ..., -2.4343e-02,\n",
2328 | " 4.1341e-03, -1.2726e-02],\n",
2329 | " [-7.5895e-03, -2.5708e-02, 6.5365e-05, ..., -1.3495e-03,\n",
2330 | " -5.5134e-03, -1.8683e-02],\n",
2331 | " [-1.0314e-02, -9.2459e-03, -5.5137e-03, ..., -1.4481e-02,\n",
2332 | " -9.4491e-03, -1.8040e-02],\n",
2333 | " ...,\n",
2334 | " [-3.3748e-02, -2.9064e-02, -5.2415e-03, ..., -8.1776e-03,\n",
2335 | " -1.4581e-02, -2.4246e-02],\n",
2336 | " [-6.7054e-03, -6.5064e-03, -5.5634e-03, ..., -1.8302e-02,\n",
2337 | " -1.3915e-02, -1.9616e-02],\n",
2338 | " [-1.2851e-02, -3.7664e-02, -7.9373e-03, ..., -1.1542e-02,\n",
2339 | " -2.7742e-02, -1.2360e-02]],\n",
2340 | " \n",
2341 | " [[ 5.9764e-03, 1.1124e-02, 3.3182e-03, ..., 1.0216e-02,\n",
2342 | " -1.5117e-02, 1.3690e-02],\n",
2343 | " [ 4.9395e-04, -7.5153e-03, 8.6296e-03, ..., 8.1994e-03,\n",
2344 | " 7.1977e-03, 2.5272e-03],\n",
2345 | " [-3.7261e-03, -2.5792e-03, -3.5059e-02, ..., 1.6435e-02,\n",
2346 | " 1.1533e-02, -5.8290e-03],\n",
2347 | " ...,\n",
2348 | " [-1.1111e-02, -1.8693e-02, -3.3552e-02, ..., -1.2267e-02,\n",
2349 | " 8.4279e-04, -3.2727e-02],\n",
2350 | " [-3.3329e-02, -2.4417e-02, -3.4563e-03, ..., -3.7300e-03,\n",
2351 | " -4.3485e-03, -2.6191e-03],\n",
2352 | " [-2.4551e-02, -2.3301e-02, -5.5629e-03, ..., -2.4263e-02,\n",
2353 | " -7.4279e-03, -5.4921e-03]],\n",
2354 | " \n",
2355 | " [[-1.8330e-02, -3.5020e-02, -4.5647e-03, ..., -1.6847e-02,\n",
2356 | " -1.8493e-02, -2.4594e-02],\n",
2357 | " [-4.1776e-03, -2.8195e-02, -1.9245e-02, ..., -2.0432e-02,\n",
2358 | " -4.7981e-03, -1.4396e-02],\n",
2359 | " [-1.4868e-02, -1.7694e-02, -2.6225e-02, ..., -3.2991e-03,\n",
2360 | " -3.6838e-03, -4.8610e-03],\n",
2361 | " ...,\n",
2362 | " [-2.5331e-03, -4.7969e-03, -2.0132e-02, ..., -4.7765e-03,\n",
2363 | " -5.7052e-03, -4.8429e-03],\n",
2364 | " [-3.4539e-03, -3.3050e-02, -1.4698e-02, ..., -1.2370e-02,\n",
2365 | " -2.3638e-02, -2.4548e-02],\n",
2366 | " [-1.5635e-02, -3.4954e-02, -1.7280e-02, ..., -1.2131e-02,\n",
2367 | " -2.3583e-02, -1.5356e-02]]]])),\n",
2368 | " ('3.bias', tensor(1.00000e-02 *\n",
2369 | " [-1.0348, -0.6432, -2.8054, 0.4010, 0.0355, -1.6032, -2.2993,\n",
2370 | " -1.0429, -0.9652, 0.4127, -1.8207, -1.2974, -0.3693, 0.1035,\n",
2371 | " -3.5085, 0.2993, -1.0232, -0.8651, 0.9668, -2.0374, -0.7152,\n",
2372 | " 0.3597, -1.8070, 0.8926, -3.2788, -0.0156, -1.5564, -1.5726,\n",
2373 | " -0.7210, 4.4880, -0.0121, -2.9784, -1.1779, -1.4455, 1.3124,\n",
2374 | " 1.3883, -2.0414, -0.6788, -0.2914, 4.7307, 0.1653, -0.8118,\n",
2375 | " -0.6951, -1.2998, 1.0289, 1.4498, -0.9608, -2.2262, -1.0067,\n",
2376 | " 0.1164, 1.2346, -1.9317, -0.8354, -0.7387, -0.8948, -0.9721,\n",
2377 | " -0.1986, -0.8877, -0.2728, -1.8956, -1.8667, -3.1181, -1.0578,\n",
2378 | " -0.4842])),\n",
2379 | " ('6.weight',\n",
2380 | " tensor([[[[-6.6457e-03, -1.4171e-02, -2.9045e-03, ..., -1.8137e-02,\n",
2381 | " -2.4039e-02, 6.8482e-03],\n",
2382 | " [ 7.1761e-03, -4.3415e-04, -3.1281e-03, ..., -2.2076e-02,\n",
2383 | " 3.7009e-03, -2.6765e-02],\n",
2384 | " [ 1.5630e-03, -1.9424e-03, 9.1876e-04, ..., -1.7380e-02,\n",
2385 | " 7.2866e-03, -1.5511e-02],\n",
2386 | " ...,\n",
2387 | " [-6.0648e-03, -7.3269e-03, -1.2549e-02, ..., -5.2128e-03,\n",
2388 | " -8.3172e-03, -1.7570e-02],\n",
2389 | " [-7.9316e-03, -2.4722e-02, 2.5008e-03, ..., -2.3667e-02,\n",
2390 | " -2.3427e-02, -1.3126e-02],\n",
2391 | " [-6.7987e-03, -1.5110e-02, -8.4143e-03, ..., -1.4240e-04,\n",
2392 | " -1.7958e-02, 8.3597e-04]],\n",
2393 | " \n",
2394 | " [[-7.3525e-03, 7.4036e-03, 4.3098e-04, ..., -1.5146e-02,\n",
2395 | " 7.1143e-03, 6.2732e-04],\n",
2396 | " [ 1.6696e-02, -6.1884e-03, -1.7679e-02, ..., 3.8439e-03,\n",
2397 | " -1.2341e-02, -1.3297e-02],\n",
2398 | " [ 2.2285e-02, -7.4451e-03, 9.5357e-03, ..., 5.9170e-03,\n",
2399 | " -1.4165e-02, 5.7909e-03],\n",
2400 | " ...,\n",
2401 | " [ 8.5605e-03, 1.5439e-03, 3.1369e-03, ..., 2.6004e-02,\n",
2402 | " 1.6715e-02, -6.2791e-03],\n",
2403 | " [-2.9113e-03, -5.9755e-03, 2.4794e-02, ..., 1.4971e-02,\n",
2404 | " 2.4299e-02, 4.9134e-03],\n",
2405 | " [ 8.1300e-03, 2.7531e-02, 2.3008e-02, ..., 2.6274e-02,\n",
2406 | " 2.3459e-02, 8.4176e-03]],\n",
2407 | " \n",
2408 | " [[ 1.6915e-03, 1.5662e-02, -2.1010e-02, ..., -2.5390e-02,\n",
2409 | " -1.8454e-02, -2.5313e-03],\n",
2410 | " [-2.4235e-03, -1.7186e-02, -1.6349e-02, ..., -1.0117e-02,\n",
2411 | " -2.0963e-03, 4.7621e-03],\n",
2412 | " [ 5.7097e-03, -5.0673e-03, -1.0786e-02, ..., -2.2081e-02,\n",
2413 | " -1.2243e-02, -1.6443e-02],\n",
2414 | " ...,\n",
2415 | " [ 1.8973e-04, 5.9129e-03, 2.4763e-02, ..., -1.0624e-02,\n",
2416 | " 2.7799e-02, 1.7528e-02],\n",
2417 | " [ 1.5302e-02, 1.1425e-02, 1.0583e-03, ..., -2.5907e-02,\n",
2418 | " -6.2298e-03, 2.6912e-02],\n",
2419 | " [ 1.3923e-03, 3.1232e-03, 2.4442e-02, ..., 4.6041e-03,\n",
2420 | " 1.3593e-03, 3.2995e-04]],\n",
2421 | " \n",
2422 | " ...,\n",
2423 | " \n",
2424 | " [[ 2.5818e-02, -2.5142e-03, 1.4200e-03, ..., -2.1599e-03,\n",
2425 | " -2.2257e-03, -1.5570e-02],\n",
2426 | " [ 1.1808e-02, 5.1975e-03, -1.2687e-02, ..., -9.0135e-03,\n",
2427 | " -1.0521e-02, -7.2020e-03],\n",
2428 | " [ 2.6967e-02, 1.1292e-02, 4.3858e-03, ..., -1.5487e-02,\n",
2429 | " -7.1060e-03, -2.4728e-02],\n",
2430 | " ...,\n",
2431 | " [ 6.9493e-03, -7.3873e-03, -1.4296e-03, ..., -1.5632e-03,\n",
2432 | " -9.1091e-03, -1.7611e-02],\n",
2433 | " [-8.2599e-03, -1.2565e-02, -9.7295e-04, ..., -1.3228e-02,\n",
2434 | " -2.3057e-02, 2.0873e-03],\n",
2435 | " [ 2.5067e-02, 2.2780e-02, -2.1365e-02, ..., -2.5433e-02,\n",
2436 | " -1.2683e-02, -1.1745e-02]],\n",
2437 | " \n",
2438 | " [[ 5.5638e-04, -1.4176e-02, -2.1675e-02, ..., 6.9348e-03,\n",
2439 | " -2.5002e-02, -7.3456e-03],\n",
2440 | " [-2.0352e-02, 6.1517e-03, -1.1137e-02, ..., -1.0299e-02,\n",
2441 | " -7.1797e-03, -1.7937e-02],\n",
2442 | " [-2.4783e-02, 7.8138e-03, -8.3013e-03, ..., -7.0645e-03,\n",
2443 | " 5.7574e-03, -6.3606e-03],\n",
2444 | " ...,\n",
2445 | " [-8.1102e-03, 5.2446e-04, 1.3026e-02, ..., 3.2308e-04,\n",
2446 | " -6.0556e-03, -2.3312e-02],\n",
2447 | " [-1.9393e-02, -1.0644e-02, -1.3462e-02, ..., -2.9526e-03,\n",
2448 | " -1.1095e-02, -4.4025e-03],\n",
2449 | " [-2.0711e-02, -1.2897e-02, -2.3291e-02, ..., -2.2207e-02,\n",
2450 | " -2.4636e-02, -9.8060e-03]],\n",
2451 | " \n",
2452 | " [[-2.7536e-02, 2.2127e-04, -2.0344e-02, ..., -2.6237e-02,\n",
2453 | " -1.6757e-02, -1.0473e-02],\n",
2454 | " [ 2.9774e-03, -3.4460e-03, 4.1607e-04, ..., -1.8696e-02,\n",
2455 | " -1.7803e-02, -1.5318e-02],\n",
2456 | " [-6.8567e-03, -5.4140e-03, -2.2211e-03, ..., -1.5153e-02,\n",
2457 | " -9.4086e-03, -2.4556e-02],\n",
2458 | " ...,\n",
2459 | " [-2.0466e-02, -1.5368e-02, -1.3362e-03, ..., -1.2661e-02,\n",
2460 | " -2.7657e-02, -2.6702e-02],\n",
2461 | " [-1.6134e-04, -5.4864e-03, -6.9648e-03, ..., -8.6749e-03,\n",
2462 | " -1.6099e-02, -1.1674e-02],\n",
2463 | " [-3.9682e-03, -2.1888e-04, -1.8551e-02, ..., 3.1419e-03,\n",
2464 | " -1.6960e-02, -3.9024e-03]]],\n",
2465 | " \n",
2466 | " \n",
2467 | " [[[ 2.6815e-03, 2.7600e-03, -2.3110e-02, ..., -6.3854e-03,\n",
2468 | " 6.4987e-03, 1.1546e-03],\n",
2469 | " [-1.9149e-02, 2.1954e-03, -2.2608e-02, ..., 1.9906e-03,\n",
2470 | " -9.6423e-03, -1.6311e-02],\n",
2471 | " [-4.5714e-04, -6.5635e-03, -1.8411e-02, ..., 2.6722e-02,\n",
2472 | " -1.0920e-02, -2.1461e-02],\n",
2473 | " ...,\n",
2474 | " [ 6.3454e-03, -7.8911e-03, -2.8480e-03, ..., -1.6411e-02,\n",
2475 | " 6.4979e-03, -6.4111e-03],\n",
2476 | " [-2.7195e-02, -2.6426e-02, 6.3926e-03, ..., 7.5039e-03,\n",
2477 | " 1.6723e-02, -2.7925e-03],\n",
2478 | " [-9.6588e-03, -1.8814e-03, -3.7692e-03, ..., -2.3274e-02,\n",
2479 | " -3.0475e-04, -2.4586e-02]],\n",
2480 | " \n",
2481 | " [[-1.9053e-02, -1.4415e-02, -3.9138e-04, ..., -2.2224e-02,\n",
2482 | " -2.5606e-02, -2.7464e-03],\n",
2483 | " [ 3.4185e-03, 6.5735e-04, -6.7643e-03, ..., 3.8953e-03,\n",
2484 | " -2.2330e-02, 3.5497e-04],\n",
2485 | " [-1.7709e-03, -2.3377e-02, -6.9347e-03, ..., -1.8656e-02,\n",
2486 | " -1.9381e-02, -6.5882e-03],\n",
2487 | " ...,\n",
2488 | " [ 7.6387e-03, -2.6929e-02, -7.6107e-04, ..., -2.7788e-02,\n",
2489 | " -1.9311e-02, -2.3376e-02],\n",
2490 | " [-1.8804e-02, -1.5826e-02, -2.3658e-02, ..., -4.7362e-03,\n",
2491 | " -3.9745e-03, -2.0802e-02],\n",
2492 | " [-2.3835e-02, -2.0257e-03, 6.2832e-03, ..., -1.6132e-02,\n",
2493 | " -2.4613e-02, -1.9445e-02]],\n",
2494 | " \n",
2495 | " [[ 3.7441e-03, -2.8301e-04, -2.1012e-02, ..., -2.1116e-02,\n",
2496 | " -1.9632e-02, 4.1838e-03],\n",
2497 | " [ 5.3022e-03, -1.0277e-02, 4.0184e-03, ..., 1.8427e-03,\n",
2498 | " -1.7806e-02, -5.5921e-03],\n",
2499 | " [-2.4765e-02, -1.2122e-02, -3.3981e-03, ..., -2.7065e-03,\n",
2500 | " 7.5494e-03, -8.5881e-03],\n",
2501 | " ...,\n",
2502 | " [-2.5949e-03, -1.2332e-02, -9.9704e-04, ..., 6.1100e-03,\n",
2503 | " -2.1041e-02, 1.5915e-03],\n",
2504 | " [-2.9155e-03, -1.2471e-03, 2.3624e-03, ..., -4.0809e-04,\n",
2505 | " 2.2107e-03, 5.9018e-03],\n",
2506 | " [-2.7314e-02, -8.8494e-03, 3.4153e-03, ..., 1.9356e-03,\n",
2507 | " -2.2871e-02, -1.3754e-02]],\n",
2508 | " \n",
2509 | " ...,\n",
2510 | " \n",
2511 | " [[-1.4542e-02, -1.1539e-02, 8.9263e-05, ..., -7.3279e-03,\n",
2512 | " -2.6264e-02, -1.3329e-02],\n",
2513 | " [-2.7454e-02, 3.3421e-03, -2.5765e-02, ..., -1.0423e-02,\n",
2514 | " -2.6844e-02, 7.3982e-03],\n",
2515 | " [-2.3613e-02, -1.3673e-02, -1.8357e-02, ..., -1.7721e-02,\n",
2516 | " -8.5604e-03, -2.2132e-02],\n",
2517 | " ...,\n",
2518 | " [-2.6013e-02, -3.6969e-03, 2.5747e-03, ..., -3.1840e-03,\n",
2519 | " -1.5127e-02, -5.5397e-03],\n",
2520 | " [-1.4254e-02, -2.5712e-02, -1.9869e-02, ..., -1.7686e-02,\n",
2521 | " 4.4819e-03, -9.8499e-03],\n",
2522 | " [-8.2287e-03, -2.6694e-02, -2.0531e-02, ..., -1.7120e-03,\n",
2523 | " -2.0798e-02, -1.7615e-02]],\n",
2524 | " \n",
2525 | " [[-1.1641e-02, 1.9956e-03, 1.1898e-02, ..., 3.6846e-03,\n",
2526 | " 1.1974e-02, -4.5329e-04],\n",
2527 | " [-2.5668e-02, 1.7122e-02, 1.7507e-02, ..., 9.9175e-03,\n",
2528 | " 2.5714e-02, -7.6476e-04],\n",
2529 | " [-1.7509e-02, 4.3558e-03, 7.5123e-04, ..., -1.4198e-03,\n",
2530 | " 2.5469e-03, 2.4452e-03],\n",
2531 | " ...,\n",
2532 | " [-4.9957e-03, 2.1021e-02, 1.2628e-02, ..., 5.9583e-03,\n",
2533 | " -8.1602e-04, 5.6060e-03],\n",
2534 | " [ 9.3684e-03, -3.8993e-03, -7.4301e-03, ..., 2.5262e-02,\n",
2535 | " -1.1567e-02, -2.2611e-02],\n",
2536 | " [ 1.5262e-02, 8.9769e-03, 9.7152e-03, ..., -7.4974e-03,\n",
2537 | " -4.8129e-03, 5.6780e-03]],\n",
2538 | " \n",
2539 | " [[ 2.3000e-03, -2.4523e-02, 6.6512e-03, ..., -2.7391e-02,\n",
2540 | " 6.8425e-03, -2.7274e-03],\n",
2541 | " [-7.4881e-03, -2.6908e-02, -1.0024e-02, ..., 6.7545e-03,\n",
2542 | " -1.3386e-02, -2.3434e-02],\n",
2543 | " [-1.5010e-03, -1.7844e-03, -1.2954e-02, ..., -1.4116e-02,\n",
2544 | " -5.1217e-03, -8.3684e-03],\n",
2545 | " ...,\n",
2546 | " [-2.3182e-02, -1.3679e-02, -2.6907e-02, ..., 7.7890e-03,\n",
2547 | " 5.6772e-03, -2.3604e-03],\n",
2548 | " [-1.3363e-02, 3.2209e-03, -2.5748e-02, ..., -2.0797e-02,\n",
2549 | " -1.4555e-02, -1.4172e-02],\n",
2550 | " [-1.8342e-03, -1.0991e-02, -1.9722e-02, ..., -1.5551e-02,\n",
2551 | " -1.0138e-02, -1.0672e-02]]],\n",
2552 | " \n",
2553 | " \n",
2554 | " [[[ 1.0803e-02, 4.7048e-03, 1.6983e-02, ..., 4.1527e-03,\n",
2555 | " 2.2373e-02, 5.4560e-04],\n",
2556 | " [ 6.3237e-03, 2.1544e-02, 1.7252e-02, ..., -2.2766e-03,\n",
2557 | " 1.3347e-02, -4.3080e-03],\n",
2558 | " [ 2.6734e-02, 2.6813e-02, 6.2577e-03, ..., 2.1421e-02,\n",
2559 | " -3.0671e-03, 2.6876e-02],\n",
2560 | " ...,\n",
2561 | " [ 3.8466e-03, 1.4918e-02, 9.1837e-04, ..., 1.4482e-02,\n",
2562 | " -2.3947e-02, 2.3661e-02],\n",
2563 | " [-5.0735e-03, 1.9258e-02, 7.1542e-03, ..., 2.7190e-02,\n",
2564 | " -2.4411e-02, 2.2396e-02],\n",
2565 | " [ 5.5550e-03, 2.6562e-03, 2.5110e-02, ..., 1.3546e-02,\n",
2566 | " 6.1975e-03, 1.0409e-02]],\n",
2567 | " \n",
2568 | " [[-1.1136e-02, 6.9883e-03, 3.0030e-03, ..., -5.5232e-04,\n",
2569 | " -1.7540e-02, -2.3302e-02],\n",
2570 | " [-1.4507e-02, 3.2926e-03, -2.3579e-02, ..., -1.3034e-02,\n",
2571 | " -1.0693e-02, -1.6482e-02],\n",
2572 | " [-1.4580e-02, -9.5563e-03, -6.7839e-03, ..., -1.4063e-02,\n",
2573 | " -1.8502e-02, -2.5409e-02],\n",
2574 | " ...,\n",
2575 | " [-1.0305e-02, 6.6265e-03, -6.3571e-03, ..., -1.4248e-02,\n",
2576 | " -1.3378e-03, -2.7316e-02],\n",
2577 | " [-2.7698e-02, 5.9108e-03, -2.4755e-02, ..., -1.2901e-02,\n",
2578 | " -1.3346e-02, -1.8909e-02],\n",
2579 | " [-7.2682e-03, 2.3862e-03, 7.2970e-03, ..., -1.9567e-03,\n",
2580 | " 2.5399e-03, -1.2041e-02]],\n",
2581 | " \n",
2582 | " [[ 9.3208e-04, -2.4150e-02, -8.2703e-03, ..., -9.9188e-03,\n",
2583 | " -2.7008e-02, -6.4440e-03],\n",
2584 | " [-2.8552e-03, -2.5445e-02, -1.7352e-03, ..., -5.3413e-03,\n",
2585 | " 3.9580e-03, -1.5058e-02],\n",
2586 | " [-2.2481e-02, -7.4268e-03, -1.6228e-02, ..., 6.2900e-03,\n",
2587 | " -4.6813e-03, -2.2208e-02],\n",
2588 | " ...,\n",
2589 | " [-2.2341e-02, 1.4652e-03, -6.4600e-03, ..., -1.5374e-02,\n",
2590 | " -2.3160e-02, -3.9129e-03],\n",
2591 | " [-1.1384e-02, -2.0828e-02, 5.7455e-03, ..., -1.1452e-02,\n",
2592 | " -7.6033e-03, 7.8521e-03],\n",
2593 | " [-1.1966e-03, -1.0845e-02, -9.7271e-04, ..., -9.2989e-03,\n",
2594 | " -8.6757e-03, -2.6281e-02]],\n",
2595 | " \n",
2596 | " ...,\n",
2597 | " \n",
2598 | " [[-1.3458e-02, -7.7781e-03, -2.3052e-02, ..., 2.8025e-03,\n",
2599 | " -7.8977e-03, -3.7936e-03],\n",
2600 | " [-1.1218e-02, -1.6381e-02, 6.8840e-03, ..., 3.5669e-03,\n",
2601 | " -2.7674e-02, -3.5688e-03],\n",
2602 | " [-8.9585e-03, -1.2310e-02, -2.2705e-02, ..., -9.7054e-03,\n",
2603 | " -2.3737e-03, -6.4271e-04],\n",
2604 | " ...,\n",
2605 | " [ 3.4600e-03, -9.8721e-04, 2.1120e-02, ..., -2.6087e-02,\n",
2606 | " -4.4846e-03, -5.2615e-03],\n",
2607 | " [ 8.7108e-04, -8.7200e-03, 1.5654e-02, ..., -9.8368e-03,\n",
2608 | " -1.5175e-02, 1.6077e-03],\n",
2609 | " [ 3.6899e-03, -1.1976e-02, -3.6526e-03, ..., 1.2364e-04,\n",
2610 | " -1.8276e-02, -2.1552e-02]],\n",
2611 | " \n",
2612 | " [[ 2.5739e-03, 3.8341e-03, 4.8284e-03, ..., 1.5254e-02,\n",
2613 | " -1.8352e-02, -1.8539e-02],\n",
2614 | " [-1.0978e-03, 3.0958e-03, -2.1609e-02, ..., -1.6518e-02,\n",
2615 | " 1.1658e-02, -1.6776e-02],\n",
2616 | " [ 2.3345e-02, 1.4186e-02, 7.7396e-03, ..., 2.4179e-02,\n",
2617 | " 7.5861e-03, 1.4574e-03],\n",
2618 | " ...,\n",
2619 | " [ 9.2825e-03, 3.2912e-03, 1.9568e-03, ..., -1.0460e-03,\n",
2620 | " -4.2239e-04, 2.6380e-03],\n",
2621 | " [ 2.2806e-02, 2.7072e-02, 1.1315e-02, ..., 5.2665e-03,\n",
2622 | " 3.7033e-04, 2.7828e-02],\n",
2623 | " [ 2.7164e-02, 1.1026e-03, 2.7055e-03, ..., 1.7518e-02,\n",
2624 | " 2.3056e-02, -6.8682e-03]],\n",
2625 | " \n",
2626 | " [[-1.4881e-02, -5.9023e-03, -1.9649e-02, ..., -4.1369e-04,\n",
2627 | " -1.3280e-02, -2.6200e-02],\n",
2628 | " [-2.6755e-02, -2.1669e-02, 4.5764e-03, ..., -7.8507e-03,\n",
2629 | " 6.4255e-03, 9.9325e-03],\n",
2630 | " [-8.6054e-03, -7.6855e-03, 5.8127e-03, ..., 2.5860e-02,\n",
2631 | " 6.4223e-03, 3.5202e-03],\n",
2632 | " ...,\n",
2633 | " [-6.3107e-03, 4.4912e-03, -7.6356e-03, ..., 2.1135e-02,\n",
2634 | " -1.6345e-03, 5.7075e-03],\n",
2635 | " [ 3.9341e-03, 1.1165e-02, -7.7545e-03, ..., 1.0315e-02,\n",
2636 | " -4.8345e-03, 1.4341e-02],\n",
2637 | " [ 1.8492e-02, 1.3883e-02, 1.0993e-02, ..., 3.8087e-03,\n",
2638 | " 2.1333e-02, 5.9169e-03]]],\n",
2639 | " \n",
2640 | " \n",
2641 | " ...,\n",
2642 | " \n",
2643 | " \n",
2644 | " [[[-1.7079e-02, -2.3652e-02, 1.7911e-02, ..., -1.2363e-02,\n",
2645 | " 2.8492e-03, 7.0113e-03],\n",
2646 | " [ 1.6031e-03, -2.7487e-02, -1.1339e-03, ..., -2.4735e-02,\n",
2647 | " 1.1502e-02, 1.2130e-02],\n",
2648 | " [-5.5296e-04, -2.5571e-02, -6.1638e-04, ..., 1.6285e-02,\n",
2649 | " 1.5937e-02, 6.5888e-03],\n",
2650 | " ...,\n",
2651 | " [-5.1860e-04, -5.0372e-03, 8.0611e-03, ..., -1.0326e-03,\n",
2652 | " -1.7013e-02, 6.6016e-03],\n",
2653 | " [-1.2407e-02, -7.1872e-03, 2.0173e-02, ..., 2.6709e-02,\n",
2654 | " 2.6810e-02, -2.2917e-02],\n",
2655 | " [-4.1939e-03, 1.3234e-02, 7.8543e-03, ..., 5.6746e-03,\n",
2656 | " -1.7797e-02, 4.2977e-03]],\n",
2657 | " \n",
2658 | " [[-5.5146e-03, -1.6946e-02, -6.5365e-03, ..., -2.4159e-02,\n",
2659 | " -2.6040e-02, -9.4051e-03],\n",
2660 | " [ 7.1273e-03, -4.6073e-03, -8.6110e-03, ..., 1.7259e-03,\n",
2661 | " -3.6051e-03, 2.7651e-03],\n",
2662 | " [-1.9700e-02, -2.6362e-02, -9.3747e-03, ..., -2.6163e-03,\n",
2663 | " -1.9860e-02, -4.4046e-04],\n",
2664 | " ...,\n",
2665 | " [-1.1889e-02, -9.4752e-03, -2.4356e-02, ..., -2.3420e-02,\n",
2666 | " -2.0885e-02, -1.9287e-02],\n",
2667 | " [-2.6928e-02, -2.4612e-02, 4.7622e-03, ..., -1.5503e-02,\n",
2668 | " -2.4363e-02, 7.5888e-03],\n",
2669 | " [-1.5518e-02, -2.3157e-02, -1.0659e-03, ..., -2.4205e-02,\n",
2670 | " -9.6639e-03, -2.3377e-02]],\n",
2671 | " \n",
2672 | " [[-2.6864e-02, -2.4899e-02, -2.2055e-03, ..., -1.4565e-02,\n",
2673 | " -8.2756e-03, -2.1349e-02],\n",
2674 | " [-1.9350e-02, -2.6102e-02, -7.5557e-03, ..., -2.6522e-02,\n",
2675 | " -2.1705e-02, -2.3488e-02],\n",
2676 | " [ 6.7886e-03, -2.0861e-02, -7.1895e-03, ..., -2.0731e-02,\n",
2677 | " -1.6870e-02, -1.9063e-02],\n",
2678 | " ...,\n",
2679 | " [-8.5981e-03, -1.5810e-02, -2.1077e-02, ..., 1.8970e-02,\n",
2680 | " -7.3123e-03, 6.5245e-03],\n",
2681 | " [-1.9654e-02, -2.7379e-02, -1.4654e-02, ..., 1.7281e-02,\n",
2682 | " -2.6117e-02, -9.2734e-03],\n",
2683 | " [-1.7851e-02, -7.7316e-03, 4.3901e-03, ..., -3.3982e-03,\n",
2684 | " 5.3714e-03, 4.5850e-03]],\n",
2685 | " \n",
2686 | " ...,\n",
2687 | " \n",
2688 | " [[ 7.6055e-03, -9.5157e-03, -2.1007e-02, ..., 2.3747e-03,\n",
2689 | " 5.1110e-03, -2.7625e-02],\n",
2690 | " [-1.3811e-02, 5.6590e-03, 1.1003e-04, ..., -1.8449e-02,\n",
2691 | " -8.6538e-04, 1.8602e-03],\n",
2692 | " [ 1.5298e-03, 5.9226e-03, -1.5929e-02, ..., -7.0295e-03,\n",
2693 | " -6.9297e-03, -3.3335e-04],\n",
2694 | " ...,\n",
2695 | " [-8.5364e-03, 5.2309e-04, -2.4532e-02, ..., -2.7381e-02,\n",
2696 | " -2.3954e-02, -7.8353e-04],\n",
2697 | " [-1.2966e-02, -9.3232e-04, -1.1649e-02, ..., 7.2251e-03,\n",
2698 | " -2.4828e-02, -7.1678e-03],\n",
2699 | " [-2.7845e-02, -7.3668e-03, -1.3037e-02, ..., -2.5463e-03,\n",
2700 | " -1.1670e-02, 6.9228e-04]],\n",
2701 | " \n",
2702 | " [[ 4.2987e-03, -1.3866e-02, -3.0098e-04, ..., -2.0312e-02,\n",
2703 | " -2.6673e-02, -7.5054e-03],\n",
2704 | " [-2.5288e-02, -2.7234e-02, -3.2072e-03, ..., -1.6922e-03,\n",
2705 | " 5.1159e-03, 1.8809e-03],\n",
2706 | " [-7.8404e-03, -2.4190e-02, -5.6545e-03, ..., -9.9718e-03,\n",
2707 | " 2.2418e-03, -1.8270e-03],\n",
2708 | " ...,\n",
2709 | " [-2.1183e-02, -1.7935e-02, -1.2816e-02, ..., -4.2227e-03,\n",
2710 | " 3.4619e-03, -5.6836e-03],\n",
2711 | " [ 5.1959e-03, 1.4082e-03, -1.8438e-02, ..., 5.0958e-03,\n",
2712 | " -4.6172e-03, -1.0442e-02],\n",
2713 | " [ 3.1867e-03, 1.6476e-02, -2.3770e-03, ..., -1.1497e-03,\n",
2714 | " -5.9099e-03, -1.2312e-05]],\n",
2715 | " \n",
2716 | " [[-4.6278e-03, -1.7988e-02, -1.4015e-02, ..., -7.2963e-03,\n",
2717 | " -1.5966e-02, -2.2753e-02],\n",
2718 | " [-2.2051e-02, -1.8920e-02, -2.3424e-02, ..., -1.3496e-02,\n",
2719 | " -4.3788e-03, -1.8417e-02],\n",
2720 | " [ 6.6881e-03, -2.0990e-03, -1.6915e-02, ..., -1.0629e-02,\n",
2721 | " -1.8865e-02, -2.7226e-02],\n",
2722 | " ...,\n",
2723 | " [-2.1795e-02, -9.9422e-03, 1.1856e-03, ..., -1.4233e-02,\n",
2724 | " -5.5066e-03, -1.3657e-03],\n",
2725 | " [-9.7043e-03, -1.9177e-02, -1.1190e-02, ..., 6.3276e-03,\n",
2726 | " 3.6512e-03, -4.3879e-04],\n",
2727 | " [-3.5802e-03, -1.2609e-02, 3.3233e-03, ..., 6.7619e-04,\n",
2728 | " 4.9258e-03, 3.0377e-03]]],\n",
2729 | " \n",
2730 | " \n",
2731 | " [[[-7.1877e-03, -1.5681e-02, -1.6549e-02, ..., 9.0503e-03,\n",
2732 | " 2.6306e-02, -2.6235e-03],\n",
2733 | " [-2.3821e-02, -8.0970e-03, -7.9879e-03, ..., -2.6150e-02,\n",
2734 | " -1.9651e-02, -2.1417e-02],\n",
2735 | " [ 1.0182e-02, 2.1408e-02, -1.7475e-02, ..., -3.8979e-03,\n",
2736 | " -8.5626e-03, -2.2207e-02],\n",
2737 | " ...,\n",
2738 | " [ 1.2065e-02, -3.3887e-03, -2.4597e-02, ..., -7.3119e-03,\n",
2739 | " 5.5528e-04, -2.4736e-02],\n",
2740 | " [ 6.9064e-03, -1.4728e-03, -7.0641e-03, ..., -5.9020e-03,\n",
2741 | " -1.9837e-03, 9.0277e-04],\n",
2742 | " [ 3.5109e-03, 8.2354e-03, 1.1213e-02, ..., 2.2563e-03,\n",
2743 | " -2.5394e-03, -4.8740e-04]],\n",
2744 | " \n",
2745 | " [[ 1.4663e-02, -2.5992e-02, 6.7058e-03, ..., 1.3753e-03,\n",
2746 | " -1.5902e-02, -3.0446e-04],\n",
2747 | " [-1.5684e-02, 1.5662e-03, 1.4345e-04, ..., 3.9895e-03,\n",
2748 | " -1.3194e-02, -1.8605e-02],\n",
2749 | " [-1.2445e-02, -1.7827e-02, -3.9375e-03, ..., 5.2872e-03,\n",
2750 | " -1.1453e-03, 6.0658e-03],\n",
2751 | " ...,\n",
2752 | " [ 1.9661e-02, -2.8060e-03, 5.9395e-03, ..., -1.0668e-02,\n",
2753 | " -1.9702e-02, -1.1407e-02],\n",
2754 | " [-5.6370e-03, -8.0981e-03, -9.2554e-03, ..., 4.9647e-03,\n",
2755 | " 6.1075e-03, -2.8991e-03],\n",
2756 | " [-3.0469e-04, 9.4089e-03, -3.9601e-03, ..., -1.7853e-02,\n",
2757 | " -2.6795e-02, -1.4895e-03]],\n",
2758 | " \n",
2759 | " [[-1.0753e-02, 1.3153e-02, -7.8495e-03, ..., -6.2965e-03,\n",
2760 | " -6.8527e-03, -4.3924e-03],\n",
2761 | " [ 2.5400e-03, -2.6458e-02, 3.5085e-03, ..., -2.7219e-02,\n",
2762 | " -1.2093e-02, 4.6735e-03],\n",
2763 | " [-1.0301e-02, -2.7772e-02, -2.2750e-02, ..., -7.2343e-03,\n",
2764 | " -5.1331e-04, 2.2712e-03],\n",
2765 | " ...,\n",
2766 | " [-1.7714e-02, -3.8750e-03, 5.8806e-03, ..., 1.6281e-02,\n",
2767 | " -2.3514e-03, 1.7316e-02],\n",
2768 | " [-1.8493e-02, -1.9961e-02, -1.1608e-02, ..., 2.9879e-03,\n",
2769 | " -1.2182e-02, 1.6411e-03],\n",
2770 | " [-3.9716e-03, -2.7665e-02, -1.9828e-02, ..., -6.4639e-03,\n",
2771 | " -9.6503e-03, 5.3992e-04]],\n",
2772 | " \n",
2773 | " ...,\n",
2774 | " \n",
2775 | " [[ 1.6866e-02, 2.1281e-02, -1.9741e-02, ..., -1.8323e-02,\n",
2776 | " -2.5315e-02, -2.2827e-02],\n",
2777 | " [ 1.2587e-02, -2.1247e-02, -1.3705e-02, ..., 4.2168e-04,\n",
2778 | " 4.2513e-03, -1.8466e-02],\n",
2779 | " [-2.4485e-02, -1.5450e-02, -1.6921e-02, ..., 3.0821e-03,\n",
2780 | " -1.4335e-02, 5.8570e-03],\n",
2781 | " ...,\n",
2782 | " [-7.2738e-03, -4.1662e-03, -1.5849e-02, ..., 5.0289e-04,\n",
2783 | " -7.0477e-03, -1.7925e-02],\n",
2784 | " [-3.5463e-03, -1.9288e-02, -1.6590e-02, ..., -4.3331e-03,\n",
2785 | " 4.0621e-03, -1.3745e-02],\n",
2786 | " [ 2.4187e-02, 1.1818e-02, -1.6819e-02, ..., -2.5773e-02,\n",
2787 | " -7.9688e-03, -1.2778e-02]],\n",
2788 | " \n",
2789 | " [[-2.6345e-02, -2.2053e-02, -1.0640e-02, ..., -1.8684e-02,\n",
2790 | " -1.4214e-02, -6.4522e-03],\n",
2791 | " [-1.3135e-02, -1.2603e-02, 2.7860e-03, ..., -1.1153e-02,\n",
2792 | " -2.6949e-02, -1.9304e-02],\n",
2793 | " [ 6.7585e-03, 2.1437e-03, -2.2104e-02, ..., -2.6568e-02,\n",
2794 | " -1.2645e-02, -4.9750e-03],\n",
2795 | " ...,\n",
2796 | " [ 9.7202e-05, 2.2102e-02, -1.1010e-02, ..., -2.9561e-03,\n",
2797 | " -1.6349e-02, -8.2710e-03],\n",
2798 | " [ 1.4986e-02, -2.2819e-03, 1.5725e-02, ..., -2.8215e-03,\n",
2799 | " -8.3108e-04, 7.6056e-03],\n",
2800 | " [ 1.5228e-02, 1.1487e-02, -2.5822e-02, ..., 9.8976e-03,\n",
2801 | " -2.6789e-02, -4.1409e-03]],\n",
2802 | " \n",
2803 | " [[-2.9711e-03, -1.4094e-02, 3.8414e-03, ..., -2.0743e-02,\n",
2804 | " -9.5010e-03, -2.3399e-02],\n",
2805 | " [-5.2331e-04, -6.4809e-03, -2.0062e-02, ..., 7.0671e-03,\n",
2806 | " -1.0242e-02, -1.8892e-02],\n",
2807 | " [-1.8418e-02, -1.2636e-02, 2.0545e-03, ..., -1.7045e-03,\n",
2808 | " -1.2336e-02, -2.4090e-02],\n",
2809 | " ...,\n",
2810 | " [-7.5012e-03, 3.8512e-03, -2.6576e-02, ..., -2.0135e-02,\n",
2811 | " -1.1112e-02, -2.2840e-02],\n",
2812 | " [-9.6134e-03, -2.5728e-02, -1.8202e-02, ..., 6.0040e-04,\n",
2813 | " 7.6143e-03, -7.5557e-03],\n",
2814 | " [ 5.8229e-03, -3.4572e-03, -1.0796e-02, ..., -1.7034e-04,\n",
2815 | " -2.3383e-02, -8.9818e-03]]],\n",
2816 | " \n",
2817 | " \n",
2818 | " [[[-2.3425e-02, -7.5719e-03, 9.8183e-03, ..., -7.3464e-03,\n",
2819 | " 1.0208e-02, 2.6022e-02],\n",
2820 | " [ 1.9817e-02, 2.0486e-03, 7.5612e-03, ..., 2.3252e-02,\n",
2821 | " 3.6919e-03, 2.4617e-02],\n",
2822 | " [ 1.5216e-02, 7.6164e-03, 1.2121e-02, ..., -2.5427e-02,\n",
2823 | " 5.9616e-03, -1.5313e-02],\n",
2824 | " ...,\n",
2825 | " [-1.8953e-02, -2.7664e-02, -8.3372e-04, ..., -1.1394e-02,\n",
2826 | " -3.9599e-03, -1.0342e-03],\n",
2827 | " [-1.6751e-02, -2.0885e-02, -1.7630e-02, ..., -1.6645e-03,\n",
2828 | " -2.3710e-02, -1.7802e-02],\n",
2829 | " [-6.0117e-03, 3.8652e-03, -2.6424e-02, ..., -2.2235e-02,\n",
2830 | " -1.6443e-03, -2.7785e-02]],\n",
2831 | " \n",
2832 | " [[-4.1271e-03, 4.0829e-03, 3.4600e-03, ..., -2.2573e-02,\n",
2833 | " -1.6629e-02, -3.0176e-03],\n",
2834 | " [ 2.0742e-02, -8.8202e-03, -2.5944e-02, ..., 2.3755e-02,\n",
2835 | " -6.2048e-03, 1.5848e-02],\n",
2836 | " [ 6.0385e-03, 9.0078e-03, 1.1106e-02, ..., -2.3429e-02,\n",
2837 | " 6.0346e-03, 2.3764e-02],\n",
2838 | " ...,\n",
2839 | " [-3.2518e-03, 1.1081e-02, -2.9847e-03, ..., 2.1810e-03,\n",
2840 | " 2.1432e-02, 1.4721e-02],\n",
2841 | " [ 2.4611e-03, 2.6107e-02, -1.9289e-03, ..., 1.3872e-02,\n",
2842 | " 2.3297e-03, -1.8788e-03],\n",
2843 | " [ 2.1329e-02, 1.6712e-03, 2.4485e-02, ..., 1.1636e-02,\n",
2844 | " 9.4464e-03, 2.6383e-02]],\n",
2845 | " \n",
2846 | " [[-2.0996e-02, 6.0790e-03, -8.0994e-03, ..., 3.8938e-03,\n",
2847 | " -1.3891e-03, 7.1402e-03],\n",
2848 | " [-7.0939e-03, 6.2268e-03, -1.4198e-02, ..., -5.2488e-03,\n",
2849 | " 1.4681e-02, 1.2842e-02],\n",
2850 | " [ 4.9848e-03, -2.7536e-03, -2.2892e-02, ..., 3.7270e-03,\n",
2851 | " 2.0247e-02, 1.3076e-02],\n",
2852 | " ...,\n",
2853 | " [-1.8175e-03, 1.1675e-02, 1.6029e-02, ..., 3.0613e-03,\n",
2854 | " 1.4126e-03, -1.0311e-03],\n",
2855 | " [ 1.1964e-02, -2.5340e-03, 2.3853e-02, ..., 6.0123e-03,\n",
2856 | " 1.8182e-02, 4.9782e-03],\n",
2857 | " [ 2.6864e-02, -6.5097e-03, 1.3913e-02, ..., -5.3833e-03,\n",
2858 | " 1.0168e-03, 3.6364e-03]],\n",
2859 | " \n",
2860 | " ...,\n",
2861 | " \n",
2862 | " [[-2.2790e-02, -2.2155e-02, 2.9486e-03, ..., -4.1600e-04,\n",
2863 | " -9.5766e-05, -9.7980e-03],\n",
2864 | " [ 2.8710e-04, -8.9594e-03, -2.1569e-03, ..., 3.8048e-03,\n",
2865 | " -9.6475e-03, -1.3285e-02],\n",
2866 | " [-1.6881e-03, -2.4389e-02, -2.6588e-02, ..., -1.8146e-02,\n",
2867 | " -2.5774e-02, -1.9062e-02],\n",
2868 | " ...,\n",
2869 | " [ 6.1846e-03, -2.6508e-02, -2.3966e-02, ..., -8.0941e-03,\n",
2870 | " -1.7214e-03, -1.8662e-02],\n",
2871 | " [-2.4548e-02, 2.0505e-02, -1.8847e-02, ..., -1.8596e-02,\n",
2872 | " -2.2775e-02, -1.5670e-02],\n",
2873 | " [-6.7244e-03, 1.5245e-02, 2.6767e-03, ..., -9.2259e-04,\n",
2874 | " -1.3007e-02, 3.1601e-03]],\n",
2875 | " \n",
2876 | " [[-2.3199e-02, -8.7317e-03, -3.8718e-03, ..., 7.0642e-03,\n",
2877 | " -2.6819e-02, -2.3488e-02],\n",
2878 | " [-2.7719e-02, 1.8092e-03, -4.2290e-03, ..., -3.7541e-03,\n",
2879 | " 2.3110e-02, -5.9336e-03],\n",
2880 | " [-1.3882e-02, -9.4410e-03, 7.1976e-03, ..., 6.1983e-03,\n",
2881 | " 7.5404e-03, 2.6457e-02],\n",
2882 | " ...,\n",
2883 | " [-3.6166e-03, -1.9016e-02, 7.3500e-03, ..., -7.7176e-03,\n",
2884 | " -4.5644e-03, -7.5307e-03],\n",
2885 | " [-1.6041e-02, -1.3890e-03, -8.0973e-03, ..., -2.1373e-02,\n",
2886 | " -1.3475e-02, -1.5834e-02],\n",
2887 | " [-1.5544e-02, -5.1768e-04, 5.4445e-03, ..., -1.8930e-02,\n",
2888 | " -2.3949e-02, -5.7021e-03]],\n",
2889 | " \n",
2890 | " [[ 1.0378e-03, 8.1250e-04, -1.7659e-02, ..., 4.4009e-03,\n",
2891 | " -5.7019e-04, 5.7071e-03],\n",
2892 | " [-8.5712e-04, 5.3408e-03, -2.6760e-02, ..., -2.3124e-02,\n",
2893 | " -5.0353e-03, -1.1309e-02],\n",
2894 | " [ 2.5485e-02, -1.7972e-02, 3.4282e-03, ..., -4.4639e-03,\n",
2895 | " 1.3660e-03, -8.8214e-04],\n",
2896 | " ...,\n",
2897 | " [-9.1250e-03, -1.2143e-02, -1.7638e-03, ..., -2.3895e-02,\n",
2898 | " -2.5546e-02, 5.2568e-03],\n",
2899 | " [-1.0582e-02, 3.3731e-03, -2.1635e-02, ..., -1.5461e-02,\n",
2900 | " -8.5758e-03, -7.9359e-03],\n",
2901 | " [-1.5926e-02, -1.1710e-02, -1.3718e-02, ..., -1.8985e-02,\n",
2902 | " 1.9257e-03, -3.7265e-03]]]])),\n",
2903 | " ('6.bias', tensor(1.00000e-02 *\n",
2904 | " [-0.6255, 4.9319, -3.6779, -2.9463, -2.5801, 0.8595, -1.0889,\n",
2905 | " 4.8599, 0.5028, 1.3037, -0.7622, 3.5637, 1.6952, -2.5448,\n",
2906 | " -0.1713, 1.7510, -3.0964, -0.9239, 2.0107, -1.5601, -4.1642,\n",
2907 | " -1.7541, -0.9685, 2.0369, -0.7735, 4.4888, 1.0942, -0.2250,\n",
2908 | " 1.5792, 1.1349, -1.6582, -1.1896, -1.3102, 4.1395, -0.1528,\n",
2909 | " -4.3832, -3.0477, 2.4790, -0.6793, -0.5944, -2.2985, 0.9787,\n",
2910 | " -1.1641, 0.8887, -2.2574, -0.9951, -1.2451, 2.0503, -7.5850,\n",
2911 | " -0.5772, -1.6409, 0.9793, -1.5066, 4.9639, -2.9812, -1.3580,\n",
2912 | " 0.0373, 1.6401, -0.9795, -2.6780, -0.8956, 3.6520, -1.1645,\n",
2913 | " 2.0801])),\n",
2914 | " ('10.weight',\n",
2915 | " tensor([[-7.5301e-02, -1.7809e-02, -3.9599e-02, ..., 7.6142e-02,\n",
2916 | " -1.0008e-01, -7.2872e-02],\n",
2917 | " [ 5.1972e-02, -1.6626e-01, 8.4465e-02, ..., -7.6805e-02,\n",
2918 | " -9.8366e-02, 6.6758e-02],\n",
2919 | " [-3.3718e-02, 1.3370e-01, -5.7192e-02, ..., -9.0067e-02,\n",
2920 | " 7.1618e-02, -2.5465e-02],\n",
2921 | " ...,\n",
2922 | " [ 6.2247e-02, 6.4090e-02, 8.5833e-02, ..., -1.2668e-02,\n",
2923 | " 1.3935e-02, -5.4030e-02],\n",
2924 | " [-2.3584e-01, 1.3796e-01, 8.0857e-02, ..., 1.2481e-01,\n",
2925 | " -4.7108e-02, -1.1746e-01],\n",
2926 | " [ 1.1030e-01, -4.2672e-02, 2.4807e-02, ..., 3.9567e-02,\n",
2927 | " -5.2033e-02, 5.8760e-02]])),\n",
2928 | " ('10.bias',\n",
2929 | " tensor([-0.0170, -0.0177, 0.0905, 0.0724, 0.0496, 0.0758, 0.0863,\n",
2930 | " -0.0121, -0.1114, -0.1325, 0.0691, 0.0418, 0.0570, 0.0775,\n",
2931 | " 0.1363, -0.0270, 0.0533, -0.0383, -0.0989, 0.0183, 0.0397,\n",
2932 | " 0.1140, 0.0707, 0.0802, 0.0219, -0.0462, -0.0971, -0.0339,\n",
2933 | " 0.0596, 0.1036, -0.0411, -0.0024, 0.0568, 0.0786, -0.0063,\n",
2934 | " -0.1060, 0.0394, -0.1205, 0.0189, -0.0318, 0.0170, -0.1569,\n",
2935 | " 0.1222, -0.0652, -0.0800, -0.1372, -0.0851, -0.1614, -0.0519,\n",
2936 | " -0.1048, 0.1035, -0.0287, -0.0404, -0.1073, 0.0188, 0.1039,\n",
2937 | " -0.0469, 0.0518, 0.0717, 0.0868, 0.0811, 0.0636, 0.0492,\n",
2938 | " -0.0230, -0.0766, -0.0199, 0.0445, -0.0969, 0.0910, -0.0910,\n",
2939 | " 0.0038, -0.0456, 0.0315, -0.0613, -0.0293, -0.0596, 0.0228,\n",
2940 | " -0.0958, 0.1407, -0.0356, -0.0213, -0.0660, 0.0504, 0.0503,\n",
2941 | " -0.0463, 0.0843, 0.0917, 0.0356, -0.0272, -0.1018, -0.0236,\n",
2942 | " -0.1267, -0.0688, 0.0875, 0.0440, -0.0899, 0.0881, 0.0511,\n",
2943 | " 0.1372, -0.0741])),\n",
2944 | " ('12.weight',\n",
2945 | " tensor([[-0.0017, -0.0766, 0.0924, ..., 0.0853, -0.0931, -0.1333],\n",
2946 | " [-0.1053, 0.0104, 0.0136, ..., -0.0441, -0.0201, 0.0947],\n",
2947 | " [ 0.0697, 0.0490, -0.0532, ..., -0.0319, 0.1249, -0.0447],\n",
2948 | " ...,\n",
2949 | " [-0.0374, -0.0541, 0.0537, ..., 0.0963, 0.0487, 0.0269],\n",
2950 | " [ 0.0725, 0.0446, -0.0674, ..., -0.0942, 0.0055, -0.0619],\n",
2951 | " [-0.0330, 0.0317, -0.0500, ..., -0.0020, -0.0695, -0.1809]])),\n",
2952 | " ('12.bias',\n",
2953 | " tensor([-0.0489, 0.1297, -0.0611, 0.0806, -0.0072, -0.0580, -0.0646,\n",
2954 | " 0.0661, -0.0694, -0.0294, -0.0115, -0.0775, 0.0346, -0.0762,\n",
2955 | " -0.1076, 0.0488, -0.1113, -0.0511, -0.0543, 0.0004, -0.0727,\n",
2956 | " -0.0120, -0.1211, 0.1344, -0.0039, 0.0428, 0.0673, 0.1046,\n",
2957 | " 0.0122, -0.0327, -0.0499, 0.0923, -0.1074, -0.0446, 0.0439,\n",
2958 | " -0.1016, -0.0942, -0.1311, -0.0221, 0.1263, 0.0584, -0.0257,\n",
2959 | " -0.0426, 0.0923, 0.0596, 0.0151, 0.0068, -0.0514, -0.0368,\n",
2960 | " -0.0243, 0.0778, 0.0376, 0.0819, -0.0541, 0.0811, 0.0558,\n",
2961 | " -0.0639, 0.0004, 0.0526, -0.0735, 0.0347, -0.0209, -0.0446,\n",
2962 | " -0.1415, -0.0052]))])"
2963 | ]
2964 | },
2965 | "execution_count": 52,
2966 | "metadata": {},
2967 | "output_type": "execute_result"
2968 | }
2969 | ],
2970 | "source": [
2971 | "model.state_dict()"
2972 | ]
2973 | },
2974 | {
2975 | "cell_type": "code",
2976 | "execution_count": null,
2977 | "metadata": {},
2978 | "outputs": [],
2979 | "source": []
2980 | },
2981 | {
2982 | "cell_type": "code",
2983 | "execution_count": null,
2984 | "metadata": {},
2985 | "outputs": [],
2986 | "source": []
2987 | }
2988 | ],
2989 | "metadata": {
2990 | "kernelspec": {
2991 | "display_name": "Python 3",
2992 | "language": "python",
2993 | "name": "python3"
2994 | },
2995 | "language_info": {
2996 | "codemirror_mode": {
2997 | "name": "ipython",
2998 | "version": 3
2999 | },
3000 | "file_extension": ".py",
3001 | "mimetype": "text/x-python",
3002 | "name": "python",
3003 | "nbconvert_exporter": "python",
3004 | "pygments_lexer": "ipython3",
3005 | "version": "3.6.5"
3006 | }
3007 | },
3008 | "nbformat": 4,
3009 | "nbformat_minor": 2
3010 | }
3011 |
--------------------------------------------------------------------------------
/fruit-classifier.py:
--------------------------------------------------------------------------------
1 |
2 | # coding: utf-8
3 |
4 | # ## Aim: To classifiy fruits images.
5 | # ### Dataset: Fruits360
6 | #
7 | # - Then to build an iOS app to use the machine learning model.
8 |
9 | # In[85]:
10 |
11 |
12 | # importing
13 | import random
14 | import pandas as pd
15 | import numpy as np
16 | import torchvision
17 | import torch
18 | from torch import nn
19 | from torch.autograd import Variable
20 | from sklearn.model_selection import train_test_split
21 | import torchvision.transforms as T
22 | from torchvision.datasets import ImageFolder
23 | import matplotlib.pyplot as plt
24 | import cv2
25 | from torch.utils.data import DataLoader
26 | from sklearn.metrics import accuracy_score
27 |
28 |
29 | # In[99]:
30 |
31 |
32 | # Loading data
33 | transforms_train = T.Compose([T.ToTensor(),T.Normalize([0.5,0.5,0.5],[0.5,0.5,0.5])])
34 | image_data_train = ImageFolder("./fruits-360/Training",transform=transforms_train)
35 | image_data_test = ImageFolder("./fruits-360/Validation",transform=transforms_train)
36 |
37 | # Shuffling data and then collecting all the labels.
38 | random.shuffle(image_data_train.samples)
39 | random.shuffle(image_data_test.samples)
40 |
41 |
42 | # In[100]:
43 |
44 |
45 | # Total classes
46 | classes_idx = image_data_train.class_to_idx
47 | classes = len(image_data_train.classes)
48 | len_train_data = len(image_data_train)
49 | len_test_data = len(image_data_test)
50 |
51 |
52 | def get_labels():
53 | labels_train = [] # All the labels
54 | labels_test = []
55 | for i in image_data_train.imgs:
56 | labels_train.append(i[1])
57 |
58 | for j in image_data_test.imgs:
59 | labels_test.append(j[1])
60 |
61 | return (labels_train, labels_test)
62 |
63 | labels_train, labels_test = get_labels()
64 |
65 |
66 | # In[101]:
67 |
68 |
69 | train_loader = DataLoader(dataset=image_data_train,batch_size=100)
70 | test_loader = DataLoader(dataset=image_data_test,batch_size=100)
71 |
72 |
73 | # In[102]:
74 |
75 |
76 | print (iter(train_loader).next()[0].shape)
77 | record = iter(train_loader).next()[0]
78 |
79 |
80 | # - We can see that the image is (batch_size, channel, image_height, image_width)
81 |
82 | # In[103]:
83 |
84 |
85 | # Flatten Layer
86 | class Flatten(nn.Module):
87 | def forward(self, x):
88 | return x.view(x.size(0), -1)
89 | # Main Model
90 | class Model:
91 | def build_model(self):
92 | model = nn.Sequential(nn.Conv2d(3, 64, kernel_size=5, stride=1), nn.ReLU(),nn.MaxPool2d(2), nn.Conv2d(64, 64, kernel_size=7, stride=1),
93 | nn.ReLU(), nn.MaxPool2d(3), nn.Conv2d(64, 64, kernel_size=7), nn.ReLU(), nn.MaxPool2d(5), Flatten(), nn.Linear(64, 100), nn.ReLU(), nn.Linear(100, 65))
94 | return model
95 |
96 |
97 | # In[104]:
98 |
99 |
100 | # Building
101 | model = Model()
102 | model = model.build_model()
103 |
104 |
105 | # In[109]:
106 |
107 |
108 | print (model)
109 | print (labels_train[0])
110 | print (image_data_train.samples[0][1])
111 |
112 |
113 | # In[107]:
114 |
115 |
116 | optimizer = torch.optim.Adagrad(model.parameters(), lr=0.01)
117 | criterion = nn.CrossEntropyLoss()
118 |
119 |
120 | # In[124]:
121 |
122 |
123 | # Train the model
124 | def train(epochs):
125 | model.train()
126 | losses = []
127 | for epoch in range(1, epochs+1):
128 | print ("epoch #", epoch)
129 | current_loss = 0.0
130 | for feature, label in train_loader:
131 | x = Variable(feature, requires_grad=False).float()
132 | y = Variable(label, requires_grad=False).long()
133 | optimizer.zero_grad() # Zeroing the grads
134 | y_pred = model(x) # Calculating prediction
135 | correct = y_pred.max(1)[1].eq(y).sum()
136 | print ("no. of correct items classified: ", correct.item())
137 | loss = criterion(y_pred, y) # Calculating loss (log_softmax already included)
138 | print ("loss: ", loss.item())
139 | current_loss+=loss.item()
140 | loss.backward() # Gradient cal
141 | optimizer.step() # Changing weights
142 | losses.append(current_loss) # Only storing loss after every epoch
143 | return losses
144 | # Test the model
145 | def test():
146 | model.eval()
147 | with torch.no_grad():
148 | for feature, label in test_loader:
149 | pred = model(feature)
150 | print ("acc: ", accuracy_score(labels_test, pred.max(1)[1].data.numpy()) * 100)
151 | loss = criterion(pred, label)
152 | print ("loss: ", loss.item())
153 |
154 |
155 | # In[125]:
156 |
157 |
158 | # Training
159 | train(100)
160 |
161 |
162 | # In[130]:
163 |
164 |
165 | list(model.named_parameters())
166 |
167 |
168 | # In[132]:
169 |
170 |
171 | len(labels_train)
172 |
173 |
--------------------------------------------------------------------------------
/model-state-dict.pth:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/model-state-dict.pth
--------------------------------------------------------------------------------
/optimizer-state-dict.pth:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/aaditkapoor/Fruit-Classifier-PyTorch/6c21165180b8567bb02457a83aeb74643c15da82/optimizer-state-dict.pth
--------------------------------------------------------------------------------