├── Adam_Poker_99_4.ipynb
├── README.md
└── Tabular_fastai_Baseline.ipynb
/Adam_Poker_99_4.ipynb:
--------------------------------------------------------------------------------
1 | {
2 | "nbformat": 4,
3 | "nbformat_minor": 0,
4 | "metadata": {
5 | "colab": {
6 | "name": "Poker.ipynb",
7 | "provenance": []
8 | },
9 | "kernelspec": {
10 | "name": "python3",
11 | "display_name": "Python 3"
12 | },
13 | "accelerator": "GPU"
14 | },
15 | "cells": [
16 | {
17 | "cell_type": "markdown",
18 | "metadata": {
19 | "id": "IH4nHtPmOB7r",
20 | "colab_type": "text"
21 | },
22 | "source": [
23 | "Try four different things:\n",
24 | "\n",
25 | "1. Does `Mish` affect this dataset\n",
26 | "2. Self Attention?\n",
27 | "3. Adam + One Cycle \n",
28 | "4. Ranger + flat_cos\n",
29 | "\n",
30 | "Fit for 100 epoch batches"
31 | ]
32 | },
33 | {
34 | "cell_type": "code",
35 | "metadata": {
36 | "id": "E-WeN5zzN-fz",
37 | "colab_type": "code",
38 | "colab": {}
39 | },
40 | "source": [
41 | "import os\n",
42 | "!pip install -q feather-format kornia pyarrow wandb nbdev fastprogress --upgrade \n",
43 | "!pip install torch==1.3.1\n",
44 | "!pip install torchvision==0.4.2\n",
45 | "os._exit(00)"
46 | ],
47 | "execution_count": 0,
48 | "outputs": []
49 | },
50 | {
51 | "cell_type": "code",
52 | "metadata": {
53 | "id": "hhI8y6FTQF3_",
54 | "colab_type": "code",
55 | "colab": {}
56 | },
57 | "source": [
58 | "!pip install git+https://github.com/fastai/fastai2.git\n",
59 | "!pip install git+https://github.com/fastai/fastcore.git"
60 | ],
61 | "execution_count": 0,
62 | "outputs": []
63 | },
64 | {
65 | "cell_type": "code",
66 | "metadata": {
67 | "id": "olDm4xpFOWrd",
68 | "colab_type": "code",
69 | "colab": {}
70 | },
71 | "source": [
72 | "from fastai2.tabular.all import *"
73 | ],
74 | "execution_count": 0,
75 | "outputs": []
76 | },
77 | {
78 | "cell_type": "code",
79 | "metadata": {
80 | "id": "ENz-zGVzPGBx",
81 | "colab_type": "code",
82 | "colab": {}
83 | },
84 | "source": [
85 | "df = pd.read_csv('train.csv')"
86 | ],
87 | "execution_count": 0,
88 | "outputs": []
89 | },
90 | {
91 | "cell_type": "code",
92 | "metadata": {
93 | "id": "I9_ft9PgPHK0",
94 | "colab_type": "code",
95 | "colab": {
96 | "base_uri": "https://localhost:8080/",
97 | "height": 204
98 | },
99 | "outputId": "07309184-df02-40eb-d5ca-145ea5d90152"
100 | },
101 | "source": [
102 | "df.head()"
103 | ],
104 | "execution_count": 3,
105 | "outputs": [
106 | {
107 | "output_type": "execute_result",
108 | "data": {
109 | "text/html": [
110 | "
\n",
111 | "\n",
124 | "
\n",
125 | " \n",
126 | " \n",
127 | " | \n",
128 | " S1 | \n",
129 | " C1 | \n",
130 | " S2 | \n",
131 | " C2 | \n",
132 | " S3 | \n",
133 | " C3 | \n",
134 | " S4 | \n",
135 | " C4 | \n",
136 | " S5 | \n",
137 | " C5 | \n",
138 | " hand | \n",
139 | "
\n",
140 | " \n",
141 | " \n",
142 | " \n",
143 | " 0 | \n",
144 | " 4 | \n",
145 | " 9 | \n",
146 | " 2 | \n",
147 | " 1 | \n",
148 | " 2 | \n",
149 | " 2 | \n",
150 | " 4 | \n",
151 | " 7 | \n",
152 | " 2 | \n",
153 | " 8 | \n",
154 | " 0 | \n",
155 | "
\n",
156 | " \n",
157 | " 1 | \n",
158 | " 1 | \n",
159 | " 4 | \n",
160 | " 3 | \n",
161 | " 6 | \n",
162 | " 1 | \n",
163 | " 12 | \n",
164 | " 3 | \n",
165 | " 11 | \n",
166 | " 2 | \n",
167 | " 7 | \n",
168 | " 0 | \n",
169 | "
\n",
170 | " \n",
171 | " 2 | \n",
172 | " 1 | \n",
173 | " 11 | \n",
174 | " 4 | \n",
175 | " 1 | \n",
176 | " 3 | \n",
177 | " 7 | \n",
178 | " 4 | \n",
179 | " 11 | \n",
180 | " 2 | \n",
181 | " 1 | \n",
182 | " 2 | \n",
183 | "
\n",
184 | " \n",
185 | " 3 | \n",
186 | " 2 | \n",
187 | " 9 | \n",
188 | " 2 | \n",
189 | " 4 | \n",
190 | " 3 | \n",
191 | " 6 | \n",
192 | " 1 | \n",
193 | " 9 | \n",
194 | " 4 | \n",
195 | " 9 | \n",
196 | " 3 | \n",
197 | "
\n",
198 | " \n",
199 | " 4 | \n",
200 | " 1 | \n",
201 | " 8 | \n",
202 | " 2 | \n",
203 | " 4 | \n",
204 | " 2 | \n",
205 | " 11 | \n",
206 | " 2 | \n",
207 | " 2 | \n",
208 | " 2 | \n",
209 | " 1 | \n",
210 | " 0 | \n",
211 | "
\n",
212 | " \n",
213 | "
\n",
214 | "
"
215 | ],
216 | "text/plain": [
217 | " S1 C1 S2 C2 S3 C3 S4 C4 S5 C5 hand\n",
218 | "0 4 9 2 1 2 2 4 7 2 8 0\n",
219 | "1 1 4 3 6 1 12 3 11 2 7 0\n",
220 | "2 1 11 4 1 3 7 4 11 2 1 2\n",
221 | "3 2 9 2 4 3 6 1 9 4 9 3\n",
222 | "4 1 8 2 4 2 11 2 2 2 1 0"
223 | ]
224 | },
225 | "metadata": {
226 | "tags": []
227 | },
228 | "execution_count": 3
229 | }
230 | ]
231 | },
232 | {
233 | "cell_type": "markdown",
234 | "metadata": {
235 | "id": "N3CG6TgGPnyJ",
236 | "colab_type": "text"
237 | },
238 | "source": [
239 | "Now we'll represent the card number as a categorical too"
240 | ]
241 | },
242 | {
243 | "cell_type": "code",
244 | "metadata": {
245 | "id": "rctrC2HKPnWN",
246 | "colab_type": "code",
247 | "colab": {}
248 | },
249 | "source": [
250 | "for i in range(1,6):\n",
251 | " df['cC'+str(i)]=df['C'+str(i)]"
252 | ],
253 | "execution_count": 0,
254 | "outputs": []
255 | },
256 | {
257 | "cell_type": "code",
258 | "metadata": {
259 | "id": "Kx2vD5GuPVT6",
260 | "colab_type": "code",
261 | "colab": {}
262 | },
263 | "source": [
264 | "Idea for including the card number in categorical by Fabio Barros\n",
265 | "cat_vars = ['S1', 'S2', 'S3', 'S4', 'S5','cC1', 'cC2', 'cC3', 'cC4', 'cC5']\n",
266 | "cont_vars = ['C1', 'C2', 'C3', 'C4', 'C5']\n",
267 | "dep_var = ['hand']"
268 | ],
269 | "execution_count": 0,
270 | "outputs": []
271 | },
272 | {
273 | "cell_type": "code",
274 | "metadata": {
275 | "id": "SFnyazmnPYJg",
276 | "colab_type": "code",
277 | "colab": {}
278 | },
279 | "source": [
280 | "procs = [Categorify, Normalize]\n",
281 | "splits = RandomSplitter()(range_of(df))"
282 | ],
283 | "execution_count": 0,
284 | "outputs": []
285 | },
286 | {
287 | "cell_type": "code",
288 | "metadata": {
289 | "id": "_LbaFK8yPbZI",
290 | "colab_type": "code",
291 | "colab": {}
292 | },
293 | "source": [
294 | "to = TabularPandas(df, procs, cat_names=cat_vars, cont_names=cont_vars, y_names=dep_var, splits=splits)"
295 | ],
296 | "execution_count": 0,
297 | "outputs": []
298 | },
299 | {
300 | "cell_type": "code",
301 | "metadata": {
302 | "id": "7gYnE7pQPcOF",
303 | "colab_type": "code",
304 | "colab": {
305 | "base_uri": "https://localhost:8080/",
306 | "height": 359
307 | },
308 | "outputId": "9292a722-577b-4796-d3bc-4b72fb42dfcd"
309 | },
310 | "source": [
311 | "to.show()"
312 | ],
313 | "execution_count": 8,
314 | "outputs": [
315 | {
316 | "output_type": "display_data",
317 | "data": {
318 | "text/html": [
319 | "\n",
320 | " \n",
321 | " \n",
322 | " | \n",
323 | " S1 | \n",
324 | " S2 | \n",
325 | " S3 | \n",
326 | " S4 | \n",
327 | " S5 | \n",
328 | " cC1 | \n",
329 | " cC2 | \n",
330 | " cC3 | \n",
331 | " cC4 | \n",
332 | " cC5 | \n",
333 | " C1 | \n",
334 | " C2 | \n",
335 | " C3 | \n",
336 | " C4 | \n",
337 | " C5 | \n",
338 | " hand | \n",
339 | "
\n",
340 | " \n",
341 | " \n",
342 | " \n",
343 | " 17218 | \n",
344 | " 3 | \n",
345 | " 3 | \n",
346 | " 1 | \n",
347 | " 3 | \n",
348 | " 1 | \n",
349 | " 5 | \n",
350 | " 3 | \n",
351 | " 3 | \n",
352 | " 4 | \n",
353 | " 4 | \n",
354 | " 5.0 | \n",
355 | " 3.0 | \n",
356 | " 3.0 | \n",
357 | " 4.0 | \n",
358 | " 4.0 | \n",
359 | " 2 | \n",
360 | "
\n",
361 | " \n",
362 | " 23181 | \n",
363 | " 4 | \n",
364 | " 4 | \n",
365 | " 2 | \n",
366 | " 2 | \n",
367 | " 2 | \n",
368 | " 10 | \n",
369 | " 13 | \n",
370 | " 6 | \n",
371 | " 2 | \n",
372 | " 12 | \n",
373 | " 10.0 | \n",
374 | " 13.0 | \n",
375 | " 6.0 | \n",
376 | " 2.0 | \n",
377 | " 12.0 | \n",
378 | " 0 | \n",
379 | "
\n",
380 | " \n",
381 | " 11213 | \n",
382 | " 3 | \n",
383 | " 1 | \n",
384 | " 1 | \n",
385 | " 2 | \n",
386 | " 3 | \n",
387 | " 13 | \n",
388 | " 7 | \n",
389 | " 8 | \n",
390 | " 1 | \n",
391 | " 1 | \n",
392 | " 13.0 | \n",
393 | " 7.0 | \n",
394 | " 8.0 | \n",
395 | " 1.0 | \n",
396 | " 1.0 | \n",
397 | " 1 | \n",
398 | "
\n",
399 | " \n",
400 | " 13364 | \n",
401 | " 1 | \n",
402 | " 4 | \n",
403 | " 3 | \n",
404 | " 3 | \n",
405 | " 1 | \n",
406 | " 9 | \n",
407 | " 5 | \n",
408 | " 13 | \n",
409 | " 1 | \n",
410 | " 10 | \n",
411 | " 9.0 | \n",
412 | " 5.0 | \n",
413 | " 13.0 | \n",
414 | " 1.0 | \n",
415 | " 10.0 | \n",
416 | " 0 | \n",
417 | "
\n",
418 | " \n",
419 | " 13937 | \n",
420 | " 3 | \n",
421 | " 2 | \n",
422 | " 4 | \n",
423 | " 3 | \n",
424 | " 2 | \n",
425 | " 10 | \n",
426 | " 7 | \n",
427 | " 2 | \n",
428 | " 12 | \n",
429 | " 2 | \n",
430 | " 10.0 | \n",
431 | " 7.0 | \n",
432 | " 2.0 | \n",
433 | " 12.0 | \n",
434 | " 2.0 | \n",
435 | " 1 | \n",
436 | "
\n",
437 | " \n",
438 | " 17760 | \n",
439 | " 4 | \n",
440 | " 4 | \n",
441 | " 1 | \n",
442 | " 2 | \n",
443 | " 1 | \n",
444 | " 9 | \n",
445 | " 10 | \n",
446 | " 1 | \n",
447 | " 4 | \n",
448 | " 10 | \n",
449 | " 9.0 | \n",
450 | " 10.0 | \n",
451 | " 1.0 | \n",
452 | " 4.0 | \n",
453 | " 10.0 | \n",
454 | " 1 | \n",
455 | "
\n",
456 | " \n",
457 | " 5463 | \n",
458 | " 2 | \n",
459 | " 4 | \n",
460 | " 3 | \n",
461 | " 4 | \n",
462 | " 2 | \n",
463 | " 9 | \n",
464 | " 6 | \n",
465 | " 7 | \n",
466 | " 13 | \n",
467 | " 13 | \n",
468 | " 9.0 | \n",
469 | " 6.0 | \n",
470 | " 7.0 | \n",
471 | " 13.0 | \n",
472 | " 13.0 | \n",
473 | " 1 | \n",
474 | "
\n",
475 | " \n",
476 | " 18348 | \n",
477 | " 2 | \n",
478 | " 4 | \n",
479 | " 4 | \n",
480 | " 4 | \n",
481 | " 4 | \n",
482 | " 10 | \n",
483 | " 10 | \n",
484 | " 7 | \n",
485 | " 8 | \n",
486 | " 1 | \n",
487 | " 10.0 | \n",
488 | " 10.0 | \n",
489 | " 7.0 | \n",
490 | " 8.0 | \n",
491 | " 1.0 | \n",
492 | " 1 | \n",
493 | "
\n",
494 | " \n",
495 | " 4866 | \n",
496 | " 4 | \n",
497 | " 3 | \n",
498 | " 1 | \n",
499 | " 2 | \n",
500 | " 3 | \n",
501 | " 5 | \n",
502 | " 3 | \n",
503 | " 5 | \n",
504 | " 12 | \n",
505 | " 8 | \n",
506 | " 5.0 | \n",
507 | " 3.0 | \n",
508 | " 5.0 | \n",
509 | " 12.0 | \n",
510 | " 8.0 | \n",
511 | " 1 | \n",
512 | "
\n",
513 | " \n",
514 | " 20850 | \n",
515 | " 2 | \n",
516 | " 3 | \n",
517 | " 1 | \n",
518 | " 3 | \n",
519 | " 4 | \n",
520 | " 11 | \n",
521 | " 12 | \n",
522 | " 5 | \n",
523 | " 4 | \n",
524 | " 9 | \n",
525 | " 11.0 | \n",
526 | " 12.0 | \n",
527 | " 5.0 | \n",
528 | " 4.0 | \n",
529 | " 9.0 | \n",
530 | " 0 | \n",
531 | "
\n",
532 | " \n",
533 | "
"
534 | ],
535 | "text/plain": [
536 | ""
537 | ]
538 | },
539 | "metadata": {
540 | "tags": []
541 | }
542 | }
543 | ]
544 | },
545 | {
546 | "cell_type": "code",
547 | "metadata": {
548 | "id": "L-m7gt1WPzms",
549 | "colab_type": "code",
550 | "colab": {
551 | "base_uri": "https://localhost:8080/",
552 | "height": 34
553 | },
554 | "outputId": "e4f06c6f-d283-4086-c174-b7bd278fb732"
555 | },
556 | "source": [
557 | "len(to)"
558 | ],
559 | "execution_count": 20,
560 | "outputs": [
561 | {
562 | "output_type": "execute_result",
563 | "data": {
564 | "text/plain": [
565 | "25010"
566 | ]
567 | },
568 | "metadata": {
569 | "tags": []
570 | },
571 | "execution_count": 20
572 | }
573 | ]
574 | },
575 | {
576 | "cell_type": "code",
577 | "metadata": {
578 | "id": "7IWoA3CMPHm7",
579 | "colab_type": "code",
580 | "colab": {}
581 | },
582 | "source": [
583 | "dls = to.dataloaders(bs=2048)"
584 | ],
585 | "execution_count": 0,
586 | "outputs": []
587 | },
588 | {
589 | "cell_type": "markdown",
590 | "metadata": {
591 | "id": "KiTZuvcSP6Vk",
592 | "colab_type": "text"
593 | },
594 | "source": [
595 | "# Baseline"
596 | ]
597 | },
598 | {
599 | "cell_type": "code",
600 | "metadata": {
601 | "id": "v2XR3nTwUsaB",
602 | "colab_type": "code",
603 | "colab": {}
604 | },
605 | "source": [
606 | "class myLabelSmoothingCrossEntropyFlat(BaseLoss):\n",
607 | " \"Same as `nn.CrossEntropyLoss`, but flattens input and target.\"\n",
608 | " y_int = True\n",
609 | " def __init__(self, *args, axis=-1, **kwargs): super().__init__(LabelSmoothingCrossEntropy, *args, axis=axis, **kwargs)\n",
610 | " def decodes(self, x): return x.argmax(dim=self.axis)\n",
611 | " def activation(self, x): return F.softmax(x, dim=self.axis)"
612 | ],
613 | "execution_count": 0,
614 | "outputs": []
615 | },
616 | {
617 | "cell_type": "code",
618 | "metadata": {
619 | "id": "0Gr34M22bxfO",
620 | "colab_type": "code",
621 | "colab": {}
622 | },
623 | "source": [
624 | "class TrackHighestEpoch(TrackerCallback):\n",
625 | " \"A `TrackerCallback` that terminates training when monitored quantity stops improving.\"\n",
626 | " def __init__(self, monitor='accuracy', comp=None, min_delta=0., patience=1):\n",
627 | " super().__init__(monitor=monitor, comp=comp, min_delta=min_delta)\n",
628 | " self.patience = patience\n",
629 | "\n",
630 | " def begin_fit(self): self.highest_epoch = 0; super().begin_fit()\n",
631 | " def after_epoch(self):\n",
632 | " \"Compare the value monitored to its best score and maybe stop training.\"\n",
633 | " super().after_epoch()\n",
634 | " if self.new_best: \n",
635 | " self.highest_epoch = self.epoch\n",
636 | " def after_fit(self):\n",
637 | " \"Print highest value\"\n",
638 | " print(f'Highest accuracy of: {self.best} at epoch {self.highest_epoch+1}')"
639 | ],
640 | "execution_count": 0,
641 | "outputs": []
642 | },
643 | {
644 | "cell_type": "markdown",
645 | "metadata": {
646 | "id": "AuZUx_CsWfYD",
647 | "colab_type": "text"
648 | },
649 | "source": [
650 | "## Run 1"
651 | ]
652 | },
653 | {
654 | "cell_type": "code",
655 | "metadata": {
656 | "id": "T-aEVhlNb1h_",
657 | "colab_type": "code",
658 | "colab": {
659 | "base_uri": "https://localhost:8080/",
660 | "height": 1000
661 | },
662 | "outputId": "f5500cf6-a14f-407a-e7a5-1c36c22bfeb4"
663 | },
664 | "source": [
665 | "learn = tabular_learner(dls, layers=[100,50,50],\n",
666 | " ps=[0.01,0.01,0.02], metrics=accuracy,\n",
667 | " loss_func=myLabelSmoothingCrossEntropyFlat(), n_out=10,\n",
668 | " cbs=TrackHighestEpoch)\n",
669 | "with learn.no_bar():\n",
670 | " learn.fit_one_cycle(400, 1e-1)"
671 | ],
672 | "execution_count": 108,
673 | "outputs": [
674 | {
675 | "output_type": "stream",
676 | "text": [
677 | "(#5) [0,1.8988388776779175,2.0034022331237793,0.44682127237319946,'00:00']\n",
678 | "(#5) [1,1.6181501150131226,1.3519799709320068,0.5001999139785767,'00:00']\n",
679 | "(#5) [2,1.504436731338501,1.327201008796692,0.5179927945137024,'00:00']\n",
680 | "(#5) [3,1.4352670907974243,1.2917509078979492,0.5171931385993958,'00:00']\n",
681 | "(#5) [4,1.3906110525131226,1.2875611782073975,0.5209916234016418,'00:00']\n",
682 | "(#5) [5,1.3558152914047241,1.2735843658447266,0.5453818440437317,'00:00']\n",
683 | "(#5) [6,1.327859878540039,1.2561819553375244,0.5711715221405029,'00:00']\n",
684 | "(#5) [7,1.302958607673645,1.2359035015106201,0.5897641181945801,'00:00']\n",
685 | "(#5) [8,1.2801798582077026,1.2195144891738892,0.6043582558631897,'00:00']\n",
686 | "(#5) [9,1.2572294473648071,1.2002384662628174,0.6247500777244568,'00:00']\n",
687 | "(#5) [10,1.2347543239593506,1.1807585954666138,0.6387444734573364,'00:00']\n",
688 | "(#5) [11,1.2118557691574097,1.1614450216293335,0.658736526966095,'00:00']\n",
689 | "(#5) [12,1.1889569759368896,1.1361898183822632,0.6761295199394226,'00:00']\n",
690 | "(#5) [13,1.1659647226333618,1.1285959482192993,0.6807277202606201,'00:00']\n",
691 | "(#5) [14,1.1435341835021973,1.1189855337142944,0.6863254904747009,'00:00']\n",
692 | "(#5) [15,1.1211202144622803,1.0943889617919922,0.7099160552024841,'00:00']\n",
693 | "(#5) [16,1.0997625589370728,1.0759376287460327,0.7181127667427063,'00:00']\n",
694 | "(#5) [17,1.0793744325637817,1.0681192874908447,0.7195122241973877,'00:00']\n",
695 | "(#5) [18,1.0594773292541504,1.0428119897842407,0.73870450258255,'00:00']\n",
696 | "(#5) [19,1.0395194292068481,1.0472582578659058,0.7329068183898926,'00:00']\n",
697 | "(#5) [20,1.0211474895477295,1.008906602859497,0.7588964700698853,'00:00']\n",
698 | "(#5) [21,0.9999163150787354,0.9939606189727783,0.764094352722168,'00:00']\n",
699 | "(#5) [22,0.9802188277244568,0.9845790266990662,0.7720911502838135,'00:00']\n",
700 | "(#5) [23,0.9624356627464294,0.9692959785461426,0.781687319278717,'00:00']\n",
701 | "(#5) [24,0.9458783864974976,0.9532535672187805,0.79608154296875,'00:00']\n",
702 | "(#5) [25,0.9292141795158386,0.9343454241752625,0.7998800277709961,'00:00']\n",
703 | "(#5) [26,0.9119983911514282,0.9537193775177002,0.8024790287017822,'00:00']\n",
704 | "(#5) [27,0.8972235918045044,0.9192653298377991,0.809876024723053,'00:00']\n",
705 | "(#5) [28,0.8845584392547607,0.9337584376335144,0.8044782280921936,'00:00']\n",
706 | "(#5) [29,0.872266948223114,0.9021876454353333,0.8166733384132385,'00:00']\n",
707 | "(#5) [30,0.8610424995422363,0.9057198166847229,0.824670135974884,'00:00']\n",
708 | "(#5) [31,0.8499866127967834,0.896098792552948,0.8238704800605774,'00:00']\n",
709 | "(#5) [32,0.8391835689544678,0.889091432094574,0.8382647037506104,'00:00']\n",
710 | "(#5) [33,0.8294696807861328,0.8756468892097473,0.8244702219963074,'00:00']\n",
711 | "(#5) [34,0.8188741207122803,0.8739389181137085,0.8416633605957031,'00:00']\n",
712 | "(#5) [35,0.8097578287124634,0.8869301080703735,0.8290683627128601,'00:00']\n",
713 | "(#5) [36,0.8013383150100708,0.8790386319160461,0.8344662189483643,'00:00']\n",
714 | "(#5) [37,0.791685938835144,0.8755353093147278,0.8512594699859619,'00:00']\n",
715 | "(#5) [38,0.7829576730728149,0.8563255071640015,0.8458616733551025,'00:00']\n",
716 | "(#5) [39,0.774532675743103,0.8337002396583557,0.8612555265426636,'00:00']\n",
717 | "(#5) [40,0.7657444477081299,0.8145809769630432,0.8684526085853577,'00:00']\n",
718 | "(#5) [41,0.7578209638595581,0.8168904781341553,0.8618552684783936,'00:00']\n",
719 | "(#5) [42,0.7496445178985596,0.8152536749839783,0.8672531247138977,'00:00']\n",
720 | "(#5) [43,0.7446134686470032,0.8254022598266602,0.8692523241043091,'00:00']\n",
721 | "(#5) [44,0.7395678162574768,0.8241293430328369,0.8642542958259583,'00:00']\n",
722 | "(#5) [45,0.7360106110572815,0.8508003950119019,0.8404638171195984,'00:00']\n",
723 | "(#5) [46,0.7299895882606506,0.8130757212638855,0.8764494061470032,'00:00']\n",
724 | "(#5) [47,0.7262740731239319,0.879626452922821,0.825269877910614,'00:00']\n",
725 | "(#5) [48,0.7239258885383606,0.8276737928390503,0.8582566976547241,'00:00']\n",
726 | "(#5) [49,0.7196939587593079,0.7869423627853394,0.8800479769706726,'00:00']\n",
727 | "(#5) [50,0.7155860066413879,0.8121333122253418,0.865453839302063,'00:00']\n",
728 | "(#5) [51,0.7114527821540833,0.8295021653175354,0.8600559830665588,'00:00']\n",
729 | "(#5) [52,0.7083442211151123,0.7996428608894348,0.8780487775802612,'00:00']\n",
730 | "(#5) [53,0.7057041525840759,0.7776599526405334,0.8832467198371887,'00:00']\n",
731 | "(#5) [54,0.7013317346572876,0.8330228328704834,0.8674530386924744,'00:00']\n",
732 | "(#5) [55,0.6991393566131592,0.8088069558143616,0.8736505508422852,'00:00']\n",
733 | "(#5) [56,0.697238564491272,0.8746702671051025,0.8320671916007996,'00:00']\n",
734 | "(#5) [57,0.6954111456871033,0.764887809753418,0.8922430872917175,'00:00']\n",
735 | "(#5) [58,0.6921842098236084,0.7629520297050476,0.8950420022010803,'00:00']\n",
736 | "(#5) [59,0.6886324882507324,0.7597423791885376,0.9018392562866211,'00:00']\n",
737 | "(#5) [60,0.6859751343727112,0.7602872848510742,0.8990404009819031,'00:00']\n",
738 | "(#5) [61,0.6844431161880493,0.7950742840766907,0.8778488636016846,'00:00']\n",
739 | "(#5) [62,0.6823853254318237,0.766648530960083,0.8956417441368103,'00:00']\n",
740 | "(#5) [63,0.681084930896759,0.7762118577957153,0.897441029548645,'00:00']\n",
741 | "(#5) [64,0.681154727935791,0.8217461109161377,0.8672531247138977,'00:00']\n",
742 | "(#5) [65,0.6802733540534973,0.7687191367149353,0.8932427167892456,'00:00']\n",
743 | "(#5) [66,0.6778400540351868,0.7699198722839355,0.9018392562866211,'00:00']\n",
744 | "(#5) [67,0.6745471954345703,0.7579618692398071,0.9068372845649719,'00:00']\n",
745 | "(#5) [68,0.6712662577629089,0.7921924591064453,0.8700519800186157,'00:00']\n",
746 | "(#5) [69,0.6680634617805481,0.7589104175567627,0.9040383696556091,'00:00']\n",
747 | "(#5) [70,0.6647331118583679,0.738341748714447,0.8950420022010803,'00:00']\n",
748 | "(#5) [71,0.6629887819290161,0.7243375182151794,0.914034366607666,'00:00']\n",
749 | "(#5) [72,0.6610223054885864,0.7300659418106079,0.9082366824150085,'00:00']\n",
750 | "(#5) [73,0.6612351536750793,0.7462111711502075,0.9032387137413025,'00:00']\n",
751 | "(#5) [74,0.6588223576545715,0.7482232451438904,0.8938424587249756,'00:00']\n",
752 | "(#5) [75,0.6581284403800964,0.7288116216659546,0.9168332815170288,'00:00']\n",
753 | "(#5) [76,0.657396137714386,0.7340035438537598,0.9166333675384521,'00:00']\n",
754 | "(#5) [77,0.6567118167877197,0.7139840126037598,0.914034366607666,'00:00']\n",
755 | "(#5) [78,0.6552243828773499,0.6953218579292297,0.9204318523406982,'00:00']\n",
756 | "(#5) [79,0.6534650921821594,0.7364976406097412,0.9082366824150085,'00:00']\n",
757 | "(#5) [80,0.6507847309112549,0.6812044382095337,0.9328268766403198,'00:00']\n",
758 | "(#5) [81,0.6485080122947693,0.7159050703048706,0.9110355973243713,'00:00']\n",
759 | "(#5) [82,0.6475773453712463,0.6979034543037415,0.9222310781478882,'00:00']\n",
760 | "(#5) [83,0.6452143788337708,0.7028968930244446,0.9138344526290894,'00:00']\n",
761 | "(#5) [84,0.6426419019699097,0.6774625182151794,0.9354258179664612,'00:00']\n",
762 | "(#5) [85,0.6409481167793274,0.6782192587852478,0.927828848361969,'00:00']\n",
763 | "(#5) [86,0.6379715800285339,0.6746974587440491,0.9360256195068359,'00:00']\n",
764 | "(#5) [87,0.635582447052002,0.7017251253128052,0.9136345386505127,'00:00']\n",
765 | "(#5) [88,0.6329542398452759,0.656029462814331,0.938224732875824,'00:00']\n",
766 | "(#5) [89,0.6327173113822937,0.6887244582176208,0.924430251121521,'00:00']\n",
767 | "(#5) [90,0.6329394578933716,0.6587323546409607,0.9482207298278809,'00:00']\n",
768 | "(#5) [91,0.6293033957481384,0.6331092715263367,0.9508196711540222,'00:00']\n",
769 | "(#5) [92,0.6265695691108704,0.6293234825134277,0.9578168988227844,'00:00']\n",
770 | "(#5) [93,0.6233600378036499,0.6232103109359741,0.9582167267799377,'00:00']\n",
771 | "(#5) [94,0.6197111010551453,0.6486911177635193,0.9486205577850342,'00:00']\n",
772 | "(#5) [95,0.6173653602600098,0.682388961315155,0.9298280477523804,'00:00']\n",
773 | "(#5) [96,0.6174587607383728,0.6462038159370422,0.9494202136993408,'00:00']\n",
774 | "(#5) [97,0.6148543953895569,0.6063200831413269,0.9654138088226318,'00:00']\n",
775 | "(#5) [98,0.6140066385269165,0.6107450723648071,0.9646141529083252,'00:00']\n",
776 | "(#5) [99,0.6123109459877014,0.6159162521362305,0.9618152976036072,'00:00']\n",
777 | "(#5) [100,0.6104340553283691,0.5938677191734314,0.9672130942344666,'00:00']\n",
778 | "(#5) [101,0.6081230044364929,0.6183945536613464,0.9590163826942444,'00:00']\n",
779 | "(#5) [102,0.6061484813690186,0.620755136013031,0.9602159261703491,'00:00']\n",
780 | "(#5) [103,0.6051089763641357,0.6587780117988586,0.9474210143089294,'00:00']\n",
781 | "(#5) [104,0.604724109172821,0.6369314193725586,0.9540184140205383,'00:00']\n",
782 | "(#5) [105,0.6026014089584351,0.5947378873825073,0.971411406993866,'00:00']\n",
783 | "(#5) [106,0.6014025807380676,0.6220039129257202,0.9588164687156677,'00:00']\n",
784 | "(#5) [107,0.60160231590271,0.5944986939430237,0.9716113805770874,'00:00']\n",
785 | "(#5) [108,0.6010482311248779,0.6154510974884033,0.9612154960632324,'00:00']\n",
786 | "(#5) [109,0.600772500038147,0.5983782410621643,0.9654138088226318,'00:00']\n",
787 | "(#5) [110,0.5980451107025146,0.5829362869262695,0.973010778427124,'00:00']\n",
788 | "(#5) [111,0.595073401927948,0.5813127756118774,0.9754098653793335,'00:00']\n",
789 | "(#5) [112,0.5921765565872192,0.5829159617424011,0.973010778427124,'00:00']\n",
790 | "(#5) [113,0.5897014141082764,0.5911180973052979,0.9728108644485474,'00:00']\n",
791 | "(#5) [114,0.5876219272613525,0.5798064470291138,0.9746101498603821,'00:00']\n",
792 | "(#5) [115,0.5877175331115723,0.5761328935623169,0.9786085486412048,'00:00']\n",
793 | "(#5) [116,0.5853715538978577,0.5639895796775818,0.9826069474220276,'00:00']\n",
794 | "(#5) [117,0.5835192203521729,0.5926344394683838,0.9734106063842773,'00:00']\n",
795 | "(#5) [118,0.5830507874488831,0.5719068646430969,0.9800080060958862,'00:00']\n",
796 | "(#5) [119,0.5823454856872559,0.5688933730125427,0.9778088927268982,'00:00']\n",
797 | "(#5) [120,0.5812788605690002,0.5804968476295471,0.9782087206840515,'00:00']\n",
798 | "(#5) [121,0.5802531242370605,0.5817098021507263,0.9786085486412048,'00:00']\n",
799 | "(#5) [122,0.5785289406776428,0.5683091282844543,0.9770091772079468,'00:00']\n",
800 | "(#5) [123,0.5766546130180359,0.565406084060669,0.9794082641601562,'00:00']\n",
801 | "(#5) [124,0.5767857432365417,0.5652543306350708,0.9820072054862976,'00:00']\n",
802 | "(#5) [125,0.5757301449775696,0.5628215074539185,0.981807291507721,'00:00']\n",
803 | "(#5) [126,0.5744662880897522,0.5605084896087646,0.9814074635505676,'00:00']\n",
804 | "(#5) [127,0.5727643370628357,0.5696738958358765,0.9824070334434509,'00:00']\n",
805 | "(#5) [128,0.5719968676567078,0.561036229133606,0.9844062328338623,'00:00']\n",
806 | "(#5) [129,0.571144700050354,0.5610754489898682,0.9806077480316162,'00:00']\n",
807 | "(#5) [130,0.5703204870223999,0.5663055181503296,0.9800080060958862,'00:00']\n",
808 | "(#5) [131,0.5699008703231812,0.5629748106002808,0.9798080921173096,'00:00']\n",
809 | "(#5) [132,0.568790078163147,0.5617280602455139,0.9808076620101929,'00:00']\n",
810 | "(#5) [133,0.5687212944030762,0.567672073841095,0.9822071194648743,'00:00']\n",
811 | "(#5) [134,0.5691676139831543,0.5635556578636169,0.9810075759887695,'00:00']\n",
812 | "(#5) [135,0.5681486129760742,0.5564377903938293,0.9824070334434509,'00:00']\n",
813 | "(#5) [136,0.5666252970695496,0.5512400269508362,0.9864054322242737,'00:00']\n",
814 | "(#5) [137,0.5664322972297668,0.5638113617897034,0.9812074899673462,'00:00']\n",
815 | "(#5) [138,0.5664032101631165,0.5677741169929504,0.9802079200744629,'00:00']\n",
816 | "(#5) [139,0.5664545297622681,0.5555366277694702,0.9848060607910156,'00:00']\n",
817 | "(#5) [140,0.5652403831481934,0.5545257329940796,0.9860056042671204,'00:00']\n",
818 | "(#5) [141,0.5644558072090149,0.5589013695716858,0.9866053462028503,'00:00']\n",
819 | "(#5) [142,0.5642939209938049,0.5501952767372131,0.9866053462028503,'00:00']\n",
820 | "(#5) [143,0.563563346862793,0.5516894459724426,0.9878048896789551,'00:00']\n",
821 | "(#5) [144,0.563177227973938,0.5705329179763794,0.9782087206840515,'00:00']\n",
822 | "(#5) [145,0.5634644031524658,0.5540329813957214,0.984606146812439,'00:00']\n",
823 | "(#5) [146,0.562550961971283,0.5526329278945923,0.986805260181427,'00:00']\n",
824 | "(#5) [147,0.5626583099365234,0.5515076518058777,0.9886045455932617,'00:00']\n",
825 | "(#5) [148,0.561762273311615,0.5435655117034912,0.9888044595718384,'00:00']\n",
826 | "(#5) [149,0.5611134171485901,0.5439176559448242,0.9898040890693665,'00:00']\n",
827 | "(#5) [150,0.5602315664291382,0.557362973690033,0.985605776309967,'00:00']\n",
828 | "(#5) [151,0.5593281984329224,0.5489062070846558,0.9884046316146851,'00:00']\n",
829 | "(#5) [152,0.5584642887115479,0.56034255027771,0.9896041750907898,'00:00']\n",
830 | "(#5) [153,0.5588650107383728,0.551461935043335,0.9876049757003784,'00:00']\n",
831 | "(#5) [154,0.558020293712616,0.5569924116134644,0.9870051741600037,'00:00']\n",
832 | "(#5) [155,0.5597991943359375,0.5600662231445312,0.9836065769195557,'00:00']\n",
833 | "(#5) [156,0.5607252717018127,0.5604606866836548,0.9828068614006042,'00:00']\n",
834 | "(#5) [157,0.5598622560501099,0.5419889688491821,0.9900040030479431,'00:00']\n",
835 | "(#5) [158,0.5571200847625732,0.5459945797920227,0.986805260181427,'00:00']\n",
836 | "(#5) [159,0.5554546117782593,0.543572723865509,0.9894042611122131,'00:00']\n",
837 | "(#5) [160,0.5542852878570557,0.5524628758430481,0.9848060607910156,'00:00']\n",
838 | "(#5) [161,0.5527011752128601,0.5476252436637878,0.9874050617218018,'00:00']\n",
839 | "(#5) [162,0.551811158657074,0.5463951826095581,0.9866053462028503,'00:00']\n",
840 | "(#5) [163,0.5511592030525208,0.5452464818954468,0.9888044595718384,'00:00']\n",
841 | "(#5) [164,0.5510541200637817,0.5631833076477051,0.985605776309967,'00:00']\n",
842 | "(#5) [165,0.5518730282783508,0.5472319722175598,0.9892043471336365,'00:00']\n",
843 | "(#5) [166,0.5517995953559875,0.5441977381706238,0.9886045455932617,'00:00']\n",
844 | "(#5) [167,0.5516155958175659,0.5419974327087402,0.9886045455932617,'00:00']\n",
845 | "(#5) [168,0.5510050058364868,0.5389197468757629,0.9914034605026245,'00:00']\n",
846 | "(#5) [169,0.5507071614265442,0.5403546690940857,0.9894042611122131,'00:00']\n",
847 | "(#5) [170,0.5508738160133362,0.55748051404953,0.9870051741600037,'00:00']\n",
848 | "(#5) [171,0.5508279204368591,0.5415942072868347,0.9910035729408264,'00:00']\n",
849 | "(#5) [172,0.5502063035964966,0.539540708065033,0.9900040030479431,'00:00']\n",
850 | "(#5) [173,0.5494776368141174,0.5608266592025757,0.9822071194648743,'00:00']\n",
851 | "(#5) [174,0.5508195161819458,0.5469868779182434,0.989004373550415,'00:00']\n",
852 | "(#5) [175,0.5507072806358337,0.5425346493721008,0.9892043471336365,'00:00']\n",
853 | "(#5) [176,0.5496603846549988,0.5461878776550293,0.9896041750907898,'00:00']\n",
854 | "(#5) [177,0.5479555130004883,0.5399890542030334,0.9904038310050964,'00:00']\n",
855 | "(#5) [178,0.5474578738212585,0.541008472442627,0.9894042611122131,'00:00']\n",
856 | "(#5) [179,0.5465767979621887,0.5527443885803223,0.9888044595718384,'00:00']\n",
857 | "(#5) [180,0.5461452007293701,0.536941409111023,0.9898040890693665,'00:00']\n",
858 | "(#5) [181,0.5458506345748901,0.54200279712677,0.9904038310050964,'00:00']\n",
859 | "(#5) [182,0.547073483467102,0.5441285371780396,0.9920032024383545,'00:00']\n",
860 | "(#5) [183,0.5463429093360901,0.5373473167419434,0.9902039170265198,'00:00']\n",
861 | "(#5) [184,0.5449623465538025,0.5397842526435852,0.9916033744812012,'00:00']\n",
862 | "(#5) [185,0.5447919964790344,0.5407416820526123,0.9898040890693665,'00:00']\n",
863 | "(#5) [186,0.544193685054779,0.5387341380119324,0.9904038310050964,'00:00']\n",
864 | "(#5) [187,0.5438226461410522,0.541583776473999,0.989004373550415,'00:00']\n",
865 | "(#5) [188,0.5437393188476562,0.5371403694152832,0.9912035465240479,'00:00']\n",
866 | "(#5) [189,0.5434578657150269,0.5361962914466858,0.9912035465240479,'00:00']\n",
867 | "(#5) [190,0.5438090562820435,0.5386058688163757,0.9910035729408264,'00:00']\n",
868 | "(#5) [191,0.5437993407249451,0.5419303774833679,0.9894042611122131,'00:00']\n",
869 | "(#5) [192,0.543586254119873,0.5401433706283569,0.9902039170265198,'00:00']\n",
870 | "(#5) [193,0.5426438450813293,0.5415073037147522,0.9894042611122131,'00:00']\n",
871 | "(#5) [194,0.542177140712738,0.5372280478477478,0.9912035465240479,'00:00']\n",
872 | "(#5) [195,0.5414615273475647,0.5371184945106506,0.9922031164169312,'00:00']\n",
873 | "(#5) [196,0.5406960248947144,0.532403290271759,0.9926029443740845,'00:00']\n",
874 | "(#5) [197,0.540004551410675,0.5330573320388794,0.9910035729408264,'00:00']\n",
875 | "(#5) [198,0.5390638113021851,0.5313688516616821,0.9934026598930359,'00:00']\n",
876 | "(#5) [199,0.5390013456344604,0.5409775376319885,0.9918032884597778,'00:00']\n",
877 | "(#5) [200,0.5391598343849182,0.5460970401763916,0.9912035465240479,'00:00']\n",
878 | "(#5) [201,0.5389962196350098,0.5367165803909302,0.9918032884597778,'00:00']\n",
879 | "(#5) [202,0.5388821959495544,0.5360429883003235,0.9908036589622498,'00:00']\n",
880 | "(#5) [203,0.5385870933532715,0.5345481038093567,0.9916033744812012,'00:00']\n",
881 | "(#5) [204,0.5379867553710938,0.531783401966095,0.9914034605026245,'00:00']\n",
882 | "(#5) [205,0.5372632741928101,0.5313836336135864,0.9918032884597778,'00:00']\n",
883 | "(#5) [206,0.5368760824203491,0.5384743809700012,0.9908036589622498,'00:00']\n",
884 | "(#5) [207,0.5365601778030396,0.5326656699180603,0.9928028583526611,'00:00']\n",
885 | "(#5) [208,0.5363569259643555,0.5316846966743469,0.9910035729408264,'00:00']\n",
886 | "(#5) [209,0.5352291464805603,0.5325562953948975,0.9922031164169312,'00:00']\n",
887 | "(#5) [210,0.5347089171409607,0.5412618517875671,0.989004373550415,'00:00']\n",
888 | "(#5) [211,0.5351636409759521,0.5336302518844604,0.9924030303955078,'00:00']\n",
889 | "(#5) [212,0.5352975130081177,0.5330905914306641,0.9932027459144592,'00:00']\n",
890 | "(#5) [213,0.5348905324935913,0.5326248407363892,0.9932027459144592,'00:00']\n",
891 | "(#5) [214,0.5345026850700378,0.5316553711891174,0.9926029443740845,'00:00']\n",
892 | "(#5) [215,0.5345447659492493,0.5350981950759888,0.9918032884597778,'00:00']\n",
893 | "(#5) [216,0.534011721611023,0.5335423946380615,0.9920032024383545,'00:00']\n",
894 | "(#5) [217,0.533636212348938,0.534536600112915,0.9914034605026245,'00:00']\n",
895 | "(#5) [218,0.5331500768661499,0.5349645018577576,0.9922031164169312,'00:00']\n",
896 | "(#5) [219,0.5329317450523376,0.5325735211372375,0.9930027723312378,'00:00']\n",
897 | "(#5) [220,0.5332186222076416,0.5331716537475586,0.9926029443740845,'00:00']\n",
898 | "(#5) [221,0.5329287052154541,0.5287380218505859,0.9930027723312378,'00:00']\n",
899 | "(#5) [222,0.5324598550796509,0.531495988368988,0.9914034605026245,'00:00']\n",
900 | "(#5) [223,0.5324926376342773,0.5294556617736816,0.9916033744812012,'00:00']\n",
901 | "(#5) [224,0.5316376686096191,0.5313072800636292,0.9914034605026245,'00:00']\n",
902 | "(#5) [225,0.5310033559799194,0.5313200950622559,0.9922031164169312,'00:00']\n",
903 | "(#5) [226,0.5309513807296753,0.5338365435600281,0.9918032884597778,'00:00']\n",
904 | "(#5) [227,0.5305466055870056,0.5325965881347656,0.9922031164169312,'00:00']\n",
905 | "(#5) [228,0.5299484133720398,0.5315355062484741,0.9924030303955078,'00:00']\n",
906 | "(#5) [229,0.5294996500015259,0.5310744643211365,0.9934026598930359,'00:00']\n",
907 | "(#5) [230,0.5292233824729919,0.531655490398407,0.9928028583526611,'00:00']\n",
908 | "(#5) [231,0.5290960073471069,0.5311590433120728,0.9912035465240479,'00:00']\n",
909 | "(#5) [232,0.5296154022216797,0.534904956817627,0.9914034605026245,'00:00']\n",
910 | "(#5) [233,0.5295825600624084,0.53073650598526,0.9912035465240479,'00:00']\n",
911 | "(#5) [234,0.5297051072120667,0.5349593162536621,0.9920032024383545,'00:00']\n",
912 | "(#5) [235,0.529041588306427,0.5336426496505737,0.9918032884597778,'00:00']\n",
913 | "(#5) [236,0.5294653177261353,0.5289511680603027,0.9924030303955078,'00:00']\n",
914 | "(#5) [237,0.5291647911071777,0.5286902785301208,0.9926029443740845,'00:00']\n",
915 | "(#5) [238,0.5281515121459961,0.5282547473907471,0.9920032024383545,'00:00']\n",
916 | "(#5) [239,0.5272935628890991,0.5294502973556519,0.9920032024383545,'00:00']\n",
917 | "(#5) [240,0.527264416217804,0.5310019254684448,0.9928028583526611,'00:00']\n",
918 | "(#5) [241,0.5275453329086304,0.5301372408866882,0.9922031164169312,'00:00']\n",
919 | "(#5) [242,0.527704656124115,0.5293781161308289,0.9930027723312378,'00:00']\n",
920 | "(#5) [243,0.5272142291069031,0.5293933749198914,0.9932027459144592,'00:00']\n",
921 | "(#5) [244,0.5268895030021667,0.5255526304244995,0.9938024878501892,'00:00']\n",
922 | "(#5) [245,0.5262994766235352,0.5336002111434937,0.9926029443740845,'00:00']\n",
923 | "(#5) [246,0.5263981223106384,0.5306041836738586,0.9938024878501892,'00:00']\n",
924 | "(#5) [247,0.5262888073921204,0.5355449914932251,0.9928028583526611,'00:00']\n",
925 | "(#5) [248,0.5259829759597778,0.530654788017273,0.9922031164169312,'00:00']\n",
926 | "(#5) [249,0.5257411003112793,0.5266352891921997,0.9940024018287659,'00:00']\n",
927 | "(#5) [250,0.5255599617958069,0.5279903411865234,0.9924030303955078,'00:00']\n",
928 | "(#5) [251,0.5253666639328003,0.5290457010269165,0.9934026598930359,'00:00']\n",
929 | "(#5) [252,0.5250216126441956,0.529258668422699,0.9932027459144592,'00:00']\n",
930 | "(#5) [253,0.5249864459037781,0.5306791067123413,0.9926029443740845,'00:00']\n",
931 | "(#5) [254,0.5246566534042358,0.5313565135002136,0.9930027723312378,'00:00']\n",
932 | "(#5) [255,0.5250007510185242,0.5302221775054932,0.9928028583526611,'00:00']\n",
933 | "(#5) [256,0.5247348546981812,0.5337882041931152,0.9932027459144592,'00:00']\n",
934 | "(#5) [257,0.5248061418533325,0.531670331954956,0.9938024878501892,'00:00']\n",
935 | "(#5) [258,0.524968683719635,0.5280632972717285,0.9938024878501892,'00:00']\n",
936 | "(#5) [259,0.5249279737472534,0.5247723460197449,0.9936025738716125,'00:00']\n",
937 | "(#5) [260,0.5252251625061035,0.5306606292724609,0.9930027723312378,'00:00']\n",
938 | "(#5) [261,0.524858295917511,0.5295507907867432,0.9930027723312378,'00:00']\n",
939 | "(#5) [262,0.5244728922843933,0.5331110954284668,0.9924030303955078,'00:00']\n",
940 | "(#5) [263,0.5238193869590759,0.5272631049156189,0.9934026598930359,'00:00']\n",
941 | "(#5) [264,0.5235834121704102,0.5241556167602539,0.9936025738716125,'00:00']\n",
942 | "(#5) [265,0.5233652591705322,0.5264466404914856,0.9934026598930359,'00:00']\n",
943 | "(#5) [266,0.5232020020484924,0.5273608565330505,0.9934026598930359,'00:00']\n",
944 | "(#5) [267,0.5228861570358276,0.526611328125,0.9934026598930359,'00:00']\n",
945 | "(#5) [268,0.5226648449897766,0.5264301300048828,0.9930027723312378,'00:00']\n",
946 | "(#5) [269,0.5220755934715271,0.5272606015205383,0.9930027723312378,'00:00']\n",
947 | "(#5) [270,0.5214000344276428,0.5279192328453064,0.9928028583526611,'00:00']\n",
948 | "(#5) [271,0.5208781361579895,0.5276367664337158,0.9924030303955078,'00:00']\n",
949 | "(#5) [272,0.5204918384552002,0.5274407267570496,0.9930027723312378,'00:00']\n",
950 | "(#5) [273,0.5204680562019348,0.5274019241333008,0.9930027723312378,'00:00']\n",
951 | "(#5) [274,0.5203876495361328,0.5266688466072083,0.9926029443740845,'00:00']\n",
952 | "(#5) [275,0.5204253792762756,0.5308211445808411,0.9930027723312378,'00:00']\n",
953 | "(#5) [276,0.5211333632469177,0.5283054709434509,0.9934026598930359,'00:00']\n",
954 | "(#5) [277,0.521157443523407,0.5251121520996094,0.9934026598930359,'00:00']\n",
955 | "(#5) [278,0.5210174322128296,0.5262086391448975,0.9942023158073425,'00:00']\n",
956 | "(#5) [279,0.520548939704895,0.5268658995628357,0.9944022297859192,'00:00']\n",
957 | "(#5) [280,0.5201582312583923,0.5237573385238647,0.9936025738716125,'00:00']\n",
958 | "(#5) [281,0.5196271538734436,0.5251186490058899,0.9940024018287659,'00:00']\n",
959 | "(#5) [282,0.519331693649292,0.5264992713928223,0.9934026598930359,'00:00']\n",
960 | "(#5) [283,0.5192395448684692,0.5261979699134827,0.9940024018287659,'00:00']\n",
961 | "(#5) [284,0.5194402933120728,0.5247426629066467,0.9936025738716125,'00:00']\n",
962 | "(#5) [285,0.5192012786865234,0.5251612067222595,0.9938024878501892,'00:00']\n",
963 | "(#5) [286,0.5191983580589294,0.5265753269195557,0.9938024878501892,'00:00']\n",
964 | "(#5) [287,0.5188241600990295,0.5252770185470581,0.9942023158073425,'00:00']\n",
965 | "(#5) [288,0.5186485052108765,0.5259371995925903,0.9936025738716125,'00:00']\n",
966 | "(#5) [289,0.5184611678123474,0.5236454010009766,0.9944022297859192,'00:00']\n",
967 | "(#5) [290,0.5182766914367676,0.5273721814155579,0.9938024878501892,'00:00']\n",
968 | "(#5) [291,0.5178884267807007,0.5253341197967529,0.9938024878501892,'00:00']\n",
969 | "(#5) [292,0.5174964070320129,0.5250474214553833,0.9940024018287659,'00:00']\n",
970 | "(#5) [293,0.5173673033714294,0.5253459811210632,0.9938024878501892,'00:00']\n",
971 | "(#5) [294,0.5173306465148926,0.5247576832771301,0.9942023158073425,'00:00']\n",
972 | "(#5) [295,0.5172480940818787,0.524131178855896,0.9942023158073425,'00:00']\n",
973 | "(#5) [296,0.5171375870704651,0.5243687033653259,0.9934026598930359,'00:00']\n",
974 | "(#5) [297,0.5169159173965454,0.5246539115905762,0.9944022297859192,'00:00']\n",
975 | "(#5) [298,0.5169457793235779,0.5245479345321655,0.9938024878501892,'00:00']\n",
976 | "(#5) [299,0.5168913006782532,0.5249813795089722,0.9944022297859192,'00:00']\n",
977 | "(#5) [300,0.5167838335037231,0.5257232785224915,0.9928028583526611,'00:00']\n",
978 | "(#5) [301,0.5166453123092651,0.5245307087898254,0.9936025738716125,'00:00']\n",
979 | "(#5) [302,0.5166196227073669,0.5239624977111816,0.9940024018287659,'00:00']\n",
980 | "(#5) [303,0.5166654586791992,0.5234816670417786,0.9944022297859192,'00:00']\n",
981 | "(#5) [304,0.516602098941803,0.5260818004608154,0.9932027459144592,'00:00']\n",
982 | "(#5) [305,0.5166118144989014,0.5234494209289551,0.9946021437644958,'00:00']\n",
983 | "(#5) [306,0.5165378451347351,0.5228818655014038,0.9940024018287659,'00:00']\n",
984 | "(#5) [307,0.5165170431137085,0.524742603302002,0.9942023158073425,'00:00']\n",
985 | "(#5) [308,0.5160667896270752,0.5237326622009277,0.9946021437644958,'00:00']\n",
986 | "(#5) [309,0.5161541104316711,0.5234215259552002,0.9944022297859192,'00:00']\n",
987 | "(#5) [310,0.515663206577301,0.5237724781036377,0.9936025738716125,'00:00']\n",
988 | "(#5) [311,0.5160006880760193,0.5243257880210876,0.9934026598930359,'00:00']\n",
989 | "(#5) [312,0.5159153938293457,0.5231497883796692,0.9936025738716125,'00:00']\n",
990 | "(#5) [313,0.5156089663505554,0.5245527625083923,0.9940024018287659,'00:00']\n",
991 | "(#5) [314,0.5153904557228088,0.5241479873657227,0.9938024878501892,'00:00']\n",
992 | "(#5) [315,0.5152974128723145,0.5233134031295776,0.9942023158073425,'00:00']\n",
993 | "(#5) [316,0.5149085521697998,0.5224497318267822,0.9942023158073425,'00:00']\n",
994 | "(#5) [317,0.5145557522773743,0.5231661200523376,0.9942023158073425,'00:00']\n",
995 | "(#5) [318,0.5146691799163818,0.5231816172599792,0.9942023158073425,'00:00']\n",
996 | "(#5) [319,0.5144539475440979,0.5233817100524902,0.9944022297859192,'00:00']\n",
997 | "(#5) [320,0.514216423034668,0.5233805179595947,0.9944022297859192,'00:00']\n",
998 | "(#5) [321,0.5142581462860107,0.522704005241394,0.9946021437644958,'00:00']\n",
999 | "(#5) [322,0.5141892433166504,0.5222909450531006,0.9946021437644958,'00:00']\n",
1000 | "(#5) [323,0.5139610171318054,0.5232413411140442,0.9944022297859192,'00:00']\n",
1001 | "(#5) [324,0.5138713717460632,0.5226497650146484,0.9944022297859192,'00:00']\n",
1002 | "(#5) [325,0.5139579176902771,0.5226728916168213,0.9944022297859192,'00:00']\n",
1003 | "(#5) [326,0.5136806964874268,0.5220051407814026,0.9944022297859192,'00:00']\n",
1004 | "(#5) [327,0.5134351849555969,0.52243572473526,0.9940024018287659,'00:00']\n",
1005 | "(#5) [328,0.5131663680076599,0.5218405723571777,0.9946021437644958,'00:00']\n",
1006 | "(#5) [329,0.5130077600479126,0.5212416052818298,0.9946021437644958,'00:00']\n",
1007 | "(#5) [330,0.5129803419113159,0.5213346481323242,0.9948020577430725,'00:00']\n",
1008 | "(#5) [331,0.5130721926689148,0.5222629308700562,0.9942023158073425,'00:00']\n",
1009 | "(#5) [332,0.513016939163208,0.521479070186615,0.9944022297859192,'00:00']\n",
1010 | "(#5) [333,0.512627899646759,0.5216013193130493,0.9942023158073425,'00:00']\n",
1011 | "(#5) [334,0.5126359462738037,0.5218287706375122,0.9938024878501892,'00:00']\n",
1012 | "(#5) [335,0.5126863121986389,0.5217129588127136,0.9940024018287659,'00:00']\n",
1013 | "(#5) [336,0.5125294327735901,0.5219804644584656,0.9940024018287659,'00:00']\n",
1014 | "(#5) [337,0.5124229788780212,0.5227481722831726,0.9940024018287659,'00:00']\n",
1015 | "(#5) [338,0.5126993060112,0.5220319032669067,0.9942023158073425,'00:00']\n",
1016 | "(#5) [339,0.5124730467796326,0.5214740633964539,0.9942023158073425,'00:00']\n",
1017 | "(#5) [340,0.5124539732933044,0.5213128328323364,0.9944022297859192,'00:00']\n",
1018 | "(#5) [341,0.5126002430915833,0.5220752954483032,0.9946021437644958,'00:00']\n",
1019 | "(#5) [342,0.5124865174293518,0.5229030251502991,0.9938024878501892,'00:00']\n",
1020 | "(#5) [343,0.5125812292098999,0.5227707028388977,0.9942023158073425,'00:00']\n",
1021 | "(#5) [344,0.5124053359031677,0.5218341946601868,0.9944022297859192,'00:00']\n",
1022 | "(#5) [345,0.5122432708740234,0.5217817425727844,0.9944022297859192,'00:00']\n",
1023 | "(#5) [346,0.5121005177497864,0.5221076607704163,0.9944022297859192,'00:00']\n",
1024 | "(#5) [347,0.5118415355682373,0.5217265486717224,0.9948020577430725,'00:00']\n",
1025 | "(#5) [348,0.5118343234062195,0.5219483375549316,0.9946021437644958,'00:00']\n",
1026 | "(#5) [349,0.5118020176887512,0.5218709111213684,0.9942023158073425,'00:00']\n",
1027 | "(#5) [350,0.5120850205421448,0.5222635269165039,0.9942023158073425,'00:00']\n",
1028 | "(#5) [351,0.512013852596283,0.5215933322906494,0.9942023158073425,'00:00']\n",
1029 | "(#5) [352,0.5117856860160828,0.5217563509941101,0.9944022297859192,'00:00']\n",
1030 | "(#5) [353,0.5116154551506042,0.5210474133491516,0.9942023158073425,'00:00']\n",
1031 | "(#5) [354,0.5116564035415649,0.5211648941040039,0.9944022297859192,'00:00']\n",
1032 | "(#5) [355,0.5115399360656738,0.5210342407226562,0.9944022297859192,'00:00']\n",
1033 | "(#5) [356,0.511486291885376,0.5216180086135864,0.9944022297859192,'00:00']\n",
1034 | "(#5) [357,0.5112183094024658,0.5214399695396423,0.9944022297859192,'00:00']\n",
1035 | "(#5) [358,0.5113040208816528,0.521693229675293,0.9944022297859192,'00:00']\n",
1036 | "(#5) [359,0.51099693775177,0.5215311050415039,0.9942023158073425,'00:00']\n",
1037 | "(#5) [360,0.5107249021530151,0.5213457345962524,0.9942023158073425,'00:00']\n",
1038 | "(#5) [361,0.5106485486030579,0.5210188627243042,0.9942023158073425,'00:00']\n",
1039 | "(#5) [362,0.5106625556945801,0.5207528471946716,0.9940024018287659,'00:00']\n",
1040 | "(#5) [363,0.5105874538421631,0.520715057849884,0.9944022297859192,'00:00']\n",
1041 | "(#5) [364,0.5104106664657593,0.5208777785301208,0.9946021437644958,'00:00']\n",
1042 | "(#5) [365,0.5104284882545471,0.5210198163986206,0.9942023158073425,'00:00']\n",
1043 | "(#5) [366,0.5103885531425476,0.520967423915863,0.9944022297859192,'00:00']\n",
1044 | "(#5) [367,0.5102233290672302,0.5208911299705505,0.9944022297859192,'00:00']\n",
1045 | "(#5) [368,0.5101333260536194,0.5208389163017273,0.9940024018287659,'00:00']\n",
1046 | "(#5) [369,0.5101016163825989,0.5209945440292358,0.9940024018287659,'00:00']\n",
1047 | "(#5) [370,0.5102167129516602,0.520787239074707,0.9944022297859192,'00:00']\n",
1048 | "(#5) [371,0.5103836059570312,0.5207669138908386,0.9946021437644958,'00:00']\n",
1049 | "(#5) [372,0.5103139281272888,0.52109694480896,0.9946021437644958,'00:00']\n",
1050 | "(#5) [373,0.5101790428161621,0.5213913321495056,0.9940024018287659,'00:00']\n",
1051 | "(#5) [374,0.5099978446960449,0.5211849808692932,0.9940024018287659,'00:00']\n",
1052 | "(#5) [375,0.5100690126419067,0.5210920572280884,0.9942023158073425,'00:00']\n",
1053 | "(#5) [376,0.5098588466644287,0.5211091041564941,0.9942023158073425,'00:00']\n",
1054 | "(#5) [377,0.5098261833190918,0.5209088325500488,0.9944022297859192,'00:00']\n",
1055 | "(#5) [378,0.5098662972450256,0.5207557082176208,0.9942023158073425,'00:00']\n",
1056 | "(#5) [379,0.5099231004714966,0.5208523273468018,0.9942023158073425,'00:00']\n",
1057 | "(#5) [380,0.5097832679748535,0.5209195017814636,0.9942023158073425,'00:00']\n",
1058 | "(#5) [381,0.5100704431533813,0.5210700035095215,0.9942023158073425,'00:00']\n",
1059 | "(#5) [382,0.5101048946380615,0.5209875702857971,0.9942023158073425,'00:00']\n",
1060 | "(#5) [383,0.5100592374801636,0.5209808349609375,0.9942023158073425,'00:00']\n",
1061 | "(#5) [384,0.5098922252655029,0.5210126042366028,0.9940024018287659,'00:00']\n",
1062 | "(#5) [385,0.5099773406982422,0.5209571719169617,0.9940024018287659,'00:00']\n",
1063 | "(#5) [386,0.5097300410270691,0.5209506154060364,0.9940024018287659,'00:00']\n",
1064 | "(#5) [387,0.50971919298172,0.5209936499595642,0.9942023158073425,'00:00']\n",
1065 | "(#5) [388,0.5096389055252075,0.5209466218948364,0.9940024018287659,'00:00']\n",
1066 | "(#5) [389,0.5094747543334961,0.520992636680603,0.9942023158073425,'00:00']\n",
1067 | "(#5) [390,0.5094887018203735,0.5209727883338928,0.9942023158073425,'00:00']\n",
1068 | "(#5) [391,0.5095515847206116,0.5209215879440308,0.9940024018287659,'00:00']\n",
1069 | "(#5) [392,0.5094560980796814,0.5208989977836609,0.9940024018287659,'00:00']\n",
1070 | "(#5) [393,0.5096333026885986,0.520866870880127,0.9942023158073425,'00:00']\n",
1071 | "(#5) [394,0.5094992518424988,0.5208722949028015,0.9940024018287659,'00:00']\n",
1072 | "(#5) [395,0.5094854831695557,0.5209173560142517,0.9940024018287659,'00:00']\n",
1073 | "(#5) [396,0.5096306204795837,0.5209161639213562,0.9942023158073425,'00:00']\n",
1074 | "(#5) [397,0.5094793438911438,0.5209320783615112,0.9942023158073425,'00:00']\n",
1075 | "(#5) [398,0.5095208287239075,0.5209279656410217,0.9942023158073425,'00:00']\n",
1076 | "(#5) [399,0.5097430944442749,0.5209218263626099,0.9942023158073425,'00:00']\n",
1077 | "Highest accuracy of: 0.9948020577430725 at epoch 331\n"
1078 | ],
1079 | "name": "stdout"
1080 | }
1081 | ]
1082 | },
1083 | {
1084 | "cell_type": "markdown",
1085 | "metadata": {
1086 | "id": "5JQ3MiYiWhve",
1087 | "colab_type": "text"
1088 | },
1089 | "source": [
1090 | "## Run 2"
1091 | ]
1092 | },
1093 | {
1094 | "cell_type": "code",
1095 | "metadata": {
1096 | "id": "ZjATeOFyb5Nj",
1097 | "colab_type": "code",
1098 | "colab": {
1099 | "base_uri": "https://localhost:8080/",
1100 | "height": 1000
1101 | },
1102 | "outputId": "64bfe9c8-42e1-4575-bc32-b363309f925b"
1103 | },
1104 | "source": [
1105 | "learn = tabular_learner(dls, layers=[100,50,50],\n",
1106 | " ps=[0.01,0.01,0.02], metrics=accuracy,\n",
1107 | " loss_func=myLabelSmoothingCrossEntropyFlat(), n_out=10,\n",
1108 | " cbs=TrackHighestEpoch)\n",
1109 | "with learn.no_bar():\n",
1110 | " learn.fit_one_cycle(400, 1e-1)"
1111 | ],
1112 | "execution_count": 109,
1113 | "outputs": [
1114 | {
1115 | "output_type": "stream",
1116 | "text": [
1117 | "(#5) [0,1.8379777669906616,1.9357826709747314,0.49500200152397156,'00:00']\n",
1118 | "(#5) [1,1.576326847076416,1.3467679023742676,0.49500200152397156,'00:00']\n",
1119 | "(#5) [2,1.4765552282333374,1.2920480966567993,0.4968012869358063,'00:00']\n",
1120 | "(#5) [3,1.415789008140564,1.2997297048568726,0.5057976841926575,'00:00']\n",
1121 | "(#5) [4,1.3760191202163696,1.2883087396621704,0.5195921659469604,'00:00']\n",
1122 | "(#5) [5,1.3465536832809448,1.2797282934188843,0.5377848744392395,'00:00']\n",
1123 | "(#5) [6,1.3234179019927979,1.2694367170333862,0.545781672000885,'00:00']\n",
1124 | "(#5) [7,1.3030749559402466,1.2590352296829224,0.558976411819458,'00:00']\n",
1125 | "(#5) [8,1.2843879461288452,1.2440656423568726,0.5703718662261963,'00:00']\n",
1126 | "(#5) [9,1.265557885169983,1.2323834896087646,0.588164746761322,'00:00']\n",
1127 | "(#5) [10,1.2474874258041382,1.207640528678894,0.6109555959701538,'00:00']\n",
1128 | "(#5) [11,1.2271007299423218,1.183942198753357,0.6329468488693237,'00:00']\n",
1129 | "(#5) [12,1.2050892114639282,1.1692123413085938,0.6437425017356873,'00:00']\n",
1130 | "(#5) [13,1.1826720237731934,1.170510172843933,0.6529388427734375,'00:00']\n",
1131 | "(#5) [14,1.1590005159378052,1.1490989923477173,0.6735305786132812,'00:00']\n",
1132 | "(#5) [15,1.1359986066818237,1.1374499797821045,0.6785286068916321,'00:00']\n",
1133 | "(#5) [16,1.1135276556015015,1.1285189390182495,0.6909236311912537,'00:00']\n",
1134 | "(#5) [17,1.0917491912841797,1.0969785451889038,0.6979208588600159,'00:00']\n",
1135 | "(#5) [18,1.07032310962677,1.0838333368301392,0.7157137393951416,'00:00']\n",
1136 | "(#5) [19,1.0491902828216553,1.0484939813613892,0.7381047606468201,'00:00']\n",
1137 | "(#5) [20,1.0281840562820435,1.0379589796066284,0.7433027029037476,'00:00']\n",
1138 | "(#5) [21,1.0071666240692139,0.9990405440330505,0.7596961259841919,'00:00']\n",
1139 | "(#5) [22,0.9863239526748657,0.9900838732719421,0.7680927515029907,'00:00']\n",
1140 | "(#5) [23,0.9665817618370056,0.9694926738739014,0.7770891785621643,'00:00']\n",
1141 | "(#5) [24,0.9484809637069702,0.9943398833274841,0.7726909518241882,'00:00']\n",
1142 | "(#5) [25,0.9309156537055969,0.965316891670227,0.7848860621452332,'00:00']\n",
1143 | "(#5) [26,0.9149118661880493,0.9653962850570679,0.7858856320381165,'00:00']\n",
1144 | "(#5) [27,0.8998865485191345,0.9388004541397095,0.7978808283805847,'00:00']\n",
1145 | "(#5) [28,0.8857294321060181,0.9378483891487122,0.8020791411399841,'00:00']\n",
1146 | "(#5) [29,0.8718585968017578,0.9604345560073853,0.7894842028617859,'00:00']\n",
1147 | "(#5) [30,0.8593076467514038,0.9483985900878906,0.8034785985946655,'00:00']\n",
1148 | "(#5) [31,0.8482779860496521,0.9147768616676331,0.8198720216751099,'00:00']\n",
1149 | "(#5) [32,0.836195707321167,0.9020322561264038,0.8256697058677673,'00:00']\n",
1150 | "(#5) [33,0.8255259394645691,0.9497817158699036,0.7890843749046326,'00:00']\n",
1151 | "(#5) [34,0.8155574202537537,0.9008734226226807,0.8376649618148804,'00:00']\n",
1152 | "(#5) [35,0.8057754635810852,0.9167855381965637,0.8326669335365295,'00:00']\n",
1153 | "(#5) [36,0.7977457642555237,0.8905264139175415,0.824070394039154,'00:00']\n",
1154 | "(#5) [37,0.789029061794281,0.8667623996734619,0.841263473033905,'00:00']\n",
1155 | "(#5) [38,0.7794758677482605,0.8859580159187317,0.8280687928199768,'00:00']\n",
1156 | "(#5) [39,0.7705880403518677,0.8788511753082275,0.8344662189483643,'00:00']\n",
1157 | "(#5) [40,0.7615398168563843,0.8338834643363953,0.857257068157196,'00:00']\n",
1158 | "(#5) [41,0.7546232342720032,0.8571226000785828,0.8574570417404175,'00:00']\n",
1159 | "(#5) [42,0.7477862238883972,0.8518473505973816,0.8456617593765259,'00:00']\n",
1160 | "(#5) [43,0.7410028576850891,0.822620153427124,0.8590563535690308,'00:00']\n",
1161 | "(#5) [44,0.7334682941436768,0.8260731101036072,0.8638544678688049,'00:00']\n",
1162 | "(#5) [45,0.7268732190132141,0.8462994694709778,0.854458212852478,'00:00']\n",
1163 | "(#5) [46,0.7211664319038391,0.8056215643882751,0.8730508089065552,'00:00']\n",
1164 | "(#5) [47,0.7150381207466125,0.7815446257591248,0.8876449465751648,'00:00']\n",
1165 | "(#5) [48,0.7098140120506287,0.7779073119163513,0.8904438018798828,'00:00']\n",
1166 | "(#5) [49,0.7053088545799255,0.75980544090271,0.8924430012702942,'00:00']\n",
1167 | "(#5) [50,0.699455201625824,0.7577926516532898,0.896841287612915,'00:00']\n",
1168 | "(#5) [51,0.6944956183433533,0.7608451843261719,0.8922430872917175,'00:00']\n",
1169 | "(#5) [52,0.6896678805351257,0.7711065411567688,0.8830468058586121,'00:00']\n",
1170 | "(#5) [53,0.6849479079246521,0.7917908430099487,0.8774490356445312,'00:00']\n",
1171 | "(#5) [54,0.6794836521148682,0.8037066459655762,0.8760495781898499,'00:00']\n",
1172 | "(#5) [55,0.6764140725135803,0.7688310146331787,0.8892443180084229,'00:00']\n",
1173 | "(#5) [56,0.6743643283843994,0.8200469613075256,0.8566573262214661,'00:00']\n",
1174 | "(#5) [57,0.6737531423568726,0.7386503219604492,0.8982406854629517,'00:00']\n",
1175 | "(#5) [58,0.670484185218811,0.7453084588050842,0.9024389982223511,'00:00']\n",
1176 | "(#5) [59,0.666454553604126,0.7436971068382263,0.9036385416984558,'00:00']\n",
1177 | "(#5) [60,0.6619927883148193,0.7283854484558105,0.916233479976654,'00:00']\n",
1178 | "(#5) [61,0.6572404503822327,0.7041569948196411,0.9168332815170288,'00:00']\n",
1179 | "(#5) [62,0.653551459312439,0.7058644890785217,0.9210315942764282,'00:00']\n",
1180 | "(#5) [63,0.6504225730895996,0.7152230143547058,0.9176329374313354,'00:00']\n",
1181 | "(#5) [64,0.6485350131988525,0.7157670855522156,0.9156337380409241,'00:00']\n",
1182 | "(#5) [65,0.6457213163375854,0.7032666206359863,0.9194322228431702,'00:00']\n",
1183 | "(#5) [66,0.6423847675323486,0.696395754814148,0.926629364490509,'00:00']\n",
1184 | "(#5) [67,0.6395806074142456,0.6871780157089233,0.9356257319450378,'00:00']\n",
1185 | "(#5) [68,0.6348661184310913,0.6540480256080627,0.94382244348526,'00:00']\n",
1186 | "(#5) [69,0.6311874985694885,0.6762862205505371,0.9354258179664612,'00:00']\n",
1187 | "(#5) [70,0.6304004192352295,0.7483986020088196,0.8966413140296936,'00:00']\n",
1188 | "(#5) [71,0.6286932826042175,0.6478606462478638,0.9472211003303528,'00:00']\n",
1189 | "(#5) [72,0.6246771216392517,0.6320382952690125,0.9524190425872803,'00:00']\n",
1190 | "(#5) [73,0.6212963461875916,0.6394813656806946,0.9512194991111755,'00:00']\n",
1191 | "(#5) [74,0.6179182529449463,0.6401713490486145,0.9494202136993408,'00:00']\n",
1192 | "(#5) [75,0.6155080199241638,0.6027900576591492,0.968012809753418,'00:00']\n",
1193 | "(#5) [76,0.6132632493972778,0.5913717746734619,0.972411036491394,'00:00']\n",
1194 | "(#5) [77,0.6085559129714966,0.5829378962516785,0.9754098653793335,'00:00']\n",
1195 | "(#5) [78,0.6061554551124573,0.6341630816459656,0.9522191286087036,'00:00']\n",
1196 | "(#5) [79,0.6038838028907776,0.5826234221458435,0.9758096933364868,'00:00']\n",
1197 | "(#5) [80,0.6006876230239868,0.5808020830154419,0.9760096073150635,'00:00']\n",
1198 | "(#5) [81,0.5974030494689941,0.5870344042778015,0.9718112945556641,'00:00']\n",
1199 | "(#5) [82,0.5941664576530457,0.5911421775817871,0.9720112085342407,'00:00']\n",
1200 | "(#5) [83,0.5914193987846375,0.6024871468544006,0.9694122076034546,'00:00']\n",
1201 | "(#5) [84,0.5919245481491089,0.5871289968490601,0.9768092632293701,'00:00']\n",
1202 | "(#5) [85,0.5905911922454834,0.598868727684021,0.9658136963844299,'00:00']\n",
1203 | "(#5) [86,0.5891609191894531,0.604249894618988,0.9654138088226318,'00:00']\n",
1204 | "(#5) [87,0.5880398154258728,0.6155419945716858,0.9562175273895264,'00:00']\n",
1205 | "(#5) [88,0.5879352688789368,0.5829364657402039,0.9732106924057007,'00:00']\n",
1206 | "(#5) [89,0.58553546667099,0.5948285460472107,0.968012809753418,'00:00']\n",
1207 | "(#5) [90,0.5836919546127319,0.7069556713104248,0.9280287623405457,'00:00']\n",
1208 | "(#5) [91,0.5818227529525757,0.5678604245185852,0.9812074899673462,'00:00']\n",
1209 | "(#5) [92,0.5800365209579468,0.5770272612571716,0.9752098917961121,'00:00']\n",
1210 | "(#5) [93,0.5791610479354858,0.5677480697631836,0.9816073775291443,'00:00']\n",
1211 | "(#5) [94,0.5791536569595337,0.5935924649238586,0.969612181186676,'00:00']\n",
1212 | "(#5) [95,0.5808218121528625,0.5737993717193604,0.9750099778175354,'00:00']\n",
1213 | "(#5) [96,0.5809024572372437,0.5892658829689026,0.9738104939460754,'00:00']\n",
1214 | "(#5) [97,0.5826152563095093,0.5842866897583008,0.9776089787483215,'00:00']\n",
1215 | "(#5) [98,0.5819464325904846,0.5920460224151611,0.9682127237319946,'00:00']\n",
1216 | "(#5) [99,0.5805971026420593,0.5805243253707886,0.9768092632293701,'00:00']\n",
1217 | "(#5) [100,0.5789372324943542,0.568297803401947,0.9824070334434509,'00:00']\n",
1218 | "(#5) [101,0.5762990713119507,0.5545435547828674,0.9830067753791809,'00:00']\n",
1219 | "(#5) [102,0.5747407078742981,0.5678584575653076,0.9828068614006042,'00:00']\n",
1220 | "(#5) [103,0.573013186454773,0.5538428425788879,0.985205888748169,'00:00']\n",
1221 | "(#5) [104,0.5716136693954468,0.5635040998458862,0.9812074899673462,'00:00']\n",
1222 | "(#5) [105,0.570667028427124,0.5552479028701782,0.9864054322242737,'00:00']\n",
1223 | "(#5) [106,0.569153368473053,0.5637291073799133,0.9830067753791809,'00:00']\n",
1224 | "(#5) [107,0.5670950412750244,0.5546660423278809,0.986205518245697,'00:00']\n",
1225 | "(#5) [108,0.5654078125953674,0.5556226968765259,0.9844062328338623,'00:00']\n",
1226 | "(#5) [109,0.5638400912284851,0.5539201498031616,0.986805260181427,'00:00']\n",
1227 | "(#5) [110,0.5635663866996765,0.5617299675941467,0.9826069474220276,'00:00']\n",
1228 | "(#5) [111,0.5644837021827698,0.5758697986602783,0.9794082641601562,'00:00']\n",
1229 | "(#5) [112,0.5660070180892944,0.5777251720428467,0.9788084626197815,'00:00']\n",
1230 | "(#5) [113,0.5659078359603882,0.5572465658187866,0.9820072054862976,'00:00']\n",
1231 | "(#5) [114,0.5658300518989563,0.5579032301902771,0.9836065769195557,'00:00']\n",
1232 | "(#5) [115,0.5688309073448181,0.5734835267066956,0.9774090647697449,'00:00']\n",
1233 | "(#5) [116,0.5707860589027405,0.5678554177284241,0.9808076620101929,'00:00']\n",
1234 | "(#5) [117,0.5708754658699036,0.564287543296814,0.9814074635505676,'00:00']\n",
1235 | "(#5) [118,0.5682251453399658,0.5450521111488342,0.9878048896789551,'00:00']\n",
1236 | "(#5) [119,0.565558910369873,0.5449495315551758,0.9876049757003784,'00:00']\n",
1237 | "(#5) [120,0.5639945864677429,0.5387378334999084,0.9914034605026245,'00:00']\n",
1238 | "(#5) [121,0.5619353652000427,0.5444121956825256,0.9882047176361084,'00:00']\n",
1239 | "(#5) [122,0.5604152679443359,0.5488649010658264,0.9870051741600037,'00:00']\n",
1240 | "(#5) [123,0.5597664713859558,0.5651334524154663,0.9794082641601562,'00:00']\n",
1241 | "(#5) [124,0.5592530965805054,0.598774790763855,0.9662135243415833,'00:00']\n",
1242 | "(#5) [125,0.5603740215301514,0.5890414714813232,0.9746101498603821,'00:00']\n",
1243 | "(#5) [126,0.5615623593330383,0.5659888386726379,0.9822071194648743,'00:00']\n",
1244 | "(#5) [127,0.5636051893234253,0.5665591955184937,0.981807291507721,'00:00']\n",
1245 | "(#5) [128,0.5649935603141785,0.5620694756507874,0.9826069474220276,'00:00']\n",
1246 | "(#5) [129,0.5650741457939148,0.565484344959259,0.9800080060958862,'00:00']\n",
1247 | "(#5) [130,0.5641555190086365,0.54715895652771,0.9892043471336365,'00:00']\n",
1248 | "(#5) [131,0.5621376037597656,0.5424715876579285,0.989004373550415,'00:00']\n",
1249 | "(#5) [132,0.560894787311554,0.5410281419754028,0.9888044595718384,'00:00']\n",
1250 | "(#5) [133,0.558781623840332,0.5413447618484497,0.9884046316146851,'00:00']\n",
1251 | "(#5) [134,0.5574846863746643,0.5465904474258423,0.9900040030479431,'00:00']\n",
1252 | "(#5) [135,0.5568422675132751,0.5407936573028564,0.9884046316146851,'00:00']\n",
1253 | "(#5) [136,0.5553787350654602,0.5444555282592773,0.9884046316146851,'00:00']\n",
1254 | "(#5) [137,0.5538921356201172,0.539490818977356,0.9896041750907898,'00:00']\n",
1255 | "(#5) [138,0.5546979904174805,0.5668619275093079,0.9864054322242737,'00:00']\n",
1256 | "(#5) [139,0.5539058446884155,0.5483890771865845,0.9872051477432251,'00:00']\n",
1257 | "(#5) [140,0.5530227422714233,0.537726879119873,0.9922031164169312,'00:00']\n",
1258 | "(#5) [141,0.5529534220695496,0.5554157495498657,0.9880048036575317,'00:00']\n",
1259 | "(#5) [142,0.552675724029541,0.5417508482933044,0.9908036589622498,'00:00']\n",
1260 | "(#5) [143,0.5520794987678528,0.5526933073997498,0.984006404876709,'00:00']\n",
1261 | "(#5) [144,0.5510904788970947,0.546791672706604,0.9876049757003784,'00:00']\n",
1262 | "(#5) [145,0.5530887842178345,0.5559198260307312,0.989004373550415,'00:00']\n",
1263 | "(#5) [146,0.5537351965904236,0.5527952909469604,0.9874050617218018,'00:00']\n",
1264 | "(#5) [147,0.5537644028663635,0.5425427556037903,0.9904038310050964,'00:00']\n",
1265 | "(#5) [148,0.5525138974189758,0.5393775105476379,0.9898040890693665,'00:00']\n",
1266 | "(#5) [149,0.5505514740943909,0.5436888337135315,0.9886045455932617,'00:00']\n",
1267 | "(#5) [150,0.5493066906929016,0.5380961298942566,0.9910035729408264,'00:00']\n",
1268 | "(#5) [151,0.5483595728874207,0.5451228618621826,0.9886045455932617,'00:00']\n",
1269 | "(#5) [152,0.5478620529174805,0.555934488773346,0.986205518245697,'00:00']\n",
1270 | "(#5) [153,0.5488855838775635,0.5443827509880066,0.9912035465240479,'00:00']\n",
1271 | "(#5) [154,0.5496466755867004,0.5364307165145874,0.9928028583526611,'00:00']\n",
1272 | "(#5) [155,0.5491375923156738,0.546013355255127,0.9882047176361084,'00:00']\n",
1273 | "(#5) [156,0.5482364296913147,0.5415401458740234,0.9878048896789551,'00:00']\n",
1274 | "(#5) [157,0.5477516651153564,0.5376436114311218,0.9906037449836731,'00:00']\n",
1275 | "(#5) [158,0.5476828813552856,0.538558304309845,0.9910035729408264,'00:00']\n",
1276 | "(#5) [159,0.5471773743629456,0.5394008159637451,0.9916033744812012,'00:00']\n",
1277 | "(#5) [160,0.5478582978248596,0.5433517098426819,0.9902039170265198,'00:00']\n",
1278 | "(#5) [161,0.5475465059280396,0.540709912776947,0.9904038310050964,'00:00']\n",
1279 | "(#5) [162,0.5467386841773987,0.5357633829116821,0.9902039170265198,'00:00']\n",
1280 | "(#5) [163,0.5458488464355469,0.5376097559928894,0.9898040890693665,'00:00']\n",
1281 | "(#5) [164,0.5449305772781372,0.5416443943977356,0.9904038310050964,'00:00']\n",
1282 | "(#5) [165,0.5444855093955994,0.5357122421264648,0.9926029443740845,'00:00']\n",
1283 | "(#5) [166,0.5447099804878235,0.5436012148857117,0.9896041750907898,'00:00']\n",
1284 | "(#5) [167,0.5443747639656067,0.5414571762084961,0.9896041750907898,'00:00']\n",
1285 | "(#5) [168,0.5433170795440674,0.5437408089637756,0.9900040030479431,'00:00']\n",
1286 | "(#5) [169,0.542607307434082,0.5369961261749268,0.9904038310050964,'00:00']\n",
1287 | "(#5) [170,0.5424132347106934,0.5384692549705505,0.9892043471336365,'00:00']\n",
1288 | "(#5) [171,0.543666422367096,0.5766170024871826,0.9826069474220276,'00:00']\n",
1289 | "(#5) [172,0.5450561046600342,0.5467339158058167,0.989004373550415,'00:00']\n",
1290 | "(#5) [173,0.5439987778663635,0.540519118309021,0.9894042611122131,'00:00']\n",
1291 | "(#5) [174,0.5429681539535522,0.5374937653541565,0.9918032884597778,'00:00']\n",
1292 | "(#5) [175,0.542198121547699,0.5348916053771973,0.9916033744812012,'00:00']\n",
1293 | "(#5) [176,0.5415282845497131,0.5380637645721436,0.9908036589622498,'00:00']\n",
1294 | "(#5) [177,0.5407301187515259,0.5386428236961365,0.9904038310050964,'00:00']\n",
1295 | "(#5) [178,0.5399132370948792,0.5335087776184082,0.9922031164169312,'00:00']\n",
1296 | "(#5) [179,0.5391473770141602,0.5411477088928223,0.9888044595718384,'00:00']\n",
1297 | "(#5) [180,0.5384039878845215,0.539435088634491,0.9904038310050964,'00:00']\n",
1298 | "(#5) [181,0.5376245379447937,0.5337391495704651,0.9900040030479431,'00:00']\n",
1299 | "(#5) [182,0.5371623635292053,0.536837637424469,0.9932027459144592,'00:00']\n",
1300 | "(#5) [183,0.5371792316436768,0.5358443260192871,0.9896041750907898,'00:00']\n",
1301 | "(#5) [184,0.5367618203163147,0.5355667471885681,0.9902039170265198,'00:00']\n",
1302 | "(#5) [185,0.5386577844619751,0.5484377145767212,0.9908036589622498,'00:00']\n",
1303 | "(#5) [186,0.540336549282074,0.540101945400238,0.9900040030479431,'00:00']\n",
1304 | "(#5) [187,0.5407863259315491,0.543674111366272,0.9916033744812012,'00:00']\n",
1305 | "(#5) [188,0.5414509177207947,0.5415787696838379,0.9904038310050964,'00:00']\n",
1306 | "(#5) [189,0.5406838059425354,0.5361565351486206,0.9904038310050964,'00:00']\n",
1307 | "(#5) [190,0.5395206809043884,0.5332191586494446,0.9908036589622498,'00:00']\n",
1308 | "(#5) [191,0.5392788052558899,0.537745475769043,0.9912035465240479,'00:00']\n",
1309 | "(#5) [192,0.5394918918609619,0.5361258387565613,0.9920032024383545,'00:00']\n",
1310 | "(#5) [193,0.5393324494361877,0.5358547568321228,0.9920032024383545,'00:00']\n",
1311 | "(#5) [194,0.5389197468757629,0.5389012098312378,0.9928028583526611,'00:00']\n",
1312 | "(#5) [195,0.538921594619751,0.5367191433906555,0.9908036589622498,'00:00']\n",
1313 | "(#5) [196,0.53797847032547,0.5348914861679077,0.9924030303955078,'00:00']\n",
1314 | "(#5) [197,0.5371230840682983,0.5359246134757996,0.9916033744812012,'00:00']\n",
1315 | "(#5) [198,0.5358856916427612,0.5365298986434937,0.9904038310050964,'00:00']\n",
1316 | "(#5) [199,0.5351035594940186,0.5316326022148132,0.9920032024383545,'00:00']\n",
1317 | "(#5) [200,0.5343203544616699,0.5353274941444397,0.9924030303955078,'00:00']\n",
1318 | "(#5) [201,0.5334475040435791,0.5297375321388245,0.9920032024383545,'00:00']\n",
1319 | "(#5) [202,0.5327377915382385,0.5286293029785156,0.9924030303955078,'00:00']\n",
1320 | "(#5) [203,0.5319967269897461,0.5296909809112549,0.9936025738716125,'00:00']\n",
1321 | "(#5) [204,0.5315675735473633,0.5341347455978394,0.9910035729408264,'00:00']\n",
1322 | "(#5) [205,0.5316758751869202,0.5468865633010864,0.9912035465240479,'00:00']\n",
1323 | "(#5) [206,0.5343092679977417,0.5448389649391174,0.9908036589622498,'00:00']\n",
1324 | "(#5) [207,0.5345548987388611,0.5347534418106079,0.9912035465240479,'00:00']\n",
1325 | "(#5) [208,0.5337480306625366,0.531776487827301,0.9920032024383545,'00:00']\n",
1326 | "(#5) [209,0.5328558087348938,0.5307406187057495,0.9930027723312378,'00:00']\n",
1327 | "(#5) [210,0.5322050452232361,0.5365418195724487,0.9926029443740845,'00:00']\n",
1328 | "(#5) [211,0.5317865014076233,0.5309271812438965,0.9916033744812012,'00:00']\n",
1329 | "(#5) [212,0.5310025215148926,0.5306375026702881,0.9922031164169312,'00:00']\n",
1330 | "(#5) [213,0.5308721661567688,0.5299833416938782,0.9930027723312378,'00:00']\n",
1331 | "(#5) [214,0.5306683778762817,0.5334042310714722,0.9906037449836731,'00:00']\n",
1332 | "(#5) [215,0.530573308467865,0.5335736274719238,0.9918032884597778,'00:00']\n",
1333 | "(#5) [216,0.5301867723464966,0.5292391180992126,0.9922031164169312,'00:00']\n",
1334 | "(#5) [217,0.5295171737670898,0.524917721748352,0.9938024878501892,'00:00']\n",
1335 | "(#5) [218,0.5291056036949158,0.5281755924224854,0.9928028583526611,'00:00']\n",
1336 | "(#5) [219,0.5289586186408997,0.5292388796806335,0.9920032024383545,'00:00']\n",
1337 | "(#5) [220,0.5287994146347046,0.5307968854904175,0.9912035465240479,'00:00']\n",
1338 | "(#5) [221,0.5293843746185303,0.5331360101699829,0.9916033744812012,'00:00']\n",
1339 | "(#5) [222,0.5298016667366028,0.5340238809585571,0.9924030303955078,'00:00']\n",
1340 | "(#5) [223,0.5299842953681946,0.5329611897468567,0.9908036589622498,'00:00']\n",
1341 | "(#5) [224,0.5300183892250061,0.5327491164207458,0.9904038310050964,'00:00']\n",
1342 | "(#5) [225,0.5302886962890625,0.529076874256134,0.9920032024383545,'00:00']\n",
1343 | "(#5) [226,0.5300524830818176,0.5325285792350769,0.9912035465240479,'00:00']\n",
1344 | "(#5) [227,0.5291770100593567,0.5321189165115356,0.9912035465240479,'00:00']\n",
1345 | "(#5) [228,0.5285636782646179,0.5309420228004456,0.9922031164169312,'00:00']\n",
1346 | "(#5) [229,0.5284871459007263,0.5328423380851746,0.9922031164169312,'00:00']\n",
1347 | "(#5) [230,0.5282176733016968,0.5324925780296326,0.9924030303955078,'00:00']\n",
1348 | "(#5) [231,0.5278685688972473,0.5312387943267822,0.9908036589622498,'00:00']\n",
1349 | "(#5) [232,0.5272446274757385,0.5291371941566467,0.9930027723312378,'00:00']\n",
1350 | "(#5) [233,0.5268353223800659,0.5247685313224792,0.9940024018287659,'00:00']\n",
1351 | "(#5) [234,0.5269707441329956,0.5329433679580688,0.9928028583526611,'00:00']\n",
1352 | "(#5) [235,0.5274010896682739,0.5324746370315552,0.9918032884597778,'00:00']\n",
1353 | "(#5) [236,0.5274480581283569,0.5297783017158508,0.9918032884597778,'00:00']\n",
1354 | "(#5) [237,0.5272480845451355,0.5326783061027527,0.9908036589622498,'00:00']\n",
1355 | "(#5) [238,0.5272433161735535,0.5307130813598633,0.9930027723312378,'00:00']\n",
1356 | "(#5) [239,0.5268052220344543,0.5317208766937256,0.9910035729408264,'00:00']\n",
1357 | "(#5) [240,0.526492714881897,0.5283480286598206,0.9930027723312378,'00:00']\n",
1358 | "(#5) [241,0.5260053873062134,0.5311684012413025,0.9916033744812012,'00:00']\n",
1359 | "(#5) [242,0.5255916714668274,0.527891993522644,0.9936025738716125,'00:00']\n",
1360 | "(#5) [243,0.5253407955169678,0.5345184803009033,0.9912035465240479,'00:00']\n",
1361 | "(#5) [244,0.5252403020858765,0.5300960540771484,0.9924030303955078,'00:00']\n",
1362 | "(#5) [245,0.524783730506897,0.527423620223999,0.9936025738716125,'00:00']\n",
1363 | "(#5) [246,0.5245959758758545,0.527352511882782,0.9934026598930359,'00:00']\n",
1364 | "(#5) [247,0.5247647166252136,0.5282964706420898,0.9924030303955078,'00:00']\n",
1365 | "(#5) [248,0.524625837802887,0.5270624160766602,0.9932027459144592,'00:00']\n",
1366 | "(#5) [249,0.5243129730224609,0.5282413363456726,0.9934026598930359,'00:00']\n",
1367 | "(#5) [250,0.5239346623420715,0.5286538004875183,0.9930027723312378,'00:00']\n",
1368 | "(#5) [251,0.5235201716423035,0.5297479629516602,0.9926029443740845,'00:00']\n",
1369 | "(#5) [252,0.5233739614486694,0.5274367332458496,0.9934026598930359,'00:00']\n",
1370 | "(#5) [253,0.5232270956039429,0.5293559432029724,0.9930027723312378,'00:00']\n",
1371 | "(#5) [254,0.5229390859603882,0.5293557643890381,0.9944022297859192,'00:00']\n",
1372 | "(#5) [255,0.5226703882217407,0.5304177403450012,0.9914034605026245,'00:00']\n",
1373 | "(#5) [256,0.5225520730018616,0.527757465839386,0.9930027723312378,'00:00']\n",
1374 | "(#5) [257,0.5223419666290283,0.5275525450706482,0.9930027723312378,'00:00']\n",
1375 | "(#5) [258,0.5221992135047913,0.5264022350311279,0.9932027459144592,'00:00']\n",
1376 | "(#5) [259,0.5219066143035889,0.5255751013755798,0.9934026598930359,'00:00']\n",
1377 | "(#5) [260,0.5216912627220154,0.5275321006774902,0.9922031164169312,'00:00']\n",
1378 | "(#5) [261,0.5221092104911804,0.5300160050392151,0.9922031164169312,'00:00']\n",
1379 | "(#5) [262,0.5227319002151489,0.5303525328636169,0.9912035465240479,'00:00']\n",
1380 | "(#5) [263,0.5226017236709595,0.5283069610595703,0.9928028583526611,'00:00']\n",
1381 | "(#5) [264,0.5227190256118774,0.5294409990310669,0.9926029443740845,'00:00']\n",
1382 | "(#5) [265,0.5224606394767761,0.5258386135101318,0.9930027723312378,'00:00']\n",
1383 | "(#5) [266,0.5222586393356323,0.5303590893745422,0.9926029443740845,'00:00']\n",
1384 | "(#5) [267,0.521849513053894,0.5306782722473145,0.9926029443740845,'00:00']\n",
1385 | "(#5) [268,0.521772563457489,0.5279519557952881,0.9930027723312378,'00:00']\n",
1386 | "(#5) [269,0.5214856266975403,0.5284996628761292,0.9938024878501892,'00:00']\n",
1387 | "(#5) [270,0.5209625363349915,0.5269749760627747,0.9936025738716125,'00:00']\n",
1388 | "(#5) [271,0.5208937525749207,0.5247790813446045,0.9936025738716125,'00:00']\n",
1389 | "(#5) [272,0.5205020904541016,0.5274707674980164,0.9936025738716125,'00:00']\n",
1390 | "(#5) [273,0.52024906873703,0.5252721905708313,0.9936025738716125,'00:00']\n",
1391 | "(#5) [274,0.5198321342468262,0.5264414548873901,0.9934026598930359,'00:00']\n",
1392 | "(#5) [275,0.519546389579773,0.5258185863494873,0.9936025738716125,'00:00']\n",
1393 | "(#5) [276,0.5197317004203796,0.52490234375,0.9930027723312378,'00:00']\n",
1394 | "(#5) [277,0.5193116068840027,0.5259972214698792,0.9940024018287659,'00:00']\n",
1395 | "(#5) [278,0.5190655589103699,0.5299040675163269,0.9934026598930359,'00:00']\n",
1396 | "(#5) [279,0.5186665654182434,0.5282294154167175,0.9934026598930359,'00:00']\n",
1397 | "(#5) [280,0.5180574655532837,0.5270416140556335,0.9928028583526611,'00:00']\n",
1398 | "(#5) [281,0.5180503129959106,0.5255627036094666,0.9938024878501892,'00:00']\n",
1399 | "(#5) [282,0.5177482962608337,0.5264762043952942,0.9938024878501892,'00:00']\n",
1400 | "(#5) [283,0.5173510313034058,0.5257301926612854,0.9932027459144592,'00:00']\n",
1401 | "(#5) [284,0.517229437828064,0.5265830159187317,0.9934026598930359,'00:00']\n",
1402 | "(#5) [285,0.5171796083450317,0.524927020072937,0.9944022297859192,'00:00']\n",
1403 | "(#5) [286,0.5167602896690369,0.5259541273117065,0.9934026598930359,'00:00']\n",
1404 | "(#5) [287,0.5163432359695435,0.5262866616249084,0.9932027459144592,'00:00']\n",
1405 | "(#5) [288,0.5162656903266907,0.5262730717658997,0.9930027723312378,'00:00']\n",
1406 | "(#5) [289,0.5163859724998474,0.5261811017990112,0.9934026598930359,'00:00']\n",
1407 | "(#5) [290,0.5167157649993896,0.5309205651283264,0.9924030303955078,'00:00']\n",
1408 | "(#5) [291,0.5168908834457397,0.5261966586112976,0.9932027459144592,'00:00']\n",
1409 | "(#5) [292,0.5166318416595459,0.528278648853302,0.9928028583526611,'00:00']\n",
1410 | "(#5) [293,0.5165367722511292,0.5267728567123413,0.9922031164169312,'00:00']\n",
1411 | "(#5) [294,0.5163583159446716,0.5271599292755127,0.9930027723312378,'00:00']\n",
1412 | "(#5) [295,0.5161346197128296,0.5283721685409546,0.9926029443740845,'00:00']\n",
1413 | "(#5) [296,0.5159791707992554,0.5291717052459717,0.9916033744812012,'00:00']\n",
1414 | "(#5) [297,0.5160075426101685,0.5295758247375488,0.9922031164169312,'00:00']\n",
1415 | "(#5) [298,0.5159670114517212,0.5270628333091736,0.9936025738716125,'00:00']\n",
1416 | "(#5) [299,0.5155978202819824,0.5267398357391357,0.9926029443740845,'00:00']\n",
1417 | "(#5) [300,0.5155945420265198,0.5278663635253906,0.9920032024383545,'00:00']\n",
1418 | "(#5) [301,0.5154345035552979,0.5262714624404907,0.9928028583526611,'00:00']\n",
1419 | "(#5) [302,0.5153883099555969,0.5262600779533386,0.9936025738716125,'00:00']\n",
1420 | "(#5) [303,0.5151153206825256,0.5245475769042969,0.9928028583526611,'00:00']\n",
1421 | "(#5) [304,0.514721155166626,0.524198055267334,0.9928028583526611,'00:00']\n",
1422 | "(#5) [305,0.5144121646881104,0.5235378742218018,0.9944022297859192,'00:00']\n",
1423 | "(#5) [306,0.5139491558074951,0.5248339176177979,0.9940024018287659,'00:00']\n",
1424 | "(#5) [307,0.5136052966117859,0.5246012806892395,0.9926029443740845,'00:00']\n",
1425 | "(#5) [308,0.5135369896888733,0.5243590474128723,0.9936025738716125,'00:00']\n",
1426 | "(#5) [309,0.5132105946540833,0.5241089463233948,0.9938024878501892,'00:00']\n",
1427 | "(#5) [310,0.5128307938575745,0.5249074101448059,0.9938024878501892,'00:00']\n",
1428 | "(#5) [311,0.5128471851348877,0.5252271294593811,0.9936025738716125,'00:00']\n",
1429 | "(#5) [312,0.5128665566444397,0.5267950892448425,0.9936025738716125,'00:00']\n",
1430 | "(#5) [313,0.5129103064537048,0.5257311463356018,0.9930027723312378,'00:00']\n",
1431 | "(#5) [314,0.5129151344299316,0.5250723958015442,0.9940024018287659,'00:00']\n",
1432 | "(#5) [315,0.5126934051513672,0.5251940488815308,0.9936025738716125,'00:00']\n",
1433 | "(#5) [316,0.5126887559890747,0.5254873037338257,0.9928028583526611,'00:00']\n",
1434 | "(#5) [317,0.5127467513084412,0.5262694954872131,0.9934026598930359,'00:00']\n",
1435 | "(#5) [318,0.5127425789833069,0.5251608490943909,0.9932027459144592,'00:00']\n",
1436 | "(#5) [319,0.5124712586402893,0.5243393182754517,0.9938024878501892,'00:00']\n",
1437 | "(#5) [320,0.5122718811035156,0.5250230431556702,0.9934026598930359,'00:00']\n",
1438 | "(#5) [321,0.5119929909706116,0.5240145921707153,0.9938024878501892,'00:00']\n",
1439 | "(#5) [322,0.5118818283081055,0.5228912234306335,0.9946021437644958,'00:00']\n",
1440 | "(#5) [323,0.5116565823554993,0.5243515372276306,0.9936025738716125,'00:00']\n",
1441 | "(#5) [324,0.5116114616394043,0.5262109041213989,0.9930027723312378,'00:00']\n",
1442 | "(#5) [325,0.5115693807601929,0.526508629322052,0.9930027723312378,'00:00']\n",
1443 | "(#5) [326,0.5116836428642273,0.5242931842803955,0.9936025738716125,'00:00']\n",
1444 | "(#5) [327,0.5115422606468201,0.5248793959617615,0.9932027459144592,'00:00']\n",
1445 | "(#5) [328,0.511383056640625,0.525867760181427,0.9932027459144592,'00:00']\n",
1446 | "(#5) [329,0.5111684799194336,0.5265765190124512,0.9928028583526611,'00:00']\n",
1447 | "(#5) [330,0.5109468698501587,0.5249160528182983,0.9934026598930359,'00:00']\n",
1448 | "(#5) [331,0.5110107064247131,0.5236458778381348,0.9936025738716125,'00:00']\n",
1449 | "(#5) [332,0.5110443234443665,0.523188591003418,0.9938024878501892,'00:00']\n",
1450 | "(#5) [333,0.510869026184082,0.524666428565979,0.9938024878501892,'00:00']\n",
1451 | "(#5) [334,0.5107426643371582,0.5257650017738342,0.9934026598930359,'00:00']\n",
1452 | "(#5) [335,0.5106871128082275,0.5247673392295837,0.9938024878501892,'00:00']\n",
1453 | "(#5) [336,0.5103838443756104,0.5236378908157349,0.9938024878501892,'00:00']\n",
1454 | "(#5) [337,0.5102378726005554,0.5241193771362305,0.9940024018287659,'00:00']\n",
1455 | "(#5) [338,0.5102707147598267,0.5252342224121094,0.9940024018287659,'00:00']\n",
1456 | "(#5) [339,0.5100149512290955,0.5235048532485962,0.9936025738716125,'00:00']\n",
1457 | "(#5) [340,0.5099682211875916,0.5231490135192871,0.9938024878501892,'00:00']\n",
1458 | "(#5) [341,0.510116696357727,0.52529376745224,0.9936025738716125,'00:00']\n",
1459 | "(#5) [342,0.5102107524871826,0.5236325263977051,0.9934026598930359,'00:00']\n",
1460 | "(#5) [343,0.5101140737533569,0.5237225890159607,0.9934026598930359,'00:00']\n",
1461 | "(#5) [344,0.5098199844360352,0.523674488067627,0.9938024878501892,'00:00']\n",
1462 | "(#5) [345,0.5097367167472839,0.5240693092346191,0.9936025738716125,'00:00']\n",
1463 | "(#5) [346,0.5095605850219727,0.5247449278831482,0.9936025738716125,'00:00']\n",
1464 | "(#5) [347,0.5096175074577332,0.5244668126106262,0.9938024878501892,'00:00']\n",
1465 | "(#5) [348,0.5095990300178528,0.5240023136138916,0.9938024878501892,'00:00']\n",
1466 | "(#5) [349,0.5094757676124573,0.5230056643486023,0.9938024878501892,'00:00']\n",
1467 | "(#5) [350,0.5095022916793823,0.523391604423523,0.9936025738716125,'00:00']\n",
1468 | "(#5) [351,0.5094606280326843,0.5237401723861694,0.9936025738716125,'00:00']\n",
1469 | "(#5) [352,0.5093594789505005,0.5237089395523071,0.9938024878501892,'00:00']\n",
1470 | "(#5) [353,0.5094043016433716,0.5240695476531982,0.9932027459144592,'00:00']\n",
1471 | "(#5) [354,0.5092387199401855,0.5240017175674438,0.9934026598930359,'00:00']\n",
1472 | "(#5) [355,0.5092251896858215,0.5235189199447632,0.9934026598930359,'00:00']\n",
1473 | "(#5) [356,0.5092337727546692,0.5239027142524719,0.9936025738716125,'00:00']\n",
1474 | "(#5) [357,0.5092180371284485,0.5237512588500977,0.9936025738716125,'00:00']\n",
1475 | "(#5) [358,0.5091328620910645,0.5239577889442444,0.9936025738716125,'00:00']\n",
1476 | "(#5) [359,0.5092942714691162,0.5242449641227722,0.9934026598930359,'00:00']\n",
1477 | "(#5) [360,0.5093680024147034,0.5239078402519226,0.9932027459144592,'00:00']\n",
1478 | "(#5) [361,0.5092443823814392,0.5237924456596375,0.9936025738716125,'00:00']\n",
1479 | "(#5) [362,0.5093152523040771,0.5234453082084656,0.9936025738716125,'00:00']\n",
1480 | "(#5) [363,0.5091857314109802,0.5238706469535828,0.9934026598930359,'00:00']\n",
1481 | "(#5) [364,0.508921205997467,0.5237467885017395,0.9932027459144592,'00:00']\n",
1482 | "(#5) [365,0.5090736150741577,0.5238143801689148,0.9932027459144592,'00:00']\n",
1483 | "(#5) [366,0.5090389847755432,0.523424506187439,0.9936025738716125,'00:00']\n",
1484 | "(#5) [367,0.508752703666687,0.523482084274292,0.9936025738716125,'00:00']\n",
1485 | "(#5) [368,0.508599579334259,0.5234363079071045,0.9936025738716125,'00:00']\n",
1486 | "(#5) [369,0.5086329579353333,0.5232797861099243,0.9936025738716125,'00:00']\n",
1487 | "(#5) [370,0.5085641741752625,0.5232124924659729,0.9936025738716125,'00:00']\n",
1488 | "(#5) [371,0.5085307955741882,0.5229364633560181,0.9936025738716125,'00:00']\n",
1489 | "(#5) [372,0.5084658265113831,0.5227537155151367,0.9936025738716125,'00:00']\n",
1490 | "(#5) [373,0.5084697604179382,0.5230106115341187,0.9936025738716125,'00:00']\n",
1491 | "(#5) [374,0.5083491802215576,0.5228976011276245,0.9938024878501892,'00:00']\n",
1492 | "(#5) [375,0.508352518081665,0.5228821635246277,0.9936025738716125,'00:00']\n",
1493 | "(#5) [376,0.5083907842636108,0.5228365063667297,0.9934026598930359,'00:00']\n",
1494 | "(#5) [377,0.5081908106803894,0.5227349400520325,0.9936025738716125,'00:00']\n",
1495 | "(#5) [378,0.5081226229667664,0.5227527618408203,0.9934026598930359,'00:00']\n",
1496 | "(#5) [379,0.5079931616783142,0.522771954536438,0.9936025738716125,'00:00']\n",
1497 | "(#5) [380,0.5078628659248352,0.5227649807929993,0.9938024878501892,'00:00']\n",
1498 | "(#5) [381,0.5080171823501587,0.5229080319404602,0.9936025738716125,'00:00']\n",
1499 | "(#5) [382,0.5080382823944092,0.5228443145751953,0.9938024878501892,'00:00']\n",
1500 | "(#5) [383,0.5080419778823853,0.5227728486061096,0.9938024878501892,'00:00']\n",
1501 | "(#5) [384,0.5079154372215271,0.5228997468948364,0.9938024878501892,'00:00']\n",
1502 | "(#5) [385,0.5081967711448669,0.5229795575141907,0.9938024878501892,'00:00']\n",
1503 | "(#5) [386,0.5082715153694153,0.5231399536132812,0.9938024878501892,'00:00']\n",
1504 | "(#5) [387,0.5080891847610474,0.5231689214706421,0.9938024878501892,'00:00']\n",
1505 | "(#5) [388,0.5081734657287598,0.5230467319488525,0.9938024878501892,'00:00']\n",
1506 | "(#5) [389,0.5081997513771057,0.5230736136436462,0.9938024878501892,'00:00']\n",
1507 | "(#5) [390,0.5082019567489624,0.5230721831321716,0.9940024018287659,'00:00']\n",
1508 | "(#5) [391,0.5082195997238159,0.5231530666351318,0.9938024878501892,'00:00']\n",
1509 | "(#5) [392,0.5083235502243042,0.5231331586837769,0.9940024018287659,'00:00']\n",
1510 | "(#5) [393,0.5083001255989075,0.5231126546859741,0.9938024878501892,'00:00']\n",
1511 | "(#5) [394,0.5082123279571533,0.5230859518051147,0.9938024878501892,'00:00']\n",
1512 | "(#5) [395,0.5082860589027405,0.5230616927146912,0.9938024878501892,'00:00']\n",
1513 | "(#5) [396,0.5081390142440796,0.5230945944786072,0.9940024018287659,'00:00']\n",
1514 | "(#5) [397,0.5081673860549927,0.5230311751365662,0.9938024878501892,'00:00']\n",
1515 | "(#5) [398,0.5081211924552917,0.523110568523407,0.9938024878501892,'00:00']\n",
1516 | "(#5) [399,0.5081083178520203,0.5230675935745239,0.9938024878501892,'00:00']\n",
1517 | "Highest accuracy of: 0.9946021437644958 at epoch 323\n"
1518 | ],
1519 | "name": "stdout"
1520 | }
1521 | ]
1522 | },
1523 | {
1524 | "cell_type": "markdown",
1525 | "metadata": {
1526 | "id": "B5eLzv2EWj_n",
1527 | "colab_type": "text"
1528 | },
1529 | "source": [
1530 | "## Run 3"
1531 | ]
1532 | },
1533 | {
1534 | "cell_type": "code",
1535 | "metadata": {
1536 | "id": "iede7ECXb8NT",
1537 | "colab_type": "code",
1538 | "colab": {
1539 | "base_uri": "https://localhost:8080/",
1540 | "height": 1000
1541 | },
1542 | "outputId": "ca7e9496-2a46-48a2-e691-832f2919a8bf"
1543 | },
1544 | "source": [
1545 | "learn = tabular_learner(dls, layers=[100,50,50],\n",
1546 | " ps=[0.01,0.01,0.02], metrics=accuracy,\n",
1547 | " loss_func=myLabelSmoothingCrossEntropyFlat(), n_out=10,\n",
1548 | " cbs=TrackHighestEpoch)\n",
1549 | "with learn.no_bar():\n",
1550 | " learn.fit_one_cycle(400, 1e-1)"
1551 | ],
1552 | "execution_count": 110,
1553 | "outputs": [
1554 | {
1555 | "output_type": "stream",
1556 | "text": [
1557 | "(#5) [0,2.0293729305267334,2.0614888668060303,0.42463013529777527,'00:00']\n",
1558 | "(#5) [1,1.6987190246582031,1.3678958415985107,0.4296281635761261,'00:00']\n",
1559 | "(#5) [2,1.5585050582885742,1.3144861459732056,0.5019991993904114,'00:00']\n",
1560 | "(#5) [3,1.4771995544433594,1.3003623485565186,0.514394223690033,'00:00']\n",
1561 | "(#5) [4,1.4260493516921997,1.2955440282821655,0.5125949382781982,'00:00']\n",
1562 | "(#5) [5,1.3896437883377075,1.2868778705596924,0.5139943957328796,'00:00']\n",
1563 | "(#5) [6,1.363073468208313,1.2853848934173584,0.5255897641181946,'00:00']\n",
1564 | "(#5) [7,1.3416186571121216,1.280599594116211,0.531987190246582,'00:00']\n",
1565 | "(#5) [8,1.3240435123443604,1.2781611680984497,0.5329868197441101,'00:00']\n",
1566 | "(#5) [9,1.3087990283966064,1.2757419347763062,0.5391843318939209,'00:00']\n",
1567 | "(#5) [10,1.2953828573226929,1.2710528373718262,0.5387845039367676,'00:00']\n",
1568 | "(#5) [11,1.2829558849334717,1.263350009918213,0.5507797002792358,'00:00']\n",
1569 | "(#5) [12,1.2711344957351685,1.248146414756775,0.5709716081619263,'00:00']\n",
1570 | "(#5) [13,1.2579454183578491,1.2261199951171875,0.5885645747184753,'00:00']\n",
1571 | "(#5) [14,1.2434748411178589,1.2128901481628418,0.5995602011680603,'00:00']\n",
1572 | "(#5) [15,1.227673888206482,1.1926087141036987,0.6129547953605652,'00:00']\n",
1573 | "(#5) [16,1.2095675468444824,1.196568250656128,0.620751678943634,'00:00']\n",
1574 | "(#5) [17,1.1905622482299805,1.1793168783187866,0.6291483640670776,'00:00']\n",
1575 | "(#5) [18,1.1711511611938477,1.1607747077941895,0.6583366394042969,'00:00']\n",
1576 | "(#5) [19,1.15105402469635,1.1518604755401611,0.6647341251373291,'00:00']\n",
1577 | "(#5) [20,1.1297993659973145,1.1014149188995361,0.6961215734481812,'00:00']\n",
1578 | "(#5) [21,1.10642671585083,1.1079325675964355,0.70391845703125,'00:00']\n",
1579 | "(#5) [22,1.0832972526550293,1.1164686679840088,0.7025189995765686,'00:00']\n",
1580 | "(#5) [23,1.0610774755477905,1.07585608959198,0.7141143679618835,'00:00']\n",
1581 | "(#5) [24,1.0396634340286255,1.1111730337142944,0.6945222020149231,'00:00']\n",
1582 | "(#5) [25,1.0190600156784058,1.050371527671814,0.7383046746253967,'00:00']\n",
1583 | "(#5) [26,0.9993913769721985,1.0096499919891357,0.7554978132247925,'00:00']\n",
1584 | "(#5) [27,0.9799573421478271,1.0153080224990845,0.7453019022941589,'00:00']\n",
1585 | "(#5) [28,0.9600304961204529,0.9603157043457031,0.7826869487762451,'00:00']\n",
1586 | "(#5) [29,0.9402801394462585,0.9715015292167664,0.777289092540741,'00:00']\n",
1587 | "(#5) [30,0.9224637746810913,0.9605710506439209,0.7850859761238098,'00:00']\n",
1588 | "(#5) [31,0.9060249924659729,0.9490686058998108,0.7928828597068787,'00:00']\n",
1589 | "(#5) [32,0.8891942501068115,0.9068381190299988,0.809876024723053,'00:00']\n",
1590 | "(#5) [33,0.8728064298629761,0.9097915291786194,0.8192722797393799,'00:00']\n",
1591 | "(#5) [34,0.8572878837585449,0.8992374539375305,0.8206717371940613,'00:00']\n",
1592 | "(#5) [35,0.8418242931365967,0.8708944320678711,0.8354657888412476,'00:00']\n",
1593 | "(#5) [36,0.827081024646759,0.9142832159996033,0.8136745095252991,'00:00']\n",
1594 | "(#5) [37,0.8127288818359375,0.829062819480896,0.8600559830665588,'00:00']\n",
1595 | "(#5) [38,0.7985082864761353,0.8247146606445312,0.8556577563285828,'00:00']\n",
1596 | "(#5) [39,0.7859086394309998,0.8149366974830627,0.866053581237793,'00:00']\n",
1597 | "(#5) [40,0.7744123935699463,0.7973683476448059,0.8696521520614624,'00:00']\n",
1598 | "(#5) [41,0.7634449005126953,0.7760258913040161,0.882047176361084,'00:00']\n",
1599 | "(#5) [42,0.7515241503715515,0.7710000872612,0.8898440599441528,'00:00']\n",
1600 | "(#5) [43,0.7406054139137268,0.7592818140983582,0.8946421146392822,'00:00']\n",
1601 | "(#5) [44,0.7321797013282776,0.7723474502563477,0.8772491216659546,'00:00']\n",
1602 | "(#5) [45,0.7255554795265198,0.7642300724983215,0.8844462037086487,'00:00']\n",
1603 | "(#5) [46,0.7176724076271057,0.7774329781532288,0.8794482350349426,'00:00']\n",
1604 | "(#5) [47,0.7121101021766663,0.7442382574081421,0.9036385416984558,'00:00']\n",
1605 | "(#5) [48,0.7042600512504578,0.7408820390701294,0.8964414000511169,'00:00']\n",
1606 | "(#5) [49,0.6973034739494324,0.7152826189994812,0.9098360538482666,'00:00']\n",
1607 | "(#5) [50,0.6900440454483032,0.7294615507125854,0.8988404870033264,'00:00']\n",
1608 | "(#5) [51,0.6834279894828796,0.7127374410629272,0.9066373705863953,'00:00']\n",
1609 | "(#5) [52,0.6779332756996155,0.7219710946083069,0.9066373705863953,'00:00']\n",
1610 | "(#5) [53,0.6739873290061951,0.7247345447540283,0.9088364839553833,'00:00']\n",
1611 | "(#5) [54,0.6710664629936218,0.7579176425933838,0.8884446024894714,'00:00']\n",
1612 | "(#5) [55,0.669172465801239,0.7432525157928467,0.897441029548645,'00:00']\n",
1613 | "(#5) [56,0.6669477224349976,0.7310008406639099,0.9098360538482666,'00:00']\n",
1614 | "(#5) [57,0.6651394367218018,0.7383612990379333,0.8970412015914917,'00:00']\n",
1615 | "(#5) [58,0.6614023447036743,0.7375746965408325,0.8986405730247498,'00:00']\n",
1616 | "(#5) [59,0.6573171019554138,0.6837430000305176,0.9310275912284851,'00:00']\n",
1617 | "(#5) [60,0.6526678204536438,0.7011649012565613,0.9214314222335815,'00:00']\n",
1618 | "(#5) [61,0.6479463577270508,0.6689791679382324,0.9390243887901306,'00:00']\n",
1619 | "(#5) [62,0.6438406705856323,0.6791353821754456,0.9290283918380737,'00:00']\n",
1620 | "(#5) [63,0.6409642100334167,0.6933336853981018,0.9282287359237671,'00:00']\n",
1621 | "(#5) [64,0.639179527759552,0.6738916039466858,0.9358256459236145,'00:00']\n",
1622 | "(#5) [65,0.6363300085067749,0.6576906442642212,0.9450219869613647,'00:00']\n",
1623 | "(#5) [66,0.6325833201408386,0.6454792618751526,0.9480208158493042,'00:00']\n",
1624 | "(#5) [67,0.628663957118988,0.678716778755188,0.9336265325546265,'00:00']\n",
1625 | "(#5) [68,0.6263977885246277,0.6237483620643616,0.9580168128013611,'00:00']\n",
1626 | "(#5) [69,0.6236716508865356,0.6347540020942688,0.9560176134109497,'00:00']\n",
1627 | "(#5) [70,0.6196887493133545,0.6522923707962036,0.9442223310470581,'00:00']\n",
1628 | "(#5) [71,0.6169704794883728,0.6241353750228882,0.955817699432373,'00:00']\n",
1629 | "(#5) [72,0.6126185059547424,0.5881877541542053,0.970811665058136,'00:00']\n",
1630 | "(#5) [73,0.6073721051216125,0.5792770981788635,0.9742103219032288,'00:00']\n",
1631 | "(#5) [74,0.6028069257736206,0.5751972794532776,0.9774090647697449,'00:00']\n",
1632 | "(#5) [75,0.5990620255470276,0.5944998264312744,0.9690123796463013,'00:00']\n",
1633 | "(#5) [76,0.5971100926399231,0.5938073396682739,0.9678128957748413,'00:00']\n",
1634 | "(#5) [77,0.5971310138702393,0.5936140418052673,0.9682127237319946,'00:00']\n",
1635 | "(#5) [78,0.5959857106208801,0.6190955638885498,0.9624150395393372,'00:00']\n",
1636 | "(#5) [79,0.5938277244567871,0.5821041464805603,0.9776089787483215,'00:00']\n",
1637 | "(#5) [80,0.5916339755058289,0.5726815462112427,0.9774090647697449,'00:00']\n",
1638 | "(#5) [81,0.5887506604194641,0.5658004283905029,0.9830067753791809,'00:00']\n",
1639 | "(#5) [82,0.5864509344100952,0.5733028054237366,0.9772090911865234,'00:00']\n",
1640 | "(#5) [83,0.5848480463027954,0.6004351377487183,0.9706117510795593,'00:00']\n",
1641 | "(#5) [84,0.5847706198692322,0.5682312250137329,0.9806077480316162,'00:00']\n",
1642 | "(#5) [85,0.5834918022155762,0.5666011571884155,0.9812074899673462,'00:00']\n",
1643 | "(#5) [86,0.5806758403778076,0.5586360692977905,0.9826069474220276,'00:00']\n",
1644 | "(#5) [87,0.5792121291160583,0.574543833732605,0.9812074899673462,'00:00']\n",
1645 | "(#5) [88,0.5791826248168945,0.5596486926078796,0.9812074899673462,'00:00']\n",
1646 | "(#5) [89,0.5783922076225281,0.5726499557495117,0.9782087206840515,'00:00']\n",
1647 | "(#5) [90,0.5767524838447571,0.5775555372238159,0.9806077480316162,'00:00']\n",
1648 | "(#5) [91,0.5738511085510254,0.5541389584541321,0.986205518245697,'00:00']\n",
1649 | "(#5) [92,0.5725259184837341,0.5546411275863647,0.9854058623313904,'00:00']\n",
1650 | "(#5) [93,0.5707733631134033,0.5626939535140991,0.9854058623313904,'00:00']\n",
1651 | "(#5) [94,0.5701825618743896,0.5609492659568787,0.9820072054862976,'00:00']\n",
1652 | "(#5) [95,0.5694450736045837,0.5610015988349915,0.9844062328338623,'00:00']\n",
1653 | "(#5) [96,0.5683678388595581,0.5604926943778992,0.9832066893577576,'00:00']\n",
1654 | "(#5) [97,0.5689476728439331,0.5627782344818115,0.9828068614006042,'00:00']\n",
1655 | "(#5) [98,0.5699014663696289,0.5687479972839355,0.9766093492507935,'00:00']\n",
1656 | "(#5) [99,0.5713880062103271,0.6205713748931885,0.9650139808654785,'00:00']\n",
1657 | "(#5) [100,0.5707502961158752,0.5555552244186401,0.984606146812439,'00:00']\n",
1658 | "(#5) [101,0.5702082514762878,0.5551009178161621,0.9828068614006042,'00:00']\n",
1659 | "(#5) [102,0.5693853497505188,0.5558168292045593,0.9874050617218018,'00:00']\n",
1660 | "(#5) [103,0.5687289237976074,0.5437724590301514,0.9892043471336365,'00:00']\n",
1661 | "(#5) [104,0.5653432011604309,0.5420469641685486,0.9906037449836731,'00:00']\n",
1662 | "(#5) [105,0.5630996227264404,0.5449538230895996,0.9888044595718384,'00:00']\n",
1663 | "(#5) [106,0.5624733567237854,0.5430625677108765,0.9882047176361084,'00:00']\n",
1664 | "(#5) [107,0.5626106858253479,0.5790496468544006,0.9750099778175354,'00:00']\n",
1665 | "(#5) [108,0.5624863505363464,0.5997983813285828,0.9716113805770874,'00:00']\n",
1666 | "(#5) [109,0.562101423740387,0.5511804819107056,0.986805260181427,'00:00']\n",
1667 | "(#5) [110,0.5616140365600586,0.5483325123786926,0.9882047176361084,'00:00']\n",
1668 | "(#5) [111,0.5610569715499878,0.545558512210846,0.986805260181427,'00:00']\n",
1669 | "(#5) [112,0.5615199208259583,0.5477606058120728,0.9874050617218018,'00:00']\n",
1670 | "(#5) [113,0.5624269247055054,0.5531288981437683,0.9872051477432251,'00:00']\n",
1671 | "(#5) [114,0.5623468160629272,0.5580272078514099,0.9860056042671204,'00:00']\n",
1672 | "(#5) [115,0.5617954134941101,0.5579862594604492,0.9848060607910156,'00:00']\n",
1673 | "(#5) [116,0.5601282119750977,0.5430387854576111,0.9902039170265198,'00:00']\n",
1674 | "(#5) [117,0.5585423111915588,0.5427149534225464,0.989004373550415,'00:00']\n",
1675 | "(#5) [118,0.5571534633636475,0.5417501926422119,0.9894042611122131,'00:00']\n",
1676 | "(#5) [119,0.5563919544219971,0.5476879477500916,0.9866053462028503,'00:00']\n",
1677 | "(#5) [120,0.5562312602996826,0.5480661988258362,0.9894042611122131,'00:00']\n",
1678 | "(#5) [121,0.5577057003974915,0.5815487504005432,0.9770091772079468,'00:00']\n",
1679 | "(#5) [122,0.5588575005531311,0.553451418876648,0.9864054322242737,'00:00']\n",
1680 | "(#5) [123,0.5586798191070557,0.5610347986221313,0.985605776309967,'00:00']\n",
1681 | "(#5) [124,0.5590838193893433,0.5533037185668945,0.9882047176361084,'00:00']\n",
1682 | "(#5) [125,0.5585794448852539,0.5486536622047424,0.9888044595718384,'00:00']\n",
1683 | "(#5) [126,0.5582724213600159,0.5473837852478027,0.9888044595718384,'00:00']\n",
1684 | "(#5) [127,0.5573394298553467,0.5442860722541809,0.9900040030479431,'00:00']\n",
1685 | "(#5) [128,0.5559693574905396,0.5366613268852234,0.9910035729408264,'00:00']\n",
1686 | "(#5) [129,0.5541499853134155,0.5394537448883057,0.9902039170265198,'00:00']\n",
1687 | "(#5) [130,0.5527504682540894,0.549728274345398,0.9858056902885437,'00:00']\n",
1688 | "(#5) [131,0.5516896843910217,0.55316162109375,0.9836065769195557,'00:00']\n",
1689 | "(#5) [132,0.5512922406196594,0.5450029373168945,0.9900040030479431,'00:00']\n",
1690 | "(#5) [133,0.5505049228668213,0.5378580093383789,0.9920032024383545,'00:00']\n",
1691 | "(#5) [134,0.5511950254440308,0.5645809173583984,0.9874050617218018,'00:00']\n",
1692 | "(#5) [135,0.5511496067047119,0.5460282564163208,0.9886045455932617,'00:00']\n",
1693 | "(#5) [136,0.5504924058914185,0.5362847447395325,0.9918032884597778,'00:00']\n",
1694 | "(#5) [137,0.5496066808700562,0.5442584753036499,0.9898040890693665,'00:00']\n",
1695 | "(#5) [138,0.5507466793060303,0.5589262247085571,0.9874050617218018,'00:00']\n",
1696 | "(#5) [139,0.5537057518959045,0.5652374029159546,0.9864054322242737,'00:00']\n",
1697 | "(#5) [140,0.5537629127502441,0.5391098260879517,0.9920032024383545,'00:00']\n",
1698 | "(#5) [141,0.5528732538223267,0.5386133790016174,0.9906037449836731,'00:00']\n",
1699 | "(#5) [142,0.5509880185127258,0.5318397283554077,0.9930027723312378,'00:00']\n",
1700 | "(#5) [143,0.5505596399307251,0.5366260409355164,0.9906037449836731,'00:00']\n",
1701 | "(#5) [144,0.5496766567230225,0.5404962301254272,0.9906037449836731,'00:00']\n",
1702 | "(#5) [145,0.5487512350082397,0.5446631908416748,0.989004373550415,'00:00']\n",
1703 | "(#5) [146,0.5483594536781311,0.541664719581604,0.9904038310050964,'00:00']\n",
1704 | "(#5) [147,0.5477534532546997,0.5359944701194763,0.9908036589622498,'00:00']\n",
1705 | "(#5) [148,0.5468186140060425,0.5313493013381958,0.9926029443740845,'00:00']\n",
1706 | "(#5) [149,0.5457525253295898,0.533440113067627,0.9934026598930359,'00:00']\n",
1707 | "(#5) [150,0.5451511144638062,0.5369581580162048,0.9918032884597778,'00:00']\n",
1708 | "(#5) [151,0.5444038510322571,0.5355120897293091,0.9922031164169312,'00:00']\n",
1709 | "(#5) [152,0.5462029576301575,0.5968393683433533,0.9830067753791809,'00:00']\n",
1710 | "(#5) [153,0.5476782917976379,0.5449767112731934,0.9910035729408264,'00:00']\n",
1711 | "(#5) [154,0.5478924512863159,0.5406473278999329,0.9910035729408264,'00:00']\n",
1712 | "(#5) [155,0.5473326444625854,0.5408923625946045,0.9892043471336365,'00:00']\n",
1713 | "(#5) [156,0.547015368938446,0.5465584993362427,0.9918032884597778,'00:00']\n",
1714 | "(#5) [157,0.5467331409454346,0.5335783362388611,0.9934026598930359,'00:00']\n",
1715 | "(#5) [158,0.5458985567092896,0.5332105159759521,0.9920032024383545,'00:00']\n",
1716 | "(#5) [159,0.5450376272201538,0.5329470038414001,0.9922031164169312,'00:00']\n",
1717 | "(#5) [160,0.5449099540710449,0.5489603877067566,0.9880048036575317,'00:00']\n",
1718 | "(#5) [161,0.545313835144043,0.5385501384735107,0.9910035729408264,'00:00']\n",
1719 | "(#5) [162,0.5449542999267578,0.5430415272712708,0.9894042611122131,'00:00']\n",
1720 | "(#5) [163,0.5439230799674988,0.5361923575401306,0.9916033744812012,'00:00']\n",
1721 | "(#5) [164,0.543691873550415,0.5344606041908264,0.9914034605026245,'00:00']\n",
1722 | "(#5) [165,0.5434236526489258,0.5356640219688416,0.9906037449836731,'00:00']\n",
1723 | "(#5) [166,0.5422744750976562,0.5311957001686096,0.9926029443740845,'00:00']\n",
1724 | "(#5) [167,0.5414705872535706,0.5397035479545593,0.9904038310050964,'00:00']\n",
1725 | "(#5) [168,0.5408236980438232,0.5362274050712585,0.9910035729408264,'00:00']\n",
1726 | "(#5) [169,0.5398615002632141,0.5463695526123047,0.9910035729408264,'00:00']\n",
1727 | "(#5) [170,0.53958660364151,0.5325379371643066,0.9924030303955078,'00:00']\n",
1728 | "(#5) [171,0.5392106175422668,0.5339803695678711,0.9922031164169312,'00:00']\n",
1729 | "(#5) [172,0.5394755601882935,0.5379841923713684,0.9912035465240479,'00:00']\n",
1730 | "(#5) [173,0.5390117168426514,0.5342628359794617,0.9922031164169312,'00:00']\n",
1731 | "(#5) [174,0.5388332009315491,0.5369259715080261,0.9912035465240479,'00:00']\n",
1732 | "(#5) [175,0.5377786159515381,0.5357035398483276,0.9930027723312378,'00:00']\n",
1733 | "(#5) [176,0.5372411608695984,0.5328651666641235,0.9916033744812012,'00:00']\n",
1734 | "(#5) [177,0.5360430479049683,0.5358276963233948,0.9902039170265198,'00:00']\n",
1735 | "(#5) [178,0.5361058712005615,0.5445337295532227,0.9894042611122131,'00:00']\n",
1736 | "(#5) [179,0.5377619862556458,0.5418775081634521,0.9908036589622498,'00:00']\n",
1737 | "(#5) [180,0.5383524894714355,0.5423731803894043,0.9906037449836731,'00:00']\n",
1738 | "(#5) [181,0.5387566685676575,0.5413951873779297,0.9900040030479431,'00:00']\n",
1739 | "(#5) [182,0.5380509495735168,0.5320597290992737,0.9928028583526611,'00:00']\n",
1740 | "(#5) [183,0.5368372797966003,0.5321051478385925,0.9920032024383545,'00:00']\n",
1741 | "(#5) [184,0.535862386226654,0.5341758131980896,0.9912035465240479,'00:00']\n",
1742 | "(#5) [185,0.5352054238319397,0.5339136719703674,0.9906037449836731,'00:00']\n",
1743 | "(#5) [186,0.5343647599220276,0.5324766039848328,0.9918032884597778,'00:00']\n",
1744 | "(#5) [187,0.5343749523162842,0.5308598875999451,0.9922031164169312,'00:00']\n",
1745 | "(#5) [188,0.533940315246582,0.5344732999801636,0.9922031164169312,'00:00']\n",
1746 | "(#5) [189,0.5336899161338806,0.5355494022369385,0.9912035465240479,'00:00']\n",
1747 | "(#5) [190,0.5337553024291992,0.5325902104377747,0.9920032024383545,'00:00']\n",
1748 | "(#5) [191,0.533592164516449,0.5327901840209961,0.9920032024383545,'00:00']\n",
1749 | "(#5) [192,0.5331459641456604,0.5302454829216003,0.9932027459144592,'00:00']\n",
1750 | "(#5) [193,0.5322906374931335,0.5304670929908752,0.9924030303955078,'00:00']\n",
1751 | "(#5) [194,0.5319868922233582,0.5340350866317749,0.9914034605026245,'00:00']\n",
1752 | "(#5) [195,0.532592236995697,0.5319945812225342,0.9938024878501892,'00:00']\n",
1753 | "(#5) [196,0.5326769351959229,0.5303594470024109,0.9930027723312378,'00:00']\n",
1754 | "(#5) [197,0.532151460647583,0.527151346206665,0.9934026598930359,'00:00']\n",
1755 | "(#5) [198,0.5315413475036621,0.5338375568389893,0.9920032024383545,'00:00']\n",
1756 | "(#5) [199,0.5311356782913208,0.5303662419319153,0.9926029443740845,'00:00']\n",
1757 | "(#5) [200,0.5301967859268188,0.5272606015205383,0.9938024878501892,'00:00']\n",
1758 | "(#5) [201,0.5292907357215881,0.5297924876213074,0.9912035465240479,'00:00']\n",
1759 | "(#5) [202,0.529024600982666,0.5299506187438965,0.9926029443740845,'00:00']\n",
1760 | "(#5) [203,0.5287343859672546,0.5299375653266907,0.9924030303955078,'00:00']\n",
1761 | "(#5) [204,0.5283051133155823,0.5368390679359436,0.9896041750907898,'00:00']\n",
1762 | "(#5) [205,0.5288468599319458,0.5329996347427368,0.9900040030479431,'00:00']\n",
1763 | "(#5) [206,0.5292216539382935,0.5385533571243286,0.9908036589622498,'00:00']\n",
1764 | "(#5) [207,0.5298982262611389,0.5363742709159851,0.9914034605026245,'00:00']\n",
1765 | "(#5) [208,0.529724657535553,0.530693531036377,0.9930027723312378,'00:00']\n",
1766 | "(#5) [209,0.5295588374137878,0.5311755537986755,0.9922031164169312,'00:00']\n",
1767 | "(#5) [210,0.529642641544342,0.5314441323280334,0.9920032024383545,'00:00']\n",
1768 | "(#5) [211,0.5289945006370544,0.5272084474563599,0.9934026598930359,'00:00']\n",
1769 | "(#5) [212,0.5284972190856934,0.5284705758094788,0.9910035729408264,'00:00']\n",
1770 | "(#5) [213,0.5273048281669617,0.527241051197052,0.9930027723312378,'00:00']\n",
1771 | "(#5) [214,0.5274118781089783,0.5394220948219299,0.9916033744812012,'00:00']\n",
1772 | "(#5) [215,0.527419924736023,0.5306907296180725,0.9916033744812012,'00:00']\n",
1773 | "(#5) [216,0.5272518992424011,0.5284817814826965,0.9924030303955078,'00:00']\n",
1774 | "(#5) [217,0.5270996689796448,0.5286542773246765,0.9938024878501892,'00:00']\n",
1775 | "(#5) [218,0.5268861055374146,0.535449743270874,0.9906037449836731,'00:00']\n",
1776 | "(#5) [219,0.526660144329071,0.5336844325065613,0.9910035729408264,'00:00']\n",
1777 | "(#5) [220,0.5275100469589233,0.5291022062301636,0.9934026598930359,'00:00']\n",
1778 | "(#5) [221,0.5279107689857483,0.5334424376487732,0.9920032024383545,'00:00']\n",
1779 | "(#5) [222,0.5274928212165833,0.528995156288147,0.9934026598930359,'00:00']\n",
1780 | "(#5) [223,0.5272024869918823,0.5269895195960999,0.9932027459144592,'00:00']\n",
1781 | "(#5) [224,0.5268068313598633,0.529697060585022,0.9918032884597778,'00:00']\n",
1782 | "(#5) [225,0.526954710483551,0.5314246416091919,0.9930027723312378,'00:00']\n",
1783 | "(#5) [226,0.5263296365737915,0.5295976400375366,0.9920032024383545,'00:00']\n",
1784 | "(#5) [227,0.5262846946716309,0.5275958776473999,0.9922031164169312,'00:00']\n",
1785 | "(#5) [228,0.5263620615005493,0.530559778213501,0.9930027723312378,'00:00']\n",
1786 | "(#5) [229,0.5261244773864746,0.5262530446052551,0.9928028583526611,'00:00']\n",
1787 | "(#5) [230,0.5255694389343262,0.533979594707489,0.9914034605026245,'00:00']\n",
1788 | "(#5) [231,0.5253062844276428,0.5335589647293091,0.9912035465240479,'00:00']\n",
1789 | "(#5) [232,0.524657130241394,0.5286259055137634,0.9934026598930359,'00:00']\n",
1790 | "(#5) [233,0.5243027806282043,0.527667760848999,0.9934026598930359,'00:00']\n",
1791 | "(#5) [234,0.5238720774650574,0.5280137062072754,0.9924030303955078,'00:00']\n",
1792 | "(#5) [235,0.5236458778381348,0.5291562080383301,0.9936025738716125,'00:00']\n",
1793 | "(#5) [236,0.523596465587616,0.5319516062736511,0.9932027459144592,'00:00']\n",
1794 | "(#5) [237,0.5234949588775635,0.5289976596832275,0.9930027723312378,'00:00']\n",
1795 | "(#5) [238,0.5235670208930969,0.5287747383117676,0.9932027459144592,'00:00']\n",
1796 | "(#5) [239,0.5236977934837341,0.5286727547645569,0.9924030303955078,'00:00']\n",
1797 | "(#5) [240,0.5237545371055603,0.528296709060669,0.9932027459144592,'00:00']\n",
1798 | "(#5) [241,0.5241016149520874,0.5377134084701538,0.9916033744812012,'00:00']\n",
1799 | "(#5) [242,0.5240206122398376,0.5264391899108887,0.9938024878501892,'00:00']\n",
1800 | "(#5) [243,0.5234401226043701,0.5317704677581787,0.9930027723312378,'00:00']\n",
1801 | "(#5) [244,0.5226144790649414,0.5282142758369446,0.9928028583526611,'00:00']\n",
1802 | "(#5) [245,0.5220852494239807,0.526871919631958,0.9930027723312378,'00:00']\n",
1803 | "(#5) [246,0.5225103497505188,0.5302862524986267,0.9924030303955078,'00:00']\n",
1804 | "(#5) [247,0.5226790904998779,0.527371883392334,0.9930027723312378,'00:00']\n",
1805 | "(#5) [248,0.5224716663360596,0.526581346988678,0.9942023158073425,'00:00']\n",
1806 | "(#5) [249,0.5221636295318604,0.526177704334259,0.9928028583526611,'00:00']\n",
1807 | "(#5) [250,0.5218122601509094,0.5248898863792419,0.9942023158073425,'00:00']\n",
1808 | "(#5) [251,0.5217852592468262,0.5270642638206482,0.9930027723312378,'00:00']\n",
1809 | "(#5) [252,0.5214852094650269,0.5292826294898987,0.9918032884597778,'00:00']\n",
1810 | "(#5) [253,0.5212065577507019,0.5267166495323181,0.9934026598930359,'00:00']\n",
1811 | "(#5) [254,0.5209375619888306,0.5260090231895447,0.9930027723312378,'00:00']\n",
1812 | "(#5) [255,0.52054762840271,0.5293883681297302,0.9928028583526611,'00:00']\n",
1813 | "(#5) [256,0.5203977227210999,0.5268653035163879,0.9932027459144592,'00:00']\n",
1814 | "(#5) [257,0.5206385850906372,0.5298270583152771,0.9930027723312378,'00:00']\n",
1815 | "(#5) [258,0.5205107927322388,0.5285757780075073,0.9926029443740845,'00:00']\n",
1816 | "(#5) [259,0.5204576253890991,0.5275424718856812,0.9928028583526611,'00:00']\n",
1817 | "(#5) [260,0.5202888250350952,0.5328793525695801,0.9918032884597778,'00:00']\n",
1818 | "(#5) [261,0.5204641222953796,0.5250154733657837,0.9940024018287659,'00:00']\n",
1819 | "(#5) [262,0.520363450050354,0.5281965136528015,0.9930027723312378,'00:00']\n",
1820 | "(#5) [263,0.5201384425163269,0.5265505909919739,0.9936025738716125,'00:00']\n",
1821 | "(#5) [264,0.5196272134780884,0.5254904627799988,0.9930027723312378,'00:00']\n",
1822 | "(#5) [265,0.5190228819847107,0.5273863673210144,0.9926029443740845,'00:00']\n",
1823 | "(#5) [266,0.5187090039253235,0.5231461524963379,0.9944022297859192,'00:00']\n",
1824 | "(#5) [267,0.5185018181800842,0.5279315710067749,0.9940024018287659,'00:00']\n",
1825 | "(#5) [268,0.5184301733970642,0.5265986323356628,0.9942023158073425,'00:00']\n",
1826 | "(#5) [269,0.5183773636817932,0.5279849171638489,0.9930027723312378,'00:00']\n",
1827 | "(#5) [270,0.5181651711463928,0.5247080326080322,0.9930027723312378,'00:00']\n",
1828 | "(#5) [271,0.5179810523986816,0.5276584625244141,0.9922031164169312,'00:00']\n",
1829 | "(#5) [272,0.5179438591003418,0.5274320244789124,0.9920032024383545,'00:00']\n",
1830 | "(#5) [273,0.5180685520172119,0.5270858407020569,0.9916033744812012,'00:00']\n",
1831 | "(#5) [274,0.5177229046821594,0.5304097533226013,0.9922031164169312,'00:00']\n",
1832 | "(#5) [275,0.5174278020858765,0.5287764072418213,0.9926029443740845,'00:00']\n",
1833 | "(#5) [276,0.5173517465591431,0.5258155465126038,0.9930027723312378,'00:00']\n",
1834 | "(#5) [277,0.5169214606285095,0.5258303880691528,0.9932027459144592,'00:00']\n",
1835 | "(#5) [278,0.5165901780128479,0.5251988768577576,0.9936025738716125,'00:00']\n",
1836 | "(#5) [279,0.5171644687652588,0.5307123064994812,0.9922031164169312,'00:00']\n",
1837 | "(#5) [280,0.5173956155776978,0.5298999547958374,0.9920032024383545,'00:00']\n",
1838 | "(#5) [281,0.5175777077674866,0.5288965106010437,0.9930027723312378,'00:00']\n",
1839 | "(#5) [282,0.5175548195838928,0.5292484760284424,0.9930027723312378,'00:00']\n",
1840 | "(#5) [283,0.517184853553772,0.5265353918075562,0.9924030303955078,'00:00']\n",
1841 | "(#5) [284,0.5167863368988037,0.5292109251022339,0.9922031164169312,'00:00']\n",
1842 | "(#5) [285,0.5167406797409058,0.5246927738189697,0.9934026598930359,'00:00']\n",
1843 | "(#5) [286,0.5162572264671326,0.5254926085472107,0.9934026598930359,'00:00']\n",
1844 | "(#5) [287,0.5162468552589417,0.5296564102172852,0.9928028583526611,'00:00']\n",
1845 | "(#5) [288,0.5163547992706299,0.5268962979316711,0.9928028583526611,'00:00']\n",
1846 | "(#5) [289,0.5162858366966248,0.5287567973136902,0.9938024878501892,'00:00']\n",
1847 | "(#5) [290,0.5162416696548462,0.5260918736457825,0.9936025738716125,'00:00']\n",
1848 | "(#5) [291,0.5158631801605225,0.5242154598236084,0.9938024878501892,'00:00']\n",
1849 | "(#5) [292,0.5152209997177124,0.5249069929122925,0.9940024018287659,'00:00']\n",
1850 | "(#5) [293,0.5148078799247742,0.5248844027519226,0.9930027723312378,'00:00']\n",
1851 | "(#5) [294,0.5144733190536499,0.5254446268081665,0.9938024878501892,'00:00']\n",
1852 | "(#5) [295,0.5142903923988342,0.5247061252593994,0.9942023158073425,'00:00']\n",
1853 | "(#5) [296,0.5140748023986816,0.5265892744064331,0.9924030303955078,'00:00']\n",
1854 | "(#5) [297,0.5141046643257141,0.525843620300293,0.9928028583526611,'00:00']\n",
1855 | "(#5) [298,0.5138106942176819,0.5249148011207581,0.9928028583526611,'00:00']\n",
1856 | "(#5) [299,0.5135413408279419,0.5246065258979797,0.9934026598930359,'00:00']\n",
1857 | "(#5) [300,0.5134429931640625,0.5222412347793579,0.9944022297859192,'00:00']\n",
1858 | "(#5) [301,0.5131553411483765,0.5234413146972656,0.9938024878501892,'00:00']\n",
1859 | "(#5) [302,0.5127937197685242,0.522749662399292,0.9944022297859192,'00:00']\n",
1860 | "(#5) [303,0.513033390045166,0.5239572525024414,0.9944022297859192,'00:00']\n",
1861 | "(#5) [304,0.5132825374603271,0.5218459367752075,0.9944022297859192,'00:00']\n",
1862 | "(#5) [305,0.5131625533103943,0.5218533873558044,0.9942023158073425,'00:00']\n",
1863 | "(#5) [306,0.5131841897964478,0.52339768409729,0.9932027459144592,'00:00']\n",
1864 | "(#5) [307,0.5130677223205566,0.5234390497207642,0.9944022297859192,'00:00']\n",
1865 | "(#5) [308,0.5128426551818848,0.5233975052833557,0.9942023158073425,'00:00']\n",
1866 | "(#5) [309,0.5126115083694458,0.5234133005142212,0.9938024878501892,'00:00']\n",
1867 | "(#5) [310,0.5123909711837769,0.5232430696487427,0.9938024878501892,'00:00']\n",
1868 | "(#5) [311,0.5121563673019409,0.5238012075424194,0.9934026598930359,'00:00']\n",
1869 | "(#5) [312,0.5120766162872314,0.521774172782898,0.9940024018287659,'00:00']\n",
1870 | "(#5) [313,0.5119715332984924,0.52287757396698,0.9940024018287659,'00:00']\n",
1871 | "(#5) [314,0.5117764472961426,0.5252045392990112,0.9928028583526611,'00:00']\n",
1872 | "(#5) [315,0.5118545293807983,0.5249967575073242,0.9932027459144592,'00:00']\n",
1873 | "(#5) [316,0.5119632482528687,0.5246098041534424,0.9936025738716125,'00:00']\n",
1874 | "(#5) [317,0.5120376348495483,0.5266666412353516,0.9934026598930359,'00:00']\n",
1875 | "(#5) [318,0.5119698643684387,0.52298504114151,0.9938024878501892,'00:00']\n",
1876 | "(#5) [319,0.5117302536964417,0.5238855481147766,0.9938024878501892,'00:00']\n",
1877 | "(#5) [320,0.5118598341941833,0.5238199830055237,0.9938024878501892,'00:00']\n",
1878 | "(#5) [321,0.5120772123336792,0.5226683616638184,0.9936025738716125,'00:00']\n",
1879 | "(#5) [322,0.5116055607795715,0.5233619213104248,0.9940024018287659,'00:00']\n",
1880 | "(#5) [323,0.5112345218658447,0.5246673822402954,0.9936025738716125,'00:00']\n",
1881 | "(#5) [324,0.5109999775886536,0.5242363214492798,0.9932027459144592,'00:00']\n",
1882 | "(#5) [325,0.510985791683197,0.524116575717926,0.9936025738716125,'00:00']\n",
1883 | "(#5) [326,0.5107462406158447,0.5229503512382507,0.9942023158073425,'00:00']\n",
1884 | "(#5) [327,0.5106740593910217,0.5236828923225403,0.9940024018287659,'00:00']\n",
1885 | "(#5) [328,0.5105391144752502,0.5235517024993896,0.9938024878501892,'00:00']\n",
1886 | "(#5) [329,0.510552704334259,0.5230703353881836,0.9942023158073425,'00:00']\n",
1887 | "(#5) [330,0.5105986595153809,0.5224387049674988,0.9944022297859192,'00:00']\n",
1888 | "(#5) [331,0.510701060295105,0.5218894481658936,0.9940024018287659,'00:00']\n",
1889 | "(#5) [332,0.5105094909667969,0.5222654342651367,0.9942023158073425,'00:00']\n",
1890 | "(#5) [333,0.5102624893188477,0.5234419107437134,0.9944022297859192,'00:00']\n",
1891 | "(#5) [334,0.5100911259651184,0.523962140083313,0.9936025738716125,'00:00']\n",
1892 | "(#5) [335,0.5100873112678528,0.5244113206863403,0.9936025738716125,'00:00']\n",
1893 | "(#5) [336,0.5098394155502319,0.5239353179931641,0.9944022297859192,'00:00']\n",
1894 | "(#5) [337,0.509896993637085,0.5238118767738342,0.9938024878501892,'00:00']\n",
1895 | "(#5) [338,0.5100304484367371,0.5226858258247375,0.9940024018287659,'00:00']\n",
1896 | "(#5) [339,0.509960412979126,0.5218740105628967,0.9942023158073425,'00:00']\n",
1897 | "(#5) [340,0.5098704695701599,0.5226128101348877,0.9938024878501892,'00:00']\n",
1898 | "(#5) [341,0.5098358392715454,0.5231605172157288,0.9938024878501892,'00:00']\n",
1899 | "(#5) [342,0.5095862150192261,0.5223684310913086,0.9942023158073425,'00:00']\n",
1900 | "(#5) [343,0.5095844864845276,0.5231474041938782,0.9938024878501892,'00:00']\n",
1901 | "(#5) [344,0.5094133019447327,0.5244612097740173,0.9940024018287659,'00:00']\n",
1902 | "(#5) [345,0.509349524974823,0.5233712196350098,0.9936025738716125,'00:00']\n",
1903 | "(#5) [346,0.5093934535980225,0.5230147242546082,0.9936025738716125,'00:00']\n",
1904 | "(#5) [347,0.5093787908554077,0.5223046541213989,0.9942023158073425,'00:00']\n",
1905 | "(#5) [348,0.5091740489006042,0.5223799347877502,0.9936025738716125,'00:00']\n",
1906 | "(#5) [349,0.5090999603271484,0.5225371718406677,0.9936025738716125,'00:00']\n",
1907 | "(#5) [350,0.5090742111206055,0.522295355796814,0.9938024878501892,'00:00']\n",
1908 | "(#5) [351,0.5091212391853333,0.5229374170303345,0.9938024878501892,'00:00']\n",
1909 | "(#5) [352,0.5090122222900391,0.5225344896316528,0.9936025738716125,'00:00']\n",
1910 | "(#5) [353,0.5090354681015015,0.5220562815666199,0.9940024018287659,'00:00']\n",
1911 | "(#5) [354,0.5088732838630676,0.5225508809089661,0.9938024878501892,'00:00']\n",
1912 | "(#5) [355,0.5086938738822937,0.5225921273231506,0.9936025738716125,'00:00']\n",
1913 | "(#5) [356,0.5087247490882874,0.5228272676467896,0.9940024018287659,'00:00']\n",
1914 | "(#5) [357,0.5087428689002991,0.5225372910499573,0.9942023158073425,'00:00']\n",
1915 | "(#5) [358,0.5087617039680481,0.5224955081939697,0.9942023158073425,'00:00']\n",
1916 | "(#5) [359,0.5085393786430359,0.5224195718765259,0.9942023158073425,'00:00']\n",
1917 | "(#5) [360,0.5085108876228333,0.5228965878486633,0.9940024018287659,'00:00']\n",
1918 | "(#5) [361,0.5085413455963135,0.523306667804718,0.9938024878501892,'00:00']\n",
1919 | "(#5) [362,0.508520781993866,0.5229383111000061,0.9940024018287659,'00:00']\n",
1920 | "(#5) [363,0.5085293054580688,0.5225691795349121,0.9938024878501892,'00:00']\n",
1921 | "(#5) [364,0.5085575580596924,0.5228148698806763,0.9938024878501892,'00:00']\n",
1922 | "(#5) [365,0.5087820291519165,0.5229143500328064,0.9938024878501892,'00:00']\n",
1923 | "(#5) [366,0.5088400840759277,0.5225988030433655,0.9938024878501892,'00:00']\n",
1924 | "(#5) [367,0.508857011795044,0.5224554538726807,0.9940024018287659,'00:00']\n",
1925 | "(#5) [368,0.5089028477668762,0.5229243040084839,0.9940024018287659,'00:00']\n",
1926 | "(#5) [369,0.508629322052002,0.5230326652526855,0.9942023158073425,'00:00']\n",
1927 | "(#5) [370,0.5085878968238831,0.5228439569473267,0.9942023158073425,'00:00']\n",
1928 | "(#5) [371,0.5084392428398132,0.5227200388908386,0.9942023158073425,'00:00']\n",
1929 | "(#5) [372,0.5083572864532471,0.5225576758384705,0.9944022297859192,'00:00']\n",
1930 | "(#5) [373,0.5083764791488647,0.5228384733200073,0.9942023158073425,'00:00']\n",
1931 | "(#5) [374,0.508211612701416,0.5226112604141235,0.9944022297859192,'00:00']\n",
1932 | "(#5) [375,0.5080885887145996,0.5226343274116516,0.9942023158073425,'00:00']\n",
1933 | "(#5) [376,0.5081456303596497,0.5225542187690735,0.9942023158073425,'00:00']\n",
1934 | "(#5) [377,0.5082231163978577,0.5225827097892761,0.9940024018287659,'00:00']\n",
1935 | "(#5) [378,0.508144736289978,0.5225563049316406,0.9944022297859192,'00:00']\n",
1936 | "(#5) [379,0.5083276629447937,0.5221487283706665,0.9944022297859192,'00:00']\n",
1937 | "(#5) [380,0.5081814527511597,0.5221341848373413,0.9944022297859192,'00:00']\n",
1938 | "(#5) [381,0.5082696080207825,0.5222209692001343,0.9944022297859192,'00:00']\n",
1939 | "(#5) [382,0.5081558227539062,0.5224487781524658,0.9944022297859192,'00:00']\n",
1940 | "(#5) [383,0.5082300901412964,0.5224199891090393,0.9942023158073425,'00:00']\n",
1941 | "(#5) [384,0.5081693530082703,0.5222299695014954,0.9942023158073425,'00:00']\n",
1942 | "(#5) [385,0.508202850818634,0.5222810506820679,0.9942023158073425,'00:00']\n",
1943 | "(#5) [386,0.5080522298812866,0.5222872495651245,0.9942023158073425,'00:00']\n",
1944 | "(#5) [387,0.5079510807991028,0.5221360325813293,0.9942023158073425,'00:00']\n",
1945 | "(#5) [388,0.5082764625549316,0.5221952795982361,0.9942023158073425,'00:00']\n",
1946 | "(#5) [389,0.5083134174346924,0.5222253203392029,0.9942023158073425,'00:00']\n",
1947 | "(#5) [390,0.5081120133399963,0.5222678780555725,0.9942023158073425,'00:00']\n",
1948 | "(#5) [391,0.5081126093864441,0.5223051905632019,0.9942023158073425,'00:00']\n",
1949 | "(#5) [392,0.507978081703186,0.5224204659461975,0.9942023158073425,'00:00']\n",
1950 | "(#5) [393,0.507956326007843,0.5224355459213257,0.9942023158073425,'00:00']\n",
1951 | "(#5) [394,0.5080015659332275,0.5224387049674988,0.9940024018287659,'00:00']\n",
1952 | "(#5) [395,0.507987380027771,0.522358775138855,0.9942023158073425,'00:00']\n",
1953 | "(#5) [396,0.5079963207244873,0.5223493576049805,0.9942023158073425,'00:00']\n",
1954 | "(#5) [397,0.5079240798950195,0.5225111842155457,0.9940024018287659,'00:00']\n",
1955 | "(#5) [398,0.5078703165054321,0.5223772525787354,0.9942023158073425,'00:00']\n",
1956 | "(#5) [399,0.5079249143600464,0.5223718881607056,0.9942023158073425,'00:00']\n",
1957 | "Highest accuracy of: 0.9944022297859192 at epoch 267\n"
1958 | ],
1959 | "name": "stdout"
1960 | }
1961 | ]
1962 | },
1963 | {
1964 | "cell_type": "markdown",
1965 | "metadata": {
1966 | "id": "9tJs8FgbWmoz",
1967 | "colab_type": "text"
1968 | },
1969 | "source": [
1970 | "## Run 4"
1971 | ]
1972 | },
1973 | {
1974 | "cell_type": "code",
1975 | "metadata": {
1976 | "id": "cj-MJKPEb9-o",
1977 | "colab_type": "code",
1978 | "colab": {
1979 | "base_uri": "https://localhost:8080/",
1980 | "height": 1000
1981 | },
1982 | "outputId": "a70fcd50-96ee-4d63-c63e-d2b8fb57c699"
1983 | },
1984 | "source": [
1985 | "learn = tabular_learner(dls, layers=[100,50,50],\n",
1986 | " ps=[0.01,0.01,0.02], metrics=accuracy,\n",
1987 | " loss_func=myLabelSmoothingCrossEntropyFlat(), n_out=10,\n",
1988 | " cbs=TrackHighestEpoch)\n",
1989 | "with learn.no_bar():\n",
1990 | " learn.fit_one_cycle(400, 1e-1)"
1991 | ],
1992 | "execution_count": 111,
1993 | "outputs": [
1994 | {
1995 | "output_type": "stream",
1996 | "text": [
1997 | "(#5) [0,2.0003058910369873,2.0761032104492188,0.42463013529777527,'00:00']\n",
1998 | "(#5) [1,1.67828369140625,1.42345130443573,0.4906037449836731,'00:00']\n",
1999 | "(#5) [2,1.5407624244689941,1.3101568222045898,0.49840062856674194,'00:00']\n",
2000 | "(#5) [3,1.4638121128082275,1.2966821193695068,0.49740102887153625,'00:00']\n",
2001 | "(#5) [4,1.4130326509475708,1.2953085899353027,0.5041983127593994,'00:00']\n",
2002 | "(#5) [5,1.3762407302856445,1.2870265245437622,0.5175929665565491,'00:00']\n",
2003 | "(#5) [6,1.348793625831604,1.273974895477295,0.5483806729316711,'00:00']\n",
2004 | "(#5) [7,1.3258235454559326,1.2650690078735352,0.5631747245788574,'00:00']\n",
2005 | "(#5) [8,1.305737018585205,1.2540934085845947,0.5685725808143616,'00:00']\n",
2006 | "(#5) [9,1.2874256372451782,1.2418713569641113,0.5783686637878418,'00:00']\n",
2007 | "(#5) [10,1.269816279411316,1.2248858213424683,0.588764488697052,'00:00']\n",
2008 | "(#5) [11,1.2515718936920166,1.2058950662612915,0.6143542528152466,'00:00']\n",
2009 | "(#5) [12,1.23350989818573,1.1945611238479614,0.6259496212005615,'00:00']\n",
2010 | "(#5) [13,1.2134891748428345,1.1741676330566406,0.6419432163238525,'00:00']\n",
2011 | "(#5) [14,1.1931734085083008,1.153082013130188,0.6531387567520142,'00:00']\n",
2012 | "(#5) [15,1.1719533205032349,1.1472806930541992,0.6649340391159058,'00:00']\n",
2013 | "(#5) [16,1.1496803760528564,1.12527334690094,0.690723717212677,'00:00']\n",
2014 | "(#5) [17,1.1257740259170532,1.0939685106277466,0.7129148244857788,'00:00']\n",
2015 | "(#5) [18,1.1010150909423828,1.0939463376998901,0.7113154530525208,'00:00']\n",
2016 | "(#5) [19,1.0766586065292358,1.0537782907485962,0.7339064478874207,'00:00']\n",
2017 | "(#5) [20,1.0535318851470947,1.0166994333267212,0.7544981837272644,'00:00']\n",
2018 | "(#5) [21,1.0303922891616821,1.0092788934707642,0.7530987858772278,'00:00']\n",
2019 | "(#5) [22,1.0084642171859741,1.0314825773239136,0.747501015663147,'00:00']\n",
2020 | "(#5) [23,0.9873597621917725,0.9995150566101074,0.7648940682411194,'00:00']\n",
2021 | "(#5) [24,0.9685803651809692,0.9765790700912476,0.781687319278717,'00:00']\n",
2022 | "(#5) [25,0.9509515762329102,0.9722303748130798,0.7818872332572937,'00:00']\n",
2023 | "(#5) [26,0.9341896772384644,0.9456905722618103,0.7890843749046326,'00:00']\n",
2024 | "(#5) [27,0.9182038307189941,0.9492547512054443,0.7892842888832092,'00:00']\n",
2025 | "(#5) [28,0.9040509462356567,0.9475475549697876,0.7860855460166931,'00:00']\n",
2026 | "(#5) [29,0.8905585408210754,0.9653003811836243,0.7786885499954224,'00:00']\n",
2027 | "(#5) [30,0.8774340748786926,0.9469389915466309,0.7898840308189392,'00:00']\n",
2028 | "(#5) [31,0.8658234477043152,0.9579833149909973,0.7830867767333984,'00:00']\n",
2029 | "(#5) [32,0.8569309115409851,0.9508890509605408,0.7890843749046326,'00:00']\n",
2030 | "(#5) [33,0.8486475944519043,0.9480903744697571,0.7892842888832092,'00:00']\n",
2031 | "(#5) [34,0.840252697467804,0.9346659779548645,0.7962815165519714,'00:00']\n",
2032 | "(#5) [35,0.8325198292732239,0.9217291474342346,0.7976809144020081,'00:00']\n",
2033 | "(#5) [36,0.823998749256134,0.9159250259399414,0.8044782280921936,'00:00']\n",
2034 | "(#5) [37,0.8169054388999939,0.9114623665809631,0.820271909236908,'00:00']\n",
2035 | "(#5) [38,0.8101741075515747,0.9240720868110657,0.7952818870544434,'00:00']\n",
2036 | "(#5) [39,0.8033385872840881,0.9483035802841187,0.7992802858352661,'00:00']\n",
2037 | "(#5) [40,0.7977873086929321,0.8983215093612671,0.8192722797393799,'00:00']\n",
2038 | "(#5) [41,0.7928269505500793,0.9097771048545837,0.8118752241134644,'00:00']\n",
2039 | "(#5) [42,0.787647008895874,0.8899490833282471,0.8222711086273193,'00:00']\n",
2040 | "(#5) [43,0.7828716039657593,0.8808231353759766,0.8222711086273193,'00:00']\n",
2041 | "(#5) [44,0.7777317762374878,0.8923096060752869,0.823670506477356,'00:00']\n",
2042 | "(#5) [45,0.7738550305366516,0.8853497505187988,0.8382647037506104,'00:00']\n",
2043 | "(#5) [46,0.7709805965423584,0.8972917795181274,0.8220711946487427,'00:00']\n",
2044 | "(#5) [47,0.7673884630203247,0.8800128102302551,0.8278688788414001,'00:00']\n",
2045 | "(#5) [48,0.7640093564987183,0.9135023951530457,0.8062775135040283,'00:00']\n",
2046 | "(#5) [49,0.7599205374717712,0.8737468719482422,0.8250699639320374,'00:00']\n",
2047 | "(#5) [50,0.7570430636405945,0.8932161331176758,0.8182727098464966,'00:00']\n",
2048 | "(#5) [51,0.7531866431236267,0.8813871145248413,0.8324670195579529,'00:00']\n",
2049 | "(#5) [52,0.7509766221046448,0.8721150159835815,0.8284686207771301,'00:00']\n",
2050 | "(#5) [53,0.7505348920822144,0.8717920780181885,0.8350659608840942,'00:00']\n",
2051 | "(#5) [54,0.7480961084365845,0.8608375787734985,0.8348660469055176,'00:00']\n",
2052 | "(#5) [55,0.7456995844841003,0.8628750443458557,0.8316673040390015,'00:00']\n",
2053 | "(#5) [56,0.7420889139175415,0.8884004950523376,0.8244702219963074,'00:00']\n",
2054 | "(#5) [57,0.7396153807640076,0.8796932101249695,0.8176729083061218,'00:00']\n",
2055 | "(#5) [58,0.7376757264137268,0.9113091230392456,0.8074769973754883,'00:00']\n",
2056 | "(#5) [59,0.736484706401825,0.8932759761810303,0.8172730803489685,'00:00']\n",
2057 | "(#5) [60,0.7353126406669617,0.8956537246704102,0.8134745955467224,'00:00']\n",
2058 | "(#5) [61,0.7325313687324524,0.8618877530097961,0.838464617729187,'00:00']\n",
2059 | "(#5) [62,0.7293753027915955,0.8461672067642212,0.8488604426383972,'00:00']\n",
2060 | "(#5) [63,0.7279269099235535,0.8688767552375793,0.8332666754722595,'00:00']\n",
2061 | "(#5) [64,0.7260914444923401,0.8612349033355713,0.8298680782318115,'00:00']\n",
2062 | "(#5) [65,0.7238287329673767,0.8527958989143372,0.8394641876220703,'00:00']\n",
2063 | "(#5) [66,0.7230509519577026,0.8784788846969604,0.8142743110656738,'00:00']\n",
2064 | "(#5) [67,0.7223744988441467,0.8546345233917236,0.8346661329269409,'00:00']\n",
2065 | "(#5) [68,0.7207707166671753,0.8325837850570679,0.8466613292694092,'00:00']\n",
2066 | "(#5) [69,0.7198972105979919,0.8347228765487671,0.8488604426383972,'00:00']\n",
2067 | "(#5) [70,0.7172579765319824,0.8470204472541809,0.8422631025314331,'00:00']\n",
2068 | "(#5) [71,0.7150745987892151,0.8431375622749329,0.8350659608840942,'00:00']\n",
2069 | "(#5) [72,0.7129457592964172,0.8525550961494446,0.836265504360199,'00:00']\n",
2070 | "(#5) [73,0.712224543094635,0.8295906186103821,0.8486605286598206,'00:00']\n",
2071 | "(#5) [74,0.7104686498641968,0.8574065566062927,0.8352658748626709,'00:00']\n",
2072 | "(#5) [75,0.7105570435523987,0.830181896686554,0.8396641612052917,'00:00']\n",
2073 | "(#5) [76,0.7093480825424194,0.8414129614830017,0.8446621298789978,'00:00']\n",
2074 | "(#5) [77,0.7075664401054382,0.8345168828964233,0.8464614152908325,'00:00']\n",
2075 | "(#5) [78,0.7070014476776123,0.859185516834259,0.8604558110237122,'00:00']\n",
2076 | "(#5) [79,0.7080651521682739,0.7991187572479248,0.8618552684783936,'00:00']\n",
2077 | "(#5) [80,0.7058107852935791,0.82581627368927,0.8450619578361511,'00:00']\n",
2078 | "(#5) [81,0.7037486433982849,0.77824866771698,0.8664534091949463,'00:00']\n",
2079 | "(#5) [82,0.69974684715271,0.7948270440101624,0.868252694606781,'00:00']\n",
2080 | "(#5) [83,0.6961161494255066,0.8123301267623901,0.8668532371520996,'00:00']\n",
2081 | "(#5) [84,0.6935539245605469,0.8104300498962402,0.8542582988739014,'00:00']\n",
2082 | "(#5) [85,0.6913067698478699,0.8051688075065613,0.8734506368637085,'00:00']\n",
2083 | "(#5) [86,0.6892038583755493,0.767038881778717,0.8722510933876038,'00:00']\n",
2084 | "(#5) [87,0.6881877183914185,0.7710039019584656,0.8724510073661804,'00:00']\n",
2085 | "(#5) [88,0.6889418959617615,0.7467213273048401,0.8902438879013062,'00:00']\n",
2086 | "(#5) [89,0.6861802935600281,0.7407645583152771,0.8854458332061768,'00:00']\n",
2087 | "(#5) [90,0.682510256767273,0.7697193026542664,0.8720511794090271,'00:00']\n",
2088 | "(#5) [91,0.6798180937767029,0.7464407682418823,0.8908436894416809,'00:00']\n",
2089 | "(#5) [92,0.6780225038528442,0.7661136388778687,0.881447434425354,'00:00']\n",
2090 | "(#5) [93,0.6747889518737793,0.7250258326530457,0.898040771484375,'00:00']\n",
2091 | "(#5) [94,0.6722937822341919,0.7420400977134705,0.8828468322753906,'00:00']\n",
2092 | "(#5) [95,0.6706210374832153,0.7211131453514099,0.8986405730247498,'00:00']\n",
2093 | "(#5) [96,0.6718377470970154,0.755474865436554,0.8870452046394348,'00:00']\n",
2094 | "(#5) [97,0.6714345812797546,0.7162908911705017,0.8976409435272217,'00:00']\n",
2095 | "(#5) [98,0.6679667830467224,0.7154003381729126,0.9020391702651978,'00:00']\n",
2096 | "(#5) [99,0.6647761464118958,0.7184165120124817,0.896841287612915,'00:00']\n",
2097 | "(#5) [100,0.6610886454582214,0.7141867876052856,0.9018392562866211,'00:00']\n",
2098 | "(#5) [101,0.6580597758293152,0.7133729457855225,0.9006397724151611,'00:00']\n",
2099 | "(#5) [102,0.6561830639839172,0.7321455478668213,0.8954418301582336,'00:00']\n",
2100 | "(#5) [103,0.6544478535652161,0.7389310002326965,0.8986405730247498,'00:00']\n",
2101 | "(#5) [104,0.652513325214386,0.7252397537231445,0.8948420882225037,'00:00']\n",
2102 | "(#5) [105,0.6513540148735046,0.7073065042495728,0.9020391702651978,'00:00']\n",
2103 | "(#5) [106,0.649445116519928,0.7087975144386292,0.9034386277198792,'00:00']\n",
2104 | "(#5) [107,0.6472246050834656,0.7044957876205444,0.9116353392601013,'00:00']\n",
2105 | "(#5) [108,0.645189642906189,0.7150427103042603,0.9076369404792786,'00:00']\n",
2106 | "(#5) [109,0.6443395018577576,0.7242041230201721,0.913434624671936,'00:00']\n",
2107 | "(#5) [110,0.6434120535850525,0.722388505935669,0.9012395143508911,'00:00']\n",
2108 | "(#5) [111,0.6414698362350464,0.7140684127807617,0.9042382836341858,'00:00']\n",
2109 | "(#5) [112,0.6402621865272522,0.7077004909515381,0.9060375690460205,'00:00']\n",
2110 | "(#5) [113,0.6402186155319214,0.746085524559021,0.8984405994415283,'00:00']\n",
2111 | "(#5) [114,0.6390677690505981,0.7134633660316467,0.9094362258911133,'00:00']\n",
2112 | "(#5) [115,0.6370812058448792,0.7281525135040283,0.9040383696556091,'00:00']\n",
2113 | "(#5) [116,0.6363402009010315,0.7368808388710022,0.9022390842437744,'00:00']\n",
2114 | "(#5) [117,0.6345449686050415,0.7051540613174438,0.9102358818054199,'00:00']\n",
2115 | "(#5) [118,0.6325724124908447,0.725058913230896,0.9104358553886414,'00:00']\n",
2116 | "(#5) [119,0.6310868859291077,0.7395963072776794,0.9094362258911133,'00:00']\n",
2117 | "(#5) [120,0.630473256111145,0.7043727040290833,0.9054378271102905,'00:00']\n",
2118 | "(#5) [121,0.6289581656455994,0.7401187419891357,0.8992403149604797,'00:00']\n",
2119 | "(#5) [122,0.6287906169891357,0.7386677265167236,0.9066373705863953,'00:00']\n",
2120 | "(#5) [123,0.6277364492416382,0.687985897064209,0.9138344526290894,'00:00']\n",
2121 | "(#5) [124,0.6277832984924316,0.7047213912010193,0.9088364839553833,'00:00']\n",
2122 | "(#5) [125,0.6272262930870056,0.6932193636894226,0.9160335659980774,'00:00']\n",
2123 | "(#5) [126,0.6254146695137024,0.7008631825447083,0.9136345386505127,'00:00']\n",
2124 | "(#5) [127,0.6236904859542847,0.7224925756454468,0.9082366824150085,'00:00']\n",
2125 | "(#5) [128,0.6226184368133545,0.7011900544166565,0.9142342805862427,'00:00']\n",
2126 | "(#5) [129,0.622261643409729,0.6936149001121521,0.9184326529502869,'00:00']\n",
2127 | "(#5) [130,0.6205112338066101,0.6994861960411072,0.9174330234527588,'00:00']\n",
2128 | "(#5) [131,0.6198267936706543,0.7135074138641357,0.9124350547790527,'00:00']\n",
2129 | "(#5) [132,0.6193405389785767,0.7035949230194092,0.9126349687576294,'00:00']\n",
2130 | "(#5) [133,0.6176502704620361,0.6999126076698303,0.9096361398696899,'00:00']\n",
2131 | "(#5) [134,0.6158040761947632,0.7035370469093323,0.9188324809074402,'00:00']\n",
2132 | "(#5) [135,0.6156546473503113,0.7029498815536499,0.9206317663192749,'00:00']\n",
2133 | "(#5) [136,0.6159342527389526,0.7170933485031128,0.9152339100837708,'00:00']\n",
2134 | "(#5) [137,0.6155687570571899,0.7170588970184326,0.9086365699768066,'00:00']\n",
2135 | "(#5) [138,0.6150934100151062,0.7031316161155701,0.9196321368217468,'00:00']\n",
2136 | "(#5) [139,0.614624559879303,0.7111772298812866,0.9146341681480408,'00:00']\n",
2137 | "(#5) [140,0.6158698201179504,0.7001308798789978,0.9190323948860168,'00:00']\n",
2138 | "(#5) [141,0.616431713104248,0.7059189081192017,0.9078368544578552,'00:00']\n",
2139 | "(#5) [142,0.6149819493293762,0.6966524124145508,0.9186325669288635,'00:00']\n",
2140 | "(#5) [143,0.614099383354187,0.7016303539276123,0.9146341681480408,'00:00']\n",
2141 | "(#5) [144,0.6132082343101501,0.7121127843856812,0.9130347967147827,'00:00']\n",
2142 | "(#5) [145,0.6135184168815613,0.6919340491294861,0.9204318523406982,'00:00']\n",
2143 | "(#5) [146,0.6130149364471436,0.6965556144714355,0.9200319647789001,'00:00']\n",
2144 | "(#5) [147,0.6111933588981628,0.691131055355072,0.9242303371429443,'00:00']\n",
2145 | "(#5) [148,0.6093133091926575,0.6842235326766968,0.9276289343833923,'00:00']\n",
2146 | "(#5) [149,0.608814001083374,0.6866974830627441,0.924430251121521,'00:00']\n",
2147 | "(#5) [150,0.6078141331672668,0.6747334003448486,0.9330267906188965,'00:00']\n",
2148 | "(#5) [151,0.6070014834403992,0.6872704029083252,0.9338264465332031,'00:00']\n",
2149 | "(#5) [152,0.6054865121841431,0.6751208305358887,0.9292283058166504,'00:00']\n",
2150 | "(#5) [153,0.6036891937255859,0.691012442111969,0.9234306216239929,'00:00']\n",
2151 | "(#5) [154,0.6028554439544678,0.6588934659957886,0.9392243027687073,'00:00']\n",
2152 | "(#5) [155,0.6018180847167969,0.6643573641777039,0.9348260760307312,'00:00']\n",
2153 | "(#5) [156,0.6011530160903931,0.6831613779067993,0.9368252754211426,'00:00']\n",
2154 | "(#5) [157,0.5993403792381287,0.6673189997673035,0.9380248188972473,'00:00']\n",
2155 | "(#5) [158,0.5981720685958862,0.6699034571647644,0.9330267906188965,'00:00']\n",
2156 | "(#5) [159,0.5975591540336609,0.6722262501716614,0.9428228735923767,'00:00']\n",
2157 | "(#5) [160,0.5980014801025391,0.6464094519615173,0.9456217288970947,'00:00']\n",
2158 | "(#5) [161,0.5964894890785217,0.63887619972229,0.9474210143089294,'00:00']\n",
2159 | "(#5) [162,0.594303548336029,0.635678768157959,0.9516193270683289,'00:00']\n",
2160 | "(#5) [163,0.5907434821128845,0.6223987340927124,0.9556177258491516,'00:00']\n",
2161 | "(#5) [164,0.5887797474861145,0.6146103143692017,0.957616925239563,'00:00']\n",
2162 | "(#5) [165,0.5873358845710754,0.6020277142524719,0.9638144969940186,'00:00']\n",
2163 | "(#5) [166,0.5848684906959534,0.6276305913925171,0.9536185264587402,'00:00']\n",
2164 | "(#5) [167,0.5838876366615295,0.5988636612892151,0.9664134383201599,'00:00']\n",
2165 | "(#5) [168,0.5819734334945679,0.593903660774231,0.9694122076034546,'00:00']\n",
2166 | "(#5) [169,0.5806432962417603,0.5945674180984497,0.9668132662773132,'00:00']\n",
2167 | "(#5) [170,0.5805205702781677,0.5915608406066895,0.9700120091438293,'00:00']\n",
2168 | "(#5) [171,0.5791205763816833,0.570715069770813,0.9754098653793335,'00:00']\n",
2169 | "(#5) [172,0.5773524045944214,0.5711948275566101,0.9758096933364868,'00:00']\n",
2170 | "(#5) [173,0.5753962993621826,0.5602182745933533,0.9842063188552856,'00:00']\n",
2171 | "(#5) [174,0.5736754536628723,0.5679469704627991,0.9782087206840515,'00:00']\n",
2172 | "(#5) [175,0.5715762376785278,0.5567198991775513,0.9836065769195557,'00:00']\n",
2173 | "(#5) [176,0.5697609186172485,0.5640451908111572,0.9798080921173096,'00:00']\n",
2174 | "(#5) [177,0.5682932734489441,0.5589687824249268,0.9812074899673462,'00:00']\n",
2175 | "(#5) [178,0.5668113231658936,0.5551193952560425,0.9842063188552856,'00:00']\n",
2176 | "(#5) [179,0.5653032660484314,0.5603320002555847,0.9796081781387329,'00:00']\n",
2177 | "(#5) [180,0.5643274784088135,0.5567006468772888,0.9848060607910156,'00:00']\n",
2178 | "(#5) [181,0.5629553198814392,0.5561044812202454,0.9860056042671204,'00:00']\n",
2179 | "(#5) [182,0.5619140863418579,0.5527594089508057,0.9874050617218018,'00:00']\n",
2180 | "(#5) [183,0.5620712041854858,0.5484068393707275,0.9872051477432251,'00:00']\n",
2181 | "(#5) [184,0.5616167187690735,0.5499398708343506,0.9854058623313904,'00:00']\n",
2182 | "(#5) [185,0.5610474944114685,0.5435861349105835,0.9896041750907898,'00:00']\n",
2183 | "(#5) [186,0.5596954226493835,0.5403269529342651,0.9886045455932617,'00:00']\n",
2184 | "(#5) [187,0.5585765838623047,0.5531136393547058,0.986205518245697,'00:00']\n",
2185 | "(#5) [188,0.5574848651885986,0.5445507168769836,0.9898040890693665,'00:00']\n",
2186 | "(#5) [189,0.5563370585441589,0.5510722398757935,0.9872051477432251,'00:00']\n",
2187 | "(#5) [190,0.5551019310951233,0.5469622611999512,0.9884046316146851,'00:00']\n",
2188 | "(#5) [191,0.5544649362564087,0.5506313443183899,0.985205888748169,'00:00']\n",
2189 | "(#5) [192,0.5534972548484802,0.5465825200080872,0.9886045455932617,'00:00']\n",
2190 | "(#5) [193,0.5522512197494507,0.5451715588569641,0.9860056042671204,'00:00']\n",
2191 | "(#5) [194,0.5514794588088989,0.5413194298744202,0.9904038310050964,'00:00']\n",
2192 | "(#5) [195,0.5512505769729614,0.542043924331665,0.9896041750907898,'00:00']\n",
2193 | "(#5) [196,0.5517233610153198,0.5463293790817261,0.9894042611122131,'00:00']\n",
2194 | "(#5) [197,0.5525488257408142,0.5484658479690552,0.9882047176361084,'00:00']\n",
2195 | "(#5) [198,0.5526827573776245,0.5478832125663757,0.9866053462028503,'00:00']\n",
2196 | "(#5) [199,0.551626980304718,0.5401144027709961,0.9892043471336365,'00:00']\n",
2197 | "(#5) [200,0.5506093502044678,0.5380721688270569,0.9906037449836731,'00:00']\n",
2198 | "(#5) [201,0.5491954684257507,0.542596161365509,0.9902039170265198,'00:00']\n",
2199 | "(#5) [202,0.5486178994178772,0.5461004972457886,0.9902039170265198,'00:00']\n",
2200 | "(#5) [203,0.5473641157150269,0.539888858795166,0.9908036589622498,'00:00']\n",
2201 | "(#5) [204,0.5466387271881104,0.5439626574516296,0.9906037449836731,'00:00']\n",
2202 | "(#5) [205,0.5463984608650208,0.5461925864219666,0.9888044595718384,'00:00']\n",
2203 | "(#5) [206,0.5462753176689148,0.5429316759109497,0.9906037449836731,'00:00']\n",
2204 | "(#5) [207,0.5459163784980774,0.5421329736709595,0.9908036589622498,'00:00']\n",
2205 | "(#5) [208,0.5450856685638428,0.5414056777954102,0.9894042611122131,'00:00']\n",
2206 | "(#5) [209,0.544485867023468,0.5403134822845459,0.9900040030479431,'00:00']\n",
2207 | "(#5) [210,0.544035017490387,0.5426049828529358,0.9894042611122131,'00:00']\n",
2208 | "(#5) [211,0.5429638028144836,0.5401840806007385,0.9904038310050964,'00:00']\n",
2209 | "(#5) [212,0.5425575375556946,0.5422840118408203,0.9896041750907898,'00:00']\n",
2210 | "(#5) [213,0.5429237484931946,0.542927086353302,0.9900040030479431,'00:00']\n",
2211 | "(#5) [214,0.542816162109375,0.5381215810775757,0.9902039170265198,'00:00']\n",
2212 | "(#5) [215,0.5420499444007874,0.540573239326477,0.9898040890693665,'00:00']\n",
2213 | "(#5) [216,0.5420210957527161,0.5403479337692261,0.9904038310050964,'00:00']\n",
2214 | "(#5) [217,0.541577935218811,0.537257969379425,0.9928028583526611,'00:00']\n",
2215 | "(#5) [218,0.5414021611213684,0.5413365960121155,0.9908036589622498,'00:00']\n",
2216 | "(#5) [219,0.540424644947052,0.536346971988678,0.9918032884597778,'00:00']\n",
2217 | "(#5) [220,0.5395395755767822,0.541458785533905,0.9896041750907898,'00:00']\n",
2218 | "(#5) [221,0.5397221446037292,0.5418392419815063,0.9916033744812012,'00:00']\n",
2219 | "(#5) [222,0.5396131873130798,0.5369334816932678,0.9920032024383545,'00:00']\n",
2220 | "(#5) [223,0.539309561252594,0.5373867750167847,0.9920032024383545,'00:00']\n",
2221 | "(#5) [224,0.5395938158035278,0.5419530272483826,0.9900040030479431,'00:00']\n",
2222 | "(#5) [225,0.5390751361846924,0.5344215035438538,0.9922031164169312,'00:00']\n",
2223 | "(#5) [226,0.5380330681800842,0.5340580940246582,0.9926029443740845,'00:00']\n",
2224 | "(#5) [227,0.5372695326805115,0.5376895070075989,0.9920032024383545,'00:00']\n",
2225 | "(#5) [228,0.5364302396774292,0.534730076789856,0.9906037449836731,'00:00']\n",
2226 | "(#5) [229,0.5359565019607544,0.5342651605606079,0.9910035729408264,'00:00']\n",
2227 | "(#5) [230,0.5356634855270386,0.5358877182006836,0.9922031164169312,'00:00']\n",
2228 | "(#5) [231,0.5356540083885193,0.5348705053329468,0.9914034605026245,'00:00']\n",
2229 | "(#5) [232,0.535110592842102,0.5354580283164978,0.9922031164169312,'00:00']\n",
2230 | "(#5) [233,0.5350244045257568,0.5387479662895203,0.9908036589622498,'00:00']\n",
2231 | "(#5) [234,0.5346865653991699,0.5375396609306335,0.9924030303955078,'00:00']\n",
2232 | "(#5) [235,0.5347023010253906,0.5412723422050476,0.9902039170265198,'00:00']\n",
2233 | "(#5) [236,0.534405529499054,0.5340064764022827,0.9926029443740845,'00:00']\n",
2234 | "(#5) [237,0.5342296957969666,0.5369793176651001,0.9916033744812012,'00:00']\n",
2235 | "(#5) [238,0.5344192981719971,0.5355124473571777,0.9918032884597778,'00:00']\n",
2236 | "(#5) [239,0.534367561340332,0.5357213020324707,0.9918032884597778,'00:00']\n",
2237 | "(#5) [240,0.5342124104499817,0.5352226495742798,0.9926029443740845,'00:00']\n",
2238 | "(#5) [241,0.534148633480072,0.5325578451156616,0.9926029443740845,'00:00']\n",
2239 | "(#5) [242,0.533916175365448,0.5347300171852112,0.9918032884597778,'00:00']\n",
2240 | "(#5) [243,0.5332643389701843,0.5342212319374084,0.9922031164169312,'00:00']\n",
2241 | "(#5) [244,0.5326927900314331,0.5352438688278198,0.9926029443740845,'00:00']\n",
2242 | "(#5) [245,0.5324588418006897,0.5325627326965332,0.9924030303955078,'00:00']\n",
2243 | "(#5) [246,0.5321437120437622,0.5326060056686401,0.9908036589622498,'00:00']\n",
2244 | "(#5) [247,0.5311025381088257,0.5336413383483887,0.9926029443740845,'00:00']\n",
2245 | "(#5) [248,0.5304700136184692,0.533159077167511,0.9924030303955078,'00:00']\n",
2246 | "(#5) [249,0.5300271511077881,0.5333096981048584,0.9922031164169312,'00:00']\n",
2247 | "(#5) [250,0.5299978256225586,0.5347007513046265,0.9922031164169312,'00:00']\n",
2248 | "(#5) [251,0.5302603244781494,0.5321550369262695,0.9930027723312378,'00:00']\n",
2249 | "(#5) [252,0.5303952693939209,0.532942533493042,0.9922031164169312,'00:00']\n",
2250 | "(#5) [253,0.5299874544143677,0.531720757484436,0.9916033744812012,'00:00']\n",
2251 | "(#5) [254,0.5293612480163574,0.535294771194458,0.9918032884597778,'00:00']\n",
2252 | "(#5) [255,0.5290010571479797,0.5334727168083191,0.9920032024383545,'00:00']\n",
2253 | "(#5) [256,0.5291496515274048,0.5332854986190796,0.9926029443740845,'00:00']\n",
2254 | "(#5) [257,0.5289875268936157,0.5369863510131836,0.9918032884597778,'00:00']\n",
2255 | "(#5) [258,0.5292960405349731,0.5360062718391418,0.9912035465240479,'00:00']\n",
2256 | "(#5) [259,0.5294293761253357,0.5352133512496948,0.9918032884597778,'00:00']\n",
2257 | "(#5) [260,0.5296972990036011,0.5324904918670654,0.9932027459144592,'00:00']\n",
2258 | "(#5) [261,0.5297520160675049,0.5358486175537109,0.9920032024383545,'00:00']\n",
2259 | "(#5) [262,0.5300208330154419,0.5354281663894653,0.9920032024383545,'00:00']\n",
2260 | "(#5) [263,0.5300083756446838,0.5335763692855835,0.9922031164169312,'00:00']\n",
2261 | "(#5) [264,0.5300591588020325,0.5340001583099365,0.9918032884597778,'00:00']\n",
2262 | "(#5) [265,0.529534637928009,0.5326916575431824,0.9938024878501892,'00:00']\n",
2263 | "(#5) [266,0.5293682217597961,0.5303005576133728,0.9934026598930359,'00:00']\n",
2264 | "(#5) [267,0.5284995436668396,0.5304892659187317,0.9926029443740845,'00:00']\n",
2265 | "(#5) [268,0.5280436277389526,0.5328031182289124,0.9924030303955078,'00:00']\n",
2266 | "(#5) [269,0.5278945565223694,0.530960738658905,0.9926029443740845,'00:00']\n",
2267 | "(#5) [270,0.5277324318885803,0.5315265655517578,0.9928028583526611,'00:00']\n",
2268 | "(#5) [271,0.5274272561073303,0.5316656827926636,0.9928028583526611,'00:00']\n",
2269 | "(#5) [272,0.5272798538208008,0.5357393026351929,0.9920032024383545,'00:00']\n",
2270 | "(#5) [273,0.5272314548492432,0.5321664214134216,0.9918032884597778,'00:00']\n",
2271 | "(#5) [274,0.5271017551422119,0.530215322971344,0.9930027723312378,'00:00']\n",
2272 | "(#5) [275,0.5265266299247742,0.5309420228004456,0.9924030303955078,'00:00']\n",
2273 | "(#5) [276,0.5259681940078735,0.5328221321105957,0.9918032884597778,'00:00']\n",
2274 | "(#5) [277,0.5260156989097595,0.5320685505867004,0.9914034605026245,'00:00']\n",
2275 | "(#5) [278,0.5255963206291199,0.5312820672988892,0.9928028583526611,'00:00']\n",
2276 | "(#5) [279,0.5252783298492432,0.5326845645904541,0.9922031164169312,'00:00']\n",
2277 | "(#5) [280,0.5252740979194641,0.5330591797828674,0.9922031164169312,'00:00']\n",
2278 | "(#5) [281,0.5250119566917419,0.5329728722572327,0.9922031164169312,'00:00']\n",
2279 | "(#5) [282,0.5249338150024414,0.5304170250892639,0.9934026598930359,'00:00']\n",
2280 | "(#5) [283,0.525185227394104,0.5298480987548828,0.9932027459144592,'00:00']\n",
2281 | "(#5) [284,0.5249873995780945,0.5299460887908936,0.9928028583526611,'00:00']\n",
2282 | "(#5) [285,0.5243609547615051,0.5310508608818054,0.9932027459144592,'00:00']\n",
2283 | "(#5) [286,0.5243965983390808,0.5296792984008789,0.9934026598930359,'00:00']\n",
2284 | "(#5) [287,0.5242559313774109,0.5302827954292297,0.9932027459144592,'00:00']\n",
2285 | "(#5) [288,0.5241348743438721,0.5328070521354675,0.9932027459144592,'00:00']\n",
2286 | "(#5) [289,0.5243997573852539,0.5326344966888428,0.9938024878501892,'00:00']\n",
2287 | "(#5) [290,0.5245122909545898,0.5313625931739807,0.9930027723312378,'00:00']\n",
2288 | "(#5) [291,0.5245428085327148,0.530437171459198,0.9932027459144592,'00:00']\n",
2289 | "(#5) [292,0.5241310596466064,0.5301350951194763,0.9928028583526611,'00:00']\n",
2290 | "(#5) [293,0.5238795280456543,0.5321123003959656,0.9928028583526611,'00:00']\n",
2291 | "(#5) [294,0.5236005783081055,0.5306488871574402,0.9934026598930359,'00:00']\n",
2292 | "(#5) [295,0.5233083367347717,0.5298057198524475,0.9936025738716125,'00:00']\n",
2293 | "(#5) [296,0.5229709148406982,0.5285005569458008,0.9936025738716125,'00:00']\n",
2294 | "(#5) [297,0.5230247974395752,0.5279933214187622,0.9940024018287659,'00:00']\n",
2295 | "(#5) [298,0.5224641561508179,0.5297904014587402,0.9926029443740845,'00:00']\n",
2296 | "(#5) [299,0.5220513939857483,0.5295735001564026,0.9930027723312378,'00:00']\n",
2297 | "(#5) [300,0.5215341448783875,0.5288663506507874,0.9930027723312378,'00:00']\n",
2298 | "(#5) [301,0.5215601325035095,0.5345451831817627,0.9918032884597778,'00:00']\n",
2299 | "(#5) [302,0.5214611291885376,0.5297326445579529,0.9930027723312378,'00:00']\n",
2300 | "(#5) [303,0.52143394947052,0.5310884714126587,0.9920032024383545,'00:00']\n",
2301 | "(#5) [304,0.5211716294288635,0.5301254987716675,0.9936025738716125,'00:00']\n",
2302 | "(#5) [305,0.5210453867912292,0.5286486744880676,0.9938024878501892,'00:00']\n",
2303 | "(#5) [306,0.5210368633270264,0.5286911725997925,0.9926029443740845,'00:00']\n",
2304 | "(#5) [307,0.5211474299430847,0.5285249352455139,0.9936025738716125,'00:00']\n",
2305 | "(#5) [308,0.5209577083587646,0.5296209454536438,0.9928028583526611,'00:00']\n",
2306 | "(#5) [309,0.5210529565811157,0.531628429889679,0.9928028583526611,'00:00']\n",
2307 | "(#5) [310,0.5213543772697449,0.5287055373191833,0.9930027723312378,'00:00']\n",
2308 | "(#5) [311,0.5213340520858765,0.5317543148994446,0.9924030303955078,'00:00']\n",
2309 | "(#5) [312,0.5210754871368408,0.5302956700325012,0.9934026598930359,'00:00']\n",
2310 | "(#5) [313,0.5207858085632324,0.5300148725509644,0.9936025738716125,'00:00']\n",
2311 | "(#5) [314,0.5204238891601562,0.529970109462738,0.9932027459144592,'00:00']\n",
2312 | "(#5) [315,0.5202995538711548,0.5301073789596558,0.9926029443740845,'00:00']\n",
2313 | "(#5) [316,0.5200840830802917,0.5282450318336487,0.9936025738716125,'00:00']\n",
2314 | "(#5) [317,0.5199294090270996,0.5306731462478638,0.9930027723312378,'00:00']\n",
2315 | "(#5) [318,0.519396960735321,0.5293433666229248,0.9932027459144592,'00:00']\n",
2316 | "(#5) [319,0.5193592309951782,0.5298054218292236,0.9926029443740845,'00:00']\n",
2317 | "(#5) [320,0.5191681981086731,0.530682384967804,0.9924030303955078,'00:00']\n",
2318 | "(#5) [321,0.5191587209701538,0.5297680497169495,0.9930027723312378,'00:00']\n",
2319 | "(#5) [322,0.5188485980033875,0.5309107303619385,0.9926029443740845,'00:00']\n",
2320 | "(#5) [323,0.5189487338066101,0.5309447646141052,0.9932027459144592,'00:00']\n",
2321 | "(#5) [324,0.5188524723052979,0.5303348898887634,0.9930027723312378,'00:00']\n",
2322 | "(#5) [325,0.5189779996871948,0.5306690335273743,0.9922031164169312,'00:00']\n",
2323 | "(#5) [326,0.5188019275665283,0.5299952030181885,0.9928028583526611,'00:00']\n",
2324 | "(#5) [327,0.518695592880249,0.5284841060638428,0.9934026598930359,'00:00']\n",
2325 | "(#5) [328,0.5185051560401917,0.5285061001777649,0.9932027459144592,'00:00']\n",
2326 | "(#5) [329,0.5188384652137756,0.5287044644355774,0.9928028583526611,'00:00']\n",
2327 | "(#5) [330,0.5186468362808228,0.5293283462524414,0.9928028583526611,'00:00']\n",
2328 | "(#5) [331,0.518567681312561,0.5291353464126587,0.9932027459144592,'00:00']\n",
2329 | "(#5) [332,0.5184825658798218,0.5274478793144226,0.9938024878501892,'00:00']\n",
2330 | "(#5) [333,0.5184876322746277,0.5271239280700684,0.9932027459144592,'00:00']\n",
2331 | "(#5) [334,0.5183936357498169,0.528414785861969,0.9928028583526611,'00:00']\n",
2332 | "(#5) [335,0.5180483460426331,0.5291456580162048,0.9926029443740845,'00:00']\n",
2333 | "(#5) [336,0.5179432034492493,0.5286192893981934,0.9932027459144592,'00:00']\n",
2334 | "(#5) [337,0.5177868008613586,0.5284668803215027,0.9930027723312378,'00:00']\n",
2335 | "(#5) [338,0.517536461353302,0.528547465801239,0.9930027723312378,'00:00']\n",
2336 | "(#5) [339,0.5174716711044312,0.5286524295806885,0.9928028583526611,'00:00']\n",
2337 | "(#5) [340,0.5172891616821289,0.5290689468383789,0.9932027459144592,'00:00']\n",
2338 | "(#5) [341,0.5169526934623718,0.5286818146705627,0.9928028583526611,'00:00']\n",
2339 | "(#5) [342,0.5170671939849854,0.5280165672302246,0.9934026598930359,'00:00']\n",
2340 | "(#5) [343,0.5169171690940857,0.5287995934486389,0.9924030303955078,'00:00']\n",
2341 | "(#5) [344,0.5168113708496094,0.5294147729873657,0.9928028583526611,'00:00']\n",
2342 | "(#5) [345,0.5168098211288452,0.5291945934295654,0.9926029443740845,'00:00']\n",
2343 | "(#5) [346,0.5166471600532532,0.5289372205734253,0.9928028583526611,'00:00']\n",
2344 | "(#5) [347,0.5165153741836548,0.5282745361328125,0.9932027459144592,'00:00']\n",
2345 | "(#5) [348,0.5166364312171936,0.5278546810150146,0.9930027723312378,'00:00']\n",
2346 | "(#5) [349,0.5169546008110046,0.5282431244850159,0.9932027459144592,'00:00']\n",
2347 | "(#5) [350,0.5167357921600342,0.5281462669372559,0.9928028583526611,'00:00']\n",
2348 | "(#5) [351,0.5167911052703857,0.5282053351402283,0.9928028583526611,'00:00']\n",
2349 | "(#5) [352,0.5166352987289429,0.527938187122345,0.9932027459144592,'00:00']\n",
2350 | "(#5) [353,0.5165953040122986,0.5275187492370605,0.9934026598930359,'00:00']\n",
2351 | "(#5) [354,0.5165454745292664,0.5281561613082886,0.9934026598930359,'00:00']\n",
2352 | "(#5) [355,0.5163648724555969,0.528043806552887,0.9932027459144592,'00:00']\n",
2353 | "(#5) [356,0.5160258412361145,0.5281446576118469,0.9934026598930359,'00:00']\n",
2354 | "(#5) [357,0.5159211754798889,0.5281926989555359,0.9930027723312378,'00:00']\n",
2355 | "(#5) [358,0.5160395503044128,0.5285668969154358,0.9930027723312378,'00:00']\n",
2356 | "(#5) [359,0.5161588191986084,0.5279431939125061,0.9932027459144592,'00:00']\n",
2357 | "(#5) [360,0.5160760283470154,0.527444064617157,0.9934026598930359,'00:00']\n",
2358 | "(#5) [361,0.5161653161048889,0.5277760028839111,0.9932027459144592,'00:00']\n",
2359 | "(#5) [362,0.5159686207771301,0.5282360911369324,0.9934026598930359,'00:00']\n",
2360 | "(#5) [363,0.5159649848937988,0.5275589227676392,0.9930027723312378,'00:00']\n",
2361 | "(#5) [364,0.5159788131713867,0.5273492336273193,0.9938024878501892,'00:00']\n",
2362 | "(#5) [365,0.5157800912857056,0.5275050401687622,0.9932027459144592,'00:00']\n",
2363 | "(#5) [366,0.5157893300056458,0.527679443359375,0.9934026598930359,'00:00']\n",
2364 | "(#5) [367,0.5157250165939331,0.5275229215621948,0.9936025738716125,'00:00']\n",
2365 | "(#5) [368,0.5157070159912109,0.527600884437561,0.9934026598930359,'00:00']\n",
2366 | "(#5) [369,0.5155916810035706,0.5276570320129395,0.9932027459144592,'00:00']\n",
2367 | "(#5) [370,0.5153377652168274,0.5279443264007568,0.9932027459144592,'00:00']\n",
2368 | "(#5) [371,0.5151305198669434,0.5277968049049377,0.9934026598930359,'00:00']\n",
2369 | "(#5) [372,0.5153862833976746,0.5277093648910522,0.9934026598930359,'00:00']\n",
2370 | "(#5) [373,0.515356183052063,0.527471661567688,0.9936025738716125,'00:00']\n",
2371 | "(#5) [374,0.5152143239974976,0.5273513197898865,0.9932027459144592,'00:00']\n",
2372 | "(#5) [375,0.5154057741165161,0.5272999405860901,0.9932027459144592,'00:00']\n",
2373 | "(#5) [376,0.5153412222862244,0.5274387001991272,0.9932027459144592,'00:00']\n",
2374 | "(#5) [377,0.5151574611663818,0.5272072553634644,0.9932027459144592,'00:00']\n",
2375 | "(#5) [378,0.5150768160820007,0.5269420742988586,0.9932027459144592,'00:00']\n",
2376 | "(#5) [379,0.5150449872016907,0.5269762277603149,0.9934026598930359,'00:00']\n",
2377 | "(#5) [380,0.5151028037071228,0.5272069573402405,0.9932027459144592,'00:00']\n",
2378 | "(#5) [381,0.5150880813598633,0.5272423028945923,0.9932027459144592,'00:00']\n",
2379 | "(#5) [382,0.515092670917511,0.5271323919296265,0.9934026598930359,'00:00']\n",
2380 | "(#5) [383,0.5149607062339783,0.5271402597427368,0.9932027459144592,'00:00']\n",
2381 | "(#5) [384,0.5148206949234009,0.5271366834640503,0.9932027459144592,'00:00']\n",
2382 | "(#5) [385,0.5148480534553528,0.5270259976387024,0.9934026598930359,'00:00']\n",
2383 | "(#5) [386,0.515235185623169,0.526939868927002,0.9934026598930359,'00:00']\n",
2384 | "(#5) [387,0.5152973532676697,0.5270364284515381,0.9934026598930359,'00:00']\n",
2385 | "(#5) [388,0.5152448415756226,0.5270441174507141,0.9934026598930359,'00:00']\n",
2386 | "(#5) [389,0.5152629017829895,0.526996910572052,0.9934026598930359,'00:00']\n",
2387 | "(#5) [390,0.5153074264526367,0.5271141529083252,0.9930027723312378,'00:00']\n",
2388 | "(#5) [391,0.5150854587554932,0.527251660823822,0.9932027459144592,'00:00']\n",
2389 | "(#5) [392,0.515135645866394,0.5272926092147827,0.9932027459144592,'00:00']\n",
2390 | "(#5) [393,0.5153532028198242,0.5272953510284424,0.9932027459144592,'00:00']\n",
2391 | "(#5) [394,0.5151983499526978,0.5272786617279053,0.9932027459144592,'00:00']\n",
2392 | "(#5) [395,0.5151939392089844,0.5271652340888977,0.9932027459144592,'00:00']\n",
2393 | "(#5) [396,0.5149791836738586,0.5272667407989502,0.9932027459144592,'00:00']\n",
2394 | "(#5) [397,0.5150371789932251,0.5272676944732666,0.9932027459144592,'00:00']\n",
2395 | "(#5) [398,0.5150265097618103,0.5273163318634033,0.9932027459144592,'00:00']\n",
2396 | "(#5) [399,0.5149377584457397,0.5271505117416382,0.9932027459144592,'00:00']\n",
2397 | "Highest accuracy of: 0.9940024018287659 at epoch 298\n"
2398 | ],
2399 | "name": "stdout"
2400 | }
2401 | ]
2402 | },
2403 | {
2404 | "cell_type": "markdown",
2405 | "metadata": {
2406 | "id": "Ef83mldoWpHF",
2407 | "colab_type": "text"
2408 | },
2409 | "source": [
2410 | "## Run 5"
2411 | ]
2412 | },
2413 | {
2414 | "cell_type": "code",
2415 | "metadata": {
2416 | "id": "AHXESj4KcBEF",
2417 | "colab_type": "code",
2418 | "colab": {
2419 | "base_uri": "https://localhost:8080/",
2420 | "height": 1000
2421 | },
2422 | "outputId": "c43951d2-12e3-431f-8460-3fcea2457663"
2423 | },
2424 | "source": [
2425 | "learn = tabular_learner(dls, layers=[100,50,50],\n",
2426 | " ps=[0.01,0.01,0.02], metrics=accuracy,\n",
2427 | " loss_func=myLabelSmoothingCrossEntropyFlat(), n_out=10,\n",
2428 | " cbs=TrackHighestEpoch)\n",
2429 | "with learn.no_bar():\n",
2430 | " learn.fit_one_cycle(400, 1e-1)"
2431 | ],
2432 | "execution_count": 112,
2433 | "outputs": [
2434 | {
2435 | "output_type": "stream",
2436 | "text": [
2437 | "(#5) [0,1.856536865234375,1.9822254180908203,0.49500200152397156,'00:00']\n",
2438 | "(#5) [1,1.5840586423873901,1.3882856369018555,0.49500200152397156,'00:00']\n",
2439 | "(#5) [2,1.4862524271011353,1.298932671546936,0.49500200152397156,'00:00']\n",
2440 | "(#5) [3,1.4239410161972046,1.3021901845932007,0.5035985708236694,'00:00']\n",
2441 | "(#5) [4,1.3853504657745361,1.3002160787582397,0.5053978562355042,'00:00']\n",
2442 | "(#5) [5,1.3564832210540771,1.2835593223571777,0.526989221572876,'00:00']\n",
2443 | "(#5) [6,1.3348164558410645,1.2770748138427734,0.5327869057655334,'00:00']\n",
2444 | "(#5) [7,1.3162322044372559,1.2688472270965576,0.5463814735412598,'00:00']\n",
2445 | "(#5) [8,1.2997393608093262,1.2645835876464844,0.55677729845047,'00:00']\n",
2446 | "(#5) [9,1.2839065790176392,1.2528749704360962,0.5687724947929382,'00:00']\n",
2447 | "(#5) [10,1.2694367170333862,1.2479283809661865,0.5867652893066406,'00:00']\n",
2448 | "(#5) [11,1.254752516746521,1.2275829315185547,0.5963614583015442,'00:00']\n",
2449 | "(#5) [12,1.2393661737442017,1.2126461267471313,0.6097561120986938,'00:00']\n",
2450 | "(#5) [13,1.2225242853164673,1.2012723684310913,0.6227508783340454,'00:00']\n",
2451 | "(#5) [14,1.2043054103851318,1.1886439323425293,0.6365453600883484,'00:00']\n",
2452 | "(#5) [15,1.1844737529754639,1.1696069240570068,0.646141529083252,'00:00']\n",
2453 | "(#5) [16,1.1629328727722168,1.1497223377227783,0.6639344096183777,'00:00']\n",
2454 | "(#5) [17,1.1415144205093384,1.128962516784668,0.6861255764961243,'00:00']\n",
2455 | "(#5) [18,1.1196281909942627,1.1377650499343872,0.6835265755653381,'00:00']\n",
2456 | "(#5) [19,1.0980544090270996,1.1112674474716187,0.7017192840576172,'00:00']\n",
2457 | "(#5) [20,1.076671838760376,1.0731879472732544,0.7213114500045776,'00:00']\n",
2458 | "(#5) [21,1.0553170442581177,1.1016515493392944,0.7041183710098267,'00:00']\n",
2459 | "(#5) [22,1.0342395305633545,1.0540293455123901,0.7237105369567871,'00:00']\n",
2460 | "(#5) [23,1.0136915445327759,1.0281001329421997,0.7506996989250183,'00:00']\n",
2461 | "(#5) [24,0.9937040209770203,1.0108968019485474,0.7560975551605225,'00:00']\n",
2462 | "(#5) [25,0.9745908975601196,0.9957839846611023,0.7618952393531799,'00:00']\n",
2463 | "(#5) [26,0.9565381407737732,1.0075819492340088,0.7572970986366272,'00:00']\n",
2464 | "(#5) [27,0.9390842914581299,0.9794436693191528,0.7672930955886841,'00:00']\n",
2465 | "(#5) [28,0.9219772815704346,0.9587832689285278,0.7916833162307739,'00:00']\n",
2466 | "(#5) [29,0.9058039784431458,0.9490118026733398,0.7890843749046326,'00:00']\n",
2467 | "(#5) [30,0.8889201283454895,0.9081711173057556,0.8156737089157104,'00:00']\n",
2468 | "(#5) [31,0.8729901313781738,0.9020345211029053,0.8254697918891907,'00:00']\n",
2469 | "(#5) [32,0.8592733144760132,0.9052109718322754,0.8190723657608032,'00:00']\n",
2470 | "(#5) [33,0.8465763330459595,0.9196886420249939,0.8102759122848511,'00:00']\n",
2471 | "(#5) [34,0.8337653875350952,0.8670014142990112,0.8364654183387756,'00:00']\n",
2472 | "(#5) [35,0.8224568367004395,0.8609052300453186,0.8404638171195984,'00:00']\n",
2473 | "(#5) [36,0.8109555244445801,0.865397572517395,0.8470611572265625,'00:00']\n",
2474 | "(#5) [37,0.8003664016723633,0.8570094704627991,0.8430627584457397,'00:00']\n",
2475 | "(#5) [38,0.7901191115379333,0.8224971890449524,0.863254725933075,'00:00']\n",
2476 | "(#5) [39,0.7806990742683411,0.8333624601364136,0.8576569557189941,'00:00']\n",
2477 | "(#5) [40,0.7712745070457458,0.8263095021247864,0.8592563271522522,'00:00']\n",
2478 | "(#5) [41,0.7631810903549194,0.816109299659729,0.8636545538902283,'00:00']\n",
2479 | "(#5) [42,0.752457857131958,0.7915651202201843,0.8742502927780151,'00:00']\n",
2480 | "(#5) [43,0.7435197234153748,0.7747954726219177,0.8896441459655762,'00:00']\n",
2481 | "(#5) [44,0.7347887754440308,0.7663367986679077,0.8900439739227295,'00:00']\n",
2482 | "(#5) [45,0.7266516089439392,0.7777137160301208,0.8800479769706726,'00:00']\n",
2483 | "(#5) [46,0.720198392868042,0.835684061050415,0.8526589274406433,'00:00']\n",
2484 | "(#5) [47,0.7141945958137512,0.7740717530250549,0.8828468322753906,'00:00']\n",
2485 | "(#5) [48,0.7073748707771301,0.7457954287528992,0.9014394283294678,'00:00']\n",
2486 | "(#5) [49,0.7021173238754272,0.7405821084976196,0.8934426307678223,'00:00']\n",
2487 | "(#5) [50,0.6961896419525146,0.7385624051094055,0.9080367684364319,'00:00']\n",
2488 | "(#5) [51,0.6904593706130981,0.7373228073120117,0.9032387137413025,'00:00']\n",
2489 | "(#5) [52,0.684364914894104,0.7374168634414673,0.9062374830245972,'00:00']\n",
2490 | "(#5) [53,0.6801447868347168,0.7042743563652039,0.9170331954956055,'00:00']\n",
2491 | "(#5) [54,0.6756096482276917,0.7199286222457886,0.9160335659980774,'00:00']\n",
2492 | "(#5) [55,0.6719427704811096,0.7033419013023376,0.9180327653884888,'00:00']\n",
2493 | "(#5) [56,0.668209433555603,0.7108800411224365,0.9260295629501343,'00:00']\n",
2494 | "(#5) [57,0.6641027927398682,0.6710099577903748,0.9324270486831665,'00:00']\n",
2495 | "(#5) [58,0.6593616008758545,0.6422502398490906,0.9500200152397156,'00:00']\n",
2496 | "(#5) [59,0.6542106866836548,0.6377432346343994,0.955417811870575,'00:00']\n",
2497 | "(#5) [60,0.6484523415565491,0.6339776515960693,0.9510195851325989,'00:00']\n",
2498 | "(#5) [61,0.644486129283905,0.6318050026893616,0.952019214630127,'00:00']\n",
2499 | "(#5) [62,0.6407502889633179,0.6335462927818298,0.9556177258491516,'00:00']\n",
2500 | "(#5) [63,0.6358315944671631,0.6174135804176331,0.9604158401489258,'00:00']\n",
2501 | "(#5) [64,0.6297134160995483,0.6177477240562439,0.9582167267799377,'00:00']\n",
2502 | "(#5) [65,0.6263782382011414,0.6316858530044556,0.9578168988227844,'00:00']\n",
2503 | "(#5) [66,0.6240304112434387,0.6381304264068604,0.9510195851325989,'00:00']\n",
2504 | "(#5) [67,0.6210463643074036,0.611888587474823,0.9658136963844299,'00:00']\n",
2505 | "(#5) [68,0.6176733374595642,0.6020469069480896,0.9678128957748413,'00:00']\n",
2506 | "(#5) [69,0.6158297061920166,0.6315561532974243,0.9522191286087036,'00:00']\n",
2507 | "(#5) [70,0.6149362325668335,0.6047263741493225,0.9620152115821838,'00:00']\n",
2508 | "(#5) [71,0.6124557852745056,0.6052445769309998,0.9662135243415833,'00:00']\n",
2509 | "(#5) [72,0.61038738489151,0.6053462624549866,0.968012809753418,'00:00']\n",
2510 | "(#5) [73,0.6077246069908142,0.6012412309646606,0.9662135243415833,'00:00']\n",
2511 | "(#5) [74,0.6059748530387878,0.602819561958313,0.9620152115821838,'00:00']\n",
2512 | "(#5) [75,0.6060189008712769,0.6254074573516846,0.9528188705444336,'00:00']\n",
2513 | "(#5) [76,0.6049039959907532,0.6162943840026855,0.9560176134109497,'00:00']\n",
2514 | "(#5) [77,0.6030431389808655,0.612459659576416,0.9628148674964905,'00:00']\n",
2515 | "(#5) [78,0.6037601828575134,0.6142211556434631,0.9652138948440552,'00:00']\n",
2516 | "(#5) [79,0.6030499935150146,0.5827398896217346,0.9740104079246521,'00:00']\n",
2517 | "(#5) [80,0.6010799407958984,0.5872158408164978,0.9672130942344666,'00:00']\n",
2518 | "(#5) [81,0.5993661880493164,0.596929132938385,0.9646141529083252,'00:00']\n",
2519 | "(#5) [82,0.5993936061859131,0.6059935688972473,0.9658136963844299,'00:00']\n",
2520 | "(#5) [83,0.5977742671966553,0.5778101682662964,0.9784086346626282,'00:00']\n",
2521 | "(#5) [84,0.5968233942985535,0.5987315773963928,0.9688124656677246,'00:00']\n",
2522 | "(#5) [85,0.5966017842292786,0.5924776792526245,0.9712114930152893,'00:00']\n",
2523 | "(#5) [86,0.5972205400466919,0.5881239175796509,0.9746101498603821,'00:00']\n",
2524 | "(#5) [87,0.5951439142227173,0.5807530283927917,0.9750099778175354,'00:00']\n",
2525 | "(#5) [88,0.593777060508728,0.5950912833213806,0.9700120091438293,'00:00']\n",
2526 | "(#5) [89,0.5927764773368835,0.5824320912361145,0.9758096933364868,'00:00']\n",
2527 | "(#5) [90,0.5905457139015198,0.5850991010665894,0.9726109504699707,'00:00']\n",
2528 | "(#5) [91,0.5893580317497253,0.5762814879417419,0.9750099778175354,'00:00']\n",
2529 | "(#5) [92,0.5874578356742859,0.587800920009613,0.9716113805770874,'00:00']\n",
2530 | "(#5) [93,0.5864006280899048,0.5826623439788818,0.9740104079246521,'00:00']\n",
2531 | "(#5) [94,0.5843186378479004,0.5807972550392151,0.9748100638389587,'00:00']\n",
2532 | "(#5) [95,0.5833198428153992,0.5906395316123962,0.9726109504699707,'00:00']\n",
2533 | "(#5) [96,0.5830738544464111,0.579444169998169,0.9754098653793335,'00:00']\n",
2534 | "(#5) [97,0.5827361941337585,0.5899611115455627,0.9752098917961121,'00:00']\n",
2535 | "(#5) [98,0.581727147102356,0.5787261724472046,0.9784086346626282,'00:00']\n",
2536 | "(#5) [99,0.5807763934135437,0.6053228378295898,0.968012809753418,'00:00']\n",
2537 | "(#5) [100,0.5798343420028687,0.5681502223014832,0.9794082641601562,'00:00']\n",
2538 | "(#5) [101,0.578869104385376,0.5803552865982056,0.9802079200744629,'00:00']\n",
2539 | "(#5) [102,0.5786525011062622,0.567516565322876,0.9804078340530396,'00:00']\n",
2540 | "(#5) [103,0.5775110721588135,0.5640953779220581,0.9806077480316162,'00:00']\n",
2541 | "(#5) [104,0.5784242153167725,0.5768898725509644,0.9780088067054749,'00:00']\n",
2542 | "(#5) [105,0.5778679251670837,0.5790872573852539,0.9796081781387329,'00:00']\n",
2543 | "(#5) [106,0.577000617980957,0.577926516532898,0.9770091772079468,'00:00']\n",
2544 | "(#5) [107,0.5758468508720398,0.5667359232902527,0.9784086346626282,'00:00']\n",
2545 | "(#5) [108,0.5751124620437622,0.5644055008888245,0.9838064908981323,'00:00']\n",
2546 | "(#5) [109,0.5737295746803284,0.5599752068519592,0.9860056042671204,'00:00']\n",
2547 | "(#5) [110,0.5726966261863708,0.5690990090370178,0.9810075759887695,'00:00']\n",
2548 | "(#5) [111,0.5711759328842163,0.5684869289398193,0.9752098917961121,'00:00']\n",
2549 | "(#5) [112,0.5700328946113586,0.5709130167961121,0.9814074635505676,'00:00']\n",
2550 | "(#5) [113,0.5694721341133118,0.552615761756897,0.9878048896789551,'00:00']\n",
2551 | "(#5) [114,0.5714902877807617,0.576148271560669,0.9788084626197815,'00:00']\n",
2552 | "(#5) [115,0.5717239379882812,0.5633708238601685,0.9860056042671204,'00:00']\n",
2553 | "(#5) [116,0.5707281827926636,0.569799542427063,0.9778088927268982,'00:00']\n",
2554 | "(#5) [117,0.5702168941497803,0.5628139972686768,0.9848060607910156,'00:00']\n",
2555 | "(#5) [118,0.5693718791007996,0.5594673752784729,0.984006404876709,'00:00']\n",
2556 | "(#5) [119,0.5684109926223755,0.5623971819877625,0.9802079200744629,'00:00']\n",
2557 | "(#5) [120,0.5672259330749512,0.5607349872589111,0.9842063188552856,'00:00']\n",
2558 | "(#5) [121,0.5670547485351562,0.5714294910430908,0.9794082641601562,'00:00']\n",
2559 | "(#5) [122,0.5668333768844604,0.5649471879005432,0.9794082641601562,'00:00']\n",
2560 | "(#5) [123,0.5668005347251892,0.5851779580116272,0.9718112945556641,'00:00']\n",
2561 | "(#5) [124,0.566870927810669,0.5632203817367554,0.9816073775291443,'00:00']\n",
2562 | "(#5) [125,0.565920889377594,0.5729835033416748,0.9744102358818054,'00:00']\n",
2563 | "(#5) [126,0.5659525394439697,0.5674250721931458,0.9806077480316162,'00:00']\n",
2564 | "(#5) [127,0.5650352835655212,0.5610708594322205,0.9830067753791809,'00:00']\n",
2565 | "(#5) [128,0.564613938331604,0.5623105764389038,0.984606146812439,'00:00']\n",
2566 | "(#5) [129,0.5647157430648804,0.55865478515625,0.9854058623313904,'00:00']\n",
2567 | "(#5) [130,0.5645697712898254,0.5993083119392395,0.9706117510795593,'00:00']\n",
2568 | "(#5) [131,0.565568208694458,0.5671666860580444,0.9804078340530396,'00:00']\n",
2569 | "(#5) [132,0.5653231143951416,0.5493966937065125,0.9870051741600037,'00:00']\n",
2570 | "(#5) [133,0.5648764967918396,0.5556283593177795,0.985605776309967,'00:00']\n",
2571 | "(#5) [134,0.5649174451828003,0.5549166202545166,0.9838064908981323,'00:00']\n",
2572 | "(#5) [135,0.5645290613174438,0.5749046802520752,0.9778088927268982,'00:00']\n",
2573 | "(#5) [136,0.565645694732666,0.5631795525550842,0.984006404876709,'00:00']\n",
2574 | "(#5) [137,0.5666859745979309,0.5786696076393127,0.9794082641601562,'00:00']\n",
2575 | "(#5) [138,0.5665870308876038,0.5558186769485474,0.985205888748169,'00:00']\n",
2576 | "(#5) [139,0.5658290386199951,0.5618767142295837,0.9842063188552856,'00:00']\n",
2577 | "(#5) [140,0.5652888417243958,0.5540696382522583,0.9864054322242737,'00:00']\n",
2578 | "(#5) [141,0.5630706548690796,0.5586217045783997,0.985605776309967,'00:00']\n",
2579 | "(#5) [142,0.5613420605659485,0.5607969164848328,0.9838064908981323,'00:00']\n",
2580 | "(#5) [143,0.5607155561447144,0.5743324756622314,0.9766093492507935,'00:00']\n",
2581 | "(#5) [144,0.5607999563217163,0.5644251108169556,0.9806077480316162,'00:00']\n",
2582 | "(#5) [145,0.5603078603744507,0.5548836588859558,0.9874050617218018,'00:00']\n",
2583 | "(#5) [146,0.5598398447036743,0.5555053353309631,0.9854058623313904,'00:00']\n",
2584 | "(#5) [147,0.5588536858558655,0.5569325089454651,0.9832066893577576,'00:00']\n",
2585 | "(#5) [148,0.558508038520813,0.5557915568351746,0.984606146812439,'00:00']\n",
2586 | "(#5) [149,0.5573377013206482,0.5698828101158142,0.9798080921173096,'00:00']\n",
2587 | "(#5) [150,0.5562808513641357,0.5604540705680847,0.9830067753791809,'00:00']\n",
2588 | "(#5) [151,0.5560491681098938,0.5565154552459717,0.9858056902885437,'00:00']\n",
2589 | "(#5) [152,0.555692195892334,0.5495925545692444,0.9864054322242737,'00:00']\n",
2590 | "(#5) [153,0.5545212626457214,0.5462074875831604,0.9882047176361084,'00:00']\n",
2591 | "(#5) [154,0.5540472269058228,0.5547978281974792,0.985605776309967,'00:00']\n",
2592 | "(#5) [155,0.5545400977134705,0.5579161643981934,0.9828068614006042,'00:00']\n",
2593 | "(#5) [156,0.5541111826896667,0.5492957830429077,0.9876049757003784,'00:00']\n",
2594 | "(#5) [157,0.554722011089325,0.5495989322662354,0.9880048036575317,'00:00']\n",
2595 | "(#5) [158,0.554149329662323,0.5462068319320679,0.9878048896789551,'00:00']\n",
2596 | "(#5) [159,0.55352783203125,0.5653315782546997,0.9804078340530396,'00:00']\n",
2597 | "(#5) [160,0.5522112846374512,0.5523480772972107,0.9874050617218018,'00:00']\n",
2598 | "(#5) [161,0.55159991979599,0.5550404191017151,0.9844062328338623,'00:00']\n",
2599 | "(#5) [162,0.5511665940284729,0.5492388606071472,0.986805260181427,'00:00']\n",
2600 | "(#5) [163,0.5510576963424683,0.5596024990081787,0.9826069474220276,'00:00']\n",
2601 | "(#5) [164,0.5516799092292786,0.5612037181854248,0.9808076620101929,'00:00']\n",
2602 | "(#5) [165,0.5519921183586121,0.5492284893989563,0.9866053462028503,'00:00']\n",
2603 | "(#5) [166,0.5520929098129272,0.5504580140113831,0.985205888748169,'00:00']\n",
2604 | "(#5) [167,0.5511202216148376,0.543316662311554,0.9888044595718384,'00:00']\n",
2605 | "(#5) [168,0.5504035353660583,0.5465852618217468,0.9876049757003784,'00:00']\n",
2606 | "(#5) [169,0.5499338507652283,0.5408616662025452,0.9880048036575317,'00:00']\n",
2607 | "(#5) [170,0.5503076910972595,0.556277871131897,0.9896041750907898,'00:00']\n",
2608 | "(#5) [171,0.5507432222366333,0.5562807321548462,0.9854058623313904,'00:00']\n",
2609 | "(#5) [172,0.5507407188415527,0.545134961605072,0.989004373550415,'00:00']\n",
2610 | "(#5) [173,0.5501847267150879,0.5532421469688416,0.9836065769195557,'00:00']\n",
2611 | "(#5) [174,0.5497926473617554,0.5557788610458374,0.9874050617218018,'00:00']\n",
2612 | "(#5) [175,0.5488583445549011,0.5472760796546936,0.9876049757003784,'00:00']\n",
2613 | "(#5) [176,0.5484886169433594,0.5448355674743652,0.9876049757003784,'00:00']\n",
2614 | "(#5) [177,0.5478754639625549,0.5474599003791809,0.9888044595718384,'00:00']\n",
2615 | "(#5) [178,0.5466562509536743,0.5412596464157104,0.9896041750907898,'00:00']\n",
2616 | "(#5) [179,0.5458281636238098,0.5400437116622925,0.9894042611122131,'00:00']\n",
2617 | "(#5) [180,0.5453305840492249,0.5458052754402161,0.9892043471336365,'00:00']\n",
2618 | "(#5) [181,0.5455133318901062,0.5416017770767212,0.9902039170265198,'00:00']\n",
2619 | "(#5) [182,0.5449730157852173,0.5450880527496338,0.9880048036575317,'00:00']\n",
2620 | "(#5) [183,0.5440098643302917,0.5431408286094666,0.9902039170265198,'00:00']\n",
2621 | "(#5) [184,0.5439778566360474,0.5425741076469421,0.9898040890693665,'00:00']\n",
2622 | "(#5) [185,0.5435535907745361,0.5419609546661377,0.9902039170265198,'00:00']\n",
2623 | "(#5) [186,0.5427433848381042,0.5530862808227539,0.9858056902885437,'00:00']\n",
2624 | "(#5) [187,0.5430252552032471,0.5426696538925171,0.9878048896789551,'00:00']\n",
2625 | "(#5) [188,0.542786180973053,0.5475503206253052,0.9888044595718384,'00:00']\n",
2626 | "(#5) [189,0.5429360866546631,0.5423799157142639,0.9886045455932617,'00:00']\n",
2627 | "(#5) [190,0.5420181751251221,0.5406954288482666,0.9884046316146851,'00:00']\n",
2628 | "(#5) [191,0.541693389415741,0.5537710189819336,0.9850059747695923,'00:00']\n",
2629 | "(#5) [192,0.5415081977844238,0.5439608097076416,0.9860056042671204,'00:00']\n",
2630 | "(#5) [193,0.5406923294067383,0.5391072034835815,0.9894042611122131,'00:00']\n",
2631 | "(#5) [194,0.5400973558425903,0.5459045767784119,0.9880048036575317,'00:00']\n",
2632 | "(#5) [195,0.5401219129562378,0.543524980545044,0.9906037449836731,'00:00']\n",
2633 | "(#5) [196,0.5399553775787354,0.541273295879364,0.9888044595718384,'00:00']\n",
2634 | "(#5) [197,0.5396719574928284,0.5455816388130188,0.9886045455932617,'00:00']\n",
2635 | "(#5) [198,0.5399596691131592,0.5421000123023987,0.9894042611122131,'00:00']\n",
2636 | "(#5) [199,0.5399712324142456,0.5493955612182617,0.986805260181427,'00:00']\n",
2637 | "(#5) [200,0.5392962098121643,0.5414031147956848,0.9892043471336365,'00:00']\n",
2638 | "(#5) [201,0.5389527678489685,0.5390656590461731,0.9888044595718384,'00:00']\n",
2639 | "(#5) [202,0.5382970571517944,0.5321962237358093,0.9924030303955078,'00:00']\n",
2640 | "(#5) [203,0.5371732115745544,0.534155547618866,0.9916033744812012,'00:00']\n",
2641 | "(#5) [204,0.5368566513061523,0.5385439395904541,0.9902039170265198,'00:00']\n",
2642 | "(#5) [205,0.5365192294120789,0.5327334403991699,0.9922031164169312,'00:00']\n",
2643 | "(#5) [206,0.535795271396637,0.5338372588157654,0.9910035729408264,'00:00']\n",
2644 | "(#5) [207,0.535208523273468,0.5372083783149719,0.9924030303955078,'00:00']\n",
2645 | "(#5) [208,0.5353611707687378,0.5383073091506958,0.9908036589622498,'00:00']\n",
2646 | "(#5) [209,0.5352184772491455,0.5402861833572388,0.9874050617218018,'00:00']\n",
2647 | "(#5) [210,0.5352620482444763,0.5450273752212524,0.9860056042671204,'00:00']\n",
2648 | "(#5) [211,0.535393476486206,0.5433362722396851,0.9886045455932617,'00:00']\n",
2649 | "(#5) [212,0.5359456539154053,0.541436493396759,0.989004373550415,'00:00']\n",
2650 | "(#5) [213,0.5352783799171448,0.5332552790641785,0.9910035729408264,'00:00']\n",
2651 | "(#5) [214,0.5347485542297363,0.539842963218689,0.9906037449836731,'00:00']\n",
2652 | "(#5) [215,0.534434974193573,0.5338597893714905,0.9924030303955078,'00:00']\n",
2653 | "(#5) [216,0.5340366959571838,0.5342581868171692,0.9924030303955078,'00:00']\n",
2654 | "(#5) [217,0.5335840582847595,0.5312546491622925,0.9920032024383545,'00:00']\n",
2655 | "(#5) [218,0.5332886576652527,0.5379671454429626,0.9916033744812012,'00:00']\n",
2656 | "(#5) [219,0.5335736870765686,0.5378097891807556,0.9898040890693665,'00:00']\n",
2657 | "(#5) [220,0.533571183681488,0.5418524742126465,0.986805260181427,'00:00']\n",
2658 | "(#5) [221,0.5335400104522705,0.5394924879074097,0.989004373550415,'00:00']\n",
2659 | "(#5) [222,0.5335590839385986,0.5391682386398315,0.9900040030479431,'00:00']\n",
2660 | "(#5) [223,0.5331704020500183,0.5359265208244324,0.9920032024383545,'00:00']\n",
2661 | "(#5) [224,0.5333060622215271,0.530480146408081,0.9934026598930359,'00:00']\n",
2662 | "(#5) [225,0.5326299071311951,0.5330601930618286,0.9918032884597778,'00:00']\n",
2663 | "(#5) [226,0.5320948958396912,0.5376766324043274,0.9904038310050964,'00:00']\n",
2664 | "(#5) [227,0.5328490138053894,0.5391951203346252,0.9900040030479431,'00:00']\n",
2665 | "(#5) [228,0.5327755808830261,0.5370854139328003,0.9908036589622498,'00:00']\n",
2666 | "(#5) [229,0.5323711633682251,0.5374538898468018,0.9904038310050964,'00:00']\n",
2667 | "(#5) [230,0.5317545533180237,0.5384283065795898,0.9898040890693665,'00:00']\n",
2668 | "(#5) [231,0.5317268371582031,0.5422711968421936,0.9882047176361084,'00:00']\n",
2669 | "(#5) [232,0.5313385128974915,0.5312452912330627,0.9922031164169312,'00:00']\n",
2670 | "(#5) [233,0.5313094258308411,0.532535970211029,0.9920032024383545,'00:00']\n",
2671 | "(#5) [234,0.5317742824554443,0.5340278744697571,0.9912035465240479,'00:00']\n",
2672 | "(#5) [235,0.5316512584686279,0.5350274443626404,0.9912035465240479,'00:00']\n",
2673 | "(#5) [236,0.5315529108047485,0.5316570401191711,0.9916033744812012,'00:00']\n",
2674 | "(#5) [237,0.5308003425598145,0.5308747887611389,0.9912035465240479,'00:00']\n",
2675 | "(#5) [238,0.530122697353363,0.5298713445663452,0.9920032024383545,'00:00']\n",
2676 | "(#5) [239,0.5294141173362732,0.5307459831237793,0.9926029443740845,'00:00']\n",
2677 | "(#5) [240,0.5285311937332153,0.5317652225494385,0.9912035465240479,'00:00']\n",
2678 | "(#5) [241,0.5281766653060913,0.5291816592216492,0.9914034605026245,'00:00']\n",
2679 | "(#5) [242,0.5277355909347534,0.5302223563194275,0.9912035465240479,'00:00']\n",
2680 | "(#5) [243,0.5271890163421631,0.5335779190063477,0.9910035729408264,'00:00']\n",
2681 | "(#5) [244,0.527217447757721,0.5293419361114502,0.9916033744812012,'00:00']\n",
2682 | "(#5) [245,0.5270070433616638,0.5316809415817261,0.9924030303955078,'00:00']\n",
2683 | "(#5) [246,0.5267521142959595,0.5316113829612732,0.9916033744812012,'00:00']\n",
2684 | "(#5) [247,0.5263513922691345,0.5303942561149597,0.9918032884597778,'00:00']\n",
2685 | "(#5) [248,0.5258430242538452,0.532983124256134,0.9896041750907898,'00:00']\n",
2686 | "(#5) [249,0.5256255269050598,0.5318371653556824,0.9904038310050964,'00:00']\n",
2687 | "(#5) [250,0.5252947807312012,0.5299137234687805,0.9924030303955078,'00:00']\n",
2688 | "(#5) [251,0.5251561999320984,0.5319276452064514,0.9916033744812012,'00:00']\n",
2689 | "(#5) [252,0.5253430604934692,0.5330942869186401,0.9914034605026245,'00:00']\n",
2690 | "(#5) [253,0.5257636308670044,0.5319235920906067,0.9920032024383545,'00:00']\n",
2691 | "(#5) [254,0.5256302356719971,0.5319210886955261,0.9908036589622498,'00:00']\n",
2692 | "(#5) [255,0.5255649089813232,0.5295400023460388,0.9920032024383545,'00:00']\n",
2693 | "(#5) [256,0.5253782868385315,0.5343179702758789,0.9924030303955078,'00:00']\n",
2694 | "(#5) [257,0.5254818797111511,0.542191743850708,0.9900040030479431,'00:00']\n",
2695 | "(#5) [258,0.52579265832901,0.5292031764984131,0.9920032024383545,'00:00']\n",
2696 | "(#5) [259,0.5258984565734863,0.5322515368461609,0.9914034605026245,'00:00']\n",
2697 | "(#5) [260,0.5256097316741943,0.5314350128173828,0.9916033744812012,'00:00']\n",
2698 | "(#5) [261,0.52555251121521,0.5295942425727844,0.9918032884597778,'00:00']\n",
2699 | "(#5) [262,0.5255754590034485,0.5315802097320557,0.9916033744812012,'00:00']\n",
2700 | "(#5) [263,0.5250247716903687,0.5291919708251953,0.9920032024383545,'00:00']\n",
2701 | "(#5) [264,0.5245399475097656,0.5284217596054077,0.9924030303955078,'00:00']\n",
2702 | "(#5) [265,0.5241454839706421,0.5305991172790527,0.9916033744812012,'00:00']\n",
2703 | "(#5) [266,0.5236685276031494,0.531481146812439,0.9914034605026245,'00:00']\n",
2704 | "(#5) [267,0.523162841796875,0.5289321541786194,0.9914034605026245,'00:00']\n",
2705 | "(#5) [268,0.5231082439422607,0.5287920832633972,0.9926029443740845,'00:00']\n",
2706 | "(#5) [269,0.5227447152137756,0.5263374447822571,0.9930027723312378,'00:00']\n",
2707 | "(#5) [270,0.5228907465934753,0.5281500816345215,0.9928028583526611,'00:00']\n",
2708 | "(#5) [271,0.5229178667068481,0.5276056528091431,0.9934026598930359,'00:00']\n",
2709 | "(#5) [272,0.5229331254959106,0.5289475321769714,0.9916033744812012,'00:00']\n",
2710 | "(#5) [273,0.5228919386863708,0.5290558338165283,0.9920032024383545,'00:00']\n",
2711 | "(#5) [274,0.522659182548523,0.5261228680610657,0.9934026598930359,'00:00']\n",
2712 | "(#5) [275,0.5224993228912354,0.5274240970611572,0.9936025738716125,'00:00']\n",
2713 | "(#5) [276,0.5226684808731079,0.5325731635093689,0.9910035729408264,'00:00']\n",
2714 | "(#5) [277,0.5225193500518799,0.5268531441688538,0.9944022297859192,'00:00']\n",
2715 | "(#5) [278,0.5220715999603271,0.5294817686080933,0.9912035465240479,'00:00']\n",
2716 | "(#5) [279,0.5220339894294739,0.5287832021713257,0.9928028583526611,'00:00']\n",
2717 | "(#5) [280,0.5218959450721741,0.5279656648635864,0.9932027459144592,'00:00']\n",
2718 | "(#5) [281,0.5217199325561523,0.5258055925369263,0.9932027459144592,'00:00']\n",
2719 | "(#5) [282,0.5212569832801819,0.5274145007133484,0.9918032884597778,'00:00']\n",
2720 | "(#5) [283,0.5207387208938599,0.5302248001098633,0.9912035465240479,'00:00']\n",
2721 | "(#5) [284,0.5204330682754517,0.5275241732597351,0.9922031164169312,'00:00']\n",
2722 | "(#5) [285,0.5201017260551453,0.5263945460319519,0.9932027459144592,'00:00']\n",
2723 | "(#5) [286,0.5197675228118896,0.5265263319015503,0.9932027459144592,'00:00']\n",
2724 | "(#5) [287,0.5194923877716064,0.5269125699996948,0.9930027723312378,'00:00']\n",
2725 | "(#5) [288,0.5192520022392273,0.5275761485099792,0.9926029443740845,'00:00']\n",
2726 | "(#5) [289,0.5192333459854126,0.5261156558990479,0.9926029443740845,'00:00']\n",
2727 | "(#5) [290,0.5192663073539734,0.5256569981575012,0.9928028583526611,'00:00']\n",
2728 | "(#5) [291,0.5191482305526733,0.5259803533554077,0.9930027723312378,'00:00']\n",
2729 | "(#5) [292,0.5193918943405151,0.5255590677261353,0.9940024018287659,'00:00']\n",
2730 | "(#5) [293,0.5195315480232239,0.5252060890197754,0.9934026598930359,'00:00']\n",
2731 | "(#5) [294,0.5194035172462463,0.5247570276260376,0.9928028583526611,'00:00']\n",
2732 | "(#5) [295,0.5192937254905701,0.5267224907875061,0.9922031164169312,'00:00']\n",
2733 | "(#5) [296,0.5190075635910034,0.526543140411377,0.9924030303955078,'00:00']\n",
2734 | "(#5) [297,0.5186933279037476,0.5270529389381409,0.9920032024383545,'00:00']\n",
2735 | "(#5) [298,0.5185025334358215,0.5268010497093201,0.9926029443740845,'00:00']\n",
2736 | "(#5) [299,0.5186411738395691,0.5280489921569824,0.9916033744812012,'00:00']\n",
2737 | "(#5) [300,0.5186982154846191,0.5278685688972473,0.9916033744812012,'00:00']\n",
2738 | "(#5) [301,0.5186182856559753,0.5262508988380432,0.9926029443740845,'00:00']\n",
2739 | "(#5) [302,0.5183812975883484,0.526432454586029,0.9926029443740845,'00:00']\n",
2740 | "(#5) [303,0.5183549523353577,0.5261136293411255,0.9926029443740845,'00:00']\n",
2741 | "(#5) [304,0.518186092376709,0.5252718925476074,0.9920032024383545,'00:00']\n",
2742 | "(#5) [305,0.5180179476737976,0.5258474946022034,0.9926029443740845,'00:00']\n",
2743 | "(#5) [306,0.5177079439163208,0.5257453322410583,0.9916033744812012,'00:00']\n",
2744 | "(#5) [307,0.5174733996391296,0.5270876288414001,0.9918032884597778,'00:00']\n",
2745 | "(#5) [308,0.5172706842422485,0.5257407426834106,0.9928028583526611,'00:00']\n",
2746 | "(#5) [309,0.517080545425415,0.525310754776001,0.9922031164169312,'00:00']\n",
2747 | "(#5) [310,0.5169222354888916,0.5248811841011047,0.9930027723312378,'00:00']\n",
2748 | "(#5) [311,0.5169236660003662,0.526151180267334,0.9932027459144592,'00:00']\n",
2749 | "(#5) [312,0.5166144967079163,0.5257360339164734,0.9924030303955078,'00:00']\n",
2750 | "(#5) [313,0.5164701342582703,0.5272460579872131,0.9928028583526611,'00:00']\n",
2751 | "(#5) [314,0.5162502527236938,0.5268305540084839,0.9932027459144592,'00:00']\n",
2752 | "(#5) [315,0.516147792339325,0.5260716080665588,0.9922031164169312,'00:00']\n",
2753 | "(#5) [316,0.5161650776863098,0.5268478989601135,0.9922031164169312,'00:00']\n",
2754 | "(#5) [317,0.5160204172134399,0.526618242263794,0.9922031164169312,'00:00']\n",
2755 | "(#5) [318,0.5157511830329895,0.5245882868766785,0.9936025738716125,'00:00']\n",
2756 | "(#5) [319,0.5154873728752136,0.5243923664093018,0.9936025738716125,'00:00']\n",
2757 | "(#5) [320,0.515476644039154,0.5248814821243286,0.9934026598930359,'00:00']\n",
2758 | "(#5) [321,0.5154152512550354,0.5243255496025085,0.9936025738716125,'00:00']\n",
2759 | "(#5) [322,0.5153467655181885,0.5241288542747498,0.9930027723312378,'00:00']\n",
2760 | "(#5) [323,0.5151672959327698,0.5247509479522705,0.9936025738716125,'00:00']\n",
2761 | "(#5) [324,0.5150103569030762,0.5252503752708435,0.9926029443740845,'00:00']\n",
2762 | "(#5) [325,0.5150166153907776,0.5245863795280457,0.9926029443740845,'00:00']\n",
2763 | "(#5) [326,0.5149470567703247,0.5261703729629517,0.9926029443740845,'00:00']\n",
2764 | "(#5) [327,0.5149006247520447,0.5248196721076965,0.9934026598930359,'00:00']\n",
2765 | "(#5) [328,0.5146340727806091,0.5249042510986328,0.9936025738716125,'00:00']\n",
2766 | "(#5) [329,0.5145626068115234,0.5241353511810303,0.9938024878501892,'00:00']\n",
2767 | "(#5) [330,0.5144791007041931,0.5234629511833191,0.9938024878501892,'00:00']\n",
2768 | "(#5) [331,0.5145208239555359,0.5243208408355713,0.9938024878501892,'00:00']\n",
2769 | "(#5) [332,0.5144168138504028,0.5242570042610168,0.9938024878501892,'00:00']\n",
2770 | "(#5) [333,0.514085590839386,0.5246111154556274,0.9930027723312378,'00:00']\n",
2771 | "(#5) [334,0.5142087340354919,0.5246843695640564,0.9934026598930359,'00:00']\n",
2772 | "(#5) [335,0.5140172839164734,0.5252116918563843,0.9926029443740845,'00:00']\n",
2773 | "(#5) [336,0.5141299962997437,0.5249341726303101,0.9932027459144592,'00:00']\n",
2774 | "(#5) [337,0.5141574740409851,0.5235794186592102,0.9936025738716125,'00:00']\n",
2775 | "(#5) [338,0.5140243768692017,0.52287757396698,0.9940024018287659,'00:00']\n",
2776 | "(#5) [339,0.5140059590339661,0.5242075324058533,0.9934026598930359,'00:00']\n",
2777 | "(#5) [340,0.5139784812927246,0.5232439041137695,0.9942023158073425,'00:00']\n",
2778 | "(#5) [341,0.5138511657714844,0.5233055353164673,0.9940024018287659,'00:00']\n",
2779 | "(#5) [342,0.5136136412620544,0.5236180424690247,0.9940024018287659,'00:00']\n",
2780 | "(#5) [343,0.5135014653205872,0.5222076177597046,0.9940024018287659,'00:00']\n",
2781 | "(#5) [344,0.5134781002998352,0.5232444405555725,0.9938024878501892,'00:00']\n",
2782 | "(#5) [345,0.5134434700012207,0.5227674841880798,0.9938024878501892,'00:00']\n",
2783 | "(#5) [346,0.5133272409439087,0.5238898992538452,0.9932027459144592,'00:00']\n",
2784 | "(#5) [347,0.5129953026771545,0.5243415236473083,0.9932027459144592,'00:00']\n",
2785 | "(#5) [348,0.5129275321960449,0.5239620804786682,0.9932027459144592,'00:00']\n",
2786 | "(#5) [349,0.512813925743103,0.5245627164840698,0.9934026598930359,'00:00']\n",
2787 | "(#5) [350,0.5126359462738037,0.523507833480835,0.9932027459144592,'00:00']\n",
2788 | "(#5) [351,0.5127357840538025,0.5234606266021729,0.9934026598930359,'00:00']\n",
2789 | "(#5) [352,0.5127506256103516,0.5231567025184631,0.9930027723312378,'00:00']\n",
2790 | "(#5) [353,0.5126528739929199,0.5234667658805847,0.9932027459144592,'00:00']\n",
2791 | "(#5) [354,0.5126602649688721,0.5228467583656311,0.9936025738716125,'00:00']\n",
2792 | "(#5) [355,0.5125593543052673,0.5229310393333435,0.9938024878501892,'00:00']\n",
2793 | "(#5) [356,0.5124865174293518,0.523015022277832,0.9938024878501892,'00:00']\n",
2794 | "(#5) [357,0.5122842192649841,0.5228272676467896,0.9934026598930359,'00:00']\n",
2795 | "(#5) [358,0.5121994614601135,0.5237144827842712,0.9934026598930359,'00:00']\n",
2796 | "(#5) [359,0.5121628642082214,0.5244333148002625,0.9932027459144592,'00:00']\n",
2797 | "(#5) [360,0.512198805809021,0.5242804884910583,0.9932027459144592,'00:00']\n",
2798 | "(#5) [361,0.5121768116950989,0.5238335132598877,0.9932027459144592,'00:00']\n",
2799 | "(#5) [362,0.5121279358863831,0.5237452387809753,0.9932027459144592,'00:00']\n",
2800 | "(#5) [363,0.5121635794639587,0.523725688457489,0.9934026598930359,'00:00']\n",
2801 | "(#5) [364,0.5119736790657043,0.5238353610038757,0.9928028583526611,'00:00']\n",
2802 | "(#5) [365,0.5118523240089417,0.5235882997512817,0.9930027723312378,'00:00']\n",
2803 | "(#5) [366,0.5117815732955933,0.5234648585319519,0.9930027723312378,'00:00']\n",
2804 | "(#5) [367,0.511821448802948,0.5232802629470825,0.9932027459144592,'00:00']\n",
2805 | "(#5) [368,0.5116668343544006,0.523810863494873,0.9930027723312378,'00:00']\n",
2806 | "(#5) [369,0.5117686986923218,0.5233906507492065,0.9930027723312378,'00:00']\n",
2807 | "(#5) [370,0.5117844343185425,0.5235735774040222,0.9932027459144592,'00:00']\n",
2808 | "(#5) [371,0.5117461085319519,0.5234304070472717,0.9930027723312378,'00:00']\n",
2809 | "(#5) [372,0.5117005109786987,0.5234314203262329,0.9930027723312378,'00:00']\n",
2810 | "(#5) [373,0.5116655230522156,0.5242964625358582,0.9930027723312378,'00:00']\n",
2811 | "(#5) [374,0.5116093158721924,0.5237722992897034,0.9930027723312378,'00:00']\n",
2812 | "(#5) [375,0.5116337537765503,0.5233075022697449,0.9932027459144592,'00:00']\n",
2813 | "(#5) [376,0.5115463733673096,0.5234260559082031,0.9932027459144592,'00:00']\n",
2814 | "(#5) [377,0.5115786194801331,0.5230952501296997,0.9932027459144592,'00:00']\n",
2815 | "(#5) [378,0.5115038752555847,0.5232494473457336,0.9932027459144592,'00:00']\n",
2816 | "(#5) [379,0.511390209197998,0.5234609842300415,0.9930027723312378,'00:00']\n",
2817 | "(#5) [380,0.5111578702926636,0.5234550833702087,0.9930027723312378,'00:00']\n",
2818 | "(#5) [381,0.511075496673584,0.5234181880950928,0.9928028583526611,'00:00']\n",
2819 | "(#5) [382,0.5110391974449158,0.5233864188194275,0.9930027723312378,'00:00']\n",
2820 | "(#5) [383,0.5111837983131409,0.5232412815093994,0.9930027723312378,'00:00']\n",
2821 | "(#5) [384,0.5110808610916138,0.5232195854187012,0.9930027723312378,'00:00']\n",
2822 | "(#5) [385,0.5110124945640564,0.523213803768158,0.9930027723312378,'00:00']\n",
2823 | "(#5) [386,0.5111136436462402,0.5232985019683838,0.9930027723312378,'00:00']\n",
2824 | "(#5) [387,0.5110445022583008,0.5233603715896606,0.9930027723312378,'00:00']\n",
2825 | "(#5) [388,0.5110945105552673,0.523431122303009,0.9930027723312378,'00:00']\n",
2826 | "(#5) [389,0.5110653638839722,0.5233187079429626,0.9930027723312378,'00:00']\n",
2827 | "(#5) [390,0.511041522026062,0.5233006477355957,0.9930027723312378,'00:00']\n",
2828 | "(#5) [391,0.51111900806427,0.5233792662620544,0.9930027723312378,'00:00']\n",
2829 | "(#5) [392,0.5112746953964233,0.5233858823776245,0.9930027723312378,'00:00']\n",
2830 | "(#5) [393,0.5111038684844971,0.5233259201049805,0.9930027723312378,'00:00']\n",
2831 | "(#5) [394,0.5110563635826111,0.5232934951782227,0.9930027723312378,'00:00']\n",
2832 | "(#5) [395,0.5111752152442932,0.5232762098312378,0.9930027723312378,'00:00']\n",
2833 | "(#5) [396,0.511090099811554,0.5232969522476196,0.9930027723312378,'00:00']\n",
2834 | "(#5) [397,0.51102614402771,0.523305356502533,0.9930027723312378,'00:00']\n",
2835 | "(#5) [398,0.5111712217330933,0.5232568383216858,0.9930027723312378,'00:00']\n",
2836 | "(#5) [399,0.5110330581665039,0.5233137011528015,0.9930027723312378,'00:00']\n",
2837 | "Highest accuracy of: 0.9944022297859192 at epoch 278\n"
2838 | ],
2839 | "name": "stdout"
2840 | }
2841 | ]
2842 | },
2843 | {
2844 | "cell_type": "code",
2845 | "metadata": {
2846 | "id": "_2quWIkeTnOf",
2847 | "colab_type": "code",
2848 | "colab": {}
2849 | },
2850 | "source": [
2851 | "avgs = np.array([99.48,99.46,99.44,99.4,99.44])\n",
2852 | "epchs = np.array([331,323,267,298,278])"
2853 | ],
2854 | "execution_count": 0,
2855 | "outputs": []
2856 | },
2857 | {
2858 | "cell_type": "code",
2859 | "metadata": {
2860 | "id": "LJYK9cqGhKbS",
2861 | "colab_type": "code",
2862 | "colab": {
2863 | "base_uri": "https://localhost:8080/",
2864 | "height": 85
2865 | },
2866 | "outputId": "38bc66c2-8891-4099-a0f4-0b08cbded32e"
2867 | },
2868 | "source": [
2869 | "print(f\"Average Accuracy: {avgs.mean()}\\nAccuracy Stdv: {avgs.std()}\\n\\\n",
2870 | "Average Total Epochs: {epchs.mean()}\\nEpcohs Stdv: {epchs.std()}\")"
2871 | ],
2872 | "execution_count": 131,
2873 | "outputs": [
2874 | {
2875 | "output_type": "stream",
2876 | "text": [
2877 | "Average Accuracy: 99.44399999999999\n",
2878 | "Accuracy Stdv: 0.026532998322841776\n",
2879 | "Average Total Epochs: 299.4\n",
2880 | "Epcohs Stdv: 24.759644585494357\n"
2881 | ],
2882 | "name": "stdout"
2883 | }
2884 | ]
2885 | }
2886 | ]
2887 | }
2888 |
--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
1 | # fastai2 Tabular Baseline
2 |
3 | The following repository has a few tested baselines for tabular datasets outside of the two `fastai` uses (Rossmann and ADULTs).
4 | Along with these include a few popular techniques also used, and how `fastai` compares.
5 |
6 |
7 | [Poker Hand Induction](https://www.kaggle.com/c/poker-rule-induction)
8 |
9 | | Model | Test Accuracy (%) |
10 | |:-------------------------:|:-----------------:|
11 | | Decision Tree | 50% |
12 | | Multi-layer perceptron | 50% |
13 | | Deep Neural Decision Tree | 65.1% |
14 | | TabNet | 99.3% |
15 | | **fastai2** | **99.44%** |
16 |
17 | Credit to Fabio Barros for the idea of treating the numerical cards as both categorical and continuous.
18 |
19 | [Sarcos Robotics Arm Inverse Dynamics](http://www.gaussianprocess.org/gpml/data/)
20 |
21 | | Model | MSE | Number of Parameters |
22 | |:-----------------------------:|:-----:|:--------------------:|
23 | | Random Forest | 2.39 | 16.7K |
24 | | Stochastic Decision Tree | 2.11 | 28K |
25 | | Multi-Layer Perceptron | 2.13 | 0.14M |
26 | | Adaptive Neural Tree Ensemble | 1.23 | 0.60M |
27 | | Gradient Boosted Tree | 1.44 | 0.99M |
28 | | TabNet-S | 1.25 | 6.3K |
29 | | TabNet-M | 0.28 | 590K |
30 | | TabNet-L | 0.14 | 1.75M |
31 | | **fastai2** | **0.038** | **530K** | * Needs to be looked at again,
32 |
33 | [Higgs Boson](https://archive.ics.uci.edu/ml/datasets/HIGGS)
34 |
35 | | Model | Test Accuracy (%) | Number of Parameters |
36 | |:--------------------------------------------------:|:-----------------:|:--------------------:|
37 | | **Sparse evolutionary trained multi-layer perceptron** | **78.47** | **81K** |
38 | | Gradient boosted tree - S | 74.22 | 120K |
39 | | Gradient boosted tree - M | 75.97 | 690K |
40 | | Multi-layer perceptron | 78.44 | 2.04M |
41 | | Gradient boosted tree - L | 76.98 | 6.96M |
42 | | TabNet - S | 78.25 | 81K |
43 | | **TabNet - M** | **78.84** | **660K** |
44 | | **fastai2** | **76.94** | **530K** |
45 |
--------------------------------------------------------------------------------