├── README.md ├── __init__.py ├── auglib ├── __init__.py ├── augmentation │ ├── __init__.py │ ├── augmentations.py │ ├── inception_crop.py │ ├── tps │ │ ├── __init__.py │ │ ├── tps_warp.py │ │ └── warp_image.py │ └── two_lesions.py ├── dataset_loader.py ├── meters.py └── test.py ├── requirements.txt ├── splits ├── split_task3_testsubmission_challenge.txt ├── split_task3_train_full_1.txt ├── split_task3_train_full_2.txt ├── split_task3_train_full_3.txt ├── split_task3_train_full_4.txt ├── split_task3_train_full_5.txt ├── split_task3_train_only_1.txt ├── split_task3_train_only_2.txt ├── split_task3_train_only_3.txt ├── split_task3_train_only_4.txt ├── split_task3_train_only_5.txt ├── split_task3_validation_challenge.txt ├── split_task3_validation_full_1.txt ├── split_task3_validation_full_2.txt ├── split_task3_validation_full_3.txt ├── split_task3_validation_full_4.txt ├── split_task3_validation_full_5.txt ├── split_task3_validation_only_1.txt ├── split_task3_validation_only_2.txt ├── split_task3_validation_only_3.txt ├── split_task3_validation_only_4.txt └── split_task3_validation_only_5.txt ├── test.py └── train.py /README.md: -------------------------------------------------------------------------------- 1 | # ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection: Task 3 2 | 3 | This project contains the source code used for the RECOD Titan's submission to ISIC 4 | 2018: Skin Lesion Analysis Towards Melanoma Detection (Task 3). This project was 5 | forked from the [source](https://github.com/fabioperez/skin-data-augmentation) 6 | of the paper 'Data Augmentation for Skin Lesion Analysis'. 7 | 8 | ## Project setup 9 | 10 | 1. Install OpenCV with `pip3 install opencv-python`. 11 | 2. Run `pip3 install -r requirements.txt`. 12 | 3. Download data from [ISIC 2017: Skin Lesion Analysis Towards Melanoma 13 | Detection](https://challenge.kitware.com/#challenge/583f126bcad3a51cc66c8d9a). 14 | 15 | 16 | ## Train 17 | 18 | The project uses [Sacred](http://sacred.readthedocs.io) to organize the 19 | experiments. The main script for training is in the `train.py` file. Check the 20 | available settings by running `python3 train.py print_config`. 21 | 22 | Possible values for `model_names`: `resnet152`, `inceptionv4`, `densenet161`. 23 | 24 | #### Example: training ResNet-152 with split 1 25 | 26 | ``` 27 | TRAIN_ROOT=/path/to/dataset/images 28 | TRAIN_CSV=splits/split_task3_train_full_1.txt 29 | VAL_ROOT=/path/to/dataset/images 30 | VAL_CSV=splits/split_task3_validation.txt 31 | 32 | python3 train.py with \ 33 | train_root=$TRAIN_ROOT train_csv=$TRAIN_CSV \ 34 | val_root=$VAL_ROOT val_csv=$VAL_CSV \ 35 | model_name='resnet152' \ 36 | 'aug={"color_contrast": 0.3, "color_saturation": 0.3, "color_brightness": 0.3, "color_hue": 0.1, "rotation": 90, "scale": (0.8, 1.2), "shear": 20, "vflip": True, "hflip": True, "random_crop": True}' \ 37 | weighted_loss=True \ 38 | --name resnet152-split-1 39 | ``` 40 | 41 | If everything goes well, Sacred will create a directory with a unique ID inside 42 | `results` (e.g. `results/1` for the first run). Inside this directory, you will 43 | find: 44 | 45 | * `config.json`: Sacred configuration used in training. 46 | * `cout.txt`: Entire stdout produced during the training. 47 | * `run.json`: General metadata of the training. 48 | * `train.csv`: CSV with metrics on train set. 49 | * `val.csv`: CSV with metrics on validation set. 50 | * `checkpoints/model_best.pth`: model with the best validation AUC. 51 | * `checkpoints/model_last.pth`: model as in the last epoch. 52 | 53 | ### Telegram API 54 | 55 | If you want to monitor the experiments with Telegram (receive a message when 56 | the experiments start, finish, or fail), create a file `telegram.json` at the 57 | root of the project: 58 | 59 | ``` 60 | $ cat telegram.json 61 | { 62 | "token": "00000000:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX", 63 | "chat_id": "00000000" 64 | } 65 | ``` 66 | 67 | To configure the Telegram API, check 68 | [this](https://stackoverflow.com/questions/32423837/telegram-bot-how-to-get-a-group-chat-id). 69 | 70 | 71 | ## Test 72 | 73 | Each model file (i.e, `model_best.pth` or `model_last.pth`) contains the 74 | PyTorch model, weights, and augmentation configuration (accessed through 75 | `model.aug_params`). To load the model, use `torch.load`. 76 | 77 | The `test.py` file will automatically infer the augmentation settings from the 78 | model. Run `python3 test.py --help` to check all available options. 79 | 80 | #### Example: get predictions for test set 81 | 82 | ``` 83 | TEST_ROOT=/path/to/dataset/images 84 | TEST_CSV=splits/split_task3_testsubmission_challenge.txt 85 | python3 test.py results//checkpoints/model_best.pth $TEST_ROOT $TEST_CSV -n 128 --output results_test.csv 86 | ``` 87 | -------------------------------------------------------------------------------- /__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/learningtitans/isic2018-part3/2fa6c770b690ed4ebc6fb8206555aa260b09fe1b/__init__.py -------------------------------------------------------------------------------- /auglib/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/learningtitans/isic2018-part3/2fa6c770b690ed4ebc6fb8206555aa260b09fe1b/auglib/__init__.py -------------------------------------------------------------------------------- /auglib/augmentation/__init__.py: -------------------------------------------------------------------------------- 1 | from .augmentations import Augmentations, set_seeds 2 | from .inception_crop import InceptionCrop 3 | -------------------------------------------------------------------------------- /auglib/augmentation/augmentations.py: -------------------------------------------------------------------------------- 1 | import math 2 | import random 3 | 4 | from imgaug import augmenters as iaa 5 | import imgaug as ia 6 | import numpy as np 7 | import PIL 8 | import torch 9 | from torchvision import transforms 10 | 11 | from .tps.tps_warp import tps_warp 12 | from .inception_crop import InceptionCrop 13 | 14 | 15 | def set_seeds(worker_id): 16 | """ 17 | Set random seeds. Used for setting different seeds for each 18 | worker created by DataLoader. 19 | """ 20 | seed = torch.initial_seed() % 2**31 21 | ia.seed(seed + 1) 22 | np.random.seed(seed + 2) 23 | random.seed(seed + 3) 24 | 25 | 26 | class RandomErasing: 27 | ''' 28 | Class that performs Random Erasing in Random Erasing Data Augmentation by 29 | Zhong et al. 30 | 31 | Modified from https://github.com/zhunzhong07/Random-Erasing 32 | 33 | Args: 34 | probability: The probability that the operation will be performed. 35 | sl: min erasing area 36 | sh: max erasing area 37 | r1: min aspect ratio 38 | ''' 39 | def __init__(self, probability=0.5, sl=0.02, sh=0.4, r1=0.3): 40 | self.probability = probability 41 | self.sl = sl 42 | self.sh = sh 43 | self.r1 = r1 44 | 45 | def __call__(self, img): 46 | if random.uniform(0, 1) > self.probability: 47 | return img 48 | 49 | for attempt in range(10): 50 | area = img.shape[0] * img.shape[1] 51 | 52 | target_area = random.uniform(self.sl, self.sh) * area 53 | aspect_ratio = random.uniform(self.r1, 1/self.r1) 54 | 55 | h = int(round(math.sqrt(target_area * aspect_ratio))) 56 | w = int(round(math.sqrt(target_area / aspect_ratio))) 57 | 58 | if w < img.shape[1] and h < img.shape[0]: 59 | x1 = random.randint(0, img.shape[0] - h) 60 | y1 = random.randint(0, img.shape[1] - w) 61 | if img.shape[2] == 3: 62 | img[x1:x1+h, y1:y1+w, :] = np.random.rand(h, w, 3)*255. 63 | else: 64 | img[x1:x1+h, y1:y1+w, 0] = np.random.rand(h, w, 1)*255. 65 | return img 66 | 67 | return img 68 | 69 | 70 | class Augmentations: 71 | def __init__(self, **augs): 72 | self.mean = augs['mean'] 73 | self.std = augs['std'] 74 | self.size = augs['size'] 75 | 76 | tf_list = [] 77 | 78 | if not augs['scale']: 79 | augs['scale'] = 1.0 80 | 81 | affine = iaa.Affine( 82 | rotate=(-augs['rotation'], augs['rotation']), 83 | shear=(-augs['shear'], augs['shear']), 84 | scale=({'x': augs['scale'], 'y': augs['scale']}), 85 | mode='symmetric') 86 | 87 | piecewise_affine = iaa.PiecewiseAffine( 88 | scale=(0.0, 0.1), nb_rows=4, nb_cols=4, 89 | mode='symmetric') 90 | 91 | if augs['random_crop']: 92 | tf_list.append(transforms.RandomResizedCrop( 93 | augs['size'], scale=(0.4, 1.0))) 94 | else: 95 | tf_list.append(transforms.Resize((augs['size'], augs['size']))) 96 | tf_list.append(lambda x: np.array(x)) 97 | if augs['random_erasing']: 98 | tf_list.append(RandomErasing(sh=0.3)) 99 | if augs['rotation'] or augs['shear'] or augs['scale'] != 1.0: 100 | tf_list.append(lambda x: affine.augment_image(x)) 101 | if augs['piecewise_affine']: 102 | tf_list.append(lambda x: piecewise_affine.augment_image(x)) 103 | if augs['tps']: 104 | tf_list.append(lambda x: tps_warp(x, 4, 0.1)) 105 | tf_list.append(lambda x: PIL.Image.fromarray(x)) 106 | if augs['hflip']: 107 | tf_list.append(transforms.RandomHorizontalFlip()) 108 | if augs['vflip']: 109 | tf_list.append(transforms.RandomVerticalFlip()) 110 | if (augs['color_saturation'] or augs['color_contrast'] 111 | or augs['color_brightness'] or augs['color_hue']): 112 | tf_list.append(transforms.ColorJitter( 113 | brightness=augs['color_brightness'], 114 | contrast=augs['color_contrast'], 115 | saturation=augs['color_saturation'], 116 | hue=augs['color_hue'])) 117 | 118 | tf_list.append(transforms.ToTensor()) 119 | self.tf_augment = transforms.Compose(tf_list) 120 | self.tf_transform = transforms.Compose([ 121 | self.tf_augment, 122 | transforms.Normalize(augs['mean'], augs['std']) 123 | ]) 124 | self.no_augmentation = transforms.Compose([ 125 | transforms.Resize((augs['size'], augs['size'])), 126 | transforms.ToTensor(), 127 | transforms.Normalize(augs['mean'], augs['std']) 128 | ]) 129 | self.ten_crop = self._get_crop_transform('ten') 130 | self.inception_crop = self._get_crop_transform('inception') 131 | 132 | def seed(self, seed): 133 | ia.seed(seed + 1 % 2**32) 134 | np.random.seed(seed + 1 % 2**32) 135 | random.seed(seed + 1 % 2**32) 136 | 137 | def _get_crop_transform(self, method): 138 | if method == 'ten': 139 | crop_tf = transforms.Compose([ 140 | transforms.Resize((self.size + 32, self.size + 32)), 141 | transforms.TenCrop((self.size, self.size)) 142 | ]) 143 | if method == 'inception': 144 | crop_tf = InceptionCrop( 145 | self.size, 146 | resizes=tuple(range(self.size + 32, self.size + 129, 32)) 147 | ) 148 | after_crop = transforms.Compose([ 149 | transforms.ToTensor(), 150 | transforms.Normalize(self.mean, self.std), 151 | ]) 152 | return transforms.Compose([ 153 | crop_tf, 154 | transforms.Lambda( 155 | lambda crops: torch.stack( 156 | [after_crop(crop) for crop in crops])) 157 | ]) 158 | -------------------------------------------------------------------------------- /auglib/augmentation/inception_crop.py: -------------------------------------------------------------------------------- 1 | from PIL import Image 2 | from torchvision.transforms import Resize, TenCrop 3 | 4 | 5 | def _inception_crop(img, size, resizes=(256, 288, 320, 352)): 6 | resized = [Resize(size_)(img) for size_ in resizes] 7 | results = [] 8 | for resized_img in resized: 9 | w, h = resized_img.size 10 | if w < h: 11 | t1 = resized_img.crop((0, 0, w, w)) 12 | t2 = resized_img.crop((0, h/2 - w/2, w, h/2 + w/2)) 13 | t3 = resized_img.crop((0, h-w, w, h)) 14 | else: 15 | t1 = resized_img.crop((0, 0, h, h)) 16 | t2 = resized_img.crop((w/2 - h/2, 0, w/2 + h/2, h)) 17 | t3 = resized_img.crop((w-h, 0, w, h)) 18 | 19 | for square in (t1, t2, t3): 20 | resized_square = Resize(size)(square) 21 | results.append(resized_square) 22 | results.append(resized_square.transpose(Image.FLIP_LEFT_RIGHT)) 23 | results += TenCrop(size)(square) 24 | 25 | return results 26 | 27 | 28 | class InceptionCrop(object): 29 | def __init__(self, size, resizes): 30 | self.size = size 31 | self.resizes = resizes 32 | 33 | def __call__(self, img): 34 | return _inception_crop(img, self.size, self.resizes) 35 | -------------------------------------------------------------------------------- /auglib/augmentation/tps/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/learningtitans/isic2018-part3/2fa6c770b690ed4ebc6fb8206555aa260b09fe1b/auglib/augmentation/tps/__init__.py -------------------------------------------------------------------------------- /auglib/augmentation/tps/tps_warp.py: -------------------------------------------------------------------------------- 1 | import numpy as np 2 | 3 | from .warp_image import warp_images 4 | 5 | 6 | def _get_regular_grid(image, points_per_dim): 7 | nrows, ncols = image.shape[0], image.shape[1] 8 | rows = np.linspace(0, nrows, points_per_dim) 9 | cols = np.linspace(0, ncols, points_per_dim) 10 | rows, cols = np.meshgrid(rows, cols) 11 | return np.dstack([cols.flat, rows.flat])[0] 12 | 13 | 14 | def _generate_random_vectors(image, src_points, scale): 15 | dst_pts = src_points + np.random.uniform(-scale, scale, src_points.shape) 16 | return dst_pts 17 | 18 | 19 | def _thin_plate_spline_warp(image, src_points, dst_points, keep_corners=True): 20 | width, height = image.shape[:2] 21 | if keep_corners: 22 | corner_points = np.array( 23 | [[0, 0], [0, width], [height, 0], [height, width]]) 24 | src_points = np.concatenate((src_points, corner_points)) 25 | dst_points = np.concatenate((dst_points, corner_points)) 26 | out = warp_images(src_points, dst_points, 27 | np.moveaxis(image, 2, 0), 28 | (0, 0, width - 1, height - 1)) 29 | return np.moveaxis(np.array(out), 0, 2) 30 | 31 | 32 | def tps_warp(image, points_per_dim, scale): 33 | width, height = image.shape[:2] 34 | src = _get_regular_grid(image, points_per_dim=points_per_dim) 35 | dst = _generate_random_vectors(image, src, scale=scale*width) 36 | out = _thin_plate_spline_warp(image, src, dst) 37 | return out 38 | -------------------------------------------------------------------------------- /auglib/augmentation/tps/warp_image.py: -------------------------------------------------------------------------------- 1 | # Copyright 2007 Zachary Pincus 2 | # This file is part of CellTool. 3 | # 4 | # CellTool is free software; you can redistribute it and/or modify 5 | # it under the terms of version 2 of the GNU General Public License as 6 | # published by the Free Software Foundation. 7 | # 8 | # File available at https://github.com/zpincus/celltool under the 9 | # GNU General Public License v2.0. 10 | # 11 | # The code was modified to reflect the image instead of filling with 12 | # black pixels for the skin-data-augmentation project. 13 | 14 | from scipy import ndimage 15 | import numpy 16 | 17 | def warp_images(from_points, to_points, images, output_region, interpolation_order = 1, approximate_grid=2): 18 | """Define a thin-plate-spline warping transform that warps from the from_points 19 | to the to_points, and then warp the given images by that transform. This 20 | transform is described in the paper: "Principal Warps: Thin-Plate Splines and 21 | the Decomposition of Deformations" by F.L. Bookstein. 22 | 23 | Parameters: 24 | - from_points and to_points: Nx2 arrays containing N 2D landmark points. 25 | - images: list of images to warp with the given warp transform. 26 | - output_region: the (xmin, ymin, xmax, ymax) region of the output 27 | image that should be produced. (Note: The region is inclusive, i.e. 28 | xmin <= x <= xmax) 29 | - interpolation_order: if 1, then use linear interpolation; if 0 then use 30 | nearest-neighbor. 31 | - approximate_grid: defining the warping transform is slow. If approximate_grid 32 | is greater than 1, then the transform is defined on a grid 'approximate_grid' 33 | times smaller than the output image region, and then the transform is 34 | bilinearly interpolated to the larger region. This is fairly accurate 35 | for values up to 10 or so. 36 | """ 37 | transform = _make_inverse_warp(from_points, to_points, output_region, approximate_grid) 38 | return [ndimage.map_coordinates(numpy.asarray(image), transform, order=interpolation_order, mode='reflect') for image in images] 39 | 40 | def _make_inverse_warp(from_points, to_points, output_region, approximate_grid): 41 | x_min, y_min, x_max, y_max = output_region 42 | if approximate_grid is None: approximate_grid = 1 43 | x_steps = (x_max - x_min) / approximate_grid 44 | y_steps = (y_max - y_min) / approximate_grid 45 | x, y = numpy.mgrid[x_min:x_max:x_steps*1j, y_min:y_max:y_steps*1j] 46 | 47 | # make the reverse transform warping from the to_points to the from_points, because we 48 | # do image interpolation in this reverse fashion 49 | transform = _make_warp(to_points, from_points, x, y) 50 | 51 | if approximate_grid != 1: 52 | # linearly interpolate the zoomed transform grid 53 | new_x, new_y = numpy.mgrid[x_min:x_max+1, y_min:y_max+1] 54 | x_fracs, x_indices = numpy.modf((x_steps-1)*(new_x-x_min)/float(x_max-x_min)) 55 | y_fracs, y_indices = numpy.modf((y_steps-1)*(new_y-y_min)/float(y_max-y_min)) 56 | x_indices = x_indices.astype(int) 57 | y_indices = y_indices.astype(int) 58 | x1 = 1 - x_fracs 59 | y1 = 1 - y_fracs 60 | ix1 = (x_indices+1).clip(0, x_steps-1).astype(int) 61 | iy1 = (y_indices+1).clip(0, y_steps-1).astype(int) 62 | t00 = transform[0][(x_indices, y_indices)] 63 | t01 = transform[0][(x_indices, iy1)] 64 | t10 = transform[0][(ix1, y_indices)] 65 | t11 = transform[0][(ix1, iy1)] 66 | transform_x = t00*x1*y1 + t01*x1*y_fracs + t10*x_fracs*y1 + t11*x_fracs*y_fracs 67 | t00 = transform[1][(x_indices, y_indices)] 68 | t01 = transform[1][(x_indices, iy1)] 69 | t10 = transform[1][(ix1, y_indices)] 70 | t11 = transform[1][(ix1, iy1)] 71 | transform_y = t00*x1*y1 + t01*x1*y_fracs + t10*x_fracs*y1 + t11*x_fracs*y_fracs 72 | transform = [transform_x, transform_y] 73 | return transform 74 | 75 | _small = 1e-100 76 | def _U(x): 77 | return (x**2) * numpy.where(x<_small, 0, numpy.log(x)) 78 | 79 | def _interpoint_distances(points): 80 | xd = numpy.subtract.outer(points[:,0], points[:,0]) 81 | yd = numpy.subtract.outer(points[:,1], points[:,1]) 82 | return numpy.sqrt(xd**2 + yd**2) 83 | 84 | def _make_L_matrix(points): 85 | n = len(points) 86 | K = _U(_interpoint_distances(points)) 87 | P = numpy.ones((n, 3)) 88 | P[:,1:] = points 89 | O = numpy.zeros((3, 3)) 90 | L = numpy.asarray(numpy.bmat([[K, P],[P.transpose(), O]])) 91 | return L 92 | 93 | def _calculate_f(coeffs, points, x, y): 94 | w = coeffs[:-3] 95 | a1, ax, ay = coeffs[-3:] 96 | # The following uses too much RAM: 97 | # distances = _U(numpy.sqrt((points[:,0]-x[...,numpy.newaxis])**2 + (points[:,1]-y[...,numpy.newaxis])**2)) 98 | # summation = (w * distances).sum(axis=-1) 99 | summation = numpy.zeros(x.shape) 100 | for wi, Pi in zip(w, points): 101 | summation += wi * _U(numpy.sqrt((x-Pi[0])**2 + (y-Pi[1])**2)) 102 | return a1 + ax*x + ay*y + summation 103 | 104 | def _make_warp(from_points, to_points, x_vals, y_vals): 105 | from_points, to_points = numpy.asarray(from_points), numpy.asarray(to_points) 106 | err = numpy.seterr(divide='ignore') 107 | L = _make_L_matrix(from_points) 108 | V = numpy.resize(to_points, (len(to_points)+3, 2)) 109 | V[-3:, :] = 0 110 | coeffs = numpy.dot(numpy.linalg.pinv(L), V) 111 | x_warp = _calculate_f(coeffs[:,0], from_points, x_vals, y_vals) 112 | y_warp = _calculate_f(coeffs[:,1], from_points, x_vals, y_vals) 113 | numpy.seterr(**err) 114 | return [x_warp, y_warp] 115 | -------------------------------------------------------------------------------- /auglib/augmentation/two_lesions.py: -------------------------------------------------------------------------------- 1 | import numpy as np 2 | from numpy import ma 3 | from random import randint 4 | from skimage.transform import rotate, SimilarityTransform, warp 5 | from scipy.ndimage import center_of_mass 6 | from skimage.filters import gaussian 7 | 8 | 9 | def _histogram_matching(source, template): 10 | """ 11 | Adjust the pixel values of a grayscale image such that its histogram 12 | matches that of a target image 13 | 14 | Arguments: 15 | ----------- 16 | source: np.ndarray 17 | Image to transform; the histogram is computed over the flattened 18 | array 19 | template: np.ndarray 20 | Template image; can have different dimensions to source 21 | Returns: 22 | ----------- 23 | matched: np.ndarray 24 | The transformed output image 25 | 26 | Source: https://stackoverflow.com/a/33047048/604734 (Creative Commons) 27 | """ 28 | 29 | template = template.copy() 30 | source = source.copy() 31 | template[template.mask] = 0 32 | 33 | oldshape = source.shape 34 | source = source.ravel() 35 | template = template.ravel() 36 | 37 | # get the set of unique pixel values and their corresponding indices and 38 | # counts 39 | s_values, bin_idx, s_counts = np.unique(source, return_inverse=True, 40 | return_counts=True) 41 | t_values, t_counts = np.unique(template, return_counts=True) 42 | t_values = np.delete(t_values, 0) 43 | t_counts = np.delete(t_counts, 0) 44 | 45 | # take the cumsum of the counts and normalize by the number of pixels to 46 | # get the empirical cumulative distribution functions for the source and 47 | # template images (maps pixel value --> quantile) 48 | s_quantiles = np.cumsum(s_counts).astype(np.float64) 49 | s_quantiles /= s_quantiles[-1] 50 | t_quantiles = np.cumsum(t_counts).astype(np.float64) 51 | t_quantiles /= t_quantiles[-1] 52 | 53 | # interpolate linearly to find the pixel values in the template image 54 | # that correspond most closely to the quantiles in the source image 55 | interp_t_values = np.interp(s_quantiles, t_quantiles, t_values) 56 | 57 | return interp_t_values[bin_idx].reshape(oldshape) 58 | 59 | 60 | def mix_lesions(lesion_bg, lesion_fg, mask_bg, mask_fg, gauss_sigma=0): 61 | height, width = lesion_bg.shape[:2] 62 | 63 | # Histogram matching 64 | for i in range(3): 65 | lesion_bg_masked = ma.array(lesion_bg[..., i], mask=~mask_bg) 66 | lesion_fg[..., i] = _histogram_matching(lesion_fg[..., i], 67 | lesion_bg_masked) 68 | 69 | rotation = randint(0, 90) 70 | lesion_fg = rotate(lesion_fg, rotation, mode='reflect', 71 | preserve_range=True).astype('uint8') 72 | mask_fg = rotate(mask_fg, rotation, mode='constant', cval=0, 73 | preserve_range=True).astype('uint8') 74 | 75 | cm_fg = center_of_mass(mask_fg) 76 | cm_bg = center_of_mass(mask_bg) 77 | 78 | tf_ = SimilarityTransform( 79 | scale=1, rotation=0, 80 | translation=(cm_fg[1] - cm_bg[1], cm_fg[0] - cm_bg[0])) 81 | 82 | lesion_fg = warp(lesion_fg, tf_, mode='constant', 83 | preserve_range=True).astype('uint8') 84 | mask_fg = warp(mask_fg, tf_, mode='constant', cval=0, 85 | preserve_range=True).astype('uint8') 86 | cm_fg = center_of_mass(mask_fg) 87 | 88 | # Cut mask 89 | cut_mask = np.zeros(mask_fg.shape) 90 | cut_mask[cut_mask.shape[0] // 2:, :] = 255 91 | cut_mask = rotate(cut_mask, 92 | randint(0, 90), 93 | mode='reflect', 94 | preserve_range=True).astype('uint8') 95 | tf_cm = SimilarityTransform( 96 | scale=1, 97 | rotation=0, 98 | translation=(width // 2 - cm_bg[1], height // 2 - cm_bg[0])) 99 | cut_mask = warp(cut_mask, tf_cm, mode='constant', cval=0, 100 | preserve_range=True).astype('uint8') 101 | mask_fg = np.where(np.logical_and(mask_fg, cut_mask), 255, 0) 102 | 103 | # Calculate mask bounding box 104 | coords = np.argwhere(mask_fg == 255) 105 | y0, x0 = coords.min(axis=0) 106 | y1, x1 = coords.max(axis=0) + 1 107 | 108 | # Convert mask to 3 channels 109 | mask_fg = np.dstack((mask_fg, mask_fg, mask_fg)) 110 | # Convert it to float 111 | mask_fg = mask_fg.astype('float') 112 | # And normalize it to 0.0~1.0 113 | mask_fg *= (1.0/255.0) 114 | 115 | # Apply Gaussian Blur to the mask 116 | mask_fg = gaussian(mask_fg, sigma=gauss_sigma, multichannel=True, 117 | preserve_range=True) 118 | 119 | out = np.copy(lesion_bg) 120 | 121 | out_ = (lesion_bg * (1.0 - mask_fg) + lesion_fg * mask_fg).astype('uint8') 122 | out = np.where(mask_fg == 0, lesion_bg, out_) 123 | 124 | return out 125 | -------------------------------------------------------------------------------- /auglib/dataset_loader.py: -------------------------------------------------------------------------------- 1 | import os 2 | import os.path 3 | 4 | import pandas as pd 5 | import torch.utils.data as data 6 | from torchvision.datasets.folder import default_loader 7 | 8 | 9 | # TODO: Make target_field optional for unannotated datasets. 10 | class CSVDataset(data.Dataset): 11 | def __init__(self, root, csv_file, image_field, target_field, 12 | loader=default_loader, transform=None, 13 | target_transform=None, add_extension=None, 14 | limit=None, random_subset_size=None, 15 | split=None): 16 | self.root = root 17 | self.loader = loader 18 | self.image_field = image_field 19 | self.target_field = target_field 20 | self.transform = transform 21 | self.target_transform = target_transform 22 | self.add_extension = add_extension 23 | 24 | self.data = pd.read_csv(csv_file, sep=None) 25 | 26 | # Split 27 | if split is not None: 28 | with open(split, 'r') as f: 29 | selected_images = f.read().splitlines() 30 | self.data = self.data[self.data[image_field].isin(selected_images)] 31 | self.data = self.data.reset_index() 32 | 33 | # Calculate class weights for WeightedRandomSampler 34 | self.class_counts = dict(self.data['label'].value_counts()) 35 | self.class_weights = {label: max(self.class_counts.values()) / count 36 | for label, count in self.class_counts.items()} 37 | self.sampler_weights = [self.class_weights[cls] 38 | for cls in self.data['label']] 39 | self.class_weights_list = [self.class_weights[k] 40 | for k in sorted(self.class_weights)] 41 | 42 | if random_subset_size: 43 | self.data = self.data.sample(n=random_subset_size) 44 | self.data = self.data.reset_index() 45 | 46 | if type(limit) == int: 47 | limit = (0, limit) 48 | if type(limit) == tuple: 49 | self.data = self.data[limit[0]:limit[1]] 50 | self.data = self.data.reset_index() 51 | 52 | classes = list(self.data[self.target_field].unique()) 53 | classes.sort() 54 | self.class_to_idx = {classes[i]: i for i in range(len(classes))} 55 | self.classes = classes 56 | 57 | print('Found {} images from {} classes.'.format(len(self.data), 58 | len(classes))) 59 | for class_name, idx in self.class_to_idx.items(): 60 | n_images = dict(self.data[self.target_field].value_counts()) 61 | print(" Class '{}' ({}): {} images.".format( 62 | class_name, idx, n_images[class_name])) 63 | 64 | def __getitem__(self, index): 65 | path = os.path.join(self.root, 66 | self.data.loc[index, self.image_field]) 67 | if self.add_extension: 68 | path = path + self.add_extension 69 | sample = self.loader(path) 70 | target = self.class_to_idx[self.data.loc[index, self.target_field]] 71 | if self.transform is not None: 72 | sample = self.transform(sample) 73 | if self.target_transform is not None: 74 | target = self.target_transform(target) 75 | 76 | return sample, target 77 | 78 | def __len__(self): 79 | return len(self.data) 80 | 81 | 82 | class CSVDatasetWithName(CSVDataset): 83 | """ 84 | CSVData that also returns image names. 85 | """ 86 | 87 | def __getitem__(self, i): 88 | """ 89 | Returns: 90 | tuple(tuple(PIL image, int), str): a tuple 91 | containing another tuple with an image and 92 | the label, and a string representing the 93 | name of the image. 94 | """ 95 | name = self.data.loc[i, self.image_field] 96 | return super().__getitem__(i), name 97 | -------------------------------------------------------------------------------- /auglib/meters.py: -------------------------------------------------------------------------------- 1 | class AverageMeter(object): 2 | """Computes and stores the average and current value""" 3 | def __init__(self): 4 | self.reset() 5 | 6 | def reset(self): 7 | self.val = 0 8 | self.avg = 0 9 | self.sum = 0 10 | self.count = 0 11 | 12 | def update(self, val, n=1): 13 | self.val = val 14 | self.sum += val * n 15 | self.count += n 16 | self.avg = self.sum / self.count 17 | -------------------------------------------------------------------------------- /auglib/test.py: -------------------------------------------------------------------------------- 1 | import numpy as np 2 | import pandas as pd 3 | from sklearn.metrics import (accuracy_score, confusion_matrix) 4 | import torch 5 | import torch.nn as nn 6 | import torch.nn.functional as F 7 | from torchvision.utils import save_image, make_grid 8 | from tqdm import tqdm 9 | 10 | from .augmentation import set_seeds 11 | from .meters import AverageMeter 12 | 13 | 14 | class AugmentOnTest: 15 | def __init__(self, dataset, n): 16 | self.dataset = dataset 17 | self.n = n 18 | 19 | def __len__(self): 20 | return self.n * len(self.dataset) 21 | 22 | def __getitem__(self, i): 23 | return self.dataset[i // self.n] 24 | 25 | 26 | def test_with_augmentation(model, dataset, device, num_workers, n, 27 | save_images=False): 28 | assert n >= 1, "n must be larger than 1" 29 | 30 | model.eval() 31 | criterion = nn.CrossEntropyLoss() 32 | 33 | if n != 1: 34 | dataset = AugmentOnTest(dataset, n) 35 | 36 | dataloader = torch.utils.data.DataLoader( 37 | dataset, batch_size=n, shuffle=False, 38 | num_workers=num_workers, pin_memory=True, 39 | worker_init_fn=set_seeds) 40 | 41 | losses = AverageMeter() 42 | predictions = pd.DataFrame( 43 | columns=['image', 'label', 'MEL', 'NV', 'BCC', 44 | 'AKIEC', 'BKL', 'DF', 'VASC']) 45 | all_scores = [] 46 | 47 | for i, data in enumerate(tqdm(dataloader)): 48 | (inputs, labels), name = data 49 | 50 | # If the inputs tensor has 5 dimensions, it means 51 | # that TenCrop or DenseCrop was used. 52 | if inputs.dim() == 5: 53 | inputs = inputs.squeeze(0) 54 | labels = labels.repeat(inputs.shape[0]) 55 | 56 | inputs = inputs.to(device) 57 | labels = labels.to(device) 58 | 59 | if save_images: 60 | if i <= 10: 61 | save_image(make_grid(inputs, padding=0), 62 | 'grid_{}.jpg'.format(i)) 63 | 64 | with torch.no_grad(): 65 | outputs = model(inputs) 66 | scores = F.softmax(outputs, dim=1).cpu().data.numpy() 67 | loss = criterion(outputs, labels) 68 | 69 | losses.update(loss.item(), inputs.size(0)) 70 | 71 | scores = scores.mean(axis=0) 72 | all_scores.append(scores) 73 | predictions = predictions.append( 74 | {'image': name[0], 75 | 'label': labels.data[0].item(), 76 | 'MEL': scores[0], 77 | 'NV': scores[1], 78 | 'BCC': scores[2], 79 | 'AKIEC': scores[3], 80 | 'BKL': scores[4], 81 | 'DF': scores[5], 82 | 'VASC': scores[6]}, 83 | ignore_index=True) 84 | 85 | labels_array = predictions['label'].values.astype(int) 86 | scores_array = np.array(all_scores) 87 | predicted_labels = scores_array.argmax(axis=1) 88 | 89 | acc = accuracy_score(labels_array, predicted_labels) 90 | 91 | # Confusion Matrix 92 | print('Confusion matrix') 93 | cm = confusion_matrix(labels_array, predicted_labels) 94 | cmn = cm.astype('float') / cm.sum(axis=1)[:, np.newaxis] 95 | print(cm) 96 | print(cmn) 97 | acc = np.trace(cmn) / cmn.shape[0] 98 | 99 | return ({'loss': losses.avg, 'acc': acc}, predictions) 100 | -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | numpy==1.14.3 2 | opencv-python==3.4.0.12 3 | pandas==0.22.0 4 | Pillow==5.2.0 5 | pretrainedmodels==0.6.2 6 | python-telegram-bot==10.1.0 7 | sacred==0.7.4 8 | scikit_image==0.13.1 9 | scikit_learn==0.19.2 10 | scipy==1.1.0 11 | torch==0.4.0 12 | torchvision==0.2.1 13 | tqdm==4.23.3 14 | git+https://github.com/aleju/imgaug 15 | -------------------------------------------------------------------------------- /splits/split_task3_testsubmission_challenge.txt: -------------------------------------------------------------------------------- 1 | ISIC_0034524 2 | ISIC_0034525 3 | ISIC_0034526 4 | ISIC_0034527 5 | ISIC_0034528 6 | ISIC_0034529 7 | ISIC_0034530 8 | ISIC_0034531 9 | ISIC_0034532 10 | ISIC_0034533 11 | ISIC_0034534 12 | ISIC_0034535 13 | ISIC_0034536 14 | ISIC_0034537 15 | ISIC_0034538 16 | ISIC_0034539 17 | ISIC_0034540 18 | ISIC_0034541 19 | ISIC_0034542 20 | ISIC_0034543 21 | ISIC_0034544 22 | ISIC_0034545 23 | ISIC_0034546 24 | ISIC_0034547 25 | ISIC_0034548 26 | ISIC_0034549 27 | ISIC_0034551 28 | ISIC_0034552 29 | ISIC_0034553 30 | ISIC_0034554 31 | ISIC_0034555 32 | ISIC_0034556 33 | ISIC_0034557 34 | ISIC_0034558 35 | ISIC_0034559 36 | ISIC_0034560 37 | ISIC_0034561 38 | ISIC_0034562 39 | ISIC_0034563 40 | ISIC_0034564 41 | ISIC_0034565 42 | ISIC_0034566 43 | ISIC_0034567 44 | ISIC_0034568 45 | ISIC_0034569 46 | ISIC_0034570 47 | ISIC_0034571 48 | ISIC_0034572 49 | ISIC_0034573 50 | ISIC_0034574 51 | ISIC_0034575 52 | ISIC_0034576 53 | ISIC_0034577 54 | ISIC_0034578 55 | ISIC_0034579 56 | ISIC_0034580 57 | ISIC_0034581 58 | ISIC_0034582 59 | ISIC_0034583 60 | ISIC_0034584 61 | ISIC_0034585 62 | ISIC_0034586 63 | ISIC_0034587 64 | ISIC_0034588 65 | ISIC_0034589 66 | ISIC_0034590 67 | ISIC_0034591 68 | ISIC_0034592 69 | ISIC_0034593 70 | ISIC_0034594 71 | ISIC_0034595 72 | ISIC_0034596 73 | ISIC_0034597 74 | ISIC_0034598 75 | ISIC_0034599 76 | ISIC_0034600 77 | ISIC_0034601 78 | ISIC_0034602 79 | ISIC_0034603 80 | ISIC_0034604 81 | ISIC_0034605 82 | ISIC_0034606 83 | ISIC_0034607 84 | ISIC_0034608 85 | ISIC_0034609 86 | ISIC_0034610 87 | ISIC_0034611 88 | ISIC_0034612 89 | ISIC_0034613 90 | ISIC_0034614 91 | ISIC_0034615 92 | ISIC_0034616 93 | ISIC_0034617 94 | ISIC_0034618 95 | ISIC_0034619 96 | ISIC_0034620 97 | ISIC_0034621 98 | ISIC_0034622 99 | ISIC_0034623 100 | ISIC_0034624 101 | ISIC_0034625 102 | ISIC_0034626 103 | ISIC_0034627 104 | ISIC_0034628 105 | ISIC_0034629 106 | ISIC_0034630 107 | ISIC_0034631 108 | ISIC_0034632 109 | ISIC_0034633 110 | ISIC_0034634 111 | ISIC_0034635 112 | ISIC_0034636 113 | ISIC_0034637 114 | ISIC_0034638 115 | ISIC_0034639 116 | ISIC_0034640 117 | ISIC_0034641 118 | ISIC_0034642 119 | ISIC_0034643 120 | ISIC_0034644 121 | ISIC_0034645 122 | ISIC_0034646 123 | ISIC_0034648 124 | ISIC_0034649 125 | ISIC_0034650 126 | ISIC_0034651 127 | ISIC_0034652 128 | ISIC_0034653 129 | ISIC_0034654 130 | ISIC_0034655 131 | ISIC_0034656 132 | ISIC_0034657 133 | ISIC_0034658 134 | ISIC_0034659 135 | ISIC_0034660 136 | ISIC_0034661 137 | ISIC_0034662 138 | ISIC_0034663 139 | ISIC_0034664 140 | ISIC_0034665 141 | ISIC_0034666 142 | ISIC_0034667 143 | ISIC_0034668 144 | ISIC_0034669 145 | ISIC_0034670 146 | ISIC_0034671 147 | ISIC_0034672 148 | ISIC_0034674 149 | ISIC_0034675 150 | ISIC_0034676 151 | ISIC_0034677 152 | ISIC_0034678 153 | ISIC_0034679 154 | ISIC_0034680 155 | ISIC_0034681 156 | ISIC_0034682 157 | ISIC_0034683 158 | ISIC_0034684 159 | ISIC_0034685 160 | ISIC_0034686 161 | ISIC_0034687 162 | ISIC_0034688 163 | ISIC_0034689 164 | ISIC_0034690 165 | ISIC_0034691 166 | ISIC_0034692 167 | ISIC_0034693 168 | ISIC_0034694 169 | ISIC_0034695 170 | ISIC_0034696 171 | ISIC_0034697 172 | ISIC_0034698 173 | ISIC_0034699 174 | ISIC_0034700 175 | ISIC_0034701 176 | ISIC_0034702 177 | ISIC_0034703 178 | ISIC_0034704 179 | ISIC_0034705 180 | ISIC_0034706 181 | ISIC_0034707 182 | ISIC_0034708 183 | ISIC_0034709 184 | ISIC_0034710 185 | ISIC_0034711 186 | ISIC_0034712 187 | ISIC_0034713 188 | ISIC_0034714 189 | ISIC_0034715 190 | ISIC_0034716 191 | ISIC_0034717 192 | ISIC_0034718 193 | ISIC_0034719 194 | ISIC_0034720 195 | ISIC_0034721 196 | ISIC_0034722 197 | ISIC_0034723 198 | ISIC_0034724 199 | ISIC_0034725 200 | ISIC_0034726 201 | ISIC_0034727 202 | ISIC_0034728 203 | ISIC_0034729 204 | ISIC_0034730 205 | ISIC_0034731 206 | ISIC_0034732 207 | ISIC_0034733 208 | ISIC_0034734 209 | ISIC_0034735 210 | ISIC_0034736 211 | ISIC_0034737 212 | ISIC_0034738 213 | ISIC_0034739 214 | ISIC_0034740 215 | ISIC_0034741 216 | ISIC_0034742 217 | ISIC_0034743 218 | ISIC_0034744 219 | ISIC_0034745 220 | ISIC_0034746 221 | ISIC_0034747 222 | ISIC_0034748 223 | ISIC_0034749 224 | ISIC_0034750 225 | ISIC_0034751 226 | ISIC_0034752 227 | ISIC_0034753 228 | ISIC_0034754 229 | ISIC_0034755 230 | ISIC_0034756 231 | ISIC_0034757 232 | ISIC_0034758 233 | ISIC_0034759 234 | ISIC_0034760 235 | ISIC_0034761 236 | ISIC_0034762 237 | ISIC_0034763 238 | ISIC_0034764 239 | ISIC_0034765 240 | ISIC_0034766 241 | ISIC_0034767 242 | ISIC_0034768 243 | ISIC_0034769 244 | ISIC_0034770 245 | ISIC_0034771 246 | ISIC_0034772 247 | ISIC_0034773 248 | ISIC_0034774 249 | ISIC_0034776 250 | ISIC_0034777 251 | ISIC_0034778 252 | ISIC_0034779 253 | ISIC_0034780 254 | ISIC_0034781 255 | ISIC_0034782 256 | ISIC_0034783 257 | ISIC_0034784 258 | ISIC_0034785 259 | ISIC_0034786 260 | ISIC_0034787 261 | ISIC_0034788 262 | ISIC_0034789 263 | ISIC_0034790 264 | ISIC_0034791 265 | ISIC_0034792 266 | ISIC_0034793 267 | ISIC_0034794 268 | ISIC_0034795 269 | ISIC_0034797 270 | ISIC_0034798 271 | ISIC_0034800 272 | ISIC_0034801 273 | ISIC_0034802 274 | ISIC_0034803 275 | ISIC_0034804 276 | ISIC_0034805 277 | ISIC_0034806 278 | ISIC_0034807 279 | ISIC_0034808 280 | ISIC_0034809 281 | ISIC_0034810 282 | ISIC_0034811 283 | ISIC_0034812 284 | ISIC_0034813 285 | ISIC_0034814 286 | ISIC_0034815 287 | ISIC_0034816 288 | ISIC_0034817 289 | ISIC_0034818 290 | ISIC_0034819 291 | ISIC_0034820 292 | ISIC_0034821 293 | ISIC_0034822 294 | ISIC_0034823 295 | ISIC_0034824 296 | ISIC_0034825 297 | ISIC_0034826 298 | ISIC_0034827 299 | ISIC_0034828 300 | ISIC_0034829 301 | ISIC_0034830 302 | ISIC_0034831 303 | ISIC_0034832 304 | ISIC_0034833 305 | ISIC_0034834 306 | ISIC_0034835 307 | ISIC_0034836 308 | ISIC_0034837 309 | ISIC_0034838 310 | ISIC_0034839 311 | ISIC_0034840 312 | ISIC_0034841 313 | ISIC_0034842 314 | ISIC_0034843 315 | ISIC_0034844 316 | ISIC_0034845 317 | ISIC_0034846 318 | ISIC_0034847 319 | ISIC_0034848 320 | ISIC_0034849 321 | ISIC_0034850 322 | ISIC_0034851 323 | ISIC_0034852 324 | ISIC_0034853 325 | ISIC_0034854 326 | ISIC_0034855 327 | ISIC_0034856 328 | ISIC_0034857 329 | ISIC_0034858 330 | ISIC_0034859 331 | ISIC_0034860 332 | ISIC_0034861 333 | ISIC_0034862 334 | ISIC_0034863 335 | ISIC_0034864 336 | ISIC_0034865 337 | ISIC_0034866 338 | ISIC_0034867 339 | ISIC_0034868 340 | ISIC_0034869 341 | ISIC_0034870 342 | ISIC_0034871 343 | ISIC_0034872 344 | ISIC_0034873 345 | ISIC_0034874 346 | ISIC_0034875 347 | ISIC_0034876 348 | ISIC_0034877 349 | ISIC_0034878 350 | ISIC_0034879 351 | ISIC_0034880 352 | ISIC_0034881 353 | ISIC_0034882 354 | ISIC_0034883 355 | ISIC_0034884 356 | ISIC_0034885 357 | ISIC_0034886 358 | ISIC_0034887 359 | ISIC_0034888 360 | ISIC_0034889 361 | ISIC_0034890 362 | ISIC_0034891 363 | ISIC_0034892 364 | ISIC_0034893 365 | ISIC_0034894 366 | ISIC_0034895 367 | ISIC_0034896 368 | ISIC_0034897 369 | ISIC_0034898 370 | ISIC_0034899 371 | ISIC_0034900 372 | ISIC_0034901 373 | ISIC_0034902 374 | ISIC_0034903 375 | ISIC_0034904 376 | ISIC_0034905 377 | ISIC_0034906 378 | ISIC_0034907 379 | ISIC_0034908 380 | ISIC_0034909 381 | ISIC_0034910 382 | ISIC_0034911 383 | ISIC_0034912 384 | ISIC_0034913 385 | ISIC_0034914 386 | ISIC_0034915 387 | ISIC_0034916 388 | ISIC_0034917 389 | ISIC_0034918 390 | ISIC_0034919 391 | ISIC_0034920 392 | ISIC_0034921 393 | ISIC_0034922 394 | ISIC_0034923 395 | ISIC_0034924 396 | ISIC_0034925 397 | ISIC_0034926 398 | ISIC_0034927 399 | ISIC_0034928 400 | ISIC_0034930 401 | ISIC_0034931 402 | ISIC_0034932 403 | ISIC_0034933 404 | ISIC_0034934 405 | ISIC_0034935 406 | ISIC_0034936 407 | ISIC_0034937 408 | ISIC_0034938 409 | ISIC_0034939 410 | ISIC_0034940 411 | ISIC_0034941 412 | ISIC_0034942 413 | ISIC_0034943 414 | ISIC_0034944 415 | ISIC_0034945 416 | ISIC_0034946 417 | ISIC_0034947 418 | ISIC_0034948 419 | ISIC_0034949 420 | ISIC_0034950 421 | ISIC_0034951 422 | ISIC_0034952 423 | ISIC_0034953 424 | ISIC_0034954 425 | ISIC_0034955 426 | ISIC_0034956 427 | ISIC_0034957 428 | ISIC_0034958 429 | ISIC_0034959 430 | ISIC_0034960 431 | ISIC_0034961 432 | ISIC_0034962 433 | ISIC_0034964 434 | ISIC_0034965 435 | ISIC_0034966 436 | ISIC_0034967 437 | ISIC_0034968 438 | ISIC_0034970 439 | ISIC_0034971 440 | ISIC_0034972 441 | ISIC_0034973 442 | ISIC_0034974 443 | ISIC_0034975 444 | ISIC_0034976 445 | ISIC_0034977 446 | ISIC_0034978 447 | ISIC_0034979 448 | ISIC_0034980 449 | ISIC_0034982 450 | ISIC_0034983 451 | ISIC_0034984 452 | ISIC_0034985 453 | ISIC_0034986 454 | ISIC_0034987 455 | ISIC_0034988 456 | ISIC_0034989 457 | ISIC_0034990 458 | ISIC_0034991 459 | ISIC_0034992 460 | ISIC_0034993 461 | ISIC_0034994 462 | ISIC_0034995 463 | ISIC_0034996 464 | ISIC_0034997 465 | ISIC_0034998 466 | ISIC_0034999 467 | ISIC_0035000 468 | ISIC_0035001 469 | ISIC_0035002 470 | ISIC_0035003 471 | ISIC_0035004 472 | ISIC_0035005 473 | ISIC_0035006 474 | ISIC_0035007 475 | ISIC_0035008 476 | ISIC_0035009 477 | ISIC_0035010 478 | ISIC_0035011 479 | ISIC_0035012 480 | ISIC_0035013 481 | ISIC_0035014 482 | ISIC_0035015 483 | ISIC_0035016 484 | ISIC_0035017 485 | ISIC_0035018 486 | ISIC_0035019 487 | ISIC_0035020 488 | ISIC_0035021 489 | ISIC_0035022 490 | ISIC_0035023 491 | ISIC_0035024 492 | ISIC_0035025 493 | ISIC_0035026 494 | ISIC_0035027 495 | ISIC_0035028 496 | ISIC_0035029 497 | ISIC_0035030 498 | ISIC_0035031 499 | ISIC_0035032 500 | ISIC_0035033 501 | ISIC_0035034 502 | ISIC_0035035 503 | ISIC_0035036 504 | ISIC_0035037 505 | ISIC_0035038 506 | ISIC_0035039 507 | ISIC_0035040 508 | ISIC_0035041 509 | ISIC_0035042 510 | ISIC_0035043 511 | ISIC_0035044 512 | ISIC_0035045 513 | ISIC_0035046 514 | ISIC_0035047 515 | ISIC_0035048 516 | ISIC_0035049 517 | ISIC_0035050 518 | ISIC_0035051 519 | ISIC_0035052 520 | ISIC_0035053 521 | ISIC_0035054 522 | ISIC_0035055 523 | ISIC_0035056 524 | ISIC_0035057 525 | ISIC_0035058 526 | ISIC_0035059 527 | ISIC_0035060 528 | ISIC_0035061 529 | ISIC_0035062 530 | ISIC_0035063 531 | ISIC_0035064 532 | ISIC_0035065 533 | ISIC_0035066 534 | ISIC_0035067 535 | ISIC_0035068 536 | ISIC_0035070 537 | ISIC_0035071 538 | ISIC_0035072 539 | ISIC_0035073 540 | ISIC_0035074 541 | ISIC_0035075 542 | ISIC_0035076 543 | ISIC_0035077 544 | ISIC_0035078 545 | ISIC_0035079 546 | ISIC_0035080 547 | ISIC_0035081 548 | ISIC_0035082 549 | ISIC_0035083 550 | ISIC_0035084 551 | ISIC_0035085 552 | ISIC_0035086 553 | ISIC_0035087 554 | ISIC_0035088 555 | ISIC_0035089 556 | ISIC_0035090 557 | ISIC_0035091 558 | ISIC_0035092 559 | ISIC_0035093 560 | ISIC_0035094 561 | ISIC_0035095 562 | ISIC_0035096 563 | ISIC_0035097 564 | ISIC_0035098 565 | ISIC_0035099 566 | ISIC_0035100 567 | ISIC_0035101 568 | ISIC_0035102 569 | ISIC_0035103 570 | ISIC_0035104 571 | ISIC_0035105 572 | ISIC_0035106 573 | ISIC_0035107 574 | ISIC_0035108 575 | ISIC_0035109 576 | ISIC_0035110 577 | ISIC_0035111 578 | ISIC_0035112 579 | ISIC_0035113 580 | ISIC_0035114 581 | ISIC_0035115 582 | ISIC_0035116 583 | ISIC_0035117 584 | ISIC_0035118 585 | ISIC_0035119 586 | ISIC_0035120 587 | ISIC_0035121 588 | ISIC_0035122 589 | ISIC_0035123 590 | ISIC_0035124 591 | ISIC_0035125 592 | ISIC_0035126 593 | ISIC_0035127 594 | ISIC_0035128 595 | ISIC_0035129 596 | ISIC_0035130 597 | ISIC_0035131 598 | ISIC_0035132 599 | ISIC_0035133 600 | ISIC_0035134 601 | ISIC_0035135 602 | ISIC_0035136 603 | ISIC_0035137 604 | ISIC_0035138 605 | ISIC_0035139 606 | ISIC_0035140 607 | ISIC_0035142 608 | ISIC_0035143 609 | ISIC_0035144 610 | ISIC_0035145 611 | ISIC_0035146 612 | ISIC_0035147 613 | ISIC_0035148 614 | ISIC_0035149 615 | ISIC_0035150 616 | ISIC_0035151 617 | ISIC_0035152 618 | ISIC_0035153 619 | ISIC_0035154 620 | ISIC_0035155 621 | ISIC_0035156 622 | ISIC_0035157 623 | ISIC_0035158 624 | ISIC_0035160 625 | ISIC_0035161 626 | ISIC_0035162 627 | ISIC_0035163 628 | ISIC_0035164 629 | ISIC_0035165 630 | ISIC_0035166 631 | ISIC_0035167 632 | ISIC_0035168 633 | ISIC_0035169 634 | ISIC_0035170 635 | ISIC_0035171 636 | ISIC_0035172 637 | ISIC_0035173 638 | ISIC_0035175 639 | ISIC_0035176 640 | ISIC_0035177 641 | ISIC_0035178 642 | ISIC_0035179 643 | ISIC_0035180 644 | ISIC_0035181 645 | ISIC_0035182 646 | ISIC_0035184 647 | ISIC_0035185 648 | ISIC_0035186 649 | ISIC_0035187 650 | ISIC_0035188 651 | ISIC_0035189 652 | ISIC_0035190 653 | ISIC_0035191 654 | ISIC_0035192 655 | ISIC_0035193 656 | ISIC_0035194 657 | ISIC_0035195 658 | ISIC_0035196 659 | ISIC_0035197 660 | ISIC_0035198 661 | ISIC_0035199 662 | ISIC_0035200 663 | ISIC_0035201 664 | ISIC_0035202 665 | ISIC_0035204 666 | ISIC_0035205 667 | ISIC_0035206 668 | ISIC_0035207 669 | ISIC_0035208 670 | ISIC_0035209 671 | ISIC_0035210 672 | ISIC_0035211 673 | ISIC_0035212 674 | ISIC_0035213 675 | ISIC_0035214 676 | ISIC_0035215 677 | ISIC_0035216 678 | ISIC_0035217 679 | ISIC_0035218 680 | ISIC_0035219 681 | ISIC_0035220 682 | ISIC_0035221 683 | ISIC_0035222 684 | ISIC_0035223 685 | ISIC_0035224 686 | ISIC_0035225 687 | ISIC_0035226 688 | ISIC_0035227 689 | ISIC_0035228 690 | ISIC_0035229 691 | ISIC_0035230 692 | ISIC_0035231 693 | ISIC_0035232 694 | ISIC_0035233 695 | ISIC_0035234 696 | ISIC_0035235 697 | ISIC_0035236 698 | ISIC_0035237 699 | ISIC_0035238 700 | ISIC_0035239 701 | ISIC_0035240 702 | ISIC_0035241 703 | ISIC_0035242 704 | ISIC_0035243 705 | ISIC_0035244 706 | ISIC_0035245 707 | ISIC_0035246 708 | ISIC_0035247 709 | ISIC_0035248 710 | ISIC_0035250 711 | ISIC_0035253 712 | ISIC_0035254 713 | ISIC_0035255 714 | ISIC_0035256 715 | ISIC_0035257 716 | ISIC_0035258 717 | ISIC_0035259 718 | ISIC_0035260 719 | ISIC_0035261 720 | ISIC_0035262 721 | ISIC_0035263 722 | ISIC_0035264 723 | ISIC_0035265 724 | ISIC_0035266 725 | ISIC_0035267 726 | ISIC_0035268 727 | ISIC_0035270 728 | ISIC_0035271 729 | ISIC_0035272 730 | ISIC_0035273 731 | ISIC_0035274 732 | ISIC_0035275 733 | ISIC_0035276 734 | ISIC_0035277 735 | ISIC_0035278 736 | ISIC_0035280 737 | ISIC_0035281 738 | ISIC_0035282 739 | ISIC_0035283 740 | ISIC_0035284 741 | ISIC_0035285 742 | ISIC_0035286 743 | ISIC_0035287 744 | ISIC_0035288 745 | ISIC_0035289 746 | ISIC_0035290 747 | ISIC_0035291 748 | ISIC_0035292 749 | ISIC_0035293 750 | ISIC_0035294 751 | ISIC_0035295 752 | ISIC_0035296 753 | ISIC_0035297 754 | ISIC_0035298 755 | ISIC_0035299 756 | ISIC_0035300 757 | ISIC_0035301 758 | ISIC_0035302 759 | ISIC_0035303 760 | ISIC_0035304 761 | ISIC_0035305 762 | ISIC_0035306 763 | ISIC_0035307 764 | ISIC_0035308 765 | ISIC_0035309 766 | ISIC_0035310 767 | ISIC_0035311 768 | ISIC_0035312 769 | ISIC_0035313 770 | ISIC_0035314 771 | ISIC_0035315 772 | ISIC_0035316 773 | ISIC_0035317 774 | ISIC_0035318 775 | ISIC_0035319 776 | ISIC_0035320 777 | ISIC_0035321 778 | ISIC_0035322 779 | ISIC_0035323 780 | ISIC_0035324 781 | ISIC_0035325 782 | ISIC_0035326 783 | ISIC_0035327 784 | ISIC_0035328 785 | ISIC_0035329 786 | ISIC_0035330 787 | ISIC_0035331 788 | ISIC_0035332 789 | ISIC_0035333 790 | ISIC_0035334 791 | ISIC_0035335 792 | ISIC_0035336 793 | ISIC_0035337 794 | ISIC_0035338 795 | ISIC_0035339 796 | ISIC_0035340 797 | ISIC_0035341 798 | ISIC_0035342 799 | ISIC_0035343 800 | ISIC_0035344 801 | ISIC_0035345 802 | ISIC_0035346 803 | ISIC_0035347 804 | ISIC_0035348 805 | ISIC_0035349 806 | ISIC_0035350 807 | ISIC_0035351 808 | ISIC_0035352 809 | ISIC_0035353 810 | ISIC_0035354 811 | ISIC_0035355 812 | ISIC_0035356 813 | ISIC_0035357 814 | ISIC_0035358 815 | ISIC_0035359 816 | ISIC_0035360 817 | ISIC_0035361 818 | ISIC_0035362 819 | ISIC_0035363 820 | ISIC_0035364 821 | ISIC_0035365 822 | ISIC_0035366 823 | ISIC_0035367 824 | ISIC_0035368 825 | ISIC_0035369 826 | ISIC_0035370 827 | ISIC_0035372 828 | ISIC_0035373 829 | ISIC_0035374 830 | ISIC_0035375 831 | ISIC_0035376 832 | ISIC_0035377 833 | ISIC_0035378 834 | ISIC_0035379 835 | ISIC_0035380 836 | ISIC_0035381 837 | ISIC_0035382 838 | ISIC_0035383 839 | ISIC_0035384 840 | ISIC_0035385 841 | ISIC_0035386 842 | ISIC_0035387 843 | ISIC_0035388 844 | ISIC_0035389 845 | ISIC_0035390 846 | ISIC_0035391 847 | ISIC_0035392 848 | ISIC_0035393 849 | ISIC_0035394 850 | ISIC_0035395 851 | ISIC_0035396 852 | ISIC_0035397 853 | ISIC_0035398 854 | ISIC_0035399 855 | ISIC_0035400 856 | ISIC_0035401 857 | ISIC_0035402 858 | ISIC_0035403 859 | ISIC_0035404 860 | ISIC_0035405 861 | ISIC_0035406 862 | ISIC_0035407 863 | ISIC_0035408 864 | ISIC_0035409 865 | ISIC_0035410 866 | ISIC_0035411 867 | ISIC_0035412 868 | ISIC_0035413 869 | ISIC_0035414 870 | ISIC_0035415 871 | ISIC_0035416 872 | ISIC_0035417 873 | ISIC_0035418 874 | ISIC_0035419 875 | ISIC_0035420 876 | ISIC_0035421 877 | ISIC_0035422 878 | ISIC_0035423 879 | ISIC_0035425 880 | ISIC_0035427 881 | ISIC_0035428 882 | ISIC_0035429 883 | ISIC_0035430 884 | ISIC_0035431 885 | ISIC_0035432 886 | ISIC_0035433 887 | ISIC_0035434 888 | ISIC_0035435 889 | ISIC_0035436 890 | ISIC_0035437 891 | ISIC_0035438 892 | ISIC_0035439 893 | ISIC_0035440 894 | ISIC_0035441 895 | ISIC_0035442 896 | ISIC_0035443 897 | ISIC_0035444 898 | ISIC_0035445 899 | ISIC_0035446 900 | ISIC_0035447 901 | ISIC_0035448 902 | ISIC_0035449 903 | ISIC_0035450 904 | ISIC_0035451 905 | ISIC_0035452 906 | ISIC_0035453 907 | ISIC_0035454 908 | ISIC_0035455 909 | ISIC_0035456 910 | ISIC_0035457 911 | ISIC_0035458 912 | ISIC_0035459 913 | ISIC_0035460 914 | ISIC_0035461 915 | ISIC_0035462 916 | ISIC_0035463 917 | ISIC_0035464 918 | ISIC_0035465 919 | ISIC_0035466 920 | ISIC_0035467 921 | ISIC_0035468 922 | ISIC_0035469 923 | ISIC_0035470 924 | ISIC_0035471 925 | ISIC_0035472 926 | ISIC_0035473 927 | ISIC_0035474 928 | ISIC_0035475 929 | ISIC_0035476 930 | ISIC_0035477 931 | ISIC_0035478 932 | ISIC_0035479 933 | ISIC_0035480 934 | ISIC_0035481 935 | ISIC_0035482 936 | ISIC_0035483 937 | ISIC_0035484 938 | ISIC_0035485 939 | ISIC_0035486 940 | ISIC_0035487 941 | ISIC_0035488 942 | ISIC_0035489 943 | ISIC_0035490 944 | ISIC_0035491 945 | ISIC_0035492 946 | ISIC_0035493 947 | ISIC_0035494 948 | ISIC_0035495 949 | ISIC_0035496 950 | ISIC_0035497 951 | ISIC_0035498 952 | ISIC_0035499 953 | ISIC_0035500 954 | ISIC_0035501 955 | ISIC_0035503 956 | ISIC_0035504 957 | ISIC_0035505 958 | ISIC_0035506 959 | ISIC_0035507 960 | ISIC_0035508 961 | ISIC_0035509 962 | ISIC_0035510 963 | ISIC_0035511 964 | ISIC_0035512 965 | ISIC_0035513 966 | ISIC_0035515 967 | ISIC_0035516 968 | ISIC_0035517 969 | ISIC_0035518 970 | ISIC_0035519 971 | ISIC_0035520 972 | ISIC_0035521 973 | ISIC_0035522 974 | ISIC_0035523 975 | ISIC_0035524 976 | ISIC_0035525 977 | ISIC_0035526 978 | ISIC_0035527 979 | ISIC_0035528 980 | ISIC_0035529 981 | ISIC_0035530 982 | ISIC_0035531 983 | ISIC_0035532 984 | ISIC_0035533 985 | ISIC_0035534 986 | ISIC_0035535 987 | ISIC_0035536 988 | ISIC_0035537 989 | ISIC_0035538 990 | ISIC_0035539 991 | ISIC_0035540 992 | ISIC_0035541 993 | ISIC_0035542 994 | ISIC_0035543 995 | ISIC_0035544 996 | ISIC_0035545 997 | ISIC_0035546 998 | ISIC_0035547 999 | ISIC_0035548 1000 | ISIC_0035550 1001 | ISIC_0035551 1002 | ISIC_0035552 1003 | ISIC_0035553 1004 | ISIC_0035554 1005 | ISIC_0035555 1006 | ISIC_0035556 1007 | ISIC_0035557 1008 | ISIC_0035558 1009 | ISIC_0035559 1010 | ISIC_0035560 1011 | ISIC_0035561 1012 | ISIC_0035562 1013 | ISIC_0035563 1014 | ISIC_0035564 1015 | ISIC_0035565 1016 | ISIC_0035566 1017 | ISIC_0035567 1018 | ISIC_0035568 1019 | ISIC_0035569 1020 | ISIC_0035570 1021 | ISIC_0035571 1022 | ISIC_0035572 1023 | ISIC_0035573 1024 | ISIC_0035574 1025 | ISIC_0035575 1026 | ISIC_0035576 1027 | ISIC_0035577 1028 | ISIC_0035578 1029 | ISIC_0035579 1030 | ISIC_0035580 1031 | ISIC_0035581 1032 | ISIC_0035582 1033 | ISIC_0035583 1034 | ISIC_0035584 1035 | ISIC_0035585 1036 | ISIC_0035586 1037 | ISIC_0035587 1038 | ISIC_0035588 1039 | ISIC_0035589 1040 | ISIC_0035590 1041 | ISIC_0035591 1042 | ISIC_0035592 1043 | ISIC_0035593 1044 | ISIC_0035594 1045 | ISIC_0035596 1046 | ISIC_0035597 1047 | ISIC_0035598 1048 | ISIC_0035599 1049 | ISIC_0035600 1050 | ISIC_0035601 1051 | ISIC_0035602 1052 | ISIC_0035603 1053 | ISIC_0035604 1054 | ISIC_0035605 1055 | ISIC_0035606 1056 | ISIC_0035607 1057 | ISIC_0035608 1058 | ISIC_0035609 1059 | ISIC_0035610 1060 | ISIC_0035611 1061 | ISIC_0035612 1062 | ISIC_0035613 1063 | ISIC_0035614 1064 | ISIC_0035615 1065 | ISIC_0035616 1066 | ISIC_0035617 1067 | ISIC_0035618 1068 | ISIC_0035619 1069 | ISIC_0035621 1070 | ISIC_0035622 1071 | ISIC_0035623 1072 | ISIC_0035624 1073 | ISIC_0035625 1074 | ISIC_0035626 1075 | ISIC_0035627 1076 | ISIC_0035628 1077 | ISIC_0035629 1078 | ISIC_0035630 1079 | ISIC_0035631 1080 | ISIC_0035632 1081 | ISIC_0035633 1082 | ISIC_0035634 1083 | ISIC_0035635 1084 | ISIC_0035636 1085 | ISIC_0035637 1086 | ISIC_0035638 1087 | ISIC_0035639 1088 | ISIC_0035640 1089 | ISIC_0035641 1090 | ISIC_0035642 1091 | ISIC_0035643 1092 | ISIC_0035644 1093 | ISIC_0035645 1094 | ISIC_0035646 1095 | ISIC_0035647 1096 | ISIC_0035648 1097 | ISIC_0035649 1098 | ISIC_0035650 1099 | ISIC_0035651 1100 | ISIC_0035652 1101 | ISIC_0035653 1102 | ISIC_0035654 1103 | ISIC_0035655 1104 | ISIC_0035656 1105 | ISIC_0035657 1106 | ISIC_0035658 1107 | ISIC_0035659 1108 | ISIC_0035660 1109 | ISIC_0035661 1110 | ISIC_0035662 1111 | ISIC_0035663 1112 | ISIC_0035664 1113 | ISIC_0035665 1114 | ISIC_0035666 1115 | ISIC_0035667 1116 | ISIC_0035668 1117 | ISIC_0035669 1118 | ISIC_0035670 1119 | ISIC_0035671 1120 | ISIC_0035672 1121 | ISIC_0035673 1122 | ISIC_0035674 1123 | ISIC_0035675 1124 | ISIC_0035676 1125 | ISIC_0035677 1126 | ISIC_0035678 1127 | ISIC_0035679 1128 | ISIC_0035680 1129 | ISIC_0035681 1130 | ISIC_0035682 1131 | ISIC_0035683 1132 | ISIC_0035684 1133 | ISIC_0035685 1134 | ISIC_0035686 1135 | ISIC_0035687 1136 | ISIC_0035688 1137 | ISIC_0035689 1138 | ISIC_0035690 1139 | ISIC_0035691 1140 | ISIC_0035692 1141 | ISIC_0035693 1142 | ISIC_0035694 1143 | ISIC_0035695 1144 | ISIC_0035696 1145 | ISIC_0035697 1146 | ISIC_0035698 1147 | ISIC_0035699 1148 | ISIC_0035700 1149 | ISIC_0035701 1150 | ISIC_0035702 1151 | ISIC_0035703 1152 | ISIC_0035704 1153 | ISIC_0035705 1154 | ISIC_0035706 1155 | ISIC_0035707 1156 | ISIC_0035708 1157 | ISIC_0035709 1158 | ISIC_0035710 1159 | ISIC_0035711 1160 | ISIC_0035712 1161 | ISIC_0035713 1162 | ISIC_0035714 1163 | ISIC_0035715 1164 | ISIC_0035716 1165 | ISIC_0035717 1166 | ISIC_0035718 1167 | ISIC_0035719 1168 | ISIC_0035720 1169 | ISIC_0035721 1170 | ISIC_0035722 1171 | ISIC_0035723 1172 | ISIC_0035724 1173 | ISIC_0035725 1174 | ISIC_0035726 1175 | ISIC_0035727 1176 | ISIC_0035728 1177 | ISIC_0035729 1178 | ISIC_0035730 1179 | ISIC_0035731 1180 | ISIC_0035732 1181 | ISIC_0035733 1182 | ISIC_0035734 1183 | ISIC_0035735 1184 | ISIC_0035736 1185 | ISIC_0035737 1186 | ISIC_0035738 1187 | ISIC_0035739 1188 | ISIC_0035740 1189 | ISIC_0035741 1190 | ISIC_0035742 1191 | ISIC_0035743 1192 | ISIC_0035744 1193 | ISIC_0035745 1194 | ISIC_0035746 1195 | ISIC_0035747 1196 | ISIC_0035748 1197 | ISIC_0035749 1198 | ISIC_0035750 1199 | ISIC_0035751 1200 | ISIC_0035752 1201 | ISIC_0035753 1202 | ISIC_0035754 1203 | ISIC_0035755 1204 | ISIC_0035756 1205 | ISIC_0035757 1206 | ISIC_0035758 1207 | ISIC_0035759 1208 | ISIC_0035760 1209 | ISIC_0035761 1210 | ISIC_0035762 1211 | ISIC_0035763 1212 | ISIC_0035764 1213 | ISIC_0035765 1214 | ISIC_0035766 1215 | ISIC_0035767 1216 | ISIC_0035768 1217 | ISIC_0035769 1218 | ISIC_0035770 1219 | ISIC_0035771 1220 | ISIC_0035772 1221 | ISIC_0035773 1222 | ISIC_0035774 1223 | ISIC_0035775 1224 | ISIC_0035776 1225 | ISIC_0035777 1226 | ISIC_0035778 1227 | ISIC_0035779 1228 | ISIC_0035780 1229 | ISIC_0035781 1230 | ISIC_0035782 1231 | ISIC_0035783 1232 | ISIC_0035784 1233 | ISIC_0035785 1234 | ISIC_0035786 1235 | ISIC_0035787 1236 | ISIC_0035788 1237 | ISIC_0035789 1238 | ISIC_0035790 1239 | ISIC_0035791 1240 | ISIC_0035792 1241 | ISIC_0035793 1242 | ISIC_0035794 1243 | ISIC_0035795 1244 | ISIC_0035796 1245 | ISIC_0035797 1246 | ISIC_0035798 1247 | ISIC_0035799 1248 | ISIC_0035800 1249 | ISIC_0035801 1250 | ISIC_0035802 1251 | ISIC_0035803 1252 | ISIC_0035804 1253 | ISIC_0035805 1254 | ISIC_0035806 1255 | ISIC_0035807 1256 | ISIC_0035808 1257 | ISIC_0035809 1258 | ISIC_0035810 1259 | ISIC_0035811 1260 | ISIC_0035812 1261 | ISIC_0035813 1262 | ISIC_0035814 1263 | ISIC_0035815 1264 | ISIC_0035816 1265 | ISIC_0035817 1266 | ISIC_0035818 1267 | ISIC_0035819 1268 | ISIC_0035820 1269 | ISIC_0035821 1270 | ISIC_0035822 1271 | ISIC_0035823 1272 | ISIC_0035824 1273 | ISIC_0035825 1274 | ISIC_0035826 1275 | ISIC_0035827 1276 | ISIC_0035828 1277 | ISIC_0035829 1278 | ISIC_0035830 1279 | ISIC_0035831 1280 | ISIC_0035832 1281 | ISIC_0035833 1282 | ISIC_0035834 1283 | ISIC_0035835 1284 | ISIC_0035836 1285 | ISIC_0035837 1286 | ISIC_0035838 1287 | ISIC_0035839 1288 | ISIC_0035840 1289 | ISIC_0035841 1290 | ISIC_0035842 1291 | ISIC_0035843 1292 | ISIC_0035844 1293 | ISIC_0035845 1294 | ISIC_0035846 1295 | ISIC_0035847 1296 | ISIC_0035848 1297 | ISIC_0035849 1298 | ISIC_0035850 1299 | ISIC_0035851 1300 | ISIC_0035852 1301 | ISIC_0035853 1302 | ISIC_0035854 1303 | ISIC_0035855 1304 | ISIC_0035856 1305 | ISIC_0035857 1306 | ISIC_0035858 1307 | ISIC_0035859 1308 | ISIC_0035860 1309 | ISIC_0035861 1310 | ISIC_0035862 1311 | ISIC_0035863 1312 | ISIC_0035864 1313 | ISIC_0035865 1314 | ISIC_0035866 1315 | ISIC_0035867 1316 | ISIC_0035868 1317 | ISIC_0035869 1318 | ISIC_0035870 1319 | ISIC_0035871 1320 | ISIC_0035872 1321 | ISIC_0035873 1322 | ISIC_0035874 1323 | ISIC_0035875 1324 | ISIC_0035876 1325 | ISIC_0035877 1326 | ISIC_0035878 1327 | ISIC_0035879 1328 | ISIC_0035880 1329 | ISIC_0035881 1330 | ISIC_0035882 1331 | ISIC_0035883 1332 | ISIC_0035884 1333 | ISIC_0035885 1334 | ISIC_0035886 1335 | ISIC_0035887 1336 | ISIC_0035888 1337 | ISIC_0035889 1338 | ISIC_0035890 1339 | ISIC_0035891 1340 | ISIC_0035892 1341 | ISIC_0035893 1342 | ISIC_0035894 1343 | ISIC_0035895 1344 | ISIC_0035896 1345 | ISIC_0035897 1346 | ISIC_0035898 1347 | ISIC_0035899 1348 | ISIC_0035900 1349 | ISIC_0035901 1350 | ISIC_0035902 1351 | ISIC_0035903 1352 | ISIC_0035904 1353 | ISIC_0035905 1354 | ISIC_0035906 1355 | ISIC_0035907 1356 | ISIC_0035908 1357 | ISIC_0035909 1358 | ISIC_0035910 1359 | ISIC_0035911 1360 | ISIC_0035912 1361 | ISIC_0035913 1362 | ISIC_0035914 1363 | ISIC_0035915 1364 | ISIC_0035916 1365 | ISIC_0035917 1366 | ISIC_0035918 1367 | ISIC_0035919 1368 | ISIC_0035920 1369 | ISIC_0035921 1370 | ISIC_0035922 1371 | ISIC_0035923 1372 | ISIC_0035924 1373 | ISIC_0035925 1374 | ISIC_0035926 1375 | ISIC_0035927 1376 | ISIC_0035928 1377 | ISIC_0035929 1378 | ISIC_0035930 1379 | ISIC_0035931 1380 | ISIC_0035932 1381 | ISIC_0035933 1382 | ISIC_0035934 1383 | ISIC_0035935 1384 | ISIC_0035936 1385 | ISIC_0035937 1386 | ISIC_0035938 1387 | ISIC_0035939 1388 | ISIC_0035940 1389 | ISIC_0035941 1390 | ISIC_0035942 1391 | ISIC_0035943 1392 | ISIC_0035944 1393 | ISIC_0035945 1394 | ISIC_0035946 1395 | ISIC_0035947 1396 | ISIC_0035948 1397 | ISIC_0035949 1398 | ISIC_0035950 1399 | ISIC_0035951 1400 | ISIC_0035952 1401 | ISIC_0035953 1402 | ISIC_0035954 1403 | ISIC_0035955 1404 | ISIC_0035956 1405 | ISIC_0035957 1406 | ISIC_0035958 1407 | ISIC_0035959 1408 | ISIC_0035960 1409 | ISIC_0035961 1410 | ISIC_0035962 1411 | ISIC_0035963 1412 | ISIC_0035964 1413 | ISIC_0035965 1414 | ISIC_0035966 1415 | ISIC_0035967 1416 | ISIC_0035968 1417 | ISIC_0035969 1418 | ISIC_0035970 1419 | ISIC_0035971 1420 | ISIC_0035972 1421 | ISIC_0035973 1422 | ISIC_0035974 1423 | ISIC_0035975 1424 | ISIC_0035976 1425 | ISIC_0035977 1426 | ISIC_0035978 1427 | ISIC_0035979 1428 | ISIC_0035980 1429 | ISIC_0035981 1430 | ISIC_0035982 1431 | ISIC_0035983 1432 | ISIC_0035984 1433 | ISIC_0035985 1434 | ISIC_0035986 1435 | ISIC_0035987 1436 | ISIC_0035988 1437 | ISIC_0035989 1438 | ISIC_0035990 1439 | ISIC_0035991 1440 | ISIC_0035992 1441 | ISIC_0035993 1442 | ISIC_0035994 1443 | ISIC_0035995 1444 | ISIC_0035996 1445 | ISIC_0035997 1446 | ISIC_0035998 1447 | ISIC_0035999 1448 | ISIC_0036000 1449 | ISIC_0036001 1450 | ISIC_0036002 1451 | ISIC_0036003 1452 | ISIC_0036004 1453 | ISIC_0036005 1454 | ISIC_0036006 1455 | ISIC_0036007 1456 | ISIC_0036008 1457 | ISIC_0036009 1458 | ISIC_0036010 1459 | ISIC_0036011 1460 | ISIC_0036012 1461 | ISIC_0036013 1462 | ISIC_0036014 1463 | ISIC_0036015 1464 | ISIC_0036016 1465 | ISIC_0036017 1466 | ISIC_0036018 1467 | ISIC_0036019 1468 | ISIC_0036020 1469 | ISIC_0036021 1470 | ISIC_0036022 1471 | ISIC_0036023 1472 | ISIC_0036024 1473 | ISIC_0036025 1474 | ISIC_0036026 1475 | ISIC_0036027 1476 | ISIC_0036028 1477 | ISIC_0036029 1478 | ISIC_0036030 1479 | ISIC_0036031 1480 | ISIC_0036032 1481 | ISIC_0036033 1482 | ISIC_0036034 1483 | ISIC_0036035 1484 | ISIC_0036036 1485 | ISIC_0036037 1486 | ISIC_0036038 1487 | ISIC_0036039 1488 | ISIC_0036040 1489 | ISIC_0036041 1490 | ISIC_0036042 1491 | ISIC_0036043 1492 | ISIC_0036044 1493 | ISIC_0036045 1494 | ISIC_0036046 1495 | ISIC_0036047 1496 | ISIC_0036048 1497 | ISIC_0036049 1498 | ISIC_0036050 1499 | ISIC_0036051 1500 | ISIC_0036052 1501 | ISIC_0036053 1502 | ISIC_0036054 1503 | ISIC_0036055 1504 | ISIC_0036056 1505 | ISIC_0036057 1506 | ISIC_0036058 1507 | ISIC_0036059 1508 | ISIC_0036060 1509 | ISIC_0036061 1510 | ISIC_0036062 1511 | ISIC_0036063 1512 | ISIC_0036064 1513 | -------------------------------------------------------------------------------- /splits/split_task3_validation_challenge.txt: -------------------------------------------------------------------------------- 1 | ISIC_0034321 2 | ISIC_0034322 3 | ISIC_0034323 4 | ISIC_0034324 5 | ISIC_0034325 6 | ISIC_0034326 7 | ISIC_0034328 8 | ISIC_0034329 9 | ISIC_0034330 10 | ISIC_0034331 11 | ISIC_0034332 12 | ISIC_0034333 13 | ISIC_0034334 14 | ISIC_0034335 15 | ISIC_0034336 16 | ISIC_0034337 17 | ISIC_0034338 18 | ISIC_0034339 19 | ISIC_0034340 20 | ISIC_0034341 21 | ISIC_0034342 22 | ISIC_0034343 23 | ISIC_0034344 24 | ISIC_0034345 25 | ISIC_0034346 26 | ISIC_0034347 27 | ISIC_0034348 28 | ISIC_0034349 29 | ISIC_0034350 30 | ISIC_0034351 31 | ISIC_0034352 32 | ISIC_0034354 33 | ISIC_0034355 34 | ISIC_0034356 35 | ISIC_0034357 36 | ISIC_0034359 37 | ISIC_0034360 38 | ISIC_0034361 39 | ISIC_0034362 40 | ISIC_0034363 41 | ISIC_0034364 42 | ISIC_0034365 43 | ISIC_0034366 44 | ISIC_0034367 45 | ISIC_0034368 46 | ISIC_0034369 47 | ISIC_0034370 48 | ISIC_0034371 49 | ISIC_0034372 50 | ISIC_0034374 51 | ISIC_0034375 52 | ISIC_0034376 53 | ISIC_0034377 54 | ISIC_0034378 55 | ISIC_0034379 56 | ISIC_0034380 57 | ISIC_0034381 58 | ISIC_0034382 59 | ISIC_0034383 60 | ISIC_0034385 61 | ISIC_0034386 62 | ISIC_0034387 63 | ISIC_0034389 64 | ISIC_0034390 65 | ISIC_0034391 66 | ISIC_0034392 67 | ISIC_0034393 68 | ISIC_0034394 69 | ISIC_0034395 70 | ISIC_0034396 71 | ISIC_0034397 72 | ISIC_0034398 73 | ISIC_0034399 74 | ISIC_0034400 75 | ISIC_0034401 76 | ISIC_0034402 77 | ISIC_0034403 78 | ISIC_0034404 79 | ISIC_0034405 80 | ISIC_0034406 81 | ISIC_0034407 82 | ISIC_0034408 83 | ISIC_0034409 84 | ISIC_0034410 85 | ISIC_0034411 86 | ISIC_0034412 87 | ISIC_0034413 88 | ISIC_0034414 89 | ISIC_0034415 90 | ISIC_0034416 91 | ISIC_0034417 92 | ISIC_0034418 93 | ISIC_0034419 94 | ISIC_0034420 95 | ISIC_0034421 96 | ISIC_0034422 97 | ISIC_0034423 98 | ISIC_0034424 99 | ISIC_0034425 100 | ISIC_0034426 101 | ISIC_0034427 102 | ISIC_0034428 103 | ISIC_0034429 104 | ISIC_0034430 105 | ISIC_0034431 106 | ISIC_0034433 107 | ISIC_0034434 108 | ISIC_0034435 109 | ISIC_0034436 110 | ISIC_0034437 111 | ISIC_0034438 112 | ISIC_0034439 113 | ISIC_0034440 114 | ISIC_0034441 115 | ISIC_0034442 116 | ISIC_0034443 117 | ISIC_0034444 118 | ISIC_0034445 119 | ISIC_0034446 120 | ISIC_0034447 121 | ISIC_0034448 122 | ISIC_0034449 123 | ISIC_0034450 124 | ISIC_0034451 125 | ISIC_0034452 126 | ISIC_0034453 127 | ISIC_0034454 128 | ISIC_0034455 129 | ISIC_0034456 130 | ISIC_0034457 131 | ISIC_0034458 132 | ISIC_0034459 133 | ISIC_0034460 134 | ISIC_0034461 135 | ISIC_0034463 136 | ISIC_0034464 137 | ISIC_0034465 138 | ISIC_0034466 139 | ISIC_0034467 140 | ISIC_0034468 141 | ISIC_0034469 142 | ISIC_0034470 143 | ISIC_0034471 144 | ISIC_0034472 145 | ISIC_0034474 146 | ISIC_0034475 147 | ISIC_0034476 148 | ISIC_0034477 149 | ISIC_0034478 150 | ISIC_0034480 151 | ISIC_0034481 152 | ISIC_0034482 153 | ISIC_0034483 154 | ISIC_0034484 155 | ISIC_0034485 156 | ISIC_0034486 157 | ISIC_0034487 158 | ISIC_0034488 159 | ISIC_0034489 160 | ISIC_0034490 161 | ISIC_0034491 162 | ISIC_0034492 163 | ISIC_0034493 164 | ISIC_0034494 165 | ISIC_0034495 166 | ISIC_0034496 167 | ISIC_0034497 168 | ISIC_0034498 169 | ISIC_0034499 170 | ISIC_0034500 171 | ISIC_0034501 172 | ISIC_0034502 173 | ISIC_0034503 174 | ISIC_0034504 175 | ISIC_0034505 176 | ISIC_0034506 177 | ISIC_0034507 178 | ISIC_0034508 179 | ISIC_0034509 180 | ISIC_0034510 181 | ISIC_0034511 182 | ISIC_0034512 183 | ISIC_0034513 184 | ISIC_0034514 185 | ISIC_0034515 186 | ISIC_0034516 187 | ISIC_0034517 188 | ISIC_0034518 189 | ISIC_0034519 190 | ISIC_0034520 191 | ISIC_0034521 192 | ISIC_0034522 193 | ISIC_0034523 194 | -------------------------------------------------------------------------------- /splits/split_task3_validation_only_1.txt: -------------------------------------------------------------------------------- 1 | ISIC_0024320 2 | ISIC_0024325 3 | ISIC_0024349 4 | ISIC_0024358 5 | ISIC_0024378 6 | ISIC_0024412 7 | ISIC_0024416 8 | ISIC_0024451 9 | ISIC_0024457 10 | ISIC_0024459 11 | ISIC_0024464 12 | ISIC_0024482 13 | ISIC_0024528 14 | ISIC_0024532 15 | ISIC_0024537 16 | ISIC_0024542 17 | ISIC_0024553 18 | ISIC_0024555 19 | ISIC_0024565 20 | ISIC_0024568 21 | ISIC_0024598 22 | ISIC_0024613 23 | ISIC_0024616 24 | ISIC_0024624 25 | ISIC_0024625 26 | ISIC_0024626 27 | ISIC_0024627 28 | ISIC_0024633 29 | ISIC_0024648 30 | ISIC_0024653 31 | ISIC_0024655 32 | ISIC_0024664 33 | ISIC_0024675 34 | ISIC_0024699 35 | ISIC_0024716 36 | ISIC_0024722 37 | ISIC_0024749 38 | ISIC_0024751 39 | ISIC_0024758 40 | ISIC_0024763 41 | ISIC_0024768 42 | ISIC_0024772 43 | ISIC_0024779 44 | ISIC_0024781 45 | ISIC_0024783 46 | ISIC_0024785 47 | ISIC_0024789 48 | ISIC_0024802 49 | ISIC_0024815 50 | ISIC_0024816 51 | ISIC_0024830 52 | ISIC_0024832 53 | ISIC_0024847 54 | ISIC_0024871 55 | ISIC_0024881 56 | ISIC_0024899 57 | ISIC_0024901 58 | ISIC_0024911 59 | ISIC_0024913 60 | ISIC_0024920 61 | ISIC_0024926 62 | ISIC_0024928 63 | ISIC_0024930 64 | ISIC_0024933 65 | ISIC_0024956 66 | ISIC_0024972 67 | ISIC_0024973 68 | ISIC_0024982 69 | ISIC_0024996 70 | ISIC_0025011 71 | ISIC_0025012 72 | ISIC_0025037 73 | ISIC_0025056 74 | ISIC_0025062 75 | ISIC_0025076 76 | ISIC_0025081 77 | ISIC_0025083 78 | ISIC_0025124 79 | ISIC_0025129 80 | ISIC_0025133 81 | ISIC_0025135 82 | ISIC_0025142 83 | ISIC_0025143 84 | ISIC_0025145 85 | ISIC_0025151 86 | ISIC_0025167 87 | ISIC_0025172 88 | ISIC_0025180 89 | ISIC_0025183 90 | ISIC_0025187 91 | ISIC_0025248 92 | ISIC_0025251 93 | ISIC_0025257 94 | ISIC_0025263 95 | ISIC_0025268 96 | ISIC_0025270 97 | ISIC_0025273 98 | ISIC_0025277 99 | ISIC_0025282 100 | ISIC_0025300 101 | ISIC_0025302 102 | ISIC_0025305 103 | ISIC_0025308 104 | ISIC_0025319 105 | ISIC_0025351 106 | ISIC_0025355 107 | ISIC_0025381 108 | ISIC_0025400 109 | ISIC_0025410 110 | ISIC_0025411 111 | ISIC_0025413 112 | ISIC_0025422 113 | ISIC_0025431 114 | ISIC_0025445 115 | ISIC_0025458 116 | ISIC_0025464 117 | ISIC_0025469 118 | ISIC_0025480 119 | ISIC_0025484 120 | ISIC_0025499 121 | ISIC_0025527 122 | ISIC_0025531 123 | ISIC_0025532 124 | ISIC_0025547 125 | ISIC_0025559 126 | ISIC_0025567 127 | ISIC_0025590 128 | ISIC_0025611 129 | ISIC_0025613 130 | ISIC_0025615 131 | ISIC_0025621 132 | ISIC_0025629 133 | ISIC_0025633 134 | ISIC_0025642 135 | ISIC_0025646 136 | ISIC_0025681 137 | ISIC_0025687 138 | ISIC_0025693 139 | ISIC_0025694 140 | ISIC_0025702 141 | ISIC_0025706 142 | ISIC_0025715 143 | ISIC_0025727 144 | ISIC_0025736 145 | ISIC_0025738 146 | ISIC_0025751 147 | ISIC_0025757 148 | ISIC_0025761 149 | ISIC_0025774 150 | ISIC_0025798 151 | ISIC_0025799 152 | ISIC_0025806 153 | ISIC_0025824 154 | ISIC_0025831 155 | ISIC_0025840 156 | ISIC_0025842 157 | ISIC_0025845 158 | ISIC_0025851 159 | ISIC_0025876 160 | ISIC_0025883 161 | ISIC_0025891 162 | ISIC_0025896 163 | ISIC_0025901 164 | ISIC_0025924 165 | ISIC_0025929 166 | ISIC_0025946 167 | ISIC_0025949 168 | ISIC_0025952 169 | ISIC_0025975 170 | ISIC_0025997 171 | ISIC_0026020 172 | ISIC_0026022 173 | ISIC_0026035 174 | ISIC_0026053 175 | ISIC_0026056 176 | ISIC_0026063 177 | ISIC_0026068 178 | ISIC_0026089 179 | ISIC_0026095 180 | ISIC_0026099 181 | ISIC_0026102 182 | ISIC_0026107 183 | ISIC_0026114 184 | ISIC_0026123 185 | ISIC_0026125 186 | ISIC_0026126 187 | ISIC_0026128 188 | ISIC_0026141 189 | ISIC_0026143 190 | ISIC_0026150 191 | ISIC_0026151 192 | ISIC_0026153 193 | ISIC_0026173 194 | ISIC_0026179 195 | ISIC_0026198 196 | ISIC_0026203 197 | ISIC_0026237 198 | ISIC_0026243 199 | ISIC_0026278 200 | ISIC_0026289 201 | ISIC_0026298 202 | ISIC_0026299 203 | ISIC_0026316 204 | ISIC_0026319 205 | ISIC_0026337 206 | ISIC_0026340 207 | ISIC_0026351 208 | ISIC_0026367 209 | ISIC_0026369 210 | ISIC_0026370 211 | ISIC_0026374 212 | ISIC_0026386 213 | ISIC_0026403 214 | ISIC_0026406 215 | ISIC_0026416 216 | ISIC_0026429 217 | ISIC_0026439 218 | ISIC_0026453 219 | ISIC_0026467 220 | ISIC_0026476 221 | ISIC_0026477 222 | ISIC_0026489 223 | ISIC_0026492 224 | ISIC_0026496 225 | ISIC_0026521 226 | ISIC_0026523 227 | ISIC_0026529 228 | ISIC_0026535 229 | ISIC_0026536 230 | ISIC_0026539 231 | ISIC_0026565 232 | ISIC_0026569 233 | ISIC_0026583 234 | ISIC_0026587 235 | ISIC_0026629 236 | ISIC_0026649 237 | ISIC_0026652 238 | ISIC_0026677 239 | ISIC_0026684 240 | ISIC_0026687 241 | ISIC_0026702 242 | ISIC_0026704 243 | ISIC_0026705 244 | ISIC_0026715 245 | ISIC_0026718 246 | ISIC_0026725 247 | ISIC_0026738 248 | ISIC_0026739 249 | ISIC_0026741 250 | ISIC_0026744 251 | ISIC_0026755 252 | ISIC_0026758 253 | ISIC_0026777 254 | ISIC_0026778 255 | ISIC_0026781 256 | ISIC_0026842 257 | ISIC_0026845 258 | ISIC_0026851 259 | ISIC_0026855 260 | ISIC_0026857 261 | ISIC_0026864 262 | ISIC_0026871 263 | ISIC_0026896 264 | ISIC_0026902 265 | ISIC_0026914 266 | ISIC_0026922 267 | ISIC_0026940 268 | ISIC_0026944 269 | ISIC_0026953 270 | ISIC_0026958 271 | ISIC_0026965 272 | ISIC_0026984 273 | ISIC_0027000 274 | ISIC_0027041 275 | ISIC_0027045 276 | ISIC_0027046 277 | ISIC_0027049 278 | ISIC_0027057 279 | ISIC_0027072 280 | ISIC_0027077 281 | ISIC_0027079 282 | ISIC_0027082 283 | ISIC_0027084 284 | ISIC_0027101 285 | ISIC_0027110 286 | ISIC_0027148 287 | ISIC_0027156 288 | ISIC_0027157 289 | ISIC_0027167 290 | ISIC_0027173 291 | ISIC_0027205 292 | ISIC_0027210 293 | ISIC_0027211 294 | ISIC_0027218 295 | ISIC_0027220 296 | ISIC_0027221 297 | ISIC_0027234 298 | ISIC_0027248 299 | ISIC_0027267 300 | ISIC_0027280 301 | ISIC_0027311 302 | ISIC_0027314 303 | ISIC_0027324 304 | ISIC_0027330 305 | ISIC_0027344 306 | ISIC_0027346 307 | ISIC_0027347 308 | ISIC_0027355 309 | ISIC_0027387 310 | ISIC_0027395 311 | ISIC_0027429 312 | ISIC_0027440 313 | ISIC_0027444 314 | ISIC_0027455 315 | ISIC_0027457 316 | ISIC_0027470 317 | ISIC_0027479 318 | ISIC_0027483 319 | ISIC_0027484 320 | ISIC_0027491 321 | ISIC_0027500 322 | ISIC_0027507 323 | ISIC_0027508 324 | ISIC_0027512 325 | ISIC_0027526 326 | ISIC_0027541 327 | ISIC_0027544 328 | ISIC_0027547 329 | ISIC_0027550 330 | ISIC_0027564 331 | ISIC_0027567 332 | ISIC_0027588 333 | ISIC_0027601 334 | ISIC_0027631 335 | ISIC_0027633 336 | ISIC_0027644 337 | ISIC_0027646 338 | ISIC_0027676 339 | ISIC_0027681 340 | ISIC_0027700 341 | ISIC_0027701 342 | ISIC_0027725 343 | ISIC_0027752 344 | ISIC_0027753 345 | ISIC_0027756 346 | ISIC_0027759 347 | ISIC_0027770 348 | ISIC_0027771 349 | ISIC_0027773 350 | ISIC_0027782 351 | ISIC_0027790 352 | ISIC_0027800 353 | ISIC_0027804 354 | ISIC_0027807 355 | ISIC_0027809 356 | ISIC_0027820 357 | ISIC_0027823 358 | ISIC_0027826 359 | ISIC_0027841 360 | ISIC_0027848 361 | ISIC_0027853 362 | ISIC_0027857 363 | ISIC_0027871 364 | ISIC_0027883 365 | ISIC_0027886 366 | ISIC_0027887 367 | ISIC_0027894 368 | ISIC_0027915 369 | ISIC_0027929 370 | ISIC_0027931 371 | ISIC_0027949 372 | ISIC_0027951 373 | ISIC_0027953 374 | ISIC_0027973 375 | ISIC_0027991 376 | ISIC_0027996 377 | ISIC_0027997 378 | ISIC_0027998 379 | ISIC_0028000 380 | ISIC_0028014 381 | ISIC_0028015 382 | ISIC_0028016 383 | ISIC_0028036 384 | ISIC_0028037 385 | ISIC_0028045 386 | ISIC_0028079 387 | ISIC_0028083 388 | ISIC_0028086 389 | ISIC_0028102 390 | ISIC_0028107 391 | ISIC_0028109 392 | ISIC_0028148 393 | ISIC_0028166 394 | ISIC_0028168 395 | ISIC_0028186 396 | ISIC_0028195 397 | ISIC_0028204 398 | ISIC_0028218 399 | ISIC_0028228 400 | ISIC_0028232 401 | ISIC_0028238 402 | ISIC_0028271 403 | ISIC_0028285 404 | ISIC_0028300 405 | ISIC_0028310 406 | ISIC_0028325 407 | ISIC_0028328 408 | ISIC_0028334 409 | ISIC_0028340 410 | ISIC_0028344 411 | ISIC_0028347 412 | ISIC_0028353 413 | ISIC_0028369 414 | ISIC_0028393 415 | ISIC_0028400 416 | ISIC_0028418 417 | ISIC_0028423 418 | ISIC_0028425 419 | ISIC_0028438 420 | ISIC_0028443 421 | ISIC_0028451 422 | ISIC_0028461 423 | ISIC_0028464 424 | ISIC_0028471 425 | ISIC_0028474 426 | ISIC_0028523 427 | ISIC_0028536 428 | ISIC_0028537 429 | ISIC_0028545 430 | ISIC_0028546 431 | ISIC_0028580 432 | ISIC_0028585 433 | ISIC_0028587 434 | ISIC_0028599 435 | ISIC_0028604 436 | ISIC_0028617 437 | ISIC_0028625 438 | ISIC_0028636 439 | ISIC_0028645 440 | ISIC_0028647 441 | ISIC_0028650 442 | ISIC_0028654 443 | ISIC_0028656 444 | ISIC_0028673 445 | ISIC_0028706 446 | ISIC_0028709 447 | ISIC_0028713 448 | ISIC_0028725 449 | ISIC_0028734 450 | ISIC_0028745 451 | ISIC_0028758 452 | ISIC_0028760 453 | ISIC_0028772 454 | ISIC_0028778 455 | ISIC_0028779 456 | ISIC_0028798 457 | ISIC_0028811 458 | ISIC_0028812 459 | ISIC_0028816 460 | ISIC_0028830 461 | ISIC_0028842 462 | ISIC_0028865 463 | ISIC_0028870 464 | ISIC_0028876 465 | ISIC_0028878 466 | ISIC_0028900 467 | ISIC_0028912 468 | ISIC_0028918 469 | ISIC_0028920 470 | ISIC_0028922 471 | ISIC_0028924 472 | ISIC_0028958 473 | ISIC_0028971 474 | ISIC_0028975 475 | ISIC_0028992 476 | ISIC_0028997 477 | ISIC_0029001 478 | ISIC_0029013 479 | ISIC_0029029 480 | ISIC_0029038 481 | ISIC_0029044 482 | ISIC_0029052 483 | ISIC_0029058 484 | ISIC_0029068 485 | ISIC_0029107 486 | ISIC_0029119 487 | ISIC_0029138 488 | ISIC_0029143 489 | ISIC_0029144 490 | ISIC_0029165 491 | ISIC_0029174 492 | ISIC_0029176 493 | ISIC_0029188 494 | ISIC_0029193 495 | ISIC_0029201 496 | ISIC_0029203 497 | ISIC_0029211 498 | ISIC_0029216 499 | ISIC_0029222 500 | ISIC_0029229 501 | ISIC_0029239 502 | ISIC_0029240 503 | ISIC_0029249 504 | ISIC_0029263 505 | ISIC_0029275 506 | ISIC_0029305 507 | ISIC_0029309 508 | ISIC_0029325 509 | ISIC_0029329 510 | ISIC_0029352 511 | ISIC_0029367 512 | ISIC_0029369 513 | ISIC_0029382 514 | ISIC_0029385 515 | ISIC_0029386 516 | ISIC_0029389 517 | ISIC_0029400 518 | ISIC_0029416 519 | ISIC_0029418 520 | ISIC_0029440 521 | ISIC_0029450 522 | ISIC_0029456 523 | ISIC_0029461 524 | ISIC_0029466 525 | ISIC_0029474 526 | ISIC_0029475 527 | ISIC_0029476 528 | ISIC_0029491 529 | ISIC_0029507 530 | ISIC_0029509 531 | ISIC_0029523 532 | ISIC_0029525 533 | ISIC_0029527 534 | ISIC_0029535 535 | ISIC_0029555 536 | ISIC_0029584 537 | ISIC_0029589 538 | ISIC_0029606 539 | ISIC_0029627 540 | ISIC_0029634 541 | ISIC_0029636 542 | ISIC_0029645 543 | ISIC_0029646 544 | ISIC_0029661 545 | ISIC_0029662 546 | ISIC_0029687 547 | ISIC_0029688 548 | ISIC_0029689 549 | ISIC_0029702 550 | ISIC_0029714 551 | ISIC_0029737 552 | ISIC_0029739 553 | ISIC_0029755 554 | ISIC_0029764 555 | ISIC_0029767 556 | ISIC_0029768 557 | ISIC_0029779 558 | ISIC_0029785 559 | ISIC_0029801 560 | ISIC_0029805 561 | ISIC_0029813 562 | ISIC_0029815 563 | ISIC_0029817 564 | ISIC_0029821 565 | ISIC_0029839 566 | ISIC_0029842 567 | ISIC_0029853 568 | ISIC_0029877 569 | ISIC_0029884 570 | ISIC_0029885 571 | ISIC_0029891 572 | ISIC_0029894 573 | ISIC_0029911 574 | ISIC_0029918 575 | ISIC_0029933 576 | ISIC_0029937 577 | ISIC_0029941 578 | ISIC_0029951 579 | ISIC_0029954 580 | ISIC_0029957 581 | ISIC_0029961 582 | ISIC_0029966 583 | ISIC_0029979 584 | ISIC_0029982 585 | ISIC_0029993 586 | ISIC_0029995 587 | ISIC_0029997 588 | ISIC_0030002 589 | ISIC_0030025 590 | ISIC_0030033 591 | ISIC_0030039 592 | ISIC_0030040 593 | ISIC_0030070 594 | ISIC_0030083 595 | ISIC_0030093 596 | ISIC_0030095 597 | ISIC_0030103 598 | ISIC_0030134 599 | ISIC_0030138 600 | ISIC_0030145 601 | ISIC_0030146 602 | ISIC_0030172 603 | ISIC_0030177 604 | ISIC_0030183 605 | ISIC_0030204 606 | ISIC_0030208 607 | ISIC_0030209 608 | ISIC_0030231 609 | ISIC_0030235 610 | ISIC_0030257 611 | ISIC_0030262 612 | ISIC_0030269 613 | ISIC_0030280 614 | ISIC_0030286 615 | ISIC_0030295 616 | ISIC_0030297 617 | ISIC_0030309 618 | ISIC_0030313 619 | ISIC_0030322 620 | ISIC_0030339 621 | ISIC_0030378 622 | ISIC_0030382 623 | ISIC_0030386 624 | ISIC_0030400 625 | ISIC_0030404 626 | ISIC_0030437 627 | ISIC_0030438 628 | ISIC_0030444 629 | ISIC_0030445 630 | ISIC_0030447 631 | ISIC_0030486 632 | ISIC_0030494 633 | ISIC_0030495 634 | ISIC_0030517 635 | ISIC_0030521 636 | ISIC_0030522 637 | ISIC_0030540 638 | ISIC_0030542 639 | ISIC_0030544 640 | ISIC_0030560 641 | ISIC_0030564 642 | ISIC_0030572 643 | ISIC_0030582 644 | ISIC_0030602 645 | ISIC_0030605 646 | ISIC_0030617 647 | ISIC_0030627 648 | ISIC_0030640 649 | ISIC_0030641 650 | ISIC_0030671 651 | ISIC_0030679 652 | ISIC_0030686 653 | ISIC_0030697 654 | ISIC_0030698 655 | ISIC_0030701 656 | ISIC_0030710 657 | ISIC_0030718 658 | ISIC_0030721 659 | ISIC_0030727 660 | ISIC_0030737 661 | ISIC_0030756 662 | ISIC_0030758 663 | ISIC_0030779 664 | ISIC_0030795 665 | ISIC_0030797 666 | ISIC_0030798 667 | ISIC_0030803 668 | ISIC_0030822 669 | ISIC_0030830 670 | ISIC_0030832 671 | ISIC_0030847 672 | ISIC_0030861 673 | ISIC_0030876 674 | ISIC_0030891 675 | ISIC_0030892 676 | ISIC_0030896 677 | ISIC_0030900 678 | ISIC_0030903 679 | ISIC_0030917 680 | ISIC_0030924 681 | ISIC_0030937 682 | ISIC_0030945 683 | ISIC_0030949 684 | ISIC_0030957 685 | ISIC_0030958 686 | ISIC_0030962 687 | ISIC_0030973 688 | ISIC_0030985 689 | ISIC_0030992 690 | ISIC_0031011 691 | ISIC_0031023 692 | ISIC_0031050 693 | ISIC_0031052 694 | ISIC_0031071 695 | ISIC_0031082 696 | ISIC_0031098 697 | ISIC_0031104 698 | ISIC_0031106 699 | ISIC_0031107 700 | ISIC_0031117 701 | ISIC_0031119 702 | ISIC_0031120 703 | ISIC_0031131 704 | ISIC_0031143 705 | ISIC_0031154 706 | ISIC_0031155 707 | ISIC_0031158 708 | ISIC_0031162 709 | ISIC_0031174 710 | ISIC_0031190 711 | ISIC_0031197 712 | ISIC_0031202 713 | ISIC_0031214 714 | ISIC_0031222 715 | ISIC_0031228 716 | ISIC_0031230 717 | ISIC_0031234 718 | ISIC_0031236 719 | ISIC_0031238 720 | ISIC_0031241 721 | ISIC_0031260 722 | ISIC_0031262 723 | ISIC_0031264 724 | ISIC_0031265 725 | ISIC_0031268 726 | ISIC_0031270 727 | ISIC_0031271 728 | ISIC_0031274 729 | ISIC_0031276 730 | ISIC_0031289 731 | ISIC_0031290 732 | ISIC_0031299 733 | ISIC_0031313 734 | ISIC_0031321 735 | ISIC_0031382 736 | ISIC_0031394 737 | ISIC_0031400 738 | ISIC_0031403 739 | ISIC_0031404 740 | ISIC_0031408 741 | ISIC_0031434 742 | ISIC_0031449 743 | ISIC_0031452 744 | ISIC_0031467 745 | ISIC_0031469 746 | ISIC_0031473 747 | ISIC_0031474 748 | ISIC_0031475 749 | ISIC_0031489 750 | ISIC_0031490 751 | ISIC_0031498 752 | ISIC_0031509 753 | ISIC_0031521 754 | ISIC_0031549 755 | ISIC_0031561 756 | ISIC_0031562 757 | ISIC_0031575 758 | ISIC_0031590 759 | ISIC_0031591 760 | ISIC_0031609 761 | ISIC_0031622 762 | ISIC_0031642 763 | ISIC_0031647 764 | ISIC_0031670 765 | ISIC_0031680 766 | ISIC_0031695 767 | ISIC_0031706 768 | ISIC_0031719 769 | ISIC_0031736 770 | ISIC_0031740 771 | ISIC_0031750 772 | ISIC_0031755 773 | ISIC_0031779 774 | ISIC_0031817 775 | ISIC_0031824 776 | ISIC_0031846 777 | ISIC_0031855 778 | ISIC_0031858 779 | ISIC_0031863 780 | ISIC_0031866 781 | ISIC_0031867 782 | ISIC_0031870 783 | ISIC_0031875 784 | ISIC_0031876 785 | ISIC_0031889 786 | ISIC_0031894 787 | ISIC_0031896 788 | ISIC_0031907 789 | ISIC_0031920 790 | ISIC_0031932 791 | ISIC_0031956 792 | ISIC_0031973 793 | ISIC_0031976 794 | ISIC_0031995 795 | ISIC_0031996 796 | ISIC_0032006 797 | ISIC_0032009 798 | ISIC_0032016 799 | ISIC_0032028 800 | ISIC_0032039 801 | ISIC_0032056 802 | ISIC_0032075 803 | ISIC_0032080 804 | ISIC_0032096 805 | ISIC_0032102 806 | ISIC_0032108 807 | ISIC_0032125 808 | ISIC_0032145 809 | ISIC_0032148 810 | ISIC_0032185 811 | ISIC_0032188 812 | ISIC_0032198 813 | ISIC_0032201 814 | ISIC_0032202 815 | ISIC_0032223 816 | ISIC_0032226 817 | ISIC_0032230 818 | ISIC_0032243 819 | ISIC_0032259 820 | ISIC_0032269 821 | ISIC_0032302 822 | ISIC_0032317 823 | ISIC_0032339 824 | ISIC_0032344 825 | ISIC_0032347 826 | ISIC_0032387 827 | ISIC_0032388 828 | ISIC_0032394 829 | ISIC_0032415 830 | ISIC_0032421 831 | ISIC_0032429 832 | ISIC_0032435 833 | ISIC_0032443 834 | ISIC_0032451 835 | ISIC_0032456 836 | ISIC_0032471 837 | ISIC_0032477 838 | ISIC_0032478 839 | ISIC_0032488 840 | ISIC_0032492 841 | ISIC_0032505 842 | ISIC_0032514 843 | ISIC_0032516 844 | ISIC_0032531 845 | ISIC_0032532 846 | ISIC_0032553 847 | ISIC_0032560 848 | ISIC_0032566 849 | ISIC_0032568 850 | ISIC_0032572 851 | ISIC_0032588 852 | ISIC_0032592 853 | ISIC_0032594 854 | ISIC_0032596 855 | ISIC_0032617 856 | ISIC_0032624 857 | ISIC_0032633 858 | ISIC_0032640 859 | ISIC_0032641 860 | ISIC_0032645 861 | ISIC_0032646 862 | ISIC_0032649 863 | ISIC_0032656 864 | ISIC_0032666 865 | ISIC_0032671 866 | ISIC_0032677 867 | ISIC_0032683 868 | ISIC_0032700 869 | ISIC_0032721 870 | ISIC_0032739 871 | ISIC_0032740 872 | ISIC_0032762 873 | ISIC_0032765 874 | ISIC_0032787 875 | ISIC_0032797 876 | ISIC_0032807 877 | ISIC_0032809 878 | ISIC_0032810 879 | ISIC_0032811 880 | ISIC_0032813 881 | ISIC_0032817 882 | ISIC_0032819 883 | ISIC_0032820 884 | ISIC_0032852 885 | ISIC_0032854 886 | ISIC_0032856 887 | ISIC_0032857 888 | ISIC_0032858 889 | ISIC_0032860 890 | ISIC_0032874 891 | ISIC_0032890 892 | ISIC_0032893 893 | ISIC_0032905 894 | ISIC_0032906 895 | ISIC_0032914 896 | ISIC_0032933 897 | ISIC_0032934 898 | ISIC_0032938 899 | ISIC_0032947 900 | ISIC_0032970 901 | ISIC_0032981 902 | ISIC_0033000 903 | ISIC_0033013 904 | ISIC_0033014 905 | ISIC_0033024 906 | ISIC_0033067 907 | ISIC_0033093 908 | ISIC_0033099 909 | ISIC_0033101 910 | ISIC_0033105 911 | ISIC_0033118 912 | ISIC_0033125 913 | ISIC_0033126 914 | ISIC_0033132 915 | ISIC_0033147 916 | ISIC_0033157 917 | ISIC_0033176 918 | ISIC_0033188 919 | ISIC_0033193 920 | ISIC_0033195 921 | ISIC_0033220 922 | ISIC_0033224 923 | ISIC_0033225 924 | ISIC_0033251 925 | ISIC_0033259 926 | ISIC_0033295 927 | ISIC_0033300 928 | ISIC_0033308 929 | ISIC_0033309 930 | ISIC_0033311 931 | ISIC_0033345 932 | ISIC_0033354 933 | ISIC_0033357 934 | ISIC_0033360 935 | ISIC_0033402 936 | ISIC_0033403 937 | ISIC_0033427 938 | ISIC_0033433 939 | ISIC_0033434 940 | ISIC_0033437 941 | ISIC_0033439 942 | ISIC_0033473 943 | ISIC_0033479 944 | ISIC_0033491 945 | ISIC_0033500 946 | ISIC_0033501 947 | ISIC_0033511 948 | ISIC_0033522 949 | ISIC_0033537 950 | ISIC_0033546 951 | ISIC_0033554 952 | ISIC_0033557 953 | ISIC_0033566 954 | ISIC_0033584 955 | ISIC_0033613 956 | ISIC_0033614 957 | ISIC_0033615 958 | ISIC_0033616 959 | ISIC_0033627 960 | ISIC_0033637 961 | ISIC_0033660 962 | ISIC_0033665 963 | ISIC_0033680 964 | ISIC_0033685 965 | ISIC_0033688 966 | ISIC_0033690 967 | ISIC_0033716 968 | ISIC_0033727 969 | ISIC_0033747 970 | ISIC_0033753 971 | ISIC_0033754 972 | ISIC_0033768 973 | ISIC_0033798 974 | ISIC_0033803 975 | ISIC_0033810 976 | ISIC_0033818 977 | ISIC_0033821 978 | ISIC_0033822 979 | ISIC_0033832 980 | ISIC_0033844 981 | ISIC_0033850 982 | ISIC_0033866 983 | ISIC_0033872 984 | ISIC_0033883 985 | ISIC_0033891 986 | ISIC_0033892 987 | ISIC_0033896 988 | ISIC_0033940 989 | ISIC_0033942 990 | ISIC_0033943 991 | ISIC_0033945 992 | ISIC_0033948 993 | ISIC_0033955 994 | ISIC_0033959 995 | ISIC_0033960 996 | ISIC_0033965 997 | ISIC_0033966 998 | ISIC_0033977 999 | ISIC_0033984 1000 | ISIC_0033996 1001 | ISIC_0034001 1002 | ISIC_0034002 1003 | ISIC_0034010 1004 | ISIC_0034011 1005 | ISIC_0034020 1006 | ISIC_0034029 1007 | ISIC_0034040 1008 | ISIC_0034049 1009 | ISIC_0034072 1010 | ISIC_0034099 1011 | ISIC_0034109 1012 | ISIC_0034134 1013 | ISIC_0034145 1014 | ISIC_0034161 1015 | ISIC_0034171 1016 | ISIC_0034178 1017 | ISIC_0034200 1018 | ISIC_0034203 1019 | ISIC_0034204 1020 | ISIC_0034221 1021 | ISIC_0034234 1022 | ISIC_0034274 1023 | ISIC_0034280 1024 | ISIC_0034282 1025 | ISIC_0034285 1026 | ISIC_0034298 1027 | -------------------------------------------------------------------------------- /splits/split_task3_validation_only_2.txt: -------------------------------------------------------------------------------- 1 | ISIC_0024306 2 | ISIC_0024333 3 | ISIC_0024335 4 | ISIC_0024342 5 | ISIC_0024346 6 | ISIC_0024354 7 | ISIC_0024359 8 | ISIC_0024361 9 | ISIC_0024384 10 | ISIC_0024401 11 | ISIC_0024413 12 | ISIC_0024419 13 | ISIC_0024432 14 | ISIC_0024460 15 | ISIC_0024464 16 | ISIC_0024470 17 | ISIC_0024483 18 | ISIC_0024489 19 | ISIC_0024494 20 | ISIC_0024504 21 | ISIC_0024519 22 | ISIC_0024523 23 | ISIC_0024524 24 | ISIC_0024529 25 | ISIC_0024542 26 | ISIC_0024545 27 | ISIC_0024565 28 | ISIC_0024571 29 | ISIC_0024579 30 | ISIC_0024585 31 | ISIC_0024614 32 | ISIC_0024624 33 | ISIC_0024630 34 | ISIC_0024648 35 | ISIC_0024678 36 | ISIC_0024697 37 | ISIC_0024703 38 | ISIC_0024708 39 | ISIC_0024714 40 | ISIC_0024715 41 | ISIC_0024717 42 | ISIC_0024721 43 | ISIC_0024736 44 | ISIC_0024741 45 | ISIC_0024757 46 | ISIC_0024775 47 | ISIC_0024782 48 | ISIC_0024789 49 | ISIC_0024792 50 | ISIC_0024811 51 | ISIC_0024827 52 | ISIC_0024832 53 | ISIC_0024833 54 | ISIC_0024850 55 | ISIC_0024864 56 | ISIC_0024866 57 | ISIC_0024874 58 | ISIC_0024880 59 | ISIC_0024887 60 | ISIC_0024895 61 | ISIC_0024897 62 | ISIC_0024914 63 | ISIC_0024951 64 | ISIC_0024953 65 | ISIC_0024957 66 | ISIC_0024990 67 | ISIC_0024992 68 | ISIC_0025004 69 | ISIC_0025014 70 | ISIC_0025029 71 | ISIC_0025041 72 | ISIC_0025069 73 | ISIC_0025071 74 | ISIC_0025079 75 | ISIC_0025089 76 | ISIC_0025094 77 | ISIC_0025106 78 | ISIC_0025107 79 | ISIC_0025147 80 | ISIC_0025159 81 | ISIC_0025166 82 | ISIC_0025180 83 | ISIC_0025191 84 | ISIC_0025194 85 | ISIC_0025195 86 | ISIC_0025196 87 | ISIC_0025206 88 | ISIC_0025214 89 | ISIC_0025217 90 | ISIC_0025222 91 | ISIC_0025227 92 | ISIC_0025236 93 | ISIC_0025241 94 | ISIC_0025253 95 | ISIC_0025283 96 | ISIC_0025298 97 | ISIC_0025305 98 | ISIC_0025310 99 | ISIC_0025338 100 | ISIC_0025353 101 | ISIC_0025370 102 | ISIC_0025379 103 | ISIC_0025401 104 | ISIC_0025408 105 | ISIC_0025428 106 | ISIC_0025444 107 | ISIC_0025445 108 | ISIC_0025452 109 | ISIC_0025453 110 | ISIC_0025491 111 | ISIC_0025504 112 | ISIC_0025505 113 | ISIC_0025529 114 | ISIC_0025539 115 | ISIC_0025545 116 | ISIC_0025549 117 | ISIC_0025551 118 | ISIC_0025577 119 | ISIC_0025593 120 | ISIC_0025600 121 | ISIC_0025602 122 | ISIC_0025606 123 | ISIC_0025613 124 | ISIC_0025616 125 | ISIC_0025620 126 | ISIC_0025624 127 | ISIC_0025634 128 | ISIC_0025639 129 | ISIC_0025652 130 | ISIC_0025653 131 | ISIC_0025683 132 | ISIC_0025692 133 | ISIC_0025695 134 | ISIC_0025697 135 | ISIC_0025707 136 | ISIC_0025722 137 | ISIC_0025733 138 | ISIC_0025745 139 | ISIC_0025747 140 | ISIC_0025767 141 | ISIC_0025772 142 | ISIC_0025789 143 | ISIC_0025793 144 | ISIC_0025796 145 | ISIC_0025801 146 | ISIC_0025811 147 | ISIC_0025812 148 | ISIC_0025835 149 | ISIC_0025844 150 | ISIC_0025851 151 | ISIC_0025862 152 | ISIC_0025867 153 | ISIC_0025874 154 | ISIC_0025876 155 | ISIC_0025900 156 | ISIC_0025926 157 | ISIC_0025928 158 | ISIC_0025929 159 | ISIC_0025947 160 | ISIC_0025953 161 | ISIC_0025993 162 | ISIC_0026001 163 | ISIC_0026004 164 | ISIC_0026007 165 | ISIC_0026021 166 | ISIC_0026023 167 | ISIC_0026048 168 | ISIC_0026067 169 | ISIC_0026069 170 | ISIC_0026074 171 | ISIC_0026075 172 | ISIC_0026078 173 | ISIC_0026085 174 | ISIC_0026107 175 | ISIC_0026115 176 | ISIC_0026116 177 | ISIC_0026132 178 | ISIC_0026133 179 | ISIC_0026153 180 | ISIC_0026173 181 | ISIC_0026176 182 | ISIC_0026180 183 | ISIC_0026187 184 | ISIC_0026211 185 | ISIC_0026222 186 | ISIC_0026246 187 | ISIC_0026276 188 | ISIC_0026278 189 | ISIC_0026281 190 | ISIC_0026282 191 | ISIC_0026286 192 | ISIC_0026295 193 | ISIC_0026299 194 | ISIC_0026322 195 | ISIC_0026343 196 | ISIC_0026361 197 | ISIC_0026367 198 | ISIC_0026388 199 | ISIC_0026399 200 | ISIC_0026411 201 | ISIC_0026421 202 | ISIC_0026427 203 | ISIC_0026444 204 | ISIC_0026496 205 | ISIC_0026503 206 | ISIC_0026509 207 | ISIC_0026510 208 | ISIC_0026521 209 | ISIC_0026524 210 | ISIC_0026536 211 | ISIC_0026540 212 | ISIC_0026546 213 | ISIC_0026552 214 | ISIC_0026554 215 | ISIC_0026573 216 | ISIC_0026577 217 | ISIC_0026582 218 | ISIC_0026588 219 | ISIC_0026599 220 | ISIC_0026600 221 | ISIC_0026615 222 | ISIC_0026622 223 | ISIC_0026627 224 | ISIC_0026639 225 | ISIC_0026648 226 | ISIC_0026666 227 | ISIC_0026676 228 | ISIC_0026691 229 | ISIC_0026696 230 | ISIC_0026711 231 | ISIC_0026719 232 | ISIC_0026748 233 | ISIC_0026752 234 | ISIC_0026754 235 | ISIC_0026772 236 | ISIC_0026780 237 | ISIC_0026788 238 | ISIC_0026808 239 | ISIC_0026812 240 | ISIC_0026826 241 | ISIC_0026842 242 | ISIC_0026867 243 | ISIC_0026871 244 | ISIC_0026872 245 | ISIC_0026898 246 | ISIC_0026899 247 | ISIC_0026941 248 | ISIC_0026949 249 | ISIC_0026954 250 | ISIC_0026956 251 | ISIC_0026958 252 | ISIC_0026980 253 | ISIC_0026991 254 | ISIC_0027005 255 | ISIC_0027008 256 | ISIC_0027017 257 | ISIC_0027036 258 | ISIC_0027046 259 | ISIC_0027051 260 | ISIC_0027060 261 | ISIC_0027066 262 | ISIC_0027087 263 | ISIC_0027102 264 | ISIC_0027116 265 | ISIC_0027117 266 | ISIC_0027128 267 | ISIC_0027131 268 | ISIC_0027138 269 | ISIC_0027149 270 | ISIC_0027156 271 | ISIC_0027158 272 | ISIC_0027163 273 | ISIC_0027167 274 | ISIC_0027168 275 | ISIC_0027173 276 | ISIC_0027177 277 | ISIC_0027178 278 | ISIC_0027183 279 | ISIC_0027213 280 | ISIC_0027259 281 | ISIC_0027260 282 | ISIC_0027261 283 | ISIC_0027265 284 | ISIC_0027273 285 | ISIC_0027284 286 | ISIC_0027287 287 | ISIC_0027315 288 | ISIC_0027316 289 | ISIC_0027318 290 | ISIC_0027322 291 | ISIC_0027331 292 | ISIC_0027335 293 | ISIC_0027342 294 | ISIC_0027345 295 | ISIC_0027352 296 | ISIC_0027353 297 | ISIC_0027359 298 | ISIC_0027362 299 | ISIC_0027363 300 | ISIC_0027365 301 | ISIC_0027390 302 | ISIC_0027393 303 | ISIC_0027401 304 | ISIC_0027411 305 | ISIC_0027423 306 | ISIC_0027431 307 | ISIC_0027441 308 | ISIC_0027460 309 | ISIC_0027461 310 | ISIC_0027471 311 | ISIC_0027482 312 | ISIC_0027490 313 | ISIC_0027499 314 | ISIC_0027500 315 | ISIC_0027509 316 | ISIC_0027511 317 | ISIC_0027542 318 | ISIC_0027546 319 | ISIC_0027548 320 | ISIC_0027552 321 | ISIC_0027563 322 | ISIC_0027568 323 | ISIC_0027570 324 | ISIC_0027596 325 | ISIC_0027604 326 | ISIC_0027605 327 | ISIC_0027626 328 | ISIC_0027629 329 | ISIC_0027642 330 | ISIC_0027660 331 | ISIC_0027671 332 | ISIC_0027673 333 | ISIC_0027677 334 | ISIC_0027689 335 | ISIC_0027695 336 | ISIC_0027706 337 | ISIC_0027712 338 | ISIC_0027726 339 | ISIC_0027732 340 | ISIC_0027741 341 | ISIC_0027744 342 | ISIC_0027746 343 | ISIC_0027791 344 | ISIC_0027794 345 | ISIC_0027804 346 | ISIC_0027827 347 | ISIC_0027828 348 | ISIC_0027834 349 | ISIC_0027840 350 | ISIC_0027859 351 | ISIC_0027866 352 | ISIC_0027884 353 | ISIC_0027891 354 | ISIC_0027892 355 | ISIC_0027893 356 | ISIC_0027908 357 | ISIC_0027916 358 | ISIC_0027926 359 | ISIC_0027937 360 | ISIC_0027939 361 | ISIC_0027947 362 | ISIC_0027961 363 | ISIC_0027962 364 | ISIC_0027972 365 | ISIC_0027992 366 | ISIC_0027996 367 | ISIC_0028004 368 | ISIC_0028038 369 | ISIC_0028039 370 | ISIC_0028044 371 | ISIC_0028053 372 | ISIC_0028100 373 | ISIC_0028112 374 | ISIC_0028114 375 | ISIC_0028116 376 | ISIC_0028129 377 | ISIC_0028131 378 | ISIC_0028132 379 | ISIC_0028144 380 | ISIC_0028145 381 | ISIC_0028157 382 | ISIC_0028168 383 | ISIC_0028196 384 | ISIC_0028200 385 | ISIC_0028214 386 | ISIC_0028240 387 | ISIC_0028266 388 | ISIC_0028279 389 | ISIC_0028295 390 | ISIC_0028299 391 | ISIC_0028326 392 | ISIC_0028327 393 | ISIC_0028342 394 | ISIC_0028347 395 | ISIC_0028371 396 | ISIC_0028373 397 | ISIC_0028380 398 | ISIC_0028403 399 | ISIC_0028419 400 | ISIC_0028420 401 | ISIC_0028437 402 | ISIC_0028474 403 | ISIC_0028480 404 | ISIC_0028491 405 | ISIC_0028495 406 | ISIC_0028497 407 | ISIC_0028505 408 | ISIC_0028509 409 | ISIC_0028517 410 | ISIC_0028526 411 | ISIC_0028536 412 | ISIC_0028551 413 | ISIC_0028557 414 | ISIC_0028573 415 | ISIC_0028577 416 | ISIC_0028590 417 | ISIC_0028591 418 | ISIC_0028604 419 | ISIC_0028621 420 | ISIC_0028622 421 | ISIC_0028629 422 | ISIC_0028637 423 | ISIC_0028649 424 | ISIC_0028659 425 | ISIC_0028667 426 | ISIC_0028671 427 | ISIC_0028694 428 | ISIC_0028703 429 | ISIC_0028705 430 | ISIC_0028716 431 | ISIC_0028719 432 | ISIC_0028737 433 | ISIC_0028743 434 | ISIC_0028753 435 | ISIC_0028770 436 | ISIC_0028783 437 | ISIC_0028789 438 | ISIC_0028790 439 | ISIC_0028792 440 | ISIC_0028826 441 | ISIC_0028839 442 | ISIC_0028844 443 | ISIC_0028855 444 | ISIC_0028857 445 | ISIC_0028879 446 | ISIC_0028897 447 | ISIC_0028902 448 | ISIC_0028917 449 | ISIC_0028936 450 | ISIC_0028938 451 | ISIC_0028960 452 | ISIC_0028973 453 | ISIC_0029004 454 | ISIC_0029012 455 | ISIC_0029039 456 | ISIC_0029051 457 | ISIC_0029058 458 | ISIC_0029061 459 | ISIC_0029076 460 | ISIC_0029082 461 | ISIC_0029085 462 | ISIC_0029097 463 | ISIC_0029109 464 | ISIC_0029120 465 | ISIC_0029131 466 | ISIC_0029133 467 | ISIC_0029180 468 | ISIC_0029206 469 | ISIC_0029209 470 | ISIC_0029213 471 | ISIC_0029237 472 | ISIC_0029241 473 | ISIC_0029258 474 | ISIC_0029264 475 | ISIC_0029271 476 | ISIC_0029280 477 | ISIC_0029291 478 | ISIC_0029305 479 | ISIC_0029311 480 | ISIC_0029335 481 | ISIC_0029340 482 | ISIC_0029341 483 | ISIC_0029342 484 | ISIC_0029350 485 | ISIC_0029352 486 | ISIC_0029357 487 | ISIC_0029362 488 | ISIC_0029370 489 | ISIC_0029375 490 | ISIC_0029389 491 | ISIC_0029391 492 | ISIC_0029406 493 | ISIC_0029434 494 | ISIC_0029436 495 | ISIC_0029470 496 | ISIC_0029475 497 | ISIC_0029496 498 | ISIC_0029507 499 | ISIC_0029509 500 | ISIC_0029517 501 | ISIC_0029520 502 | ISIC_0029543 503 | ISIC_0029547 504 | ISIC_0029558 505 | ISIC_0029586 506 | ISIC_0029597 507 | ISIC_0029601 508 | ISIC_0029615 509 | ISIC_0029616 510 | ISIC_0029619 511 | ISIC_0029622 512 | ISIC_0029625 513 | ISIC_0029638 514 | ISIC_0029642 515 | ISIC_0029649 516 | ISIC_0029658 517 | ISIC_0029671 518 | ISIC_0029672 519 | ISIC_0029685 520 | ISIC_0029688 521 | ISIC_0029699 522 | ISIC_0029721 523 | ISIC_0029739 524 | ISIC_0029744 525 | ISIC_0029745 526 | ISIC_0029753 527 | ISIC_0029759 528 | ISIC_0029775 529 | ISIC_0029777 530 | ISIC_0029786 531 | ISIC_0029803 532 | ISIC_0029809 533 | ISIC_0029817 534 | ISIC_0029830 535 | ISIC_0029836 536 | ISIC_0029872 537 | ISIC_0029876 538 | ISIC_0029886 539 | ISIC_0029888 540 | ISIC_0029889 541 | ISIC_0029893 542 | ISIC_0029894 543 | ISIC_0029901 544 | ISIC_0029920 545 | ISIC_0029954 546 | ISIC_0029961 547 | ISIC_0029976 548 | ISIC_0029982 549 | ISIC_0029988 550 | ISIC_0029990 551 | ISIC_0030002 552 | ISIC_0030004 553 | ISIC_0030011 554 | ISIC_0030012 555 | ISIC_0030013 556 | ISIC_0030017 557 | ISIC_0030019 558 | ISIC_0030025 559 | ISIC_0030028 560 | ISIC_0030048 561 | ISIC_0030057 562 | ISIC_0030061 563 | ISIC_0030063 564 | ISIC_0030069 565 | ISIC_0030083 566 | ISIC_0030090 567 | ISIC_0030098 568 | ISIC_0030100 569 | ISIC_0030103 570 | ISIC_0030106 571 | ISIC_0030124 572 | ISIC_0030145 573 | ISIC_0030149 574 | ISIC_0030158 575 | ISIC_0030159 576 | ISIC_0030163 577 | ISIC_0030173 578 | ISIC_0030185 579 | ISIC_0030196 580 | ISIC_0030204 581 | ISIC_0030207 582 | ISIC_0030208 583 | ISIC_0030215 584 | ISIC_0030217 585 | ISIC_0030220 586 | ISIC_0030226 587 | ISIC_0030228 588 | ISIC_0030237 589 | ISIC_0030244 590 | ISIC_0030261 591 | ISIC_0030268 592 | ISIC_0030274 593 | ISIC_0030293 594 | ISIC_0030310 595 | ISIC_0030311 596 | ISIC_0030319 597 | ISIC_0030335 598 | ISIC_0030340 599 | ISIC_0030341 600 | ISIC_0030386 601 | ISIC_0030400 602 | ISIC_0030402 603 | ISIC_0030427 604 | ISIC_0030432 605 | ISIC_0030437 606 | ISIC_0030446 607 | ISIC_0030466 608 | ISIC_0030467 609 | ISIC_0030472 610 | ISIC_0030490 611 | ISIC_0030511 612 | ISIC_0030516 613 | ISIC_0030523 614 | ISIC_0030527 615 | ISIC_0030539 616 | ISIC_0030541 617 | ISIC_0030552 618 | ISIC_0030574 619 | ISIC_0030591 620 | ISIC_0030618 621 | ISIC_0030622 622 | ISIC_0030629 623 | ISIC_0030639 624 | ISIC_0030640 625 | ISIC_0030645 626 | ISIC_0030669 627 | ISIC_0030673 628 | ISIC_0030691 629 | ISIC_0030696 630 | ISIC_0030705 631 | ISIC_0030717 632 | ISIC_0030726 633 | ISIC_0030727 634 | ISIC_0030734 635 | ISIC_0030740 636 | ISIC_0030766 637 | ISIC_0030770 638 | ISIC_0030797 639 | ISIC_0030817 640 | ISIC_0030821 641 | ISIC_0030828 642 | ISIC_0030847 643 | ISIC_0030867 644 | ISIC_0030879 645 | ISIC_0030898 646 | ISIC_0030935 647 | ISIC_0030949 648 | ISIC_0030953 649 | ISIC_0030960 650 | ISIC_0030979 651 | ISIC_0030984 652 | ISIC_0030992 653 | ISIC_0030993 654 | ISIC_0031001 655 | ISIC_0031010 656 | ISIC_0031016 657 | ISIC_0031030 658 | ISIC_0031033 659 | ISIC_0031069 660 | ISIC_0031081 661 | ISIC_0031085 662 | ISIC_0031089 663 | ISIC_0031091 664 | ISIC_0031111 665 | ISIC_0031117 666 | ISIC_0031124 667 | ISIC_0031148 668 | ISIC_0031154 669 | ISIC_0031178 670 | ISIC_0031179 671 | ISIC_0031188 672 | ISIC_0031196 673 | ISIC_0031199 674 | ISIC_0031219 675 | ISIC_0031223 676 | ISIC_0031239 677 | ISIC_0031242 678 | ISIC_0031247 679 | ISIC_0031274 680 | ISIC_0031275 681 | ISIC_0031284 682 | ISIC_0031294 683 | ISIC_0031301 684 | ISIC_0031304 685 | ISIC_0031305 686 | ISIC_0031307 687 | ISIC_0031326 688 | ISIC_0031332 689 | ISIC_0031384 690 | ISIC_0031410 691 | ISIC_0031413 692 | ISIC_0031414 693 | ISIC_0031434 694 | ISIC_0031449 695 | ISIC_0031463 696 | ISIC_0031487 697 | ISIC_0031503 698 | ISIC_0031527 699 | ISIC_0031529 700 | ISIC_0031536 701 | ISIC_0031541 702 | ISIC_0031544 703 | ISIC_0031568 704 | ISIC_0031584 705 | ISIC_0031588 706 | ISIC_0031591 707 | ISIC_0031594 708 | ISIC_0031608 709 | ISIC_0031611 710 | ISIC_0031618 711 | ISIC_0031622 712 | ISIC_0031626 713 | ISIC_0031632 714 | ISIC_0031644 715 | ISIC_0031668 716 | ISIC_0031671 717 | ISIC_0031688 718 | ISIC_0031696 719 | ISIC_0031706 720 | ISIC_0031712 721 | ISIC_0031715 722 | ISIC_0031721 723 | ISIC_0031722 724 | ISIC_0031747 725 | ISIC_0031754 726 | ISIC_0031772 727 | ISIC_0031774 728 | ISIC_0031787 729 | ISIC_0031789 730 | ISIC_0031806 731 | ISIC_0031824 732 | ISIC_0031827 733 | ISIC_0031832 734 | ISIC_0031844 735 | ISIC_0031857 736 | ISIC_0031872 737 | ISIC_0031879 738 | ISIC_0031884 739 | ISIC_0031890 740 | ISIC_0031893 741 | ISIC_0031903 742 | ISIC_0031909 743 | ISIC_0031913 744 | ISIC_0031922 745 | ISIC_0031930 746 | ISIC_0031944 747 | ISIC_0031948 748 | ISIC_0031949 749 | ISIC_0031958 750 | ISIC_0031959 751 | ISIC_0031967 752 | ISIC_0031971 753 | ISIC_0031972 754 | ISIC_0031980 755 | ISIC_0032003 756 | ISIC_0032019 757 | ISIC_0032023 758 | ISIC_0032040 759 | ISIC_0032041 760 | ISIC_0032048 761 | ISIC_0032063 762 | ISIC_0032067 763 | ISIC_0032074 764 | ISIC_0032078 765 | ISIC_0032104 766 | ISIC_0032119 767 | ISIC_0032129 768 | ISIC_0032130 769 | ISIC_0032134 770 | ISIC_0032135 771 | ISIC_0032160 772 | ISIC_0032176 773 | ISIC_0032182 774 | ISIC_0032184 775 | ISIC_0032186 776 | ISIC_0032188 777 | ISIC_0032201 778 | ISIC_0032216 779 | ISIC_0032229 780 | ISIC_0032233 781 | ISIC_0032240 782 | ISIC_0032248 783 | ISIC_0032259 784 | ISIC_0032277 785 | ISIC_0032302 786 | ISIC_0032307 787 | ISIC_0032330 788 | ISIC_0032343 789 | ISIC_0032351 790 | ISIC_0032355 791 | ISIC_0032357 792 | ISIC_0032376 793 | ISIC_0032394 794 | ISIC_0032400 795 | ISIC_0032403 796 | ISIC_0032410 797 | ISIC_0032417 798 | ISIC_0032419 799 | ISIC_0032426 800 | ISIC_0032440 801 | ISIC_0032469 802 | ISIC_0032481 803 | ISIC_0032490 804 | ISIC_0032491 805 | ISIC_0032507 806 | ISIC_0032512 807 | ISIC_0032517 808 | ISIC_0032544 809 | ISIC_0032545 810 | ISIC_0032579 811 | ISIC_0032584 812 | ISIC_0032586 813 | ISIC_0032587 814 | ISIC_0032588 815 | ISIC_0032590 816 | ISIC_0032593 817 | ISIC_0032594 818 | ISIC_0032597 819 | ISIC_0032610 820 | ISIC_0032612 821 | ISIC_0032613 822 | ISIC_0032626 823 | ISIC_0032628 824 | ISIC_0032644 825 | ISIC_0032657 826 | ISIC_0032659 827 | ISIC_0032663 828 | ISIC_0032680 829 | ISIC_0032685 830 | ISIC_0032693 831 | ISIC_0032719 832 | ISIC_0032720 833 | ISIC_0032723 834 | ISIC_0032725 835 | ISIC_0032731 836 | ISIC_0032734 837 | ISIC_0032735 838 | ISIC_0032737 839 | ISIC_0032748 840 | ISIC_0032751 841 | ISIC_0032752 842 | ISIC_0032755 843 | ISIC_0032759 844 | ISIC_0032762 845 | ISIC_0032777 846 | ISIC_0032803 847 | ISIC_0032812 848 | ISIC_0032825 849 | ISIC_0032838 850 | ISIC_0032840 851 | ISIC_0032844 852 | ISIC_0032851 853 | ISIC_0032858 854 | ISIC_0032867 855 | ISIC_0032875 856 | ISIC_0032887 857 | ISIC_0032892 858 | ISIC_0032901 859 | ISIC_0032903 860 | ISIC_0032911 861 | ISIC_0032924 862 | ISIC_0032926 863 | ISIC_0032929 864 | ISIC_0032933 865 | ISIC_0032936 866 | ISIC_0032938 867 | ISIC_0032941 868 | ISIC_0032942 869 | ISIC_0032950 870 | ISIC_0032956 871 | ISIC_0032963 872 | ISIC_0032969 873 | ISIC_0032972 874 | ISIC_0032975 875 | ISIC_0032984 876 | ISIC_0032985 877 | ISIC_0032991 878 | ISIC_0032994 879 | ISIC_0032996 880 | ISIC_0033008 881 | ISIC_0033010 882 | ISIC_0033019 883 | ISIC_0033024 884 | ISIC_0033028 885 | ISIC_0033030 886 | ISIC_0033034 887 | ISIC_0033036 888 | ISIC_0033042 889 | ISIC_0033049 890 | ISIC_0033057 891 | ISIC_0033058 892 | ISIC_0033069 893 | ISIC_0033072 894 | ISIC_0033078 895 | ISIC_0033081 896 | ISIC_0033086 897 | ISIC_0033104 898 | ISIC_0033112 899 | ISIC_0033140 900 | ISIC_0033147 901 | ISIC_0033151 902 | ISIC_0033158 903 | ISIC_0033170 904 | ISIC_0033177 905 | ISIC_0033182 906 | ISIC_0033189 907 | ISIC_0033199 908 | ISIC_0033230 909 | ISIC_0033232 910 | ISIC_0033235 911 | ISIC_0033256 912 | ISIC_0033279 913 | ISIC_0033286 914 | ISIC_0033293 915 | ISIC_0033294 916 | ISIC_0033299 917 | ISIC_0033323 918 | ISIC_0033324 919 | ISIC_0033335 920 | ISIC_0033350 921 | ISIC_0033358 922 | ISIC_0033363 923 | ISIC_0033378 924 | ISIC_0033393 925 | ISIC_0033396 926 | ISIC_0033397 927 | ISIC_0033401 928 | ISIC_0033410 929 | ISIC_0033414 930 | ISIC_0033424 931 | ISIC_0033429 932 | ISIC_0033443 933 | ISIC_0033447 934 | ISIC_0033449 935 | ISIC_0033489 936 | ISIC_0033518 937 | ISIC_0033519 938 | ISIC_0033534 939 | ISIC_0033542 940 | ISIC_0033549 941 | ISIC_0033553 942 | ISIC_0033554 943 | ISIC_0033557 944 | ISIC_0033567 945 | ISIC_0033570 946 | ISIC_0033604 947 | ISIC_0033609 948 | ISIC_0033612 949 | ISIC_0033619 950 | ISIC_0033631 951 | ISIC_0033632 952 | ISIC_0033639 953 | ISIC_0033648 954 | ISIC_0033663 955 | ISIC_0033674 956 | ISIC_0033676 957 | ISIC_0033688 958 | ISIC_0033705 959 | ISIC_0033710 960 | ISIC_0033719 961 | ISIC_0033723 962 | ISIC_0033730 963 | ISIC_0033731 964 | ISIC_0033736 965 | ISIC_0033745 966 | ISIC_0033752 967 | ISIC_0033754 968 | ISIC_0033762 969 | ISIC_0033766 970 | ISIC_0033777 971 | ISIC_0033794 972 | ISIC_0033797 973 | ISIC_0033800 974 | ISIC_0033802 975 | ISIC_0033810 976 | ISIC_0033811 977 | ISIC_0033813 978 | ISIC_0033819 979 | ISIC_0033824 980 | ISIC_0033825 981 | ISIC_0033830 982 | ISIC_0033837 983 | ISIC_0033840 984 | ISIC_0033843 985 | ISIC_0033854 986 | ISIC_0033857 987 | ISIC_0033861 988 | ISIC_0033877 989 | ISIC_0033880 990 | ISIC_0033891 991 | ISIC_0033894 992 | ISIC_0033909 993 | ISIC_0033921 994 | ISIC_0033933 995 | ISIC_0033935 996 | ISIC_0033957 997 | ISIC_0033965 998 | ISIC_0033993 999 | ISIC_0033994 1000 | ISIC_0034009 1001 | ISIC_0034025 1002 | ISIC_0034026 1003 | ISIC_0034039 1004 | ISIC_0034055 1005 | ISIC_0034065 1006 | ISIC_0034072 1007 | ISIC_0034093 1008 | ISIC_0034097 1009 | ISIC_0034113 1010 | ISIC_0034123 1011 | ISIC_0034124 1012 | ISIC_0034131 1013 | ISIC_0034134 1014 | ISIC_0034140 1015 | ISIC_0034149 1016 | ISIC_0034156 1017 | ISIC_0034169 1018 | ISIC_0034172 1019 | ISIC_0034190 1020 | ISIC_0034191 1021 | ISIC_0034193 1022 | ISIC_0034202 1023 | ISIC_0034205 1024 | ISIC_0034209 1025 | ISIC_0034212 1026 | ISIC_0034214 1027 | ISIC_0034230 1028 | ISIC_0034256 1029 | ISIC_0034271 1030 | ISIC_0034272 1031 | ISIC_0034284 1032 | ISIC_0034293 1033 | ISIC_0034294 1034 | ISIC_0034297 1035 | ISIC_0034305 1036 | ISIC_0034313 1037 | ISIC_0034316 1038 | ISIC_0034318 1039 | -------------------------------------------------------------------------------- /splits/split_task3_validation_only_3.txt: -------------------------------------------------------------------------------- 1 | ISIC_0024315 2 | ISIC_0024319 3 | ISIC_0024325 4 | ISIC_0024340 5 | ISIC_0024354 6 | ISIC_0024368 7 | ISIC_0024375 8 | ISIC_0024381 9 | ISIC_0024418 10 | ISIC_0024425 11 | ISIC_0024431 12 | ISIC_0024448 13 | ISIC_0024451 14 | ISIC_0024492 15 | ISIC_0024505 16 | ISIC_0024521 17 | ISIC_0024525 18 | ISIC_0024539 19 | ISIC_0024541 20 | ISIC_0024574 21 | ISIC_0024624 22 | ISIC_0024632 23 | ISIC_0024634 24 | ISIC_0024655 25 | ISIC_0024664 26 | ISIC_0024667 27 | ISIC_0024671 28 | ISIC_0024673 29 | ISIC_0024678 30 | ISIC_0024679 31 | ISIC_0024694 32 | ISIC_0024715 33 | ISIC_0024733 34 | ISIC_0024740 35 | ISIC_0024752 36 | ISIC_0024761 37 | ISIC_0024767 38 | ISIC_0024768 39 | ISIC_0024769 40 | ISIC_0024777 41 | ISIC_0024784 42 | ISIC_0024795 43 | ISIC_0024818 44 | ISIC_0024820 45 | ISIC_0024826 46 | ISIC_0024857 47 | ISIC_0024860 48 | ISIC_0024861 49 | ISIC_0024865 50 | ISIC_0024874 51 | ISIC_0024881 52 | ISIC_0024897 53 | ISIC_0024898 54 | ISIC_0024907 55 | ISIC_0024910 56 | ISIC_0024914 57 | ISIC_0024919 58 | ISIC_0024923 59 | ISIC_0024947 60 | ISIC_0024966 61 | ISIC_0024972 62 | ISIC_0024986 63 | ISIC_0024994 64 | ISIC_0024995 65 | ISIC_0025000 66 | ISIC_0025007 67 | ISIC_0025011 68 | ISIC_0025014 69 | ISIC_0025020 70 | ISIC_0025053 71 | ISIC_0025118 72 | ISIC_0025127 73 | ISIC_0025137 74 | ISIC_0025142 75 | ISIC_0025160 76 | ISIC_0025197 77 | ISIC_0025202 78 | ISIC_0025203 79 | ISIC_0025223 80 | ISIC_0025230 81 | ISIC_0025233 82 | ISIC_0025237 83 | ISIC_0025253 84 | ISIC_0025257 85 | ISIC_0025278 86 | ISIC_0025280 87 | ISIC_0025289 88 | ISIC_0025317 89 | ISIC_0025325 90 | ISIC_0025328 91 | ISIC_0025358 92 | ISIC_0025360 93 | ISIC_0025361 94 | ISIC_0025403 95 | ISIC_0025404 96 | ISIC_0025441 97 | ISIC_0025458 98 | ISIC_0025464 99 | ISIC_0025472 100 | ISIC_0025483 101 | ISIC_0025510 102 | ISIC_0025531 103 | ISIC_0025535 104 | ISIC_0025548 105 | ISIC_0025589 106 | ISIC_0025612 107 | ISIC_0025620 108 | ISIC_0025624 109 | ISIC_0025644 110 | ISIC_0025646 111 | ISIC_0025648 112 | ISIC_0025659 113 | ISIC_0025661 114 | ISIC_0025664 115 | ISIC_0025674 116 | ISIC_0025678 117 | ISIC_0025679 118 | ISIC_0025697 119 | ISIC_0025702 120 | ISIC_0025706 121 | ISIC_0025713 122 | ISIC_0025750 123 | ISIC_0025754 124 | ISIC_0025757 125 | ISIC_0025761 126 | ISIC_0025763 127 | ISIC_0025790 128 | ISIC_0025824 129 | ISIC_0025825 130 | ISIC_0025827 131 | ISIC_0025848 132 | ISIC_0025849 133 | ISIC_0025864 134 | ISIC_0025866 135 | ISIC_0025880 136 | ISIC_0025892 137 | ISIC_0025897 138 | ISIC_0025903 139 | ISIC_0025906 140 | ISIC_0025909 141 | ISIC_0025914 142 | ISIC_0025926 143 | ISIC_0025931 144 | ISIC_0025948 145 | ISIC_0025962 146 | ISIC_0025971 147 | ISIC_0025981 148 | ISIC_0025987 149 | ISIC_0025991 150 | ISIC_0025992 151 | ISIC_0026005 152 | ISIC_0026012 153 | ISIC_0026013 154 | ISIC_0026026 155 | ISIC_0026029 156 | ISIC_0026050 157 | ISIC_0026055 158 | ISIC_0026076 159 | ISIC_0026078 160 | ISIC_0026079 161 | ISIC_0026096 162 | ISIC_0026106 163 | ISIC_0026110 164 | ISIC_0026118 165 | ISIC_0026134 166 | ISIC_0026144 167 | ISIC_0026149 168 | ISIC_0026157 169 | ISIC_0026167 170 | ISIC_0026168 171 | ISIC_0026174 172 | ISIC_0026195 173 | ISIC_0026215 174 | ISIC_0026228 175 | ISIC_0026245 176 | ISIC_0026249 177 | ISIC_0026263 178 | ISIC_0026266 179 | ISIC_0026277 180 | ISIC_0026309 181 | ISIC_0026318 182 | ISIC_0026325 183 | ISIC_0026326 184 | ISIC_0026329 185 | ISIC_0026338 186 | ISIC_0026347 187 | ISIC_0026361 188 | ISIC_0026365 189 | ISIC_0026371 190 | ISIC_0026377 191 | ISIC_0026389 192 | ISIC_0026397 193 | ISIC_0026407 194 | ISIC_0026420 195 | ISIC_0026433 196 | ISIC_0026437 197 | ISIC_0026445 198 | ISIC_0026466 199 | ISIC_0026470 200 | ISIC_0026479 201 | ISIC_0026502 202 | ISIC_0026529 203 | ISIC_0026539 204 | ISIC_0026542 205 | ISIC_0026575 206 | ISIC_0026582 207 | ISIC_0026584 208 | ISIC_0026592 209 | ISIC_0026595 210 | ISIC_0026596 211 | ISIC_0026597 212 | ISIC_0026623 213 | ISIC_0026626 214 | ISIC_0026628 215 | ISIC_0026637 216 | ISIC_0026639 217 | ISIC_0026643 218 | ISIC_0026656 219 | ISIC_0026668 220 | ISIC_0026707 221 | ISIC_0026713 222 | ISIC_0026716 223 | ISIC_0026736 224 | ISIC_0026758 225 | ISIC_0026767 226 | ISIC_0026769 227 | ISIC_0026802 228 | ISIC_0026814 229 | ISIC_0026831 230 | ISIC_0026832 231 | ISIC_0026866 232 | ISIC_0026868 233 | ISIC_0026874 234 | ISIC_0026883 235 | ISIC_0026896 236 | ISIC_0026926 237 | ISIC_0026940 238 | ISIC_0026986 239 | ISIC_0026994 240 | ISIC_0027004 241 | ISIC_0027027 242 | ISIC_0027044 243 | ISIC_0027047 244 | ISIC_0027051 245 | ISIC_0027053 246 | ISIC_0027057 247 | ISIC_0027064 248 | ISIC_0027075 249 | ISIC_0027077 250 | ISIC_0027082 251 | ISIC_0027083 252 | ISIC_0027119 253 | ISIC_0027139 254 | ISIC_0027151 255 | ISIC_0027159 256 | ISIC_0027165 257 | ISIC_0027181 258 | ISIC_0027196 259 | ISIC_0027223 260 | ISIC_0027225 261 | ISIC_0027229 262 | ISIC_0027231 263 | ISIC_0027237 264 | ISIC_0027255 265 | ISIC_0027279 266 | ISIC_0027282 267 | ISIC_0027301 268 | ISIC_0027312 269 | ISIC_0027326 270 | ISIC_0027327 271 | ISIC_0027339 272 | ISIC_0027343 273 | ISIC_0027348 274 | ISIC_0027352 275 | ISIC_0027357 276 | ISIC_0027361 277 | ISIC_0027380 278 | ISIC_0027391 279 | ISIC_0027399 280 | ISIC_0027411 281 | ISIC_0027413 282 | ISIC_0027427 283 | ISIC_0027431 284 | ISIC_0027432 285 | ISIC_0027438 286 | ISIC_0027444 287 | ISIC_0027486 288 | ISIC_0027494 289 | ISIC_0027497 290 | ISIC_0027500 291 | ISIC_0027508 292 | ISIC_0027522 293 | ISIC_0027542 294 | ISIC_0027550 295 | ISIC_0027557 296 | ISIC_0027561 297 | ISIC_0027569 298 | ISIC_0027573 299 | ISIC_0027587 300 | ISIC_0027589 301 | ISIC_0027620 302 | ISIC_0027625 303 | ISIC_0027645 304 | ISIC_0027647 305 | ISIC_0027652 306 | ISIC_0027653 307 | ISIC_0027663 308 | ISIC_0027678 309 | ISIC_0027694 310 | ISIC_0027706 311 | ISIC_0027723 312 | ISIC_0027750 313 | ISIC_0027754 314 | ISIC_0027758 315 | ISIC_0027770 316 | ISIC_0027792 317 | ISIC_0027813 318 | ISIC_0027832 319 | ISIC_0027853 320 | ISIC_0027859 321 | ISIC_0027861 322 | ISIC_0027876 323 | ISIC_0027878 324 | ISIC_0027895 325 | ISIC_0027901 326 | ISIC_0027904 327 | ISIC_0027931 328 | ISIC_0027947 329 | ISIC_0027955 330 | ISIC_0027961 331 | ISIC_0027964 332 | ISIC_0027966 333 | ISIC_0027968 334 | ISIC_0027986 335 | ISIC_0027990 336 | ISIC_0028012 337 | ISIC_0028026 338 | ISIC_0028027 339 | ISIC_0028037 340 | ISIC_0028046 341 | ISIC_0028055 342 | ISIC_0028056 343 | ISIC_0028068 344 | ISIC_0028129 345 | ISIC_0028130 346 | ISIC_0028138 347 | ISIC_0028143 348 | ISIC_0028145 349 | ISIC_0028148 350 | ISIC_0028161 351 | ISIC_0028181 352 | ISIC_0028188 353 | ISIC_0028199 354 | ISIC_0028203 355 | ISIC_0028204 356 | ISIC_0028206 357 | ISIC_0028213 358 | ISIC_0028220 359 | ISIC_0028226 360 | ISIC_0028237 361 | ISIC_0028244 362 | ISIC_0028247 363 | ISIC_0028252 364 | ISIC_0028255 365 | ISIC_0028273 366 | ISIC_0028278 367 | ISIC_0028285 368 | ISIC_0028294 369 | ISIC_0028296 370 | ISIC_0028300 371 | ISIC_0028302 372 | ISIC_0028304 373 | ISIC_0028306 374 | ISIC_0028315 375 | ISIC_0028319 376 | ISIC_0028340 377 | ISIC_0028341 378 | ISIC_0028342 379 | ISIC_0028345 380 | ISIC_0028350 381 | ISIC_0028352 382 | ISIC_0028354 383 | ISIC_0028362 384 | ISIC_0028370 385 | ISIC_0028375 386 | ISIC_0028391 387 | ISIC_0028392 388 | ISIC_0028396 389 | ISIC_0028411 390 | ISIC_0028418 391 | ISIC_0028421 392 | ISIC_0028442 393 | ISIC_0028458 394 | ISIC_0028464 395 | ISIC_0028471 396 | ISIC_0028479 397 | ISIC_0028484 398 | ISIC_0028485 399 | ISIC_0028499 400 | ISIC_0028506 401 | ISIC_0028510 402 | ISIC_0028518 403 | ISIC_0028519 404 | ISIC_0028534 405 | ISIC_0028545 406 | ISIC_0028560 407 | ISIC_0028566 408 | ISIC_0028574 409 | ISIC_0028575 410 | ISIC_0028577 411 | ISIC_0028582 412 | ISIC_0028607 413 | ISIC_0028620 414 | ISIC_0028627 415 | ISIC_0028630 416 | ISIC_0028631 417 | ISIC_0028649 418 | ISIC_0028662 419 | ISIC_0028664 420 | ISIC_0028671 421 | ISIC_0028681 422 | ISIC_0028685 423 | ISIC_0028713 424 | ISIC_0028719 425 | ISIC_0028720 426 | ISIC_0028726 427 | ISIC_0028729 428 | ISIC_0028752 429 | ISIC_0028777 430 | ISIC_0028785 431 | ISIC_0028797 432 | ISIC_0028807 433 | ISIC_0028831 434 | ISIC_0028844 435 | ISIC_0028855 436 | ISIC_0028861 437 | ISIC_0028864 438 | ISIC_0028865 439 | ISIC_0028884 440 | ISIC_0028893 441 | ISIC_0028898 442 | ISIC_0028911 443 | ISIC_0028919 444 | ISIC_0028922 445 | ISIC_0028953 446 | ISIC_0028984 447 | ISIC_0028988 448 | ISIC_0028998 449 | ISIC_0029004 450 | ISIC_0029005 451 | ISIC_0029009 452 | ISIC_0029023 453 | ISIC_0029040 454 | ISIC_0029041 455 | ISIC_0029044 456 | ISIC_0029056 457 | ISIC_0029061 458 | ISIC_0029067 459 | ISIC_0029074 460 | ISIC_0029090 461 | ISIC_0029108 462 | ISIC_0029111 463 | ISIC_0029114 464 | ISIC_0029128 465 | ISIC_0029137 466 | ISIC_0029142 467 | ISIC_0029145 468 | ISIC_0029186 469 | ISIC_0029196 470 | ISIC_0029215 471 | ISIC_0029219 472 | ISIC_0029222 473 | ISIC_0029223 474 | ISIC_0029226 475 | ISIC_0029229 476 | ISIC_0029237 477 | ISIC_0029247 478 | ISIC_0029251 479 | ISIC_0029254 480 | ISIC_0029256 481 | ISIC_0029284 482 | ISIC_0029285 483 | ISIC_0029301 484 | ISIC_0029308 485 | ISIC_0029310 486 | ISIC_0029329 487 | ISIC_0029339 488 | ISIC_0029342 489 | ISIC_0029349 490 | ISIC_0029352 491 | ISIC_0029375 492 | ISIC_0029379 493 | ISIC_0029390 494 | ISIC_0029395 495 | ISIC_0029424 496 | ISIC_0029430 497 | ISIC_0029439 498 | ISIC_0029441 499 | ISIC_0029445 500 | ISIC_0029466 501 | ISIC_0029467 502 | ISIC_0029476 503 | ISIC_0029479 504 | ISIC_0029502 505 | ISIC_0029507 506 | ISIC_0029509 507 | ISIC_0029521 508 | ISIC_0029526 509 | ISIC_0029538 510 | ISIC_0029544 511 | ISIC_0029546 512 | ISIC_0029558 513 | ISIC_0029584 514 | ISIC_0029585 515 | ISIC_0029588 516 | ISIC_0029589 517 | ISIC_0029620 518 | ISIC_0029629 519 | ISIC_0029633 520 | ISIC_0029636 521 | ISIC_0029637 522 | ISIC_0029654 523 | ISIC_0029662 524 | ISIC_0029671 525 | ISIC_0029674 526 | ISIC_0029704 527 | ISIC_0029713 528 | ISIC_0029732 529 | ISIC_0029741 530 | ISIC_0029750 531 | ISIC_0029752 532 | ISIC_0029764 533 | ISIC_0029775 534 | ISIC_0029778 535 | ISIC_0029812 536 | ISIC_0029820 537 | ISIC_0029883 538 | ISIC_0029916 539 | ISIC_0029937 540 | ISIC_0029938 541 | ISIC_0029951 542 | ISIC_0029952 543 | ISIC_0029967 544 | ISIC_0029968 545 | ISIC_0029984 546 | ISIC_0029988 547 | ISIC_0029999 548 | ISIC_0030001 549 | ISIC_0030008 550 | ISIC_0030017 551 | ISIC_0030041 552 | ISIC_0030045 553 | ISIC_0030078 554 | ISIC_0030090 555 | ISIC_0030091 556 | ISIC_0030095 557 | ISIC_0030117 558 | ISIC_0030130 559 | ISIC_0030139 560 | ISIC_0030146 561 | ISIC_0030152 562 | ISIC_0030170 563 | ISIC_0030179 564 | ISIC_0030183 565 | ISIC_0030187 566 | ISIC_0030199 567 | ISIC_0030201 568 | ISIC_0030220 569 | ISIC_0030228 570 | ISIC_0030231 571 | ISIC_0030242 572 | ISIC_0030243 573 | ISIC_0030271 574 | ISIC_0030289 575 | ISIC_0030301 576 | ISIC_0030314 577 | ISIC_0030321 578 | ISIC_0030324 579 | ISIC_0030339 580 | ISIC_0030340 581 | ISIC_0030342 582 | ISIC_0030357 583 | ISIC_0030359 584 | ISIC_0030373 585 | ISIC_0030376 586 | ISIC_0030418 587 | ISIC_0030422 588 | ISIC_0030430 589 | ISIC_0030436 590 | ISIC_0030438 591 | ISIC_0030439 592 | ISIC_0030457 593 | ISIC_0030468 594 | ISIC_0030475 595 | ISIC_0030485 596 | ISIC_0030489 597 | ISIC_0030500 598 | ISIC_0030515 599 | ISIC_0030535 600 | ISIC_0030537 601 | ISIC_0030546 602 | ISIC_0030554 603 | ISIC_0030564 604 | ISIC_0030575 605 | ISIC_0030582 606 | ISIC_0030586 607 | ISIC_0030589 608 | ISIC_0030593 609 | ISIC_0030601 610 | ISIC_0030608 611 | ISIC_0030609 612 | ISIC_0030610 613 | ISIC_0030619 614 | ISIC_0030629 615 | ISIC_0030635 616 | ISIC_0030636 617 | ISIC_0030642 618 | ISIC_0030644 619 | ISIC_0030647 620 | ISIC_0030649 621 | ISIC_0030661 622 | ISIC_0030667 623 | ISIC_0030673 624 | ISIC_0030678 625 | ISIC_0030681 626 | ISIC_0030684 627 | ISIC_0030705 628 | ISIC_0030716 629 | ISIC_0030749 630 | ISIC_0030756 631 | ISIC_0030786 632 | ISIC_0030824 633 | ISIC_0030839 634 | ISIC_0030842 635 | ISIC_0030843 636 | ISIC_0030848 637 | ISIC_0030853 638 | ISIC_0030858 639 | ISIC_0030867 640 | ISIC_0030890 641 | ISIC_0030914 642 | ISIC_0030979 643 | ISIC_0030988 644 | ISIC_0030989 645 | ISIC_0030990 646 | ISIC_0030992 647 | ISIC_0030994 648 | ISIC_0031031 649 | ISIC_0031040 650 | ISIC_0031041 651 | ISIC_0031060 652 | ISIC_0031075 653 | ISIC_0031082 654 | ISIC_0031086 655 | ISIC_0031091 656 | ISIC_0031092 657 | ISIC_0031095 658 | ISIC_0031103 659 | ISIC_0031104 660 | ISIC_0031122 661 | ISIC_0031136 662 | ISIC_0031147 663 | ISIC_0031150 664 | ISIC_0031153 665 | ISIC_0031178 666 | ISIC_0031181 667 | ISIC_0031207 668 | ISIC_0031211 669 | ISIC_0031218 670 | ISIC_0031257 671 | ISIC_0031263 672 | ISIC_0031275 673 | ISIC_0031294 674 | ISIC_0031297 675 | ISIC_0031312 676 | ISIC_0031315 677 | ISIC_0031319 678 | ISIC_0031320 679 | ISIC_0031328 680 | ISIC_0031336 681 | ISIC_0031347 682 | ISIC_0031349 683 | ISIC_0031351 684 | ISIC_0031369 685 | ISIC_0031371 686 | ISIC_0031373 687 | ISIC_0031391 688 | ISIC_0031393 689 | ISIC_0031394 690 | ISIC_0031400 691 | ISIC_0031401 692 | ISIC_0031412 693 | ISIC_0031421 694 | ISIC_0031438 695 | ISIC_0031443 696 | ISIC_0031461 697 | ISIC_0031467 698 | ISIC_0031479 699 | ISIC_0031486 700 | ISIC_0031494 701 | ISIC_0031507 702 | ISIC_0031508 703 | ISIC_0031514 704 | ISIC_0031533 705 | ISIC_0031554 706 | ISIC_0031555 707 | ISIC_0031565 708 | ISIC_0031582 709 | ISIC_0031584 710 | ISIC_0031595 711 | ISIC_0031596 712 | ISIC_0031599 713 | ISIC_0031604 714 | ISIC_0031612 715 | ISIC_0031624 716 | ISIC_0031650 717 | ISIC_0031664 718 | ISIC_0031668 719 | ISIC_0031675 720 | ISIC_0031684 721 | ISIC_0031693 722 | ISIC_0031704 723 | ISIC_0031775 724 | ISIC_0031778 725 | ISIC_0031779 726 | ISIC_0031793 727 | ISIC_0031797 728 | ISIC_0031803 729 | ISIC_0031828 730 | ISIC_0031832 731 | ISIC_0031842 732 | ISIC_0031851 733 | ISIC_0031879 734 | ISIC_0031893 735 | ISIC_0031899 736 | ISIC_0031902 737 | ISIC_0031910 738 | ISIC_0031940 739 | ISIC_0031941 740 | ISIC_0031942 741 | ISIC_0031967 742 | ISIC_0031968 743 | ISIC_0031969 744 | ISIC_0031979 745 | ISIC_0031982 746 | ISIC_0031985 747 | ISIC_0032000 748 | ISIC_0032022 749 | ISIC_0032029 750 | ISIC_0032043 751 | ISIC_0032045 752 | ISIC_0032055 753 | ISIC_0032058 754 | ISIC_0032059 755 | ISIC_0032066 756 | ISIC_0032082 757 | ISIC_0032084 758 | ISIC_0032085 759 | ISIC_0032089 760 | ISIC_0032096 761 | ISIC_0032116 762 | ISIC_0032126 763 | ISIC_0032127 764 | ISIC_0032130 765 | ISIC_0032145 766 | ISIC_0032149 767 | ISIC_0032189 768 | ISIC_0032194 769 | ISIC_0032197 770 | ISIC_0032202 771 | ISIC_0032206 772 | ISIC_0032213 773 | ISIC_0032224 774 | ISIC_0032232 775 | ISIC_0032241 776 | ISIC_0032245 777 | ISIC_0032268 778 | ISIC_0032278 779 | ISIC_0032302 780 | ISIC_0032312 781 | ISIC_0032315 782 | ISIC_0032327 783 | ISIC_0032357 784 | ISIC_0032359 785 | ISIC_0032366 786 | ISIC_0032370 787 | ISIC_0032372 788 | ISIC_0032376 789 | ISIC_0032377 790 | ISIC_0032381 791 | ISIC_0032392 792 | ISIC_0032398 793 | ISIC_0032410 794 | ISIC_0032420 795 | ISIC_0032429 796 | ISIC_0032430 797 | ISIC_0032438 798 | ISIC_0032452 799 | ISIC_0032453 800 | ISIC_0032458 801 | ISIC_0032463 802 | ISIC_0032465 803 | ISIC_0032469 804 | ISIC_0032477 805 | ISIC_0032482 806 | ISIC_0032487 807 | ISIC_0032488 808 | ISIC_0032492 809 | ISIC_0032499 810 | ISIC_0032508 811 | ISIC_0032516 812 | ISIC_0032560 813 | ISIC_0032561 814 | ISIC_0032576 815 | ISIC_0032579 816 | ISIC_0032594 817 | ISIC_0032595 818 | ISIC_0032601 819 | ISIC_0032634 820 | ISIC_0032654 821 | ISIC_0032665 822 | ISIC_0032682 823 | ISIC_0032707 824 | ISIC_0032710 825 | ISIC_0032726 826 | ISIC_0032740 827 | ISIC_0032744 828 | ISIC_0032755 829 | ISIC_0032757 830 | ISIC_0032762 831 | ISIC_0032772 832 | ISIC_0032774 833 | ISIC_0032784 834 | ISIC_0032819 835 | ISIC_0032837 836 | ISIC_0032843 837 | ISIC_0032848 838 | ISIC_0032852 839 | ISIC_0032863 840 | ISIC_0032864 841 | ISIC_0032868 842 | ISIC_0032869 843 | ISIC_0032876 844 | ISIC_0032878 845 | ISIC_0032881 846 | ISIC_0032883 847 | ISIC_0032885 848 | ISIC_0032888 849 | ISIC_0032892 850 | ISIC_0032897 851 | ISIC_0032898 852 | ISIC_0032904 853 | ISIC_0032905 854 | ISIC_0032927 855 | ISIC_0032930 856 | ISIC_0032933 857 | ISIC_0032956 858 | ISIC_0032966 859 | ISIC_0032971 860 | ISIC_0032972 861 | ISIC_0032983 862 | ISIC_0032992 863 | ISIC_0033008 864 | ISIC_0033014 865 | ISIC_0033029 866 | ISIC_0033033 867 | ISIC_0033034 868 | ISIC_0033037 869 | ISIC_0033047 870 | ISIC_0033048 871 | ISIC_0033077 872 | ISIC_0033079 873 | ISIC_0033083 874 | ISIC_0033091 875 | ISIC_0033097 876 | ISIC_0033104 877 | ISIC_0033118 878 | ISIC_0033130 879 | ISIC_0033133 880 | ISIC_0033139 881 | ISIC_0033147 882 | ISIC_0033149 883 | ISIC_0033163 884 | ISIC_0033181 885 | ISIC_0033187 886 | ISIC_0033189 887 | ISIC_0033191 888 | ISIC_0033211 889 | ISIC_0033212 890 | ISIC_0033225 891 | ISIC_0033230 892 | ISIC_0033246 893 | ISIC_0033272 894 | ISIC_0033276 895 | ISIC_0033280 896 | ISIC_0033291 897 | ISIC_0033296 898 | ISIC_0033316 899 | ISIC_0033330 900 | ISIC_0033348 901 | ISIC_0033352 902 | ISIC_0033374 903 | ISIC_0033379 904 | ISIC_0033389 905 | ISIC_0033390 906 | ISIC_0033409 907 | ISIC_0033426 908 | ISIC_0033438 909 | ISIC_0033459 910 | ISIC_0033462 911 | ISIC_0033476 912 | ISIC_0033477 913 | ISIC_0033486 914 | ISIC_0033488 915 | ISIC_0033496 916 | ISIC_0033524 917 | ISIC_0033539 918 | ISIC_0033546 919 | ISIC_0033578 920 | ISIC_0033579 921 | ISIC_0033584 922 | ISIC_0033598 923 | ISIC_0033606 924 | ISIC_0033615 925 | ISIC_0033617 926 | ISIC_0033628 927 | ISIC_0033629 928 | ISIC_0033642 929 | ISIC_0033650 930 | ISIC_0033661 931 | ISIC_0033685 932 | ISIC_0033706 933 | ISIC_0033728 934 | ISIC_0033729 935 | ISIC_0033747 936 | ISIC_0033749 937 | ISIC_0033758 938 | ISIC_0033759 939 | ISIC_0033762 940 | ISIC_0033763 941 | ISIC_0033766 942 | ISIC_0033768 943 | ISIC_0033769 944 | ISIC_0033770 945 | ISIC_0033773 946 | ISIC_0033778 947 | ISIC_0033798 948 | ISIC_0033813 949 | ISIC_0033814 950 | ISIC_0033818 951 | ISIC_0033820 952 | ISIC_0033822 953 | ISIC_0033836 954 | ISIC_0033838 955 | ISIC_0033839 956 | ISIC_0033864 957 | ISIC_0033869 958 | ISIC_0033870 959 | ISIC_0033873 960 | ISIC_0033880 961 | ISIC_0033887 962 | ISIC_0033889 963 | ISIC_0033902 964 | ISIC_0033907 965 | ISIC_0033940 966 | ISIC_0033951 967 | ISIC_0033955 968 | ISIC_0033968 969 | ISIC_0033994 970 | ISIC_0034001 971 | ISIC_0034003 972 | ISIC_0034004 973 | ISIC_0034010 974 | ISIC_0034014 975 | ISIC_0034015 976 | ISIC_0034021 977 | ISIC_0034024 978 | ISIC_0034029 979 | ISIC_0034033 980 | ISIC_0034037 981 | ISIC_0034041 982 | ISIC_0034042 983 | ISIC_0034063 984 | ISIC_0034082 985 | ISIC_0034083 986 | ISIC_0034092 987 | ISIC_0034095 988 | ISIC_0034100 989 | ISIC_0034102 990 | ISIC_0034103 991 | ISIC_0034110 992 | ISIC_0034118 993 | ISIC_0034133 994 | ISIC_0034137 995 | ISIC_0034138 996 | ISIC_0034143 997 | ISIC_0034144 998 | ISIC_0034161 999 | ISIC_0034168 1000 | ISIC_0034196 1001 | ISIC_0034201 1002 | ISIC_0034202 1003 | ISIC_0034213 1004 | ISIC_0034214 1005 | ISIC_0034215 1006 | ISIC_0034223 1007 | ISIC_0034231 1008 | ISIC_0034239 1009 | ISIC_0034287 1010 | ISIC_0034294 1011 | ISIC_0034307 1012 | ISIC_0034311 1013 | ISIC_0034318 1014 | -------------------------------------------------------------------------------- /splits/split_task3_validation_only_4.txt: -------------------------------------------------------------------------------- 1 | ISIC_0024309 2 | ISIC_0024310 3 | ISIC_0024329 4 | ISIC_0024336 5 | ISIC_0024339 6 | ISIC_0024351 7 | ISIC_0024364 8 | ISIC_0024370 9 | ISIC_0024386 10 | ISIC_0024387 11 | ISIC_0024390 12 | ISIC_0024399 13 | ISIC_0024405 14 | ISIC_0024413 15 | ISIC_0024415 16 | ISIC_0024419 17 | ISIC_0024423 18 | ISIC_0024427 19 | ISIC_0024436 20 | ISIC_0024444 21 | ISIC_0024462 22 | ISIC_0024482 23 | ISIC_0024484 24 | ISIC_0024488 25 | ISIC_0024491 26 | ISIC_0024493 27 | ISIC_0024497 28 | ISIC_0024507 29 | ISIC_0024522 30 | ISIC_0024536 31 | ISIC_0024555 32 | ISIC_0024588 33 | ISIC_0024599 34 | ISIC_0024619 35 | ISIC_0024621 36 | ISIC_0024623 37 | ISIC_0024640 38 | ISIC_0024655 39 | ISIC_0024682 40 | ISIC_0024684 41 | ISIC_0024685 42 | ISIC_0024686 43 | ISIC_0024687 44 | ISIC_0024697 45 | ISIC_0024699 46 | ISIC_0024711 47 | ISIC_0024715 48 | ISIC_0024721 49 | ISIC_0024762 50 | ISIC_0024768 51 | ISIC_0024783 52 | ISIC_0024788 53 | ISIC_0024796 54 | ISIC_0024798 55 | ISIC_0024802 56 | ISIC_0024815 57 | ISIC_0024823 58 | ISIC_0024829 59 | ISIC_0024843 60 | ISIC_0024851 61 | ISIC_0024877 62 | ISIC_0024880 63 | ISIC_0024883 64 | ISIC_0024886 65 | ISIC_0024887 66 | ISIC_0024888 67 | ISIC_0024899 68 | ISIC_0024920 69 | ISIC_0024929 70 | ISIC_0024949 71 | ISIC_0024960 72 | ISIC_0024962 73 | ISIC_0024963 74 | ISIC_0024964 75 | ISIC_0024968 76 | ISIC_0024978 77 | ISIC_0024979 78 | ISIC_0024984 79 | ISIC_0024992 80 | ISIC_0025001 81 | ISIC_0025011 82 | ISIC_0025014 83 | ISIC_0025018 84 | ISIC_0025032 85 | ISIC_0025038 86 | ISIC_0025040 87 | ISIC_0025063 88 | ISIC_0025064 89 | ISIC_0025080 90 | ISIC_0025082 91 | ISIC_0025090 92 | ISIC_0025103 93 | ISIC_0025113 94 | ISIC_0025133 95 | ISIC_0025134 96 | ISIC_0025148 97 | ISIC_0025152 98 | ISIC_0025153 99 | ISIC_0025154 100 | ISIC_0025160 101 | ISIC_0025172 102 | ISIC_0025175 103 | ISIC_0025178 104 | ISIC_0025190 105 | ISIC_0025204 106 | ISIC_0025211 107 | ISIC_0025212 108 | ISIC_0025214 109 | ISIC_0025218 110 | ISIC_0025241 111 | ISIC_0025242 112 | ISIC_0025256 113 | ISIC_0025269 114 | ISIC_0025289 115 | ISIC_0025317 116 | ISIC_0025325 117 | ISIC_0025333 118 | ISIC_0025342 119 | ISIC_0025384 120 | ISIC_0025398 121 | ISIC_0025413 122 | ISIC_0025427 123 | ISIC_0025429 124 | ISIC_0025445 125 | ISIC_0025463 126 | ISIC_0025469 127 | ISIC_0025485 128 | ISIC_0025487 129 | ISIC_0025491 130 | ISIC_0025493 131 | ISIC_0025495 132 | ISIC_0025519 133 | ISIC_0025520 134 | ISIC_0025529 135 | ISIC_0025531 136 | ISIC_0025540 137 | ISIC_0025551 138 | ISIC_0025570 139 | ISIC_0025571 140 | ISIC_0025588 141 | ISIC_0025594 142 | ISIC_0025612 143 | ISIC_0025622 144 | ISIC_0025638 145 | ISIC_0025651 146 | ISIC_0025663 147 | ISIC_0025690 148 | ISIC_0025699 149 | ISIC_0025709 150 | ISIC_0025710 151 | ISIC_0025717 152 | ISIC_0025722 153 | ISIC_0025734 154 | ISIC_0025739 155 | ISIC_0025776 156 | ISIC_0025778 157 | ISIC_0025779 158 | ISIC_0025810 159 | ISIC_0025818 160 | ISIC_0025849 161 | ISIC_0025851 162 | ISIC_0025859 163 | ISIC_0025863 164 | ISIC_0025885 165 | ISIC_0025899 166 | ISIC_0025908 167 | ISIC_0025924 168 | ISIC_0025927 169 | ISIC_0025946 170 | ISIC_0025949 171 | ISIC_0025952 172 | ISIC_0025990 173 | ISIC_0025992 174 | ISIC_0026001 175 | ISIC_0026005 176 | ISIC_0026010 177 | ISIC_0026019 178 | ISIC_0026021 179 | ISIC_0026033 180 | ISIC_0026036 181 | ISIC_0026046 182 | ISIC_0026073 183 | ISIC_0026074 184 | ISIC_0026083 185 | ISIC_0026119 186 | ISIC_0026125 187 | ISIC_0026130 188 | ISIC_0026131 189 | ISIC_0026137 190 | ISIC_0026149 191 | ISIC_0026176 192 | ISIC_0026229 193 | ISIC_0026246 194 | ISIC_0026286 195 | ISIC_0026292 196 | ISIC_0026296 197 | ISIC_0026303 198 | ISIC_0026304 199 | ISIC_0026343 200 | ISIC_0026345 201 | ISIC_0026347 202 | ISIC_0026351 203 | ISIC_0026361 204 | ISIC_0026381 205 | ISIC_0026383 206 | ISIC_0026399 207 | ISIC_0026402 208 | ISIC_0026416 209 | ISIC_0026420 210 | ISIC_0026426 211 | ISIC_0026429 212 | ISIC_0026439 213 | ISIC_0026461 214 | ISIC_0026466 215 | ISIC_0026486 216 | ISIC_0026509 217 | ISIC_0026526 218 | ISIC_0026527 219 | ISIC_0026542 220 | ISIC_0026545 221 | ISIC_0026548 222 | ISIC_0026555 223 | ISIC_0026566 224 | ISIC_0026595 225 | ISIC_0026601 226 | ISIC_0026608 227 | ISIC_0026610 228 | ISIC_0026618 229 | ISIC_0026642 230 | ISIC_0026652 231 | ISIC_0026662 232 | ISIC_0026670 233 | ISIC_0026681 234 | ISIC_0026690 235 | ISIC_0026729 236 | ISIC_0026732 237 | ISIC_0026738 238 | ISIC_0026739 239 | ISIC_0026747 240 | ISIC_0026754 241 | ISIC_0026755 242 | ISIC_0026757 243 | ISIC_0026785 244 | ISIC_0026801 245 | ISIC_0026807 246 | ISIC_0026809 247 | ISIC_0026812 248 | ISIC_0026816 249 | ISIC_0026821 250 | ISIC_0026822 251 | ISIC_0026826 252 | ISIC_0026843 253 | ISIC_0026852 254 | ISIC_0026863 255 | ISIC_0026867 256 | ISIC_0026877 257 | ISIC_0026884 258 | ISIC_0026927 259 | ISIC_0026929 260 | ISIC_0026936 261 | ISIC_0026940 262 | ISIC_0026945 263 | ISIC_0026972 264 | ISIC_0026973 265 | ISIC_0026977 266 | ISIC_0027001 267 | ISIC_0027005 268 | ISIC_0027023 269 | ISIC_0027038 270 | ISIC_0027057 271 | ISIC_0027071 272 | ISIC_0027072 273 | ISIC_0027080 274 | ISIC_0027084 275 | ISIC_0027096 276 | ISIC_0027101 277 | ISIC_0027144 278 | ISIC_0027152 279 | ISIC_0027168 280 | ISIC_0027170 281 | ISIC_0027175 282 | ISIC_0027198 283 | ISIC_0027210 284 | ISIC_0027218 285 | ISIC_0027220 286 | ISIC_0027221 287 | ISIC_0027235 288 | ISIC_0027271 289 | ISIC_0027276 290 | ISIC_0027283 291 | ISIC_0027284 292 | ISIC_0027288 293 | ISIC_0027300 294 | ISIC_0027330 295 | ISIC_0027341 296 | ISIC_0027365 297 | ISIC_0027366 298 | ISIC_0027369 299 | ISIC_0027383 300 | ISIC_0027391 301 | ISIC_0027392 302 | ISIC_0027395 303 | ISIC_0027402 304 | ISIC_0027403 305 | ISIC_0027410 306 | ISIC_0027412 307 | ISIC_0027421 308 | ISIC_0027423 309 | ISIC_0027429 310 | ISIC_0027446 311 | ISIC_0027463 312 | ISIC_0027472 313 | ISIC_0027476 314 | ISIC_0027481 315 | ISIC_0027484 316 | ISIC_0027499 317 | ISIC_0027500 318 | ISIC_0027532 319 | ISIC_0027548 320 | ISIC_0027554 321 | ISIC_0027595 322 | ISIC_0027596 323 | ISIC_0027599 324 | ISIC_0027617 325 | ISIC_0027623 326 | ISIC_0027624 327 | ISIC_0027631 328 | ISIC_0027634 329 | ISIC_0027644 330 | ISIC_0027656 331 | ISIC_0027663 332 | ISIC_0027668 333 | ISIC_0027672 334 | ISIC_0027675 335 | ISIC_0027710 336 | ISIC_0027717 337 | ISIC_0027723 338 | ISIC_0027726 339 | ISIC_0027730 340 | ISIC_0027739 341 | ISIC_0027756 342 | ISIC_0027758 343 | ISIC_0027768 344 | ISIC_0027772 345 | ISIC_0027785 346 | ISIC_0027787 347 | ISIC_0027799 348 | ISIC_0027802 349 | ISIC_0027810 350 | ISIC_0027819 351 | ISIC_0027826 352 | ISIC_0027827 353 | ISIC_0027872 354 | ISIC_0027875 355 | ISIC_0027913 356 | ISIC_0027917 357 | ISIC_0027923 358 | ISIC_0027927 359 | ISIC_0027930 360 | ISIC_0027932 361 | ISIC_0027973 362 | ISIC_0028001 363 | ISIC_0028004 364 | ISIC_0028011 365 | ISIC_0028021 366 | ISIC_0028022 367 | ISIC_0028055 368 | ISIC_0028063 369 | ISIC_0028068 370 | ISIC_0028099 371 | ISIC_0028106 372 | ISIC_0028108 373 | ISIC_0028122 374 | ISIC_0028123 375 | ISIC_0028133 376 | ISIC_0028142 377 | ISIC_0028143 378 | ISIC_0028160 379 | ISIC_0028169 380 | ISIC_0028178 381 | ISIC_0028198 382 | ISIC_0028206 383 | ISIC_0028213 384 | ISIC_0028222 385 | ISIC_0028225 386 | ISIC_0028242 387 | ISIC_0028248 388 | ISIC_0028263 389 | ISIC_0028277 390 | ISIC_0028283 391 | ISIC_0028285 392 | ISIC_0028331 393 | ISIC_0028335 394 | ISIC_0028336 395 | ISIC_0028340 396 | ISIC_0028346 397 | ISIC_0028366 398 | ISIC_0028378 399 | ISIC_0028385 400 | ISIC_0028400 401 | ISIC_0028401 402 | ISIC_0028402 403 | ISIC_0028449 404 | ISIC_0028450 405 | ISIC_0028463 406 | ISIC_0028495 407 | ISIC_0028503 408 | ISIC_0028510 409 | ISIC_0028512 410 | ISIC_0028541 411 | ISIC_0028554 412 | ISIC_0028592 413 | ISIC_0028594 414 | ISIC_0028601 415 | ISIC_0028605 416 | ISIC_0028610 417 | ISIC_0028624 418 | ISIC_0028633 419 | ISIC_0028635 420 | ISIC_0028646 421 | ISIC_0028650 422 | ISIC_0028653 423 | ISIC_0028680 424 | ISIC_0028682 425 | ISIC_0028690 426 | ISIC_0028700 427 | ISIC_0028701 428 | ISIC_0028707 429 | ISIC_0028713 430 | ISIC_0028714 431 | ISIC_0028726 432 | ISIC_0028730 433 | ISIC_0028734 434 | ISIC_0028737 435 | ISIC_0028743 436 | ISIC_0028752 437 | ISIC_0028770 438 | ISIC_0028771 439 | ISIC_0028773 440 | ISIC_0028781 441 | ISIC_0028784 442 | ISIC_0028788 443 | ISIC_0028796 444 | ISIC_0028800 445 | ISIC_0028805 446 | ISIC_0028851 447 | ISIC_0028861 448 | ISIC_0028868 449 | ISIC_0028870 450 | ISIC_0028872 451 | ISIC_0028874 452 | ISIC_0028877 453 | ISIC_0028879 454 | ISIC_0028886 455 | ISIC_0028889 456 | ISIC_0028902 457 | ISIC_0028914 458 | ISIC_0028917 459 | ISIC_0028920 460 | ISIC_0028935 461 | ISIC_0028943 462 | ISIC_0028952 463 | ISIC_0028960 464 | ISIC_0028973 465 | ISIC_0028981 466 | ISIC_0028987 467 | ISIC_0028992 468 | ISIC_0029002 469 | ISIC_0029003 470 | ISIC_0029014 471 | ISIC_0029034 472 | ISIC_0029079 473 | ISIC_0029082 474 | ISIC_0029092 475 | ISIC_0029099 476 | ISIC_0029105 477 | ISIC_0029106 478 | ISIC_0029114 479 | ISIC_0029149 480 | ISIC_0029173 481 | ISIC_0029174 482 | ISIC_0029175 483 | ISIC_0029184 484 | ISIC_0029197 485 | ISIC_0029201 486 | ISIC_0029217 487 | ISIC_0029223 488 | ISIC_0029228 489 | ISIC_0029229 490 | ISIC_0029233 491 | ISIC_0029248 492 | ISIC_0029253 493 | ISIC_0029254 494 | ISIC_0029256 495 | ISIC_0029272 496 | ISIC_0029282 497 | ISIC_0029321 498 | ISIC_0029336 499 | ISIC_0029340 500 | ISIC_0029341 501 | ISIC_0029354 502 | ISIC_0029356 503 | ISIC_0029374 504 | ISIC_0029375 505 | ISIC_0029383 506 | ISIC_0029394 507 | ISIC_0029416 508 | ISIC_0029428 509 | ISIC_0029433 510 | ISIC_0029440 511 | ISIC_0029445 512 | ISIC_0029457 513 | ISIC_0029466 514 | ISIC_0029471 515 | ISIC_0029476 516 | ISIC_0029477 517 | ISIC_0029482 518 | ISIC_0029500 519 | ISIC_0029506 520 | ISIC_0029512 521 | ISIC_0029514 522 | ISIC_0029517 523 | ISIC_0029523 524 | ISIC_0029530 525 | ISIC_0029537 526 | ISIC_0029540 527 | ISIC_0029544 528 | ISIC_0029545 529 | ISIC_0029553 530 | ISIC_0029570 531 | ISIC_0029582 532 | ISIC_0029587 533 | ISIC_0029589 534 | ISIC_0029593 535 | ISIC_0029598 536 | ISIC_0029609 537 | ISIC_0029613 538 | ISIC_0029617 539 | ISIC_0029644 540 | ISIC_0029653 541 | ISIC_0029664 542 | ISIC_0029665 543 | ISIC_0029669 544 | ISIC_0029700 545 | ISIC_0029765 546 | ISIC_0029779 547 | ISIC_0029780 548 | ISIC_0029782 549 | ISIC_0029784 550 | ISIC_0029791 551 | ISIC_0029796 552 | ISIC_0029801 553 | ISIC_0029805 554 | ISIC_0029812 555 | ISIC_0029816 556 | ISIC_0029824 557 | ISIC_0029833 558 | ISIC_0029837 559 | ISIC_0029847 560 | ISIC_0029852 561 | ISIC_0029857 562 | ISIC_0029864 563 | ISIC_0029877 564 | ISIC_0029887 565 | ISIC_0029889 566 | ISIC_0029903 567 | ISIC_0029908 568 | ISIC_0029951 569 | ISIC_0029987 570 | ISIC_0029995 571 | ISIC_0030007 572 | ISIC_0030013 573 | ISIC_0030042 574 | ISIC_0030052 575 | ISIC_0030057 576 | ISIC_0030081 577 | ISIC_0030094 578 | ISIC_0030101 579 | ISIC_0030123 580 | ISIC_0030125 581 | ISIC_0030131 582 | ISIC_0030132 583 | ISIC_0030141 584 | ISIC_0030170 585 | ISIC_0030181 586 | ISIC_0030186 587 | ISIC_0030204 588 | ISIC_0030220 589 | ISIC_0030236 590 | ISIC_0030251 591 | ISIC_0030270 592 | ISIC_0030272 593 | ISIC_0030284 594 | ISIC_0030303 595 | ISIC_0030305 596 | ISIC_0030333 597 | ISIC_0030334 598 | ISIC_0030341 599 | ISIC_0030346 600 | ISIC_0030362 601 | ISIC_0030364 602 | ISIC_0030371 603 | ISIC_0030378 604 | ISIC_0030387 605 | ISIC_0030389 606 | ISIC_0030397 607 | ISIC_0030398 608 | ISIC_0030400 609 | ISIC_0030405 610 | ISIC_0030412 611 | ISIC_0030442 612 | ISIC_0030465 613 | ISIC_0030471 614 | ISIC_0030474 615 | ISIC_0030491 616 | ISIC_0030499 617 | ISIC_0030500 618 | ISIC_0030516 619 | ISIC_0030518 620 | ISIC_0030522 621 | ISIC_0030525 622 | ISIC_0030539 623 | ISIC_0030542 624 | ISIC_0030550 625 | ISIC_0030558 626 | ISIC_0030562 627 | ISIC_0030568 628 | ISIC_0030574 629 | ISIC_0030577 630 | ISIC_0030609 631 | ISIC_0030614 632 | ISIC_0030620 633 | ISIC_0030627 634 | ISIC_0030637 635 | ISIC_0030646 636 | ISIC_0030662 637 | ISIC_0030667 638 | ISIC_0030695 639 | ISIC_0030699 640 | ISIC_0030718 641 | ISIC_0030746 642 | ISIC_0030757 643 | ISIC_0030759 644 | ISIC_0030768 645 | ISIC_0030771 646 | ISIC_0030774 647 | ISIC_0030776 648 | ISIC_0030784 649 | ISIC_0030787 650 | ISIC_0030794 651 | ISIC_0030800 652 | ISIC_0030802 653 | ISIC_0030819 654 | ISIC_0030833 655 | ISIC_0030835 656 | ISIC_0030858 657 | ISIC_0030880 658 | ISIC_0030885 659 | ISIC_0030887 660 | ISIC_0030889 661 | ISIC_0030916 662 | ISIC_0030917 663 | ISIC_0030928 664 | ISIC_0030947 665 | ISIC_0030950 666 | ISIC_0030956 667 | ISIC_0030959 668 | ISIC_0030970 669 | ISIC_0030977 670 | ISIC_0030981 671 | ISIC_0030986 672 | ISIC_0031000 673 | ISIC_0031025 674 | ISIC_0031035 675 | ISIC_0031058 676 | ISIC_0031063 677 | ISIC_0031073 678 | ISIC_0031081 679 | ISIC_0031088 680 | ISIC_0031097 681 | ISIC_0031098 682 | ISIC_0031101 683 | ISIC_0031135 684 | ISIC_0031156 685 | ISIC_0031167 686 | ISIC_0031169 687 | ISIC_0031177 688 | ISIC_0031192 689 | ISIC_0031203 690 | ISIC_0031207 691 | ISIC_0031208 692 | ISIC_0031214 693 | ISIC_0031224 694 | ISIC_0031229 695 | ISIC_0031234 696 | ISIC_0031239 697 | ISIC_0031241 698 | ISIC_0031250 699 | ISIC_0031251 700 | ISIC_0031262 701 | ISIC_0031272 702 | ISIC_0031279 703 | ISIC_0031302 704 | ISIC_0031308 705 | ISIC_0031310 706 | ISIC_0031312 707 | ISIC_0031315 708 | ISIC_0031344 709 | ISIC_0031358 710 | ISIC_0031360 711 | ISIC_0031364 712 | ISIC_0031377 713 | ISIC_0031381 714 | ISIC_0031411 715 | ISIC_0031431 716 | ISIC_0031434 717 | ISIC_0031441 718 | ISIC_0031456 719 | ISIC_0031460 720 | ISIC_0031471 721 | ISIC_0031492 722 | ISIC_0031517 723 | ISIC_0031519 724 | ISIC_0031541 725 | ISIC_0031548 726 | ISIC_0031556 727 | ISIC_0031570 728 | ISIC_0031579 729 | ISIC_0031589 730 | ISIC_0031598 731 | ISIC_0031630 732 | ISIC_0031661 733 | ISIC_0031664 734 | ISIC_0031672 735 | ISIC_0031686 736 | ISIC_0031689 737 | ISIC_0031696 738 | ISIC_0031704 739 | ISIC_0031723 740 | ISIC_0031735 741 | ISIC_0031736 742 | ISIC_0031737 743 | ISIC_0031748 744 | ISIC_0031749 745 | ISIC_0031762 746 | ISIC_0031770 747 | ISIC_0031771 748 | ISIC_0031796 749 | ISIC_0031812 750 | ISIC_0031842 751 | ISIC_0031855 752 | ISIC_0031870 753 | ISIC_0031876 754 | ISIC_0031880 755 | ISIC_0031894 756 | ISIC_0031897 757 | ISIC_0031900 758 | ISIC_0031903 759 | ISIC_0031912 760 | ISIC_0031921 761 | ISIC_0031928 762 | ISIC_0031931 763 | ISIC_0031945 764 | ISIC_0031947 765 | ISIC_0031954 766 | ISIC_0031965 767 | ISIC_0031972 768 | ISIC_0031976 769 | ISIC_0031983 770 | ISIC_0031993 771 | ISIC_0031997 772 | ISIC_0032004 773 | ISIC_0032005 774 | ISIC_0032006 775 | ISIC_0032009 776 | ISIC_0032017 777 | ISIC_0032030 778 | ISIC_0032036 779 | ISIC_0032038 780 | ISIC_0032048 781 | ISIC_0032075 782 | ISIC_0032081 783 | ISIC_0032125 784 | ISIC_0032135 785 | ISIC_0032142 786 | ISIC_0032144 787 | ISIC_0032178 788 | ISIC_0032184 789 | ISIC_0032195 790 | ISIC_0032196 791 | ISIC_0032201 792 | ISIC_0032205 793 | ISIC_0032208 794 | ISIC_0032210 795 | ISIC_0032214 796 | ISIC_0032228 797 | ISIC_0032251 798 | ISIC_0032253 799 | ISIC_0032274 800 | ISIC_0032282 801 | ISIC_0032290 802 | ISIC_0032291 803 | ISIC_0032319 804 | ISIC_0032333 805 | ISIC_0032336 806 | ISIC_0032337 807 | ISIC_0032338 808 | ISIC_0032346 809 | ISIC_0032351 810 | ISIC_0032363 811 | ISIC_0032389 812 | ISIC_0032420 813 | ISIC_0032425 814 | ISIC_0032429 815 | ISIC_0032436 816 | ISIC_0032451 817 | ISIC_0032464 818 | ISIC_0032465 819 | ISIC_0032487 820 | ISIC_0032494 821 | ISIC_0032520 822 | ISIC_0032521 823 | ISIC_0032524 824 | ISIC_0032538 825 | ISIC_0032556 826 | ISIC_0032558 827 | ISIC_0032561 828 | ISIC_0032564 829 | ISIC_0032574 830 | ISIC_0032579 831 | ISIC_0032586 832 | ISIC_0032591 833 | ISIC_0032598 834 | ISIC_0032669 835 | ISIC_0032672 836 | ISIC_0032674 837 | ISIC_0032695 838 | ISIC_0032706 839 | ISIC_0032711 840 | ISIC_0032716 841 | ISIC_0032720 842 | ISIC_0032721 843 | ISIC_0032725 844 | ISIC_0032729 845 | ISIC_0032733 846 | ISIC_0032759 847 | ISIC_0032760 848 | ISIC_0032789 849 | ISIC_0032799 850 | ISIC_0032809 851 | ISIC_0032813 852 | ISIC_0032819 853 | ISIC_0032823 854 | ISIC_0032832 855 | ISIC_0032833 856 | ISIC_0032838 857 | ISIC_0032843 858 | ISIC_0032849 859 | ISIC_0032858 860 | ISIC_0032860 861 | ISIC_0032864 862 | ISIC_0032877 863 | ISIC_0032912 864 | ISIC_0032923 865 | ISIC_0032934 866 | ISIC_0032943 867 | ISIC_0032949 868 | ISIC_0032996 869 | ISIC_0032999 870 | ISIC_0033013 871 | ISIC_0033036 872 | ISIC_0033039 873 | ISIC_0033057 874 | ISIC_0033063 875 | ISIC_0033075 876 | ISIC_0033076 877 | ISIC_0033077 878 | ISIC_0033086 879 | ISIC_0033104 880 | ISIC_0033121 881 | ISIC_0033122 882 | ISIC_0033127 883 | ISIC_0033135 884 | ISIC_0033149 885 | ISIC_0033151 886 | ISIC_0033177 887 | ISIC_0033183 888 | ISIC_0033189 889 | ISIC_0033191 890 | ISIC_0033197 891 | ISIC_0033201 892 | ISIC_0033204 893 | ISIC_0033207 894 | ISIC_0033213 895 | ISIC_0033236 896 | ISIC_0033241 897 | ISIC_0033244 898 | ISIC_0033246 899 | ISIC_0033282 900 | ISIC_0033286 901 | ISIC_0033303 902 | ISIC_0033310 903 | ISIC_0033313 904 | ISIC_0033314 905 | ISIC_0033322 906 | ISIC_0033329 907 | ISIC_0033358 908 | ISIC_0033364 909 | ISIC_0033372 910 | ISIC_0033373 911 | ISIC_0033376 912 | ISIC_0033389 913 | ISIC_0033394 914 | ISIC_0033398 915 | ISIC_0033410 916 | ISIC_0033432 917 | ISIC_0033433 918 | ISIC_0033435 919 | ISIC_0033442 920 | ISIC_0033462 921 | ISIC_0033470 922 | ISIC_0033482 923 | ISIC_0033490 924 | ISIC_0033523 925 | ISIC_0033528 926 | ISIC_0033537 927 | ISIC_0033558 928 | ISIC_0033560 929 | ISIC_0033580 930 | ISIC_0033590 931 | ISIC_0033591 932 | ISIC_0033595 933 | ISIC_0033631 934 | ISIC_0033640 935 | ISIC_0033650 936 | ISIC_0033653 937 | ISIC_0033665 938 | ISIC_0033671 939 | ISIC_0033691 940 | ISIC_0033711 941 | ISIC_0033713 942 | ISIC_0033718 943 | ISIC_0033763 944 | ISIC_0033796 945 | ISIC_0033803 946 | ISIC_0033808 947 | ISIC_0033811 948 | ISIC_0033812 949 | ISIC_0033839 950 | ISIC_0033842 951 | ISIC_0033847 952 | ISIC_0033860 953 | ISIC_0033865 954 | ISIC_0033875 955 | ISIC_0033879 956 | ISIC_0033896 957 | ISIC_0033903 958 | ISIC_0033910 959 | ISIC_0033914 960 | ISIC_0033917 961 | ISIC_0033919 962 | ISIC_0033927 963 | ISIC_0033931 964 | ISIC_0033951 965 | ISIC_0033953 966 | ISIC_0033958 967 | ISIC_0033965 968 | ISIC_0033970 969 | ISIC_0033978 970 | ISIC_0034010 971 | ISIC_0034016 972 | ISIC_0034026 973 | ISIC_0034032 974 | ISIC_0034059 975 | ISIC_0034061 976 | ISIC_0034066 977 | ISIC_0034067 978 | ISIC_0034076 979 | ISIC_0034094 980 | ISIC_0034101 981 | ISIC_0034110 982 | ISIC_0034114 983 | ISIC_0034123 984 | ISIC_0034128 985 | ISIC_0034158 986 | ISIC_0034159 987 | ISIC_0034175 988 | ISIC_0034213 989 | ISIC_0034230 990 | ISIC_0034233 991 | ISIC_0034236 992 | ISIC_0034237 993 | ISIC_0034286 994 | ISIC_0034289 995 | ISIC_0034306 996 | -------------------------------------------------------------------------------- /splits/split_task3_validation_only_5.txt: -------------------------------------------------------------------------------- 1 | ISIC_0024306 2 | ISIC_0024314 3 | ISIC_0024327 4 | ISIC_0024328 5 | ISIC_0024335 6 | ISIC_0024339 7 | ISIC_0024352 8 | ISIC_0024354 9 | ISIC_0024361 10 | ISIC_0024369 11 | ISIC_0024385 12 | ISIC_0024389 13 | ISIC_0024391 14 | ISIC_0024398 15 | ISIC_0024403 16 | ISIC_0024417 17 | ISIC_0024439 18 | ISIC_0024441 19 | ISIC_0024449 20 | ISIC_0024452 21 | ISIC_0024466 22 | ISIC_0024468 23 | ISIC_0024496 24 | ISIC_0024515 25 | ISIC_0024540 26 | ISIC_0024551 27 | ISIC_0024567 28 | ISIC_0024569 29 | ISIC_0024571 30 | ISIC_0024579 31 | ISIC_0024580 32 | ISIC_0024584 33 | ISIC_0024593 34 | ISIC_0024603 35 | ISIC_0024606 36 | ISIC_0024607 37 | ISIC_0024608 38 | ISIC_0024620 39 | ISIC_0024621 40 | ISIC_0024628 41 | ISIC_0024640 42 | ISIC_0024652 43 | ISIC_0024655 44 | ISIC_0024659 45 | ISIC_0024662 46 | ISIC_0024666 47 | ISIC_0024683 48 | ISIC_0024684 49 | ISIC_0024707 50 | ISIC_0024708 51 | ISIC_0024711 52 | ISIC_0024719 53 | ISIC_0024727 54 | ISIC_0024740 55 | ISIC_0024746 56 | ISIC_0024771 57 | ISIC_0024776 58 | ISIC_0024777 59 | ISIC_0024782 60 | ISIC_0024783 61 | ISIC_0024789 62 | ISIC_0024808 63 | ISIC_0024830 64 | ISIC_0024833 65 | ISIC_0024863 66 | ISIC_0024867 67 | ISIC_0024875 68 | ISIC_0024894 69 | ISIC_0024907 70 | ISIC_0024913 71 | ISIC_0024919 72 | ISIC_0024945 73 | ISIC_0024963 74 | ISIC_0024972 75 | ISIC_0024973 76 | ISIC_0024991 77 | ISIC_0024992 78 | ISIC_0024998 79 | ISIC_0025000 80 | ISIC_0025007 81 | ISIC_0025008 82 | ISIC_0025012 83 | ISIC_0025013 84 | ISIC_0025014 85 | ISIC_0025015 86 | ISIC_0025018 87 | ISIC_0025036 88 | ISIC_0025043 89 | ISIC_0025056 90 | ISIC_0025076 91 | ISIC_0025086 92 | ISIC_0025090 93 | ISIC_0025096 94 | ISIC_0025105 95 | ISIC_0025110 96 | ISIC_0025121 97 | ISIC_0025128 98 | ISIC_0025133 99 | ISIC_0025161 100 | ISIC_0025184 101 | ISIC_0025199 102 | ISIC_0025214 103 | ISIC_0025217 104 | ISIC_0025218 105 | ISIC_0025240 106 | ISIC_0025245 107 | ISIC_0025252 108 | ISIC_0025257 109 | ISIC_0025267 110 | ISIC_0025283 111 | ISIC_0025287 112 | ISIC_0025306 113 | ISIC_0025328 114 | ISIC_0025359 115 | ISIC_0025368 116 | ISIC_0025380 117 | ISIC_0025388 118 | ISIC_0025389 119 | ISIC_0025400 120 | ISIC_0025441 121 | ISIC_0025451 122 | ISIC_0025462 123 | ISIC_0025469 124 | ISIC_0025479 125 | ISIC_0025480 126 | ISIC_0025492 127 | ISIC_0025508 128 | ISIC_0025524 129 | ISIC_0025526 130 | ISIC_0025544 131 | ISIC_0025550 132 | ISIC_0025552 133 | ISIC_0025553 134 | ISIC_0025557 135 | ISIC_0025562 136 | ISIC_0025574 137 | ISIC_0025577 138 | ISIC_0025583 139 | ISIC_0025585 140 | ISIC_0025607 141 | ISIC_0025621 142 | ISIC_0025627 143 | ISIC_0025639 144 | ISIC_0025642 145 | ISIC_0025688 146 | ISIC_0025691 147 | ISIC_0025693 148 | ISIC_0025696 149 | ISIC_0025715 150 | ISIC_0025735 151 | ISIC_0025752 152 | ISIC_0025755 153 | ISIC_0025757 154 | ISIC_0025766 155 | ISIC_0025777 156 | ISIC_0025801 157 | ISIC_0025807 158 | ISIC_0025812 159 | ISIC_0025814 160 | ISIC_0025840 161 | ISIC_0025876 162 | ISIC_0025878 163 | ISIC_0025884 164 | ISIC_0025890 165 | ISIC_0025893 166 | ISIC_0025894 167 | ISIC_0025900 168 | ISIC_0025905 169 | ISIC_0025906 170 | ISIC_0025910 171 | ISIC_0025917 172 | ISIC_0025939 173 | ISIC_0025952 174 | ISIC_0025960 175 | ISIC_0025963 176 | ISIC_0025969 177 | ISIC_0025987 178 | ISIC_0026017 179 | ISIC_0026018 180 | ISIC_0026019 181 | ISIC_0026022 182 | ISIC_0026025 183 | ISIC_0026029 184 | ISIC_0026030 185 | ISIC_0026039 186 | ISIC_0026041 187 | ISIC_0026043 188 | ISIC_0026056 189 | ISIC_0026059 190 | ISIC_0026062 191 | ISIC_0026069 192 | ISIC_0026072 193 | ISIC_0026110 194 | ISIC_0026116 195 | ISIC_0026120 196 | ISIC_0026130 197 | ISIC_0026132 198 | ISIC_0026138 199 | ISIC_0026153 200 | ISIC_0026163 201 | ISIC_0026164 202 | ISIC_0026167 203 | ISIC_0026171 204 | ISIC_0026188 205 | ISIC_0026204 206 | ISIC_0026211 207 | ISIC_0026227 208 | ISIC_0026249 209 | ISIC_0026260 210 | ISIC_0026261 211 | ISIC_0026268 212 | ISIC_0026270 213 | ISIC_0026273 214 | ISIC_0026280 215 | ISIC_0026293 216 | ISIC_0026296 217 | ISIC_0026309 218 | ISIC_0026311 219 | ISIC_0026313 220 | ISIC_0026381 221 | ISIC_0026389 222 | ISIC_0026406 223 | ISIC_0026425 224 | ISIC_0026429 225 | ISIC_0026450 226 | ISIC_0026456 227 | ISIC_0026481 228 | ISIC_0026488 229 | ISIC_0026513 230 | ISIC_0026524 231 | ISIC_0026528 232 | ISIC_0026541 233 | ISIC_0026547 234 | ISIC_0026592 235 | ISIC_0026596 236 | ISIC_0026610 237 | ISIC_0026619 238 | ISIC_0026621 239 | ISIC_0026633 240 | ISIC_0026634 241 | ISIC_0026641 242 | ISIC_0026661 243 | ISIC_0026712 244 | ISIC_0026722 245 | ISIC_0026732 246 | ISIC_0026748 247 | ISIC_0026761 248 | ISIC_0026764 249 | ISIC_0026792 250 | ISIC_0026799 251 | ISIC_0026801 252 | ISIC_0026825 253 | ISIC_0026830 254 | ISIC_0026840 255 | ISIC_0026853 256 | ISIC_0026854 257 | ISIC_0026872 258 | ISIC_0026880 259 | ISIC_0026888 260 | ISIC_0026898 261 | ISIC_0026901 262 | ISIC_0026933 263 | ISIC_0026936 264 | ISIC_0026948 265 | ISIC_0026950 266 | ISIC_0026962 267 | ISIC_0026964 268 | ISIC_0026966 269 | ISIC_0026969 270 | ISIC_0026978 271 | ISIC_0026992 272 | ISIC_0027005 273 | ISIC_0027010 274 | ISIC_0027023 275 | ISIC_0027076 276 | ISIC_0027092 277 | ISIC_0027094 278 | ISIC_0027127 279 | ISIC_0027143 280 | ISIC_0027151 281 | ISIC_0027164 282 | ISIC_0027170 283 | ISIC_0027173 284 | ISIC_0027175 285 | ISIC_0027203 286 | ISIC_0027218 287 | ISIC_0027221 288 | ISIC_0027227 289 | ISIC_0027228 290 | ISIC_0027238 291 | ISIC_0027241 292 | ISIC_0027263 293 | ISIC_0027264 294 | ISIC_0027278 295 | ISIC_0027294 296 | ISIC_0027305 297 | ISIC_0027318 298 | ISIC_0027321 299 | ISIC_0027339 300 | ISIC_0027344 301 | ISIC_0027356 302 | ISIC_0027364 303 | ISIC_0027367 304 | ISIC_0027396 305 | ISIC_0027406 306 | ISIC_0027422 307 | ISIC_0027427 308 | ISIC_0027432 309 | ISIC_0027439 310 | ISIC_0027454 311 | ISIC_0027457 312 | ISIC_0027483 313 | ISIC_0027493 314 | ISIC_0027504 315 | ISIC_0027507 316 | ISIC_0027509 317 | ISIC_0027515 318 | ISIC_0027518 319 | ISIC_0027532 320 | ISIC_0027540 321 | ISIC_0027546 322 | ISIC_0027551 323 | ISIC_0027557 324 | ISIC_0027565 325 | ISIC_0027568 326 | ISIC_0027569 327 | ISIC_0027576 328 | ISIC_0027602 329 | ISIC_0027630 330 | ISIC_0027639 331 | ISIC_0027663 332 | ISIC_0027666 333 | ISIC_0027677 334 | ISIC_0027682 335 | ISIC_0027683 336 | ISIC_0027685 337 | ISIC_0027703 338 | ISIC_0027704 339 | ISIC_0027710 340 | ISIC_0027715 341 | ISIC_0027718 342 | ISIC_0027719 343 | ISIC_0027723 344 | ISIC_0027724 345 | ISIC_0027726 346 | ISIC_0027734 347 | ISIC_0027748 348 | ISIC_0027767 349 | ISIC_0027780 350 | ISIC_0027789 351 | ISIC_0027797 352 | ISIC_0027808 353 | ISIC_0027811 354 | ISIC_0027819 355 | ISIC_0027821 356 | ISIC_0027836 357 | ISIC_0027838 358 | ISIC_0027841 359 | ISIC_0027849 360 | ISIC_0027852 361 | ISIC_0027861 362 | ISIC_0027864 363 | ISIC_0027872 364 | ISIC_0027873 365 | ISIC_0027876 366 | ISIC_0027881 367 | ISIC_0027893 368 | ISIC_0027897 369 | ISIC_0027903 370 | ISIC_0027905 371 | ISIC_0027913 372 | ISIC_0027922 373 | ISIC_0027930 374 | ISIC_0027939 375 | ISIC_0027948 376 | ISIC_0027951 377 | ISIC_0027955 378 | ISIC_0027976 379 | ISIC_0027984 380 | ISIC_0027997 381 | ISIC_0028000 382 | ISIC_0028010 383 | ISIC_0028017 384 | ISIC_0028034 385 | ISIC_0028038 386 | ISIC_0028042 387 | ISIC_0028056 388 | ISIC_0028062 389 | ISIC_0028074 390 | ISIC_0028080 391 | ISIC_0028085 392 | ISIC_0028090 393 | ISIC_0028099 394 | ISIC_0028104 395 | ISIC_0028124 396 | ISIC_0028127 397 | ISIC_0028132 398 | ISIC_0028150 399 | ISIC_0028151 400 | ISIC_0028161 401 | ISIC_0028166 402 | ISIC_0028167 403 | ISIC_0028170 404 | ISIC_0028177 405 | ISIC_0028194 406 | ISIC_0028209 407 | ISIC_0028220 408 | ISIC_0028230 409 | ISIC_0028263 410 | ISIC_0028264 411 | ISIC_0028283 412 | ISIC_0028284 413 | ISIC_0028289 414 | ISIC_0028303 415 | ISIC_0028308 416 | ISIC_0028309 417 | ISIC_0028319 418 | ISIC_0028323 419 | ISIC_0028329 420 | ISIC_0028337 421 | ISIC_0028341 422 | ISIC_0028343 423 | ISIC_0028388 424 | ISIC_0028389 425 | ISIC_0028400 426 | ISIC_0028412 427 | ISIC_0028413 428 | ISIC_0028423 429 | ISIC_0028430 430 | ISIC_0028431 431 | ISIC_0028440 432 | ISIC_0028445 433 | ISIC_0028455 434 | ISIC_0028488 435 | ISIC_0028500 436 | ISIC_0028514 437 | ISIC_0028516 438 | ISIC_0028535 439 | ISIC_0028551 440 | ISIC_0028562 441 | ISIC_0028566 442 | ISIC_0028594 443 | ISIC_0028601 444 | ISIC_0028606 445 | ISIC_0028610 446 | ISIC_0028614 447 | ISIC_0028638 448 | ISIC_0028654 449 | ISIC_0028655 450 | ISIC_0028660 451 | ISIC_0028669 452 | ISIC_0028709 453 | ISIC_0028749 454 | ISIC_0028754 455 | ISIC_0028761 456 | ISIC_0028780 457 | ISIC_0028802 458 | ISIC_0028804 459 | ISIC_0028808 460 | ISIC_0028812 461 | ISIC_0028828 462 | ISIC_0028832 463 | ISIC_0028849 464 | ISIC_0028864 465 | ISIC_0028882 466 | ISIC_0028890 467 | ISIC_0028924 468 | ISIC_0028926 469 | ISIC_0028928 470 | ISIC_0028954 471 | ISIC_0028956 472 | ISIC_0028962 473 | ISIC_0028970 474 | ISIC_0028980 475 | ISIC_0028984 476 | ISIC_0028986 477 | ISIC_0028991 478 | ISIC_0029003 479 | ISIC_0029018 480 | ISIC_0029019 481 | ISIC_0029020 482 | ISIC_0029029 483 | ISIC_0029041 484 | ISIC_0029049 485 | ISIC_0029050 486 | ISIC_0029065 487 | ISIC_0029067 488 | ISIC_0029086 489 | ISIC_0029088 490 | ISIC_0029092 491 | ISIC_0029100 492 | ISIC_0029103 493 | ISIC_0029105 494 | ISIC_0029108 495 | ISIC_0029125 496 | ISIC_0029130 497 | ISIC_0029131 498 | ISIC_0029143 499 | ISIC_0029145 500 | ISIC_0029146 501 | ISIC_0029161 502 | ISIC_0029169 503 | ISIC_0029181 504 | ISIC_0029184 505 | ISIC_0029191 506 | ISIC_0029196 507 | ISIC_0029203 508 | ISIC_0029213 509 | ISIC_0029227 510 | ISIC_0029236 511 | ISIC_0029239 512 | ISIC_0029242 513 | ISIC_0029252 514 | ISIC_0029261 515 | ISIC_0029270 516 | ISIC_0029277 517 | ISIC_0029279 518 | ISIC_0029282 519 | ISIC_0029285 520 | ISIC_0029305 521 | ISIC_0029323 522 | ISIC_0029357 523 | ISIC_0029362 524 | ISIC_0029380 525 | ISIC_0029385 526 | ISIC_0029389 527 | ISIC_0029401 528 | ISIC_0029403 529 | ISIC_0029419 530 | ISIC_0029423 531 | ISIC_0029441 532 | ISIC_0029442 533 | ISIC_0029459 534 | ISIC_0029463 535 | ISIC_0029482 536 | ISIC_0029512 537 | ISIC_0029518 538 | ISIC_0029520 539 | ISIC_0029537 540 | ISIC_0029539 541 | ISIC_0029544 542 | ISIC_0029551 543 | ISIC_0029560 544 | ISIC_0029563 545 | ISIC_0029565 546 | ISIC_0029566 547 | ISIC_0029571 548 | ISIC_0029572 549 | ISIC_0029574 550 | ISIC_0029581 551 | ISIC_0029609 552 | ISIC_0029618 553 | ISIC_0029638 554 | ISIC_0029660 555 | ISIC_0029670 556 | ISIC_0029673 557 | ISIC_0029675 558 | ISIC_0029687 559 | ISIC_0029688 560 | ISIC_0029689 561 | ISIC_0029708 562 | ISIC_0029714 563 | ISIC_0029721 564 | ISIC_0029726 565 | ISIC_0029727 566 | ISIC_0029735 567 | ISIC_0029739 568 | ISIC_0029782 569 | ISIC_0029784 570 | ISIC_0029785 571 | ISIC_0029791 572 | ISIC_0029802 573 | ISIC_0029803 574 | ISIC_0029806 575 | ISIC_0029816 576 | ISIC_0029829 577 | ISIC_0029851 578 | ISIC_0029859 579 | ISIC_0029865 580 | ISIC_0029872 581 | ISIC_0029876 582 | ISIC_0029891 583 | ISIC_0029893 584 | ISIC_0029902 585 | ISIC_0029929 586 | ISIC_0029936 587 | ISIC_0029938 588 | ISIC_0029960 589 | ISIC_0029967 590 | ISIC_0029969 591 | ISIC_0029976 592 | ISIC_0029986 593 | ISIC_0029994 594 | ISIC_0029997 595 | ISIC_0030029 596 | ISIC_0030031 597 | ISIC_0030076 598 | ISIC_0030077 599 | ISIC_0030086 600 | ISIC_0030116 601 | ISIC_0030136 602 | ISIC_0030154 603 | ISIC_0030165 604 | ISIC_0030167 605 | ISIC_0030180 606 | ISIC_0030184 607 | ISIC_0030200 608 | ISIC_0030219 609 | ISIC_0030229 610 | ISIC_0030237 611 | ISIC_0030241 612 | ISIC_0030242 613 | ISIC_0030246 614 | ISIC_0030273 615 | ISIC_0030288 616 | ISIC_0030289 617 | ISIC_0030302 618 | ISIC_0030309 619 | ISIC_0030316 620 | ISIC_0030317 621 | ISIC_0030319 622 | ISIC_0030322 623 | ISIC_0030324 624 | ISIC_0030355 625 | ISIC_0030362 626 | ISIC_0030368 627 | ISIC_0030399 628 | ISIC_0030406 629 | ISIC_0030426 630 | ISIC_0030441 631 | ISIC_0030446 632 | ISIC_0030482 633 | ISIC_0030513 634 | ISIC_0030525 635 | ISIC_0030528 636 | ISIC_0030529 637 | ISIC_0030542 638 | ISIC_0030562 639 | ISIC_0030583 640 | ISIC_0030591 641 | ISIC_0030598 642 | ISIC_0030599 643 | ISIC_0030608 644 | ISIC_0030618 645 | ISIC_0030619 646 | ISIC_0030638 647 | ISIC_0030641 648 | ISIC_0030649 649 | ISIC_0030650 650 | ISIC_0030655 651 | ISIC_0030658 652 | ISIC_0030660 653 | ISIC_0030675 654 | ISIC_0030676 655 | ISIC_0030692 656 | ISIC_0030713 657 | ISIC_0030726 658 | ISIC_0030727 659 | ISIC_0030739 660 | ISIC_0030748 661 | ISIC_0030751 662 | ISIC_0030786 663 | ISIC_0030795 664 | ISIC_0030806 665 | ISIC_0030812 666 | ISIC_0030815 667 | ISIC_0030830 668 | ISIC_0030841 669 | ISIC_0030842 670 | ISIC_0030884 671 | ISIC_0030899 672 | ISIC_0030907 673 | ISIC_0030913 674 | ISIC_0030914 675 | ISIC_0030920 676 | ISIC_0030921 677 | ISIC_0030930 678 | ISIC_0030933 679 | ISIC_0030935 680 | ISIC_0030937 681 | ISIC_0030943 682 | ISIC_0030947 683 | ISIC_0030950 684 | ISIC_0030959 685 | ISIC_0030972 686 | ISIC_0030985 687 | ISIC_0030994 688 | ISIC_0030996 689 | ISIC_0031001 690 | ISIC_0031019 691 | ISIC_0031033 692 | ISIC_0031038 693 | ISIC_0031040 694 | ISIC_0031059 695 | ISIC_0031060 696 | ISIC_0031081 697 | ISIC_0031089 698 | ISIC_0031090 699 | ISIC_0031104 700 | ISIC_0031107 701 | ISIC_0031121 702 | ISIC_0031128 703 | ISIC_0031130 704 | ISIC_0031135 705 | ISIC_0031145 706 | ISIC_0031146 707 | ISIC_0031147 708 | ISIC_0031156 709 | ISIC_0031170 710 | ISIC_0031171 711 | ISIC_0031176 712 | ISIC_0031199 713 | ISIC_0031213 714 | ISIC_0031218 715 | ISIC_0031225 716 | ISIC_0031234 717 | ISIC_0031236 718 | ISIC_0031257 719 | ISIC_0031258 720 | ISIC_0031269 721 | ISIC_0031273 722 | ISIC_0031281 723 | ISIC_0031291 724 | ISIC_0031296 725 | ISIC_0031306 726 | ISIC_0031314 727 | ISIC_0031316 728 | ISIC_0031325 729 | ISIC_0031351 730 | ISIC_0031355 731 | ISIC_0031360 732 | ISIC_0031364 733 | ISIC_0031372 734 | ISIC_0031378 735 | ISIC_0031396 736 | ISIC_0031398 737 | ISIC_0031434 738 | ISIC_0031439 739 | ISIC_0031450 740 | ISIC_0031455 741 | ISIC_0031460 742 | ISIC_0031493 743 | ISIC_0031508 744 | ISIC_0031520 745 | ISIC_0031527 746 | ISIC_0031538 747 | ISIC_0031551 748 | ISIC_0031580 749 | ISIC_0031584 750 | ISIC_0031585 751 | ISIC_0031586 752 | ISIC_0031602 753 | ISIC_0031606 754 | ISIC_0031638 755 | ISIC_0031641 756 | ISIC_0031657 757 | ISIC_0031665 758 | ISIC_0031670 759 | ISIC_0031680 760 | ISIC_0031683 761 | ISIC_0031723 762 | ISIC_0031727 763 | ISIC_0031740 764 | ISIC_0031741 765 | ISIC_0031745 766 | ISIC_0031747 767 | ISIC_0031754 768 | ISIC_0031757 769 | ISIC_0031763 770 | ISIC_0031779 771 | ISIC_0031807 772 | ISIC_0031808 773 | ISIC_0031823 774 | ISIC_0031838 775 | ISIC_0031850 776 | ISIC_0031870 777 | ISIC_0031876 778 | ISIC_0031884 779 | ISIC_0031907 780 | ISIC_0031925 781 | ISIC_0031935 782 | ISIC_0031948 783 | ISIC_0031950 784 | ISIC_0031951 785 | ISIC_0031967 786 | ISIC_0031975 787 | ISIC_0031982 788 | ISIC_0031991 789 | ISIC_0031994 790 | ISIC_0032000 791 | ISIC_0032001 792 | ISIC_0032025 793 | ISIC_0032033 794 | ISIC_0032034 795 | ISIC_0032040 796 | ISIC_0032041 797 | ISIC_0032043 798 | ISIC_0032056 799 | ISIC_0032059 800 | ISIC_0032077 801 | ISIC_0032094 802 | ISIC_0032132 803 | ISIC_0032142 804 | ISIC_0032152 805 | ISIC_0032155 806 | ISIC_0032157 807 | ISIC_0032160 808 | ISIC_0032163 809 | ISIC_0032167 810 | ISIC_0032191 811 | ISIC_0032197 812 | ISIC_0032209 813 | ISIC_0032245 814 | ISIC_0032250 815 | ISIC_0032255 816 | ISIC_0032264 817 | ISIC_0032266 818 | ISIC_0032268 819 | ISIC_0032275 820 | ISIC_0032286 821 | ISIC_0032288 822 | ISIC_0032298 823 | ISIC_0032322 824 | ISIC_0032324 825 | ISIC_0032325 826 | ISIC_0032329 827 | ISIC_0032340 828 | ISIC_0032349 829 | ISIC_0032365 830 | ISIC_0032404 831 | ISIC_0032449 832 | ISIC_0032472 833 | ISIC_0032473 834 | ISIC_0032481 835 | ISIC_0032485 836 | ISIC_0032497 837 | ISIC_0032512 838 | ISIC_0032517 839 | ISIC_0032519 840 | ISIC_0032521 841 | ISIC_0032530 842 | ISIC_0032532 843 | ISIC_0032546 844 | ISIC_0032550 845 | ISIC_0032551 846 | ISIC_0032555 847 | ISIC_0032572 848 | ISIC_0032576 849 | ISIC_0032600 850 | ISIC_0032611 851 | ISIC_0032625 852 | ISIC_0032634 853 | ISIC_0032653 854 | ISIC_0032654 855 | ISIC_0032672 856 | ISIC_0032673 857 | ISIC_0032674 858 | ISIC_0032692 859 | ISIC_0032696 860 | ISIC_0032704 861 | ISIC_0032720 862 | ISIC_0032729 863 | ISIC_0032763 864 | ISIC_0032774 865 | ISIC_0032791 866 | ISIC_0032799 867 | ISIC_0032802 868 | ISIC_0032804 869 | ISIC_0032808 870 | ISIC_0032815 871 | ISIC_0032817 872 | ISIC_0032820 873 | ISIC_0032823 874 | ISIC_0032827 875 | ISIC_0032839 876 | ISIC_0032845 877 | ISIC_0032853 878 | ISIC_0032868 879 | ISIC_0032870 880 | ISIC_0032880 881 | ISIC_0032914 882 | ISIC_0032932 883 | ISIC_0032933 884 | ISIC_0032937 885 | ISIC_0032941 886 | ISIC_0032943 887 | ISIC_0032958 888 | ISIC_0032966 889 | ISIC_0032972 890 | ISIC_0032982 891 | ISIC_0032996 892 | ISIC_0033001 893 | ISIC_0033007 894 | ISIC_0033022 895 | ISIC_0033047 896 | ISIC_0033066 897 | ISIC_0033070 898 | ISIC_0033076 899 | ISIC_0033086 900 | ISIC_0033094 901 | ISIC_0033105 902 | ISIC_0033115 903 | ISIC_0033128 904 | ISIC_0033162 905 | ISIC_0033163 906 | ISIC_0033167 907 | ISIC_0033177 908 | ISIC_0033185 909 | ISIC_0033194 910 | ISIC_0033196 911 | ISIC_0033204 912 | ISIC_0033211 913 | ISIC_0033220 914 | ISIC_0033221 915 | ISIC_0033222 916 | ISIC_0033224 917 | ISIC_0033249 918 | ISIC_0033282 919 | ISIC_0033289 920 | ISIC_0033309 921 | ISIC_0033324 922 | ISIC_0033336 923 | ISIC_0033340 924 | ISIC_0033360 925 | ISIC_0033383 926 | ISIC_0033391 927 | ISIC_0033405 928 | ISIC_0033406 929 | ISIC_0033435 930 | ISIC_0033442 931 | ISIC_0033449 932 | ISIC_0033454 933 | ISIC_0033463 934 | ISIC_0033476 935 | ISIC_0033487 936 | ISIC_0033493 937 | ISIC_0033499 938 | ISIC_0033500 939 | ISIC_0033510 940 | ISIC_0033513 941 | ISIC_0033517 942 | ISIC_0033518 943 | ISIC_0033531 944 | ISIC_0033535 945 | ISIC_0033538 946 | ISIC_0033544 947 | ISIC_0033608 948 | ISIC_0033614 949 | ISIC_0033617 950 | ISIC_0033640 951 | ISIC_0033649 952 | ISIC_0033657 953 | ISIC_0033662 954 | ISIC_0033663 955 | ISIC_0033676 956 | ISIC_0033684 957 | ISIC_0033700 958 | ISIC_0033705 959 | ISIC_0033710 960 | ISIC_0033757 961 | ISIC_0033768 962 | ISIC_0033771 963 | ISIC_0033800 964 | ISIC_0033822 965 | ISIC_0033843 966 | ISIC_0033856 967 | ISIC_0033861 968 | ISIC_0033864 969 | ISIC_0033885 970 | ISIC_0033887 971 | ISIC_0033889 972 | ISIC_0033902 973 | ISIC_0033919 974 | ISIC_0033924 975 | ISIC_0033927 976 | ISIC_0033937 977 | ISIC_0033953 978 | ISIC_0033954 979 | ISIC_0033955 980 | ISIC_0033958 981 | ISIC_0033959 982 | ISIC_0033969 983 | ISIC_0033990 984 | ISIC_0033995 985 | ISIC_0033999 986 | ISIC_0034012 987 | ISIC_0034016 988 | ISIC_0034023 989 | ISIC_0034035 990 | ISIC_0034038 991 | ISIC_0034040 992 | ISIC_0034045 993 | ISIC_0034046 994 | ISIC_0034058 995 | ISIC_0034069 996 | ISIC_0034076 997 | ISIC_0034090 998 | ISIC_0034118 999 | ISIC_0034124 1000 | ISIC_0034148 1001 | ISIC_0034149 1002 | ISIC_0034150 1003 | ISIC_0034151 1004 | ISIC_0034165 1005 | ISIC_0034169 1006 | ISIC_0034173 1007 | ISIC_0034188 1008 | ISIC_0034241 1009 | ISIC_0034254 1010 | ISIC_0034258 1011 | ISIC_0034270 1012 | ISIC_0034271 1013 | ISIC_0034284 1014 | ISIC_0034291 1015 | ISIC_0034296 1016 | ISIC_0034299 1017 | ISIC_0034302 1018 | ISIC_0034306 1019 | ISIC_0034316 1020 | ISIC_0034317 1021 | ISIC_0034318 1022 | -------------------------------------------------------------------------------- /test.py: -------------------------------------------------------------------------------- 1 | import argparse 2 | 3 | import numpy as np 4 | import torch 5 | 6 | from auglib.augmentation import Augmentations 7 | from auglib.dataset_loader import CSVDatasetWithName 8 | from auglib.test import test_with_augmentation 9 | 10 | np.set_printoptions(precision=4, suppress=True) 11 | 12 | 13 | def parse_args(): 14 | parser = argparse.ArgumentParser() 15 | parser.add_argument('model', help='Path to the model') 16 | parser.add_argument('dataset_root', help='Path to dataset root') 17 | parser.add_argument('dataset_csv', help='Path to dataset csv') 18 | parser.add_argument('--dataset-split', help='Path to dataset split') 19 | parser.add_argument('-n', type=int, default=1, 20 | help='Number of image copies') 21 | parser.add_argument('--print-predictions', '-p', action='store_true', 22 | help='Print the predicted value for each image') 23 | parser.add_argument('--output', '-o', 24 | help='Path to output CSV file') 25 | return parser.parse_args() 26 | 27 | 28 | def main(args): 29 | device = torch.device("cuda" if torch.cuda.is_available() else "cpu") 30 | model = torch.load(args.model) 31 | model.eval() 32 | model.to(device) 33 | 34 | print(model.aug_params) 35 | augs = Augmentations(**model.aug_params) 36 | dataset = CSVDatasetWithName(args.dataset_root, 37 | args.dataset_csv, 38 | 'image', 39 | 'label', 40 | transform=augs.tf_transform, 41 | add_extension='.jpg', 42 | split=args.dataset_split) 43 | 44 | score, preds = test_with_augmentation(model, dataset, device, 8, args.n) 45 | print(score) 46 | 47 | if args.print_predictions: 48 | for _, row in preds.iterrows(): 49 | print("{},{}".format(row['image'], row['score'])) 50 | 51 | if args.output: 52 | preds.to_csv(args.output, index=False, 53 | columns=['image', 'MEL', 'NV', 'BCC', 'AKIEC', 54 | 'BKL', 'DF', 'VASC']) 55 | 56 | 57 | if __name__ == '__main__': 58 | args = parse_args() 59 | main(args) 60 | -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- 1 | from itertools import islice 2 | import os 3 | 4 | import numpy as np 5 | import pandas as pd 6 | import pretrainedmodels as ptm 7 | from sacred import Experiment 8 | from sacred.observers import FileStorageObserver, TelegramObserver 9 | from sklearn.metrics import confusion_matrix 10 | import torch 11 | import torch.nn as nn 12 | import torch.nn.functional as F 13 | import torch.optim as optim 14 | from torch.utils.data import DataLoader, sampler 15 | from torchvision import models 16 | from torchvision.utils import save_image 17 | from tqdm import tqdm 18 | 19 | from auglib.augmentation import Augmentations, set_seeds 20 | from auglib.meters import AverageMeter 21 | from auglib.dataset_loader import CSVDatasetWithName 22 | 23 | np.set_printoptions(precision=4, suppress=True) 24 | 25 | ex = Experiment() 26 | fs_observer = FileStorageObserver.create('results') 27 | ex.observers.append(fs_observer) 28 | telegram_file = 'telegram.json' 29 | if os.path.isfile(telegram_file): 30 | telegram_obs = TelegramObserver.from_config(telegram_file) 31 | ex.observers.append(telegram_obs) 32 | 33 | 34 | @ex.config 35 | def cfg(): 36 | train_root = None 37 | train_csv = None 38 | train_split = None 39 | val_root = None 40 | val_csv = None 41 | val_split = None 42 | n_classes = 7 43 | epochs = 200 # maximum number of epochs 44 | batch_size = 32 # batch size 45 | num_workers = 8 # parallel jobs for data loading and augmentation 46 | model_name = None # model: inceptionv4, densenet161, resnet152, senet154 47 | val_samples = 8 # number of samples per image in validation 48 | early_stopping_patience = 22 # patience for early stopping 49 | weighted_loss = False # use weighted loss based on class imbalance 50 | balanced_loader = False # balance classes in data loader 51 | # augmentations 52 | aug = { 53 | 'hflip': False, # Random Horizontal Flip 54 | 'vflip': False, # Random Vertical Flip 55 | 'rotation': 0, # Rotation (in degrees) 56 | 'shear': 0, # Shear (in degrees) 57 | 'scale': 1.0, # Scale (tuple (min, max)) 58 | 'color_contrast': 0, # Color Jitter: Contrast 59 | 'color_saturation': 0, # Color Jitter: Saturation 60 | 'color_brightness': 0, # Color Jitter: Brightness 61 | 'color_hue': 0, # Color Jitter: Hue 62 | 'random_crop': False, # Random Crops 63 | 'random_erasing': False, # Random Erasing 64 | 'piecewise_affine': False, # Piecewise Affine 65 | 'tps': False, # TPS Affine 66 | } 67 | 68 | 69 | def train_epoch(device, model, dataloaders, criterion, optimizer, phase, 70 | batches_per_epoch=None): 71 | losses = AverageMeter() 72 | accuracies = AverageMeter() 73 | all_preds = [] 74 | all_labels = [] 75 | model.train() 76 | 77 | if batches_per_epoch: 78 | tqdm_loader = tqdm( 79 | islice(dataloaders['train'], 0, batches_per_epoch), 80 | total=batches_per_epoch) 81 | else: 82 | tqdm_loader = tqdm(dataloaders[phase]) 83 | for data in tqdm_loader: 84 | (inputs, labels), name = data 85 | 86 | inputs = inputs.to(device) 87 | labels = labels.to(device) 88 | 89 | if phase == 'train': 90 | optimizer.zero_grad() 91 | 92 | with torch.set_grad_enabled(phase == 'train'): 93 | outputs = model(inputs) 94 | _, preds = torch.max(outputs.data, 1) 95 | loss = criterion(outputs, labels) 96 | 97 | if phase == 'train': 98 | loss.backward() 99 | optimizer.step() 100 | 101 | losses.update(loss.item(), inputs.size(0)) 102 | acc = torch.sum(preds == labels.data).item() / preds.shape[0] 103 | accuracies.update(acc) 104 | all_preds += list(F.softmax(outputs, dim=1).cpu().data.numpy()) 105 | all_labels += list(labels.cpu().data.numpy()) 106 | tqdm_loader.set_postfix(loss=losses.avg, acc=accuracies.avg) 107 | 108 | # Calculate multiclass AUC 109 | all_preds = np.array(all_preds) 110 | all_labels = np.array(all_labels) 111 | 112 | # Confusion Matrix 113 | print('Confusion matrix') 114 | cm = confusion_matrix(all_labels, all_preds.argmax(axis=1)) 115 | cmn = cm.astype('float') / cm.sum(axis=1)[:, np.newaxis] 116 | print(cm) 117 | print(cmn) 118 | acc = np.trace(cmn) / cmn.shape[0] 119 | 120 | return {'loss': losses.avg, 'acc': acc} 121 | 122 | 123 | def save_images(dataset, to, n=32): 124 | for i in range(n): 125 | img_path = os.path.join(to, 'img_{}.png'.format(i)) 126 | save_image(dataset[i][0], img_path) 127 | 128 | 129 | @ex.automain 130 | def main(train_root, train_csv, train_split, val_root, val_csv, val_split, 131 | epochs, aug, model_name, batch_size, num_workers, val_samples, 132 | early_stopping_patience, 133 | n_classes, weighted_loss, balanced_loader, _run): 134 | assert(model_name in 135 | ('inceptionv4', 'resnet152', 'densenet161', 'senet154')) 136 | 137 | AUGMENTED_IMAGES_DIR = os.path.join(fs_observer.dir, 'images') 138 | CHECKPOINTS_DIR = os.path.join(fs_observer.dir, 'checkpoints') 139 | BEST_MODEL_PATH = os.path.join(CHECKPOINTS_DIR, 'model_best.pth') 140 | LAST_MODEL_PATH = os.path.join(CHECKPOINTS_DIR, 'model_last.pth') 141 | for directory in (AUGMENTED_IMAGES_DIR, CHECKPOINTS_DIR): 142 | os.makedirs(directory) 143 | 144 | device = torch.device("cuda" if torch.cuda.is_available() else "cpu") 145 | 146 | if model_name == 'inceptionv4': 147 | model = ptm.inceptionv4(num_classes=1000, pretrained='imagenet') 148 | model.last_linear = nn.Linear(model.last_linear.in_features, n_classes) 149 | aug['size'] = 299 150 | aug['mean'] = model.mean 151 | aug['std'] = model.std 152 | elif model_name == 'resnet152': 153 | model = models.resnet152(pretrained=True) 154 | model.fc = nn.Linear(model.fc.in_features, n_classes) 155 | aug['size'] = 224 156 | aug['mean'] = [0.485, 0.456, 0.406] 157 | aug['std'] = [0.229, 0.224, 0.225] 158 | elif model_name == 'densenet161': 159 | model = models.densenet161(pretrained=True) 160 | model.classifier = nn.Linear(model.classifier.in_features, n_classes) 161 | aug['size'] = 224 162 | aug['mean'] = [0.485, 0.456, 0.406] 163 | aug['std'] = [0.229, 0.224, 0.225] 164 | elif model_name == 'senet154': 165 | model = ptm.senet154(num_classes=1000, pretrained='imagenet') 166 | model.last_linear = nn.Linear(model.last_linear.in_features, n_classes) 167 | aug['size'] = model.input_size[1] 168 | aug['mean'] = model.mean 169 | aug['std'] = model.std 170 | model.to(device) 171 | 172 | augs = Augmentations(**aug) 173 | model.aug_params = aug 174 | 175 | train_ds = CSVDatasetWithName( 176 | train_root, train_csv, 'image', 'label', 177 | transform=augs.tf_transform, add_extension='.jpg', split=train_split) 178 | val_ds = CSVDatasetWithName( 179 | val_root, val_csv, 'image', 'label', 180 | transform=augs.tf_transform, add_extension='.jpg', split=val_split) 181 | 182 | datasets = { 183 | 'train': train_ds, 184 | 'val': val_ds 185 | } 186 | 187 | if balanced_loader: 188 | data_sampler = sampler.WeightedRandomSampler( 189 | train_ds.sampler_weights, len(train_ds)) 190 | shuffle = False 191 | else: 192 | data_sampler = None 193 | shuffle = True 194 | 195 | dataloaders = { 196 | 'train': DataLoader(datasets['train'], batch_size=batch_size, 197 | shuffle=shuffle, num_workers=num_workers, 198 | sampler=data_sampler, worker_init_fn=set_seeds), 199 | 'val': DataLoader(datasets['val'], batch_size=batch_size, 200 | shuffle=False, num_workers=num_workers, 201 | worker_init_fn=set_seeds), 202 | } 203 | 204 | if weighted_loss: 205 | criterion = nn.CrossEntropyLoss( 206 | weight=torch.Tensor(datasets['train'].class_weights_list).cuda()) 207 | else: 208 | criterion = nn.CrossEntropyLoss() 209 | 210 | optimizer = optim.SGD(model.parameters(), lr=0.001, 211 | momentum=0.9, weight_decay=0.001) 212 | 213 | scheduler = optim.lr_scheduler.ReduceLROnPlateau(optimizer, factor=0.1, 214 | min_lr=1e-5, patience=10) 215 | 216 | metrics = { 217 | 'train': pd.DataFrame(columns=['epoch', 'loss', 'acc']), 218 | 'val': pd.DataFrame(columns=['epoch', 'loss', 'acc']) 219 | } 220 | 221 | best_val_loss = 1000.0 222 | epochs_without_improvement = 0 223 | batches_per_epoch = None 224 | 225 | for epoch in range(epochs): 226 | print('train epoch {}/{}'.format(epoch+1, epochs)) 227 | epoch_train_result = train_epoch( 228 | device, model, dataloaders, criterion, optimizer, 'train', 229 | batches_per_epoch) 230 | 231 | metrics['train'] = metrics['train'].append( 232 | {**epoch_train_result, 'epoch': epoch}, ignore_index=True) 233 | print('train', epoch_train_result) 234 | 235 | epoch_val_result = train_epoch( 236 | device, model, dataloaders, criterion, optimizer, 'val', 237 | batches_per_epoch) 238 | 239 | metrics['val'] = metrics['val'].append( 240 | {**epoch_val_result, 'epoch': epoch}, ignore_index=True) 241 | print('val', epoch_val_result) 242 | 243 | scheduler.step(epoch_val_result['loss']) 244 | 245 | if epoch_val_result['loss'] < best_val_loss: 246 | best_val_loss = epoch_val_result['loss'] 247 | epochs_without_improvement = 0 248 | torch.save(model, BEST_MODEL_PATH) 249 | print('Best loss at epoch {}'.format(epoch)) 250 | else: 251 | epochs_without_improvement += 1 252 | 253 | print('-' * 40) 254 | 255 | if epochs_without_improvement > early_stopping_patience: 256 | torch.save(model, LAST_MODEL_PATH) 257 | break 258 | 259 | if epoch == (epochs-1): 260 | torch.save(model, LAST_MODEL_PATH) 261 | 262 | for phase in ['train', 'val']: 263 | metrics[phase].epoch = metrics[phase].epoch.astype(int) 264 | metrics[phase].to_csv(os.path.join(fs_observer.dir, phase + '.csv'), 265 | index=False) 266 | 267 | print('Best validation loss: {}'.format(best_val_loss)) 268 | 269 | # TODO: return more metrics 270 | return {'max_val_acc': metrics['val']['acc'].max()} 271 | --------------------------------------------------------------------------------