├── README.md
├── investigateMetrics.py
├── investigateTraces.py
├── reading.py
└── workloads
    ├── boot_delete_config
        ├── boot-and-delete.yaml
        ├── commands-to-exec-nova-compute.sh
        ├── commands-to-exec-nova.sh
        ├── j_boot_delete_output.json
        ├── restart_nova_compute_nodes.sh
        ├── restart_nova_container.sh
        ├── trace_to_csv.py
        ├── trace_to_csv_1.1.py
        └── traceids_j_boot_delete.txt
    ├── create_delete_image_config
        ├── commands-to-exec-glance.sh
        ├── create-and-delete-image.yaml
        ├── j_image_output.html
        ├── j_image_output.json
        ├── list-images.yml
        ├── output_jasmin_image.html
        ├── output_jasmin_image.json
        ├── output_jasmin_images.json
        ├── restart_glance_container.sh
        ├── test.json
        ├── trace_ids_18th_nov
        ├── traceids_j_image.txt
        └── traceids_jasmin.txt
    ├── json_trace_ids.py
    ├── keystone_auth.yaml
    ├── network_create_delete_config
        ├── commands-to-exec-neutron.sh
        ├── create-and-delete-networks.yaml
        ├── debug.txt
        ├── glances_out.csv
        ├── restart_neutron_container.sh
        └── traceids_j_network.txt
    └── os-faults-latest.yaml


/README.md:
--------------------------------------------------------------------------------
 1 | # Multi-Source Distributed System Data for AI-powered Analytics
 2 | This repository contains the simple scripts for data statistics, and link to the multi-source distributed system dataset.
 3 | 
 4 | You may find details of this dataset from the original paper: 
 5 | 
 6 | *Sasho Nedelkoski, Jasmin Bogatinovski, Ajay Kumar Mandapati, Soeren Becker, Jorge Cardoso, Odej Kao, "Multi-Source Distributed System Data for AI-powered Analytics".*
 7 | 
 8 | 
 9 | <pre><code>
10 | @inproceedings{nedelkoski2020multi,
11 |   title={Multi-source Distributed System Data for AI-Powered Analytics},
12 |   author={Nedelkoski, Sasho and Bogatinovski, Jasmin and Mandapati, Ajay Kumar and Becker, Soeren and Cardoso, Jorge and Kao, Odej},
13 |   booktitle={European Conference on Service-Oriented and Cloud Computing},
14 |   pages={161--176},
15 |   year={2020},
16 |   organization={Springer}
17 | }
18 |   </code></pre>
19 | 
20 | <b>If you use the data, implementation, or any details of the paper, please cite!</b>
21 | 
22 | Abstract:
23 | 
24 | In recent years there has been an increased interest in Artificial Intelligence for IT Operations (AIOps). This field utilizes monitoring data from IT systems, big data platforms, and machine learning to automate various operations and maintenance (O&M) tasks for distributed systems.
25 | The major contributions have been materialized in the form of novel algorithms.
26 | Typically, researchers took the challenge of exploring one specific type of observability data sources, such as application logs, metrics, and distributed traces, to create new algorithms.
27 | Nonetheless, due to the low signal-to-noise ratio of monitoring data, there is a consensus that only the analysis of multi-source monitoring data will enable the development of useful algorithms that have better performance.  
28 | Unfortunately, existing datasets usually contain only a single source of data, often logs or metrics. This limits the possibilities for greater advances in AIOps research.
29 | Thus, we generated high-quality multi-source data composed of distributed traces, application logs, and metrics from a complex distributed system. This paper provides detailed descriptions of the experiment, statistics of the data, and identifies how such data can be analyzed to support O&M tasks such as anomaly detection, root cause analysis, and remediation.
30 | 
31 | General Information:
32 | 
33 | This repository contains the simple scripts for data statistics, and link to the multi-source distributed system dataset.
34 | 
35 | The multi-source/multimodal dataset is composed of distributed traces, application logs, and metrics produced from running a complex distributed system (Openstack). In addition, we also provide the workload and fault scripts together with the Rally report which can serve as ground truth (all at the Zenodo link below). We provide two datasets, which differ on how the workload is executed. The sequential_data is generated via executing workload of sequential user requests. The concurrent_data is generated via executing workload of concurrent user requests.
36 | 
37 | Important: The logs and the metrics are synchronized with respect time and they are both recorded on CEST (central european standard time). The traces are on UTC (Coordinated Universal Time -2 hours). They should be synchronized if the user develops multimodal methods. Please read the IMPORTANT_experiment_start_end.txt file before working with the data.
38 | 
39 | If you are interested in these data, please request the data via <a href="url">Zenodo</a>. Kindly note that the affiliation, and information about the utilization of the dataset. If you do not receive any response from Zenodo within one week, please check your spam mailbox or consider to resubmit your data request with the required information.
40 | 


--------------------------------------------------------------------------------
/investigateMetrics.py:
--------------------------------------------------------------------------------
  1 | from reading import *
  2 | import matplotlib.pyplot as plt
  3 | import os
  4 | from PyPDF2 import PdfFileReader
  5 | from PyPDF2 import PdfFileWriter
  6 | from collections import defaultdict
  7 | 
  8 | import matplotlib.ticker
  9 | 
 10 | """
 11 | Contains sripts for calculation and plotting of the statistical properties of the "metrics" data.
 12 | """
 13 | 
 14 | def plotFeaturesDistributionsMetrics(nodeID, metricsData):
 15 |     """
 16 |     Function to plot the metrics data for nodeID.
 17 |     :param nodeID: The nodeID represents the ID of the node one wants to observe.
 18 |     :param metricsData: The metricsData represent the data which distribution we are interested in.
 19 |     :return: None. Stores an image of the distribution of the properties in a folder.
 20 |     """
 21 | 
 22 |     pathToStoreTheImages = "./"
 23 | 
 24 |     plt.figure(nodeID, figsize=(12,12))
 25 |     plt.rc('xtick', labelsize=13)  # fontsize of the tick labels
 26 |     plt.rc('ytick', labelsize=13)  # fontsize of the tick labels
 27 |     plt.rc('font', size=13)  # controls default text sizes
 28 |     plt.rc('axes', titlesize=13)  # fontsize of the axes title
 29 |     plt.rc('axes', labelsize=13)  # fontsize of the x and y labels
 30 | 
 31 |     #for cnt, featureName in enumerate(['cpu.user', 'mem.used', 'load.cpucore', 'load.min1', 'load.min5', 'load.min15']):
 32 |     for cnt, featureName in enumerate(['cpu.user', 'mem.used', 'load.min1']):
 33 |         createSubplot = 230 + cnt + 1
 34 |         plt.subplot(createSubplot)
 35 |         plt.subplots_adjust(wspace=0.4)
 36 |         plt.xlabel(featureName)
 37 |         plt.hist(metricsData.loc[:, featureName], bins=100, color="black")
 38 | 
 39 |         #if nodeID in [117, 122, 123, 124]:
 40 |         #    if featureName == "cpu.user":
 41 |         #        plt.xlim((0, 80))
 42 | 
 43 |         #    if featureName == "mem.used":
 44 |         #        plt.xlim((188463616, 3662356736))
 45 | 
 46 |         #    if featureName in ['load.min1', 'load.min5', 'load.min15']:
 47 |         #        plt.xlim((0, 3))
 48 | 
 49 |         #else:
 50 |         #        if featureName == "cpu.user":
 51 |         #            plt.xlim((0, 80))
 52 | 
 53 |         #        if featureName in ['load.min1', 'load.min5', 'load.min15']:
 54 |         #            plt.xlim((0, 17))
 55 | 
 56 |     tmpPath = pathToStoreTheImages + str(nodeID) + "_new.pdf"
 57 |     #plt.suptitle("Metrics data for node: " + str(nodeID))
 58 |     plt.savefig(tmpPath, bbox_inches="tight")
 59 |     #cutPDF(tmpPath)
 60 |     plt.close()
 61 | 
 62 | 
 63 | def caluclateStatisticalProperties(metricData):
 64 |     """
 65 |      Function calculating statistical Properties of the metricData for a specific node.
 66 |     :param nodeID: The nodeID represents the ID of the node one wants to observe.
 67 |     :param metricData: The metricsData represent the data which distribution we are interested in.
 68 |     :return: To be continued if needed
 69 |     """
 70 |     d = defaultdict(dict)
 71 |     for _, featureName in enumerate(['cpu.user', 'mem.used', 'load.cpucore', 'load.min1', 'load.min5', 'load.min15']):
 72 |         d[featureName]["mean"] = np.mean(metricData.loc[:, featureName])
 73 |         d[featureName]["median"] = np.median(metricData.loc[:, featureName])
 74 |         d[featureName]["std"] = np.std(metricData.loc[:, featureName])
 75 |         d[featureName]["min"] = np.min(metricData.loc[:, featureName])
 76 |         d[featureName]["max"] = np.max(metricData.loc[:, featureName])
 77 |     return d
 78 |     #tmpPath = path + str(nodeID) + ".csv"
 79 | 
 80 | 
 81 | def cutPDF(filePath):
 82 |     """
 83 |     Helper function to trim a pdf.
 84 |     :param filePath: the Path were the pdf is stored.
 85 |     :return:
 86 |     """
 87 |     pdfRead = PdfFileReader(open(filePath, "rb"))
 88 |     page = pdfRead.getPage(0)
 89 |     print(page.cropBox.getLowerLeft())
 90 |     print(page.cropBox.getLowerRight())
 91 |     print(page.cropBox.getUpperLeft())
 92 |     print(page.cropBox.getUpperRight())
 93 |     lower_right_new_x_coordinate  = 864
 94 |     lower_right_new_y_coordinate = 400
 95 |     lower_left_new_x_coordinate = 0
 96 |     lower_left_new_y_coordinate = 400
 97 |     upper_left_new_x_coordinate = 0
 98 |     upper_left_new_y_coordinate = 864
 99 |     upper_right_new_x_coordinate = 864
100 |     upper_right_new_y_coordinate = 864
101 |     page.mediaBox.lowerRight = (lower_right_new_x_coordinate, lower_right_new_y_coordinate)
102 |     page.mediaBox.lowerLeft = (lower_left_new_x_coordinate, lower_left_new_y_coordinate)
103 |     page.mediaBox.upperRight = (upper_right_new_x_coordinate, upper_right_new_y_coordinate)
104 |     page.mediaBox.upperLeft = (upper_left_new_x_coordinate, upper_left_new_y_coordinate)
105 |     output = PdfFileWriter()
106 |     output.addPage(page)
107 |     with open("113_new.pdf", "wb") as out_f:
108 |         output.write(out_f)
109 | 
110 | lis = []
111 | for nodeID in [113, 117, 122, 123, 124]:
112 | #for nodeID in [113, 117]:
113 |     metricData = readMetrics(nodeID)
114 |     lis.append(metricData.shape[0])
115 |     plotFeaturesDistributionsMetrics(nodeID, metricData)
116 |     #break
117 | 
118 | 
119 | 


--------------------------------------------------------------------------------
/investigateTraces.py:
--------------------------------------------------------------------------------
  1 | """
  2 | Contains usefull functions for calculating the properties of the Traces data.
  3 | """
  4 | from reading import *
  5 | from pprint import PrettyPrinter
  6 | from collections import defaultdict
  7 | import json
  8 | 
  9 | 
 10 | def addOnes(dataFrame):
 11 |     """
 12 |     :param dataFrame: dataFrame representing traces
 13 |     :return: dataFrame + newColumn of ones
 14 |     """
 15 |     dataFrame["ones"] = np.ones(dataFrame.shape[0])
 16 |     return dataFrame
 17 | 
 18 | 
 19 | def groupCounts(dataFrame):
 20 |     pom = dataFrame.loc[:, ["Base_id", "ones"]].groupby(by=["Base_id"]).count()/2
 21 |     return  pom
 22 | 
 23 | 
 24 | def groupCountsAllFeatures(dataFrame, feature):
 25 |     pom = dataFrame.loc[:, [feature, "ones"]].groupby(by=[feature]).count()/2
 26 |     return pom
 27 | 
 28 | 
 29 | def storeJsons(dic, pathToStore):
 30 |     """
 31 |     :param dic: dict containing the properties
 32 |     :param operation: the operation being executed
 33 |     :param pathToStore: should be in form ./Traces/
 34 |     :return:
 35 |     """
 36 |     with open(pathToStore + "Traces_allFeatures.json", "w") as file:
 37 |         json.dump(dic, file)
 38 | 
 39 | 
 40 | def calculateStats(dataFrame, feature):
 41 |     d={}
 42 |     d["mean"] = float(list(dataFrame.mean().values)[0])
 43 |     d["std"] = float(list(dataFrame.std().values)[0])
 44 |     d["median"] = float(list(dataFrame.median().values)[0])
 45 |     d["min"] = float(list(dataFrame.min().values)[0])
 46 |     d["max"] = float(list(dataFrame.max().values)[0])
 47 |     d["quantile05"] = float(list(dataFrame.quantile(0.05).values)[0])
 48 |     d["quantile25"] = float(list(dataFrame.quantile(0.25).values)[0])
 49 |     d["quantile50"] = float(list(dataFrame.quantile(0.50).values)[0])
 50 |     d["quantile75"] = float(list(dataFrame.quantile(0.75).values)[0])
 51 |     d["quantile95"] = float(list(dataFrame.quantile(0.95).values)[0])
 52 |     d["numberUniqueValues"] = dataFrame.shape[0]
 53 | 
 54 |     return d
 55 | 
 56 | def tracesStats():
 57 |     """
 58 |     :return: creates .json files for the stats of all of the operations.
 59 |     """
 60 |     operationName = ['boot_delete_api_faults', 'boot_delete_compute_faults_traces', 'cinder_api_faults', 'cinder_compute_faults',   'create_delete_image',  'create_delete_stack', 'network_create_delete',]
 61 |     dic = defaultdict(dict)
 62 |     dic1 = defaultdict(list)
 63 |     for operation in operationName:
 64 |         first = readTraces(operation)
 65 |         pom1 = addOnes(first)
 66 |         pom1 = pom1.drop(["Unnamed: 0"], axis=1)
 67 |         dic1[operation] = pom1
 68 |         for feature in pom1.columns[:-1]:
 69 |             pom2 = groupCountsAllFeatures(pom1, feature)
 70 |             pom3 = calculateStats(pom2, feature)
 71 |             dic[operation][feature] = pom3
 72 | 
 73 |     storeJsons(dic, "./")
 74 | 
 75 |         #lista.append(dic)
 76 | 
 77 | 
 78 | def propertiesPerFeature():
 79 |     """
 80 | 
 81 |     :return: DataFrame containing the number of calls per operation on each type of calls. [rpc, wsgi and vif]
 82 |     """
 83 |     li = []
 84 |     operationName = ['boot_delete_api_faults', 'boot_delete_compute_faults_traces', 'cinder_api_faults',
 85 |                      'cinder_compute_faults', 'create_delete_image', 'create_delete_stack', 'network_create_delete', ]
 86 |     for operation in operationName:
 87 |         print("###########")
 88 |         print(operation)
 89 |         print("###########")
 90 |         first = readTraces(operation)
 91 |         oi = pd.value_counts(first.Name)
 92 |         dictionary = {}
 93 |         d = {}
 94 |         typesOfCalls = ["rpc", "wsgi", "vif", "driver"]
 95 |         for typeOfCall in typesOfCalls:
 96 |             flag = True
 97 |             for ind, x in enumerate(list(oi.index)):
 98 |                 if typeOfCall in x:
 99 |                     if flag == True:
100 |                         print("The operation {} has {} calls of type {} that number: {}".format(operation, typeOfCall, x, oi.loc[x]))
101 | 
102 |                         #li.append(oi.loc[x])
103 |                         d[typeOfCall] = oi.loc[x]
104 |                         flag = False
105 |                         #q = np.array(li)
106 |                     else:
107 |                         flag = True
108 |         pomm = list(d.keys())
109 |         if len(pomm) != 4:
110 |             if "rpc" not in pomm:
111 |                 d["rpc"] = 0
112 |             if "wsgi" not in pomm:
113 |                 d["wsgi"] = 0
114 |             if "vif" not in pomm:
115 |                 d["vif"] = 0
116 |             if "driver" not in pomm:
117 |                 d["driver"] = 0
118 |         dictionary[operation] = d
119 |         li.append(pd.DataFrame(dictionary))
120 |     return pd.concat(li, axis=1)
121 | """
122 |     for operation in operationName:
123 |         print("#######################################################")
124 |         print("#######################################################")
125 |         print("The mean number of calls for operation {} type of call {} is {}".format(operation, typeOfCall, np.mean(q)))
126 |         print("The std per number of calls for operation {} type of call {} is {}".format(operation, typeOfCall, np.std(q)))
127 |         print("The median number of calls for operation {} type of call {} is {}".format(operation, typeOfCall, np.median(q)))
128 |         print("The max number of calls for operation {} type of call {} is {}".format(operation, typeOfCall, np.max(q)))
129 |         print("The min number of calls for operation {} type of call {} is {}".format(operation, typeOfCall, np.min(q)))
130 |         print("#######################################################")
131 |         print("#######################################################")
132 | """
133 | tracesStats()
134 | a = propertiesPerFeature()


--------------------------------------------------------------------------------
/reading.py:
--------------------------------------------------------------------------------
 1 | import pandas as pd
 2 | import os
 3 | import numpy as np
 4 | 
 5 | def listLogsProject(projectName, path):
 6 |     """
 7 |     :param name: traces, logs, metrics
 8 |     :param projectName: One in ['haproxy', 'keystone', 'grafana', 'glance',
 9 |                                 'mariadb', 'kibana', 'swift', 'nova', 'ceph', 'rally', 'rabbitmq',
10 |                                 'placement', 'neutron', 'heat', 'chrony', 'openvswitch', 'cinder', 'horizon']
11 |            path: list the directories on the path.
12 |     :return: List of available logs for the project with projectName;
13 |     """
14 | 
15 |     return os.listdir(path)
16 | 
17 | 
18 | def readMetrics(nodeID, path):
19 |     """
20 |     This functions is used to read the metrics data for specific nodes.
21 |     :param nodeID: allowed values [113, 117, 122, 123, 124]
22 |            path:path where the metric data of the node.
23 |     :return: Data frame of size nx7. Where the 7 columns represent different metrics of interest.
24 |     """
25 |     assert nodeID in [113, 117, 122, 123, 124], str(nodeID) + " invalid node value. Please insert some of the 113, 117, 122, 123, 124 as relevant metrics files."
26 |     return pd.read_csv(path)
27 | 
28 | 
29 | def readTraces(path, operation="boot_delete_api_faults"):
30 |     """
31 |     Valid operations:
32 |     ['network_create_delete', 'boot_delete_api_faults', 'create_delete_image', 'boot_delete_compute_faults_traces', 'cinder_api_faults', 'cinder_compute_faults', 'create_delete_stack'],
33 |     :param operation: valid operation for the trace. It is initialized to boot_delete_api_faults as first operation when the sorting is done by alphabetical order.
34 |            path:path where the raw_csv log file is stored.
35 |     :return:
36 |     """
37 | 
38 |     assert operation in ['network_create_delete', 'boot_delete_api_faults', 'create_delete_image', 'boot_delete_compute_faults_traces', 'cinder_api_faults', 'cinder_compute_faults', 'create_delete_stack'], operation + " invalid node value. Please insert some of the set {'network_create_delete.csv', 'boot_delete_api_faults.csv', 'create_delete_image.csv', 'boot_delete_compute_faults_traces.csv', 'cinder_api_faults.csv', 'cinder_compute_faults.csv', 'create_delete_stack.csv'} as relevant trace IDs"
39 |     return pd.read_csv(path)
40 | 
41 | 
42 | 
43 | def readRaw(path):
44 |     """
45 | 
46 |     :param path:path where the raw_csv log file is stored.
47 |     :return: DataFrame contaning the logs.
48 |     """
49 |     return pd.read_csv(path)
50 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/boot-and-delete.yaml:
--------------------------------------------------------------------------------
 1 | {% set flavor_name = flavor_name or "m1.medium" %}
 2 | ---
 3 |   NovaServers.boot_and_delete_server:
 4 |     -
 5 |       args:
 6 |         flavor:
 7 |             name: "{{flavor_name}}"
 8 |         image:
 9 |             name: "ubuntu-18.04"
10 |         force_delete: true
11 |       runner:
12 |         type: "constant"
13 |         times: 2000
14 |         concurrency: 2
15 |       context:
16 |         users:
17 |           tenants: 3
18 |           users_per_tenant: 2
19 |       sla:
20 |         failure_rate:
21 |           max: 100
22 |       hooks:
23 |         - name: sys_call
24 |           description: Run script
25 |           args: sh ./restart_nova_container.sh
26 |           trigger:
27 |             name: event
28 |             args:
29 |               unit: iteration
30 |               at: [250,500,750,1000,1250,1500,2000,2250,2500,2750,3000,3250,3500,3750,4000,4250,4500,4750,5000,5250,5500,5750,6000,6250,6500,6750,7000]
31 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/commands-to-exec-nova-compute.sh:
--------------------------------------------------------------------------------
 1 | #!/bin/bash -x
 2 | # Restarting nova_api container 5 times and sleep for 10 secs between restarts
 3 | 
 4 | for i in {1..2}
 5 | do
 6 |     echo "Restarting nova-container"
 7 |     docker stop nova_compute
 8 |     sleep 15
 9 |     docker start nova_compute
10 | done
11 | 
12 | 
13 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/commands-to-exec-nova.sh:
--------------------------------------------------------------------------------
 1 | #!/bin/bash -x
 2 | # Restarting nova_api container 5 times and sleep for 10 secs between restarts
 3 | 
 4 | for i in {1..2}
 5 | do
 6 |     echo "Restarting nova-container"
 7 |     docker restart nova_api	
 8 | done
 9 | 
10 | 
11 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/restart_nova_compute_nodes.sh:
--------------------------------------------------------------------------------
1 | #!/bin/bash +x
2 | 
3 | #SSH into compute nodes and execute commands from commands-to-exec-nova-compute.sh
4 | cat commands-to-exec-nova-compute.sh | sshpass -p 'rally' ssh rally@wally117.cit.tu-berlin.de &
5 | cat commands-to-exec-nova-compute.sh | sshpass -p 'rally' ssh rally@wally122.cit.tu-berlin.de &
6 | cat commands-to-exec-nova-compute.sh | sshpass -p 'rally' ssh rally@wally124.cit.tu-berlin.de &
7 | cat commands-to-exec-nova-compute.sh | sshpass -p 'rally' ssh rally@wally123.cit.tu-berlin.de &
8 | cat commands-to-exec-nova-compute.sh | sshpass -p 'rally' ssh rally@wally113.cit.tu-berlin.de
9 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/restart_nova_container.sh:
--------------------------------------------------------------------------------
1 | #!/bin/bash +x
2 | 
3 | #SSH into Wally113 controller and execute commands from commands-to-exec-nova.sh
4 | 
5 | cat commands-to-exec-nova.sh | sshpass -p "rally" ssh rally@wally113.cit.tu-berlin.de
6 | 


--------------------------------------------------------------------------------
/workloads/boot_delete_config/trace_to_csv.py:
--------------------------------------------------------------------------------
  1 | import pandas as pd
  2 | import json
  3 | #from bs4 import BeautifulSoup
  4 | import fnmatch
  5 | from pprint import pprint
  6 | import csv
  7 | import seaborn as sns
  8 | from datetime import datetime
  9 | from tqdm import tqdm
 10 | import os
 11 | import argparse
 12 | 
 13 | 
 14 | 
 15 | # Working Parser for skipping DB calls and writing to a dataframe object.
 16 | 
 17 | # construct the argument parse and parse the arguments
 18 | ap = argparse.ArgumentParser()
 19 | ap.add_argument("-p", "--path", required=True,
 20 | 	help="path to the traces")
 21 | ap.add_argument("-o", "--out", required=True,
 22 |         help="outputpath to save csv-dump")
 23 | args = vars(ap.parse_args())
 24 | 
 25 | print(args)
 26 | 
 27 | 
 28 | 
 29 | def create_df(data_dir,output_file):
 30 |     #creating a null dataframe before starting to fill it
 31 |     df_name = pd.DataFrame(columns=['Host', 'Name', 'Service', 'Project', 'Timestamp', 'Iteration_id','Trace_id', 'Parent_id', 'Base_id'])
 32 |     list_trace_files=os.listdir(data_dir)
 33 |     # tqdm is used to visualize the progress.
 34 |     for x in tqdm(list_trace_files):
 35 |         #data_folder = 'traces_data/boot_delete_config/traces_new/api_faults/'
 36 |         file_to_read = data_dir+'/'+x
 37 |         with open(file_to_read) as trace_file:
 38 |             dict_train = json.load(trace_file)
 39 |             print("Processing trace_file:",file_to_read)
 40 |             #print name of the iteration_id
 41 |             #print(os.path.splitext(os.path.basename(file_to_read))[0])
 42 |             #print(os.path.splitext(str(list_trace_files)[0]))
 43 |             df_name = df_name.from_dict(parser(dict_train,df_name,os.path.splitext(os.path.basename(file_to_read))[0]))
 44 | 
 45 |     print("Saving Data-Frame")
 46 |     df_name.to_csv(output_file)
 47 |     print("--done--")
 48 | 
 49 | def parser(dict_train,dfObj,iteration_id):
 50 | 
 51 |     substring ='db'
 52 |     pattern = 'meta.raw_payload.*'
 53 | 
 54 |     for x in range(len(dict_train['children'])):
 55 |         if not dict_train['children'][x]['children']:
 56 |             #print("Stage-1")
 57 |             #print("No-children present in index", x)
 58 |             #print("parent_id:",dict_train['children'][x]['parent_id'])
 59 |             #print("trace_id:",dict_train['children'][x]['trace_id'])
 60 |             # print("--- Printing Payload information ---")
 61 |             # print("Host:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['info']['host'])
 62 |             # print("Name:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['name'])
 63 |             # print("Service:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['service'])
 64 |             # print("Timestamp:",datetime.strptime(dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
 65 |             # print("Parent_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['parent_id'])
 66 |             # print("Trace_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['trace_id'])
 67 |             # print("Base_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['base_id'])
 68 |             # print("Project:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['project'])
 69 |             dfObj = dfObj.append({'Host': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['info']['host'], 'Name': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['name'], 'Service': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['service'], 'Project': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['trace_id'], 'Parent_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['parent_id'], 'Base_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-start']['base_id']}, ignore_index=True)
 70 | 
 71 |             # print("Host:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['info']['host'])
 72 |             # print("Name:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['name'])
 73 |             # print("Service:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['service'])
 74 |             # print("Timestamp:",datetime.strptime(dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
 75 |             # print("Parent_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['parent_id'])
 76 |             # print("Trace_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['trace_id'])
 77 |             # print("Base_id:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['base_id'])
 78 |             # print("Project:",dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['project'])
 79 |             dfObj = dfObj.append({'Host': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['info']['host'], 'Name': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['name'], 'Service': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['service'], 'Project': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['trace_id'], 'Parent_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['parent_id'], 'Base_id': dict_train['children'][x]['info']['meta.raw_payload.wsgi-stop']['base_id']}, ignore_index=True)
 80 | 
 81 | 
 82 |         else:
 83 | 
 84 | 
 85 |             #print("Children present in index", x)
 86 |             for y in range(len(dict_train['children'][x]['children'])):
 87 |                 #print("Stage-2")
 88 |                 #print(len(dict_train['children'][x]['children']))
 89 | 
 90 |                 if not dict_train['children'][x]['children'][y]['children']:
 91 |                     #print("No children to further process in Stage-1")
 92 |                     meta_raw_payload_name_stage_1 = fnmatch.filter(dict_train['children'][x]['children'][y]['info'],pattern)
 93 |                     #print("List of payload types:",meta_raw_payload_name_stage_1)
 94 | 
 95 |                     for k in range(len(meta_raw_payload_name_stage_1)):
 96 |                         if substring in meta_raw_payload_name_stage_1[k]:
 97 |                             #compute something
 98 |                             pass
 99 |                             #print("Payload are DB-calls stage-2 , Skipping...",meta_raw_payload_name_stage_1[k])
100 |                         else:
101 | 
102 |                             # print("--- Printing Payload information ---")
103 |                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_1[k])
104 |                             # print("Host:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['info']['host'])
105 |                             # print("Name:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['name'])
106 |                             # print("Service:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['service'])
107 |                             # print("Project:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['project'])
108 |                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
109 |                             # print("Trace_id:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['trace_id'])
110 |                             # print("Parent_id:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['parent_id'])
111 |                             # print("Base_id:",dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['base_id'])
112 |                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['info'][meta_raw_payload_name_stage_1[k]]['base_id']}, ignore_index=True)
113 | 
114 | 
115 | 
116 | 
117 |                 else:
118 |                     #print("Children present in stage-2 index", x,y)
119 |                     for z in range(len(dict_train['children'][x]['children'][y]['children'])):
120 |                         #print("Stage-3")
121 |                         #print(len(dict_train['children'][x]['children'][y]['children']))
122 | 
123 |                         if not dict_train['children'][x]['children'][y]['children'][z]['children']:
124 |                             #print("No children to further process in Stage-2")
125 |                             meta_raw_payload_name_stage_2 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['info'],pattern)
126 |                             #print("List of payload types:",meta_raw_payload_name_stage_2)
127 |                             for k in range(len(meta_raw_payload_name_stage_2)):
128 |                                 if substring in meta_raw_payload_name_stage_2[k]:
129 |                                     #compute something
130 |                                     pass
131 |                                     #print("Payload are DB-calls stage-3 , Skipping...",meta_raw_payload_name_stage_2[k])
132 |                                 else:
133 |                                     # print("--- Printing Payload information ---")
134 |                                     # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_2[k])
135 |                                     # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['info']['host'])
136 |                                     # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['name'])
137 |                                     # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['service'])
138 |                                     # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['project'])
139 |                                     # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
140 |                                     # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['trace_id'])
141 |                                     # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['parent_id'])
142 |                                     # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['base_id'])
143 |                                     dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['info'][meta_raw_payload_name_stage_2[k]]['base_id']}, ignore_index=True)
144 | 
145 | 
146 | 
147 | 
148 | 
149 |                         else:
150 |                             #print("Children present in stage-3 index", x,y,z)
151 | 
152 |                             for a in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'])):
153 |                                 #print("Stage-4")
154 |                                 #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children']))
155 | 
156 |                                 if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children']:
157 |                                     #print("No children to further process in Stage-3")
158 |                                     meta_raw_payload_name_stage_3 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'],pattern)
159 |                                     #print("List of payload types:",meta_raw_payload_name_stage_3)
160 |                                     for k in range(len(meta_raw_payload_name_stage_3)):
161 |                                         if substring in meta_raw_payload_name_stage_3[k]:
162 |                                             #compute something
163 |                                             pass
164 |                                             #print("Payload are DB-calls stage-4 , Skipping...",meta_raw_payload_name_stage_3[k])
165 |                                         else:
166 |                                             # print("--- Printing Payload information ---")
167 |                                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_3[k])
168 |                                             # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['info']['host'])
169 |                                             # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['name'])
170 |                                             # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['service'])
171 |                                             # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['project'])
172 |                                             # #print("Timestamp:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['timestamp'])
173 |                                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
174 |                                             # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['trace_id'])
175 |                                             # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['parent_id'])
176 |                                             # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['base_id'])
177 |                                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['info'][meta_raw_payload_name_stage_3[k]]['base_id']}, ignore_index=True)
178 | 
179 | 
180 | 
181 | 
182 |                                 else:
183 |                                     #print("Children present in stage-4 index", x,y,z,a)
184 |                                     for b in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'])):
185 |                                         #print("Stage-5")
186 |                                         #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children']))
187 |                                         if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children']:
188 |                                             #print("No children to further process in Stage-4")
189 |                                             meta_raw_payload_name_stage_4 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'],pattern)
190 |                                             #print("List of payload types:",meta_raw_payload_name_stage_4)
191 |                                             for k in range(len(meta_raw_payload_name_stage_4)):
192 |                                                 if substring in meta_raw_payload_name_stage_4[k]:
193 |                                                     #compute something
194 |                                                     pass
195 |                                                     #print("Payload are DB-calls stage-5 , Skipping...",meta_raw_payload_name_stage_4[k])
196 |                                                 else:
197 |                                                     # print("--- Printing Payload information ---")
198 |                                                     # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_4[k])
199 |                                                     # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['info']['host'])
200 |                                                     # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['name'])
201 |                                                     # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['service'])
202 |                                                     # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['project'])
203 |                                                     #
204 |                                                     # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
205 |                                                     # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['trace_id'])
206 |                                                     # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['parent_id'])
207 |                                                     # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['base_id'])
208 | 
209 |                                                     dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['info'][meta_raw_payload_name_stage_4[k]]['base_id']}, ignore_index=True)
210 | 
211 | 
212 | 
213 |                                         else:
214 |                                             #print("Children present in stage-5 index", x,y,z,a,b)
215 |                                             for c in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'])):
216 |                                                 #print("Stage-6")
217 |                                                 #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children']))
218 |                                                 if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']:
219 |                                                     #print("No children to further process in Stage-5")
220 |                                                     meta_raw_payload_name_stage_5 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'],pattern)
221 |                                                     #print("List of payload types:",meta_raw_payload_name_stage_5)
222 |                                                     for k in range(len(meta_raw_payload_name_stage_5)):
223 |                                                         if substring in meta_raw_payload_name_stage_5[k]:
224 |                                                             #compute something
225 |                                                             pass
226 |                                                             #print("Payload are DB-calls stage-6 , Skipping...",meta_raw_payload_name_stage_5[k])
227 |                                                         else:
228 |                                                             # print("--- Printing Payload information ---")
229 |                                                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_5[k])
230 |                                                             # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['info']['host'])
231 |                                                             # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['name'])
232 |                                                             # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['service'])
233 |                                                             # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['project'])
234 |                                                             #
235 |                                                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
236 |                                                             # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['trace_id'])
237 |                                                             # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['parent_id'])
238 |                                                             # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['base_id'])
239 | 
240 |                                                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['info'][meta_raw_payload_name_stage_5[k]]['base_id']}, ignore_index=True)
241 | 
242 | 
243 | 
244 | 
245 |                                                 else:
246 |                                                     #print("Children present in stage-6 index", x,y,z,a,b,c)
247 |                                                     for d in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'])):
248 |                                                         #print("Stage-7")
249 |                                                         #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']))
250 |                                                         if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children']:
251 |                                                             #print("No children to further process in Stage-6")
252 |                                                             meta_raw_payload_name_stage_6 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'],pattern)
253 |                                                             #print("List of payload types:",meta_raw_payload_name_stage_6)
254 |                                                             for k in range(len(meta_raw_payload_name_stage_6)):
255 |                                                                 if substring in meta_raw_payload_name_stage_6[k]:
256 |                                                                     #compute something
257 |                                                                     pass
258 |                                                                     #print("Payload are DB-calls stage-7 , Skipping...",meta_raw_payload_name_stage_6[k])
259 |                                                                 else:
260 |                                                                     # print("--- Printing Payload information ---")
261 |                                                                     # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_6[k])
262 |                                                                     # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['info']['host'])
263 |                                                                     # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['name'])
264 |                                                                     # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['service'])
265 |                                                                     # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['project'])
266 |                                                                     # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
267 |                                                                     # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['trace_id'])
268 |                                                                     # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['parent_id'])
269 |                                                                     # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['base_id'])
270 | 
271 |                                                                     dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['info'][meta_raw_payload_name_stage_6[k]]['base_id']}, ignore_index=True)
272 | 
273 | 
274 | 
275 | 
276 | 
277 |                                                         else:
278 | 
279 |                                                             for e in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'])):
280 |                                                                 #print("Stage-8")
281 |                                                                 if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children']:
282 |                                                                     meta_raw_payload_name_stage_7 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'],pattern)
283 |                                                                     for k in range(len(meta_raw_payload_name_stage_7)):
284 |                                                                         if substring in meta_raw_payload_name_stage_7[k]:
285 |                                                                             #compute something
286 |                                                                             pass
287 |                                                                             #print("Payload are DB-calls stage-8 , Skipping...",meta_raw_payload_name_stage_7[k])
288 |                                                                         else:
289 |                                                                             # print("--- Printing Payload information ---")
290 |                                                                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_7[k])
291 |                                                                             # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['info']['host'])
292 |                                                                             # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['name'])
293 |                                                                             # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['service'])
294 |                                                                             # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['project'])
295 |                                                                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
296 |                                                                             # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['trace_id'])
297 |                                                                             # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['parent_id'])
298 |                                                                             # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['base_id'])
299 | 
300 |                                                                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['info'][meta_raw_payload_name_stage_7[k]]['base_id']}, ignore_index=True)
301 | 
302 | 
303 | 
304 | 
305 |                                                                 else:
306 |                                                                     #print("Children present in stage-8 index", x,y,z,a,b,c,d,e)
307 | 
308 |                                                                     for f in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'])):
309 |                                                                         #print("Stage-9")
310 |                                                                         #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']))
311 |                                                                         if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children']:
312 |                                                                             #print("No children to further process in Stage-6")
313 |                                                                             meta_raw_payload_name_stage_8 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'],pattern)
314 |                                                                             #print("List of payload types:",meta_raw_payload_name_stage_6)
315 |                                                                             for k in range(len(meta_raw_payload_name_stage_8)):
316 |                                                                                 if substring in meta_raw_payload_name_stage_8[k]:
317 |                                                                                     #compute something
318 |                                                                                     pass
319 |                                                                                     #print("Payload are DB-calls stage-9 , Skipping...",meta_raw_payload_name_stage_8[k])
320 |                                                                                 else:
321 |                                                                                     # print("--- Printing Payload information ---")
322 |                                                                                     # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_8[k])
323 |                                                                                     # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['info']['host'])
324 |                                                                                     # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['name'])
325 |                                                                                     # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['service'])
326 |                                                                                     # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['project'])
327 |                                                                                     # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
328 |                                                                                     # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['trace_id'])
329 |                                                                                     # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['parent_id'])
330 |                                                                                     # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['base_id'])
331 | 
332 |                                                                                     dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['info'][meta_raw_payload_name_stage_8[k]]['base_id']}, ignore_index=True)
333 | 
334 | 
335 | 
336 | 
337 |                                                                         else:
338 |                                                                             #print("Children present in stage-9 index", x,y,z,a,b,c,d,e,f)
339 | 
340 |                                                                             for g in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'])):
341 |                                                                                 #print("Stage-10")
342 |                                                                                 #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']))
343 |                                                                                 if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children']:
344 |                                                                                     #print("No children to further process in Stage-6")
345 |                                                                                     meta_raw_payload_name_stage_9 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'],pattern)
346 |                                                                                     #print("List of payload types:",meta_raw_payload_name_stage_6)
347 |                                                                                     for k in range(len(meta_raw_payload_name_stage_9)):
348 |                                                                                         if substring in meta_raw_payload_name_stage_9[k]:
349 |                                                                                             #compute something
350 |                                                                                             pass
351 |                                                                                             #print("Payload are DB-calls stage-10 , Skipping...",meta_raw_payload_name_stage_9[k])
352 |                                                                                         else:
353 |                                                                                             # print("--- Printing Payload information ---")
354 |                                                                                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_9[k])
355 |                                                                                             # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['info']['host'])
356 |                                                                                             # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['name'])
357 |                                                                                             # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['service'])
358 |                                                                                             # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['project'])
359 |                                                                                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
360 |                                                                                             # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['trace_id'])
361 |                                                                                             # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['parent_id'])
362 |                                                                                             # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['base_id'])
363 | 
364 |                                                                                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['info'][meta_raw_payload_name_stage_9[k]]['base_id']}, ignore_index=True)
365 | 
366 | 
367 | 
368 | 
369 |                                                                                 else:
370 |                                                                                     #print("Children present in stage-10 index", x,y,z,a,b,c,d,e,f,g)
371 | 
372 |                                                                                     for h in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'])):
373 |                                                                                         #print("Stage-11")
374 |                                                                                         #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']))
375 |                                                                                         if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children']:
376 |                                                                                             #print("No children to further process in Stage-6")
377 |                                                                                             meta_raw_payload_name_stage_10 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'],pattern)
378 |                                                                                             #print("List of payload types:",meta_raw_payload_name_stage_6)
379 |                                                                                             for k in range(len(meta_raw_payload_name_stage_10)):
380 |                                                                                                 if substring in meta_raw_payload_name_stage_10[k]:
381 |                                                                                                     #compute something
382 |                                                                                                     pass
383 |                                                                                                     #print("Payload are DB-calls stage-11 , Skipping...",meta_raw_payload_name_stage_10[k])
384 |                                                                                                 else:
385 |                                                                                                     # print("--- Printing Payload information ---")
386 |                                                                                                     # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_10[k])
387 |                                                                                                     # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['info']['host'])
388 |                                                                                                     # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['name'])
389 |                                                                                                     # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['service'])
390 |                                                                                                     # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['project'])
391 |                                                                                                     # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
392 |                                                                                                     # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['trace_id'])
393 |                                                                                                     # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['parent_id'])
394 |                                                                                                     # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['base_id'])
395 | 
396 |                                                                                                     dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['info'][meta_raw_payload_name_stage_10[k]]['base_id']}, ignore_index=True)
397 | 
398 | 
399 | 
400 | 
401 |                                                                                         else:
402 |                                                                                             #print("Children present in stage-11 index", x,y,z,a,b,c,d,e,f,g,h)
403 | 
404 |                                                                                             for i in range(len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'])):
405 |                                                                                                 # print("Stage-12")
406 |                                                                                                 #print("Length",len(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children']))
407 |                                                                                                 if not dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['children']:
408 |                                                                                                     #print("No children to further process in Stage-6")
409 |                                                                                                     meta_raw_payload_name_stage_11 = fnmatch.filter(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'],pattern)
410 |                                                                                                     #print("List of payload types:",meta_raw_payload_name_stage_6)
411 |                                                                                                     for k in range(len(meta_raw_payload_name_stage_11)):
412 |                                                                                                         if substring in meta_raw_payload_name_stage_11[k]:
413 |                                                                                                             #compute something
414 |                                                                                                             pass
415 |                                                                                                             #print("Payload are DB-calls stage-12 , Skipping...",meta_raw_payload_name_stage_11[k])
416 |                                                                                                         else:
417 |                                                                                                             # print("--- Printing Payload information ---")
418 |                                                                                                             # print("Printing Pay-Load infomarion for:",meta_raw_payload_name_stage_11[k])
419 |                                                                                                             # print("Host:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['info']['host'])
420 |                                                                                                             # print("Name:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['name'])
421 |                                                                                                             # print("Service:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['service'])
422 |                                                                                                             # print("Project:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['project'])
423 |                                                                                                             # print("Timestamp:", datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'))
424 |                                                                                                             # print("Trace_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['trace_id'])
425 |                                                                                                             # print("Parent_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['parent_id'])
426 |                                                                                                             # print("Base_id:",dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['base_id'])
427 | 
428 |                                                                                                             dfObj = dfObj.append({'Host': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['info']['host'], 'Name': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['name'], 'Service': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['service'], 'Project': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['project'], 'Timestamp': datetime.strptime(dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['timestamp'], '%Y-%m-%dT%H:%M:%S.%f'), 'Iteration_id': iteration_id, 'Trace_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['trace_id'], 'Parent_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['parent_id'], 'Base_id': dict_train['children'][x]['children'][y]['children'][z]['children'][a]['children'][b]['children'][c]['children'][d]['children'][e]['children'][f]['children'][g]['children'][h]['children'][i]['info'][meta_raw_payload_name_stage_11[k]]['base_id']}, ignore_index=True)
429 | 
430 | 
431 | 
432 | 
433 | 
434 | 
435 |                                                                                                 else:
436 |                                                                                                     print("Children present in stage-12 index", x,y,z,a,b,c,d,e,f,g,h,i)
437 |     return dfObj
438 | 
439 | 
440 | 
441 | 
442 | #create_df('/var/lib/rally_container/boot_delete_config/traces_new/compute_faults','dataframe_compute_faults')
443 | 
444 | create_df(args["path"], args["out"])
445 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/commands-to-exec-glance.sh:
--------------------------------------------------------------------------------
 1 | #!/bin/bash -x
 2 | # Restarting glance_api container 10 times and sleep for 2 secs between restarts
 3 | for i in {1..1}
 4 | do
 5 |     echo "Restarting glance-container"
 6 |     docker restart glance_api	
 7 | done
 8 | 
 9 | 
10 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/create-and-delete-image.yaml:
--------------------------------------------------------------------------------
 1 | ---
 2 |   GlanceImages.create_and_delete_image:
 3 |     -
 4 |       args:
 5 |         image_location: "http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img"
 6 |         container_format: "bare"
 7 |         disk_format: "qcow2"
 8 |       runner:
 9 |         type: "constant"
10 |         times: 3000
11 |         concurrency: 5
12 |       context:
13 |         users:
14 |           tenants: 2
15 |           users_per_tenant: 3
16 |       sla:
17 |         failure_rate:
18 |           max: 100
19 |       hooks:
20 |         - name: sys_call
21 |           description: Run script
22 |           args: sh ./restart_glance_container.sh
23 |           trigger:
24 |             name: event
25 |             args:
26 |               unit: iteration
27 |               at: [250,500,750,1000,1250,1500,1750,2000,2250,2500,2750,3000]
28 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/list-images.yml:
--------------------------------------------------------------------------------
 1 | ---
 2 |   GlanceImages.list_images:
 3 |     -
 4 |       runner:
 5 |         type: "constant"
 6 |         times: 20
 7 |         concurrency: 1
 8 |       context:
 9 |         users:
10 |           tenants: 2
11 |           users_per_tenant: 2
12 |         images:
13 |           image_url: "http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img"
14 |           disk_format: "qcow2"
15 |           container_format: "bare"
16 |           images_per_tenant: 4
17 |       sla:
18 |         failure_rate:
19 |           max: 100
20 | 
21 |       hooks:
22 |         - name: sys_call
23 |           description: Run script
24 |           args: sh /home/rally/data/list_image_config/restart_glance_container.sh
25 |           trigger:
26 |             name: event
27 |             args:
28 |               unit: iteration
29 |               at: [2]
30 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/output_jasmin_image.html:
--------------------------------------------------------------------------------
   1 | <!doctype html>
   2 | <html ng-app="App">
   3 | <head>
   4 |   <meta charset="utf-8">
   5 |   <meta name="viewport" content="width=device-width, initial-scale=1.0">
   6 |   <meta name="generator" content="Rally version 1.5.1">
   7 |   <title>Rally | Rally Task Report</title>
   8 |   
   9 |   
  10 |   <link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/nvd3/1.1.15-beta/nv.d3.min.css">
  11 |   <script type="text/javascript" src="https://ajax.googleapis.com/ajax/libs/angularjs/1.3.3/angular.min.js"></script>
  12 |   <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/d3/3.4.13/d3.min.js"></script>
  13 |   <script type="text/javascript" src="https://cdnjs.cloudflare.com/ajax/libs/nvd3/1.1.15-beta/nv.d3.min.js"></script>
  14 |   
  15 | 
  16 |   <script type="text/javascript">
  17 |     "use strict";
  18 |     function changeFrameHeight(){
  19 |   var ifm= document.getElementById("embeddedChart");
  20 |   ifm.height=document.documentElement.clientHeight;
  21 |   ifm.width=document.documentElement.clientWidth;
  22 | }
  23 | function hideEmbeddedChartLoading(){
  24 |   document.getElementById('embeddedChartLoader').style.display = 'none';
  25 | }
  26 | window.onresize=function(){
  27 |   changeFrameHeight();
  28 | }
  29 | var widgetDirective = function($compile) {
  30 |   var Chart = {
  31 |     _render: function(node, data, chart, do_after){
  32 |       nv.addGraph(function() {
  33 |         d3.select(node)
  34 |           .datum(data).transition().duration(0)
  35 |           .call(chart);
  36 |         if (typeof do_after === "function") {
  37 |           do_after(node, chart)
  38 |         }
  39 |         nv.utils.windowResize(chart.update);
  40 |       })
  41 |     },
  42 |     _widgets: {
  43 |       Pie: "pie",
  44 |       StackedArea: "stack",
  45 |       Lines: "lines",
  46 |       Histogram: "histogram"
  47 |     },
  48 |     get_chart: function(widget) {
  49 |       if (widget in this._widgets) {
  50 |         var name = this._widgets[widget];
  51 |         return Chart[name]
  52 |       }
  53 |       return function() { console.log("Error: unexpected widget:", widget) }
  54 |     },
  55 |     pie: function(node, data, opts, do_after) {
  56 |       var chart = nv.models.pieChart()
  57 |         .x(function(d) { return d.key })
  58 |         .y(function(d) { return d.values })
  59 |         .showLabels(true)
  60 |         .labelType("percent")
  61 |         .donut(true)
  62 |         .donutRatio(0.25)
  63 |         .donutLabelsOutside(true)
  64 |         .color(function(d){
  65 |           if (d.data && d.data.color) { return d.data.color }
  66 |         });
  67 |       var colorizer = new Chart.colorizer("errors"), data_ = [];
  68 |       for (var i in data) {
  69 |         data_.push({key:data[i][0], values:data[i][1], color:colorizer.get_color(data[i][0])})
  70 |       }
  71 |       Chart._render(node, data_, chart)
  72 |     },
  73 |     colorizer: function(failure_key, failure_color) {
  74 |       this.failure_key = failure_key || "failed_duration";
  75 |       this.failure_color = failure_color || "#d62728";  // red
  76 |       this.color_idx = -1;
  77 |       /* NOTE(amaretskiy): this is actually a result of
  78 |          d3.scale.category20().range(), excluding red color (#d62728)
  79 |          which is reserved for errors */
  80 |       this.colors = ["#1f77b4", "#aec7e8", "#ff7f0e", "#ffbb78", "#2ca02c",
  81 |                      "#98df8a", "#ff9896", "#9467bd", "#c5b0d5", "#8c564b",
  82 |                      "#c49c94", "#e377c2", "#f7b6d2", "#7f7f7f", "#c7c7c7",
  83 |                      "#bcbd22", "#dbdb8d", "#17becf", "#9edae5"];
  84 |       this.get_color = function(key) {
  85 |         if (key === this.failure_key) {
  86 |           return this.failure_color
  87 |         }
  88 |         if (this.color_idx > (this.colors.length - 2)) {
  89 |           this.color_idx = 0
  90 |         } else {
  91 |           this.color_idx++
  92 |         }
  93 |         return this.colors[this.color_idx]
  94 |       }
  95 |     },
  96 |     stack: function(node, data, opts, do_after) {
  97 |       var chart = nv.models.stackedAreaChart()
  98 |         .x(function(d) { return d[0] })
  99 |         .y(function(d) { return d[1] })
 100 |         .useInteractiveGuideline(opts.guide)
 101 |         .showControls(opts.controls)
 102 |         .clipEdge(true);
 103 |       chart.xAxis
 104 |         .axisLabel(opts.xname)
 105 |         .tickFormat(opts.xformat)
 106 |         .showMaxMin(opts.showmaxmin);
 107 |       chart.yAxis
 108 |         .orient("left")
 109 |         .tickFormat(d3.format(opts.yformat || ",.3f"));
 110 |       var colorizer = new Chart.colorizer(), data_ = [];
 111 |       for (var i in data) {
 112 |         data_.push({key:data[i][0], values:data[i][1], color:colorizer.get_color(data[i][0])})
 113 |       }
 114 |       Chart._render(node, data_, chart, do_after);
 115 |     },
 116 |     lines: function(node, data, opts, do_after) {
 117 |       var chart = nv.models.lineChart()
 118 |         .x(function(d) { return d[0] })
 119 |         .y(function(d) { return d[1] })
 120 |         .useInteractiveGuideline(opts.guide)
 121 |         .clipEdge(true);
 122 |       chart.xAxis
 123 |         .axisLabel(opts.xname)
 124 |         .tickFormat(opts.xformat)
 125 |         .rotateLabels(opts.xrotate)
 126 |         .showMaxMin(opts.showmaxmin);
 127 |       chart.yAxis
 128 |         .orient("left")
 129 |         .tickFormat(d3.format(opts.yformat || ",.3f"));
 130 |       var colorizer = new Chart.colorizer(), data_ = [];
 131 |       for (var i in data) {
 132 |         data_.push({key:data[i][0], values:data[i][1], color:colorizer.get_color(data[i][0])})
 133 |       }
 134 |       Chart._render(node, data_, chart, do_after)
 135 |     },
 136 |     histogram: function(node, data, opts) {
 137 |       var chart = nv.models.multiBarChart()
 138 |         .reduceXTicks(true)
 139 |         .showControls(false)
 140 |         .transitionDuration(0)
 141 |         .groupSpacing(0.05);
 142 |       chart
 143 |         .legend.radioButtonMode(true);
 144 |       chart.xAxis
 145 |         .axisLabel("Duration (seconds)")
 146 |         .tickFormat(d3.format(",.2f"));
 147 |       chart.yAxis
 148 |         .axisLabel("Iterations (frequency)")
 149 |         .tickFormat(d3.format("d"));
 150 |       Chart._render(node, data, chart)
 151 |     }
 152 |   };
 153 | 
 154 |   return {
 155 |     restrict: "A",
 156 |     scope: { data: "=" },
 157 |     link: function(scope, element, attrs) {
 158 |       scope.$watch("data", function(data) {
 159 |         if (! data) { return console.log("Chart has no data to render!") }
 160 |         if (attrs.widget === "Table") {
 161 |           var template = "<table class='striped'><thead>" +
 162 |             "<tr><th ng-repeat='i in data.cols track by $index'>{{i}}<tr>" +
 163 |             "</thead><tbody>" +
 164 |             "<tr ng-class='data.styles[$index] ? data.styles[$index] : \"\"' ng-repeat='row in data.rows track by $index'>" +
 165 |             "<td ng-repeat='i in row track by $index'>{{i}}" +
 166 |             "<tr>" +
 167 |             "</tbody></table>";
 168 |           var el = element.empty().append($compile(template)(scope)).children()[0]
 169 |         } else if (attrs.widget === "TextArea") {
 170 |           var template = "<div style='padding:0 0 5px' ng-repeat='str in data track by $index'>{{str}}</div><div style='height:10px'></div>";
 171 |           var el = element.empty().append($compile(template)(scope)).children()[0]
 172 |         }
 173 |         else if (attrs.widget == "EmbedChart") {
 174 |           if (typeof data === "string"){
 175 |             // backward compatibility
 176 |             data = {"embedded": data};
 177 |           }
 178 | 
 179 |           if (data.source !== undefined && data.source !== null){
 180 |             var template = "<span><div id='embeddedChartLoader'>Loading embedded chart. Please wait...</div><iframe id='embeddedChart' frameborder='0' onload='changeFrameHeight(); hideEmbeddedChartLoading()' style='width:100%;' src='" + data.source + "'></iframe></span>";
 181 |             var embeddedData = undefined;
 182 |           } else {
 183 |             var template = "<iframe scrolling='no' id='embeddedChart' frameborder='0' onload='changeFrameHeight()' style='width:100%;'></iframe>";
 184 |             /* NOTE(chenxu): tag <\/script> in javascript string will be parsed incorrectly.
 185 |              so we convert <\/script> to <\\/script> in python and convert it back here. */
 186 |             var embeddedData = data.embedded.replace(/\\\/script>/ig, "\/script>");
 187 |           }
 188 |           var el = element.empty().append($compile(template)(scope)).children()[0];
 189 |           if (embeddedData !== undefined) {
 190 |             var iframe = el.contentWindow || (el.contentDocument.document || el.contentDocument);
 191 |             iframe.document.open();
 192 |             iframe.document.write(embeddedData);
 193 |             iframe.document.close();
 194 |           }
 195 |         }
 196 |         else {
 197 |           var el_chart = element.addClass("chart").css({display:"block"});
 198 |           var el = el_chart.html("<svg></svg>").children()[0];
 199 | 
 200 |           var do_after = null;
 201 | 
 202 |           if (attrs.widget in {StackedArea:0, Lines:0}) {
 203 | 
 204 |             /* Hide widget if not enough data */
 205 |             if ((! data.length) || (data[0].length < 1) || (data[0][1].length < 2)) {
 206 |               return element.empty().css({display:"none"})
 207 |             }
 208 | 
 209 |             /* NOTE(amaretskiy): Dirty fix for changing chart width in case
 210 |                if there are too long Y values that overlaps chart box. */
 211 |             var do_after = function(node, chart){
 212 |               var g_box = angular.element(el_chart[0].querySelector(".nv-y.nv-axis"));
 213 | 
 214 |               if (g_box && g_box[0] && g_box[0].getBBox) {
 215 | 
 216 |                 try {
 217 |                   // 30 is padding aroung graphs
 218 |                   var width = g_box[0].getBBox().width + 30;
 219 |                 } catch (err) {
 220 |                   // This happens sometimes, just skip silently
 221 |                   return
 222 |                 }
 223 | 
 224 |                 // 890 is chart width (set by CSS)
 225 |                 if (typeof width === "number" && width > 890) {
 226 |                   width = (890 * 2) - width;
 227 |                   if (width > 0) {
 228 |                     angular.element(node).css({width:width+"px"});
 229 |                     chart.update()
 230 |                   }
 231 |                 }
 232 |               }
 233 |             }
 234 |           }
 235 |           else if (attrs.widget === "Pie") {
 236 |             if (! data.length) {
 237 |               return element.empty().css({display:"none"})
 238 |             }
 239 |           }
 240 | 
 241 |           var opts = {
 242 |             xname: attrs.nameX || "",
 243 |             xrotate: attrs.rotateX || 0,
 244 |             yformat: attrs.formatY || ",.3f",
 245 |             controls: attrs.controls === "true",
 246 |             guide: attrs.guide === "true",
 247 |             showmaxmin: attrs.showmaxmin === "true"
 248 |           };
 249 |           if (attrs.formatDateX) {
 250 |             opts.xformat = function(d) { return d3.time.format(attrs.formatDateX)(new Date(d)) }
 251 |           } else {
 252 |             opts.xformat = d3.format(attrs.formatX || "d")
 253 |           }
 254 |           Chart.get_chart(attrs.widget)(el, data, opts, do_after);
 255 |         }
 256 | 
 257 |         if (attrs.nameY) {
 258 |           /* NOTE(amaretskiy): Dirty fix for displaying Y-axis label correctly.
 259 |              I believe sometimes NVD3 will allow doing this in normal way */
 260 |           var label_y = angular.element("<div>").addClass("chart-label-y").text(attrs.nameY);
 261 |           angular.element(el).parent().prepend(label_y)
 262 |         }
 263 | 
 264 |         if (attrs.description) {
 265 |           var desc_el = angular.element("<div>").addClass(attrs.descriptionClass || "h3").text(attrs.description);
 266 |           angular.element(el).parent().prepend(desc_el)
 267 |         }
 268 | 
 269 |         if (attrs.title) {
 270 |           var title_el = angular.element("<div>").addClass(attrs.titleClass || "h2").text(attrs.title);
 271 |           angular.element(el).parent().prepend(title_el)
 272 |         }
 273 | 
 274 |         angular.element(el).parent().append(angular.element("<div style='clear:both'>"))
 275 |       });
 276 |     }
 277 |   }
 278 | };
 279 | 
 280 |     var controllerFunction = function($scope, $location) {
 281 |         $scope.source = "{\n  \"version\": 2, \n  \"title\": \"\", \n  \"description\": \"\", \n  \"subtasks\": [\n    {\n      \"title\": \"GlanceImages.create_and_delete_image\", \n      \"description\": \"\", \n      \"workloads\": [\n        {\n          \"scenario\": {\n            \"GlanceImages.create_and_delete_image\": {\n              \"image_location\": \"http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img\", \n              \"disk_format\": \"qcow2\", \n              \"container_format\": \"bare\"\n            }\n          }, \n          \"description\": \"Create and then delete an image.\", \n          \"contexts\": {\n            \"users\": {\n              \"users_per_tenant\": 3, \n              \"tenants\": 2\n            }\n          }, \n          \"runner\": {\n            \"constant\": {\n              \"concurrency\": 5, \n              \"times\": 50\n            }\n          }, \n          \"hooks\": [\n            {\n              \"action\": [\n                \"sys_call\", \n                \"sh /home/rally/data/list_image_config/restart_glance_container.sh\"\n              ], \n              \"trigger\": [\n                \"event\", \n                {\n                  \"at\": [\n                    100, \n                    200, \n                    300, \n                    400, \n                    500\n                  ], \n                  \"unit\": \"iteration\"\n                }\n              ], \n              \"description\": \"Run script\"\n            }\n          ], \n          \"sla\": {\n            \"failure_rate\": {\n              \"max\": 100\n            }\n          }\n        }\n      ]\n    }\n  ]\n}";
 282 |         $scope.scenarios = [{"runner": "constant", "hooks": [], "pos": "0", "atomic": {"pie": [["glance_v2.create_image", 9.60661852836609], ["glance_v2.delete_image", 2.9553223037719727]], "iter": [["glance_v2.create_image", [[1, 9.331961154937744], [2, 10.459383964538574], [3, 11.498549938201904], [4, 11.716097831726074], [5, 7.714972019195557], [6, 9.376167058944702], [7, 9.097991943359375], [8, 8.168601989746094], [9, 14.640720129013062], [10, 11.339364051818848], [11, 8.682183980941772], [12, 12.374226808547974], [13, 9.045531034469604], [14, 8.734501838684082], [15, 13.113250970840454], [16, 9.990133047103882], [17, 7.9879841804504395], [18, 9.501919031143188], [19, 8.366168022155762], [20, 7.601975917816162], [21, 10.473891973495483], [22, 10.40879201889038], [23, 10.38827896118164], [24, 10.39028787612915], [25, 7.208214998245239], [26, 8.762500047683716], [27, 8.711905002593994], [28, 7.855929851531982], [29, 10.351038932800293], [30, 8.975157976150513], [31, 8.135270118713379], [32, 9.844115972518921], [33, 11.656423091888428], [34, 7.549546957015991], [35, 8.87621283531189], [36, 8.115339994430542], [37, 8.34662914276123], [38, 9.997408151626587], [39, 9.148635864257812], [40, 8.341001987457275], [41, 9.547373056411743], [42, 7.827935218811035], [43, 9.050717115402222], [44, 8.883748054504395], [45, 14.415349006652832], [46, 8.779339075088501], [47, 11.38849401473999], [48, 11.45205307006836], [49, 8.767117977142334], [50, 7.94053316116333]]], ["glance_v2.delete_image", [[1, 1.5813491344451904], [2, 2.614569902420044], [3, 4.731531143188477], [4, 4.50962495803833], [5, 2.7857859134674072], [6, 4.216733932495117], [7, 3.969970941543579], [8, 3.153749942779541], [9, 2.79288911819458], [10, 1.870276927947998], [11, 2.401911973953247], [12, 2.7604379653930664], [13, 3.086153984069824], [14, 2.850080966949463], [15, 4.915533065795898], [16, 4.7526609897613525], [17, 2.3184309005737305], [18, 2.618034839630127], [19, 2.706751823425293], [20, 1.7083208560943604], [21, 2.6904799938201904], [22, 2.7505340576171875], [23, 4.152092933654785], [24, 4.191333055496216], [25, 3.0891518592834473], [26, 2.9428601264953613], [27, 2.6027541160583496], [28, 2.6535048484802246], [29, 2.3508360385894775], [30, 2.1024010181427], [31, 2.3155438899993896], [32, 1.6084840297698975], [33, 2.465954065322876], [34, 2.368496894836426], [35, 2.2607738971710205], [36, 2.5191268920898438], [37, 2.001455068588257], [38, 3.496093988418579], [39, 2.9923341274261475], [40, 3.251951217651367], [41, 2.467787027359009], [42, 1.9421918392181396], [43, 5.390998125076294], [44, 2.7675249576568604], [45, 3.0229928493499756], [46, 2.5868868827819824], [47, 2.7665019035339355], [48, 3.6177330017089844], [49, 3.059000015258789], [50, 2.993537187576294]]]], "histogram": {"data": [[{"disabled": 0, "values": [{"y": 10, "x": 8.137125000000001}, {"y": 15, "x": 9.06625}, {"y": 8, "x": 9.995375}, {"y": 7, "x": 10.9245}, {"y": 6, "x": 11.853625000000001}, {"y": 1, "x": 12.78275}, {"y": 1, "x": 13.711875}, {"y": 2, "x": 14.641}], "key": "glance_v2.create_image", "view": "Square Root Choice"}, {"disabled": 1, "values": [{"y": 6, "x": 2.05725}, {"y": 10, "x": 2.5335}, {"y": 17, "x": 3.00975}, {"y": 6, "x": 3.4859999999999998}, {"y": 2, "x": 3.96225}, {"y": 4, "x": 4.4384999999999994}, {"y": 3, "x": 4.91475}, {"y": 2, "x": 5.391}], "key": "glance_v2.delete_image", "view": "Square Root Choice"}], [{"disabled": 0, "values": [{"y": 11, "x": 8.269857142857143}, {"y": 16, "x": 9.331714285714286}, {"y": 10, "x": 10.393571428571429}, {"y": 6, "x": 11.455428571428572}, {"y": 4, "x": 12.517285714285714}, {"y": 1, "x": 13.579142857142857}, {"y": 2, "x": 14.641}], "key": "glance_v2.create_image", "view": "Sturges Formula"}, {"disabled": 1, "values": [{"y": 7, "x": 2.125285714285714}, {"y": 14, "x": 2.6695714285714285}, {"y": 17, "x": 3.213857142857143}, {"y": 3, "x": 3.758142857142857}, {"y": 4, "x": 4.302428571428571}, {"y": 3, "x": 4.8467142857142855}, {"y": 2, "x": 5.391}], "key": "glance_v2.delete_image", "view": "Sturges Formula"}], [{"disabled": 0, "values": [{"y": 10, "x": 8.137125000000001}, {"y": 15, "x": 9.06625}, {"y": 8, "x": 9.995375}, {"y": 7, "x": 10.9245}, {"y": 6, "x": 11.853625000000001}, {"y": 1, "x": 12.78275}, {"y": 1, "x": 13.711875}, {"y": 2, "x": 14.641}], "key": "glance_v2.create_image", "view": "Rice Rule"}, {"disabled": 1, "values": [{"y": 6, "x": 2.05725}, {"y": 10, "x": 2.5335}, {"y": 17, "x": 3.00975}, {"y": 6, "x": 3.4859999999999998}, {"y": 2, "x": 3.96225}, {"y": 4, "x": 4.4384999999999994}, {"y": 3, "x": 4.91475}, {"y": 2, "x": 5.391}], "key": "glance_v2.delete_image", "view": "Rice Rule"}]], "views": [{"id": 0, "name": "Square Root Choice"}, {"id": 1, "name": "Sturges Formula"}, {"id": 2, "name": "Rice Rule"}]}}, "iterations": {"pie": [["success", 50], ["errors", 0]], "iter": [["duration", [[1, 10.913447856903076], [2, 13.074084997177124], [3, 16.230239152908325], [4, 16.225876092910767], [5, 10.500921964645386], [6, 13.593005895614624], [7, 13.068074941635132], [8, 11.322429180145264], [9, 17.433691024780273], [10, 13.20972204208374], [11, 11.084233045578003], [12, 15.134748935699463], [13, 12.131784915924072], [14, 11.584665775299072], [15, 18.02886700630188], [16, 14.74291205406189], [17, 10.306499004364014], [18, 12.120062112808228], [19, 11.073020935058594], [20, 9.310420036315918], [21, 13.164511919021606], [22, 13.159446954727173], [23, 14.540541887283325], [24, 14.58174204826355], [25, 10.297457933425903], [26, 11.705476999282837], [27, 11.31475305557251], [28, 10.509531021118164], [29, 12.701995134353638], [30, 11.077676057815552], [31, 10.450911045074463], [32, 11.452684164047241], [33, 14.122451066970825], [34, 9.918165922164917], [35, 11.137094974517822], [36, 10.634567022323608], [37, 10.348185062408447], [38, 13.493613958358765], [39, 12.141142845153809], [40, 11.59303617477417], [41, 12.015263795852661], [42, 9.77023720741272], [43, 14.441802024841309], [44, 11.651347875595093], [45, 17.438477993011475], [46, 11.36630892753601], [47, 14.155148029327393], [48, 15.069867134094238], [49, 11.826210021972656], [50, 10.934176921844482]]], ["idle_duration", [[1, 0.0], [2, 0.0], [3, 0.0], [4, 0.0], [5, 0.0], [6, 0.0], [7, 0.0], [8, 0.0], [9, 0.0], [10, 0.0], [11, 0.0], [12, 0.0], [13, 0.0], [14, 0.0], [15, 0.0], [16, 0.0], [17, 0.0], [18, 0.0], [19, 0.0], [20, 0.0], [21, 0.0], [22, 0.0], [23, 0.0], [24, 0.0], [25, 0.0], [26, 0.0], [27, 0.0], [28, 0.0], [29, 0.0], [30, 0.0], [31, 0.0], [32, 0.0], [33, 0.0], [34, 0.0], [35, 0.0], [36, 0.0], [37, 0.0], [38, 0.0], [39, 0.0], [40, 0.0], [41, 0.0], [42, 0.0], [43, 0.0], [44, 0.0], [45, 0.0], [46, 0.0], [47, 0.0], [48, 0.0], [49, 0.0], [50, 0.0]]]], "histogram": {"data": [[{"disabled": null, "values": [{"y": 6, "x": 10.400225907564163}, {"y": 14, "x": 11.490031778812408}, {"y": 9, "x": 12.579837650060654}, {"y": 8, "x": 13.669643521308899}, {"y": 6, "x": 14.759449392557144}, {"y": 2, "x": 15.84925526380539}, {"y": 2, "x": 16.939061135053635}, {"y": 3, "x": 18.02886700630188}], "key": "task", "view": "Square Root Choice"}], [{"disabled": null, "values": [{"y": 9, "x": 10.555912460599627}, {"y": 15, "x": 11.801404884883336}, {"y": 6, "x": 13.046897309167043}, {"y": 9, "x": 14.292389733450754}, {"y": 6, "x": 15.537882157734462}, {"y": 2, "x": 16.78337458201817}, {"y": 3, "x": 18.02886700630188}], "key": "task", "view": "Sturges Formula"}], [{"disabled": null, "values": [{"y": 6, "x": 10.400225907564163}, {"y": 14, "x": 11.490031778812408}, {"y": 9, "x": 12.579837650060654}, {"y": 8, "x": 13.669643521308899}, {"y": 6, "x": 14.759449392557144}, {"y": 2, "x": 15.84925526380539}, {"y": 2, "x": 16.939061135053635}, {"y": 3, "x": 18.02886700630188}], "key": "task", "view": "Rice Rule"}]], "views": [{"id": 0, "name": "Square Root Choice"}, {"id": 1, "name": "Sturges Formula"}, {"id": 2, "name": "Rice Rule"}]}}, "table": {"styles": {"1": "oblique", "2": "oblique", "4": "rich", "5": "oblique", "6": "oblique"}, "rows": [["glance_v2.create_image", 7.208, 9.074, 11.662, 12.781, 14.641, 9.607, "100.0%", 50], [" -> glance_v2.get_image (x2)", 0.39, 1.003, 1.469, 2.349, 3.971, 1.131, "100.0%", 50], [" -> glance_v2.upload_data", 3.453, 4.729, 6.3, 6.746, 8.579, 5.009, "100.0%", 50], ["glance_v2.delete_image", 1.581, 2.763, 4.246, 4.743, 5.391, 2.955, "100.0%", 50], ["total", 9.31, 11.921, 15.244, 16.892, 18.029, 12.562, "100.0%", 50], [" -> duration", 9.31, 11.921, 15.244, 16.892, 18.029, 12.562, "100.0%", 50], [" -> idle_duration", 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, "100.0%", 50]], "cols": ["Action", "Min (sec)", "Median (sec)", "90%ile (sec)", "95%ile (sec)", "Max (sec)", "Avg (sec)", "Success", "Count"]}, "errors": [], "iterations_count": 50, "load_duration": 146.56392884254456, "complete_output": [[{"widget": "TextArea", "data": ["d85dede4-5b6b-4c0f-ba32-1ce97d50d404"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["580a7f32-19b5-47a9-b53b-958a9fd86ded"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["62fb720b-7b5a-480a-a5f4-7b1cf5c9f70d"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["589501f8-9faa-4220-b6d4-d3b30a8dc2cf"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["05772f9b-fdf5-42e1-9138-c66c6d188fb3"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["5fcf5acc-48dd-473b-a8da-46116631b9bc"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["e3379481-2ae2-45a2-948d-8bff02f99b00"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["e1572822-230a-43fe-86ff-def8b89b5282"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["3038d7b2-5fb6-4d1e-abe6-36a38adb8891"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["f21556dd-d736-49c0-9483-ecf72c9315af"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["960b7975-a6f6-4192-bc53-bd2c3fa3b6f5"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["8fc913d7-f6f7-4bfd-a0ac-54429fe36ca2"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["d64c2a5e-88e7-4c82-871f-c845c68e2ce1"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["6946dd94-b32d-4dd5-862f-8b19f2edb986"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["91c59dc4-8315-47f3-bc27-5e5b1a017348"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["4de89339-24be-48c3-a4e5-d50b4a659d52"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["0e009648-6068-438a-b8fc-0db7d4fd3276"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["666d66d8-d2bc-472c-89c2-ac614ec9839a"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["7b4e1262-818c-4411-ab57-679d0a0fe8e7"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["c4d54b09-950a-4760-8a4b-15091f9bf3a2"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["3779e029-5bb9-48a4-8aad-61ab1df96397"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["3fb58b9e-7a2d-44d0-ab57-9e3324fec959"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["cdce9dbf-72af-45dd-84bf-c7b6017dfcec"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["347ae950-964c-4e10-ab1c-b7ef7194d9ee"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["09b4025e-dc9e-4368-89e1-78bf6cbee644"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["f585f7de-e0b8-4f53-8352-0654e46d8da1"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["87f90f48-a741-4a9f-88ac-91598b805296"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["a4f981c1-2e03-410e-9602-35fde937f25e"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["aadbf751-1868-4a91-a090-253166f29c41"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["45b12b05-5a27-4831-b830-524190f3b416"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["f139c193-4741-4309-82ed-44bacd8276a0"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["c55da491-ecb6-43b4-bb96-da436db07aac"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["314c715c-872c-45b3-9ed7-4a0da4d48c11"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["5ed3ebb9-d55c-4fad-8f7b-bcc6e24a40ef"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["321ed386-1e8f-4ffc-9bb0-513a00af9eeb"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["242f7b79-c66f-4830-b6f0-95d889f4e25a"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["47af4000-7998-4cb3-b590-733809786afc"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["24d2d847-098f-4ff2-b1c7-136a948ddece"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["36fa1433-4677-4d45-bb5f-26d2b8e08043"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["75cc58ab-7777-4ae6-bd38-3c1d701380ac"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["dd8aac79-c4f2-4fad-8e8e-9c1f718f5d53"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["d963dbc3-60ca-4faa-91f7-d99f0c36075e"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["f048918f-7e16-45d7-8205-819061a6f87c"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["61741ccd-f855-4ea2-8929-70ebdd192d2e"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["490b613f-4e7f-451a-bfa4-cbd02a3c7f5d"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["56cbf743-e986-4309-90be-b9fd3fccd574"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["b23b442f-e099-41a5-915d-65b427bf831e"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["40aa79d2-7e79-4150-a7f2-edb5598ddbd6"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["22010b71-459c-4d24-8cd4-2301281c0f49"], "title": "OSProfiler Trace-ID"}], [{"widget": "TextArea", "data": ["5b372d67-c2cf-4d70-b5c3-b2d0e823392f"], "title": "OSProfiler Trace-ID"}]], "config": "{\n  \"version\": 2, \n  \"title\": \"A cropped version of a bigger task.\", \n  \"description\": \"Auto-generated task from a single workload (uuid=5c4d5e10-56f5-4991-a2c2-9ef13fcc42d7)\", \n  \"subtasks\": [\n    {\n      \"title\": \"GlanceImages.create_and_delete_image\", \n      \"description\": \"Create and then delete an image.\", \n      \"scenario\": {\n        \"GlanceImages.create_and_delete_image\": {\n          \"image_location\": \"http://download.cirros-cloud.net/0.3.5/cirros-0.3.5-x86_64-disk.img\", \n          \"disk_format\": \"qcow2\", \n          \"container_format\": \"bare\"\n        }\n      }, \n      \"contexts\": {\n        \"users\": {\n          \"users_per_tenant\": 3, \n          \"tenants\": 2\n        }\n      }, \n      \"runner\": {\n        \"constant\": {\n          \"concurrency\": 5, \n          \"times\": 50\n        }\n      }, \n      \"hooks\": [\n        {\n          \"action\": {\n            \"sys_call\": \"sh /home/rally/data/list_image_config/restart_glance_container.sh\"\n          }, \n          \"trigger\": {\n            \"event\": {\n              \"at\": [\n                100, \n                200, \n                300, \n                400, \n                500\n              ], \n              \"unit\": \"iteration\"\n            }\n          }, \n          \"description\": \"Run script\"\n        }\n      ], \n      \"sla\": {\n        \"failure_rate\": {\n          \"max\": 100\n        }\n      }\n    }\n  ]\n}", "sla_success": true, "output_errors": [], "cls": "GlanceImages", "description": "Create and then delete an image.", "met": "create_and_delete_image", "has_output": true, "full_duration": 157.85949802398682, "load_profile": [["parallel iterations", [[0.0, 0], [1.4949520741939546, 3.1580035312268295], [2.989904148387909, 5], [4.484856222581864, 5], [5.979808296775818, 5], [7.474760370969773, 5], [8.969712445163728, 5], [10.464664519357683, 5], [11.959616593551637, 3.8348927963393025], [13.45456866774559, 3.596143760310597], [14.949520741939546, 4.189077068890637], [16.4444728161335, 4.627086978252082], [17.939424890327455, 3.598438778722639], [19.43437696452141, 4.096269429987966], [20.929329038715366, 5], [22.42428111290932, 5], [23.919233187103274, 5], [25.414185261297227, 5], [26.90913733549118, 4.184613882727203], [28.404089409685138, 2.10939917330257], [29.899041483879092, 4.5283426400263], [31.393993558073046, 5], [32.888945632267, 4.304632040031996], [34.38389770646096, 4.51026364340039], [35.87884978065491, 5], [37.373801854848864, 4.09702190547438], [38.86875392904282, 4.7569862042756625], [40.36370600323677, 4.305041220416661], [41.85865807743073, 4.127131254033485], [43.353610151624686, 4.319797738765858], [44.84856222581864, 4.25241259594329], [46.34351430001259, 3.7581072676278504], [47.83846637420655, 4.759438053173214], [49.3334184484005, 5], [50.828370522594454, 5], [52.32332259678841, 5], [53.81827467098236, 4.574402538471162], [55.31322674517632, 4], [56.808178819370276, 3.471165590276616], [58.30313089356423, 3.646081476678251], [59.798082967758184, 3], [61.29303504195214, 4.934295660742309], [62.78798711614609, 5], [64.28293919034004, 5], [65.777891264534, 4.252561153118619], [67.27284333872795, 4.929278865923124], [68.76779541292191, 5], [70.26274748711586, 5], [71.75769956130982, 3.1981272991267], [73.25265163550378, 4.517622223065979], [74.74760370969773, 4.546117416211317], [76.24255578389169, 2.9588736783502867], [77.73750785808564, 3.56162466556441], [79.2324599322796, 4.880258389427079], [80.72741200647354, 5], [82.2223640806675, 5], [83.71731615486146, 4.8098486257708455], [85.21226822905541, 3.0711699853633982], [86.70722030324937, 3.958017277450679], [88.20217237744332, 4.176111025830695], [89.69712445163728, 4.207280600843285], [91.19207652583123, 3.0491531750263023], [92.68702860002519, 4.987804752395697], [94.18198067421913, 5], [95.6769327484131, 5], [97.17188482260705, 4.345676758927555], [98.666836896801, 4.155150880417498], [100.16178897099496, 4.628817524831245], [101.65674104518891, 4.58528420485597], [103.15169311938287, 3.460326303187975], [104.64664519357682, 3.3380480413631903], [106.14159726777078, 5], [107.63654934196472, 5], [109.13150141615868, 4.306509834786647], [110.62645349035265, 3.779010947778839], [112.12140556454659, 4.761214205377956], [113.61635763874055, 5], [115.1113097129345, 5], [116.60626178712846, 4.124093871129249], [118.1012138613224, 2.533347356476074], [119.59616593551637, 5], [121.09111800971033, 4.774271029277887], [122.58607008390427, 3.7919692136146117], [124.08102215809824, 4.3462166541682095], [125.57597423229218, 5], [127.07092630648614, 5], [128.5658783806801, 5], [130.06083045487404, 4.5799774547564205], [131.555782529068, 4.132169285404538], [133.05073460326196, 4.40418844371362], [134.5456866774559, 3.7499463925591354], [136.04063875164988, 3.876415475572228], [137.53559082584383, 4], [139.03054290003777, 3.122413326468152], [140.52549497423172, 3], [142.0204470484257, 3], [143.51539912261964, 3], [145.0103511968136, 3], [146.50530327100756, 2.471784636165357], [148.0002553452015, 0.03921568627449319], [149.49520741939546, 0]]]], "name": "create_and_delete_image", "created_at": "2019-11-18T14:45:48", "additive_output": [], "sla": [{"criterion": "failure_rate", "detail": "Failure rate criteria 0.00% <= 0.00% <= 100.00% - Passed", "success": true}]}];
 283 | 
 284 |       $scope.location = {
 285 |         /* #/path/hash/sub/div */
 286 |         normalize: function(str) {
 287 |           /* Remove unwanted characters from string */
 288 |           if (typeof str !== "string") { return "" }
 289 |           return str.replace(/[^\w\-\.]/g, "")
 290 |         },
 291 |         uri: function(obj) {
 292 |           /* Getter/Setter */
 293 |           if (! obj) {
 294 |             var uri = {path: "", hash: "", sub: "", div: ""};
 295 |             var arr = ["div", "sub", "hash", "path"];
 296 |             angular.forEach($location.url().split("/"), function(value){
 297 |               var v = $scope.location.normalize(value);
 298 |               if (v) { var k = arr.pop(); if (k) { this[k] = v }}
 299 |             }, uri);
 300 |             return uri
 301 |           }
 302 |           var arr = [obj.path, obj.hash, obj.sub, obj.div], res = [];
 303 |           for (var i in arr) { if (! arr[i]) { break }; res.push(arr[i]) }
 304 |           return $location.url("/" + res.join("/"))
 305 |         },
 306 |         path: function(path, hash) {
 307 |           /* Getter/Setter */
 308 |           if (path === "") { return this.uri({}) }
 309 |           path = this.normalize(path);
 310 |           var uri = this.uri();
 311 |           if (! path) { return uri.path }
 312 |           uri.path = path;
 313 |           var _hash = this.normalize(hash);
 314 |           if (_hash || hash === "") { uri.hash = _hash }
 315 |           return this.uri(uri)
 316 |         },
 317 |         hash: function(hash) {
 318 |           /* Getter/Setter */
 319 |           if (hash) { this.uri({path:this.uri().path, hash:hash}) }
 320 |           return this.uri().hash
 321 |         }
 322 |       }
 323 | 
 324 |       /* Dispatch */
 325 | 
 326 |       $scope.route = function(uri) {
 327 |         if (! $scope.scenarios_map) { return }
 328 | 
 329 |         // Expand menu if there is only one menu group
 330 |         if ($scope.nav.length === 1) {
 331 |           $scope.nav_idx = $scope.nav[0].idx;
 332 |         }
 333 | 
 334 |         if (uri.path in $scope.scenarios_map) {
 335 |           $scope.view = {is_scenario:true};
 336 |           $scope.scenario = $scope.scenarios_map[uri.path];
 337 |           $scope.nav_idx = $scope.nav_map[uri.path];
 338 |           if ($scope.scenario.iterations.histogram.views.length) {
 339 |             $scope.mainHistogram = $scope.scenario.iterations.histogram.views[0]
 340 |           }
 341 |           if ($scope.scenario.atomic.histogram.views.length) {
 342 |             $scope.atomicHistogram = $scope.scenario.atomic.histogram.views[0]
 343 |           }
 344 |           $scope.outputIteration = 0;
 345 |           $scope.showTab(uri);
 346 |         } else {
 347 |           $scope.scenario = null;
 348 |           if (uri.path === "source") {
 349 |             $scope.view = {is_source:true}
 350 |           } else {
 351 |             $scope.view = {is_main:true}
 352 |           }
 353 |         }
 354 |       }
 355 | 
 356 |       $scope.$on("$locationChangeSuccess", function (event, newUrl, oldUrl) {
 357 |         $scope.route($scope.location.uri())
 358 |       });
 359 | 
 360 |       $scope.showNav = function(nav_idx) { $scope.nav_idx = nav_idx }
 361 | 
 362 |       /* Tabs */
 363 | 
 364 |       $scope.tabs = [
 365 |         {
 366 |           id: "overview",
 367 |           name: "Overview",
 368 |           visible: function(){ return !! $scope.scenario.iterations.pie.length }
 369 |         },{
 370 |           id: "details",
 371 |           name: "Details",
 372 |           visible: function(){ return !! $scope.scenario.atomic.pie.length }
 373 |         },{
 374 |           id: "output",
 375 |           name: "Scenario Data",
 376 |           visible: function(){ return $scope.scenario.has_output }
 377 |         },{
 378 |           id: "hooks",
 379 |           name: "Hooks",
 380 |           visible: function(){ return $scope.scenario.hooks.length }
 381 |         },{
 382 |           id: "failures",
 383 |           name: "Failures",
 384 |           visible: function(){ return !! $scope.scenario.errors.length }
 385 |         },{
 386 |           id: "task",
 387 |           name: "Input task",
 388 |           visible: function(){ return !! $scope.scenario.config }
 389 |         }
 390 |       ];
 391 |       $scope.tabs_map = {};
 392 |       angular.forEach($scope.tabs,
 393 |                       function(tab){ this[tab.id] = tab }, $scope.tabs_map);
 394 | 
 395 |       $scope.showTab = function(uri) {
 396 |         $scope.tab = uri.hash in $scope.tabs_map ? uri.hash : "overview";
 397 |         if (uri.hash === "output") {
 398 |           if (typeof $scope.scenario.output === "undefined") {
 399 |             var has_additive = !! $scope.scenario.additive_output.length;
 400 |             var has_complete = !! ($scope.scenario.complete_output.length
 401 |                                    && $scope.scenario.complete_output[0].length);
 402 |             $scope.scenario.output = {
 403 |               has_additive: has_additive,
 404 |               has_complete: has_complete,
 405 |               length: has_additive + has_complete,
 406 |               active: has_additive ? "additive" : (has_complete ? "complete" : "")
 407 |             }
 408 |           }
 409 |           if (uri.sub && $scope.scenario.output["has_" + uri.sub]) {
 410 |             $scope.scenario.output.active = uri.sub
 411 |           }
 412 |         }
 413 |         else if (uri.hash === "hooks") {
 414 |           if ($scope.scenario.hooks.length) {
 415 |             var hook_idx = parseInt(uri.sub);
 416 | 
 417 |             if (isNaN(hook_idx) || ($scope.scenario.hooks.length - hook_idx) <= 0) {
 418 |               hook_idx = 0
 419 |             }
 420 | 
 421 |             if ($scope.scenario.hook_idx === hook_idx) {
 422 |               return
 423 |             }
 424 | 
 425 |             $scope.scenario.hooks.cur = $scope.scenario.hooks[hook_idx];
 426 |             $scope.scenario.hook_idx = hook_idx;
 427 |             if (typeof $scope.scenario.hooks.cur.active === "undefined") {
 428 |               if ($scope.scenario.hooks.cur.additive.length) {
 429 |                 $scope.scenario.hooks.cur.active = "additive"
 430 |               }
 431 |               if ($scope.scenario.hooks.cur.complete.length) {
 432 |                 if (typeof $scope.scenario.hooks.cur.active === "undefined") {
 433 |                   $scope.scenario.hooks.cur.active = "complete"
 434 |                 }
 435 |                 $scope.set_hook_run()
 436 |               }
 437 |             }
 438 |           }
 439 |         }
 440 |       }
 441 | 
 442 |       for (var i in $scope.tabs) {
 443 |         if ($scope.tabs[i].id === $scope.location.hash()) {
 444 |           $scope.tab = $scope.tabs[i].id
 445 |         }
 446 |         $scope.tabs[i].isVisible = function() {
 447 |           if ($scope.scenario) {
 448 |             if (this.visible()) { return true }
 449 |             /* If tab should be hidden but is selected - show another one */
 450 |             if (this.id === $scope.location.hash()) {
 451 |               for (var i in $scope.tabs) {
 452 |                 var tab = $scope.tabs[i];
 453 |                 if (tab.id != this.id && tab.visible()) {
 454 |                   $scope.tab = tab.id;
 455 |                   return false
 456 |                 }
 457 |               }
 458 |             }
 459 |           }
 460 |           return false
 461 |         }
 462 |       }
 463 | 
 464 |       $scope.set_hook_run = function(idx) {
 465 |         if (typeof idx !== "undefined") {
 466 |           $scope.scenario.hooks.cur.run_idx = idx
 467 |         }
 468 |         else if (typeof $scope.scenario.hooks.cur.run_idx === "undefined") {
 469 |           $scope.scenario.hooks.cur.run_idx = 0
 470 |         }
 471 |         idx = $scope.scenario.hooks.cur.run_idx;
 472 |         if (($scope.scenario.hooks.cur.complete.length - idx) > 0) {
 473 |           $scope.scenario.hooks.cur.run = $scope.scenario.hooks.cur.complete[idx]
 474 |         }
 475 |       }
 476 | 
 477 |       $scope.complete_hooks_as_dropdown = function() {
 478 |         return $scope.scenario.hooks.cur.complete.length > 10
 479 |       }
 480 | 
 481 |       /* Other helpers */
 482 | 
 483 |       $scope.showError = function(message) {
 484 |           return (function (e) {
 485 |             e.style.display = "block";
 486 |             e.textContent = message
 487 |           })(document.getElementById("page-error"))
 488 |       }
 489 | 
 490 |       $scope.compact_atomics = function() {
 491 |         return ($scope.scenario && $scope.scenario.atomic.iter.length < 9)
 492 |       }
 493 | 
 494 |       /* Initialization */
 495 | 
 496 |       angular.element(document).ready(function(){
 497 |         if (! $scope.scenarios.length) {
 498 |           return $scope.showError("No data...")
 499 |         }
 500 | 
 501 |         /* Compose data mapping */
 502 | 
 503 |         $scope.nav = [];
 504 |         $scope.nav_map = {};
 505 |         $scope.scenarios_map = {};
 506 |         var met = [], itr = 0, cls_idx = 0;
 507 |         var prev_cls, prev_met;
 508 | 
 509 |         for (var idx in $scope.scenarios) {
 510 |           var sc = $scope.scenarios[idx];
 511 |           if (! prev_cls) {
 512 |             prev_cls = sc.cls
 513 |           }
 514 |           else if (prev_cls !== sc.cls) {
 515 |             $scope.nav.push({cls:prev_cls, met:met, idx:cls_idx});
 516 |             prev_cls = sc.cls;
 517 |             met = [];
 518 |             itr = 1;
 519 |             cls_idx += 1
 520 |           }
 521 | 
 522 |           if (prev_met !== sc.met) { itr = 1 };
 523 |           sc.ref = $scope.location.normalize(sc.cls+"."+sc.met+(itr > 1 ? "-"+itr : ""));
 524 |           $scope.scenarios_map[sc.ref] = sc;
 525 |           $scope.nav_map[sc.ref] = cls_idx;
 526 |           met.push({name:sc.name, itr:itr, idx:idx, ref:sc.ref});
 527 |           prev_met = sc.met;
 528 |           itr += 1;
 529 |         }
 530 | 
 531 |         if (met.length) {
 532 |           $scope.nav.push({cls:prev_cls, met:met, idx:cls_idx})
 533 |         }
 534 | 
 535 |         /* Start */
 536 | 
 537 |         var uri = $scope.location.uri();
 538 |         uri.path = $scope.location.path();
 539 |         $scope.route(uri);
 540 |         $scope.$digest()
 541 |       })
 542 |     };
 543 | 
 544 |     if (typeof angular === "object") {
 545 |       angular.module("App", [])
 546 |         .controller("Controller", ["$scope", "$location", controllerFunction])
 547 |         .directive("widget", widgetDirective)
 548 |     }
 549 | 
 550 | 
 551 | </script>
 552 |   <style>
 553 |     body { margin:0; padding:0 0 50px; font-size:14px; font-family:Helvetica,Arial,sans-serif }
 554 |     a, a:active, a:focus, a:visited { text-decoration:none; outline:none }
 555 |     p { margin:0; padding:5px 0 }
 556 |     p.thesis { padding:10px 0 }
 557 |     h1 { color:#666; margin:0 0 20px; font-size:30px; font-weight:normal }
 558 |     h2, .h2 { color:#666; margin:24px 0 6px; font-size:25px; font-weight:normal }
 559 |     h3, .h3 { color:#777; margin:12px 0 4px; font-size:18px; font-weight:normal }
 560 |     table { border-collapse:collapse; border-spacing:0; width:100%; font-size:12px; margin:0 0 10px }
 561 |     table th { text-align:left; padding:8px; color:#000; border:2px solid #ddd; border-width:0 0 2px 0 }
 562 |     table th.sortable { cursor:pointer }
 563 |     table td { text-align:left; border-top:1px solid #ddd; padding:8px; color:#333 }
 564 |     table.compact td { padding:4px 8px }
 565 |     table.striped tr:nth-child(odd) td { background:#f9f9f9 }
 566 |     table.linked tbody tr:hover { background:#f9f9f9; cursor:pointer }
 567 |     .pointer { cursor:pointer }
 568 |     .rich, .rich td { font-weight:bold }
 569 |     .oblique { font-style:italic }
 570 |     .code { padding:10px; font-size:13px; color:#333; background:#f6f6f6; border:1px solid #e5e5e5; border-radius:4px }
 571 | 
 572 |     .header { text-align:left; background:#333; font-size:18px; padding:13px 0; margin-bottom:20px; color:#fff; background-image:linear-gradient(to bottom, #444 0px, #222 100%) }
 573 |     .header a, .header a:visited, .header a:focus { color:#999 }
 574 | 
 575 |     .notify-error { padding:5px 10px; background:#fee; color:red }
 576 |     .status-skip, .status-skip td { color:grey }
 577 |     .status-pass, .status-pass td { color:green }
 578 |     .status-fail, .status-fail td { color:red }
 579 |     .capitalize { text-transform:capitalize }
 580 |     
 581 |     .aside { margin:0 20px 0 0; display:block; width:255px; float:left }
 582 |     .aside > div { margin-bottom: 15px }
 583 |     .aside > div div:first-child { border-top-left-radius:4px; border-top-right-radius:4px }
 584 |     .aside > div div:last-child { border-bottom-left-radius:4px; border-bottom-right-radius:4px }
 585 |     .navcls { color:#678; background:#eee; border:1px solid #ddd; margin-bottom:-1px; display:block; padding:8px 9px; font-weight:bold; text-align:left; overflow:hidden; text-overflow:ellipsis; white-space:nowrap; cursor:pointer }
 586 |     .navcls.expanded { color:#469 }
 587 |     .navcls.active { background:#428bca; background-image:linear-gradient(to bottom, #428bca 0px, #3278b3 100%); border-color:#3278b3; color:#fff }
 588 |     .navmet { color:#555; background:#fff; border:1px solid #ddd; font-size:12px; display:block; margin-bottom:-1px; padding:8px 10px; text-align:left; text-overflow:ellipsis; white-space:nowrap; overflow:hidden; cursor:pointer }
 589 |     .navmet:hover { background:#f8f8f8 }
 590 |     .navmet.active, .navmet.active:hover { background:#428bca; background-image:linear-gradient(to bottom, #428bca 0px, #3278b3 100%); border-color:#3278b3; color:#fff }
 591 | 
 592 |     .buttn { color:#555; background:#fff; border:1px solid #ddd; border-radius:5px; font-size:12px; margin-bottom:-1px; padding:5px 7px; text-align:left; text-overflow:ellipsis; white-space:nowrap; overflow:hidden; cursor:pointer }
 593 |     .buttn:hover { background:#f8f8f8 }
 594 |     .buttn.active, .bttn.active:hover { background:#428bca; background-image:linear-gradient(to bottom, #428bca 0px, #3278b3 100%); border-color:#3278b3; color:#fff; cursor:default }
 595 | 
 596 |     .tabs { list-style:outside none none; margin:0 0 5px; padding:0; border-bottom:1px solid #ddd }
 597 |     .tabs:after { clear:both }
 598 |     .tabs li { float:left; margin-bottom:-1px; display:block; position:relative }
 599 |     .tabs li div { border:1px solid transparent; border-radius:4px 4px 0 0; line-height:20px; margin-right:2px; padding:10px 15px; color:#428bca }
 600 |     .tabs li div:hover { border-color:#eee #eee #ddd; background:#eee; cursor:pointer; }
 601 |     .tabs li.active div { background:#fff; border-color:#ddd #ddd transparent; border-style:solid; border-width:1px; color:#555; cursor:default }
 602 |     .failure-mesg { color:#900 }
 603 |     .failure-trace { color:#333; white-space:pre; overflow:auto }
 604 | 
 605 |     .link { color:#428BCA; padding:5px 15px 5px 5px; text-decoration:underline; cursor:pointer }
 606 |     .link.active { color:#333; text-decoration:none; cursor:default }
 607 | 
 608 |     .chart { padding:0; margin:0; width:890px }
 609 |     .chart svg { height:300px; padding:0; margin:0; overflow:visible; float:right }
 610 |     .chart.lower svg { height:180px }
 611 |     .chart-label-y { font-size:12px; position:relative; top:5px; padding:0; margin:0 }
 612 | 
 613 |     .expandable { cursor:pointer }
 614 |     .clearfix { clear:both }
 615 |     .sortable > .arrow { display:inline-block; width:12px; height:inherit; color:#c90 }
 616 |     .content-main { margin:0 5px; display:block; float:left }
 617 | 
 618 |     .content-wrap {  margin:0 auto; padding:0 5px;  }
 619 |     
 620 |     @media only screen and (min-width: 320px)  { .content-wrap { width:900px  } .content-main { width:600px } }
 621 |     @media only screen and (min-width: 900px)  { .content-wrap { width:880px  } .content-main { width:590px } }
 622 |     @media only screen and (min-width: 1000px) { .content-wrap { width:980px  } .content-main { width:690px } }
 623 |     @media only screen and (min-width: 1100px) { .content-wrap { width:1080px } .content-main { width:790px } }
 624 |     @media only screen and (min-width: 1200px) { .content-wrap { width:1180px } .content-main { width:890px } }
 625 | 
 626 |   </style>
 627 | </head>
 628 | <body ng-controller="Controller">
 629 | 
 630 |   <div class="header" id="page-header">
 631 |     <div class="content-wrap">
 632 |       <a href="https://github.com/openstack/rally">Rally</a>&nbsp;
 633 |       <span>task results</span>
 634 |     </div>
 635 |   </div>
 636 | 
 637 |   <div class="content-wrap" id="page-content">
 638 |     
 639 | 
 640 |     <p id="page-error" class="notify-error" style="display:none"></p>
 641 | 
 642 |     <div id="content-nav" class="aside" ng-show="scenarios.length" ng-cloack>
 643 |       <div>
 644 |         <div class="navcls"
 645 |              ng-class="{active:view.is_main}"
 646 |              ng-click="location.path('')">Task overview</div>
 647 |         <div class="navcls"
 648 |              ng-class="{active:view.is_source}"
 649 |              ng-click="location.path('source', '')">Input file</div>
 650 |       </div>
 651 |       <div>
 652 |         <div class="navcls" title="{{n.cls}}"
 653 |              ng-repeat-start="n in nav track by $index"
 654 |              ng-click="showNav(n.idx)"
 655 |              ng-class="{expanded:n.idx==nav_idx}">
 656 |                 <span ng-hide="n.idx==nav_idx">&#9658;</span>
 657 |                 <span ng-show="n.idx==nav_idx">&#9660;</span>
 658 |                 {{n.cls}}</div>
 659 |         <div class="navmet" title="{{m.name}}"
 660 |              ng-show="n.idx==nav_idx"
 661 |              ng-class="{active:m.ref==scenario.ref}"
 662 |              ng-click="location.path(m.ref)"
 663 |              ng-repeat="m in n.met track by $index"
 664 |              ng-repeat-end>{{m.name}}</div>
 665 |       </div>
 666 |     </div>
 667 | 
 668 |     <div id="content-main" class="content-main" ng-show="scenarios.length" ng-cloak>
 669 | 
 670 |       <div ng-show="view.is_main">
 671 |         <h1>Task overview</h1>
 672 |         <table class="linked compact"
 673 |                ng-init="ov_srt='ref'; ov_dir=false">
 674 |           <thead>
 675 |             <tr>
 676 |               <th class="sortable"
 677 |                   title="Scenario name, with optional suffix of call number"
 678 |                   ng-click="ov_srt='ref'; ov_dir=!ov_dir">
 679 |                 Scenario
 680 |                 <span class="arrow">
 681 |                   <b ng-show="ov_srt=='ref' && !ov_dir">&#x25b4;</b>
 682 |                   <b ng-show="ov_srt=='ref' && ov_dir">&#x25be;</b>
 683 |                 </span>
 684 |               <th class="sortable"
 685 |                   title="How long the scenario run, without context duration"
 686 |                   ng-click="ov_srt='load_duration'; ov_dir=!ov_dir">
 687 |                 Load duration (s)
 688 |                 <span class="arrow">
 689 |                   <b ng-show="ov_srt=='load_duration' && !ov_dir">&#x25b4;</b>
 690 |                   <b ng-show="ov_srt=='load_duration' && ov_dir">&#x25be;</b>
 691 |                 </span>
 692 |               <th class="sortable"
 693 |                   title="Scenario duration plus context duration"
 694 |                   ng-click="ov_srt='full_duration'; ov_dir=!ov_dir">
 695 |                 Full duration (s)
 696 |                 <span class="arrow">
 697 |                   <b ng-show="ov_srt=='full_duration' && !ov_dir">&#x25b4;</b>
 698 |                   <b ng-show="ov_srt=='full_duration' && ov_dir">&#x25be;</b>
 699 |                 </span>
 700 |               <th class="sortable" title="Number of iterations"
 701 |                   ng-click="ov_srt='iterations_count'; ov_dir=!ov_dir">
 702 |                 Iterations
 703 |                 <span class="arrow">
 704 |                   <b ng-show="ov_srt=='iterations_count' && !ov_dir">&#x25b4;</b>
 705 |                   <b ng-show="ov_srt=='iterations_count' && ov_dir">&#x25be;</b>
 706 |                 </span>
 707 |               <th class="sortable" title="Scenario runner type"
 708 |                   ng-click="ov_srt='runner'; ov_dir=!ov_dir">
 709 |                 Runner
 710 |                 <span class="arrow">
 711 |                   <b ng-show="ov_srt=='runner' && !ov_dir">&#x25b4;</b>
 712 |                   <b ng-show="ov_srt=='runner' && ov_dir">&#x25be;</b>
 713 |                 </span>
 714 |               <th class="sortable" title="Number of errors occurred"
 715 |                   ng-click="ov_srt='errors.length'; ov_dir=!ov_dir">
 716 |                 Errors
 717 |                 <span class="arrow">
 718 |                   <b ng-show="ov_srt=='errors.length' && !ov_dir">&#x25b4;</b>
 719 |                   <b ng-show="ov_srt=='errors.length' && ov_dir">&#x25be;</b>
 720 |                 </span>
 721 |               <th class="sortable" title="Number of hooks"
 722 |                   ng-click="ov_srt='hooks.length'; ov_dir=!ov_dir">
 723 |                 Hooks
 724 |                 <span class="arrow">
 725 |                   <b ng-show="ov_srt=='hooks.length' && !ov_dir">&#x25b4;</b>
 726 |                   <b ng-show="ov_srt=='hooks.length' && ov_dir">&#x25be;</b>
 727 |                 </span>
 728 |               <th class="sortable" title="Whether SLA check is successful"
 729 |                   ng-click="ov_srt='sla_success'; ov_dir=!ov_dir">
 730 |                 Success (SLA)
 731 |                 <span class="arrow">
 732 |                   <b ng-show="ov_srt=='sla_success' && !ov_dir">&#x25b4;</b>
 733 |                   <b ng-show="ov_srt=='sla_success' && ov_dir">&#x25be;</b>
 734 |                 </span>
 735 |             <tr>
 736 |           </thead>
 737 |           <tbody>
 738 |             <tr ng-repeat="sc in scenarios | orderBy:ov_srt:ov_dir"
 739 |                 ng-click="location.path(sc.ref)">
 740 |               <td>{{sc.ref}}
 741 |               <td>{{sc.load_duration | number:3}}
 742 |               <td>{{sc.full_duration | number:3}}
 743 |               <td>{{sc.iterations_count}}
 744 |               <td>{{sc.runner}}
 745 |               <td>{{sc.errors.length}}
 746 |               <td>{{sc.hooks.length}}
 747 |               <td>
 748 |                 <span ng-show="sc.sla_success" class="status-pass">&#x2714;</span>
 749 |                 <span ng-hide="sc.sla_success" class="status-fail">&#x2716;</span>
 750 |             <tr>
 751 |           </tbody>
 752 |         </table>
 753 |       </div>
 754 | 
 755 |       <div ng-show="view.is_source">
 756 |         <h1>Input file</h1>
 757 |         <pre class="code">{{source}}</pre>
 758 |       </div>
 759 | 
 760 |       <div ng-show="view.is_scenario">
 761 |         <h1>{{scenario.cls}}.<wbr>{{scenario.name}} ({{scenario.full_duration | number:3}}s)</h1>
 762 |         <div ng-show="scenario.description" style="margin-bottom: 20px;">
 763 |             <i>{{scenario.description}}</i>
 764 |         </div>
 765 |         <ul class="tabs">
 766 |           <li ng-repeat="t in tabs"
 767 |               ng-show="t.isVisible()"
 768 |               ng-class="{active:t.id == tab}"
 769 |               ng-click="location.hash(t.id)">
 770 |             <div>{{t.name}}</div>
 771 |           </li>
 772 |           <div class="clearfix"></div>
 773 |         </ul>
 774 |         <div ng-include="tab"></div>
 775 | 
 776 |         <script type="text/ng-template" id="overview">
 777 |           <p class="thesis">
 778 |             Load duration: <b>{{scenario.load_duration | number:3}} s</b> &nbsp;
 779 |             Full duration: <b>{{scenario.full_duration | number:3}} s</b> &nbsp;
 780 |             Iterations: <b>{{scenario.iterations_count}}</b> &nbsp;
 781 |             Failures: <b>{{scenario.errors.length}}</b> &nbsp;
 782 |             Started at: <b>{{scenario.created_at}}</b>
 783 |           </p>
 784 | 
 785 |           <div ng-show="scenario.sla.length">
 786 |             <h2>Service-level agreement</h2>
 787 |             <table class="striped">
 788 |               <thead>
 789 |                 <tr>
 790 |                   <th>Criterion
 791 |                   <th>Detail
 792 |                   <th>Success
 793 |                 <tr>
 794 |               </thead>
 795 |               <tbody>
 796 |                 <tr class="rich"
 797 |                     ng-repeat="row in scenario.sla track by $index"
 798 |                     ng-class="{'status-fail':!row.success, 'status-pass':row.success}">
 799 |                   <td>{{row.criterion}}
 800 |                   <td>{{row.detail}}
 801 |                   <td class="capitalize">{{row.success}}
 802 |                 <tr>
 803 |               </tbody>
 804 |             </table>
 805 |           </div>
 806 | 
 807 |           <div widget="Table"
 808 |                data="scenario.table"
 809 |                lastrow-class="rich"
 810 |                title="Total durations">
 811 |           </div>
 812 | 
 813 |           <div widget="StackedArea"
 814 |                data="scenario.iterations.iter"
 815 |                name-x="Iteration sequence number"
 816 |                controls="true"
 817 |                guide="true">
 818 |           </div>
 819 | 
 820 |           <div widget="StackedArea"
 821 |                data="scenario.load_profile"
 822 |                title="Load Profile"
 823 |                title-class="h3"
 824 |                name-x="Timeline (seconds)"
 825 |                format-y="d"
 826 |                format-x=",.2f"
 827 |                class="lower">
 828 |           </div>
 829 | 
 830 |           <div widget="Pie"
 831 |                data="scenario.iterations.pie"
 832 |                title="Distribution"
 833 |                title-class="h3"
 834 |                style="float:left; width:40%; margin-top:15px">
 835 |           </div>
 836 | 
 837 |           <div widget="Histogram"
 838 |                ng-if="scenario.iterations.histogram.data.length"
 839 |                data="scenario.iterations.histogram.data[mainHistogram.id]"
 840 |                style="float:left; width:59%; margin-top:15px; position:relative; top:40px">
 841 |           </div>
 842 | 
 843 |           <select ng-model="mainHistogram"
 844 |                   ng-show="scenario.iterations.histogram.data.length"
 845 |                   ng-options="i.name for i in scenario.iterations.histogram.views track by i.id"
 846 |                   style="float:right; margin:45px 35px 0">
 847 |           </select>
 848 | 
 849 |           <div class="clearfix"></div>
 850 | 
 851 |         </script>
 852 | 
 853 |         <script type="text/ng-template" id="details">
 854 | 
 855 |           <div widget="StackedArea"
 856 |                data="scenario.atomic.iter"
 857 |                title="Atomic Action Durations"
 858 |                name-x="Iteration sequence number"
 859 |                controls="true"
 860 |                guide="true">
 861 |           </div>
 862 | 
 863 |           <div widget="Pie"
 864 |                data="scenario.atomic.pie"
 865 |                title="Distribution"
 866 |                title-class="h3"
 867 |                style="float:left; margin-top:15px"
 868 |                ng-style="compact_atomics() ? {width:'40%'} : {}">
 869 |           </div>
 870 | 
 871 |           <div widget="Histogram" data="scenario.atomic.histogram.data[atomicHistogram.id]"
 872 |                ng-if="scenario.atomic.histogram.data.length"
 873 |                style="float:left; position:relative; top:40px"
 874 |                ng-style="compact_atomics() ? {width:'59%', 'margin-top':'15px'} : {}">
 875 |           </div>
 876 | 
 877 |           <select ng-show="scenario.atomic.histogram.data.length"
 878 |                   ng-model="atomicHistogram"
 879 |                   ng-options="i.name for i in scenario.atomic.histogram.views track by i.id"
 880 |                   style="float:right; margin:45px 35px 0">
 881 |           </select>
 882 | 
 883 |           <div class="clearfix"></div>
 884 | 
 885 |         </script>
 886 | 
 887 |         <script type="text/ng-template" id="output">
 888 | 
 889 |           <div style="padding:10px 0 0">
 890 |             <span class="link"
 891 |                   ng-click="location.hash('output/additive')"
 892 |                   ng-class="{active:scenario.output.active === 'additive'}"
 893 |                   ng-if="scenario.output.has_additive">Aggregated</span>
 894 |             <span class="link"
 895 |                   ng-click="location.hash('output/complete')"
 896 |                   ng-class="{active:scenario.output.active === 'complete'}"
 897 |                   ng-if="scenario.output.has_complete">Per iteration</span>
 898 |           </div>
 899 | 
 900 |           <div ng-repeat="chart in scenario.additive_output"
 901 |                ng-if="scenario.output.active === 'additive'">
 902 |             <div widget="{{chart.widget}}"
 903 |                  title="{{chart.title}}"
 904 |                  description="{{chart.description}}"
 905 |                  name-x="{{chart.axis_label}}"
 906 |                  name-y="{{chart.label}}"
 907 |                  data="chart.data">
 908 |             </div>
 909 |           </div>
 910 | 
 911 |           <div ng-if="scenario.output.active === 'complete'" style="padding:10px 0 0">
 912 |             <select ng-model="outputIteration">
 913 |               <option ng-repeat="i in scenario.complete_output track by $index"
 914 |                       value="{{$index}}">
 915 |                 Iteration {{$index}}
 916 |             </select>
 917 | 
 918 |             <div ng-repeat="chart in scenario.complete_output[outputIteration]">
 919 |               <div widget="{{chart.widget}}"
 920 |                    title="{{chart.title}}"
 921 |                    description="{{chart.description}}"
 922 |                    name-x="{{chart.axis_label}}"
 923 |                    name-y="{{chart.label}}"
 924 |                    data="chart.data">
 925 |               </div>
 926 |             </div>
 927 |           </div>
 928 |         </script>
 929 | 
 930 |         <script type="text/ng-template" id="hooks">
 931 | 
 932 |           <div style="padding:15px 0">
 933 |             <span ng-repeat="h in scenario.hooks track by $index"
 934 |                   class="buttn"
 935 |                   title="{{h.desc}}"
 936 |                   style="margin:0 10px 0 0"
 937 |                   ng-click="location.hash('hooks/'+$index)"
 938 |                   ng-class="{active:scenario.hook_idx===$index}">
 939 |               {{h.name}}
 940 |             </span>
 941 |           </div>
 942 | 
 943 |           <table class="striped" style="margin:5px 0 25px">
 944 |             <thead>
 945 |               <tr>
 946 |                 <th>Plugin
 947 |                 <th>Description
 948 |             </thead>
 949 |             <tbody>
 950 |               <tr>
 951 |                 <td>{{scenario.hooks.cur.name}}
 952 |                 <td>{{scenario.hooks.cur.desc}}
 953 |             </tbody>
 954 |           </table>
 955 | 
 956 |           <div>
 957 |             <span class="link"
 958 |                   ng-click="scenario.hooks.cur.active = 'additive'"
 959 |                   ng-class="{active:scenario.hooks.cur.active === 'additive'}"
 960 |                   ng-if="scenario.hooks.cur.additive.length">Aggregated</span>
 961 |             <span class="link"
 962 |                   ng-click="scenario.hooks.cur.active = 'complete'"
 963 |                   ng-class="{active:scenario.hooks.cur.active === 'complete'}"
 964 |                   ng-if="scenario.hooks.cur.complete.length">Per hook run</span>
 965 |           </div>
 966 | 
 967 |           <div ng-repeat="chart in scenario.hooks.cur.additive"
 968 |                ng-if="scenario.hooks.cur.active === 'additive'">
 969 |             <div widget="{{chart.widget}}"
 970 |                  title="{{chart.title}}"
 971 |                  description="{{chart.description}}"
 972 |                  name-x="{{chart.axis_label}}"
 973 |                  name-y="{{chart.label}}"
 974 |                  data="chart.data">
 975 |             </div>
 976 |           </div>
 977 | 
 978 |           <div ng-if="scenario.hooks.cur.active === 'complete'" style="padding:10px 0 0">
 979 | 
 980 |             <select ng-if="complete_hooks_as_dropdown()"
 981 |                     ng-model="scenario.hooks.cur.run_idx"
 982 |                     ng-change="set_hook_run()">
 983 |               <option ng-repeat="h in scenario.hooks.cur.complete track by $index"
 984 |                       ng-selected="scenario.hooks.cur.run_idx == $index"
 985 |                       value="{{$index}}">
 986 |                 {{h.triggered_by}}
 987 |             </select>
 988 | 
 989 |             <div ng-if="! complete_hooks_as_dropdown()"
 990 |                  style="border:#ccc solid; border-width:1px 0 0; padding:5px 0 0">
 991 |               <span ng-repeat="h in scenario.hooks.cur.complete track by $index"
 992 |                     class="link"
 993 |                     ng-class="{active:scenario.hooks.cur.run_idx == $index}"
 994 |                     ng-click="set_hook_run($index)">
 995 |                 {{h.triggered_by}}
 996 |               </span>
 997 |             </div>
 998 | 
 999 |             <table class="striped" style="margin:15px 0 15px">
1000 |               <thead>
1001 |                 <tr>
1002 |                   <th>Status
1003 |                   <th>Triggered by
1004 |                   <th>Started at
1005 |                   <th>Finished at
1006 |               </thead>
1007 |               <tbody>
1008 |                 <tr>
1009 |                   <td ng-style="scenario.hooks.cur.run.status === 'success' ? {color:'green'} : {color:'red'}">
1010 |                     <b>{{scenario.hooks.cur.run.status}}</b>
1011 |                   <td>{{scenario.hooks.cur.run.triggered_by}}
1012 |                   <td>{{scenario.hooks.cur.run.started_at}}
1013 |                   <td>{{scenario.hooks.cur.run.finished_at}}
1014 |               </tbody>
1015 |             </table>
1016 | 
1017 |             <div ng-repeat="chart in scenario.hooks.cur.run.charts">
1018 |               <div widget="{{chart.widget}}"
1019 |                    title="{{chart.title}}"
1020 |                    description="{{chart.description}}"
1021 |                    name-x="{{chart.axis_label}}"
1022 |                    name-y="{{chart.label}}"
1023 |                    data="chart.data">
1024 |               </div>
1025 |             </div>
1026 |           </div>
1027 |         </script>
1028 | 
1029 |         <script type="text/ng-template" id="failures">
1030 |           <h2>Task failures (<ng-pluralize
1031 |             count="scenario.errors.length"
1032 |             when="{'1': '1 iteration', 'other': '{} iterations'}"></ng-pluralize> failed)
1033 |           </h2>
1034 |           <table class="striped">
1035 |             <thead>
1036 |               <tr>
1037 |                 <th>
1038 |                 <th>Timestamp
1039 |                 <th>Iteration
1040 |                 <th>Exception type
1041 |                 <th>Exception message
1042 |               </tr>
1043 |             </thead>
1044 |             <tbody>
1045 |               <tr class="expandable"
1046 |                   ng-repeat-start="i in scenario.errors track by $index"
1047 |                   ng-click="i.expanded = ! i.expanded">
1048 |                 <td>
1049 |                   <span ng-hide="i.expanded">&#9658;</span>
1050 |                   <span ng-show="i.expanded">&#9660;</span>
1051 |                 <td>{{i.timestamp}}
1052 |                 <td>{{i.iteration}}
1053 |                 <td>{{i.type}}
1054 |                 <td class="failure-mesg">{{i.message}}
1055 |               </tr>
1056 |               <tr ng-show="i.expanded" ng-repeat-end>
1057 |                 <td colspan="4" class="failure-trace">{{i.traceback}}
1058 |               </tr>
1059 |             </tbody>
1060 |           </table>
1061 |         </script>
1062 | 
1063 |         <script type="text/ng-template" id="task">
1064 |           <h2>The Workload Configuration</h2>
1065 |           <pre class="code">{{scenario.config}}</pre>
1066 |         </script>
1067 |       </div>
1068 | 
1069 |     </div>
1070 |     <div class="clearfix"></div>
1071 | 
1072 | 
1073 |   </div>
1074 | 
1075 |   <script type="text/javascript">
1076 |     if (! window.angular) {(function(f){
1077 |       f(document.getElementById("content-nav"), "none");
1078 |       f(document.getElementById("content-main"), "none");
1079 |       f(document.getElementById("page-error"), "block").textContent = "Failed to load AngularJS framework"
1080 |     })(function(e, s){e.style.display = s; return e})}
1081 | </script>
1082 | </body>
1083 | </html>


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/restart_glance_container.sh:
--------------------------------------------------------------------------------
1 | #!/bin/bash +x
2 | 
3 | #SSH into Wally113 controller and execute commands from commands-to-exec-glance.sh
4 | 
5 | cat commands-to-exec-glance.sh | sshpass -p 'rally' ssh rally@wally113.cit.tu-berlin.de
6 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/test.json:
--------------------------------------------------------------------------------
  1 | {
  2 |   "info": {
  3 |     "started": 0,
  4 |     "last_trace_started": 8727,
  5 |     "finished": 10058,
  6 |     "name": "total"
  7 |   },
  8 |   "stats": {
  9 |     "wsgi": {
 10 |       "count": 12,
 11 |       "duration": 6764
 12 |     }
 13 |   },
 14 |   "children": [
 15 |     {
 16 |       "info": {
 17 |         "exception": "None",
 18 |         "name": "wsgi",
 19 |         "service": "public",
 20 |         "started": 0,
 21 |         "meta.raw_payload.wsgi-stop": {
 22 |           "info": {
 23 |             "host": "wally113"
 24 |           },
 25 |           "name": "wsgi-stop",
 26 |           "service": "public",
 27 |           "timestamp": "2019-11-18T12:19:05.147722",
 28 |           "trace_id": "116851fb-890f-46f7-a753-0dac94d55499",
 29 |           "project": "keystone",
 30 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
 31 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
 32 |         },
 33 |         "finished": 102,
 34 |         "project": "keystone",
 35 |         "host": "wally113",
 36 |         "meta.raw_payload.wsgi-start": {
 37 |           "info": {
 38 |             "host": "wally113",
 39 |             "request": {
 40 |               "path": "/",
 41 |               "scheme": "http",
 42 |               "method": "GET",
 43 |               "query": ""
 44 |             }
 45 |           },
 46 |           "name": "wsgi-start",
 47 |           "service": "public",
 48 |           "timestamp": "2019-11-18T12:19:05.045692",
 49 |           "trace_id": "116851fb-890f-46f7-a753-0dac94d55499",
 50 |           "project": "keystone",
 51 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
 52 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
 53 |         }
 54 |       },
 55 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
 56 |       "trace_id": "116851fb-890f-46f7-a753-0dac94d55499",
 57 |       "children": []
 58 |     },
 59 |     {
 60 |       "info": {
 61 |         "exception": "None",
 62 |         "name": "wsgi",
 63 |         "service": "public",
 64 |         "started": 161,
 65 |         "meta.raw_payload.wsgi-stop": {
 66 |           "info": {
 67 |             "host": "wally113"
 68 |           },
 69 |           "name": "wsgi-stop",
 70 |           "service": "public",
 71 |           "timestamp": "2019-11-18T12:19:05.608341",
 72 |           "trace_id": "895c37bf-1035-44ac-809b-4ceaa02c4de6",
 73 |           "project": "keystone",
 74 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
 75 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
 76 |         },
 77 |         "finished": 562,
 78 |         "project": "keystone",
 79 |         "host": "wally113",
 80 |         "meta.raw_payload.wsgi-start": {
 81 |           "info": {
 82 |             "host": "wally113",
 83 |             "request": {
 84 |               "path": "/v3/auth/tokens",
 85 |               "scheme": "http",
 86 |               "method": "POST",
 87 |               "query": ""
 88 |             }
 89 |           },
 90 |           "name": "wsgi-start",
 91 |           "service": "public",
 92 |           "timestamp": "2019-11-18T12:19:05.207285",
 93 |           "trace_id": "895c37bf-1035-44ac-809b-4ceaa02c4de6",
 94 |           "project": "keystone",
 95 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
 96 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
 97 |         }
 98 |       },
 99 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
100 |       "trace_id": "895c37bf-1035-44ac-809b-4ceaa02c4de6",
101 |       "children": []
102 |     },
103 |     {
104 |       "info": {
105 |         "exception": "None",
106 |         "name": "wsgi",
107 |         "service": "public",
108 |         "started": 676,
109 |         "meta.raw_payload.wsgi-stop": {
110 |           "info": {
111 |             "host": "wally113"
112 |           },
113 |           "name": "wsgi-stop",
114 |           "service": "public",
115 |           "timestamp": "2019-11-18T12:19:05.772028",
116 |           "trace_id": "5d42aa64-016e-4e07-b1f9-5228ed926a71",
117 |           "project": "keystone",
118 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
119 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
120 |         },
121 |         "finished": 726,
122 |         "project": "keystone",
123 |         "host": "wally113",
124 |         "meta.raw_payload.wsgi-start": {
125 |           "info": {
126 |             "host": "wally113",
127 |             "request": {
128 |               "path": "/",
129 |               "scheme": "http",
130 |               "method": "GET",
131 |               "query": ""
132 |             }
133 |           },
134 |           "name": "wsgi-start",
135 |           "service": "public",
136 |           "timestamp": "2019-11-18T12:19:05.722138",
137 |           "trace_id": "5d42aa64-016e-4e07-b1f9-5228ed926a71",
138 |           "project": "keystone",
139 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
140 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
141 |         }
142 |       },
143 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
144 |       "trace_id": "5d42aa64-016e-4e07-b1f9-5228ed926a71",
145 |       "children": []
146 |     },
147 |     {
148 |       "info": {
149 |         "exception": "None",
150 |         "name": "wsgi",
151 |         "service": "public",
152 |         "started": 857,
153 |         "meta.raw_payload.wsgi-stop": {
154 |           "info": {
155 |             "host": "wally113"
156 |           },
157 |           "name": "wsgi-stop",
158 |           "service": "public",
159 |           "timestamp": "2019-11-18T12:19:06.237228",
160 |           "trace_id": "2c937f51-57b7-401c-84ea-0458abcac204",
161 |           "project": "keystone",
162 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
163 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
164 |         },
165 |         "finished": 1191,
166 |         "project": "keystone",
167 |         "host": "wally113",
168 |         "meta.raw_payload.wsgi-start": {
169 |           "info": {
170 |             "host": "wally113",
171 |             "request": {
172 |               "path": "/v3/auth/tokens",
173 |               "scheme": "http",
174 |               "method": "POST",
175 |               "query": ""
176 |             }
177 |           },
178 |           "name": "wsgi-start",
179 |           "service": "public",
180 |           "timestamp": "2019-11-18T12:19:05.903666",
181 |           "trace_id": "2c937f51-57b7-401c-84ea-0458abcac204",
182 |           "project": "keystone",
183 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
184 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
185 |         }
186 |       },
187 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
188 |       "trace_id": "2c937f51-57b7-401c-84ea-0458abcac204",
189 |       "children": []
190 |     },
191 |     {
192 |       "info": {
193 |         "exception": "None",
194 |         "name": "wsgi",
195 |         "service": "api",
196 |         "started": 1261,
197 |         "meta.raw_payload.wsgi-stop": {
198 |           "info": {
199 |             "host": "wally113"
200 |           },
201 |           "name": "wsgi-stop",
202 |           "service": "api",
203 |           "timestamp": "2019-11-18T12:19:06.558746",
204 |           "trace_id": "24968a47-2031-4765-898e-69a65572f188",
205 |           "project": "glance",
206 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
207 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
208 |         },
209 |         "finished": 1513,
210 |         "project": "glance",
211 |         "host": "wally113",
212 |         "meta.raw_payload.wsgi-start": {
213 |           "info": {
214 |             "host": "wally113",
215 |             "request": {
216 |               "path": "/v2/schemas/image",
217 |               "scheme": "http",
218 |               "method": "GET",
219 |               "query": ""
220 |             }
221 |           },
222 |           "name": "wsgi-start",
223 |           "service": "api",
224 |           "timestamp": "2019-11-18T12:19:06.306821",
225 |           "trace_id": "24968a47-2031-4765-898e-69a65572f188",
226 |           "project": "glance",
227 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
228 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
229 |         }
230 |       },
231 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
232 |       "trace_id": "24968a47-2031-4765-898e-69a65572f188",
233 |       "children": [
234 |         {
235 |           "info": {
236 |             "exception": "None",
237 |             "name": "wsgi",
238 |             "service": "public",
239 |             "started": 1329,
240 |             "meta.raw_payload.wsgi-stop": {
241 |               "info": {
242 |                 "host": "wally113"
243 |               },
244 |               "name": "wsgi-stop",
245 |               "service": "public",
246 |               "timestamp": "2019-11-18T12:19:06.491599",
247 |               "trace_id": "7967078c-ef88-420b-aca7-1e6fdf0837b6",
248 |               "project": "keystone",
249 |               "parent_id": "24968a47-2031-4765-898e-69a65572f188",
250 |               "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
251 |             },
252 |             "finished": 1445,
253 |             "project": "keystone",
254 |             "host": "wally113",
255 |             "meta.raw_payload.wsgi-start": {
256 |               "info": {
257 |                 "host": "wally113",
258 |                 "request": {
259 |                   "path": "/v3/auth/tokens",
260 |                   "scheme": "http",
261 |                   "method": "GET",
262 |                   "query": ""
263 |                 }
264 |               },
265 |               "name": "wsgi-start",
266 |               "service": "public",
267 |               "timestamp": "2019-11-18T12:19:06.375032",
268 |               "trace_id": "7967078c-ef88-420b-aca7-1e6fdf0837b6",
269 |               "project": "keystone",
270 |               "parent_id": "24968a47-2031-4765-898e-69a65572f188",
271 |               "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
272 |             }
273 |           },
274 |           "parent_id": "24968a47-2031-4765-898e-69a65572f188",
275 |           "trace_id": "7967078c-ef88-420b-aca7-1e6fdf0837b6",
276 |           "children": []
277 |         }
278 |       ]
279 |     },
280 |     {
281 |       "info": {
282 |         "exception": "None",
283 |         "name": "wsgi",
284 |         "service": "api",
285 |         "started": 1617,
286 |         "meta.raw_payload.wsgi-stop": {
287 |           "info": {
288 |             "host": "wally113"
289 |           },
290 |           "name": "wsgi-stop",
291 |           "service": "api",
292 |           "timestamp": "2019-11-18T12:19:06.815019",
293 |           "trace_id": "64395150-5826-43dd-95a5-88d615f80483",
294 |           "project": "glance",
295 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
296 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
297 |         },
298 |         "finished": 1769,
299 |         "project": "glance",
300 |         "host": "wally113",
301 |         "meta.raw_payload.wsgi-start": {
302 |           "info": {
303 |             "host": "wally113",
304 |             "request": {
305 |               "path": "/v2/images",
306 |               "scheme": "http",
307 |               "method": "POST",
308 |               "query": ""
309 |             }
310 |           },
311 |           "name": "wsgi-start",
312 |           "service": "api",
313 |           "timestamp": "2019-11-18T12:19:06.663114",
314 |           "trace_id": "64395150-5826-43dd-95a5-88d615f80483",
315 |           "project": "glance",
316 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
317 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
318 |         }
319 |       },
320 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
321 |       "trace_id": "64395150-5826-43dd-95a5-88d615f80483",
322 |       "children": []
323 |     },
324 |     {
325 |       "info": {
326 |         "exception": "None",
327 |         "name": "wsgi",
328 |         "service": "api",
329 |         "started": 3861,
330 |         "meta.raw_payload.wsgi-stop": {
331 |           "info": {
332 |             "host": "wally113"
333 |           },
334 |           "name": "wsgi-stop",
335 |           "service": "api",
336 |           "timestamp": "2019-11-18T12:19:08.976930",
337 |           "trace_id": "2420a5b6-9d3d-4a2c-a09c-f221038deb86",
338 |           "project": "glance",
339 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
340 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
341 |         },
342 |         "finished": 3931,
343 |         "project": "glance",
344 |         "host": "wally113",
345 |         "meta.raw_payload.wsgi-start": {
346 |           "info": {
347 |             "host": "wally113",
348 |             "request": {
349 |               "path": "/v2/images/985aa609-db14-4b4f-abd1-f1e1521237c7",
350 |               "scheme": "http",
351 |               "method": "GET",
352 |               "query": ""
353 |             }
354 |           },
355 |           "name": "wsgi-start",
356 |           "service": "api",
357 |           "timestamp": "2019-11-18T12:19:08.906980",
358 |           "trace_id": "2420a5b6-9d3d-4a2c-a09c-f221038deb86",
359 |           "project": "glance",
360 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
361 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
362 |         }
363 |       },
364 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
365 |       "trace_id": "2420a5b6-9d3d-4a2c-a09c-f221038deb86",
366 |       "children": []
367 |     },
368 |     {
369 |       "info": {
370 |         "exception": "None",
371 |         "name": "wsgi",
372 |         "service": "api",
373 |         "started": 4044,
374 |         "meta.raw_payload.wsgi-stop": {
375 |           "info": {
376 |             "host": "wally113"
377 |           },
378 |           "name": "wsgi-stop",
379 |           "service": "api",
380 |           "timestamp": "2019-11-18T12:19:09.189027",
381 |           "trace_id": "eb43c33e-6381-4df6-b76d-55df14695cf0",
382 |           "project": "glance",
383 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
384 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
385 |         },
386 |         "finished": 4143,
387 |         "project": "glance",
388 |         "host": "wally113",
389 |         "meta.raw_payload.wsgi-start": {
390 |           "info": {
391 |             "host": "wally113",
392 |             "request": {
393 |               "path": "/v2/schemas/image",
394 |               "scheme": "http",
395 |               "method": "GET",
396 |               "query": ""
397 |             }
398 |           },
399 |           "name": "wsgi-start",
400 |           "service": "api",
401 |           "timestamp": "2019-11-18T12:19:09.090110",
402 |           "trace_id": "eb43c33e-6381-4df6-b76d-55df14695cf0",
403 |           "project": "glance",
404 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
405 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
406 |         }
407 |       },
408 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
409 |       "trace_id": "eb43c33e-6381-4df6-b76d-55df14695cf0",
410 |       "children": []
411 |     },
412 |     {
413 |       "info": {
414 |         "exception": "None",
415 |         "name": "wsgi",
416 |         "service": "api",
417 |         "started": 4642,
418 |         "meta.raw_payload.wsgi-stop": {
419 |           "info": {
420 |             "host": "wally113"
421 |           },
422 |           "name": "wsgi-stop",
423 |           "service": "api",
424 |           "timestamp": "2019-11-18T12:19:13.407117",
425 |           "trace_id": "3ef6f663-e000-4b58-84f7-aeeb929e4dc3",
426 |           "project": "glance",
427 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
428 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
429 |         },
430 |         "finished": 8361,
431 |         "project": "glance",
432 |         "host": "wally113",
433 |         "meta.raw_payload.wsgi-start": {
434 |           "info": {
435 |             "host": "wally113",
436 |             "request": {
437 |               "path": "/v2/images/985aa609-db14-4b4f-abd1-f1e1521237c7/file",
438 |               "scheme": "http",
439 |               "method": "PUT",
440 |               "query": ""
441 |             }
442 |           },
443 |           "name": "wsgi-start",
444 |           "service": "api",
445 |           "timestamp": "2019-11-18T12:19:09.688067",
446 |           "trace_id": "3ef6f663-e000-4b58-84f7-aeeb929e4dc3",
447 |           "project": "glance",
448 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
449 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
450 |         }
451 |       },
452 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
453 |       "trace_id": "3ef6f663-e000-4b58-84f7-aeeb929e4dc3",
454 |       "children": []
455 |     },
456 |     {
457 |       "info": {
458 |         "exception": "None",
459 |         "name": "wsgi",
460 |         "service": "api",
461 |         "started": 8468,
462 |         "meta.raw_payload.wsgi-stop": {
463 |           "info": {
464 |             "host": "wally113"
465 |           },
466 |           "name": "wsgi-stop",
467 |           "service": "api",
468 |           "timestamp": "2019-11-18T12:19:13.652612",
469 |           "trace_id": "eb1ec797-7411-4a6e-97ef-33449a5537d3",
470 |           "project": "glance",
471 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
472 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
473 |         },
474 |         "finished": 8606,
475 |         "project": "glance",
476 |         "host": "wally113",
477 |         "meta.raw_payload.wsgi-start": {
478 |           "info": {
479 |             "host": "wally113",
480 |             "request": {
481 |               "path": "/v2/images/985aa609-db14-4b4f-abd1-f1e1521237c7",
482 |               "scheme": "http",
483 |               "method": "GET",
484 |               "query": ""
485 |             }
486 |           },
487 |           "name": "wsgi-start",
488 |           "service": "api",
489 |           "timestamp": "2019-11-18T12:19:13.513819",
490 |           "trace_id": "eb1ec797-7411-4a6e-97ef-33449a5537d3",
491 |           "project": "glance",
492 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
493 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
494 |         }
495 |       },
496 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
497 |       "trace_id": "eb1ec797-7411-4a6e-97ef-33449a5537d3",
498 |       "children": []
499 |     },
500 |     {
501 |       "info": {
502 |         "exception": "None",
503 |         "name": "wsgi",
504 |         "service": "api",
505 |         "started": 8727,
506 |         "meta.raw_payload.wsgi-stop": {
507 |           "info": {
508 |             "host": "wally113"
509 |           },
510 |           "name": "wsgi-stop",
511 |           "service": "api",
512 |           "timestamp": "2019-11-18T12:19:15.103720",
513 |           "trace_id": "4c6b7f84-4cd0-476a-beef-b11c77cc4033",
514 |           "project": "glance",
515 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
516 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
517 |         },
518 |         "finished": 10058,
519 |         "project": "glance",
520 |         "host": "wally113",
521 |         "meta.raw_payload.wsgi-start": {
522 |           "info": {
523 |             "host": "wally113",
524 |             "request": {
525 |               "path": "/v2/images/985aa609-db14-4b4f-abd1-f1e1521237c7",
526 |               "scheme": "http",
527 |               "method": "DELETE",
528 |               "query": ""
529 |             }
530 |           },
531 |           "name": "wsgi-start",
532 |           "service": "api",
533 |           "timestamp": "2019-11-18T12:19:13.773141",
534 |           "trace_id": "4c6b7f84-4cd0-476a-beef-b11c77cc4033",
535 |           "project": "glance",
536 |           "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
537 |           "base_id": "8f6ff588-fcb6-4983-883c-282f78922756"
538 |         }
539 |       },
540 |       "parent_id": "8f6ff588-fcb6-4983-883c-282f78922756",
541 |       "trace_id": "4c6b7f84-4cd0-476a-beef-b11c77cc4033",
542 |       "children": []
543 |     }
544 |   ]
545 | }


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/trace_ids_18th_nov:
--------------------------------------------------------------------------------
 1 | 9aa0efa3-07d0-489f-bcbf-509d3a8d7809
 2 | e2fff62c-d057-4ca2-a5c1-8ba016235e0d
 3 | 306a8c35-0260-4a91-a06c-294528697940
 4 | 91477cd0-1993-48fb-b624-b6eefdf5ff7b
 5 | 8acd2fde-389e-4ada-b47a-6544e4b5dba2
 6 | f94b1484-63fd-4756-a75b-795daf67a4e3
 7 | bd4a7570-ba05-4d4c-9eb8-2024a00055e2
 8 | 6b65c41f-4e6e-4a86-8db4-a33a4badc9c5
 9 | 985f9323-a509-4371-a7fa-33fae3aecfc1
10 | 57ecfcf7-4335-4856-af8f-d25b1f9dd922
11 | 1997f188-728e-4dd8-a7ef-d5057e27e31c
12 | fbcdc9c7-a8e2-4e65-8698-e7cb1e3c4f04
13 | d50058f8-a859-4900-9ed5-4ba65294f09d
14 | 9fa11480-a6eb-4793-a770-b77b1feb4a6d
15 | e36f581c-17f1-4610-9140-bb8272fb35fc
16 | dc0ad6c3-6294-4ccf-af77-063ce3d9ffcb
17 | fb5bef91-11eb-4957-8d48-3dc66e937cf9
18 | 900f7fc2-a913-40d2-90c9-5bc5778f2b3a
19 | f49ba9bc-bff2-4eae-a9db-02c860547296
20 | 3913e01b-6f0c-457b-b98d-f239b473c6c8
21 | 555f1899-e54f-4f7c-902f-c678c0aa3423
22 | 8f42a3c4-3854-4788-8af3-7fec8b92316d
23 | bc0684fd-46fb-44c7-a20d-80af9028a6d5
24 | 93a22503-7e89-46a0-a4e7-414320b59396
25 | e1166634-783d-43e2-b1e9-77cdee9b65ae
26 | f36afb65-65a7-40c8-8396-37a80022bb69
27 | 4d48a918-3255-4b0e-a765-eb83a878dfdc
28 | 29455f03-ba06-4e93-a282-d11bd6720427
29 | c2c841a4-eef0-41ae-b109-8522784c0579
30 | 78b77da7-9692-407e-9361-199980fb68c5
31 | fd64a7a8-5eff-4451-a78e-3d3b37de8e80
32 | ba108905-831d-4845-95bb-c5df85a66dba
33 | d1c9a800-4266-49d3-ba24-2c999362ee3d
34 | 8ec60d58-d9ba-4f3d-9717-316eea5d5436
35 | 4d4ad136-c886-4dff-b156-2e756828bd57
36 | f8164b69-c54b-44ba-9f92-da986d191215
37 | 212fe628-335d-4bf4-a385-2762f8dc1e1a
38 | 3d800598-6375-4a0a-8b9a-f1e25f7e4405
39 | 3abe020e-2469-4ac9-86f0-bb413631d740
40 | 87ad5b7f-a100-4ba1-a55e-ee0ed80489c9
41 | 


--------------------------------------------------------------------------------
/workloads/create_delete_image_config/traceids_jasmin.txt:
--------------------------------------------------------------------------------
 1 | ab34aad1-40b5-4ebf-bc1c-765750970524
 2 | 0513b6a0-bbaf-4732-aacb-1fca26f21e01
 3 | 87709321-5490-4a52-9e3d-33fdd12775a3
 4 | ec64ab98-3e73-4bd6-8254-7c2ab2fdba4a
 5 | 9bca023e-b83e-4ae9-91c9-e76a02584986
 6 | f6aaccd6-2d7c-401c-b17b-6b81b000e809
 7 | 90dc4a7e-89ea-4c3a-acee-452d4b338997
 8 | 27be13af-8093-4fa8-a2e0-802ae6eefe7c
 9 | 8e4a16b6-a621-4c00-9330-895ec70b441e
10 | 6af15627-b470-4d89-8b84-761ffa43fa15
11 | 828c129e-e8b3-48c9-a47b-a21bfbee9ccd
12 | 41e087fc-a6a1-4b24-b776-9ccda8032c89
13 | 7baf432c-d63e-4656-b21c-f0ed9192940d
14 | 8637da32-11bb-41fd-a560-13bb6084b793
15 | 0d1af073-ea1a-4a12-a4a6-c65cd2d98e2c
16 | e39a0b61-6fd1-4f72-adc7-85116b977db9
17 | 4eca4b60-35e8-4462-94f4-7cb03f2c9f1f
18 | cd249ced-0fb9-422c-8f63-c2ef5582fd40
19 | afcdc4bf-8164-4129-a796-f490e0d79c72
20 | 127ec9df-7148-4e4a-88bc-e687d265734b
21 | 


--------------------------------------------------------------------------------
/workloads/json_trace_ids.py:
--------------------------------------------------------------------------------
 1 | import json
 2 | import sys
 3 | print(sys.argv[1])
 4 | file_trace = sys.argv[1]#'create_delete_1.json'
 5 | with open(str(file_trace)) as trace_file:
 6 |     trace_json = json.load(trace_file)
 7 | 
 8 | # Trace IDs for create-delete list
 9 | for i in range(len(trace_json['tasks'][0]['subtasks'][0]['workloads'][0]['data'])):
10 |     print(trace_json['tasks'][0]['subtasks'][0]['workloads'][0]['data'][i]['output']['complete'][0]['data']['trace_id'])
11 | 
12 | 


--------------------------------------------------------------------------------
/workloads/keystone_auth.yaml:
--------------------------------------------------------------------------------
 1 | ---
 2 |   Authenticate.keystone:
 3 |     -
 4 |       runner:
 5 |         type: "constant_for_duration"
 6 |         duration: 40
 7 |         concurrency: 5
 8 |       context:
 9 |         users:
10 |           tenants: 1
11 |           users_per_tenant: 1
12 |       hooks:
13 |         -
14 |           name: fault_injection
15 |           args:
16 |             action: restart memcached container on wally113
17 |           trigger:
18 |             name: event
19 |             args:
20 |               unit: iteration
21 |               at: [10]
22 |         -
23 |           name: fault_injection
24 |           args:
25 |             action: restart nova-api container on wally113
26 |           trigger:
27 |             name: event
28 |             args:
29 |               unit: time
30 |               at: [30]
31 | 


--------------------------------------------------------------------------------
/workloads/network_create_delete_config/commands-to-exec-neutron.sh:
--------------------------------------------------------------------------------
 1 | #!/bin/bash -x
 2 | # Restarting neutron containers and sleep for 25 secs between start and stop
 3 | for i in {1}
 4 | do
 5 |     echo "Restarting neutron-containers"
 6 |     docker stop neutron_metadata_agent &
 7 |     docker stop neutron_l3_agent &
 8 |     docker stop neutron_dhcp_agent &
 9 |     docker stop neutron_openvswitch_agent &
10 |     docker stop neutron_openvswitch_agent &
11 |     docker stop neutron_server
12 |     sleep 0.1
13 |     docker start neutron_metadata_agent &
14 |     docker start neutron_l3_agent &
15 |     docker start neutron_dhcp_agent &
16 |     docker start neutron_openvswitch_agent &
17 |     docker start neutron_openvswitch_agent &
18 |     docker start neutron_server
19 | done
20 | 


--------------------------------------------------------------------------------
/workloads/network_create_delete_config/create-and-delete-networks.yaml:
--------------------------------------------------------------------------------
 1 | ---
 2 |   NeutronNetworks.create_and_delete_networks:
 3 |     -
 4 |       args:
 5 |         network_create_args: {}
 6 |       runner:
 7 |         type: "constant"
 8 |         times: 6000
 9 |         concurrency: 1
10 |       context:
11 |         users:
12 |           tenants: 3
13 |           users_per_tenant: 3
14 |         quotas:
15 |           neutron:
16 |             network: -1
17 |       sla:
18 |         failure_rate:
19 |           max: 100
20 |       hooks:
21 |         - name: sys_call
22 |           description: Run script
23 |           args: sh ./restart_neutron_container.sh
24 |           trigger:
25 |             name: event
26 |             args:
27 |               unit: iteration
28 |               at: [500,1000,1500,2000,2500,3000,3500,4000,4500,5000,5500,6000,6500,7000]
29 | 


--------------------------------------------------------------------------------
/workloads/network_create_delete_config/restart_neutron_container.sh:
--------------------------------------------------------------------------------
1 | #!/bin/bash +x
2 | 
3 | #SSH into Wally113 controller and execute commands from commands-to-exec-nova.sh
4 | 
5 | cat commands-to-exec-neutron.sh | sshpass -p 'rally' ssh rally@wally113.cit.tu-berlin.de
6 | 


--------------------------------------------------------------------------------
/workloads/os-faults-latest.yaml:
--------------------------------------------------------------------------------
  1 | cloud_management:
  2 |   driver: universal
  3 | node_discover:
  4 |   driver: node_list
  5 |   args:
  6 |     - ip: 130.149.249.123  # role: controller
  7 |       fqdn: wally113
  8 |       auth:
  9 |         username: rally
 10 |         private_key_file: /home/rally/.ssh/id_rsa
 11 |         become_password: rally
 12 |     - ip: 130.149.249.132  # role: compute
 13 |       fqdn: wally122
 14 |       auth:
 15 |         username: rally
 16 |         private_key_file: /home/rally/.ssh/id_rsa
 17 |         become_password: rally
 18 |     - ip: 130.149.249.134  # role: compute
 19 |       fqdn: wally124
 20 |       auth:
 21 |         username: rally
 22 |         private_key_file: /home/rally/.ssh/id_rsa
 23 |         become_password: rally
 24 |     - ip: 130.149.249.133  # role: compute
 25 |       fqdn: wally123
 26 |       auth:
 27 |         username: rally
 28 |         private_key_file: /home/rally/.ssh/id_rsa
 29 |         become_password: rally
 30 | 
 31 |     - ip: 130.149.249.127 # role: compute
 32 |       fqdn: wally117
 33 |       auth:
 34 |         username: rally
 35 |         private_key_file: /home/rally/.ssh/id_rsa
 36 |         become_password: rally
 37 | 
 38 | containers:
 39 |   cinder_api:
 40 |     driver: docker_container
 41 |     args:
 42 |       container_name: cinder_api
 43 |     hosts:
 44 |     - 130.149.249.123
 45 |   cinder_volume:
 46 |     driver: docker_container
 47 |     args:
 48 |       container_name: cinder_volume
 49 |     hosts:
 50 |     - 130.149.249.123
 51 |     - 130.149.249.132
 52 |     - 130.149.249.134
 53 |     - 130.149.249.133
 54 |     - 130.149.249.127
 55 |     
 56 |   glance_api:
 57 |     driver: docker_container
 58 |     args:
 59 |       container_name: glance_api
 60 |     hosts:
 61 |     - 130.149.249.123
 62 |   heat_api:
 63 |     driver: docker_container
 64 |     args:
 65 |       container_name: heat_api
 66 |     hosts:
 67 |     - 130.149.249.123
 68 |   heat_engine:
 69 |     driver: docker_container
 70 |     args:
 71 |       container_name: heat_engine
 72 |     hosts:
 73 |     - 130.149.249.123
 74 |   keystone:
 75 |     driver: docker_container
 76 |     args:
 77 |       container_name: keystone
 78 |     hosts:
 79 |     - 130.149.249.123
 80 |   memcached:
 81 |     driver: docker_container
 82 |     args:
 83 |       container_name: memcached
 84 |     hosts:
 85 |     - 130.149.249.123
 86 |   neutron_server:
 87 |     driver: docker_container
 88 |     args:
 89 |       container_name: neutron_server
 90 |     hosts:
 91 |     - 130.149.249.123
 92 |   neutron_dhcp_agent:
 93 |     driver: docker_container
 94 |     args:
 95 |       container_name: neutron_dhcp_agent
 96 |     hosts:
 97 |     - 130.149.249.123
 98 |   neutron_l3_agent:
 99 |     driver: docker_container
100 |     args:
101 |       container_name: neutron_l3_agent
102 |     hosts:
103 |     - 130.149.249.123
104 |   neutron_metadata_agent:
105 |     driver: docker_container
106 |     args:
107 |       container_name: neutron_metadata_agent
108 |     hosts:
109 |     - 130.149.249.123
110 |   neutron_openvswitch_agent:
111 |     driver: docker_container
112 |     args:
113 |       container_name: neutron_openvswitch_agent
114 |     hosts:
115 |     - 130.149.249.123
116 |     - 130.149.249.132
117 |     - 130.149.249.134
118 |     - 130.149.249.133
119 |     - 130.149.249.127
120 |     
121 |   nova_api:
122 |     driver: docker_container
123 |     args:
124 |       container_name: nova_api
125 |     hosts:
126 |     - 130.149.249.123
127 |   nova_compute:
128 |     driver: docker_container
129 |     args:
130 |       container_name: nova_compute
131 |     hosts:
132 |     - 130.149.249.132
133 |     - 130.149.249.134
134 |     - 130.149.249.133
135 |     - 130.149.249.127
136 |   nova_conductor:
137 |     driver: docker_container
138 |     args:
139 |       container_name: nova_conductor
140 |     hosts:
141 |     - 130.149.249.123
142 |   nova_scheduler:
143 |     driver: docker_container
144 |     args:
145 |       container_name: nova_scheduler
146 |     hosts:
147 |     - 130.149.249.123
148 |   ovsdb_server:
149 |     driver: docker_container
150 |     args:
151 |       container_name: openvswitch_db
152 |     hosts:
153 |     - 130.149.249.123
154 |     - 130.149.249.132
155 |     - 130.149.249.134
156 |     - 130.149.249.133
157 |     - 130.149.249.127
158 |   ovs_vswitchd:
159 |     driver: docker_container
160 |     args:
161 |       container_name: openvswitch_vswitchd
162 |     hosts:
163 |     - 130.149.249.123
164 |     - 130.149.249.132
165 |     - 130.149.249.134
166 |     - 130.149.249.133
167 |     - 130.149.249.127
168 |   rabbitmq:
169 |     driver: docker_container
170 |     args:
171 |       container_name: rabbitmq
172 |     hosts:
173 |     - 130.149.249.123
174 | 


--------------------------------------------------------------------------------