├── LICENSE
├── README.md
└── RapidMiner files
    ├── Decision_Tree.rmp
    ├── Random_Forest.rmp
    ├── Gradient_Boosted_Trees.rmp
    └── Deep_Learning.rmp


/LICENSE:
--------------------------------------------------------------------------------
 1 | MIT License
 2 | 
 3 | Copyright (c) 2022 Yogeshwaran Shanmuganathan
 4 | 
 5 | Permission is hereby granted, free of charge, to any person obtaining a copy
 6 | of this software and associated documentation files (the "Software"), to deal
 7 | in the Software without restriction, including without limitation the rights
 8 | to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
 9 | copies of the Software, and to permit persons to whom the Software is
10 | furnished to do so, subject to the following conditions:
11 | 
12 | The above copyright notice and this permission notice shall be included in all
13 | copies or substantial portions of the Software.
14 | 
15 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16 | IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17 | FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18 | AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19 | LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20 | OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21 | SOFTWARE.
22 | 


--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
 1 | # Airline-Passenger-Satisfaction
 2 | ## Objective
 3 | The objective or goal of this project is to guide an airlines company to determine the important factors that influences the customer or passenger satisfaction. <br/>
 4 | Customer satisfaction plays a major role in affecting the business of a company therefore analysing and improving the factors that are closely related to customer satisfaction is important for the growth and reputation of a company. <br/>
 5 | 
 6 | *In this project, the* ***CRISP-DM methodology*** *is implemented to derive an appropriate solution for a business problem. It is carried out in six phases - Business understanding, Data understanding, Data preparation, Data Modelling, Evaluation and Deployment.*
 7 | ## About Data
 8 | The dataset for this project is obtained from Kaggle which contains the data sourced from a survey conducted by airlines on the satisfaction level of passengers/customers based on various factors. The dataset consists of 25 columns such as Age, Gender, Travel class, Arrival and Departure delays and also features that influences customer satisfaction level such as On-board service, Cleanliness, Seat comfort, Baggage handling etc. <br/>
 9 | The dataset consists of a column or feature named ***‘satisfaction’*** which describes the overall satisfaction level of the customer. It has two values, ‘neutral or dissatisfied’ and ‘satisfied’. This ***satisfaction*** feature is considered as the label feature since it conveys the overall experience of the customer based on the ratings given for other features. The dataset consists of 103904 and 25976 records in train and test respectively.
10 | ## Data Cleaning and Visualisation
11 | Data cleaning plays a key role in deriving the output of a machine learning model. Usually data cleaning consists of processes like determining outliers and removing or imputing outliers, removing or replacing missing values, removing duplicate values, removing values with less or no importance. <br/>
12 | In this project, the *‘Arrival Delay in Minutes’* column has 310 missing values in it. These missing values are imputed with the mean values of the non-missing values of the same column. <br/>
13 | Data Visualisation plays an important role in understanding the data as it gives an overview of the data before the model implementation. Exploratory Data Analysis is done for the dataset.
14 | ## Feature Selection
15 | Correlation among the features are found by generating a correlation map. The top ten features are selected using Chi-Square method. The importance of features are determined using Wrapper method and feature permutation importance technique.
16 | ## Models
17 | Eight models are used in this project to check for maximum efficiency. They are,
18 | - Logistic Regression
19 | - Naive Bayes
20 | - KNN
21 | - Decision Tree
22 | - Neural Network
23 | - Random Forest
24 | - XGBoost
25 | - AdaBoost
26 | ## Conclusion
27 | Random Forest and AdaBoost have performed equally and produced high ROC_AUC score (~90%). But ***Random Forest*** took lesser amount of time compared to time taken by AdaBoost. Therefore, we can conclude that Random Forest as the best model. <br/>
28 | 
29 | 
30 | ###### ***Note: This was a part of my academic assignment for Data Mining module - M.Sc. in Data Analytics at Dublin Business School, Ireland.***
31 | 


--------------------------------------------------------------------------------
/RapidMiner files/Decision_Tree.rmp:
--------------------------------------------------------------------------------
  1 | <?xml version="1.0" encoding="UTF-8"?><process version="9.7.002">
  2 |   <context>
  3 |     <input/>
  4 |     <output/>
  5 |     <macros/>
  6 |   </context>
  7 |   <operator activated="true" class="process" compatibility="9.7.002" expanded="true" name="Process">
  8 |     <parameter key="logverbosity" value="init"/>
  9 |     <parameter key="random_seed" value="2001"/>
 10 |     <parameter key="send_mail" value="never"/>
 11 |     <parameter key="notification_email" value=""/>
 12 |     <parameter key="process_duration_for_mail" value="30"/>
 13 |     <parameter key="encoding" value="SYSTEM"/>
 14 |     <process expanded="true">
 15 |       <operator activated="true" class="retrieve" compatibility="9.7.002" expanded="true" height="68" name="Retrieve airline_passenger_satisfaction_dataset" width="90" x="45" y="34">
 16 |         <parameter key="repository_entry" value="../Data/airline_passenger_satisfaction_dataset"/>
 17 |       </operator>
 18 |       <operator activated="true" class="model_simulator:universal_missing_value_handling" compatibility="9.7.001" expanded="true" height="103" name="Replace All Missings" width="90" x="45" y="187">
 19 |         <parameter key="return_preprocessing_model" value="false"/>
 20 |         <parameter key="create_view" value="false"/>
 21 |         <parameter key="attribute_filter_type" value="single"/>
 22 |         <parameter key="attribute" value="Arrival Delay in Minutes"/>
 23 |         <parameter key="attributes" value=""/>
 24 |         <parameter key="use_except_expression" value="false"/>
 25 |         <parameter key="value_type" value="attribute_value"/>
 26 |         <parameter key="use_value_type_exception" value="false"/>
 27 |         <parameter key="except_value_type" value="time"/>
 28 |         <parameter key="block_type" value="attribute_block"/>
 29 |         <parameter key="use_block_type_exception" value="false"/>
 30 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 31 |         <parameter key="invert_selection" value="false"/>
 32 |         <parameter key="include_special_attributes" value="false"/>
 33 |       </operator>
 34 |       <operator activated="true" class="set_role" compatibility="9.7.002" expanded="true" height="82" name="Set Role" width="90" x="45" y="340">
 35 |         <parameter key="attribute_name" value="satisfaction"/>
 36 |         <parameter key="target_role" value="label"/>
 37 |         <list key="set_additional_roles"/>
 38 |       </operator>
 39 |       <operator activated="true" class="concurrency:correlation_matrix" compatibility="9.7.002" expanded="true" height="103" name="Correlation Matrix" width="90" x="179" y="340">
 40 |         <parameter key="attribute_filter_type" value="subset"/>
 41 |         <parameter key="attribute" value=""/>
 42 |         <parameter key="attributes" value="|Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 43 |         <parameter key="use_except_expression" value="false"/>
 44 |         <parameter key="value_type" value="attribute_value"/>
 45 |         <parameter key="use_value_type_exception" value="false"/>
 46 |         <parameter key="except_value_type" value="time"/>
 47 |         <parameter key="block_type" value="attribute_block"/>
 48 |         <parameter key="use_block_type_exception" value="false"/>
 49 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 50 |         <parameter key="invert_selection" value="false"/>
 51 |         <parameter key="include_special_attributes" value="false"/>
 52 |         <parameter key="normalize_weights" value="true"/>
 53 |         <parameter key="squared_correlation" value="false"/>
 54 |       </operator>
 55 |       <operator activated="true" class="select_by_weights" compatibility="9.7.002" expanded="true" height="103" name="Select by Weights" width="90" x="313" y="340">
 56 |         <parameter key="weight_relation" value="greater equals"/>
 57 |         <parameter key="weight" value="0.5"/>
 58 |         <parameter key="k" value="10"/>
 59 |         <parameter key="p" value="0.5"/>
 60 |         <parameter key="deselect_unknown" value="true"/>
 61 |         <parameter key="use_absolute_weights" value="true"/>
 62 |       </operator>
 63 |       <operator activated="true" class="select_attributes" compatibility="9.7.002" expanded="true" height="82" name="Select Attributes" width="90" x="313" y="136">
 64 |         <parameter key="attribute_filter_type" value="subset"/>
 65 |         <parameter key="attribute" value=""/>
 66 |         <parameter key="attributes" value="|Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 67 |         <parameter key="use_except_expression" value="false"/>
 68 |         <parameter key="value_type" value="attribute_value"/>
 69 |         <parameter key="use_value_type_exception" value="false"/>
 70 |         <parameter key="except_value_type" value="time"/>
 71 |         <parameter key="block_type" value="attribute_block"/>
 72 |         <parameter key="use_block_type_exception" value="false"/>
 73 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 74 |         <parameter key="invert_selection" value="false"/>
 75 |         <parameter key="include_special_attributes" value="false"/>
 76 |       </operator>
 77 |       <operator activated="true" class="split_data" compatibility="9.7.002" expanded="true" height="103" name="Split Data" width="90" x="447" y="238">
 78 |         <enumeration key="partitions">
 79 |           <parameter key="ratio" value="0.5"/>
 80 |           <parameter key="ratio" value="0.5"/>
 81 |         </enumeration>
 82 |         <parameter key="sampling_type" value="automatic"/>
 83 |         <parameter key="use_local_random_seed" value="false"/>
 84 |         <parameter key="local_random_seed" value="1992"/>
 85 |       </operator>
 86 |       <operator activated="true" class="concurrency:parallel_decision_tree" compatibility="9.7.002" expanded="true" height="103" name="Decision Tree" width="90" x="514" y="34">
 87 |         <parameter key="criterion" value="gain_ratio"/>
 88 |         <parameter key="maximal_depth" value="10"/>
 89 |         <parameter key="apply_pruning" value="true"/>
 90 |         <parameter key="confidence" value="0.1"/>
 91 |         <parameter key="apply_prepruning" value="true"/>
 92 |         <parameter key="minimal_gain" value="0.01"/>
 93 |         <parameter key="minimal_leaf_size" value="2"/>
 94 |         <parameter key="minimal_size_for_split" value="4"/>
 95 |         <parameter key="number_of_prepruning_alternatives" value="3"/>
 96 |       </operator>
 97 |       <operator activated="true" class="apply_model" compatibility="9.7.002" expanded="true" height="82" name="Apply Model" width="90" x="581" y="238">
 98 |         <list key="application_parameters"/>
 99 |         <parameter key="create_view" value="false"/>
100 |       </operator>
101 |       <operator activated="true" class="performance" compatibility="9.7.002" expanded="true" height="82" name="Performance" width="90" x="715" y="34">
102 |         <parameter key="use_example_weights" value="true"/>
103 |       </operator>
104 |       <connect from_op="Retrieve airline_passenger_satisfaction_dataset" from_port="output" to_op="Replace All Missings" to_port="example set input"/>
105 |       <connect from_op="Replace All Missings" from_port="example set output" to_op="Set Role" to_port="example set input"/>
106 |       <connect from_op="Set Role" from_port="example set output" to_op="Correlation Matrix" to_port="example set"/>
107 |       <connect from_op="Correlation Matrix" from_port="example set" to_op="Select by Weights" to_port="example set input"/>
108 |       <connect from_op="Correlation Matrix" from_port="weights" to_op="Select by Weights" to_port="weights"/>
109 |       <connect from_op="Select by Weights" from_port="example set output" to_op="Select Attributes" to_port="example set input"/>
110 |       <connect from_op="Select Attributes" from_port="example set output" to_op="Split Data" to_port="example set"/>
111 |       <connect from_op="Split Data" from_port="partition 1" to_op="Decision Tree" to_port="training set"/>
112 |       <connect from_op="Split Data" from_port="partition 2" to_op="Apply Model" to_port="unlabelled data"/>
113 |       <connect from_op="Decision Tree" from_port="model" to_op="Apply Model" to_port="model"/>
114 |       <connect from_op="Apply Model" from_port="labelled data" to_op="Performance" to_port="labelled data"/>
115 |       <connect from_op="Performance" from_port="performance" to_port="result 1"/>
116 |       <connect from_op="Performance" from_port="example set" to_port="result 2"/>
117 |       <portSpacing port="source_input 1" spacing="0"/>
118 |       <portSpacing port="sink_result 1" spacing="0"/>
119 |       <portSpacing port="sink_result 2" spacing="0"/>
120 |       <portSpacing port="sink_result 3" spacing="0"/>
121 |     </process>
122 |   </operator>
123 | </process>
124 | 


--------------------------------------------------------------------------------
/RapidMiner files/Random_Forest.rmp:
--------------------------------------------------------------------------------
  1 | <?xml version="1.0" encoding="UTF-8"?><process version="9.7.002">
  2 |   <context>
  3 |     <input/>
  4 |     <output/>
  5 |     <macros/>
  6 |   </context>
  7 |   <operator activated="true" class="process" compatibility="9.7.002" expanded="true" name="Process">
  8 |     <parameter key="logverbosity" value="init"/>
  9 |     <parameter key="random_seed" value="2001"/>
 10 |     <parameter key="send_mail" value="never"/>
 11 |     <parameter key="notification_email" value=""/>
 12 |     <parameter key="process_duration_for_mail" value="30"/>
 13 |     <parameter key="encoding" value="SYSTEM"/>
 14 |     <process expanded="true">
 15 |       <operator activated="true" class="retrieve" compatibility="9.7.002" expanded="true" height="68" name="Retrieve airline_passenger_satisfaction_dataset" width="90" x="45" y="34">
 16 |         <parameter key="repository_entry" value="../Data/airline_passenger_satisfaction_dataset"/>
 17 |       </operator>
 18 |       <operator activated="true" class="model_simulator:universal_missing_value_handling" compatibility="9.7.001" expanded="true" height="103" name="Replace All Missings" width="90" x="45" y="136">
 19 |         <parameter key="return_preprocessing_model" value="false"/>
 20 |         <parameter key="create_view" value="false"/>
 21 |         <parameter key="attribute_filter_type" value="single"/>
 22 |         <parameter key="attribute" value="Arrival Delay in Minutes"/>
 23 |         <parameter key="attributes" value="Arrival Delay in Minutes"/>
 24 |         <parameter key="use_except_expression" value="false"/>
 25 |         <parameter key="value_type" value="attribute_value"/>
 26 |         <parameter key="use_value_type_exception" value="false"/>
 27 |         <parameter key="except_value_type" value="time"/>
 28 |         <parameter key="block_type" value="attribute_block"/>
 29 |         <parameter key="use_block_type_exception" value="false"/>
 30 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 31 |         <parameter key="invert_selection" value="false"/>
 32 |         <parameter key="include_special_attributes" value="false"/>
 33 |       </operator>
 34 |       <operator activated="true" class="set_role" compatibility="9.7.002" expanded="true" height="82" name="Set Role" width="90" x="45" y="289">
 35 |         <parameter key="attribute_name" value="satisfaction"/>
 36 |         <parameter key="target_role" value="label"/>
 37 |         <list key="set_additional_roles"/>
 38 |       </operator>
 39 |       <operator activated="true" class="concurrency:correlation_matrix" compatibility="9.7.002" expanded="true" height="103" name="Correlation Matrix" width="90" x="179" y="289">
 40 |         <parameter key="attribute_filter_type" value="subset"/>
 41 |         <parameter key="attribute" value=""/>
 42 |         <parameter key="attributes" value="Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 43 |         <parameter key="use_except_expression" value="false"/>
 44 |         <parameter key="value_type" value="attribute_value"/>
 45 |         <parameter key="use_value_type_exception" value="false"/>
 46 |         <parameter key="except_value_type" value="time"/>
 47 |         <parameter key="block_type" value="attribute_block"/>
 48 |         <parameter key="use_block_type_exception" value="false"/>
 49 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 50 |         <parameter key="invert_selection" value="false"/>
 51 |         <parameter key="include_special_attributes" value="false"/>
 52 |         <parameter key="normalize_weights" value="true"/>
 53 |         <parameter key="squared_correlation" value="false"/>
 54 |       </operator>
 55 |       <operator activated="true" class="select_by_weights" compatibility="9.7.002" expanded="true" height="103" name="Select by Weights" width="90" x="313" y="289">
 56 |         <parameter key="weight_relation" value="greater equals"/>
 57 |         <parameter key="weight" value="0.5"/>
 58 |         <parameter key="k" value="10"/>
 59 |         <parameter key="p" value="0.5"/>
 60 |         <parameter key="deselect_unknown" value="true"/>
 61 |         <parameter key="use_absolute_weights" value="true"/>
 62 |       </operator>
 63 |       <operator activated="true" class="select_attributes" compatibility="9.7.002" expanded="true" height="82" name="Select Attributes" width="90" x="246" y="136">
 64 |         <parameter key="attribute_filter_type" value="subset"/>
 65 |         <parameter key="attribute" value=""/>
 66 |         <parameter key="attributes" value="|Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 67 |         <parameter key="use_except_expression" value="false"/>
 68 |         <parameter key="value_type" value="attribute_value"/>
 69 |         <parameter key="use_value_type_exception" value="false"/>
 70 |         <parameter key="except_value_type" value="time"/>
 71 |         <parameter key="block_type" value="attribute_block"/>
 72 |         <parameter key="use_block_type_exception" value="false"/>
 73 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 74 |         <parameter key="invert_selection" value="false"/>
 75 |         <parameter key="include_special_attributes" value="false"/>
 76 |       </operator>
 77 |       <operator activated="true" class="split_data" compatibility="9.7.002" expanded="true" height="103" name="Split Data" width="90" x="447" y="238">
 78 |         <enumeration key="partitions">
 79 |           <parameter key="ratio" value="0.5"/>
 80 |           <parameter key="ratio" value="0.5"/>
 81 |         </enumeration>
 82 |         <parameter key="sampling_type" value="automatic"/>
 83 |         <parameter key="use_local_random_seed" value="false"/>
 84 |         <parameter key="local_random_seed" value="1992"/>
 85 |       </operator>
 86 |       <operator activated="true" class="concurrency:parallel_random_forest" compatibility="9.7.002" expanded="true" height="103" name="Random Forest" width="90" x="514" y="34">
 87 |         <parameter key="number_of_trees" value="400"/>
 88 |         <parameter key="criterion" value="gain_ratio"/>
 89 |         <parameter key="maximal_depth" value="40"/>
 90 |         <parameter key="apply_pruning" value="false"/>
 91 |         <parameter key="confidence" value="0.1"/>
 92 |         <parameter key="apply_prepruning" value="false"/>
 93 |         <parameter key="minimal_gain" value="0.01"/>
 94 |         <parameter key="minimal_leaf_size" value="2"/>
 95 |         <parameter key="minimal_size_for_split" value="4"/>
 96 |         <parameter key="number_of_prepruning_alternatives" value="3"/>
 97 |         <parameter key="random_splits" value="false"/>
 98 |         <parameter key="guess_subset_ratio" value="true"/>
 99 |         <parameter key="subset_ratio" value="0.2"/>
100 |         <parameter key="voting_strategy" value="confidence vote"/>
101 |         <parameter key="use_local_random_seed" value="false"/>
102 |         <parameter key="local_random_seed" value="1992"/>
103 |         <parameter key="enable_parallel_execution" value="true"/>
104 |       </operator>
105 |       <operator activated="true" class="apply_model" compatibility="9.7.002" expanded="true" height="82" name="Apply Model" width="90" x="581" y="238">
106 |         <list key="application_parameters"/>
107 |         <parameter key="create_view" value="false"/>
108 |       </operator>
109 |       <operator activated="true" class="performance" compatibility="9.7.002" expanded="true" height="82" name="Performance" width="90" x="715" y="34">
110 |         <parameter key="use_example_weights" value="true"/>
111 |       </operator>
112 |       <connect from_op="Retrieve airline_passenger_satisfaction_dataset" from_port="output" to_op="Replace All Missings" to_port="example set input"/>
113 |       <connect from_op="Replace All Missings" from_port="example set output" to_op="Set Role" to_port="example set input"/>
114 |       <connect from_op="Set Role" from_port="example set output" to_op="Correlation Matrix" to_port="example set"/>
115 |       <connect from_op="Correlation Matrix" from_port="example set" to_op="Select by Weights" to_port="example set input"/>
116 |       <connect from_op="Correlation Matrix" from_port="weights" to_op="Select by Weights" to_port="weights"/>
117 |       <connect from_op="Select by Weights" from_port="example set output" to_op="Select Attributes" to_port="example set input"/>
118 |       <connect from_op="Select Attributes" from_port="example set output" to_op="Split Data" to_port="example set"/>
119 |       <connect from_op="Split Data" from_port="partition 1" to_op="Random Forest" to_port="training set"/>
120 |       <connect from_op="Split Data" from_port="partition 2" to_op="Apply Model" to_port="unlabelled data"/>
121 |       <connect from_op="Random Forest" from_port="model" to_op="Apply Model" to_port="model"/>
122 |       <connect from_op="Apply Model" from_port="labelled data" to_op="Performance" to_port="labelled data"/>
123 |       <connect from_op="Performance" from_port="performance" to_port="result 1"/>
124 |       <connect from_op="Performance" from_port="example set" to_port="result 2"/>
125 |       <portSpacing port="source_input 1" spacing="0"/>
126 |       <portSpacing port="sink_result 1" spacing="0"/>
127 |       <portSpacing port="sink_result 2" spacing="0"/>
128 |       <portSpacing port="sink_result 3" spacing="0"/>
129 |     </process>
130 |   </operator>
131 | </process>
132 | 


--------------------------------------------------------------------------------
/RapidMiner files/Gradient_Boosted_Trees.rmp:
--------------------------------------------------------------------------------
  1 | <?xml version="1.0" encoding="UTF-8"?><process version="9.7.002">
  2 |   <context>
  3 |     <input/>
  4 |     <output/>
  5 |     <macros/>
  6 |   </context>
  7 |   <operator activated="true" class="process" compatibility="9.7.002" expanded="true" name="Process">
  8 |     <parameter key="logverbosity" value="init"/>
  9 |     <parameter key="random_seed" value="2001"/>
 10 |     <parameter key="send_mail" value="never"/>
 11 |     <parameter key="notification_email" value=""/>
 12 |     <parameter key="process_duration_for_mail" value="30"/>
 13 |     <parameter key="encoding" value="SYSTEM"/>
 14 |     <process expanded="true">
 15 |       <operator activated="true" class="retrieve" compatibility="9.7.002" expanded="true" height="68" name="Retrieve airline_passenger_satisfaction_dataset" width="90" x="45" y="34">
 16 |         <parameter key="repository_entry" value="../Data/airline_passenger_satisfaction_dataset"/>
 17 |       </operator>
 18 |       <operator activated="true" class="model_simulator:universal_missing_value_handling" compatibility="9.7.001" expanded="true" height="103" name="Replace All Missings" width="90" x="45" y="136">
 19 |         <parameter key="return_preprocessing_model" value="false"/>
 20 |         <parameter key="create_view" value="false"/>
 21 |         <parameter key="attribute_filter_type" value="single"/>
 22 |         <parameter key="attribute" value="Arrival Delay in Minutes"/>
 23 |         <parameter key="attributes" value=""/>
 24 |         <parameter key="use_except_expression" value="false"/>
 25 |         <parameter key="value_type" value="attribute_value"/>
 26 |         <parameter key="use_value_type_exception" value="false"/>
 27 |         <parameter key="except_value_type" value="time"/>
 28 |         <parameter key="block_type" value="attribute_block"/>
 29 |         <parameter key="use_block_type_exception" value="false"/>
 30 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 31 |         <parameter key="invert_selection" value="false"/>
 32 |         <parameter key="include_special_attributes" value="false"/>
 33 |       </operator>
 34 |       <operator activated="true" class="set_role" compatibility="9.7.002" expanded="true" height="82" name="Set Role" width="90" x="45" y="289">
 35 |         <parameter key="attribute_name" value="satisfaction"/>
 36 |         <parameter key="target_role" value="label"/>
 37 |         <list key="set_additional_roles"/>
 38 |       </operator>
 39 |       <operator activated="true" class="concurrency:correlation_matrix" compatibility="9.7.002" expanded="true" height="103" name="Correlation Matrix" width="90" x="179" y="289">
 40 |         <parameter key="attribute_filter_type" value="subset"/>
 41 |         <parameter key="attribute" value=""/>
 42 |         <parameter key="attributes" value="Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 43 |         <parameter key="use_except_expression" value="false"/>
 44 |         <parameter key="value_type" value="attribute_value"/>
 45 |         <parameter key="use_value_type_exception" value="false"/>
 46 |         <parameter key="except_value_type" value="time"/>
 47 |         <parameter key="block_type" value="attribute_block"/>
 48 |         <parameter key="use_block_type_exception" value="false"/>
 49 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 50 |         <parameter key="invert_selection" value="false"/>
 51 |         <parameter key="include_special_attributes" value="false"/>
 52 |         <parameter key="normalize_weights" value="true"/>
 53 |         <parameter key="squared_correlation" value="false"/>
 54 |       </operator>
 55 |       <operator activated="true" class="select_by_weights" compatibility="9.7.002" expanded="true" height="103" name="Select by Weights" width="90" x="313" y="289">
 56 |         <parameter key="weight_relation" value="greater equals"/>
 57 |         <parameter key="weight" value="0.5"/>
 58 |         <parameter key="k" value="10"/>
 59 |         <parameter key="p" value="0.5"/>
 60 |         <parameter key="deselect_unknown" value="true"/>
 61 |         <parameter key="use_absolute_weights" value="true"/>
 62 |       </operator>
 63 |       <operator activated="true" class="select_attributes" compatibility="9.7.002" expanded="true" height="82" name="Select Attributes" width="90" x="313" y="136">
 64 |         <parameter key="attribute_filter_type" value="subset"/>
 65 |         <parameter key="attribute" value=""/>
 66 |         <parameter key="attributes" value="Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 67 |         <parameter key="use_except_expression" value="false"/>
 68 |         <parameter key="value_type" value="attribute_value"/>
 69 |         <parameter key="use_value_type_exception" value="false"/>
 70 |         <parameter key="except_value_type" value="time"/>
 71 |         <parameter key="block_type" value="attribute_block"/>
 72 |         <parameter key="use_block_type_exception" value="false"/>
 73 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 74 |         <parameter key="invert_selection" value="false"/>
 75 |         <parameter key="include_special_attributes" value="false"/>
 76 |       </operator>
 77 |       <operator activated="true" class="split_data" compatibility="9.7.002" expanded="true" height="103" name="Split Data" width="90" x="447" y="238">
 78 |         <enumeration key="partitions">
 79 |           <parameter key="ratio" value="0.5"/>
 80 |           <parameter key="ratio" value="0.5"/>
 81 |         </enumeration>
 82 |         <parameter key="sampling_type" value="automatic"/>
 83 |         <parameter key="use_local_random_seed" value="false"/>
 84 |         <parameter key="local_random_seed" value="1992"/>
 85 |       </operator>
 86 |       <operator activated="true" class="h2o:gradient_boosted_trees" compatibility="9.7.001" expanded="true" height="103" name="Gradient Boosted Trees" width="90" x="514" y="34">
 87 |         <parameter key="number_of_trees" value="800"/>
 88 |         <parameter key="reproducible" value="false"/>
 89 |         <parameter key="maximum_number_of_threads" value="4"/>
 90 |         <parameter key="use_local_random_seed" value="false"/>
 91 |         <parameter key="local_random_seed" value="1992"/>
 92 |         <parameter key="maximal_depth" value="8"/>
 93 |         <parameter key="min_rows" value="10.0"/>
 94 |         <parameter key="min_split_improvement" value="1.0E-5"/>
 95 |         <parameter key="number_of_bins" value="20"/>
 96 |         <parameter key="learning_rate" value="0.1"/>
 97 |         <parameter key="sample_rate" value="1.0"/>
 98 |         <parameter key="distribution" value="AUTO"/>
 99 |         <parameter key="early_stopping" value="false"/>
100 |         <parameter key="stopping_rounds" value="1"/>
101 |         <parameter key="stopping_metric" value="AUTO"/>
102 |         <parameter key="stopping_tolerance" value="0.001"/>
103 |         <list key="monotone_constraints"/>
104 |         <parameter key="max_runtime_seconds" value="0"/>
105 |         <list key="expert_parameters"/>
106 |       </operator>
107 |       <operator activated="true" class="apply_model" compatibility="9.7.002" expanded="true" height="82" name="Apply Model" width="90" x="581" y="238">
108 |         <list key="application_parameters"/>
109 |         <parameter key="create_view" value="false"/>
110 |       </operator>
111 |       <operator activated="true" class="performance" compatibility="9.7.002" expanded="true" height="82" name="Performance" width="90" x="715" y="34">
112 |         <parameter key="use_example_weights" value="true"/>
113 |       </operator>
114 |       <connect from_op="Retrieve airline_passenger_satisfaction_dataset" from_port="output" to_op="Replace All Missings" to_port="example set input"/>
115 |       <connect from_op="Replace All Missings" from_port="example set output" to_op="Set Role" to_port="example set input"/>
116 |       <connect from_op="Set Role" from_port="example set output" to_op="Correlation Matrix" to_port="example set"/>
117 |       <connect from_op="Correlation Matrix" from_port="example set" to_op="Select by Weights" to_port="example set input"/>
118 |       <connect from_op="Correlation Matrix" from_port="weights" to_op="Select by Weights" to_port="weights"/>
119 |       <connect from_op="Select by Weights" from_port="example set output" to_op="Select Attributes" to_port="example set input"/>
120 |       <connect from_op="Select Attributes" from_port="example set output" to_op="Split Data" to_port="example set"/>
121 |       <connect from_op="Split Data" from_port="partition 1" to_op="Gradient Boosted Trees" to_port="training set"/>
122 |       <connect from_op="Split Data" from_port="partition 2" to_op="Apply Model" to_port="unlabelled data"/>
123 |       <connect from_op="Gradient Boosted Trees" from_port="model" to_op="Apply Model" to_port="model"/>
124 |       <connect from_op="Apply Model" from_port="labelled data" to_op="Performance" to_port="labelled data"/>
125 |       <connect from_op="Performance" from_port="performance" to_port="result 1"/>
126 |       <connect from_op="Performance" from_port="example set" to_port="result 2"/>
127 |       <portSpacing port="source_input 1" spacing="0"/>
128 |       <portSpacing port="sink_result 1" spacing="0"/>
129 |       <portSpacing port="sink_result 2" spacing="0"/>
130 |       <portSpacing port="sink_result 3" spacing="0"/>
131 |     </process>
132 |   </operator>
133 | </process>
134 | 


--------------------------------------------------------------------------------
/RapidMiner files/Deep_Learning.rmp:
--------------------------------------------------------------------------------
  1 | <?xml version="1.0" encoding="UTF-8"?><process version="9.7.002">
  2 |   <context>
  3 |     <input/>
  4 |     <output/>
  5 |     <macros/>
  6 |   </context>
  7 |   <operator activated="true" class="process" compatibility="9.7.002" expanded="true" name="Process">
  8 |     <parameter key="logverbosity" value="init"/>
  9 |     <parameter key="random_seed" value="2001"/>
 10 |     <parameter key="send_mail" value="never"/>
 11 |     <parameter key="notification_email" value=""/>
 12 |     <parameter key="process_duration_for_mail" value="30"/>
 13 |     <parameter key="encoding" value="SYSTEM"/>
 14 |     <process expanded="true">
 15 |       <operator activated="true" class="retrieve" compatibility="9.7.002" expanded="true" height="68" name="Retrieve airline_passenger_satisfaction_dataset" width="90" x="45" y="34">
 16 |         <parameter key="repository_entry" value="../Data/airline_passenger_satisfaction_dataset"/>
 17 |       </operator>
 18 |       <operator activated="true" class="model_simulator:universal_missing_value_handling" compatibility="9.7.001" expanded="true" height="103" name="Replace All Missings" width="90" x="45" y="136">
 19 |         <parameter key="return_preprocessing_model" value="false"/>
 20 |         <parameter key="create_view" value="false"/>
 21 |         <parameter key="attribute_filter_type" value="single"/>
 22 |         <parameter key="attribute" value="Arrival Delay in Minutes"/>
 23 |         <parameter key="attributes" value=""/>
 24 |         <parameter key="use_except_expression" value="false"/>
 25 |         <parameter key="value_type" value="attribute_value"/>
 26 |         <parameter key="use_value_type_exception" value="false"/>
 27 |         <parameter key="except_value_type" value="time"/>
 28 |         <parameter key="block_type" value="attribute_block"/>
 29 |         <parameter key="use_block_type_exception" value="false"/>
 30 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 31 |         <parameter key="invert_selection" value="false"/>
 32 |         <parameter key="include_special_attributes" value="false"/>
 33 |       </operator>
 34 |       <operator activated="true" class="set_role" compatibility="9.7.002" expanded="true" height="82" name="Set Role" width="90" x="45" y="340">
 35 |         <parameter key="attribute_name" value="satisfaction"/>
 36 |         <parameter key="target_role" value="label"/>
 37 |         <list key="set_additional_roles"/>
 38 |       </operator>
 39 |       <operator activated="true" class="concurrency:correlation_matrix" compatibility="9.7.002" expanded="true" height="103" name="Correlation Matrix" width="90" x="179" y="340">
 40 |         <parameter key="attribute_filter_type" value="subset"/>
 41 |         <parameter key="attribute" value=""/>
 42 |         <parameter key="attributes" value="|Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 43 |         <parameter key="use_except_expression" value="false"/>
 44 |         <parameter key="value_type" value="attribute_value"/>
 45 |         <parameter key="use_value_type_exception" value="false"/>
 46 |         <parameter key="except_value_type" value="time"/>
 47 |         <parameter key="block_type" value="attribute_block"/>
 48 |         <parameter key="use_block_type_exception" value="false"/>
 49 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 50 |         <parameter key="invert_selection" value="false"/>
 51 |         <parameter key="include_special_attributes" value="false"/>
 52 |         <parameter key="normalize_weights" value="true"/>
 53 |         <parameter key="squared_correlation" value="false"/>
 54 |       </operator>
 55 |       <operator activated="true" class="select_by_weights" compatibility="9.7.002" expanded="true" height="103" name="Select by Weights" width="90" x="313" y="340">
 56 |         <parameter key="weight_relation" value="greater equals"/>
 57 |         <parameter key="weight" value="0.5"/>
 58 |         <parameter key="k" value="10"/>
 59 |         <parameter key="p" value="0.5"/>
 60 |         <parameter key="deselect_unknown" value="true"/>
 61 |         <parameter key="use_absolute_weights" value="true"/>
 62 |       </operator>
 63 |       <operator activated="true" class="select_attributes" compatibility="9.7.002" expanded="true" height="82" name="Select Attributes" width="90" x="313" y="187">
 64 |         <parameter key="attribute_filter_type" value="subset"/>
 65 |         <parameter key="attribute" value=""/>
 66 |         <parameter key="attributes" value="Age|Arrival Delay in Minutes|Baggage handling|Checkin service|Class|Cleanliness|Customer Type|Departure Delay in Minutes|Departure/Arrival time convenient|Ease of Online booking|Flight Distance|Food and drink|Gender|Inflight entertainment|Inflight service|Inflight wifi service|Leg room service|On-board service|Online boarding|satisfaction|Seat comfort|Type of Travel"/>
 67 |         <parameter key="use_except_expression" value="false"/>
 68 |         <parameter key="value_type" value="attribute_value"/>
 69 |         <parameter key="use_value_type_exception" value="false"/>
 70 |         <parameter key="except_value_type" value="time"/>
 71 |         <parameter key="block_type" value="attribute_block"/>
 72 |         <parameter key="use_block_type_exception" value="false"/>
 73 |         <parameter key="except_block_type" value="value_matrix_row_start"/>
 74 |         <parameter key="invert_selection" value="false"/>
 75 |         <parameter key="include_special_attributes" value="false"/>
 76 |       </operator>
 77 |       <operator activated="true" class="split_data" compatibility="9.7.002" expanded="true" height="103" name="Split Data" width="90" x="447" y="238">
 78 |         <enumeration key="partitions">
 79 |           <parameter key="ratio" value="0.5"/>
 80 |           <parameter key="ratio" value="0.5"/>
 81 |         </enumeration>
 82 |         <parameter key="sampling_type" value="automatic"/>
 83 |         <parameter key="use_local_random_seed" value="false"/>
 84 |         <parameter key="local_random_seed" value="1992"/>
 85 |       </operator>
 86 |       <operator activated="true" class="h2o:deep_learning" compatibility="9.7.001" expanded="true" height="103" name="Deep Learning" width="90" x="514" y="34">
 87 |         <parameter key="activation" value="Rectifier"/>
 88 |         <enumeration key="hidden_layer_sizes">
 89 |           <parameter key="hidden_layer_sizes" value="50"/>
 90 |           <parameter key="hidden_layer_sizes" value="50"/>
 91 |         </enumeration>
 92 |         <enumeration key="hidden_dropout_ratios"/>
 93 |         <parameter key="reproducible_(uses_1_thread)" value="false"/>
 94 |         <parameter key="use_local_random_seed" value="false"/>
 95 |         <parameter key="local_random_seed" value="1992"/>
 96 |         <parameter key="epochs" value="10.0"/>
 97 |         <parameter key="compute_variable_importances" value="false"/>
 98 |         <parameter key="train_samples_per_iteration" value="-2"/>
 99 |         <parameter key="adaptive_rate" value="true"/>
100 |         <parameter key="epsilon" value="1.0E-8"/>
101 |         <parameter key="rho" value="0.99"/>
102 |         <parameter key="learning_rate" value="0.005"/>
103 |         <parameter key="learning_rate_annealing" value="1.0E-6"/>
104 |         <parameter key="learning_rate_decay" value="1.0"/>
105 |         <parameter key="momentum_start" value="0.0"/>
106 |         <parameter key="momentum_ramp" value="1000000.0"/>
107 |         <parameter key="momentum_stable" value="0.0"/>
108 |         <parameter key="nesterov_accelerated_gradient" value="true"/>
109 |         <parameter key="standardize" value="true"/>
110 |         <parameter key="L1" value="1.0E-5"/>
111 |         <parameter key="L2" value="0.0"/>
112 |         <parameter key="max_w2" value="10.0"/>
113 |         <parameter key="loss_function" value="Automatic"/>
114 |         <parameter key="distribution_function" value="AUTO"/>
115 |         <parameter key="early_stopping" value="false"/>
116 |         <parameter key="stopping_rounds" value="1"/>
117 |         <parameter key="stopping_metric" value="AUTO"/>
118 |         <parameter key="stopping_tolerance" value="0.001"/>
119 |         <parameter key="missing_values_handling" value="MeanImputation"/>
120 |         <parameter key="max_runtime_seconds" value="0"/>
121 |         <list key="expert_parameters"/>
122 |         <list key="expert_parameters_"/>
123 |       </operator>
124 |       <operator activated="true" class="apply_model" compatibility="9.7.002" expanded="true" height="82" name="Apply Model" width="90" x="581" y="238">
125 |         <list key="application_parameters"/>
126 |         <parameter key="create_view" value="false"/>
127 |       </operator>
128 |       <operator activated="true" class="performance" compatibility="9.7.002" expanded="true" height="82" name="Performance" width="90" x="648" y="85">
129 |         <parameter key="use_example_weights" value="true"/>
130 |       </operator>
131 |       <connect from_op="Retrieve airline_passenger_satisfaction_dataset" from_port="output" to_op="Replace All Missings" to_port="example set input"/>
132 |       <connect from_op="Replace All Missings" from_port="example set output" to_op="Set Role" to_port="example set input"/>
133 |       <connect from_op="Set Role" from_port="example set output" to_op="Correlation Matrix" to_port="example set"/>
134 |       <connect from_op="Correlation Matrix" from_port="example set" to_op="Select by Weights" to_port="example set input"/>
135 |       <connect from_op="Correlation Matrix" from_port="weights" to_op="Select by Weights" to_port="weights"/>
136 |       <connect from_op="Select by Weights" from_port="example set output" to_op="Select Attributes" to_port="example set input"/>
137 |       <connect from_op="Select Attributes" from_port="example set output" to_op="Split Data" to_port="example set"/>
138 |       <connect from_op="Split Data" from_port="partition 1" to_op="Deep Learning" to_port="training set"/>
139 |       <connect from_op="Split Data" from_port="partition 2" to_op="Apply Model" to_port="unlabelled data"/>
140 |       <connect from_op="Deep Learning" from_port="model" to_op="Apply Model" to_port="model"/>
141 |       <connect from_op="Apply Model" from_port="labelled data" to_op="Performance" to_port="labelled data"/>
142 |       <connect from_op="Performance" from_port="performance" to_port="result 1"/>
143 |       <connect from_op="Performance" from_port="example set" to_port="result 2"/>
144 |       <portSpacing port="source_input 1" spacing="0"/>
145 |       <portSpacing port="sink_result 1" spacing="0"/>
146 |       <portSpacing port="sink_result 2" spacing="0"/>
147 |       <portSpacing port="sink_result 3" spacing="0"/>
148 |     </process>
149 |   </operator>
150 | </process>
151 | 


--------------------------------------------------------------------------------