├── general.sh
├── commonsense_ability_test
    ├── clean.py
    └── ca.txt
├── robust.sh
├── README.md
├── extract.py
├── sentence_scoring.py
├── making_sense.py
├── Robust_commonsense_test
    ├── sub.txt
    ├── swap.txt
    ├── del.txt
    └── add.txt
└── LICENSE


/general.sh:
--------------------------------------------------------------------------------
1 | python making_sense.py sm nr
2 | python making_sense.py wsc nr
3 | python making_sense.py ca nr
4 | python making_sense.py swag nr
5 | python making_sense.py smr nr
6 | python making_sense.py hella_swag nr
7 | python making_sense.py arct_1 nr 
8 | python making_sense.py arct_2 nr


--------------------------------------------------------------------------------
/commonsense_ability_test/clean.py:
--------------------------------------------------------------------------------
 1 | import random
 2 | with open("wsc.txt", "r") as f:
 3 |     file = f.readlines()
 4 | num = len(file)
 5 | 
 6 | t_dic = {'A':0, 'B':1, 'C':2}
 7 | 
 8 | with open("wsc_test.txt", "w") as f:
 9 |     for i in file:
10 |         label, sentence_1, sentence_2 = i.split("\001")
11 |         label = t_dic[label]
12 |         f.write('{}'.format(label)+'\001'+sentence_1+'\001'+sentence_2)
13 | 
14 |         #label = 0
15 |         '''
16 |         label = random.randint(0, 1)
17 |         if label==0:
18 |             f.write('{}'.format(label)+'\001'+sentence_1.strip()+'\001'+sentence_2)
19 |         else:
20 |             f.write('{}'.format(label)+'\001'+sentence_2.strip()+'\001'+sentence_1+'\n')
21 |         '''
22 | 
23 | 
24 | 


--------------------------------------------------------------------------------
/robust.sh:
--------------------------------------------------------------------------------
 1 | python making_sense.py add gpt r
 2 | python making_sense.py del gpt r
 3 | python making_sense.py sub gpt r
 4 | python making_sense.py swap gpt r
 5 | python making_sense.py add gpt-2 r
 6 | python making_sense.py del gpt-2 r
 7 | python making_sense.py sub gpt-2 r
 8 | python making_sense.py swap gpt-2 r
 9 | python making_sense.py add bert r
10 | python making_sense.py del bert r
11 | python making_sense.py sub bert r
12 | python making_sense.py swap bert r
13 | python making_sense.py add roberta r
14 | python making_sense.py del roberta r
15 | python making_sense.py sub roberta r
16 | python making_sense.py swap roberta r
17 | python making_sense.py add xlnet r
18 | python making_sense.py del xlnet r
19 | python making_sense.py sub xlnet r
20 | python making_sense.py swap xlnet r
21 | 


--------------------------------------------------------------------------------
/README.md:
--------------------------------------------------------------------------------
 1 | # CATS
 2 | 
 3 | Commonsense Ability Tests
 4 | 
 5 | Dataset and script for paper [Evaluating Commonsense in Pre-trained Language Models](https://arxiv.org/abs/1911.11931)
 6 | 
 7 | Use `making_sense.py` to run the experiments:\
 8 | For ordinary tests:\
 9 | `python making_sense.py ca bert nr` 
10 | 
11 | For robust tests:\
12 | `python making_sense.py ca bert r`
13 | 
14 | Note that `ca` is the name of the task and `bert` is the model we are using. The default model is `bert-base-uncased`. To use `bert-large`, just modify the `from_pretrained('bert-base-uncased')` in the code. For more details, see [Huggingface Transformers](https://huggingface.co/transformers/index.html).
15 | 
16 | *Due to the updating of Huggingface scripts and some of our datasets, some numbers we showed in the paper may not exactly match the what you might get by rerunning the experiments. However, the conclusion should be the same.*   
17 | 


--------------------------------------------------------------------------------
/extract.py:
--------------------------------------------------------------------------------
 1 | import csv
 2 | data_2 = []
 3 | data_3 = []
 4 | with open('aug_arct.csv', 'r') as fp:
 5 |     reader = csv.reader(fp, delimiter=',', quotechar='"')
 6 |     for row in reader:
 7 |         try:
 8 |             print(row[-1])
 9 |             if int(row[-1])==3:
10 |                 data_3.append([row[0],row[1], row[2], row[5], row[6], row[7]])
11 |             elif int(row[-1])==2:
12 |                 data_2.append([row[0],row[1], row[2], row[5], row[6], row[7]])
13 |         except:
14 |             pass
15 | 
16 | print(data_3[1])       
17 | with open('aug_swap.txt', 'w') as f:
18 |     for i in data_3:
19 |         line = '{}'.format(i[0])+'\001'+i[1]+'\001'+i[2]+'\001'+'{}'.format(i[3])\
20 |                 +'\001'+i[4]+'\001'+i[5]+'\n'
21 |         f.write(line)
22 | 
23 | with open('aug_sub.txt', 'w') as f:
24 |     for i in data_2:
25 |         line = '{}'.format(i[0])+'\001'+i[1]+'\001'+i[2]+'\001'+'{}'.format(i[3])\
26 |                 +'\001'+i[4]+'\001'+i[5]+'\n'
27 |         f.write(line)
28 | 
29 | 


--------------------------------------------------------------------------------
/sentence_scoring.py:
--------------------------------------------------------------------------------
  1 | import torch
  2 | from pytorch_pretrained_bert import BertTokenizer, BertModel, BertForMaskedLM
  3 | import numpy as np
  4 | import math
  5 | # OPTIONAL: if you want to have more information on what's happening, activate the logger as follows
  6 | import logging
  7 | logging.basicConfig(level=logging.INFO)
  8 | 
  9 | def predict(text, bert_model, bert_tokenizer):
 10 |     # Tokenized input
 11 |     # text = "[CLS] I got restricted because Tom reported my reply [SEP]"
 12 |     text = "[CLS] " + text + " [SEP]"
 13 |     tokenized_text = bert_tokenizer.tokenize(text)
 14 |     # text = "[CLS] Stir the mixture until it is done [SEP]"
 15 |         #masked_index = 4
 16 |     sentence_prob = 1
 17 |     for masked_index in range(1,len(tokenized_text)-1):
 18 |         # Mask a token that we will try to predict back with `BertForMaskedLM`
 19 |         masked_word = tokenized_text[masked_index]
 20 |         if tokenized_text[masked_index]!= "[SEP]":
 21 |             tokenized_text[masked_index] = '[MASK]'
 22 |             # Convert token to vocabulary indices
 23 |             indexed_tokens = bert_tokenizer.convert_tokens_to_ids(tokenized_text)
 24 |             # Define sentence A and B indices associated to 1st and 2nd sentences (see paper)
 25 |             # segments_ids = [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1]
 26 |             length = len(tokenized_text)
 27 |             seg = tokenized_text.index("[SEP]")
 28 |             segments_ids_1 = [0 for _ in range(seg + 1)]
 29 |             segments_ids_2 = [1 for _ in range(seg + 1, length)]
 30 |             segments_ids = segments_ids_1 + segments_ids_2
 31 |             # print (tokenized_text, segments_ids)
 32 |             # Convert inputs to PyTorch tensors
 33 |             tokens_tensor = torch.tensor([indexed_tokens])
 34 |             segments_tensors = torch.tensor([segments_ids])
 35 | 
 36 |             # If you have a GPU, put everything on cuda
 37 |             tokens_tensor = tokens_tensor.to('cuda')
 38 |             segments_tensors = segments_tensors.to('cuda')
 39 | 
 40 |             # Load pre-trained model (weights)
 41 |             # bert_model = BertForMaskedLM.from_pretrained('bert-large-uncased')
 42 |             # bert_model.eval()
 43 | 
 44 |             # If you have a GPU, put everything on cuda
 45 |             tokens_tensor = tokens_tensor.to('cuda')
 46 |             segments_tensors = segments_tensors.to('cuda')
 47 |             bert_model.to('cuda')
 48 | 
 49 |             # Predict all tokens
 50 |             with torch.no_grad():
 51 |                 predictions = bert_model(tokens_tensor, segments_tensors)
 52 | 
 53 |             predictions = torch.nn.functional.softmax(predictions, -1)
 54 | 
 55 |             index = bert_tokenizer.convert_tokens_to_ids([masked_word])[0]
 56 | 
 57 |             curr_prob = predictions[0, masked_index][index]
 58 |             # predict_list = predictions[0, masked_index]
 59 |             sentence_prob *= curr_prob
 60 |             tokenized_text[masked_index] = masked_word
 61 |     return sentence_prob
 62 | #    return math.pow(sentence_prob, 1/(len(tokenized_text)-3))
 63 | 
 64 | 
 65 | 
 66 | 
 67 | # Load pre-trained model tokenizer (vocabulary)
 68 | tokenizer = BertTokenizer.from_pretrained('bert-base-uncased')
 69 | # Load pre-trained model (weights)0.25
 70 | model = BertForMaskedLM.from_pretrained('bert-base-uncased')
 71 | model.eval()
 72 | 
 73 | with open("pre_data/swag.txt", "r") as f:
 74 |     file = f.readlines()
 75 | 
 76 | num = len(file)
 77 | count = 0
 78 | curr = 0
 79 | for i in file:
 80 |     try:
 81 |         label, sentence_1, sentence_2, sentence_3, sentence_4 = i.split("\001")
 82 |         prob_1 = predict(sentence_1, bert_model=model, bert_tokenizer=tokenizer)
 83 |         prob_2 = predict(sentence_2, bert_model=model, bert_tokenizer=tokenizer)
 84 |         prob_3 = predict(sentence_3, bert_model=model, bert_tokenizer=tokenizer)
 85 |         prob_4 = predict(sentence_4, bert_model=model, bert_tokenizer=tokenizer)
 86 |         answer = max(prob_1, prob_2, prob_3, prob_4)
 87 |         if (prob_1 == answer and label[0] == "0") or (prob_2 == answer and label[0] == "1") \
 88 |             or (prob_3 == answer and label[0] == "2") or (prob_4 == answer and label[0] == "3"):
 89 |             count += 1
 90 |         curr += 1
 91 |         print (count, curr, count/curr)
 92 |     except:
 93 |         continue
 94 | print (count/num)
 95 | #base 0.2323503127792672
 96 | 
 97 | 
 98 | 
 99 | 
100 | 
101 | 
102 | 
103 | 
104 | 
105 | 
106 | 
107 | 


--------------------------------------------------------------------------------
/making_sense.py:
--------------------------------------------------------------------------------
  1 | import torch
  2 | from torch.nn import CrossEntropyLoss
  3 | from transformers import *
  4 | import numpy as np
  5 | import math
  6 | # OPTIONAL: if you want to have more information on what's happening, activate the logger as follows
  7 | import logging
  8 | import os
  9 | import sys
 10 | logging.basicConfig(level=logging.INFO)
 11 | os.environ["CUDA_VISIBLE_DEVICES"]="0"
 12 | def uni_predict(text, model, tokenizer):
 13 |     # Tokenized input
 14 |     # text = "[CLS] I got restricted because Tom reported my reply [SEP]"
 15 |     text = text
 16 |     tokenized_text = tokenizer.tokenize(text)
 17 |     sentence_score = 0
 18 |     indexed_tokens = tokenizer.convert_tokens_to_ids(tokenized_text)
 19 |     length = len(tokenized_text)
 20 |     tokens_tensor = torch.tensor([indexed_tokens])
 21 |     tokens_tensor = tokens_tensor.to('cuda')
 22 |     #masked_tensor = torch.tensor([masked_index])
 23 |     with torch.no_grad():
 24 |         outputs = model(tokens_tensor, labels= tokens_tensor)
 25 |     loss = outputs[0]
 26 |     sentence_score = -loss
 27 |     return sentence_score
 28 | 
 29 | def bert_predict(text, model, tokenizer):
 30 |     # Tokenized input
 31 |     # text = "[CLS] I got restricted because Tom reported my reply [SEP]"
 32 |     text = "[CLS] " + text + " [SEP]" #special token for BERT, RoBERTa
 33 |     tokenized_text = tokenizer.tokenize(text)
 34 |     sentence_score = 0
 35 |     length = len(tokenized_text)-2
 36 |     for masked_index in range(1,len(tokenized_text)-1):
 37 |         # Mask a token that we will try to predict back with `BertForMaskedLM`
 38 |         masked_word = tokenized_text[masked_index]
 39 |         #tokenized_text[masked_index] = '<mask>' #special token for XLNet
 40 |         tokenized_text[masked_index] = '[MASK]' #special token for BERT, RoBerta
 41 |         # Convert token to vocabulary indices
 42 |         indexed_tokens = tokenizer.convert_tokens_to_ids(tokenized_text)
 43 |         index = torch.tensor(tokenizer.convert_tokens_to_ids(masked_word))
 44 |         tokens_tensor = torch.tensor([indexed_tokens])
 45 |         tokens_tensor = tokens_tensor.to('cuda')
 46 |         index = index.to('cuda')
 47 |         #masked_tensor = torch.tensor([masked_index])
 48 |         with torch.no_grad():
 49 |             outputs = model(tokens_tensor)
 50 |         prediction_scores = outputs[0]
 51 |         prediction_scores = prediction_scores.view(-1, model.config.vocab_size)
 52 |         prediction_scores = prediction_scores[masked_index].unsqueeze(0)
 53 |         loss_fct = CrossEntropyLoss(ignore_index=-1)  # -1 index = padding token
 54 |         masked_lm_loss = loss_fct(prediction_scores, index.view(-1))
 55 |         tokenized_text[masked_index] = masked_word
 56 |         sentence_score -= masked_lm_loss.item()
 57 |         tokenized_text[masked_index] = masked_word
 58 |     sentence_score = sentence_score/length
 59 |     return sentence_score
 60 | 
 61 | def ro_predict(text, model, tokenizer):
 62 |     # Tokenized input
 63 |     # text = "[CLS] I got restricted because Tom reported my reply [SEP]"
 64 |     text = '<s> '+text+ ' </s>' #special token for RoBERTa
 65 |     tokenized_text = tokenizer.tokenize(text)
 66 |     sentence_score = 0
 67 |     length = len(tokenized_text)-2
 68 |     for masked_index in range(1,len(tokenized_text)-1):
 69 |         # Mask a token that we will try to predict back with `BertForMaskedLM`
 70 |         masked_word = tokenized_text[masked_index]
 71 |         #tokenized_text[masked_index] = '<mask>' #special token for XLNet
 72 |         tokenized_text[masked_index] = '<mask>' #special token for BERT, RoBerta
 73 |         # Convert token to vocabulary indices
 74 |         indexed_tokens = tokenizer.convert_tokens_to_ids(tokenized_text)
 75 |         index = torch.tensor(tokenizer.convert_tokens_to_ids(masked_word))
 76 |         tokens_tensor = torch.tensor([indexed_tokens])
 77 |         tokens_tensor = tokens_tensor.to('cuda')
 78 |         index = index.to('cuda')
 79 |         #masked_tensor = torch.tensor([masked_index])
 80 |         with torch.no_grad():
 81 |             outputs = model(tokens_tensor)
 82 |         prediction_scores = outputs[0]
 83 |         prediction_scores = prediction_scores.view(-1, model.config.vocab_size)
 84 |         prediction_scores = prediction_scores[masked_index].unsqueeze(0)
 85 |         loss_fct = CrossEntropyLoss(ignore_index=-1)  # -1 index = padding token
 86 |         masked_lm_loss = loss_fct(prediction_scores, index.view(-1))
 87 |         tokenized_text[masked_index] = masked_word
 88 |         sentence_score -= masked_lm_loss.item()
 89 |         tokenized_text[masked_index] = masked_word
 90 |     sentence_score = sentence_score/length
 91 |     return sentence_score
 92 | 
 93 | def xlnet_predict(text, model, tokenizer):
 94 |     tokenized_text = tokenizer.tokenize(text)
 95 |     sentence_score = 0
 96 |     #Sprint(len(tokenized_text))
 97 |     for masked_index in range(0,len(tokenized_text)):
 98 |         masked_word = tokenized_text[masked_index]
 99 |         masked_word = tokenized_text[masked_index]
100 |         tokenized_text[masked_index] = '<mask>'
101 |         input_ids = torch.tensor(tokenizer.convert_tokens_to_ids(tokenized_text)).unsqueeze(0)
102 |         index = torch.tensor(tokenizer.convert_tokens_to_ids(masked_word))
103 |         perm_mask = torch.zeros((1, input_ids.shape[1], input_ids.shape[1]), dtype=torch.float)
104 |         perm_mask[:, :, masked_index] = 1.0  # Previous tokens don't see last token
105 |         target_mapping = torch.zeros((1, 1, input_ids.shape[1]), dtype=torch.float)  # Shape [1, 1, seq_length] => let's predict one token
106 |         target_mapping[0, 0, masked_index] = 1.0  # Our first (and only) prediction will be the last token of the sequence (the masked token)
107 |         input_ids = input_ids.to('cuda')
108 |         perm_mask = perm_mask.to('cuda')
109 |         target_mapping = target_mapping.to('cuda')
110 |         index = index.to('cuda')
111 |         with torch.no_grad():
112 |             outputs = model(input_ids, perm_mask=perm_mask, target_mapping=target_mapping, labels = index)
113 |         next_token_logits = outputs[0]
114 |         length = len(tokenized_text)
115 |         # predict_list = predictions[0, masked_index]
116 |         sentence_score -= next_token_logits.item()
117 |         tokenized_text[masked_index] = masked_word
118 |     return sentence_score/(length)
119 | 
120 | test = sys.argv[1]
121 | model_type = sys.argv[2]
122 | robust = sys.argv[3]
123 | if model_type=='xlnet':
124 |     # For XLNet
125 |     tokenizer = XLNetTokenizer.from_pretrained('xlnet-large-cased')
126 |     model = XLNetLMHeadModel.from_pretrained('xlnet-large-cased')
127 | elif model_type=='bert':
128 |     # For BERT
129 |     tokenizer = BertTokenizer.from_pretrained('bert-large-uncased')
130 |     model = BertForMaskedLM.from_pretrained('bert-large-uncased')
131 | elif model_type=='roberta':
132 |     tokenizer = RobertaTokenizer.from_pretrained('roberta-large')
133 |     model = RobertaForMaskedLM.from_pretrained('roberta-large')
134 | elif model_type=='gpt':
135 |     tokenizer = OpenAIGPTTokenizer.from_pretrained('openai-gpt')
136 |     model = OpenAIGPTLMHeadModel.from_pretrained('openai-gpt')
137 | elif model_type=='gpt-2':
138 |     tokenizer = GPT2Tokenizer.from_pretrained('gpt2-medium')
139 |     model = GPT2LMHeadModel.from_pretrained('gpt2-medium')
140 | 
141 | model.to('cuda')
142 | model.eval()
143 | 
144 | if robust=='r':
145 |     with open("CATS/Robust_commonsense_test/{}.txt".format(test), "r") as f:
146 |         file = f.readlines()
147 |     num = len(file)
148 |     count = 0
149 |     curr = 0
150 |     for line in file:
151 |         line = line.strip().split("\001")
152 |         label_1 = int(line[0])
153 |         label_2 = int(line[3])
154 |         score_list = []
155 |         for sentence in line:
156 |             if not len(sentence)==1:
157 |                 if model_type=='xlnet':
158 |                     score = xlnet_predict(sentence, model=model, tokenizer=tokenizer)
159 |                 elif model_type=='bert':
160 |                     score = bert_predict(sentence, model=model, tokenizer=tokenizer)
161 |                 elif model_type=='roberta':
162 |                     score = ro_predict(sentence, model=model, tokenizer=tokenizer)
163 |                 else:
164 |                     score = uni_predict(sentence, model=model, tokenizer=tokenizer)
165 |                 score_list.append(score)
166 |         #print(score_list)
167 |         score_list_1 = score_list[:2]
168 |         score_list_2 = score_list[2:]
169 |         predict_label_1 = score_list_1.index(max(score_list_1))
170 |         predict_label_2 = score_list_2.index(max(score_list_2))
171 |         if predict_label_1==label_1 and predict_label_2==label_2:
172 |             count += 1
173 |         elif predict_label_1!=label_1 and predict_label_2!=label_2:
174 |             count += 1
175 |         curr += 1
176 |         #print (count, curr, count/curr)
177 |     print(test+' '+model_type+':-------------------')
178 |     print (count/num)
179 | else:
180 |     with open("CATS/commonsense_ability_test/{}.txt".format(test), "r") as f:
181 |         file = f.readlines()
182 |     num = len(file)
183 |     count = 0
184 |     curr = 0
185 |     for line in file:
186 |         line = line.strip().split("\001")
187 |         label = int(line[0])
188 |         score_list = []
189 |         for sentence in line[1:]:
190 |             if model_type=='xlnet':
191 |                 score = xlnet_predict(sentence, model=model, tokenizer=tokenizer)
192 |             elif model_type=='bert':
193 |                 score = bert_predict(sentence, model=model, tokenizer=tokenizer)
194 |             elif model_type=='roberta':
195 |                 score = ro_predict(sentence, model=model, tokenizer=tokenizer)
196 |             else:
197 |                 score = uni_predict(sentence, model=model, tokenizer=tokenizer)
198 |             score_list.append(score)
199 |         #print(score_list)
200 |         predict_label = score_list.index(max(score_list))
201 |         #print(predict_label, label)
202 |         if predict_label==label:
203 |             count += 1
204 |         curr += 1
205 |         #print (count, curr, count/curr)
206 |     print(test+' '+model_type+':-------------------')
207 |     print (count/num)


--------------------------------------------------------------------------------
/Robust_commonsense_test/sub.txt:
--------------------------------------------------------------------------------
 1 | 1
I wore my wedding ring on my left foot
I wore my wedding ring on my left hand
0
I wore my wedding ring on my left hand
I wore my wedding ring on my left chest
 2 | 1
boats sail on the sky
boats sail on the water
0
birds fly on the sky
birds fly on the water
 3 | 0
my grandpa can't sleep so he took sleeping pills
my grandpa can't sleep so he took stimulant pills
1
my grandpa can't get out of depression so he took sleeping pills
my grandpa can't get out of depression so he took stimulant pills
 4 | 1
he closes his eyes while reading a magazine
he turns the pages while reading a magazine
0
he opens his eyes while reading a magazine
he closes his eyes while reading a magazine
 5 | 1
teammates are here to encourage you in teamwork
teammates are here to work with you in teamwork
0
teachers are here to encourage you in teamwork
teachers are here to work with you in teamwork
 6 | 1
today I washed soup
today I washed vegetables
0
today I washed vegetables
today I washed vegetable fried rice
 7 | 1
My friend is cooking a meal on a stone
My friend is cooking a meal on a stove
0
My friend is breaking a coconut on a stone
My friend is breaking a coconut with a stove
 8 | 1
i rip a letter to tell her i am fine
i write a letter to tell her i am fine
0
i rip a letter to see her message
i write a letter to see her message
 9 | 0
paul deleted the email for it's a spam email
paul deleted the email for it's an important email
1
paul stared the email for it's a spam email
paul stared the email for it's an important email
10 | 1
she was very angry when her son was admitted to the best school
she was very happy when her son was admitted to the best school
0
she was very angry when her son was kicked out by the best school
she was very happy when her son was kicked out by the best school
11 | 0
the driver rotated the steering wheel and the car turned
the driver rotated the steering wheel and the car halted
1
the driver pressed on the brakes and the car turned
the driver pressed on the brakes the steering wheel and the car halted
12 | 1
the dog barked all day and I had to wear nasal plugs
the dog barked all day and I had to wear ear plugs
0
the fish market smelled bad and I had to wear nasal plugs
the fish market smelled bad and I had to wear ear plugs
13 | 1
I need inspirations to clean bowls
I need inspirations to design bowls
0
I need detergent to clean bowls
I need detergent to design bowls
14 | 0
Most people don't like mice
Most people like mice
1
Most people don't like dolphin
Most people like dolphin
15 | 0
Cooking is a very interesting thing, so I like it
Cooking is a very boring thing, so I like it
1
Cooking is a very interesting thing, so I hate it
Cooking is a very boring thing, so I hate it
16 | 0
you need a mask to prevent the spread of infection
you need a hat to prevent the spread of infection
1
you need a mask to prevent the wind messing up your hairstyle
you need a hat to prevent the wind messing up your hairstyle
17 | 1
Doctors don't need to write papers
Doctors need to write papers
0
Doctors don't need to write novels
Doctors need to write novels
18 | 1
jane drove so fast that she got a movie ticket
jane drove so fast that she got a speeding ticket
0
jane drove so fast for getting a movie ticket
jane drove so fast for getting a speeding ticket
19 | 0
it took 7 seconds to receive the email
it took 7 days to receive the email
1
it took 7 seconds to receive the mail
it took 7 days to receive the mail
20 | 0
I have a lamp on my desk
I have a desk on my lamp
1
I have a lamp under my desk
I have a desk under my lamp
21 | 1
Iron products are usually sensitive to rain
Iron products are usually not sensitive to rain
0
Iron products are usually sensitive to acid
Iron products are usually not sensitive to acid
22 | 1
the student's grade was higher for the incorrect answer on the exam
the student's grade was lower for the incorrect answer on the exam
0
the student's grade was higher for the correct answer on the exam
the student's grade was lower for the correct answer on the exam
23 | 0
People usually like gold
People hardly like gold
1
People hate like gold
People hardly hate gold
24 | 1
I keep things messy so that I can find something quick
I keep things orderly so that I can find something quick
0
I avoid things messy so that I can find something quick
I avoid things orderly so that I can find something quick
25 | 0
People can go back to where they are after they circle the earth
People can't go back to where they are after they circle the earth
0
People can fly back to where they are after they circle the earth
People can't fly back to where they are after they circle the earth
26 | 0
i am preparing for the trip tomorrow
i am preparing for the trip yesterday
1
i am recalling about the trip tomorrow
i am recalling about the trip yesterday
27 | 1
running can improve our thinking ability
reading can improve our thinking ability
0
running can improve our health
reading can improve our health
28 | 1
he turns on the light to listen to music
he turns on the radio to listen to music
0
he turns on the light to see things clearer
he turns on the radio to see things clearer
29 | 0
December is the 12th month of a year
December is the 13th month of a year
1
November is the 12th month of a year
December is the 12th month of a year
30 | 0
I shouted at the top of my voice to catch her attention
I shouted at the top of my voice to avoid her attention
1
I speaked at the lowest of my voice to catch her attention
I peaked at the lowest of my voice to avoid her attention
31 | 1
mia got a discount on her groceries so she spent more money
mia got a discount on her groceries so she spent less money
0
mia got a discount on her groceries so she save more money
mia got a discount on her groceries so she save less money
32 | 1
drinking too much coffee can make you drunk
drinking too much vodka can make you drunk
0
drinking too much coffee can make you stay awake
drinking too much vodka can make you stay awake
33 | 0
penguins are birds that cannot fly
penguins are fish that cannot fly
1
penguins are fish that can swim
penguins are birds that can swim
34 | 0
he is a nice boy because he smiles to everyone
he is a nice boy because he yells at everyone
1
he is a bad boy because he smiles to everyone
he is a bad boy because he yells at everyone
35 | 1
I'm thirsty so I drink seawater
I'm thirsty so I drink freshwater
0
I'm thirsty because I drink seawater
I'm thirsty because I drink freshwater
36 | 0
If you want to see then you should open your eyes
If you want to see then you should open your mouth
1
If you want to speak then you should open your eyes
If you want to speak then you should open your mouth
37 | 0
The trophy doesn't fit into the brown suitcase because the trophy is too large.
The trophy doesn't fit into the brown suitcase because the suitcase is too large.
1
The trophy doesn't fit into the brown suitcase because the trophy is too small.
The trophy doesn't fit into the brown suitcase because the suitcase is too small.
38 | 0
Joan made sure to thank Susan for all the help joan had recieved.
Joan made sure to thank Susan for all the help susan had recieved.
1
Joan made sure to thank Susan for all the help joan had given.
Joan made sure to thank Susan for all the help susan had given.
39 | 0
Paul tried to call George on the phone, but paul wasn't successful.
Paul tried to call George on the phone, but george wasn't successful.
1
Paul tried to call George on the phone, but paul wasn't available.
Paul tried to call George on the phone, but george wasn't available.
40 | 0
The lawyer asked the witness a question, but the lawyer was reluctant to repeat it.
The lawyer asked the witness a question, but the witness was reluctant to repeat it.
1
The lawyer asked the witness a question, but the lawyer was reluctant to answer it.
The lawyer asked the witness a question, but the witness was reluctant to answer it.
41 | 0
The delivery truck zoomed by the school bus because the delivery truck was going so fast.
The delivery truck zoomed by the school bus because the school bus was going so fast.
1
The delivery truck zoomed by the school bus because the delivery truck was going so slow.
The delivery truck zoomed by the school bus because the school bus was going so slow.
42 | 0
Frank felt vindicated when his longtime rival Bill revealed that frank was the winner of the competition.
Frank felt vindicated when his longtime rival Bill revealed that bill was the winner of the competition.
1
Frank felt crushed when his longtime rival Bill revealed that frank was the winner of the competition.
Frank felt crushed when his longtime rival Bill revealed that bill was the winner of the competition.
43 | 0
The man couldn't lift his son because the man was so weak.
The man couldn't lift his son because the son was so weak.
1
The man couldn't lift his son because the man was so heavy.
The man couldn't lift his son because the son was so heavy.
44 | 0
The large ball crashed right through the table because the large ball was made of steel.
The large ball crashed right through the table because the table was made of steel.
1
The large ball crashed right through the table because the large ball was made of styrofoam.
The large ball crashed right through the table because the table was made of styrofoam.
45 | 0
John couldn't see the stage with Billy in front of him because john is so short.
John couldn't see the stage with Billy in front of him because billy is so short.
1
John couldn't see the stage with Billy in front of him because john is so tall.
John couldn't see the stage with Billy in front of him because billy is so tall.
46 | 0
Tom threw his schoolbag down to Ray after tom reached the top of the stairs.
Tom threw his schoolbag down to Ray after ray reached the top of the stairs.
1
Tom threw his schoolbag down to Ray after tom reached the bottom of the stairs.
Tom threw his schoolbag down to Ray after ray reached the bottom of the stairs.
47 | 0
Although they ran at about the same speed, Sue beat Sally because sue had such a good start.
Although they ran at about the same speed, Sue beat Sally because sally had such a good start.
1
Although they ran at about the same speed, Sue beat Sally because sue had such a bad start.
Although they ran at about the same speed, Sue beat Sally because sally had such a bad start.
48 | 0
The sculpture rolled off the shelf because the sculpture wasn't anchored.
The sculpture rolled off the shelf because the shelf wasn't anchored.
1
The sculpture rolled off the shelf because the sculpture wasn't level.
The sculpture rolled off the shelf because the shelf wasn't level.
49 | 0
The firemen arrived after the police because the firemen were coming from so far away.
The firemen arrived after the police because the police were coming from so far away.
1
The firemen arrived before the police because the firemen were coming from so far away.
The firemen arrived before the police because the police were coming from so far away.
50 | 0
Frank was upset with Tom because the toaster frank had bought from him didn't work.
Frank was upset with Tom because the toaster tom had bought from him didn't work.
1
Frank was upset with Tom because the toaster frank had sold him didn't work.
Frank was upset with Tom because the toaster tom had sold him didn't work.
51 | 0
Jim yelled at Kevin because jim was so upset.
Jim yelled at Kevin because kevin was so upset.
1
Jim comforted Kevin because jim was so upset.
Jim comforted Kevin because kevin was so upset.
52 | 0
The sack of potatoes had been placed abovethe bag of flour, so the sack of potatoes had to be moved first.
The sack of potatoes had been placed abovethe bag of flour, so the bag of flour had to be moved first.
1
The sack of potatoes had been placed belowthe bag of flour, so the sack of potatoes had to be moved first.
The sack of potatoes had been placed belowthe bag of flour, so the bag of flour had to be moved first.
53 | 0
Pete envies Martin although pete is very successful.
Pete envies Martin although martin is very successful.
1
Pete envies Martin because pete is very successful.
Pete envies Martin because martin is very successful.
54 | 0
The older students were bullying the younger ones, so we punished the older students .
The older students were bullying the younger ones, so we punished the younger students .
1
The older students were bullying the younger ones, so we rescued the older students .
The older students were bullying the younger ones, so we rescued the younger students .
55 | 0
I poured water from the bottle into the cup until the bottle was empty.
I poured water from the bottle into the cup until the cup was empty.
1
I poured water from the bottle into the cup until the bottle was full.
I poured water from the bottle into the cup until the cup was full.
56 | 0
Susan knows all about Ann's personal problems because susan is nosy.
Susan knows all about Ann's personal problems because ann is nosy.
1
Susan knows all about Ann's personal problems because susan is indiscreet.
Susan knows all about Ann's personal problems because ann is indiscreet.
57 | 0
Sid explained his theory to Mark but sid couldn't convince him.
Sid explained his theory to Mark but mark couldn't convince him.
1
Sid explained his theory to Mark but sid couldn't understand him.
Sid explained his theory to Mark but mark couldn't understand him.
58 | 0
Susan knew that Ann's son had been in a car accident, so susan told her about it.
Susan knew that Ann's son had been in a car accident, so ann told her about it.
1
Susan knew that Ann's son had been in a car accident, because susan told her about it.
Susan knew that Ann's son had been in a car accident, because ann told her about it.
59 | 0
Joe's uncle can still beat him at tennis, even though joe is 30 years younger.
Joe's uncle can still beat him at tennis, even though joe's uncle is 30 years younger.
1
Joe's uncle can still beat him at tennis, even though joe is 30 years older.
Joe's uncle can still beat him at tennis, even though joe's uncle is 30 years older.
60 | 0
The painting in Mark's living room shows an oak tree. the painting is to the right of the bookcase.
The painting in Mark's living room shows an oak tree. the oak tree is to the right of the bookcase.
1
The painting in Mark's living room shows an oak tree. the painting is to the right of a house.
The painting in Mark's living room shows an oak tree. the oak tree is to the right of a house.
61 | 1
Comment sections allow customers to have direct engagement, and since this often results in arguments and nonsense when there is no moderation, Comment sections have not failed .
Comment sections allow customers to have direct engagement, but since this often results in healthy debates and enlightenment when there is moderation, Comment sections have not failed .
0
Comment sections allow customers to have direct engagement, and since this often results in arguments and nonsense when there is no moderation, Comment sections have not succeed.
Comment sections allow customers to have direct engagement, but since this often results in healthy debates and enlightenment when there is moderation, Comment sections have not succeed.
62 | 1
Comment sections allow customers to have direct engagement, and since this often results in arguments and nonsense when there is no moderation, Comment sections have not failed .
Comment sections allow customers to have direct engagement, but since this often results in healthy debates and enlightenment when there is moderation, Comment sections have not failed .
0
Comment sections allow customers to have direct engagement, and since this often results in arguments and nonsense when there is no moderation, Comment sections have not succeed.
Comment sections allow customers to have direct engagement, but since this often results in healthy debates and enlightenment when there is moderation, Comment sections have not succeed.
63 | 1
Comment sections have varied and valuable opinions, and since varied opinions cause conflict, Comment sections have not failed
Comment sections have varied and valuable opinions, but since varied opinions cause thought, Comment sections have not failed
0
Comment sections have varied and valuable opinions, and since varied opinions cause conflict, Comment sections have not succeed
Comment sections have varied and valuable opinions, but since varied opinions cause thought, Comment sections have not succeed
64 | 1
Words matter and people who think differently should be able to respond, and since commenters who have responded have done so in fuzzy, illogical fashion, Comment sections have not failed
Words matter and people who think differently should be able to respond, but since commenters who have responded have done so in a structured, logical fashion, Comment sections have not failed
0
Words matter and people who think differently should be able to respond, and since commenters who have responded have done so in fuzzy, illogical fashion, Comment sections have not succeed
Words matter and people who think differently should be able to respond, but since commenters who have responded have done so in a structured, logical fashion, Comment sections have not succeed
65 | 0
Guns are already on college campuses, and since status quo should be codified, Guns should be permitted on college campuses
Guns are already on college campuses, but since status quo should be banned, Guns should be permitted on college campuses
1
Guns are already on college campuses, and since status quo should be codified, Guns should be prohibited on college campuses
Guns are already on college campuses, but since status quo should be banned, Guns should be prohibited on college campuses
66 | 1
When there are no moderators and commentators are anonymous, they tend to abuse the privileged of commenting, and since there are also lots of people who don't abuse the privilege of commenting, Comment sections have failed
When there are no moderators and commentators are anonymous, they tend to abuse the privileged of commenting, but since there are lots of people who abuse the privilege of commenting, Comment sections have failed
0
When there are no moderators and commentators are anonymous, they tend to abuse the privileged of commenting, and since there are also lots of people who don't abuse the privilege of commenting, Comment sections have succeed
When there are no moderators and commentators are anonymous, they tend to abuse the privileged of commenting, but since there are lots of people who abuse the privilege of commenting, Comment sections have succeed
67 | 1
While not every person who has served a jail sentence has reformed I believe many realize the wrong they have done and strive to be better, and since not every felon is reformed, Felons should be allowed to vote
While not every person who has served a jail sentence has reformed I believe many realize the wrong they have done and strive to be better, but since many felons are reformed, Felons should be allowed to vote
0
While not every person who has served a jail sentence has reformed I believe many realize the wrong they have done and strive to be better, and since not every felon is reformed, Felons should be prohibited to vote
While not every person who has served a jail sentence has reformed I believe many realize the wrong they have done and strive to be better, but since many felons are reformed, Felons should be prohibited to vote
68 | 1
When comments are moderated, it is appreciated by people like me, and since many sites do not have proper moderation and therefore end up overrun by trollish comments, Comment sections have not failed
When comments are moderated, it is appreciated by people like me, but since many sites have proper moderation and therefore do not end up overrun by trollish comments, Comment sections have not failed
0
When comments are moderated, it is appreciated by people like me, and since many sites do not have proper moderation and therefore end up overrun by trollish comments, Comment sections have not succeed
When comments are moderated, it is appreciated by people like me, but since many sites have proper moderation and therefore do not end up overrun by trollish comments, Comment sections have not succeed
69 | 0
Many editorials are wrong or distorted and their claims are corrected in the comments, and since these corrections are usually noticed, and have successfully changed opinions, Comment sections have not failed
Many editorials are wrong or distorted and their claims are corrected in the comments, but since these corrections have usually gone unnoticed, or have failed to change opinions, Comment sections have not failed
1
Many editorials are wrong or distorted and their claims are corrected in the comments, and since these corrections are usually noticed, and have successfully changed opinions, Comment sections have not succeed
Many editorials are wrong or distorted and their claims are corrected in the comments, but since these corrections have usually gone unnoticed, or have failed to change opinions, Comment sections have not succeed
70 | 0
It is very nice to have the information easily available, and since a little information solves a lot of problems, Medical websites are healthful
It is very nice to have the information easily available, but since a little information causes a lot of problems, Medical websites are healthful
1
It is very nice to have the information easily available, and since a little information solves a lot of problems, Medical websites are harmful
It is very nice to have the information easily available, but since a little information causes a lot of problems, Medical websites are harmful
71 | 1
Felons should be able to have their full citizenship rights restored if they can demonstrate they are a solid citizen, and since many solid citizens are bad people anyway, Felons should be allowed to vote
Felons should be able to have their full citizenship rights restored if they can demonstrate they are a solid citizen, but since solid citizens are not bad people, Felons should be allowed to vote
0
Felons should be able to have their full citizenship rights restored if they can demonstrate they are a solid citizen, and since many solid citizens are bad people anyway, Felons should be prohibited to vote
Felons should be able to have their full citizenship rights restored if they can demonstrate they are a solid citizen, but since solid citizens are not bad people, Felons should be prohibited to vote
72 | 0
There are many treatments that doctors need to learn to help people in pain, and since doctors have enough time to learn various things, Opioid training should be mandatory
There are many treatments that doctors need to learn to help people in pain, but since doctors have so little time to learn various things, Opioid training should be mandatory
1
There are many treatments that doctors need to learn to help people in pain, and since doctors have enough time to learn various things, Opioid training should be voluntary
There are many treatments that doctors need to learn to help people in pain, but since doctors have so little time to learn various things, Opioid training should be voluntary
73 | 1
Comment sections are an important place for discussion even if some posters abuse them, and since the abuse of posters overshadows any good the constructive comments provide, Comment sections have not failed
Comment sections are an important place for discussion even if some posters abuse them, but since the abuse of posters doesn't overshadow any good the constructive comments provide, Comment sections have not failed
0
Comment sections are an important place for discussion even if some posters abuse them, and since the abuse of posters overshadows any good the constructive comments provide, Comment sections have not succeed
Comment sections are an important place for discussion even if some posters abuse them, but since the abuse of posters doesn't overshadow any good the constructive comments provide, Comment sections have not succeed
74 | 1
The patients and their family know when there is something wrong even though doctors know a lot, and since medical websites cause patients to think they know more than the doctors, Medical websites are healthful
The patients and their family know when there is something wrong even though doctors know a lot, but since medical websites allow patients to learn more without the doctors, Medical websites are healthful
0
The patients and their family know when there is something wrong even though doctors know a lot, and since medical websites cause patients to think they know more than the doctors, Medical websites are harmful
The patients and their family know when there is something wrong even though doctors know a lot, but since medical websites allow patients to learn more without the doctors, Medical websites are harmful
75 | 0
There were so many people it was as crowded as being in a shopping mall, and since it appeared no one was enjoying the park, Overcrowded national parks should have restricted access
There were so many people it was as crowded as being in a shopping mall, but since it appeared everyone was enjoying the park, Overcrowded national parks should have restricted access
1
There were so many people it was as crowded as being in a shopping mall, and since it appeared no one was enjoying the park, Overcrowded national parks should have open access
There were so many people it was as crowded as being in a shopping mall, but since it appeared everyone was enjoying the park, Overcrowded national parks should have open access
76 | 


--------------------------------------------------------------------------------
/Robust_commonsense_test/swap.txt:
--------------------------------------------------------------------------------
 1 | 1
the shipowner adjusted the wind to go faster
the shipowner adjusted the sail to go faster
0
the wind pushed the ship to go faster
the sail pushed the ship to go faster
 2 | 1
the paper is made from soil
the paper is made from wood
0
soil can bury paper
wood can bury paper
 3 | 1
tom fell and broke his heart
tom fell and broke his arm
0
tom has a heartache and fell
tom has an arm ache and fell
 4 | 0
the Heartbeat is faster in children than in adults normally
the Heartbeat is slower in children than in adults normally
1
adults' heartbeat is faster than children
children' heartbeat is faster than adults
 5 | 0
the desk is made of wood
the desk is made of wool
1
wood can wrap up desk
wool can wrap up desk
 6 | 1
silk is a common material for wedding rings
silk is a common material for wedding gowns
1
wedding rings is made of silk
wedding gowns is made of silk
 7 | 0
the driver rotated the steering wheel and the car turned
the driver rotated the steering wheel and the car halted
1
the car turned, so the driver needed to rotate the steering wheel to make it starts
the car halted, so the driver needed to rotate the steering wheel to make it starts
 8 | 1
sleeping pills keep him warm in the wild
sleeping bags keep him warm in the wild
0
he is warm but insomnic in the wild. He needs sleeping pills
he is warm but insomnic in the wild. He needs sleeping bags
 9 | 1
writing a story requires a beautiful voice
writing a story requires creativity
0
beautiful voice can recite a story
creativity can recite a story
10 | 1
animals develop from seeds
plants develop from seeds
0
seeds will be eaten by animals
seeds will be eaten by plants
11 | 1
Doctors don't need to write papers
Doctors need to write papers
0
papers are not all written by docters
papers are all written by docters
12 | 1
jane drove so fast that she got a movie ticket
jane drove so fast that she got a speeding ticket
0
jane got a movie ticket so she drove fast to catch time
jane got a speeding ticket so she drove fast to catch time
13 | 1
Iron products are usually sensitive to rain
Iron products are usually not sensitive to rain
1
rain can corrode iron products easily
rain can not corrode iron products easily
14 | 1
after I replaced the batteries, the flashlight was dead
after I replaced the batteries, the flashlight was on
0
I replaced the batteries after the flashlight was dead
I replaced the batteries after the flashlight was on
15 | 0
People usually like gold
People hardly like gold
1
gold hardly attracts people
gold attracts people
16 | 1
I keep things messy so that I can find something quick
I keep things orderly so that I can find something quick
0
I find something quick so I make things messy.
I find something quick so I make things orderly.
17 | 1
Gravity can start an electronic device
Electricity can start electronic devices
0
electronic device needs electricity
electronic device needs gravity
18 | 1
drinking too much coffee can make you drunk
drinking too much vodka can make you drunk
0
you are drunk. you should drink some coffee
you are drunk. you should drink some vodka
19 | 0
most children love candies
most children hate candies
1
most candies disattract children
most candies attract children
20 | 0
Alice became sad after felt left out by her friends
Alice became joyful after felt left out by her friends
0
her friends became sad after felt left out by Alice
her friends became joyful after felt left out by Alice
21 | 1
Bob played hard to prepare for the examination
Bob studied hard to prepare for the examination
0
after examination, bob played hard during vacation 
after examination, bob studied hard during vacation 
22 | 1
I was humiliated by him so I had better friendship with him
I was humiliated by him so I broke up with him
1
I had better friendship with him so I was humiliated.
 I broke up with him  so I was humiliated
23 | 0
candy is made of sugar
candy is made of plastic
0
he put some soy sauce to make the noodles taste better
he put some soy sauce to make the robot taste better
24 | 0
cemetery scares children
amusement park scares children
1
Mary eats at a restaurant to do the dishes
Mary eats at a restaurant to avoid doing the dishes
25 | 1
people put on summer dresses when winter comes
people put on summer dresses when summer comes
0
winter leaves, people put on summer dresses
summer leaves, people put on summer dresses
26 | 0
The trophy doesn't fit into the brown suitcase because the trophy is too large.
The trophy doesn't fit into the brown suitcase because the suitcase is too large.
1
The  brown suitcase cannot contain the trophy because the trophy is too small.
The  brown suitcase cannot contain the trophy because the suitcase is too small.
27 | 0
Joan made sure to thank Susan for all the help joan had recieved.
Joan made sure to thank Susan for all the help susan had recieved.
1
 Susan received thanks from Joan for all the help Susan had received.
 Susan received thanks from Joan for all the help Joan had received.
28 | 0
Paul tried to call George on the phone, but paul wasn't successful.
Paul tried to call George on the phone, but george wasn't successful.
1
George waited Paul on the phone, but paul wasn't successful.
George waited Paul on the phone, but george wasn't successful.
29 | 0
The lawyer asked the witness a question, but the lawyer was reluctant to repeat it.
The lawyer asked the witness a question, but the witness was reluctant to repeat it.
1
 the witness answered the lawyer a question, but the lawyer was reluctant to repeat it.
 the witness answered the lawyer a question, but the witness was reluctant to repeat it.
30 | 0
The man couldn't lift his son because the man was so weak.
The man couldn't lift his son because the son was so weak.
1
The son couldn't lift his old dad because the dad was so weak.
The son couldn't lift his old dad because the son was so weak.
31 | 1
The man couldn't lift his son because the man was so heavy.
The man couldn't lift his son because the son was so heavy.
0
The son couldn't lift his dad because the dad was so heavy.
The son couldn't lift his dad because the son was so heavy.
32 | 0
John couldn't see the stage with Billy in front of him because john is so short.
John couldn't see the stage with Billy in front of him because billy is so short.
1
Billy couldn't see the stage with John in front of him because John is so short.
Billy couldn't see the stage with John in front of him because billy is so short.
33 | 1
John couldn't see the stage with Billy in front of him because john is so tall.
John couldn't see the stage with Billy in front of him because billy is so tall.
0
Billy couldn't see the stage with John in front of him because john is so tall.
Billy couldn't see the stage with John in front of him because billy is so tall.
34 | 0
Although they ran at about the same speed, Sue beat Sally because sue had such a good start.
Although they ran at about the same speed, Sue beat Sally because sally had such a good start.
1
Although they ran at about the same speed, Sally beat Sue because sue had such a good start.
Although they ran at about the same speed, Sally beat Sue because sally had such a good start.
35 | 1
Although they ran at about the same speed, Sue beat Sally because sue had such a bad start.
Although they ran at about the same speed, Sue beat Sally because sally had such a bad start.
0
Although they ran at about the same speed, Sally beat Sue because sue had such a bad start.
Although they ran at about the same speed, Sally beat Sue because sally had such a bad start.
36 | 0
The firemen arrived after the police because the firemen were coming from so far away.
The firemen arrived after the police because the police were coming from so far away.
1
The police arrived after the firemen because the firemen were coming from so far away.
The police arrived after the firemen because the police were coming from so far away.
37 | 1
The firemen arrived before the police because the firemen were coming from so far away.
The firemen arrived before the police because the police were coming from so far away.
0
The police arrived before the firemen because the firemen were coming from so far away.
The police arrived before the firemen because the police were coming from so far away.
38 | 0
Jim yelled at Kevin because jim was so upset.
Jim yelled at Kevin because kevin was so upset.
1
Kevin yelled at Jim because jim was so upset.
Kevin yelled at Jim because kevin was so upset.
39 | 1
Jim comforted Kevin because jim was so upset.
Jim comforted Kevin because kevin was so upset.
0
Kevin comforted jim because jim was so upset.
Kevin comforted jim because kevin was so upset.
40 | 0
The drain is clogged with hair. the drain has to be cleaned.
The drain is clogged with hair. the hair has to be cleaned.
1
hair clogged drain. drain has to be removed
hair clogged drain. Hair has to be removed
41 | 0
Bob paid for Charlie's college education. bob is very rich.
Bob paid for Charlie's college education. charlie is very rich.
1
Charlie paid for Bob's college education. bob is very rich.
Charlie paid for Bob's college education. charlie is very rich.
42 | 1
Bob paid for Charlie's college education. bob is very grateful.
Bob paid for Charlie's college education. charlie is very grateful.
0
Charlie paid for Bob's college education. bob is very grateful.
Charlie paid for Bob's college education. Charlie is very grateful.
43 | 1
Jane knocked on Susan's door, but there was no answer. jane was out.
Jane knocked on Susan's door, but there was no answer. susan was out.
0
Susan knocked on Jane's door, but there was no answer. jane was out.
Susan knocked on Jane's door, but there was no answer. susan was out.
44 | 0
John hired Bill to take care of john .
John hired Bill to take care of bill .
1
Bill hired John to take care of john .
Bill hired John to take care of bill .
45 | 0
John promised Bill to leave, so an hour later john left.
John promised Bill to leave, so an hour later bill left.
1
Bill promised John to leave, so an hour later john left.
Bill promised John to leave, so an hour later bill left.
46 | 1
John ordered Bill to leave, so an hour later john left.
John ordered Bill to leave, so an hour later bill left.
0
Bill ordered John to leave, so an hour later john left.
Bill ordered John to leave, so an hour later bill left.
47 | 0
Jane knocked on Susan's door but jane did not get an answer.
Jane knocked on Susan's door but susan did not get an answer.
1
Susan knocked on Jane's door but jane did not get an answer.
Susan knocked on Jane's door but susan did not get an answer.
48 | 0
During a game of tag, Ethan chased Luke because ethan was "it".
During a game of tag, Ethan chased Luke because luke was "it".
1
During a game of tag, Luke chased Ethan because ethan was "it".
During a game of tag, Luke chased Ethan because luke was "it".
49 | 0
They add a lot to the piece and I look forward to reading comments, and since comments sections are a welcome distraction from my work, Comment sections have not failed .
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work, Comment sections have not failed .
1
They add a lot to the piece and I look forward to reading comments, and since daily work distracts people from reading comments sections, Comment sections have not failed .
They add a lot to the piece and I look forward to reading comments, but since daily work encourage people reading comments sections, Comment sections have not failed .
50 | 0
It is good to be informed about your health, and since you are able to find information online, Medical websites are healthful .
It is good to be informed about your health, but since you aren't able to be diagnosed online, Medical websites are healthful .
1
It is good to be informed about your health, and since information can be found online, Medical websites are healthful .
It is good to be informed about your health, but since diagnosis cannot be conducted online, Medical websites are healthful .
51 | 0
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, and since an act created by a single person or group is representative of the religion as a whole, Christians have created a harmful atmosphere for gays.
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, but since an act created by a single person or group isn't representative of the religion as a whole, Christians have created a harmful atmosphere for gays.
1
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, and since the religion as a whole can bail an act created by a single person or group , Christians have created a harmful atmosphere for gays.
It is good to be informed about your health, but since diagnosis cannot be conducted online, Medical websites are healthful.
52 | 1
Comment sections have varied and valuable opinions, and since varied opinions cause conflict, Comment sections have not failed
Comment sections have varied and valuable opinions, but since varied opinions cause thought, Comment sections have not failed
0
Comment sections have varied and valuable opinions, and since conflict  brought varied opinions, Comment sections have not failed
Comment sections have varied and valuable opinions, but since thought differs from varied opinions, Comment sections have not failed
53 | 0
It is very nice to have the information easily available, and since a little information solves a lot of problems, Medical websites are healthful
It is very nice to have the information easily available, but since a little information causes a lot of problems, Medical websites are healthful
1
It is very nice to have the information easily available, and since a lot of problems is caused by a little information, Medical websites are healthful
It is very nice to have the information easily available, but since a lot of problems can be solved by a little information, Medical websites are healthful
54 | 0
There were so many people it was as crowded as being in a shopping mall, and since it appeared no one was enjoying the park, Overcrowded national parks should have restricted access
There were so many people it was as crowded as being in a shopping mall, but since it appeared everyone was enjoying the park, Overcrowded national parks should have restricted access
1
There were so many people it was as crowded as being in a shopping mall, and since it appeared the park affect no one, Overcrowded national parks should have restricted access
There were so many people it was as crowded as being in a shopping mall, but since it appeared the park disattracted everyone, Overcrowded national parks should have restricted access
55 | 1
Comments sections are necessary to give a wide variety of opinions, and since there are not many opinions in the comment section, Comment sections have not failed
Comments sections are necessary to give a wide variety of opinions, but since there are many opinions available in the comment section, Comment sections have not failed
0
Comments sections are necessary to give a wide variety of opinions, and since comment section inspires many opinions , Comment sections have not failed
Comments sections are necessary to give a wide variety of opinions, but since comment section spoil many opinions, Comment sections have not failed
56 | 1
There is an epidemic in Brazil, and since this epidemic has a little relevance to the games, Brazil should postpone Olympics
There is an epidemic in Brazil, but since this epidemic has a huge relevance to the games, Brazil should postpone Olympics
0
There is an epidemic in Brazil, and since the game has a little protection to the epidemic, Brazil should postpone Olympics
There is an epidemic in Brazil, but since the game has a huge protection to the epidemic, Brazil should postpone Olympics
57 | 0
People can learn a lot from reading the comments, and since usually there is a lot to learn, Comment sections have not failed
People can learn a lot from reading the comments, but since usually there is not much to learn, Comment sections have not failed
1
People can learn a lot from reading the comments, and since usually learning cannot be done in comments sections, Comment sections have not failed
People can learn a lot from reading the comments, but since usually learning can be done in comments sections, Comment sections have not failed
58 | 1
Comments from individuals and their viewpoints has brought new insight to topics, and since nobody wants to hear new insight on topics, Comment sections have not failed
Comments from individuals and their viewpoints has brought new insight to topics, but since everyone needs to hear new insight on topics, Comment sections have not failed
0
Comments from individuals and their viewpoints has brought new insight to topics, and since new insight on topics bothered nobody, Comment sections have not failed
Comments from individuals and their viewpoints has brought new insight to topics, but since new insight on topics bothered everyone, Comment sections have not failed
59 | 1
I enjoy the NYT comments, and since enjoyment was never the purpose of the comment sections, Comment sections have not failed
I enjoy the NYT comments, but since enjoyment was the purpose of the comment sections, Comment sections have not failed
0
I enjoy the NYT comments, and since the comment sections make enjoyment, Comment sections have not failed
I enjoy the NYT comments, but since the comment sections do not make enjoyment, Comment sections have not failed
60 | 0
We are able to take into consideration all views and come to a compromise, and since comments allow us to come to a compromise, Comment sections have not failed
We are able to take into consideration all views and come to a compromise, but since comments prevent us to come to a compromise, Comment sections have not failed
1
We are able to take into consideration all views and come to a compromise, and since compromise failed by comments, Comment sections have not failed
We are able to take into consideration all views and come to a compromise, but since compromise produced by comments, Comment sections have not failed
61 | 0
Iran intends to kill every non-shia believer, and since iran has killed people recently, Iran remains a threat
Iran intends to kill every non-shia believer, but since iran hasn't actually killed anyone recently, Iran remains a threat
1
Iran intends to kill every non-shia believer, and since people has sanctioned Iran recently, Iran remains a threat
Iran intends to kill every non-shia believer, and since people hasn't actually sanctioned Iran recently, Iran remains a threat
62 | 1
Comments section enable the democratic discussion of ideas, and since this discussion often degrades into name calling, Comment sections have not failed
Comments section enable the democratic discussion of ideas, but since this discussion often ascends into respectful name dropping, Comment sections have not failed
0
Comments section enable the democratic discussion of ideas, and since name calling often ascends into discussion , Comment sections have not failed
Comments section enable the democratic discussion of ideas, but since respectful name dropping often degrades into meaningless discussion , Comment sections have not failed
63 | 1
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, and since people will incorrectly self diagnose, Medical websites are healthful
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, but since people will correctly self diagnose, Medical websites are healthful
0
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, and since self diagnose help people , Medical websites are healthful
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, but since self diagnose misdirected people, Medical websites are healthful
64 | 1
The swimmers shouldn't have to swim in toxic water, and since the pools at the Olympics are sterilized with bleach, Brazil should postpone Olympics
The swimmers shouldn't have to swim in toxic water, but since the pools at the Olympics are not sterilized properly, Brazil should postpone Olympics
0
The swimmers shouldn't have to swim in toxic water, and since bleach polluted the pools at the Olympics, Brazil should postpone Olympics
The swimmers shouldn't have to swim in toxic water, but since bleach sterilized the pools at the Olympics, Brazil should postpone Olympics
65 | 1
Iran's nuclear capabilities is a cause for worry, and since there are ways to defend against nuclear threats, Iran remains a threat
Iran's nuclear capabilities is a cause for worry, but since there aren't ways to defend against nuclear threats, Iran remains a threat
0
Iran's nuclear capabilities is a cause for worry, and since nuclear threats could not be defended against, Iran remains a threat
Iran's nuclear capabilities is a cause for worry, but since nuclear threats could be defended against , Iran remains a threat
66 | 1
I wouldn't know about my illness without medical websites, and since I mis-diagnosed my illness, Medical websites are healthful
I wouldn't know about my illness without medical websites, but since I diagnosed my illness, Medical websites are healthful
0
I wouldn't know about my illness without medical websites, and since my illness directed me, Medical websites are healthful
I wouldn't know about my illness without medical websites, but since my illness misdirected me, Medical websites are healthful
67 | 1
Prescriptions drugs are more likely to be a gateway drug, and since marijuana is now available by prescription, Marijuana is not a gateway drug
Prescriptions drugs are more likely to be a gateway drug, but since marijuana is not always available by prescription, Marijuana is not a gateway drug
0
Prescriptions drugs are more likely to be a gateway drug, and since prescription allows marijuana now, Marijuana is not a gateway drug
Prescriptions drugs are more likely to be a gateway drug, but since prescription prohibits marijuana, Marijuana is not a gateway drug
68 | 1
Comment sections provide different views on opinion pieces, and since different views detract from the main article, Comment sections have not failed
Comment sections provide different views on opinion pieces, but since different views complement the main article, Comment sections have not failed
0
Comment sections provide different views on opinion pieces, and since the main article attracts different views, Comment sections have not failed
Comment sections provide different views on opinion pieces, but since the main article distracts different views, Comment sections have not failed
69 | 0
With good moderation, useful and interesting discussions can be had, and since most sections don't lack moderating, Comment sections have not failed
With good moderation, useful and interesting discussions can be had, but since most sections lack moderating and result in arguing and bullying, Comment sections have not failed
1
With good moderation, useful and interesting discussions can be had, and since moderation disappears in most sections, Comment sections have not failed
With good moderation, useful and interesting discussions can be had, but since moderation appears in most sections, Comment sections have not failed
70 | 1
Felons should not lose their rights, for even a day, and since voting is not a right, Felons should be allowed to vote
Felons should not lose their rights, for even a day, but since voting is a right, Felons should be allowed to vote
0
Felons should not lose their rights, for even a day, and since right allows voting, Felons should be allowed to vote
Felons should not lose their rights, for even a day, but since right prohibits voting, Felons should be allowed to vote
71 | 1
More guns will not provide more safety, and since less guns will lead to greater risks, Guns should not be permitted on college campuses
More guns will not provide more safety, but since less guns will lead to fewer risks, Guns should not be permitted on college campuses
0
More guns will not provide more safety, and since risks come along with guns, Guns should not be permitted on college campuses
More guns will not provide more safety, but since risks have no matter with guns, Guns should not be permitted on college campuses
72 | 1
Comment sections are just a propaganda device, and since propaganda is a powerful method of education, Comment sections have failed
Comment sections are just a propaganda device, but since propaganda is a powerful method of spreading falsehoods, Comment sections have failed
0
Comment sections are just a propaganda device, and since education rejects propaganda, Comment sections have failed
Comment sections are just a propaganda device, but since falsehoods do not need propaganda, Comment sections have failed
73 | 0
It is good to be informed about your health, and since you are able to find information online, Medical websites are healthful
It is good to be informed about your health, but since you aren't able to be diagnosed online, Medical websites are healthful
0
It is good to be informed about your health, and since information can be found online, Medical websites are healthful
It is good to be informed about your health, but since diagnosis cannot be conducted online, Medical websites are healthful
74 | 0
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, and since an act created by a single person or group is representative of the religion as a whole, Christians have created a harmful atmosphere for gays
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, but since an act created by a single person or group isn't representative of the religion as a whole, Christians have created a harmful atmosphere for gays
1
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, and since the religion as a whole can bail an act created by a single person or group , Christians have created a harmful atmosphere for gays
The Orlando gun shooting where 38 gay people were killed are an example of how Christian hate of LGBT people can be comparable to the holocaust, but since the religion as a whole cannot bail an act created by a single person or group, Christians have created a harmful atmosphere for gays
75 | 


--------------------------------------------------------------------------------
/Robust_commonsense_test/del.txt:
--------------------------------------------------------------------------------
 1 | 0
he struggled to make his nightmare not come true
he struggled to make his dream not come true
1
he struggled to make his nightmare come true
he struggled to make his dream come true
 2 | 1
my house is not a private place
my house is not a public place
0
my house is a private place
my house is a public place
 3 | 0
we need not to be friendly to our enemies
we need not to be friendly to our friends
1
we need to be friendly to our enemies
we need to be friendly to our friends
 4 | 0
the paper is not made from soil
the paper is not made from wood
1
the paper is made from soil
the paper is made from wood
 5 | 0
he did not receive any complaints at his birthday party
he did not receive any gifts at his birthday party
1
he received many complaints at his birthday party
he received many gifts at his birthday party
 6 | 1
when you borrowed a car you can not show it to others
when you borrowed a car you can not sell it to others
0
when you borrowed a car you can show it to others
when you borrowed a car you can sell it to others
 7 | 1
the Heartbeat is not faster in children than in adults normally
the Heartbeat is not slower in children than in adults normally
0
the Heartbeat is faster in children than in adults normally
the Heartbeat is slower in children than in adults normally
 8 | 1
the desk is not made of wood
the desk is not made of wool
0
the desk is made of wood
the desk is made of wool
 9 | 0
silk is not a common material for wedding rings
silk is not a common material for wedding gowns
1
silk is a common material for wedding rings
silk is a common material for wedding gowns
10 | 1
queuing is not a rule for good order
queuing is not a punishment for destroying order
0
queuing is a rule for good order
queuing is a punishment for destroying order
11 | 1
a campfire can not be nice on a cold night
a campfire can not be nice in a cold tent
0
a campfire can be nice on a cold night
a campfire can be nice in a cold tent
12 | 0
sleeping pills do not keep him warm in the wild
sleeping bags do not keep him warm in the wild
1
sleeping pills keep him warm in the wild
sleeping bags keep him warm in the wild
13 | 0
writing a story does not require a beautiful voice
writing a story does not require creativity
1
writing a story requires a beautiful voice
writing a story requires creativity
14 | 0
animals do not develop from seeds
plants do not develop from seeds
1
animals develop from seeds
plants develop from seeds
15 | 0
Dogs do not feed blood to their young ones
Dogs do not breed their young ones
1
Dogs can feed blood to their young ones
Dogs can feed milk to their young ones
16 | 0
they get out of an air-raid shelter to avoid bombs in the air-raid shelter
they go down to an air-raid shelter to avoid bombs in the air-raid shelter
1
they get out of an air-raid shelter to avoid bombs
they go down to an air-raid shelter to avoid bombs
17 | 0
Cosmetics can make me more ugly if use them in a wrong way
Cosmetics can make me more beautiful if use them in a wrong way
1
Cosmetics can make me more ugly
Cosmetics can make me more beautiful
18 | 0
tom fell in love but that girl broke his heart
tom fell in love but that girl broke his arm
1
tom fell and broke his heart
tom fell and broke his arm
19 | 1
my sister eats an apple which is made by lime after breakfast every day
my sister eats a stone which is made by meat after breakfast every day
0
my sister eats an apple after breakfast every day
my sister eats a stone after breakfast every day
20 | 1
a man can hardly see stars and the moon drawn in picture in daytime
a man can better see stars and the moon drawn in picture in daytime
0
a man can hardly see stars and the moon in daytime
a man can better see stars and the moon in daytime
21 | 1
I put the rubbish into a trash can shaped mailbox
I put the rubbish into a mailbox shaped trash can
0
I put the rubbish into a trash can
I put the rubbish into a mailbox
22 | 1
I had a sweet pipe dream when I was asleep yesterday
I had a sweet pipe dream when I was awake yesterday
0
I had a sweet dream when I was asleep yesterday
I had a sweet dream when I was awake yesterday
23 | 1
Alice became sad after felt left out by her annoying friends
Alice became joyful after felt left out by her annoyingfriends
0
Alice became sad after felt left out by her friends
Alice became joyful after felt left out by her friends
24 | 0
Bob played hard to prepare for the physical fitness examination
Bob studied hard to prepare for the physical fitness examination
1
Bob played hard to prepare for the examination
Bob studied hard to prepare for the examination
25 | 0
I was humiliated by him decades ago but now we are reconciled so I had better friendship with him
I was humiliated by him decades ago but now we are reconciled so I broke up with him
1
I was humiliated by him so I had better friendship with him
I was humiliated by him so I broke up with him
26 | 0
plastic is the main ingredient in candy shaped toys
sugar is the main ingredient in candy shaped toys
1
plastic is the main ingredient in candy
sugar is the main ingredient in candy
27 | 1
we use a handsaw to cut wood shaped cakes
we use a penknife to cut wood shaped cakes
0
we use a handsaw to cut wood
we use a penknife to cut wood
28 | 0
she is sad to play with her annoying friends
she is happy to play with her annoying friends
1
she is sad to play with her friends
she is happy to play with her friends
29 | 1
Anna not did a lot better than her good friend Lucy on the test because anna had studied so hard.
Anna not did a lot better than her good friend Lucy on the test because lucy had studied so hard.
0
Anna did a lot better than her good friend Lucy on the test because anna had studied so hard.
Anna did a lot better than her good friend Lucy on the test because lucy had studied so hard.
30 | 1
Ann did not ask Mary what time the library closes, because ann had forgotten.
Ann did not ask Mary what time the library closes, because mary had forgotten.
0
Ann asked Mary what time the library closes, because ann had forgotten.
Ann asked Mary what time the library closes, because mary had forgotten.
31 | 0
Ann asked Mary what time the library closes, but ann had not forgotten.
Ann asked Mary what time the library closes, but mary had not forgotten.
1
Ann asked Mary what time the library closes, but ann had forgotten.
Ann asked Mary what time the library closes, but mary had forgotten.
32 | 1
Bob paid for Charlie's college education. bob is not very rich.
Bob paid for Charlie's college education. charlie is not very rich.
0
Bob paid for Charlie's college education. bob is very rich.
Bob paid for Charlie's college education. charlie is very rich.
33 | 1
Bob paid for Charlie's college education, but now Charlie acts as thoughit never happened. bob is not hurt.
Bob paid for Charlie's college education, but now Charlie acts as thoughit never happened. charlie is not hurt.
0
Bob paid for Charlie's college education, but now Charlie acts as thoughit never happened. bob is very hurt.
Bob paid for Charlie's college education, but now Charlie acts as thoughit never happened. charlie is very hurt.
34 | 1
Bob was playing cards with Adam and was way ahead. If Adam had asudden run of good luck, bob would have won.
Bob was playing cards with Adam and was way ahead. If Adam had asudden run of good luck, adam would have won.
0
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, bob would have won.
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, adam would have won.
35 | 0
Bob was playing cards with Adam and was way ahead. If Adam had asudden run of good luck, bob would have lost.
Bob was playing cards with Adam and was way ahead. If Adam had asudden run of good luck, adam would have lost.
1
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, bob would have lost.
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, adam would have lost.
36 | 1
If the con artist has not succeeded in fooling Sam, the con artist would have gotten a lot of money.
If the con artist has not succeeded in fooling Sam, sam would have gotten a lot of money.
0
If the con artist has succeeded in fooling Sam, the con artist would have gotten a lot of money.
If the con artist has succeeded in fooling Sam, sam would have gotten a lot of money.
37 | 0
If the con artist has not succeeded in fooling Sam, the con artist would have lost a lot of money.
If the con artist has not succeeded in fooling Sam, sam would have lost a lot of money.
1
If the con artist has succeeded in fooling Sam, the con artist would have lost a lot of money.
If the con artist has succeeded in fooling Sam, sam would have lost a lot of money.
38 | 1
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. bob was not ill.
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. carl was not ill.
0
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. bob was very ill.
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. carl was very ill.
39 | 1
Joe has sold his house and bought a new one a few miles away. He will not be moving out of the old house.
Joe has sold his house and bought a new one a few miles away. He will not be moving out of the new house.
0
Joe has sold his house and bought a new one a few miles away. He willbe moving out of the old house.
Joe has sold his house and bought a new one a few miles away. He willbe moving out of the new house.
40 | 0
Joe has sold his house and bought a new one a few miles away. He will not be moving into the old house.
Joe has sold his house and bought a new one a few miles away. He will not be moving into the new house.
1
Joe has sold his house and bought a new one a few miles away. He willbe moving into the old house.
Joe has sold his house and bought a new one a few miles away. He willbe moving into the new house.
41 | 0
Sam did not take French classes from Adam, because sam was known to speak it fluently.
Sam did not take French classes from Adam, because adam was known to speak it fluently.
1
Sam took French classes from Adam, because sam was known to speak it fluently.
Sam took French classes from Adam, because adam was known to speak it fluently.
42 | 1
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was short, so it worked out to find my carriage quickly.
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was short, so it worked out to find my carriage quickly.
0
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was short, so it worked out.
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was short, so it worked out.
43 | 0
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was delayed to next week, so it worked out.
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was delayed to next week, so it worked out.
1
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was delayed, so it worked out.
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was delayed, so it worked out.
44 | 1
There is a bright pillar between me and the blur stage, and I can't see around the pillar .
There is a bright pillar between me and the blur stage, and I can't see around the stage .
0
There is a pillar between me and the stage, and I can't see around the pillar .
There is a pillar between me and the stage, and I can't see around the stage .
45 | 0
There is a blur pillar between me and the bright stage, and I can't see the pillar .
There is a blur pillar between me and the bright stage, and I can't see the stage .
1
There is a pillar between me and the stage, and I can't see the pillar .
There is a pillar between me and the stage, and I can't see the stage .
46 | 1
They broadcast an announcement, but a silent subway came into the station and I couldn't hear the announcement .
They broadcast an announcement, but a silent subway came into the station and I couldn't hear the subway .
0
They broadcast an announcement, but a subway came into the station and I couldn't hear the announcement .
They broadcast an announcement, but a subway came into the station and I couldn't hear the subway .
47 | 1
In the middle of the outdoor concert, the rain started falling and the weather forecast said the rain would end in ten minutes, but the concert continued until 10.
In the middle of the outdoor concert, the rain started falling and the weather forecast said the rain would end in ten minutes. but the rain continued until 10.
0
In the middle of the outdoor concert, the rain started falling, but the concert continued until 10.
In the middle of the outdoor concert, the rain started falling, but the rain continued until 10.
48 | 0
In the middle of the outdoor concert, the rain started falling and stopped at 10, and the concert continued until 10.
In the middle of the outdoor concert, the rain started falling and stopped at 10, and the rain continued until 10.
1
In the middle of the outdoor concert, the rain started falling, and the concert continued until 10.
In the middle of the outdoor concert, the rain started falling, and the rain continued until 10.
49 | 1
I used an old rag to clean the even more older knife, and then I put the rag in the trash.
I used an old rag to clean the even more older knife, and then I put the knife in the trash.
0
I used an old rag to clean the knife, and then I put the rag in the trash.
I used an old rag to clean the knife, and then I put the knife in the trash.
50 | 0
I used an old rag to clean the knife, and then I put the rag in theclothing  drawer.
I used an old rag to clean the knife, and then I put the knife in the clothing drawer.
1
I used an old rag to clean the knife, and then I put the rag in the drawer.
I used an old rag to clean the knife, and then I put the knife in the drawer.
51 | 1
Ann deliberately asked Mary what time the library closes to remind mary, because ann had forgotten.
Ann deliberately asked Mary what time the library closes to remind mary, because mary had forgotten.
0
Ann asked Mary what time the library closes, because ann had forgotten.
Ann asked Mary what time the library closes, because mary had forgotten.
52 | 0
Ann asked Mary what time the library closes and Mary answered her, but ann had forgotten again.
Ann asked Mary what time the library closes and Mary answered her, but mary had forgotten again.
1
Ann asked Mary what time the library closes, but ann had forgotten.
Ann asked Mary what time the library closes, but mary had forgotten.
53 | 0
I took the water bottle out of the backpack and pour water out, so that the water bottle would be lighter.
I took the water bottle out of the backpack and pour water out, so that the backpack would be lighter.
1
I took the water bottle out of the backpack so that the water bottle would be lighter.
I took the water bottle out of the backpack so that the backpack would be lighter.
54 | 1
I'm sure that my map will show this building; the map is very good to detect.
I'm sure that my map will show this building; the building is very good to detect.
0
I'm sure that my map will show this building; the map is very good.
I'm sure that my map will show this building; the building is very good.
55 | 1
They add a lot to the piece and I look forward to reading comments, and since comments sections are a welcome distraction from my work, Comment sections have failed
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work, Comment sections have failed
0
They add a lot to the piece and I look forward to reading comments, and since comments sections are a welcome distraction from my work, Comment sections have not failed
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work, Comment sections have not failed
56 | 1
Many comments are thoughful and insightful, and since the rest of the comments can be skipped easily, Comment sections have failed
Many comments are thoughful and insightful, but since the rest of the comments make the section unreadable, Comment sections have failed
0
Many comments are thoughful and insightful, and since the rest of the comments can be skipped easily, Comment sections have not failed
Many comments are thoughful and insightful, but since the rest of the comments make the section unreadable, Comment sections have not failed
57 | 0
People can choose not to use Google, and since all other search engines re-direct to google, Google is a harmful monopoly
People can choose not to use Google, but since other search engines do not re-direct to google, Google is a harmful monopoly
1
People can choose not to use Google, and since all other search engines re-direct to google, Google is not a harmful monopoly
People can choose not to use Google, but since other search engines do not re-direct to google, Google is not a harmful monopoly
58 | 1
Ginsberg is brave for speaking out, and since it does not show that she will be biased against anything that has anything to do with Trump, Supreme court justice cannot denounce a candidate
Ginsberg is brave for speaking out, but since it shows she will be biased against anything that has anything to do with Trump, Supreme court justice cannot denounce a candidate
0
Ginsberg is brave for speaking out, and since it does not show that she will be biased against anything that has anything to do with Trump, Supreme court justice can denounce a candidate
Ginsberg is brave for speaking out, but since it shows she will be biased against anything that has anything to do with Trump, Supreme court justice can denounce a candidate
59 | 0
Attending the Olympics will risk the health of participants and fans as well as their families and entire countries, and since a huge pandemic would be a great news story, Brazil should not postpone Olympics
Attending the Olympics will risk the health of participants and fans as well as their families and entire countries, but since a huge pandemic would not be a great news story, Brazil should not postpone Olympics
1
Attending the Olympics will risk the health of participants and fans as well as their families and entire countries, and since a huge pandemic would be a great news story, Brazil should postpone Olympics
Attending the Olympics will risk the health of participants and fans as well as their families and entire countries, but since a huge pandemic would not be a great news story, Brazil should postpone Olympics
60 | 0
The justice is using her role as a citizen not a judge to speak and Trump is an enemy of law, and since the role of a citizen and a supreme court justice are inseparable, Supreme court justice cannot denounce a candidate
The justice is using her role as a citizen not a judge to speak and Trump is an enemy of law, but since the role of a citizen and a supreme court justice are separable, Supreme court justice cannot denounce a candidate
1
The justice is using her role as a citizen not a judge to speak and Trump is an enemy of law, and since the role of a citizen and a supreme court justice are inseparable, Supreme court justice can denounce a candidate
The justice is using her role as a citizen not a judge to speak and Trump is an enemy of law, but since the role of a citizen and a supreme court justice are separable, Supreme court justice can denounce a candidate
61 | 1
The reading public can use comments sections to voice their opinion on media, and since a majority of these comments are not trolls or arguments about preferences., Comment sections have failed
The reading public can use comments sections to voice their opinion on media, but since a majority of these comments are trolls or arguments about preferences., Comment sections have failed
0
The reading public can use comments sections to voice their opinion on media, and since a majority of these comments are not trolls or arguments about preferences., Comment sections have not failed
The reading public can use comments sections to voice their opinion on media, but since a majority of these comments are trolls or arguments about preferences., Comment sections have not failed
62 | 0
I find the idea that it is a sin to be born or live a life at all to be preposterous, and since being gay isn't considered a sin, Christians have not created a harmful atmosphere for gays
I find the idea that it is a sin to be born or live a life at all to be preposterous, but since being gay is considered a sin, Christians have not created a harmful atmosphere for gays
1
I find the idea that it is a sin to be born or live a life at all to be preposterous, and since being gay isn't considered a sin, Christians have created a harmful atmosphere for gays
I find the idea that it is a sin to be born or live a life at all to be preposterous, but since being gay is considered a sin, Christians have created a harmful atmosphere for gays
63 | 1
Comments sections permit a reader to analyze many different perspectives in one place, and since I want to see all these ideas, even stupid ones, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas, Comment sections have failed
0
Comments sections permit a reader to analyze many different perspectives in one place, and since I want to see all these ideas, even stupid ones, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas, Comment sections have not failed
64 | 0
Comment sections provide insight, and since they can cause explosive meaningless arguments, Comment sections have failed
Comment sections provide insight, but since they can cause quiet meaningful debates, Comment sections have failed
1
Comment sections provide insight, and since they can cause explosive meaningless arguments, Comment sections have not failed
Comment sections provide insight, but since they can cause quiet meaningful debates, Comment sections have not failed
65 | 1
There should be seating standards, and baggage fees should be waived for those in TSA line over 45 minutes, and since these standards are government's responsibility, Government should not regulate airline industry again
There should be seating standards, and baggage fees should be waived for those in TSA line over 45 minutes, but since these standards are not government's responsibility, Government should not regulate airline industry again
0
There should be seating standards, and baggage fees should be waived for those in TSA line over 45 minutes, and since these standards are government's responsibility, Government should regulate airline industry again
There should be seating standards, and baggage fees should be waived for those in TSA line over 45 minutes, but since these standards are not government's responsibility, Government should regulate airline industry again
66 | 0
Pot hasn't led me to lose control, and since some people can't control their addiction, Marijuana is a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction, Marijuana is a gateway drug
1
Pot hasn't led me to lose control, and since some people can't control their addiction, Marijuana is not a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction, Marijuana is not a gateway drug
67 | 1
It is good to be informed about your health, and since you are not able to find information online, Medical websites are healthful
It is good to be informed about your health, but since you are able to be diagnosed online, Medical websites are healthful
0
It is good to be informed about your health, and since you are able to find information online, Medical websites are healthful
It is good to be informed about your health, but since you aren't able to be diagnosed online, Medical websites are healthful
68 | 1
They add a lot to the piece and I look forward to reading comments, but since comments sections are a distraction from my work, Comment sections have not failed
They add a lot to the piece and I look forward to reading comments, and since comments sections always distract me from my work when I am tired from work, Comment sections have not failed
0
They add a lot to the piece and I look forward to reading comments, and since comments sections are a welcome distraction from my work, Comment sections have not failed
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work, Comment sections have not failed
69 | 0
They add a lot to the piece and I look forward to reading comments, and since comments sections are a distraction from my work, Comment sections have failed
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work when I am tired from work, Comment sections have failed
1
They add a lot to the piece and I look forward to reading comments, and since comments sections are a welcome distraction from my work, Comment sections have failed
They add a lot to the piece and I look forward to reading comments, but since comments sections always distract me from my work, Comment sections have failed
70 | 1
Many comments are thoughful and insightful, but since the rest of the comments can be skipped easily and make information lost, Comment sections have not failed
Many comments are thoughful and insightful, and since the rest of the comments seldom make the section unreadable, Comment sections have not failed
0
Many comments are thoughful and insightful, and since the rest of the comments can be skipped easily, Comment sections have not failed
Many comments are thoughful and insightful, but since the rest of the comments make the section unreadable, Comment sections have not failed
71 | 0
Many comments are thoughful and insightful, and since the rest of the comments can be skipped easily and make information lost, Comment sections have failed
Many comments are thoughful and insightful, but since the rest of the comments sledom make the section unreadable, Comment sections have failed
1
Many comments are thoughful and insightful, and since the rest of the comments can be skipped easily, Comment sections have failed
Many comments are thoughful and insightful, but since the rest of the comments make the section unreadable, Comment sections have failed
72 | 1
Comments sections permit a reader to analyze many different perspectives in one place, and since I seldom want to see all these ideas, even stupid ones, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas and I can skip them easily, Comment sections have not failed
0
Comments sections permit a reader to analyze many different perspectives in one place, and since I want to see all these ideas, even stupid ones, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas, Comment sections have not failed
73 | 0
Comments sections permit a reader to analyze many different perspectives in one place, and since I seldom want to see all these ideas, even stupid ones, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas and I can skip them easily, Comment sections have failed
1
Comments sections permit a reader to analyze many different perspectives in one place, and since I want to see all these ideas, even stupid ones, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since I don't want to see all these stupid ideas, Comment sections have failed
74 | 0
Comment sections provide insight, and since they can cause explosive meaningless arguments which stimulate media development, Comment sections have not failed
Comment sections provide insight, but since they can cause quiet meaningful debates which end meaninglessly and waste readers' time, Comment sections have not failed
1
Comment sections provide insight, and since they can cause explosive meaningless arguments, Comment sections have not failed
Comment sections provide insight, but since they can cause quiet meaningful debates, Comment sections have not failed
75 | 1
Comment sections provide insight, and since they can cause explosive meaningless arguments, Comment sections have failed
Comment sections provide insight, but since they can cause quiet meaningful debates which end meaninglessly and waste readers‘ time, Comment sections have failed
0
Comment sections provide insight, and since they can cause explosive meaningless arguments, Comment sections have failed
Comment sections provide insight, but since they can cause quiet meaningful debates, Comment sections have failed
76 | 0
Pot hasn't led me to lose control, and since some people can't control their addiction only in rare cases, Marijuana is not a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction only under the help of doctors but not by themselves, Marijuana is not a gateway drug
1
Pot hasn't led me to lose control, and since some people can't control their addiction, Marijuana is not a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction, Marijuana is not a gateway drug
77 | 1
Pot hasn't led me to lose control, and since some people can't control their addiction in rare cases, Marijuana is a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction only under the help of doctors but not by themselves, Marijuana is a gateway drug
0
Pot hasn't led me to lose control, and since some people can't control their addiction, Marijuana is a gateway drug
Pot hasn't led me to lose control, but since most people can control their addiction, Marijuana is a gateway drug
78 | 1
It is good to be informed about your health, and since you are able to find information online which may lack reliability and accuracy, Medical websites are healthful
It is good to be informed about your health, but since you aren't able to be diagnosed online which lack reliability and accuracy, Medical websites are healthful
0
It is good to be informed about your health, and since you are able to find information online, Medical websites are healthful
It is good to be informed about your health, but since you aren't able to be diagnosed online, Medical websites are healthful
79 | 0
It is good to be informed about your health, and since you are not able to find information online which may lack reliability and accuracy, Medical websites are healthful
It is good to be informed about your health, but since you are able to be diagnosed online which lack reliability and accuracy, Medical websites are healthful
1
It is good to be informed about your health, and since you are not able to find information online, Medical websites are healthful
It is good to be informed about your health, but since you are able to be diagnosed online, Medical websites are healthful
80 | 0
Comments are informative, and since Information isn't that important in rare cases, Comment sections have not failed
Comments are informative, but since Information is important only when it is targeted, Comment sections have not failed
1
Comments are informative, and since Information isn't that important., Comment sections have not failed
Comments are informative, but since Information is important., Comment sections have not failed
81 | 1
Comments are informative, and since Information isn't that important in rare cases, Comment sections have failed
Comments are informative, but since Information is important only when it is targeted, Comment sections have failed
0
Comments are informative, and since Information isn't that important., Comment sections have failed
Comments are informative, but since Information is important., Comment sections have failed
82 | 0
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives in rare cases, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives only if them are correct, Comment sections have not failed
1
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives, Comment sections have not failed
83 | 


--------------------------------------------------------------------------------
/commonsense_ability_test/ca.txt:
--------------------------------------------------------------------------------
  1 | 0
The trophy doesn't fit into the brown suitcase because the trophy is too large.
The trophy doesn't fit into the brown suitcase and the trophy is too large.
  2 | 1
The trophy doesn't fit into the brown suitcase and the suitcase is too small.
The trophy doesn't fit into the brown suitcase because the suitcase is too small.
  3 | 0
Paul tried to call George on the phone, but paul wasn't successful.
Paul tried to call George on the phone, and paul wasn't successful.
  4 | 1
Paul tried to call George on the phone, and george wasn't available.
Paul tried to call George on the phone, but george wasn't available.
  5 | 0
The lawyer asked the witness a question, but the lawyer was reluctant to repeat it.
The lawyer asked the witness a question, and the lawyer was reluctant to repeat it.
  6 | 0
The lawyer asked the witness a question, but the witness was reluctant to answer it.
The lawyer asked the witness a question, and the witness was reluctant to answer it.
  7 | 1
The delivery truck zoomed by the school bus and the delivery truck was going so fast.
The delivery truck zoomed by the school bus because the delivery truck was going so fast.
  8 | 0
The delivery truck zoomed by the school bus because the school bus was going so slow.
The delivery truck zoomed by the school bus and the school bus was going so slow.
  9 | 0
Frank felt vindicated when his longtime rival Bill revealed that frank was the winner of the competition.
Frank felt vindicated before his longtime rival Bill revealed that frank was the winner of the competition.
 10 | 1
Frank felt crushed before his longtime rival Bill revealed that bill was the winner of the competition.
Frank felt crushed when his longtime rival Bill revealed that bill was the winner of the competition.
 11 | 1
The man couldn't lift his son and the man was so weak.
The man couldn't lift his son because the man was so weak.
 12 | 1
The man couldn't lift his son and the son was so heavy.
The man couldn't lift his son because the son was so heavy.
 13 | 1
The large ball crashed right through the table and the large ball was made of steel.
The large ball crashed right through the table because the large ball was made of steel.
 14 | 0
The large ball crashed right through the table because the table was made of styrofoam.
The large ball crashed right through the table and the table was made of styrofoam.
 15 | 1
John couldn't see the stage with Billy in front of him and john is so short.
John couldn't see the stage with Billy in front of him because john is so short.
 16 | 1
John couldn't see the stage with Billy in front of him and billy is so tall.
John couldn't see the stage with Billy in front of him because billy is so tall.
 17 | 1
Although they ran at about the same speed, Sue beat Sally and sue had such a good start.
Although they ran at about the same speed, Sue beat Sally because sue had such a good start.
 18 | 1
Although they ran at about the same speed, Sue beat Sally and sally had such a bad start.
Although they ran at about the same speed, Sue beat Sally because sally had such a bad start.
 19 | 1
The sculpture rolled off the shelf and the sculpture wasn't anchored.
The sculpture rolled off the shelf because the sculpture wasn't anchored.
 20 | 1
The sculpture rolled off the shelf and the shelf wasn't level.
The sculpture rolled off the shelf because the shelf wasn't level.
 21 | 1
Anna did a lot better than her good friend Lucy on the test and anna had studied so hard.
Anna did a lot better than her good friend Lucy on the test because anna had studied so hard.
 22 | 1
Anna did a lot worse than her good friend Lucy on the test and lucy had studied so hard.
Anna did a lot worse than her good friend Lucy on the test because lucy had studied so hard.
 23 | 0
The firemen arrived after the police because the firemen were coming from so far away.
The firemen arrived after the police and the firemen were coming from so far away.
 24 | 0
The firemen arrived before the police because the police were coming from so far away.
The firemen arrived when the police because the police were coming from so far away.
 25 | 0
The firemen arrived before the police because the police were coming from so far away.
The firemen arrived before the police and the police were coming from so far away.
 26 | 0
Frank was upset with Tom because the toaster frank had bought from him didn't work.
Frank was upset with Tom and the toaster frank had bought from him didn't work.
 27 | 1
Frank was upset with Tom and the toaster tom had sold him didn't work.
Frank was upset with Tom because the toaster tom had sold him didn't work.
 28 | 1
Jim yelled at Kevin and jim was so upset.
Jim yelled at Kevin because jim was so upset.
 29 | 0
Jim comforted Kevin because kevin was so upset.
Jim comforted Kevin and kevin was so upset.
 30 | 0
Pete envies Martin because martin is very successful.
Pete envies Martin and martin is very successful.
 31 | 1
Susan knows all about Ann's personal problems but susan is nosy.
Susan knows all about Ann's personal problems because susan is nosy.
 32 | 1
Susan knows all about Ann's personal problems but ann is indiscreet.
Susan knows all about Ann's personal problems because ann is indiscreet.
 33 | 0
Sid explained his theory to Mark but sid couldn't convince him.
Sid explained his theory to Mark and sid couldn't convince him.
 34 | 0
Sid explained his theory to Mark but mark couldn't understand him.
Sid explained his theory to Mark and mark couldn't understand him.
 35 | 0
Susan knew that Ann's son had been in a car accident, because ann told her about it.
Susan knew that Ann's son had been in a car accident, and ann told her about it.
 36 | 0
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was short, so it worked out.
My meeting started at 4:00 but I needed to catch the train at 4:30, so there wasn't much time. Luckily, the meeting was short, so it worked out.
 37 | 0
My meeting started at 4:00 and I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was delayed, so it worked out.
My meeting started at 4:00 but I needed to catch the train at 4:30, so there wasn't much time. Luckily, the train was delayed, so it worked out.
 38 | 1
There is a pillar between me and the stage, because I can't see around the pillar .
There is a pillar between me and the stage, and I can't see around the pillar .
 39 | 1
They broadcast an announcement, before a subway came into the station and I couldn't hear the announcement .
They broadcast an announcement, but a subway came into the station and I couldn't hear the announcement .
 40 | 1
They broadcast an announcement, but a subway came into the station because I couldn't hear the announcement .
They broadcast an announcement, but a subway came into the station and I couldn't hear the announcement .
 41 | 0
They broadcast an announcement, but a subway came into the station and I couldn't hear over the subway .
They broadcast an announcement, because a subway came into the station and I couldn't hear over the subway .
 42 | 0
They broadcast an announcement, but a subway came into the station and I couldn't hear over the subway .
They broadcast an announcement, but a subway came into the station because I couldn't hear over the subway .
 43 | 0
In the middle of the outdoor concert, the rain started falling, but the concert continued until 10.
In the middle of the outdoor concert, the rain started falling, because the concert continued until 10.
 44 | 1
In the middle of the outdoor concert, the rain started falling, but the rain continued until 10.
In the middle of the outdoor concert, the rain started falling, and the rain continued until 10.
 45 | 1
I used an old rag to clean the knife, but then I put the rag in the trash.
I used an old rag to clean the knife, and then I put the rag in the trash.
 46 | 1
I used an old rag to clean the knife, but then I put the knife in the drawer.
I used an old rag to clean the knife, and then I put the knife in the drawer.
 47 | 0
Ann asked Mary what time the library closes, because ann had forgotten.
Ann asked Mary what time the library closes, but ann had forgotten.
 48 | 1
Ann asked Mary what time the library closes, because mary had forgotten.
Ann asked Mary what time the library closes, but mary had forgotten.
 49 | 1
I couldn't put the pot on the shelf but the pot was too tall.
I couldn't put the pot on the shelf because the pot was too tall.
 50 | 0
I couldn't put the pot on the shelf because the shelf was too high.
I couldn't put the pot on the shelf but the shelf was too high.
 51 | 1
Bob was playing cards with Adam but was way ahead. If Adam hadn't had asudden run of good luck, bob would have won.
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, bob would have won.
 52 | 0
Bob was playing cards with Adam and was way ahead. If Adam hadn't had asudden run of good luck, adam would have lost.
Bob was playing cards with Adam but was way ahead. If Adam hadn't had asudden run of good luck, adam would have lost.
 53 | 1
It was a summer afternoon, but the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the dog was hot.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the dog was hot.
 54 | 1
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up but moved to a spot under the tree, because the dog was hot.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the dog was hot.
 55 | 0
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the dog was hot.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, and the dog was hot.
 56 | 1
It was a summer afternoon, but the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the spot under the tree was cooler.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the spot under the tree was cooler.
 57 | 1
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up but moved to a spot under the tree, because the spot under the tree was cooler.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the spot under the tree was cooler.
 58 | 1
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, and the spot under the tree was cooler.
It was a summer afternoon, and the dog was sitting in the middle of thelawn. After a while, it got up and moved to a spot under the tree, because the spot under the tree was cooler.
 59 | 0
The cat was lying by the mouse hole waiting for the mouse, but the cat was too impatient.
The cat was lying by the mouse hole waiting for the mouse, and the cat was too impatient.
 60 | 0
The cat was lying by the mouse hole waiting for the mouse, but the mouse was too cautious.
The cat was lying by the mouse hole waiting for the mouse, and the mouse was too cautious.
 61 | 0
I saw Jim yelling at some guy in a military uniform with a huge red beard. I don't know why jim was, but he looked very unhappy.
I saw Jim yelling at some guy in a military uniform with a huge red beard. I don't know why jim was, and he looked very unhappy.
 62 | 0
I saw Jim yelling at some guy in a military uniform with a huge red beard. I don't know who the guy in uniform was, but he looked very unhappy.
I saw Jim yelling at some guy in a military uniform with a huge red beard. I don't know who the guy in uniform was, and he looked very unhappy.
 63 | 0
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, and I couldn't get the key in.
I was trying to open the lock with the key, and someone had filled the keyhole with chewing gum, and I couldn't get the key in.
 64 | 0
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, and I couldn't get the key in.
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, but I couldn't get the key in.
 65 | 0
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, and I couldn't get the chewing gum out.
I was trying to open the lock with the key, and someone had filled the keyhole with chewing gum, and I couldn't get the chewing gum out.
 66 | 0
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, and I couldn't get the chewing gum out.
I was trying to open the lock with the key, but someone had filled the keyhole with chewing gum, but I couldn't get the chewing gum out.
 67 | 1
In the storm, the tree fell down but crashed through the roof of my house. Now, I have to get the tree removed.
In the storm, the tree fell down and crashed through the roof of my house. Now, I have to get the tree removed.
 68 | 1
In the storm, the tree fell down but crashed through the roof of my house. Now, I have to get the roof repaired.
In the storm, the tree fell down and crashed through the roof of my house. Now, I have to get the roof repaired.
 69 | 0
The customer walked into the bank and stabbed one of the tellers. the customer was immediately taken to the police station.
The customer walked into the bank but stabbed one of the tellers. the customer was immediately taken to the police station.
 70 | 1
The customer walked into the bank but stabbed one of the tellers. the teller was immediately taken to the hospital.
The customer walked into the bank and stabbed one of the tellers. the teller was immediately taken to the hospital.
 71 | 1
John was doing research in the library before he heard a man humming and whistling. john was very annoyed.
John was doing research in the library when he heard a man humming and whistling. john was very annoyed.
 72 | 1
John was doing research in the library when he heard a man humming but whistling. john was very annoyed.
John was doing research in the library when he heard a man humming and whistling. john was very annoyed.
 73 | 1
John was doing research in the library before he heard a man humming and whistling. the man was very annoying.
John was doing research in the library when he heard a man humming and whistling. the man was very annoying.
 74 | 0
John was doing research in the library when he heard a man humming and whistling. the man was very annoying.
John was doing research in the library when he heard a man humming but whistling. the man was very annoying.
 75 | 0
John was jogging through the park when he saw a man juggling watermelons. john was very impressed.
John was jogging through the park before he saw a man juggling watermelons. john was very impressed.
 76 | 1
John was jogging through the park before he saw a man juggling watermelons. the juggler was very impressive.
John was jogging through the park when he saw a man juggling watermelons. the juggler was very impressive.
 77 | 1
Sam and Amy are passionately in love, and Amy's parents are unhappyabout it, because sam and amy are fifteen.
Sam and Amy are passionately in love, but Amy's parents are unhappyabout it, because sam and amy are fifteen.
 78 | 0
Sam and Amy are passionately in love, but Amy's parents are unhappyabout it, because amy's parents are snobs.
Sam and Amy are passionately in love, and Amy's parents are unhappyabout it, because amy's parents are snobs.
 79 | 0
Sam and Amy are passionately in love, but Amy's parents are unhappyabout it, because amy's parents are snobs.
Sam and Amy are passionately in love, but Amy's parents are unhappyabout it, and amy's parents are snobs.
 80 | 0
Joe has sold his house and bought a new one a few miles away. He willbe moving out of the old house on Thursday.
Joe has sold his house but bought a new one a few miles away. He willbe moving out of the old house on Thursday.
 81 | 0
Joe has sold his house and bought a new one a few miles away. He willbe moving into the new house on Thursday.
Joe has sold his house but bought a new one a few miles away. He willbe moving into the new house on Thursday.
 82 | 1
Many people start to read Paul's books but can't put them down. people are gripped because Paul writes so well.
Many people start to read Paul's books and can't put them down. people are gripped because Paul writes so well.
 83 | 1
Many people start to read Paul's books and can't put them down. people are gripped and Paul writes so well.
Many people start to read Paul's books and can't put them down. people are gripped because Paul writes so well.
 84 | 1
Many people start to read Paul's books but can't put them down. paul's books are popular because Paul writes so well.
Many people start to read Paul's books and can't put them down. paul's books are popular because Paul writes so well.
 85 | 1
Many people start to read Paul's books and can't put them down. paul's books are popular and Paul writes so well.
Many people start to read Paul's books and can't put them down. paul's books are popular because Paul writes so well.
 86 | 0
Mary took out her flute and played one of her favorite pieces. Shehas had the flute since she was a child.
Mary took out her flute but played one of her favorite pieces. Shehas had the flute since she was a child.
 87 | 0
Mary took out her flute and played one of her favorite pieces. Shehas loved the piece since she was a child.
Mary took out her flute but played one of her favorite pieces. Shehas loved the piece since she was a child.
 88 | 1
Sam pulled up a chair to the piano, and the chair was broken, so he had to stand instead.
Sam pulled up a chair to the piano, but the chair was broken, so he had to stand instead.
 89 | 1
Sam pulled up a chair to the piano, and the piano was broken, so he had to sing instead.
Sam pulled up a chair to the piano, but the piano was broken, so he had to sing instead.
 90 | 0
Sara borrowed the book from the library because she needs it for anarticle she is working on. She reads the book when she gets home from work.
Sara borrowed the book from the library and she needs it for anarticle she is working on. She reads the book when she gets home from work.
 91 | 0
Sara borrowed the book from the library because she needs it for anarticle she is working on. She reads the book when she gets home from work.
Sara borrowed the book from the library because she needs it for anarticle she is working on. She reads the book before she gets home from work.
 92 | 1
Sara borrowed the book from the library and she needs it for anarticle she is working on. She writes the article when she gets home from work.
Sara borrowed the book from the library because she needs it for anarticle she is working on. She writes the article when she gets home from work.
 93 | 1
Sara borrowed the book from the library because she needs it for anarticle she is working on. She writes the article before she gets home from work.
Sara borrowed the book from the library because she needs it for anarticle she is working on. She writes the article when she gets home from work.
 94 | 1
This morning, Joey built a sand castle on the beach, but put a toy flag in the highest tower, but this afternoon the tide knocked the sand castle down.
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, but this afternoon the tide knocked the sand castle down.
 95 | 1
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, and this afternoon the tide knocked the sand castle down.
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, but this afternoon the tide knocked the sand castle down.
 96 | 1
This morning, Joey built a sand castle on the beach, but put a toy flag in the highest tower, but this afternoon the wind knocked the flag down.
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, but this afternoon the wind knocked the flag down.
 97 | 0
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, but this afternoon the wind knocked the flag down.
This morning, Joey built a sand castle on the beach, and put a toy flag in the highest tower, and this afternoon the wind knocked the flag down.
 98 | 1
Jane knocked on Susan's door, and there was no answer. jane was disappointed.
Jane knocked on Susan's door, but there was no answer. jane was disappointed.
 99 | 1
Jane knocked on Susan's door, and there was no answer. susan was out.
Jane knocked on Susan's door, but there was no answer. susan was out.
100 | 0
Jane knocked on the door, and Susan answered it. jane invited her to come out.
Jane knocked on the door, but Susan answered it. jane invited her to come out.
101 | 0
Jane knocked on the door, and Susan answered it. susan invited her to come in.
Jane knocked on the door, but Susan answered it. susan invited her to come in.
102 | 0
Sam took French classes from Adam, because sam was eager to speak it fluently.
Sam took French classes from Adam, but sam was eager to speak it fluently.
103 | 0
Sam took French classes from Adam, because adam was known to speak it fluently.
Sam took French classes from Adam, and adam was known to speak it fluently.
104 | 0
The sun was covered by a thick cloud all morning, but luckily, by the timethe picnic started, the sun was out.
The sun was covered by a thick cloud all morning, and luckily, by the timethe picnic started, the sun was out.
105 | 0
The sun was covered by a thick cloud all morning, but luckily, by the timethe picnic started, the cloud was gone.
The sun was covered by a thick cloud all morning, and luckily, by the timethe picnic started, the cloud was gone.
106 | 0
Sam tried to paint a picture of shepherds with sheep, but the shepherds ended up looking more like golfers.
Sam tried to paint a picture of shepherds with sheep, and the shepherds ended up looking more like golfers.
107 | 0
Sam tried to paint a picture of shepherds with sheep, but the sheep ended up looking more like dogs.
Sam tried to paint a picture of shepherds with sheep, and the sheep ended up looking more like dogs.
108 | 0
Fred and Alice had very warm down coats, but fred and alice were not prepared for the cold in AlaskA
Fred but Alice had very warm down coats, but fred and alice were not prepared for the cold in AlaskA
109 | 0
Fred and Alice had very warm down coats, but fred and alice were not prepared for the cold in AlaskA
Fred and Alice had very warm down coats, and fred and alice were not prepared for the cold in AlaskA
110 | 0
Fred and Alice had very warm down coats, but fred and alice were not prepared for the cold in AlaskA
Fred and Alice had very warm down coats, but fred but alice were not prepared for the cold in AlaskA
111 | 0
Fred and Alice had very warm down coats, but coats were not enough for the cold in AlaskA
Fred but Alice had very warm down coats, but coats were not enough for the cold in AlaskA
112 | 0
Fred and Alice had very warm down coats, but coats were not enough for the cold in AlaskA
Fred and Alice had very warm down coats, and coats were not enough for the cold in AlaskA
113 | 0
The foxes are getting in at night and attacking the chickens. I shall haveto kill the foxes .
The foxes are getting in at night but attacking the chickens. I shall haveto kill the foxes .
114 | 0
The foxes are getting in at night and attacking the chickens. I shall haveto guard the chickens .
The foxes are getting in at night but attacking the chickens. I shall haveto guard the chickens .
115 | 1
The foxes are getting in at night but attacking the chickens. the foxes have gotten very bold.
The foxes are getting in at night and attacking the chickens. the foxes have gotten very bold.
116 | 1
The foxes are getting in at night but attacking the chickens. the chickens have gotten very nervous.
The foxes are getting in at night and attacking the chickens. the chickens have gotten very nervous.
117 | 0
Fred covered his eyes with his hands, because the wind was blowing sandaround. He opened his eyes when the wind stopped.
Fred covered his eyes with his hands, and the wind was blowing sandaround. He opened his eyes when the wind stopped.
118 | 1
Fred covered his eyes with his hands, because the wind was blowing sandaround. He opened his eyes before the wind stopped.
Fred covered his eyes with his hands, because the wind was blowing sandaround. He opened his eyes when the wind stopped.
119 | 1
Fred covered his eyes with his hands, and the wind was blowing sandaround. He lowered his hands when the wind stopped.
Fred covered his eyes with his hands, because the wind was blowing sandaround. He lowered his hands when the wind stopped.
120 | 0
Fred covered his eyes with his hands, because the wind was blowing sandaround. He lowered his hands when the wind stopped.
Fred covered his eyes with his hands, because the wind was blowing sandaround. He lowered his hands before the wind stopped.
121 | 1
The actress used to be named Terpsichore, and she changed it to Tina a few years ago, because she figured terpsichore was too hard to pronounce.
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, because she figured terpsichore was too hard to pronounce.
122 | 0
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, because she figured terpsichore was too hard to pronounce.
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, and she figured terpsichore was too hard to pronounce.
123 | 1
The actress used to be named Terpsichore, and she changed it to Tina a few years ago, because she figured tina was easier to pronounce.
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, because she figured tina was easier to pronounce.
124 | 1
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, and she figured tina was easier to pronounce.
The actress used to be named Terpsichore, but she changed it to Tina a few years ago, because she figured tina was easier to pronounce.
125 | 0
Fred was supposed to run the dishwasher, but he put it off, because he wanted to watch TV. But the show turned out to be boring, so hechanged his mind and turned the dishwasher on.
Fred was supposed to run the dishwasher, and he put it off, because he wanted to watch TV. But the show turned out to be boring, so hechanged his mind and turned the dishwasher on.
126 | 0
Fred was supposed to run the dishwasher, but he put it off, because he wanted to watch TV. But the show turned out to be boring, so hechanged his mind and turned the dishwasher on.
Fred was supposed to run the dishwasher, but he put it off, and he wanted to watch TV. But the show turned out to be boring, so hechanged his mind and turned the dishwasher on.
127 | 0
Fred was supposed to run the dishwasher, but he put it off, because he wanted to watch TV. But the show turned out to be boring, so hechanged his mind and turned the dishwasher on.
Fred was supposed to run the dishwasher, but he put it off, because he wanted to watch TV. But the show turned out to be boring, so hechanged his mind but turned the dishwasher on.
128 | 0
Fred was supposed to run the dishwasher, but he put it off,  because he wanted to watch TV. But the show turned out to be boring, so he changed his mind and turned the tv off.
Fred was supposed to run the dishwasher, and he put it off,  because he wanted to watch TV. But the show turned out to be boring, so he changed his mind and turned the tv off.
129 | 0
Fred was supposed to run the dishwasher, but he put it off,  because he wanted to watch TV. But the show turned out to be boring, so he changed his mind and turned the tv off.
Fred was supposed to run the dishwasher, but he put it off,  and he wanted to watch TV. But the show turned out to be boring, so he changed his mind and turned the tv off.
130 | 0
Fred was supposed to run the dishwasher, but he put it off,  because he wanted to watch TV. But the show turned out to be boring, so he changed his mind and turned the tv off.
Fred was supposed to run the dishwasher, but he put it off,  because he wanted to watch TV. But the show turned out to be boring, so he changed his mind but turned the tv off.
131 | 0
In July, Kamtchatka declared war on Yakutsk. Since Yakutsk's army was much better equipped and ten times larger, kamchatka were defeated within weeks.
In July, Kamtchatka declared war on Yakutsk. Since Yakutsk's army was much better equipped but ten times larger, kamchatka were defeated within weeks.
132 | 0
In July, Kamtchatka declared war on Yakutsk. Since Yakutsk's army was much better equipped and ten times larger, yakutsk were victorious within weeks.
In July, Kamtchatka declared war on Yakutsk. Since Yakutsk's army was much better equipped but ten times larger, yakutsk were victorious within weeks.
133 | 1
Sam broke both his ankles but he's walking with crutches. But a monthor so from now the ankles should be better.
Sam broke both his ankles and he's walking with crutches. But a monthor so from now the ankles should be better.
134 | 0
Sam broke both his ankles and he's walking with crutches. But a monthor so from now the crutches should be unnecessary.
Sam broke both his ankles but he's walking with crutches. But a monthor so from now the crutches should be unnecessary.
135 | 0
We had hoped to place copies of our newsletter on all the chairs in theauditorium, but there were simply not enough of copies of the newsletter .
We had hoped to place copies of our newsletter on all the chairs in theauditorium, and there were simply not enough of copies of the newsletter .
136 | 1
We had hoped to place copies of our newsletter on all the chairs in theauditorium, and there were simply too many of chairs .
We had hoped to place copies of our newsletter on all the chairs in theauditorium, but there were simply too many of chairs .
137 | 0
I couldn't find a spoon, so I tried using a pen to stir my coffee. But that turned out to be a bad idea, because the pen got full of coffee.
I couldn't find a spoon, so I tried using a pen to stir my coffee. But that turned out to be a bad idea, and the pen got full of coffee.
138 | 1
I couldn't find a spoon, so I tried using a pen to stir my coffee. But that turned out to be a bad idea, and the coffee got full of ink.
I couldn't find a spoon, so I tried using a pen to stir my coffee. But that turned out to be a bad idea, because the coffee got full of ink.
139 | 1
The table won't fit through the doorway and the table is too wide.
The table won't fit through the doorway because the table is too wide.
140 | 0
The table won't fit through the doorway because the doorway is too narrow.
The table won't fit through the doorway and the doorway is too narrow.
141 | 0
Emma's mother had died long ago, and emma education had been managed by an excellent woman as governess.
Emma's mother had died long ago, but emma education had been managed by an excellent woman as governess.
142 | 0
Emma's mother had died long ago, and emma's mother place had been taken by an excellent woman as governess.
Emma's mother had died long ago, but emma's mother place had been taken by an excellent woman as governess.
143 | 1
Jane knocked on Susan's door and jane did not get an answer.
Jane knocked on Susan's door but jane did not get an answer.
144 | 1
Jane knocked on Susan's door and susan did not answer.
Jane knocked on Susan's door but susan did not answer.
145 | 1
Beth didn't get angry with Sally, who had cut her off, and beth stopped and counted to ten.
Beth didn't get angry with Sally, who had cut her off, because beth stopped and counted to ten.
146 | 0
Beth didn't get angry with Sally, who had cut her off, because beth stopped and counted to ten.
Beth didn't get angry with Sally, who had cut her off, because beth stopped but counted to ten.
147 | 1
Beth didn't get angry with Sally, who had cut her off, and sally stopped and apologized.
Beth didn't get angry with Sally, who had cut her off, because sally stopped and apologized.
148 | 0
Beth didn't get angry with Sally, who had cut her off, because sally stopped and apologized.
Beth didn't get angry with Sally, who had cut her off, because sally stopped but apologized.
149 | 1
Jim signaled the barman but gestured toward jim empty glass
Jim signaled the barman and gestured toward jim empty glass
150 | 1
Jim signaled the barman but gestured toward the barman bathroom key.
Jim signaled the barman and gestured toward the barman bathroom key.
151 | 1
Dan took the rear seat while Bill claimed the front and dan "Dibs!" was slow.
Dan took the rear seat while Bill claimed the front because dan "Dibs!" was slow.
152 | 1
Dan took the rear seat while Bill claimed the front and bill "Dibs!" was quicker.
Dan took the rear seat while Bill claimed the front because bill "Dibs!" was quicker.
153 | 1
Bill passed the half-empty plate to John and bill was full.
Bill passed the half-empty plate to John because bill was full.
154 | 1
Bill passed the half-empty plate to John and john was hungry.
Bill passed the half-empty plate to John because john was hungry.
155 | 1
Bill passed the gameboy to John but bill turn was over.
Bill passed the gameboy to John because bill turn was over.
156 | 0
Bill passed the gameboy to John because john turn was next.
Bill passed the gameboy to John but john turn was next.
157 | 1
Billy cried and Toby wouldn't accept billy toy.
Billy cried because Toby wouldn't accept billy toy.
158 | 1
Billy cried and Toby wouldn't share toby toy.
Billy cried because Toby wouldn't share toby toy.
159 | 0
Pam's parents came home and found her having sex with her boyfriend, Paul. pam's parents were furious about it.
Pam's parents came home but found her having sex with her boyfriend, Paul. pam's parents were furious about it.
160 | 0
Pam's parents came home and found her having sex with her boyfriend, Paul. pam and paul were embarrassed about it.
Pam's parents came home but found her having sex with her boyfriend, Paul. pam and paul were embarrassed about it.
161 | 1
Pam's parents came home and found her having sex with her boyfriend, Paul. pam but paul were embarrassed about it.
Pam's parents came home and found her having sex with her boyfriend, Paul. pam and paul were embarrassed about it.
162 | 0
George got free tickets to the play, but he gave them to Eric, even though george was particularly eager to see it.
George got free tickets to the play, and he gave them to Eric, even though george was particularly eager to see it.
163 | 1
George got free tickets to the play, and he gave them to Eric, because eric was particularly eager to see it.
George got free tickets to the play, but he gave them to Eric, because eric was particularly eager to see it.
164 | 1
George got free tickets to the play, but he gave them to Eric, and eric was particularly eager to see it.
George got free tickets to the play, but he gave them to Eric, because eric was particularly eager to see it.
165 | 0
George got free tickets to the play, but he gave them to Eric, because george was not particularly eager to see it.
George got free tickets to the play, because he gave them to Eric, because george was not particularly eager to see it.
166 | 0
Jane gave Joan candy because jane wasn't hungry.
Jane gave Joan candy and jane wasn't hungry.
167 | 0
Jane gave Joan candy because joan was hungry.
Jane gave Joan candy and joan was hungry.
168 | 1
I tried to paint a picture of an orchard, with lemons in the lemon trees, and lemons came out looking more like light bulbs.
I tried to paint a picture of an orchard, with lemons in the lemon trees, but lemons came out looking more like light bulbs.
169 | 0
I tried to paint a picture of an orchard, with lemons in the lemon trees, but lemon trees came out looking more like telephone poles.
I tried to paint a picture of an orchard, with lemons in the lemon trees, and lemon trees came out looking more like telephone poles.
170 | 0
James asked Robert for a favor but james was refused.
James asked Robert for a favor and james was refused.
171 | 0
James asked Robert for a favor but robert refused.
James asked Robert for a favor and robert refused.
172 | 1
Kirilov ceded the presidency to Shatov and kirilov was less popular.
Kirilov ceded the presidency to Shatov because kirilov was less popular.
173 | 0
Kirilov ceded the presidency to Shatov because shatov was more popular.
Kirilov ceded the presidency to Shatov and shatov was more popular.
174 | 1
I put the butterfly wing on the table but the butterfly wing broke.
I put the butterfly wing on the table and the butterfly wing broke.
175 | 1
I put the heavy book on the table but the table broke.
I put the heavy book on the table and the table broke.
176 | 0
Madonna fired her trainer because madonna couldn't stand her boyfriend.
Madonna fired her trainer and madonna couldn't stand her boyfriend.
177 | 1
Madonna fired her trainer and the trainer slept with her boyfriend.
Madonna fired her trainer because the trainer slept with her boyfriend.
178 | 0
Madonna fired her trainer because she slept with madonna boyfriend.
Madonna fired her trainer and she slept with madonna boyfriend.
179 | 1
Madonna fired her trainer and she couldn't stand the trainer boyfriend.
Madonna fired her trainer because she couldn't stand the trainer boyfriend.
180 | 0
During a game of tag, Ethan chased Luke because ethan was "it".
During a game of tag, Ethan chased Luke and ethan was "it".
181 | 0
During a game of tag, Ethan ran from Luke because luke was "it".
During a game of tag, Ethan ran from Luke and luke was "it".
182 | 1
At the Loebner competition the judges couldn't figure out which respondentswere the chatbots and the judges were so stupid.
At the Loebner competition the judges couldn't figure out which respondentswere the chatbots because the judges were so stupid.
183 | 1
At the Loebner competition the judges couldn't figure out which respondentswere the chatbots and the chatbots were so advanced.
At the Loebner competition the judges couldn't figure out which respondentswere the chatbots because the chatbots were so advanced.
184 | 


--------------------------------------------------------------------------------
/LICENSE:
--------------------------------------------------------------------------------
  1 |                     GNU GENERAL PUBLIC LICENSE
  2 |                        Version 3, 29 June 2007
  3 | 
  4 |  Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
  5 |  Everyone is permitted to copy and distribute verbatim copies
  6 |  of this license document, but changing it is not allowed.
  7 | 
  8 |                             Preamble
  9 | 
 10 |   The GNU General Public License is a free, copyleft license for
 11 | software and other kinds of works.
 12 | 
 13 |   The licenses for most software and other practical works are designed
 14 | to take away your freedom to share and change the works.  By contrast,
 15 | the GNU General Public License is intended to guarantee your freedom to
 16 | share and change all versions of a program--to make sure it remains free
 17 | software for all its users.  We, the Free Software Foundation, use the
 18 | GNU General Public License for most of our software; it applies also to
 19 | any other work released this way by its authors.  You can apply it to
 20 | your programs, too.
 21 | 
 22 |   When we speak of free software, we are referring to freedom, not
 23 | price.  Our General Public Licenses are designed to make sure that you
 24 | have the freedom to distribute copies of free software (and charge for
 25 | them if you wish), that you receive source code or can get it if you
 26 | want it, that you can change the software or use pieces of it in new
 27 | free programs, and that you know you can do these things.
 28 | 
 29 |   To protect your rights, we need to prevent others from denying you
 30 | these rights or asking you to surrender the rights.  Therefore, you have
 31 | certain responsibilities if you distribute copies of the software, or if
 32 | you modify it: responsibilities to respect the freedom of others.
 33 | 
 34 |   For example, if you distribute copies of such a program, whether
 35 | gratis or for a fee, you must pass on to the recipients the same
 36 | freedoms that you received.  You must make sure that they, too, receive
 37 | or can get the source code.  And you must show them these terms so they
 38 | know their rights.
 39 | 
 40 |   Developers that use the GNU GPL protect your rights with two steps:
 41 | (1) assert copyright on the software, and (2) offer you this License
 42 | giving you legal permission to copy, distribute and/or modify it.
 43 | 
 44 |   For the developers' and authors' protection, the GPL clearly explains
 45 | that there is no warranty for this free software.  For both users' and
 46 | authors' sake, the GPL requires that modified versions be marked as
 47 | changed, so that their problems will not be attributed erroneously to
 48 | authors of previous versions.
 49 | 
 50 |   Some devices are designed to deny users access to install or run
 51 | modified versions of the software inside them, although the manufacturer
 52 | can do so.  This is fundamentally incompatible with the aim of
 53 | protecting users' freedom to change the software.  The systematic
 54 | pattern of such abuse occurs in the area of products for individuals to
 55 | use, which is precisely where it is most unacceptable.  Therefore, we
 56 | have designed this version of the GPL to prohibit the practice for those
 57 | products.  If such problems arise substantially in other domains, we
 58 | stand ready to extend this provision to those domains in future versions
 59 | of the GPL, as needed to protect the freedom of users.
 60 | 
 61 |   Finally, every program is threatened constantly by software patents.
 62 | States should not allow patents to restrict development and use of
 63 | software on general-purpose computers, but in those that do, we wish to
 64 | avoid the special danger that patents applied to a free program could
 65 | make it effectively proprietary.  To prevent this, the GPL assures that
 66 | patents cannot be used to render the program non-free.
 67 | 
 68 |   The precise terms and conditions for copying, distribution and
 69 | modification follow.
 70 | 
 71 |                        TERMS AND CONDITIONS
 72 | 
 73 |   0. Definitions.
 74 | 
 75 |   "This License" refers to version 3 of the GNU General Public License.
 76 | 
 77 |   "Copyright" also means copyright-like laws that apply to other kinds of
 78 | works, such as semiconductor masks.
 79 | 
 80 |   "The Program" refers to any copyrightable work licensed under this
 81 | License.  Each licensee is addressed as "you".  "Licensees" and
 82 | "recipients" may be individuals or organizations.
 83 | 
 84 |   To "modify" a work means to copy from or adapt all or part of the work
 85 | in a fashion requiring copyright permission, other than the making of an
 86 | exact copy.  The resulting work is called a "modified version" of the
 87 | earlier work or a work "based on" the earlier work.
 88 | 
 89 |   A "covered work" means either the unmodified Program or a work based
 90 | on the Program.
 91 | 
 92 |   To "propagate" a work means to do anything with it that, without
 93 | permission, would make you directly or secondarily liable for
 94 | infringement under applicable copyright law, except executing it on a
 95 | computer or modifying a private copy.  Propagation includes copying,
 96 | distribution (with or without modification), making available to the
 97 | public, and in some countries other activities as well.
 98 | 
 99 |   To "convey" a work means any kind of propagation that enables other
100 | parties to make or receive copies.  Mere interaction with a user through
101 | a computer network, with no transfer of a copy, is not conveying.
102 | 
103 |   An interactive user interface displays "Appropriate Legal Notices"
104 | to the extent that it includes a convenient and prominently visible
105 | feature that (1) displays an appropriate copyright notice, and (2)
106 | tells the user that there is no warranty for the work (except to the
107 | extent that warranties are provided), that licensees may convey the
108 | work under this License, and how to view a copy of this License.  If
109 | the interface presents a list of user commands or options, such as a
110 | menu, a prominent item in the list meets this criterion.
111 | 
112 |   1. Source Code.
113 | 
114 |   The "source code" for a work means the preferred form of the work
115 | for making modifications to it.  "Object code" means any non-source
116 | form of a work.
117 | 
118 |   A "Standard Interface" means an interface that either is an official
119 | standard defined by a recognized standards body, or, in the case of
120 | interfaces specified for a particular programming language, one that
121 | is widely used among developers working in that language.
122 | 
123 |   The "System Libraries" of an executable work include anything, other
124 | than the work as a whole, that (a) is included in the normal form of
125 | packaging a Major Component, but which is not part of that Major
126 | Component, and (b) serves only to enable use of the work with that
127 | Major Component, or to implement a Standard Interface for which an
128 | implementation is available to the public in source code form.  A
129 | "Major Component", in this context, means a major essential component
130 | (kernel, window system, and so on) of the specific operating system
131 | (if any) on which the executable work runs, or a compiler used to
132 | produce the work, or an object code interpreter used to run it.
133 | 
134 |   The "Corresponding Source" for a work in object code form means all
135 | the source code needed to generate, install, and (for an executable
136 | work) run the object code and to modify the work, including scripts to
137 | control those activities.  However, it does not include the work's
138 | System Libraries, or general-purpose tools or generally available free
139 | programs which are used unmodified in performing those activities but
140 | which are not part of the work.  For example, Corresponding Source
141 | includes interface definition files associated with source files for
142 | the work, and the source code for shared libraries and dynamically
143 | linked subprograms that the work is specifically designed to require,
144 | such as by intimate data communication or control flow between those
145 | subprograms and other parts of the work.
146 | 
147 |   The Corresponding Source need not include anything that users
148 | can regenerate automatically from other parts of the Corresponding
149 | Source.
150 | 
151 |   The Corresponding Source for a work in source code form is that
152 | same work.
153 | 
154 |   2. Basic Permissions.
155 | 
156 |   All rights granted under this License are granted for the term of
157 | copyright on the Program, and are irrevocable provided the stated
158 | conditions are met.  This License explicitly affirms your unlimited
159 | permission to run the unmodified Program.  The output from running a
160 | covered work is covered by this License only if the output, given its
161 | content, constitutes a covered work.  This License acknowledges your
162 | rights of fair use or other equivalent, as provided by copyright law.
163 | 
164 |   You may make, run and propagate covered works that you do not
165 | convey, without conditions so long as your license otherwise remains
166 | in force.  You may convey covered works to others for the sole purpose
167 | of having them make modifications exclusively for you, or provide you
168 | with facilities for running those works, provided that you comply with
169 | the terms of this License in conveying all material for which you do
170 | not control copyright.  Those thus making or running the covered works
171 | for you must do so exclusively on your behalf, under your direction
172 | and control, on terms that prohibit them from making any copies of
173 | your copyrighted material outside their relationship with you.
174 | 
175 |   Conveying under any other circumstances is permitted solely under
176 | the conditions stated below.  Sublicensing is not allowed; section 10
177 | makes it unnecessary.
178 | 
179 |   3. Protecting Users' Legal Rights From Anti-Circumvention Law.
180 | 
181 |   No covered work shall be deemed part of an effective technological
182 | measure under any applicable law fulfilling obligations under article
183 | 11 of the WIPO copyright treaty adopted on 20 December 1996, or
184 | similar laws prohibiting or restricting circumvention of such
185 | measures.
186 | 
187 |   When you convey a covered work, you waive any legal power to forbid
188 | circumvention of technological measures to the extent such circumvention
189 | is effected by exercising rights under this License with respect to
190 | the covered work, and you disclaim any intention to limit operation or
191 | modification of the work as a means of enforcing, against the work's
192 | users, your or third parties' legal rights to forbid circumvention of
193 | technological measures.
194 | 
195 |   4. Conveying Verbatim Copies.
196 | 
197 |   You may convey verbatim copies of the Program's source code as you
198 | receive it, in any medium, provided that you conspicuously and
199 | appropriately publish on each copy an appropriate copyright notice;
200 | keep intact all notices stating that this License and any
201 | non-permissive terms added in accord with section 7 apply to the code;
202 | keep intact all notices of the absence of any warranty; and give all
203 | recipients a copy of this License along with the Program.
204 | 
205 |   You may charge any price or no price for each copy that you convey,
206 | and you may offer support or warranty protection for a fee.
207 | 
208 |   5. Conveying Modified Source Versions.
209 | 
210 |   You may convey a work based on the Program, or the modifications to
211 | produce it from the Program, in the form of source code under the
212 | terms of section 4, provided that you also meet all of these conditions:
213 | 
214 |     a) The work must carry prominent notices stating that you modified
215 |     it, and giving a relevant date.
216 | 
217 |     b) The work must carry prominent notices stating that it is
218 |     released under this License and any conditions added under section
219 |     7.  This requirement modifies the requirement in section 4 to
220 |     "keep intact all notices".
221 | 
222 |     c) You must license the entire work, as a whole, under this
223 |     License to anyone who comes into possession of a copy.  This
224 |     License will therefore apply, along with any applicable section 7
225 |     additional terms, to the whole of the work, and all its parts,
226 |     regardless of how they are packaged.  This License gives no
227 |     permission to license the work in any other way, but it does not
228 |     invalidate such permission if you have separately received it.
229 | 
230 |     d) If the work has interactive user interfaces, each must display
231 |     Appropriate Legal Notices; however, if the Program has interactive
232 |     interfaces that do not display Appropriate Legal Notices, your
233 |     work need not make them do so.
234 | 
235 |   A compilation of a covered work with other separate and independent
236 | works, which are not by their nature extensions of the covered work,
237 | and which are not combined with it such as to form a larger program,
238 | in or on a volume of a storage or distribution medium, is called an
239 | "aggregate" if the compilation and its resulting copyright are not
240 | used to limit the access or legal rights of the compilation's users
241 | beyond what the individual works permit.  Inclusion of a covered work
242 | in an aggregate does not cause this License to apply to the other
243 | parts of the aggregate.
244 | 
245 |   6. Conveying Non-Source Forms.
246 | 
247 |   You may convey a covered work in object code form under the terms
248 | of sections 4 and 5, provided that you also convey the
249 | machine-readable Corresponding Source under the terms of this License,
250 | in one of these ways:
251 | 
252 |     a) Convey the object code in, or embodied in, a physical product
253 |     (including a physical distribution medium), accompanied by the
254 |     Corresponding Source fixed on a durable physical medium
255 |     customarily used for software interchange.
256 | 
257 |     b) Convey the object code in, or embodied in, a physical product
258 |     (including a physical distribution medium), accompanied by a
259 |     written offer, valid for at least three years and valid for as
260 |     long as you offer spare parts or customer support for that product
261 |     model, to give anyone who possesses the object code either (1) a
262 |     copy of the Corresponding Source for all the software in the
263 |     product that is covered by this License, on a durable physical
264 |     medium customarily used for software interchange, for a price no
265 |     more than your reasonable cost of physically performing this
266 |     conveying of source, or (2) access to copy the
267 |     Corresponding Source from a network server at no charge.
268 | 
269 |     c) Convey individual copies of the object code with a copy of the
270 |     written offer to provide the Corresponding Source.  This
271 |     alternative is allowed only occasionally and noncommercially, and
272 |     only if you received the object code with such an offer, in accord
273 |     with subsection 6b.
274 | 
275 |     d) Convey the object code by offering access from a designated
276 |     place (gratis or for a charge), and offer equivalent access to the
277 |     Corresponding Source in the same way through the same place at no
278 |     further charge.  You need not require recipients to copy the
279 |     Corresponding Source along with the object code.  If the place to
280 |     copy the object code is a network server, the Corresponding Source
281 |     may be on a different server (operated by you or a third party)
282 |     that supports equivalent copying facilities, provided you maintain
283 |     clear directions next to the object code saying where to find the
284 |     Corresponding Source.  Regardless of what server hosts the
285 |     Corresponding Source, you remain obligated to ensure that it is
286 |     available for as long as needed to satisfy these requirements.
287 | 
288 |     e) Convey the object code using peer-to-peer transmission, provided
289 |     you inform other peers where the object code and Corresponding
290 |     Source of the work are being offered to the general public at no
291 |     charge under subsection 6d.
292 | 
293 |   A separable portion of the object code, whose source code is excluded
294 | from the Corresponding Source as a System Library, need not be
295 | included in conveying the object code work.
296 | 
297 |   A "User Product" is either (1) a "consumer product", which means any
298 | tangible personal property which is normally used for personal, family,
299 | or household purposes, or (2) anything designed or sold for incorporation
300 | into a dwelling.  In determining whether a product is a consumer product,
301 | doubtful cases shall be resolved in favor of coverage.  For a particular
302 | product received by a particular user, "normally used" refers to a
303 | typical or common use of that class of product, regardless of the status
304 | of the particular user or of the way in which the particular user
305 | actually uses, or expects or is expected to use, the product.  A product
306 | is a consumer product regardless of whether the product has substantial
307 | commercial, industrial or non-consumer uses, unless such uses represent
308 | the only significant mode of use of the product.
309 | 
310 |   "Installation Information" for a User Product means any methods,
311 | procedures, authorization keys, or other information required to install
312 | and execute modified versions of a covered work in that User Product from
313 | a modified version of its Corresponding Source.  The information must
314 | suffice to ensure that the continued functioning of the modified object
315 | code is in no case prevented or interfered with solely because
316 | modification has been made.
317 | 
318 |   If you convey an object code work under this section in, or with, or
319 | specifically for use in, a User Product, and the conveying occurs as
320 | part of a transaction in which the right of possession and use of the
321 | User Product is transferred to the recipient in perpetuity or for a
322 | fixed term (regardless of how the transaction is characterized), the
323 | Corresponding Source conveyed under this section must be accompanied
324 | by the Installation Information.  But this requirement does not apply
325 | if neither you nor any third party retains the ability to install
326 | modified object code on the User Product (for example, the work has
327 | been installed in ROM).
328 | 
329 |   The requirement to provide Installation Information does not include a
330 | requirement to continue to provide support service, warranty, or updates
331 | for a work that has been modified or installed by the recipient, or for
332 | the User Product in which it has been modified or installed.  Access to a
333 | network may be denied when the modification itself materially and
334 | adversely affects the operation of the network or violates the rules and
335 | protocols for communication across the network.
336 | 
337 |   Corresponding Source conveyed, and Installation Information provided,
338 | in accord with this section must be in a format that is publicly
339 | documented (and with an implementation available to the public in
340 | source code form), and must require no special password or key for
341 | unpacking, reading or copying.
342 | 
343 |   7. Additional Terms.
344 | 
345 |   "Additional permissions" are terms that supplement the terms of this
346 | License by making exceptions from one or more of its conditions.
347 | Additional permissions that are applicable to the entire Program shall
348 | be treated as though they were included in this License, to the extent
349 | that they are valid under applicable law.  If additional permissions
350 | apply only to part of the Program, that part may be used separately
351 | under those permissions, but the entire Program remains governed by
352 | this License without regard to the additional permissions.
353 | 
354 |   When you convey a copy of a covered work, you may at your option
355 | remove any additional permissions from that copy, or from any part of
356 | it.  (Additional permissions may be written to require their own
357 | removal in certain cases when you modify the work.)  You may place
358 | additional permissions on material, added by you to a covered work,
359 | for which you have or can give appropriate copyright permission.
360 | 
361 |   Notwithstanding any other provision of this License, for material you
362 | add to a covered work, you may (if authorized by the copyright holders of
363 | that material) supplement the terms of this License with terms:
364 | 
365 |     a) Disclaiming warranty or limiting liability differently from the
366 |     terms of sections 15 and 16 of this License; or
367 | 
368 |     b) Requiring preservation of specified reasonable legal notices or
369 |     author attributions in that material or in the Appropriate Legal
370 |     Notices displayed by works containing it; or
371 | 
372 |     c) Prohibiting misrepresentation of the origin of that material, or
373 |     requiring that modified versions of such material be marked in
374 |     reasonable ways as different from the original version; or
375 | 
376 |     d) Limiting the use for publicity purposes of names of licensors or
377 |     authors of the material; or
378 | 
379 |     e) Declining to grant rights under trademark law for use of some
380 |     trade names, trademarks, or service marks; or
381 | 
382 |     f) Requiring indemnification of licensors and authors of that
383 |     material by anyone who conveys the material (or modified versions of
384 |     it) with contractual assumptions of liability to the recipient, for
385 |     any liability that these contractual assumptions directly impose on
386 |     those licensors and authors.
387 | 
388 |   All other non-permissive additional terms are considered "further
389 | restrictions" within the meaning of section 10.  If the Program as you
390 | received it, or any part of it, contains a notice stating that it is
391 | governed by this License along with a term that is a further
392 | restriction, you may remove that term.  If a license document contains
393 | a further restriction but permits relicensing or conveying under this
394 | License, you may add to a covered work material governed by the terms
395 | of that license document, provided that the further restriction does
396 | not survive such relicensing or conveying.
397 | 
398 |   If you add terms to a covered work in accord with this section, you
399 | must place, in the relevant source files, a statement of the
400 | additional terms that apply to those files, or a notice indicating
401 | where to find the applicable terms.
402 | 
403 |   Additional terms, permissive or non-permissive, may be stated in the
404 | form of a separately written license, or stated as exceptions;
405 | the above requirements apply either way.
406 | 
407 |   8. Termination.
408 | 
409 |   You may not propagate or modify a covered work except as expressly
410 | provided under this License.  Any attempt otherwise to propagate or
411 | modify it is void, and will automatically terminate your rights under
412 | this License (including any patent licenses granted under the third
413 | paragraph of section 11).
414 | 
415 |   However, if you cease all violation of this License, then your
416 | license from a particular copyright holder is reinstated (a)
417 | provisionally, unless and until the copyright holder explicitly and
418 | finally terminates your license, and (b) permanently, if the copyright
419 | holder fails to notify you of the violation by some reasonable means
420 | prior to 60 days after the cessation.
421 | 
422 |   Moreover, your license from a particular copyright holder is
423 | reinstated permanently if the copyright holder notifies you of the
424 | violation by some reasonable means, this is the first time you have
425 | received notice of violation of this License (for any work) from that
426 | copyright holder, and you cure the violation prior to 30 days after
427 | your receipt of the notice.
428 | 
429 |   Termination of your rights under this section does not terminate the
430 | licenses of parties who have received copies or rights from you under
431 | this License.  If your rights have been terminated and not permanently
432 | reinstated, you do not qualify to receive new licenses for the same
433 | material under section 10.
434 | 
435 |   9. Acceptance Not Required for Having Copies.
436 | 
437 |   You are not required to accept this License in order to receive or
438 | run a copy of the Program.  Ancillary propagation of a covered work
439 | occurring solely as a consequence of using peer-to-peer transmission
440 | to receive a copy likewise does not require acceptance.  However,
441 | nothing other than this License grants you permission to propagate or
442 | modify any covered work.  These actions infringe copyright if you do
443 | not accept this License.  Therefore, by modifying or propagating a
444 | covered work, you indicate your acceptance of this License to do so.
445 | 
446 |   10. Automatic Licensing of Downstream Recipients.
447 | 
448 |   Each time you convey a covered work, the recipient automatically
449 | receives a license from the original licensors, to run, modify and
450 | propagate that work, subject to this License.  You are not responsible
451 | for enforcing compliance by third parties with this License.
452 | 
453 |   An "entity transaction" is a transaction transferring control of an
454 | organization, or substantially all assets of one, or subdividing an
455 | organization, or merging organizations.  If propagation of a covered
456 | work results from an entity transaction, each party to that
457 | transaction who receives a copy of the work also receives whatever
458 | licenses to the work the party's predecessor in interest had or could
459 | give under the previous paragraph, plus a right to possession of the
460 | Corresponding Source of the work from the predecessor in interest, if
461 | the predecessor has it or can get it with reasonable efforts.
462 | 
463 |   You may not impose any further restrictions on the exercise of the
464 | rights granted or affirmed under this License.  For example, you may
465 | not impose a license fee, royalty, or other charge for exercise of
466 | rights granted under this License, and you may not initiate litigation
467 | (including a cross-claim or counterclaim in a lawsuit) alleging that
468 | any patent claim is infringed by making, using, selling, offering for
469 | sale, or importing the Program or any portion of it.
470 | 
471 |   11. Patents.
472 | 
473 |   A "contributor" is a copyright holder who authorizes use under this
474 | License of the Program or a work on which the Program is based.  The
475 | work thus licensed is called the contributor's "contributor version".
476 | 
477 |   A contributor's "essential patent claims" are all patent claims
478 | owned or controlled by the contributor, whether already acquired or
479 | hereafter acquired, that would be infringed by some manner, permitted
480 | by this License, of making, using, or selling its contributor version,
481 | but do not include claims that would be infringed only as a
482 | consequence of further modification of the contributor version.  For
483 | purposes of this definition, "control" includes the right to grant
484 | patent sublicenses in a manner consistent with the requirements of
485 | this License.
486 | 
487 |   Each contributor grants you a non-exclusive, worldwide, royalty-free
488 | patent license under the contributor's essential patent claims, to
489 | make, use, sell, offer for sale, import and otherwise run, modify and
490 | propagate the contents of its contributor version.
491 | 
492 |   In the following three paragraphs, a "patent license" is any express
493 | agreement or commitment, however denominated, not to enforce a patent
494 | (such as an express permission to practice a patent or covenant not to
495 | sue for patent infringement).  To "grant" such a patent license to a
496 | party means to make such an agreement or commitment not to enforce a
497 | patent against the party.
498 | 
499 |   If you convey a covered work, knowingly relying on a patent license,
500 | and the Corresponding Source of the work is not available for anyone
501 | to copy, free of charge and under the terms of this License, through a
502 | publicly available network server or other readily accessible means,
503 | then you must either (1) cause the Corresponding Source to be so
504 | available, or (2) arrange to deprive yourself of the benefit of the
505 | patent license for this particular work, or (3) arrange, in a manner
506 | consistent with the requirements of this License, to extend the patent
507 | license to downstream recipients.  "Knowingly relying" means you have
508 | actual knowledge that, but for the patent license, your conveying the
509 | covered work in a country, or your recipient's use of the covered work
510 | in a country, would infringe one or more identifiable patents in that
511 | country that you have reason to believe are valid.
512 | 
513 |   If, pursuant to or in connection with a single transaction or
514 | arrangement, you convey, or propagate by procuring conveyance of, a
515 | covered work, and grant a patent license to some of the parties
516 | receiving the covered work authorizing them to use, propagate, modify
517 | or convey a specific copy of the covered work, then the patent license
518 | you grant is automatically extended to all recipients of the covered
519 | work and works based on it.
520 | 
521 |   A patent license is "discriminatory" if it does not include within
522 | the scope of its coverage, prohibits the exercise of, or is
523 | conditioned on the non-exercise of one or more of the rights that are
524 | specifically granted under this License.  You may not convey a covered
525 | work if you are a party to an arrangement with a third party that is
526 | in the business of distributing software, under which you make payment
527 | to the third party based on the extent of your activity of conveying
528 | the work, and under which the third party grants, to any of the
529 | parties who would receive the covered work from you, a discriminatory
530 | patent license (a) in connection with copies of the covered work
531 | conveyed by you (or copies made from those copies), or (b) primarily
532 | for and in connection with specific products or compilations that
533 | contain the covered work, unless you entered into that arrangement,
534 | or that patent license was granted, prior to 28 March 2007.
535 | 
536 |   Nothing in this License shall be construed as excluding or limiting
537 | any implied license or other defenses to infringement that may
538 | otherwise be available to you under applicable patent law.
539 | 
540 |   12. No Surrender of Others' Freedom.
541 | 
542 |   If conditions are imposed on you (whether by court order, agreement or
543 | otherwise) that contradict the conditions of this License, they do not
544 | excuse you from the conditions of this License.  If you cannot convey a
545 | covered work so as to satisfy simultaneously your obligations under this
546 | License and any other pertinent obligations, then as a consequence you may
547 | not convey it at all.  For example, if you agree to terms that obligate you
548 | to collect a royalty for further conveying from those to whom you convey
549 | the Program, the only way you could satisfy both those terms and this
550 | License would be to refrain entirely from conveying the Program.
551 | 
552 |   13. Use with the GNU Affero General Public License.
553 | 
554 |   Notwithstanding any other provision of this License, you have
555 | permission to link or combine any covered work with a work licensed
556 | under version 3 of the GNU Affero General Public License into a single
557 | combined work, and to convey the resulting work.  The terms of this
558 | License will continue to apply to the part which is the covered work,
559 | but the special requirements of the GNU Affero General Public License,
560 | section 13, concerning interaction through a network will apply to the
561 | combination as such.
562 | 
563 |   14. Revised Versions of this License.
564 | 
565 |   The Free Software Foundation may publish revised and/or new versions of
566 | the GNU General Public License from time to time.  Such new versions will
567 | be similar in spirit to the present version, but may differ in detail to
568 | address new problems or concerns.
569 | 
570 |   Each version is given a distinguishing version number.  If the
571 | Program specifies that a certain numbered version of the GNU General
572 | Public License "or any later version" applies to it, you have the
573 | option of following the terms and conditions either of that numbered
574 | version or of any later version published by the Free Software
575 | Foundation.  If the Program does not specify a version number of the
576 | GNU General Public License, you may choose any version ever published
577 | by the Free Software Foundation.
578 | 
579 |   If the Program specifies that a proxy can decide which future
580 | versions of the GNU General Public License can be used, that proxy's
581 | public statement of acceptance of a version permanently authorizes you
582 | to choose that version for the Program.
583 | 
584 |   Later license versions may give you additional or different
585 | permissions.  However, no additional obligations are imposed on any
586 | author or copyright holder as a result of your choosing to follow a
587 | later version.
588 | 
589 |   15. Disclaimer of Warranty.
590 | 
591 |   THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
592 | APPLICABLE LAW.  EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
593 | HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
594 | OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
595 | THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
596 | PURPOSE.  THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
597 | IS WITH YOU.  SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
598 | ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
599 | 
600 |   16. Limitation of Liability.
601 | 
602 |   IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
603 | WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
604 | THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
605 | GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
606 | USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
607 | DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
608 | PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
609 | EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
610 | SUCH DAMAGES.
611 | 
612 |   17. Interpretation of Sections 15 and 16.
613 | 
614 |   If the disclaimer of warranty and limitation of liability provided
615 | above cannot be given local legal effect according to their terms,
616 | reviewing courts shall apply local law that most closely approximates
617 | an absolute waiver of all civil liability in connection with the
618 | Program, unless a warranty or assumption of liability accompanies a
619 | copy of the Program in return for a fee.
620 | 
621 |                      END OF TERMS AND CONDITIONS
622 | 
623 |             How to Apply These Terms to Your New Programs
624 | 
625 |   If you develop a new program, and you want it to be of the greatest
626 | possible use to the public, the best way to achieve this is to make it
627 | free software which everyone can redistribute and change under these terms.
628 | 
629 |   To do so, attach the following notices to the program.  It is safest
630 | to attach them to the start of each source file to most effectively
631 | state the exclusion of warranty; and each file should have at least
632 | the "copyright" line and a pointer to where the full notice is found.
633 | 
634 |     <one line to give the program's name and a brief idea of what it does.>
635 |     Copyright (C) <year>  <name of author>
636 | 
637 |     This program is free software: you can redistribute it and/or modify
638 |     it under the terms of the GNU General Public License as published by
639 |     the Free Software Foundation, either version 3 of the License, or
640 |     (at your option) any later version.
641 | 
642 |     This program is distributed in the hope that it will be useful,
643 |     but WITHOUT ANY WARRANTY; without even the implied warranty of
644 |     MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
645 |     GNU General Public License for more details.
646 | 
647 |     You should have received a copy of the GNU General Public License
648 |     along with this program.  If not, see <https://www.gnu.org/licenses/>.
649 | 
650 | Also add information on how to contact you by electronic and paper mail.
651 | 
652 |   If the program does terminal interaction, make it output a short
653 | notice like this when it starts in an interactive mode:
654 | 
655 |     <program>  Copyright (C) <year>  <name of author>
656 |     This program comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
657 |     This is free software, and you are welcome to redistribute it
658 |     under certain conditions; type `show c' for details.
659 | 
660 | The hypothetical commands `show w' and `show c' should show the appropriate
661 | parts of the General Public License.  Of course, your program's commands
662 | might be different; for a GUI interface, you would use an "about box".
663 | 
664 |   You should also get your employer (if you work as a programmer) or school,
665 | if any, to sign a "copyright disclaimer" for the program, if necessary.
666 | For more information on this, and how to apply and follow the GNU GPL, see
667 | <https://www.gnu.org/licenses/>.
668 | 
669 |   The GNU General Public License does not permit incorporating your program
670 | into proprietary programs.  If your program is a subroutine library, you
671 | may consider it more useful to permit linking proprietary applications with
672 | the library.  If this is what you want to do, use the GNU Lesser General
673 | Public License instead of this License.  But first, please read
674 | <https://www.gnu.org/licenses/why-not-lgpl.html>.
675 | 


--------------------------------------------------------------------------------
/Robust_commonsense_test/add.txt:
--------------------------------------------------------------------------------
 1 | 1
The desk is for sleeping on
The desk is for working with
0
The desk is not for sleeping on
The desk is not for working with
 2 | 0
I used an umbrella to avoid drenching in the rainy day
I used an umbrella to avoid drenching on the beach
1
I used an umbrella not to avoid drenching in the rainy day
I used an umbrella not to avoid drenching on the beach
 3 | 0
I like cakes because I have a sweet tooth
I like cakes because I like salty food
1
I do not like cakes because I have a sweet tooth
I do not like cakes because I like salty food
 4 | 1
laziness is one of the reasons people travel
curiosity is one of the reasons people travel
0
laziness is not one of the reasons people travel
curiosity is not one of the reasons people travel
 5 | 1
Seawater is drinkable
Mineral water is drinkable
0
Seawater is not drinkable
Mineral water is not drinkable
 6 | 0
A pig is an animal
An apple is an animal
1
A pig is not an animal
An apple is not an animal
 7 | 1
People don't need to use air conditioning on a hot day
People don't need to use air conditioning on the day in a temperature
0
People need to use air conditioning on a hot day
People need to use air conditioning on the day in a temperature
 8 | 0
couples would divorce if they betrayed each other
couples would divorce if they believed each other
1
couples would not divorce if they betrayed each other
couples would not divorce if they believed each other
 9 | 1
many vegetables grow on the cement
many vegetables grow on the ground
0
many vegetables do not grow on the cement
many vegetables do not grow on the ground
10 | 0
He cooked a meal in an iron pot.
He cooked a meal in a paper pot.
1
He could not cook a meal in an iron pot.
He could not cook a meal in a paper pot.
11 | 1
Gravity can start an electronic device
Electricity can start electronic devices
0
Gravity can not start an electronic device
Electricity can not start electronic devices
12 | 0
nissan is a foreign car manufacturer
nissan is a foreign plane manufacturer
1
nissan is a not car manufacturer
nissan is not a plane manufacturer
13 | 0
People usually use sunscreen in the sun
People usually use sunscreen at night
1
People usually do not use sunscreen in the sun
People usually do not use sunscreen at night
14 | 1
taking a walk is harmful to health in general
taking a walk is good for health in general
0
taking a walk is not harmful to health in general
taking a walk is not good for health in general
15 | 0
We can use the cup to catch water
We can use the net to catch water
1
We can not use the cup to catch water
We can not use the net to catch water
16 | 1
smartphones nowadays are huge
smartphones nowadays are small
0
smartphones nowadays are huge than an ant
smartphones nowadays are small than an ant
17 | 1
the farm is destroyed by a tomato
the farm is destroyed by a tornado
0
the farm is destroyed by a tomato which is infected by virus
the farm is destroyed by a tornado which is infected by virus
18 | 0
he is famous and everybody has heard of him
he is famous and nobody has heard of him
1
he is famous in Asian and everybody has heard of him in Europe
he is famous in Asian and nobody has heard of him in Europe
19 | 0
food is stored in the fridge
food is stored in the pan
1
food is stored in the fridge in ancient
food is stored in the pan in ancient
20 | 0
she goes traveling on holidays 
she goes traveling on weekdays
1
she goes traveling on holidays since prices and travel expenses are more expensive at holidays.
she goes traveling on weekdays since prices and travel expenses are more expensive at holidays.
21 | 1
he opens a book and begins to cook
he opens a book and begins to read
0
he opens a book and begins to cook, following cooking steps written in the book
he opens a book and begins to read, following cooking steps written in the book
22 | 0
people usually rest on Sundays
people usually work on Sundays
1
people usually rest on Sundays, if they have work  unfinished during workdays
people usually work on Sundays, if they have work  unfinished during workdays
23 | 1
it takes me 3 seconds to read the book
it takes me 3 days to read the book
0
it takes me 3 seconds to read the short  book catalogue
it takes me 3 days to read the short book catalogue
24 | 1
he runs faster than no one and wins the champion
he runs faster than everyone and wins the champion
0
he runs faster than no one and wins the champion. This competition is to see who is the slowest.
he runs faster than everyone and wins the champion. This competition is to see who is the slowest.
25 | 0
the regular meeting is held at 2 o'clock in the afternoon
the regular meeting is held at 2 o'clock in the morning
1
for nightbirds, the regular meeting is held at 2 o'clock in the afternoon
for nightbirds, the regular meeting is held at 2 o'clock in the morning
26 | 0
he waits a subway train in a subway stop
he waits a subway train in a bus stop
1
In a careless way, he waits a subway train in a subway stop
In a careless way, he waits a subway train in a bus stop
27 | 0
the boy next to Mary in the photo is her nephew
the girl next to Mary in the photo is her nephew
1
the boy next to Mary in the photo is her nephew's daughter
the girl next to Mary in the photo is her nephew's daughter
28 | 1
i spend a dollar to buy a diamond ring
i spend a thousand dollars to buy a diamond ring
0
i spend a dollar to buy a toy diamond ring
i spend a thousand dollars to buy a toy diamond ring
29 | 0
Mary tucked her daughter Anne into bed, so that mary could work.
Mary tucked her daughter Anne into bed, so that mary's daughter could work.
1
Mary not tucked her daughter Anne into bed, so that mary could work.
Mary not tucked her daughter Anne into bed, so that mary's daughter could work.
30 | 1
I can't cut that tree down with that axe; the tree is too small.
I can't cut that tree down with that axe; the axe is too small.
0
I can cut that tree down with that axe; the tree is too small.
I can cut that tree down with that axe; the axe is too small.
31 | 1
The foxes are getting in at night and attacking the chickens. the foxes have gotten very nervous.
The foxes are getting in at night and attacking the chickens. the chickens have gotten very nervous.
0
The foxes are not getting in at night and attacking the chickens. the foxes have gotten very nervous.
The foxes are not getting in at night and attacking the chickens. the chickens have gotten very nervous.
32 | 0
The table won't fit through the doorway because the table is too wide.
The table won't fit through the doorway because the doorway is too wide.
1
The table fit through the doorway because the table is too wide.
The table fit through the doorway because the doorway is too wide.
33 | 1
The table won't fit through the doorway because the table is too narrow.
The table won't fit through the doorway because the doorway is too narrow.
0
The table fit through the doorway because the table is too narrow.
The table fit through the doorway because the doorway is too narrow.
34 | 0
Bill passed the half-empty plate to John because bill was full.
Bill passed the half-empty plate to John because john was full.
1
Bill did not pass the half-empty plate to John because bill was full.
Bill did not pass the half-empty plate to John because john was full.
35 | 1
Bill passed the half-empty plate to John because bill was hungry.
Bill passed the half-empty plate to John because john was hungry.
0
Bill did not pass the half-empty plate to John because bill was hungry.
Bill did not pass the half-empty plate to John because john was hungry.
36 | 0
Bill passed the gameboy to John because bill turn was over.
Bill passed the gameboy to John because john turn was over.
1
Bill did not pass the gameboy to John because bill turn was over.
Bill did not pass the gameboy to John because john turn was over.
37 | 1
Bill passed the gameboy to John because bill turn was next.
Bill passed the gameboy to John because john turn was next.
0
Bill did not pass the gameboy to John because bill turn was next.
Bill did not passed the gameboy to John because john turn was next.
38 | 0
The man lifted the boy onto the man shoulders.
The man lifted the boy onto the boy shoulders.
1
The man can not lift the boy onto the man shoulders.
The man can not lift the boy onto the boy shoulders.
39 | 1
The man lifted the boy onto the man bunk bed.
The man lifted the boy onto the boy bunk bed.
0
The man can not lift the boy onto the man bunk bed.
The man can not lift the boy onto the boy bunk bed.
40 | 0
The father carried the sleeping boy in the father arms
The father carried the sleeping boy in the boy arms
1
The father cannot carry the sleeping boy in the father arms
The father cannot carry the sleeping boy in the boy arms
41 | 1
The father carried the sleeping boy in the father bassinet.
The father carried the sleeping boy in the boy bassinet.
0
The father cannot carry the sleeping boy in the father bassinet.
The father cannot carry the sleeping boy in the boy bassinet.
42 | 1
I'm sure that my map will show this building; the map is very famous.
I'm sure that my map will show this building; the building is very famous.
0
I'm sure that my map will show this building; the map is very famous for its GPS.
I'm sure that my map will show this building; the building is very famous for its GPS.
43 | 0
Bob paid for Charlie's college education. bob is very rich.
Bob paid for Charlie's college education. charlie is very rich.
1
Bob paid for Charlie's college education. bob is very rich in old days but not now.
Bob paid for Charlie's college education. charlie is very rich in old days but not now.
44 | 1
Bob paid for Charlie's college education. bob is very grateful.
Bob paid for Charlie's college education. charlie is very grateful.
0
Bob paid for Charlie's college education because Charlie helped him before. bob is very grateful.
Bob paid for Charlie's college education because Charlie helped him before. Charlie is very grateful.
45 | 0
Anne gave birth to a daughter last month. anne is a very charming woman.
Anne gave birth to a daughter last month. anne's daughter is a very charming woman.
1
Anne gave birth to a daughter last month. anne will be a very charming woman decades after.
Anne gave birth to a daughter last month. anne's daughter will be a very charming woman decades after.
46 | 1
The fish ate the worm. the fish was tasty.
The fish ate the worm. the worm was tasty.
0
The fish ate the worm and people ate the fish. the fish was tasty.
The fish ate the worm and people ate the fish. the worm was tasty.
47 | 1
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. bob was very concerned.
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. carl was very concerned.
0
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. bob was very concerned about how he knew.
Bob collapsed on the sidewalk. Soon he saw Carl coming to help. Carl was very concerned about how he knew.
48 | 0
Jane knocked on Susan's door, but there was no answer. jane was disappointed.
Jane knocked on Susan's door, but there was no answer. susan was disappointed.
1
Jane knocked on Susan's door, but there was no answer so Jane leaved. Jane was disappointed when she came back.
Jane knocked on Susan's door, but there was no answer so Jane leaved. susan was disappointed when she came back.
49 | 1
Mary tucked her daughter Anne into bed, so that mary could sleep.
Mary tucked her daughter Anne into bed, so that mary's daughter could sleep.
0
Mary tucked her daughter Anne into bed and made Anne fall in sleep, so that mary could sleep.
Mary tucked her daughter Anne into bed and made Anne fall in sleep, so that mary's daughter could sleep.
50 | 0
I can't cut that tree down with that axe; the tree is too thick.
I can't cut that tree down with that axe; the axe is too thick.
1
I can't cut that tree down with that axe; the tree is too thick to hold on.
I can't cut that tree down with that axe; the axe is too thick to hold on.
51 | 0
I put the cake away in the refrigerator. the cake has a lot of butter in it.
I put the cake away in the refrigerator. the refrigerator has a lot of butter in it.
1
I put the cake away in the refrigerator. the cake has a lot of butter in it so there is no space.
I put the cake away in the refrigerator. the refrigerator has a lot of butter in it so there is no space.
52 | 0
Steve follows Fred's example in everything. steve admires him hugely.
Steve follows Fred's example in everything. fred admires him hugely.
1
Steve follows Fred's example in everything and take success for granted. steve admires him hugely.
Steve follows Fred's example in everything and take success for granted. fred admires him hugely.
53 | 1
Steve follows Fred's example in everything. steve influences him hugely.
Steve follows Fred's example in everything. fred influences him hugely.
0
Steve follows Fred's example in everything and Fred begins to follow others. steve influences him hugely.
Steve follows Fred's example in everything and Fred begins to follow others. fred influences him hugely.
54 | 1
Jane gave Joan candy because jane was hungry.
Jane gave Joan candy because joan was hungry.
0
Jane gave Joan candy to swap for a meal because jane was hungry.
Jane gave Joan candy to swap for a meal because joan was hungry.
55 | 1
Comments are informative, and since Information isn't that important., Comment sections have not failed
Comments are informative, but since Information is important., Comment sections have not failed
0
Comments are informative, and since Information isn't that important., Comment sections have failed
Comments are informative, but since Information is important., Comment sections have failed
56 | 1
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives, Comment sections have not failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives, Comment sections have not failed
0
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives, Comment sections have failed
57 | 1
Concealed carry permit holders have already been background checked and vetted for both character and competence, and since the majority of gun violence in performed by people who have already been background checked and vetted, Guns should be permitted on college campuses
Concealed carry permit holders have already been background checked and vetted for both character and competence, but since the majority of gun violence in performed by people who have not already been background checked and vetted, Guns should be permitted on college campuses
0
Concealed carry permit holders have already been background checked and vetted for both character and competence, and since the majority of gun violence in performed by people who have already been background checked and vetted, Guns should not be permitted on college campuses
Concealed carry permit holders have already been background checked and vetted for both character and competence, but since the majority of gun violence in performed by people who have not already been background checked and vetted, Guns should not be permitted on college campuses
58 | 1
Those that have committed crimes against society should have that seen when competing fairly for jobs with those who did not commit crimes, and since one punishment is enough, Jail record should be an employer's first impression
Those that have committed crimes against society should have that seen when competing fairly for jobs with those who did not commit crimes, but since one punishment is not enough, Jail record should be an employer's first impression
0
Those that have committed crimes against society should have that seen when competing fairly for jobs with those who did not commit crimes, and since one punishment is enough, Jail record should not be an employer's first impression
Those that have committed crimes against society should have that seen when competing fairly for jobs with those who did not commit crimes, but since one punishment is not enough, Jail record should not be an employer's first impression
59 | 1
In America differing opinions are not only allowed but they have value teaching us to compromise for the best results, and since most often these opinions cannot be shared without entering into an ugly and unhealthy debate, Comment sections have not failed
In America differing opinions are not only allowed but they have value teaching us to compromise for the best results, but since most often these opinions can be shared without entering into an ugly and unhealthy debate, Comment sections have not failed
0
In America differing opinions are not only allowed but they have value teaching us to compromise for the best results, and since most often these opinions cannot be shared without entering into an ugly and unhealthy debate, Comment sections have failed
In America differing opinions are not only allowed but they have value teaching us to compromise for the best results, but since most often these opinions can be shared without entering into an ugly and unhealthy debate, Comment sections have failed
60 | 0
Justices are not prohibited from speaking about topics of interest to them, and since they are interested in the electoral process, Supreme court justice can denounce a candidate
Justices are not prohibited from speaking about topics of interest to them, but since they should not be interested in the electoral process, Supreme court justice can denounce a candidate
1
Justices are not prohibited from speaking about topics of interest to them, and since they are interested in the electoral process, Supreme court justice cannot denounce a candidate
Justices are not prohibited from speaking about topics of interest to them, but since they should not be interested in the electoral process, Supreme court justice cannot denounce a candidate
61 | 0
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil, Brazil should not postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, Brazil should not postpone Olympics
1
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil, Brazil should postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, Brazil should postpone Olympics
62 | 1
We should be able to speak other languages rather than expect everyone else to speak english, and since students should be taking those classes by choice, Foreign language classes should be mandatory in college
We should be able to speak other languages rather than expect everyone else to speak english, but since students should be taking those classes by force, Foreign language classes should be mandatory in college
0
We should be able to speak other languages rather than expect everyone else to speak english, and since students should be taking those classes by choice, Foreign language classes should not be mandatory in college
We should be able to speak other languages rather than expect everyone else to speak english, but since students should be taking those classes by force, Foreign language classes should not be mandatory in college
63 | 1
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks, Comment sections have not failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks, Comment sections have not failed
0
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks, Comment sections have failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks, Comment sections have failed
64 | 1
Felons should not be denied their right to vote after paying their debt to society and reentering the community, and since the debt to society, in most cases, can never truly be repaid, Felons should be allowed to vote
Felons should not be denied their right to vote after paying their debt to society and reentering the community, but since the debt to society, in most cases, can truly be repaid, Felons should be allowed to vote
0
Felons should not be denied their right to vote after paying their debt to society and reentering the community, and since the debt to society, in most cases, can never truly be repaid, Felons should not be allowed to vote
Felons should not be denied their right to vote after paying their debt to society and reentering the community, but since the debt to society, in most cases, can truly be repaid, Felons should not be allowed to vote
65 | 0
She didn't even give the dying aspirin, meanwhile converting them to Catholicism without their knowledge, and since this did not save their souls before they entered heaven, Mother Teresa should not be canonized
She didn't even give the dying aspirin, meanwhile converting them to Catholicism without their knowledge, but since this saved their souls before they entered heaven, Mother Teresa should not be canonized
1
She didn't even give the dying aspirin, meanwhile converting them to Catholicism without their knowledge, and since this did not save their souls before they entered heaven, Mother Teresa should be canonized
She didn't even give the dying aspirin, meanwhile converting them to Catholicism without their knowledge, but since this saved their souls before they entered heaven, Mother Teresa should be canonized
66 | 0
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling, Comment sections have not failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling, Comment sections have not failed
1
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling, Comment sections have failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling, Comment sections have failed
67 | 0
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives, Comment sections have failed
1
Comments sections permit a reader to analyze many different perspectives in one place, and since readers don't need multiple perspectives in rare cases, Comment sections have failed
Comments sections permit a reader to analyze many different perspectives in one place, but since readers need multiple perspectives only if they are correct, Comment sections have failed
68 | 0
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil, Brazil should not postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, Brazil should not postpone Olympics
1
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil until the pestilence ends, Brazil should not postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, and now they are in good health，Brazil should not postpone Olympics
69 | 1
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil, Brazil should postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, Brazil should postpone Olympics
0
The Olympics are a dream for many athletes since they train extremely hard, and since the athletes won't get sick going to Brazil until the pestilence ends, Brazil should postpone Olympics
The Olympics are a dream for many athletes since they train extremely hard, but since the athletes won't be able to compete if they are sick, and now they are in good health，Brazil should postpone Olympics
70 | 1
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks, Comment sections have not failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks, Comment sections have not failed
0
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks in rare cases, Comment sections have not failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks only when readers are reasonable, Comment sections have not failed
71 | 0
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks, Comment sections have failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks, Comment sections have failed
1
Comment sections provide a place for people to have their opinion heard, and since comments devolve into attacks in rare cases, Comment sections have failed
Comment sections provide a place for people to have their opinion heard, but since comments usually don't devolve into attacks only when readers are reasonable, Comment sections have failed
72 | 0
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling, Comment sections have not failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling, Comment sections have not failed
1
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling only when they are reasonable, Comment sections have not failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling only in sensitive topics, Comment sections have not failed
73 | 1
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling, Comment sections have failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling, Comment sections have failed
0
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, and since people are capable of have conversations without arguing and name calling only when they are reasonable, Comment sections have failed
Comment sections provide a voice to thoughts and ideas outside the scope of regular editorial content, but since people cannot have conversations without arguing and name calling only in sensitive topics, Comment sections have failed
74 | 1
Comment sections allow customers to have direct engagement, and since direct engagement with customers costs more than it earns, Comment sections have not failed
Comment sections allow customers to have direct engagement, but since direct engagement with customers earns more than it costs, Comment sections have not failed
0
Comment sections allow customers to have direct engagement, and since direct engagement with customers costs more than it earns in rare cases, Comment sections have not failed
Comment sections allow customers to have direct engagement, but since direct engagement with customers earns more than it costs in rare cases, Comment sections have not failed
75 | 0
Comment sections allow customers to have direct engagement, and since direct engagement with customers costs more than it earns, Comment sections have not succeed
Comment sections allow customers to have direct engagement, but since direct engagement with customers earns more than it costs, Comment sections have not succeed
1
Comment sections allow customers to have direct engagement, and since direct engagement with customers costs more than it earns in rare cases, Comment sections have not succeed
Comment sections allow customers to have direct engagement, but since direct engagement with customers earns more than it costs in rare cases, Comment sections have not succeed
76 | 1
People want to discuss issues rather than be told what to think, and since too many people will be talking at once, Comment sections have not failed
People want to discuss issues rather than be told what to think, but since only one person can talk at a time, Comment sections have not failed
0
People want to discuss issues rather than be told what to think, and since too many people will be talking at once and a spark of knowledge is produced, Comment sections have not failed
People want to discuss issues rather than be told what to think, but since only one person can talk at a time and there is very little information, Comment sections have not failed
77 | 0
People want to discuss issues rather than be told what to think, and since too many people will be talking at once, Comment sections have not succeed
People want to discuss issues rather than be told what to think, but since only one person can talk at a time, Comment sections have not succeed
1
People want to discuss issues rather than be told what to think, and since too many people will be talking at once and a spark of knowledge is produced, Comment sections have not succeed
People want to discuss issues rather than be told what to think, but since only one person can talk at a time and there is little information, Comment sections have not succeed
78 | 1
Comment sections have varied and valuable opinions, and since varied opinions cause conflict, Comment sections have not failed
Comment sections have varied and valuable opinions, but since varied opinions cause thought, Comment sections have not failed
0
Comment sections have varied and valuable opinions, and since varied opinions cause conflict in rare cases, Comment sections have not failed
Comment sections have varied and valuable opinions, but since varied opinions cause thought with meaningless discussion, Comment sections have not failed
79 | 0
Comment sections have varied and valuable opinions, and since varied opinions cause conflict, Comment sections have not succeed
Comment sections have varied and valuable opinions, but since varied opinions cause thought, Comment sections have not succeed
1
Comment sections have varied and valuable opinions, and since varied opinions cause conflict in rare cases, Comment sections have not succeed
Comment sections have varied and valuable opinions, but since varied opinions cause thought with meaningless discussion, Comment sections have not succeed
80 | 0
Guns are already on college campuses, and since status quo should be codified, Guns should be permitted on college campuses now
Guns are already on college campuses, but since status quo should be banned, Guns should be permitted on college campuses now
1
Guns are already on college campuses, and since status quo should seldom be codified, Guns should be permitted on college campuses now
Guns are already on college campuses, but since status quo should be banned only if government promulgate relevant laws, Guns should be permitted on college campuses now
81 | 1
Guns are already on college campuses, and since status quo should be codified, Guns should be prohibited on college campuses
Guns are already on college campuses, but since status quo should be banned, Guns should be prohibited on college campuses
0
Guns are already on college campuses, and since status quo should seldom be codified, Guns should be prohibited on college campuses
Guns are already on college campuses, but since status quo should be banned only if government promulgate relevant laws,, Guns should be prohibited on college campuses
82 | 0
It is very nice to have the information easily available, and since a little information solves a lot of problems, Medical websites are healthful
It is very nice to have the information easily available, but since a little information causes a lot of problems, Medical websites are healthful
1
It is very nice to have the information easily available, and since a little information hardly solves a lot of problems , Medical websites are healthful
It is very nice to have the information easily available, but since a little information seldom causes a lot of problems, Medical websites are healthful
83 | 1
It is very nice to have the information easily available, and since a little information solves a lot of problems, Medical websites are harmful
It is very nice to have the information easily available, but since a little information causes a lot of problems, Medical websites are harmful
0
It is very nice to have the information easily available, and since a little information hardly solves a lot of problems, Medical websites are harmful
It is very nice to have the information easily available, but since a little information seldom causes a lot of problems, Medical websites are harmful
84 | 1
Comments sections are necessary to give a wide variety of opinions, and since there are not many opinions in the comment section, Comment sections have not failed
Comments sections are necessary to give a wide variety of opinions, but since there are many opinions available in the comment section, Comment sections have not failed
0
Comments sections are necessary to give a wide variety of opinions, and since there are not many opinions in the comment section if comments sections be prohibited, Comment sections have not failed
Comments sections are necessary to give a wide variety of opinions, but since there are many opinions available in the comment section but meaningless, Comment sections have not failed
85 | 1
There is an epidemic in Brazil, and since this epidemic has a little relevance to the games, Brazil should postpone Olympics
There is an epidemic in Brazil, but since this epidemic has a huge relevance to the games, Brazil should postpone Olympics
0
There is an epidemic in Brazil, and since this epidemic has a little relevance to the games but will spread over crowds, Brazil should postpone Olympics
There is an epidemic in Brazil, but since this epidemic in rare cases has a huge relevance to the games, Brazil should postpone Olympics
86 | 0
Comment sections allow other views to be heard, and since these views are always welcome or agreeable to mainstream society, Comment sections have not failed
Comment sections allow other views to be heard, but since these views are not always welcome or agreeable to mainstream society, Comment sections have not failed
1
Comment sections allow other views to be heard, and since these views are always welcome or agreeable to mainstream society in rare cases, Comment sections have not failed
Comment sections allow other views to be heard, but since these views are not always welcome or agreeable to mainstream society in rare cases, Comment sections have not failed
87 | 1
They provide other peoples perspectives on topics, and since most of these perspectives are lunatic, Comment sections have not failed
They provide other peoples perspectives on topics, but since most of these perspectives are different than other people's views, Comment sections have not failed
0
They provide other peoples perspectives on topics, and since most of these perspectives are lunatic but ,inspired Comment sections have not failed
They provide other peoples perspectives on topics, but since most of these perspectives are different than other people's views and meaningless, Comment sections have not failed
88 | 0
Comments give new perspectives and context to stories, and since more context and perspectives is enlightening, Comment sections have not failed
Comments give new perspectives and context to stories, but since more context and perspectives is overwhelming, Comment sections have not failed
1
Comments give new perspectives and context to stories, and since more context and perspectives is enlightening only  with proper regularization, Comment sections have not failed
Comments give new perspectives and context to stories, but since more context and perspectives is overwhelming and welcome by readers, Comment sections have not failed
89 | 1
Comment sections allow other views to be heard, and since being exposed to other views is disturbing, Comment sections have not failed
Comment sections allow other views to be heard, but since being exposed to other views is enlightening, Comment sections have not failed
0
Comment sections allow other views to be heard, and since being exposed to other views is seldom disturbing, Comment sections have not failed
Comment sections allow other views to be heard, but since being exposed to other views is enlightening only if the views are correct, Comment sections have not failed
90 | 1
Comments section enable the democratic discussion of ideas, and since this discussion often degrades into name calling, Comment sections have not failed
Comments section enable the democratic discussion of ideas, but since this discussion often ascends into respectful name dropping, Comment sections have not failed
0
Comments section enable the democratic discussion of ideas, and since this discussion often degrades into name calling only on unusual sensitive  topics, Comment sections have not failed
Comments section enable the democratic discussion of ideas, but since this discussion often ascends into respectful name dropping in rare cases, Comment sections have not failed
91 | 1
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, and since people will incorrectly self diagnose, Medical websites are healthful
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, but since people will correctly self diagnose, Medical websites are healthful
0
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, and since people will seldom incorrectly self diagnose with information from medical web, Medical websites are healthful
You can't go to the doctor for every little thing so websites help figure out when you need to call the doctor, but since people will correctly self diagnose only if they know some medical knowledge, Medical websites are healthful
92 | 1
Iran's nuclear capabilities is a cause for worry, and since there are ways to defend against nuclear threats, Iran remains a threat
Iran's nuclear capabilities is a cause for worry, but since there aren't ways to defend against nuclear threats, Iran remains a threat
0
Iran's nuclear capabilities is a cause for worry, and since there are ways to defend against nuclear threats only if Iran is willing to, Iran remains a threat
Iran's nuclear capabilities is a cause for worry, but since there aren't ways to defend against nuclear threats until USA said he will stop Iran, Iran remains a threat


--------------------------------------------------------------------------------