![](\"screenshots/simple-relation.png\")
"
1234 | ]
1235 | },
1236 | {
1237 | "cell_type": "markdown",
1238 | "metadata": {
1239 | "deletable": true,
1240 | "editable": true
1241 | },
1242 | "source": [
1243 | "### V2: Nodes for relationships\n",
1244 | "One approach is to form a linked list of \"events\". Each event corresponds to a person updating the room that they are in. Since we chose edges to be our relations, we cannot form edges between relations. To alleviate this, we can transform the relation to a node, and draw two edges to form a 3-node triple."
1245 | ]
1246 | },
1247 | {
1248 | "cell_type": "code",
1249 | "execution_count": 27,
1250 | "metadata": {
1251 | "collapsed": true,
1252 | "deletable": true,
1253 | "editable": true
1254 | },
1255 | "outputs": [],
1256 | "source": [
1257 | "reset_db() # This will clear the database!"
1258 | ]
1259 | },
1260 | {
1261 | "cell_type": "code",
1262 | "execution_count": 28,
1263 | "metadata": {
1264 | "collapsed": true,
1265 | "deletable": true,
1266 | "editable": true
1267 | },
1268 | "outputs": [],
1269 | "source": [
1270 | "# Represent each relation as a node\n",
1271 | "v2_query = '''\n",
1272 | " MERGE (s:SUBJECT {name: $subject})\n",
1273 | " MERGE (o:OBJECT {name: $obj})\n",
1274 | " CREATE (s)-[:R0]->(r:RELATION {name: $relation})-[:R1]->(o)\n",
1275 | "'''\n",
1276 | "\n",
1277 | "create(v2_query)"
1278 | ]
1279 | },
1280 | {
1281 | "cell_type": "markdown",
1282 | "metadata": {
1283 | "deletable": true,
1284 | "editable": true
1285 | },
1286 | "source": [
1287 | "Run the query again and see what changed. This is better, since we can see how often a room has been visited, but still doesn't solve the question as to which room a person is in at any given time."
1288 | ]
1289 | },
1290 | {
1291 | "cell_type": "markdown",
1292 | "metadata": {
1293 | "deletable": true,
1294 | "editable": true
1295 | },
1296 | "source": [
1297 | "### V3: Linked list of relationships\n",
1298 | "The final step is to build the linked list based on the order in which the relations were created. This will allow us to not only find the room a person is in right now, but produce a list of rooms that they were in, in the order that they were visited."
1299 | ]
1300 | },
1301 | {
1302 | "cell_type": "code",
1303 | "execution_count": 29,
1304 | "metadata": {
1305 | "collapsed": false,
1306 | "deletable": true,
1307 | "editable": true
1308 | },
1309 | "outputs": [],
1310 | "source": [
1311 | "reset_db()"
1312 | ]
1313 | },
1314 | {
1315 | "cell_type": "code",
1316 | "execution_count": 30,
1317 | "metadata": {
1318 | "collapsed": false,
1319 | "deletable": true,
1320 | "editable": true
1321 | },
1322 | "outputs": [],
1323 | "source": [
1324 | "# Represent each relation as a node, ordered by a linked list (per subject)\n",
1325 | "v3_query = '''\n",
1326 | " MERGE (s:SUBJECT {name: $subject})\n",
1327 | " MERGE (o:OBJECT {name: $obj})\n",
1328 | " \n",
1329 | " WITH s,o\n",
1330 | " \n",
1331 | " // Create an new relation between the subject and object\n",
1332 | " CREATE (s)-[:R0]->(r:RELATION {name: $relation})-[:R1]->(o)\n",
1333 | " CREATE (s)-[h:HEAD]->(r) // Make the newly created relation the head of the list\n",
1334 | " \n",
1335 | " WITH s,r,o,h\n",
1336 | " \n",
1337 | " // Find the previous head of the list (if none exist, this query will terminate here)\n",
1338 | " MATCH (s)-[h_prev:HEAD]->(r_prev:RELATION)\n",
1339 | " WHERE h_prev <> h\n",
1340 | " \n",
1341 | " // Complete the link, remove the previous head pointer\n",
1342 | " CREATE (r_prev)-[:NEXT]->(r)\n",
1343 | " DELETE h_prev\n",
1344 | "'''"
1345 | ]
1346 | },
1347 | {
1348 | "cell_type": "code",
1349 | "execution_count": 31,
1350 | "metadata": {
1351 | "collapsed": true,
1352 | "deletable": true,
1353 | "editable": true
1354 | },
1355 | "outputs": [],
1356 | "source": [
1357 | "session = driver.session()\n",
1358 | "# Create an index for faster access\n",
1359 | "session.run('CREATE INDEX ON :SUBJECT(name)')\n",
1360 | "session.run('CREATE INDEX ON :RELATION(name)')\n",
1361 | "session.run('CREATE INDEX ON :OBJECT(name)')\n",
1362 | "create(v3_query)"
1363 | ]
1364 | },
1365 | {
1366 | "cell_type": "markdown",
1367 | "metadata": {
1368 | "deletable": true,
1369 | "editable": true
1370 | },
1371 | "source": [
1372 | "Check the new graph out and see what changed. It's helpful to change the colors of the nodes and edges to visualize this better."
1373 | ]
1374 | },
1375 | {
1376 | "cell_type": "markdown",
1377 | "metadata": {
1378 | "deletable": true,
1379 | "editable": true
1380 | },
1381 | "source": [
1382 | "![](\"screenshots/local-list.png\")
"
1383 | ]
1384 | },
1385 | {
1386 | "cell_type": "markdown",
1387 | "metadata": {
1388 | "deletable": true,
1389 | "editable": true
1390 | },
1391 | "source": [
1392 | "## Query the Graph\n",
1393 | "Now we can ask the graph useful questions.\n",
1394 | "#### Find the room a person is in"
1395 | ]
1396 | },
1397 | {
1398 | "cell_type": "code",
1399 | "execution_count": 32,
1400 | "metadata": {
1401 | "collapsed": true,
1402 | "deletable": true,
1403 | "editable": true
1404 | },
1405 | "outputs": [],
1406 | "source": [
1407 | "def find_person(person):\n",
1408 | " '''Find the room a person is currently in'''\n",
1409 | " query = '''\n",
1410 | " MATCH (s:SUBJECT {name:$name})-[:HEAD]->(r:RELATION)-->(o:OBJECT)\n",
1411 | " RETURN s AS subject, r AS relation, o AS obj\n",
1412 | " '''\n",
1413 | " return session.run(query, name=person)"
1414 | ]
1415 | },
1416 | {
1417 | "cell_type": "markdown",
1418 | "metadata": {
1419 | "deletable": true,
1420 | "editable": true
1421 | },
1422 | "source": [
1423 | "Using the graph-querying function above we can ask, \"Where is Mary?\""
1424 | ]
1425 | },
1426 | {
1427 | "cell_type": "code",
1428 | "execution_count": 33,
1429 | "metadata": {
1430 | "collapsed": false,
1431 | "deletable": true,
1432 | "editable": true
1433 | },
1434 | "outputs": [
1435 | {
1436 | "name": "stdout",
1437 | "output_type": "stream",
1438 | "text": [
1439 | "kitchen\n"
1440 | ]
1441 | }
1442 | ],
1443 | "source": [
1444 | "# Note: If this is run less than a second after creating the knowledge graph, \n",
1445 | "# the Python driver may cause a race condition where the graph \n",
1446 | "# isn't finished updating, which could give you the wrong answer.\n",
1447 | "session = driver.session()\n",
1448 | "record = find_person('Mary').single()\n",
1449 | "print(record['obj'].get('name'))"
1450 | ]
1451 | },
1452 | {
1453 | "cell_type": "markdown",
1454 | "metadata": {
1455 | "deletable": true,
1456 | "editable": true
1457 | },
1458 | "source": [
1459 | "According to the graph, Mary is in the kitchen. We can verify that this is true with the debug function below, and we can see the corresponding sentence that generated the relationship as well."
1460 | ]
1461 | },
1462 | {
1463 | "cell_type": "code",
1464 | "execution_count": 34,
1465 | "metadata": {
1466 | "collapsed": false,
1467 | "deletable": true,
1468 | "editable": true
1469 | },
1470 | "outputs": [
1471 | {
1472 | "data": {
1473 | "text/html": [
1474 | "![](\"screenshots/qa2-multiple-list.png\")
"
560 | ]
561 | },
562 | {
563 | "cell_type": "markdown",
564 | "metadata": {
565 | "deletable": true,
566 | "editable": true
567 | },
568 | "source": [
569 | "## Calcualte an Accuracy Score"
570 | ]
571 | },
572 | {
573 | "cell_type": "code",
574 | "execution_count": 27,
575 | "metadata": {
576 | "collapsed": true,
577 | "deletable": true,
578 | "editable": true
579 | },
580 | "outputs": [],
581 | "source": [
582 | "def get_answers(row):\n",
583 | " '''Given an input row merge the statement in the graph, \n",
584 | " or query the graph if it is a question'''\n",
585 | " if row.type == 'S':\n",
586 | " subject,relation,obj = row.extracted\n",
587 | " session.run(v4_query, subject=subject, relation=relation, obj=obj)\n",
588 | " return ''\n",
589 | " elif row.type == 'Q':\n",
590 | " obj = row.extracted\n",
591 | " # WARNING: do not consume the result (e.g., call .consume() or .single()) \n",
592 | " # until the entire iteration is done.\n",
593 | " # Failure to do so may cause the queries to be VERY slow!\n",
594 | " return find_object_location(obj)"
595 | ]
596 | },
597 | {
598 | "cell_type": "code",
599 | "execution_count": 28,
600 | "metadata": {
601 | "collapsed": true,
602 | "deletable": true,
603 | "editable": true
604 | },
605 | "outputs": [],
606 | "source": [
607 | "def traverse(result):\n",
608 | " if result['relation'] in acquire_actions:\n",
609 | " return result['acquire']\n",
610 | " else:\n",
611 | " return result['release']"
612 | ]
613 | },
614 | {
615 | "cell_type": "code",
616 | "execution_count": 30,
617 | "metadata": {
618 | "collapsed": false,
619 | "deletable": true,
620 | "editable": true
621 | },
622 | "outputs": [],
623 | "source": [
624 | "reset_db()"
625 | ]
626 | },
627 | {
628 | "cell_type": "code",
629 | "execution_count": 31,
630 | "metadata": {
631 | "collapsed": false,
632 | "deletable": true,
633 | "editable": true,
634 | "scrolled": true
635 | },
636 | "outputs": [],
637 | "source": [
638 | "session = driver.session()\n",
639 | "results = data.apply(get_answers, axis=1)\n",
640 | "results = [x for x in results if x != '']\n",
641 | "predicted = [traverse(result.single()) for result in results]"
642 | ]
643 | },
644 | {
645 | "cell_type": "code",
646 | "execution_count": 32,
647 | "metadata": {
648 | "collapsed": false,
649 | "deletable": true,
650 | "editable": true
651 | },
652 | "outputs": [
653 | {
654 | "data": {
655 | "text/plain": [
656 | "['garden', 'garden', 'hallway', 'hallway', 'kitchen']"
657 | ]
658 | },
659 | "execution_count": 32,
660 | "metadata": {},
661 | "output_type": "execute_result"
662 | }
663 | ],
664 | "source": [
665 | "predicted[:5]"
666 | ]
667 | },
668 | {
669 | "cell_type": "code",
670 | "execution_count": 33,
671 | "metadata": {
672 | "collapsed": true,
673 | "deletable": true,
674 | "editable": true
675 | },
676 | "outputs": [],
677 | "source": [
678 | "actual = list(questions().answer)"
679 | ]
680 | },
681 | {
682 | "cell_type": "code",
683 | "execution_count": 34,
684 | "metadata": {
685 | "collapsed": false,
686 | "deletable": true,
687 | "editable": true
688 | },
689 | "outputs": [
690 | {
691 | "data": {
692 | "text/plain": [
693 | "['garden', 'garden', 'hallway', 'hallway', 'kitchen']"
694 | ]
695 | },
696 | "execution_count": 34,
697 | "metadata": {},
698 | "output_type": "execute_result"
699 | }
700 | ],
701 | "source": [
702 | "actual[:5]"
703 | ]
704 | },
705 | {
706 | "cell_type": "code",
707 | "execution_count": 35,
708 | "metadata": {
709 | "collapsed": false,
710 | "deletable": true,
711 | "editable": true
712 | },
713 | "outputs": [
714 | {
715 | "data": {
716 | "text/plain": [
717 | "1.0"
718 | ]
719 | },
720 | "execution_count": 35,
721 | "metadata": {},
722 | "output_type": "execute_result"
723 | }
724 | ],
725 | "source": [
726 | "accuracy_score(actual, predicted)"
727 | ]
728 | },
729 | {
730 | "cell_type": "code",
731 | "execution_count": 36,
732 | "metadata": {
733 | "collapsed": false,
734 | "deletable": true,
735 | "editable": true
736 | },
737 | "outputs": [],
738 | "source": [
739 | "def find_incorrect(actual, predicted):\n",
740 | " z = list(zip(actual, predicted))\n",
741 | " return [(i, x[0], x[1]) for i,x in enumerate(z) if x[0] != x[1]]"
742 | ]
743 | },
744 | {
745 | "cell_type": "code",
746 | "execution_count": null,
747 | "metadata": {
748 | "collapsed": true,
749 | "deletable": true,
750 | "editable": true
751 | },
752 | "outputs": [],
753 | "source": []
754 | }
755 | ],
756 | "metadata": {
757 | "kernelspec": {
758 | "display_name": "Python 3",
759 | "language": "python",
760 | "name": "python3"
761 | },
762 | "language_info": {
763 | "codemirror_mode": {
764 | "name": "ipython",
765 | "version": 3
766 | },
767 | "file_extension": ".py",
768 | "mimetype": "text/x-python",
769 | "name": "python",
770 | "nbconvert_exporter": "python",
771 | "pygments_lexer": "ipython3",
772 | "version": "3.6.1"
773 | }
774 | },
775 | "nbformat": 4,
776 | "nbformat_minor": 2
777 | }
778 |
--------------------------------------------------------------------------------
/notebooks/dynamic_memory_3.ipynb:
--------------------------------------------------------------------------------
1 | {
2 | "cells": [
3 | {
4 | "cell_type": "markdown",
5 | "metadata": {},
6 | "source": [
7 | "# Memory Representation in Dialogue Systems (Part 3)\n",
8 | "\n",
9 | "Under construction, will update with explanations when finished.\n",
10 | "\n",
11 | "## Import"
12 | ]
13 | },
14 | {
15 | "cell_type": "code",
16 | "execution_count": 1,
17 | "metadata": {
18 | "collapsed": true
19 | },
20 | "outputs": [],
21 | "source": [
22 | "import pandas as pd\n",
23 | "import numpy as np\n",
24 | "import nltk\n",
25 | "from sklearn.metrics import accuracy_score\n",
26 | "from neo4j.v1 import GraphDatabase, basic_auth\n",
27 | "from collections import defaultdict"
28 | ]
29 | },
30 | {
31 | "cell_type": "code",
32 | "execution_count": 2,
33 | "metadata": {
34 | "collapsed": false
35 | },
36 | "outputs": [
37 | {
38 | "data": {
39 | "text/plain": [
40 | "(414, 52256)"
41 | ]
42 | },
43 | "execution_count": 2,
44 | "metadata": {},
45 | "output_type": "execute_result"
46 | }
47 | ],
48 | "source": [
49 | "refs_utts = pd.read_pickle('resources/utts_refs.pkl')\n",
50 | "props = pd.read_pickle('resources/restaurants_props.pkl')\n",
51 | "len(refs_utts), len(props)"
52 | ]
53 | },
54 | {
55 | "cell_type": "code",
56 | "execution_count": 3,
57 | "metadata": {
58 | "collapsed": false
59 | },
60 | "outputs": [
61 | {
62 | "data": {
63 | "text/html": [
64 | "\n",
65 | "\n",
66 | " \n",
67 | "
\n",
131 | "
"
132 | ],
133 | "text/plain": [
134 | " text \\\n",
135 | "0 [i, want, a, moderately, priced, restaurant, i... \n",
136 | "2 [cheap, restaurant, in, the, north, part, of, ... \n",
137 | "3 [cheap, restaurant, in, the, south, part, of, ... \n",
138 | "4 [cheap, restaurant, serving, indian, food] \n",
139 | "5 [thai, food] \n",
140 | "\n",
141 | " bot o ind mask gid target \n",
142 | "0 api_call R_cuisine west moderate trn 2 True 2 prezzo \n",
143 | "2 api_call R_cuisine north cheap trn 2 True 11 da_vinci_pizzeria \n",
144 | "3 api_call R_cuisine south cheap trn 2 True 12 the_lucky_star \n",
145 | "4 api_call indian R_location cheap trn 2 True 15 the_gandhi \n",
146 | "5 api_call thai R_location R_price trn 2 True 22 bangkok_city "
147 | ]
148 | },
149 | "execution_count": 3,
150 | "metadata": {},
151 | "output_type": "execute_result"
152 | }
153 | ],
154 | "source": [
155 | "refs_utts[:5]"
156 | ]
157 | },
158 | {
159 | "cell_type": "code",
160 | "execution_count": 4,
161 | "metadata": {
162 | "collapsed": false
163 | },
164 | "outputs": [
165 | {
166 | "data": {
167 | "text/html": [
168 | "| \n", 69 | " | text | \n", 70 | "bot | \n", 71 | "o | \n", 72 | "ind | \n", 73 | "mask | \n", 74 | "gid | \n", 75 | "target | \n", 76 | "
|---|---|---|---|---|---|---|---|
| 0 | \n", 81 | "[i, want, a, moderately, priced, restaurant, i... | \n", 82 | "api_call R_cuisine west moderate | \n", 83 | "trn | \n", 84 | "2 | \n", 85 | "True | \n", 86 | "2 | \n", 87 | "prezzo | \n", 88 | "
| 2 | \n", 91 | "[cheap, restaurant, in, the, north, part, of, ... | \n", 92 | "api_call R_cuisine north cheap | \n", 93 | "trn | \n", 94 | "2 | \n", 95 | "True | \n", 96 | "11 | \n", 97 | "da_vinci_pizzeria | \n", 98 | "
| 3 | \n", 101 | "[cheap, restaurant, in, the, south, part, of, ... | \n", 102 | "api_call R_cuisine south cheap | \n", 103 | "trn | \n", 104 | "2 | \n", 105 | "True | \n", 106 | "12 | \n", 107 | "the_lucky_star | \n", 108 | "
| 4 | \n", 111 | "[cheap, restaurant, serving, indian, food] | \n", 112 | "api_call indian R_location cheap | \n", 113 | "trn | \n", 114 | "2 | \n", 115 | "True | \n", 116 | "15 | \n", 117 | "the_gandhi | \n", 118 | "
| 5 | \n", 121 | "[thai, food] | \n", 122 | "api_call thai R_location R_price | \n", 123 | "trn | \n", 124 | "2 | \n", 125 | "True | \n", 126 | "22 | \n", 127 | "bangkok_city | \n", 128 | "
\n",
169 | "\n",
170 | " \n",
171 | "
\n",
211 | "
"
212 | ],
213 | "text/plain": [
214 | " rname attr_key attr_value\n",
215 | "3 saint_johns_chop_house R_cuisine british\n",
216 | "4 saint_johns_chop_house R_location west\n",
217 | "7 saint_johns_chop_house R_price moderate\n",
218 | "10 prezzo R_cuisine italian\n",
219 | "11 prezzo R_location west"
220 | ]
221 | },
222 | "execution_count": 4,
223 | "metadata": {},
224 | "output_type": "execute_result"
225 | }
226 | ],
227 | "source": [
228 | "props[:5]"
229 | ]
230 | },
231 | {
232 | "cell_type": "markdown",
233 | "metadata": {},
234 | "source": [
235 | "## Process Text"
236 | ]
237 | },
238 | {
239 | "cell_type": "code",
240 | "execution_count": 5,
241 | "metadata": {
242 | "collapsed": true
243 | },
244 | "outputs": [],
245 | "source": [
246 | "stemmer = nltk.stem.snowball.EnglishStemmer()\n",
247 | "\n",
248 | "def stem(sentence):\n",
249 | " return [stemmer.stem(w) for w in sentence]"
250 | ]
251 | },
252 | {
253 | "cell_type": "code",
254 | "execution_count": 6,
255 | "metadata": {
256 | "collapsed": false
257 | },
258 | "outputs": [
259 | {
260 | "data": {
261 | "text/plain": [
262 | "414"
263 | ]
264 | },
265 | "execution_count": 6,
266 | "metadata": {},
267 | "output_type": "execute_result"
268 | }
269 | ],
270 | "source": [
271 | "test = pd.DataFrame()\n",
272 | "test['text'] = [stem(s) for s in refs_utts.text]\n",
273 | "test['frame'] = [tuple(stem(f.split()[1:])) for f in refs_utts.bot]\n",
274 | "len(test)"
275 | ]
276 | },
277 | {
278 | "cell_type": "code",
279 | "execution_count": 7,
280 | "metadata": {
281 | "collapsed": false
282 | },
283 | "outputs": [
284 | {
285 | "data": {
286 | "text/plain": [
287 | "405"
288 | ]
289 | },
290 | "execution_count": 7,
291 | "metadata": {},
292 | "output_type": "execute_result"
293 | }
294 | ],
295 | "source": [
296 | "# Remove poorly formatted frames\n",
297 | "test = test[test.frame.map(len) == 3]\n",
298 | "len(test)"
299 | ]
300 | },
301 | {
302 | "cell_type": "code",
303 | "execution_count": 8,
304 | "metadata": {
305 | "collapsed": false
306 | },
307 | "outputs": [
308 | {
309 | "data": {
310 | "text/html": [
311 | "| \n", 173 | " | rname | \n", 174 | "attr_key | \n", 175 | "attr_value | \n", 176 | "
|---|---|---|---|
| 3 | \n", 181 | "saint_johns_chop_house | \n", 182 | "R_cuisine | \n", 183 | "british | \n", 184 | "
| 4 | \n", 187 | "saint_johns_chop_house | \n", 188 | "R_location | \n", 189 | "west | \n", 190 | "
| 7 | \n", 193 | "saint_johns_chop_house | \n", 194 | "R_price | \n", 195 | "moderate | \n", 196 | "
| 10 | \n", 199 | "prezzo | \n", 200 | "R_cuisine | \n", 201 | "italian | \n", 202 | "
| 11 | \n", 205 | "prezzo | \n", 206 | "R_location | \n", 207 | "west | \n", 208 | "
\n",
312 | "\n",
313 | " \n",
314 | "
\n",
348 | "
"
349 | ],
350 | "text/plain": [
351 | " text frame\n",
352 | "0 [i, want, a, moder, price, restaur, in, the, w... (r_cuisin, west, moder)\n",
353 | "1 [cheap, restaur, in, the, north, part, of, town] (r_cuisin, north, cheap)\n",
354 | "2 [cheap, restaur, in, the, south, part, of, town] (r_cuisin, south, cheap)\n",
355 | "3 [cheap, restaur, serv, indian, food] (indian, r_locat, cheap)\n",
356 | "4 [thai, food] (thai, r_locat, r_price)"
357 | ]
358 | },
359 | "execution_count": 8,
360 | "metadata": {},
361 | "output_type": "execute_result"
362 | }
363 | ],
364 | "source": [
365 | "test[:5]"
366 | ]
367 | },
368 | {
369 | "cell_type": "code",
370 | "execution_count": 9,
371 | "metadata": {
372 | "collapsed": true
373 | },
374 | "outputs": [],
375 | "source": [
376 | "knowledge = pd.DataFrame()\n",
377 | "knowledge['restaurant'] = props.rname.copy()\n",
378 | "knowledge['key'] = [stemmer.stem(s) for s in props.attr_key]\n",
379 | "knowledge['value'] = [stemmer.stem(s) for s in props.attr_value]"
380 | ]
381 | },
382 | {
383 | "cell_type": "code",
384 | "execution_count": 11,
385 | "metadata": {
386 | "collapsed": false
387 | },
388 | "outputs": [
389 | {
390 | "data": {
391 | "text/html": [
392 | "| \n", 316 | " | text | \n", 317 | "frame | \n", 318 | "
|---|---|---|
| 0 | \n", 323 | "[i, want, a, moder, price, restaur, in, the, w... | \n", 324 | "(r_cuisin, west, moder) | \n", 325 | "
| 1 | \n", 328 | "[cheap, restaur, in, the, north, part, of, town] | \n", 329 | "(r_cuisin, north, cheap) | \n", 330 | "
| 2 | \n", 333 | "[cheap, restaur, in, the, south, part, of, town] | \n", 334 | "(r_cuisin, south, cheap) | \n", 335 | "
| 3 | \n", 338 | "[cheap, restaur, serv, indian, food] | \n", 339 | "(indian, r_locat, cheap) | \n", 340 | "
| 4 | \n", 343 | "[thai, food] | \n", 344 | "(thai, r_locat, r_price) | \n", 345 | "
\n",
393 | "\n",
394 | " \n",
395 | "
\n",
435 | "
"
436 | ],
437 | "text/plain": [
438 | " restaurant key value\n",
439 | "3 saint_johns_chop_house r_cuisin british\n",
440 | "4 saint_johns_chop_house r_locat west\n",
441 | "7 saint_johns_chop_house r_price moder\n",
442 | "10 prezzo r_cuisin italian\n",
443 | "11 prezzo r_locat west"
444 | ]
445 | },
446 | "execution_count": 11,
447 | "metadata": {},
448 | "output_type": "execute_result"
449 | }
450 | ],
451 | "source": [
452 | "knowledge[:5]"
453 | ]
454 | },
455 | {
456 | "cell_type": "code",
457 | "execution_count": 11,
458 | "metadata": {
459 | "collapsed": false
460 | },
461 | "outputs": [],
462 | "source": [
463 | "# A dictionary of keys to the list of values they can take\n",
464 | "# In this instance, keys form mutually exclusive lists of values\n",
465 | "types = knowledge[['key', 'value']] \\\n",
466 | " .groupby('key') \\\n",
467 | " .aggregate(lambda x: tuple(set(x))) \\\n",
468 | " .reset_index() \\\n",
469 | " .set_index('key') \\\n",
470 | " .value \\\n",
471 | " .to_dict()"
472 | ]
473 | },
474 | {
475 | "cell_type": "code",
476 | "execution_count": 12,
477 | "metadata": {
478 | "collapsed": false
479 | },
480 | "outputs": [
481 | {
482 | "data": {
483 | "text/plain": [
484 | "('asian_orient', 'vietnames', 'lebanes', 'african', 'thai')"
485 | ]
486 | },
487 | "execution_count": 12,
488 | "metadata": {},
489 | "output_type": "execute_result"
490 | }
491 | ],
492 | "source": [
493 | "types['r_cuisin'][:5]"
494 | ]
495 | },
496 | {
497 | "cell_type": "code",
498 | "execution_count": 13,
499 | "metadata": {
500 | "collapsed": false
501 | },
502 | "outputs": [
503 | {
504 | "data": {
505 | "text/plain": [
506 | "('centr', 'south', 'west', 'east', 'north')"
507 | ]
508 | },
509 | "execution_count": 13,
510 | "metadata": {},
511 | "output_type": "execute_result"
512 | }
513 | ],
514 | "source": [
515 | "types['r_locat']"
516 | ]
517 | },
518 | {
519 | "cell_type": "code",
520 | "execution_count": 14,
521 | "metadata": {
522 | "collapsed": false
523 | },
524 | "outputs": [
525 | {
526 | "data": {
527 | "text/plain": [
528 | "('expens', 'moder', 'cheap')"
529 | ]
530 | },
531 | "execution_count": 14,
532 | "metadata": {},
533 | "output_type": "execute_result"
534 | }
535 | ],
536 | "source": [
537 | "types['r_price']"
538 | ]
539 | },
540 | {
541 | "cell_type": "markdown",
542 | "metadata": {},
543 | "source": [
544 | "## Create Knowledge Graph"
545 | ]
546 | },
547 | {
548 | "cell_type": "code",
549 | "execution_count": 15,
550 | "metadata": {
551 | "collapsed": true
552 | },
553 | "outputs": [],
554 | "source": [
555 | "# Create a neo4j session\n",
556 | "driver = GraphDatabase.driver('bolt://localhost:7687', auth=basic_auth('neo4j', 'neo4j'))"
557 | ]
558 | },
559 | {
560 | "cell_type": "code",
561 | "execution_count": 16,
562 | "metadata": {
563 | "collapsed": true
564 | },
565 | "outputs": [],
566 | "source": [
567 | "# WARNING: This will clear the database when run!\n",
568 | "def reset_db():\n",
569 | " session = driver.session()\n",
570 | " session.run('MATCH (n) DETACH DELETE n')"
571 | ]
572 | },
573 | {
574 | "cell_type": "code",
575 | "execution_count": 17,
576 | "metadata": {
577 | "collapsed": false
578 | },
579 | "outputs": [],
580 | "source": [
581 | "reset_db()"
582 | ]
583 | },
584 | {
585 | "cell_type": "code",
586 | "execution_count": 18,
587 | "metadata": {
588 | "collapsed": false
589 | },
590 | "outputs": [],
591 | "source": [
592 | "session = driver.session()\n",
593 | "\n",
594 | "for i,row in knowledge.iterrows():\n",
595 | " subject, relation, obj = row.restaurant, row.key, row.value\n",
596 | " session.run('''\n",
597 | " MERGE (s:SUBJECT {name: $subject}) \n",
598 | " MERGE (o:OBJECT {name: $obj}) \n",
599 | " MERGE (s)-[r:RELATION {name: $relation}]->(o)\n",
600 | " ''', { \n",
601 | " 'subject': subject,\n",
602 | " 'relation': relation,\n",
603 | " 'obj': obj\n",
604 | " })"
605 | ]
606 | },
607 | {
608 | "cell_type": "markdown",
609 | "metadata": {},
610 | "source": [
611 | "## Test\n",
612 | "#### Baseline\n",
613 | "The baseline accuracy is the slot accuracy, calculated by the assumption of not knowing any frame values for any of the sentences."
614 | ]
615 | },
616 | {
617 | "cell_type": "code",
618 | "execution_count": 19,
619 | "metadata": {
620 | "collapsed": false
621 | },
622 | "outputs": [
623 | {
624 | "data": {
625 | "text/plain": [
626 | "('r_cuisin', 'r_locat', 'r_price')"
627 | ]
628 | },
629 | "execution_count": 19,
630 | "metadata": {},
631 | "output_type": "execute_result"
632 | }
633 | ],
634 | "source": [
635 | "dont_know = tuple(types.keys())\n",
636 | "dont_know"
637 | ]
638 | },
639 | {
640 | "cell_type": "code",
641 | "execution_count": 20,
642 | "metadata": {
643 | "collapsed": false
644 | },
645 | "outputs": [],
646 | "source": [
647 | "base_predicted = list(dont_know) * len(test)\n",
648 | "base_actual = [w for frame in test.frame for w in frame]"
649 | ]
650 | },
651 | {
652 | "cell_type": "code",
653 | "execution_count": 21,
654 | "metadata": {
655 | "collapsed": false
656 | },
657 | "outputs": [
658 | {
659 | "data": {
660 | "text/plain": [
661 | "0.45267489711934156"
662 | ]
663 | },
664 | "execution_count": 21,
665 | "metadata": {},
666 | "output_type": "execute_result"
667 | }
668 | ],
669 | "source": [
670 | "accuracy_score(base_actual, base_predicted)"
671 | ]
672 | },
673 | {
674 | "cell_type": "markdown",
675 | "metadata": {},
676 | "source": [
677 | "#### Accuracy"
678 | ]
679 | },
680 | {
681 | "cell_type": "code",
682 | "execution_count": 91,
683 | "metadata": {
684 | "collapsed": false
685 | },
686 | "outputs": [],
687 | "source": [
688 | "# Cache properties from DB\n",
689 | "# Running this query will obtain all properties at this point in time\n",
690 | "def get_properties():\n",
691 | " session = driver.session()\n",
692 | " return session.run('''\n",
693 | " MATCH ()-[r:RELATION]->(o:OBJECT) \n",
694 | " RETURN collect(distinct o.name) AS properties\n",
695 | " ''').single()['properties']"
696 | ]
697 | },
698 | {
699 | "cell_type": "code",
700 | "execution_count": 92,
701 | "metadata": {
702 | "collapsed": true
703 | },
704 | "outputs": [],
705 | "source": [
706 | "# def get_types():\n",
707 | "# session = driver.session()\n",
708 | "# result = session.run('''\n",
709 | "# MATCH ()-[r:RELATION]->(o:OBJECT) \n",
710 | "# RETURN collect(distinct [r.name, o.name]) AS pair\n",
711 | "# ''').single()[0]\n",
712 | " \n",
713 | "# g_types = defaultdict(lambda: [])\n",
714 | "# for k,v in result:\n",
715 | "# g_types[k].append(v)\n",
716 | "# return g_types"
717 | ]
718 | },
719 | {
720 | "cell_type": "code",
721 | "execution_count": 115,
722 | "metadata": {
723 | "collapsed": false
724 | },
725 | "outputs": [],
726 | "source": [
727 | "properties = set(get_properties())"
728 | ]
729 | },
730 | {
731 | "cell_type": "code",
732 | "execution_count": 116,
733 | "metadata": {
734 | "collapsed": true
735 | },
736 | "outputs": [],
737 | "source": [
738 | "# Hotword listener\n",
739 | "def is_hotword(word):\n",
740 | " return word in properties"
741 | ]
742 | },
743 | {
744 | "cell_type": "code",
745 | "execution_count": 117,
746 | "metadata": {
747 | "collapsed": false
748 | },
749 | "outputs": [
750 | {
751 | "data": {
752 | "text/plain": [
753 | "(True, False)"
754 | ]
755 | },
756 | "execution_count": 117,
757 | "metadata": {},
758 | "output_type": "execute_result"
759 | }
760 | ],
761 | "source": [
762 | "is_hotword('british'), is_hotword('python')"
763 | ]
764 | },
765 | {
766 | "cell_type": "code",
767 | "execution_count": 122,
768 | "metadata": {
769 | "collapsed": true
770 | },
771 | "outputs": [],
772 | "source": [
773 | "# Issue DB queries\n",
774 | "def find_slot(prop):\n",
775 | " return session.run('''\n",
776 | " MATCH (s:SUBJECT)-[r:RELATION]->(o:OBJECT {name:$name}) \n",
777 | " RETURN collect(distinct [r.name, o.name]) AS properties\n",
778 | " ''', {\n",
779 | " 'name': prop\n",
780 | " })\n",
781 | "\n",
782 | "def extract(result):\n",
783 | " return result.single()['properties'][0]"
784 | ]
785 | },
786 | {
787 | "cell_type": "code",
788 | "execution_count": 123,
789 | "metadata": {
790 | "collapsed": false
791 | },
792 | "outputs": [
793 | {
794 | "data": {
795 | "text/plain": [
796 | "['r_locat', 'west']"
797 | ]
798 | },
799 | "execution_count": 123,
800 | "metadata": {},
801 | "output_type": "execute_result"
802 | }
803 | ],
804 | "source": [
805 | "session = driver.session()\n",
806 | "extract(find_slot('west'))"
807 | ]
808 | },
809 | {
810 | "cell_type": "code",
811 | "execution_count": 183,
812 | "metadata": {
813 | "collapsed": false
814 | },
815 | "outputs": [],
816 | "source": [
817 | "session = driver.session()\n",
818 | "all_slots = [[find_slot(word) for word in sentence if is_hotword(word)] for sentence in test.text]\n",
819 | "extracted_slots = [[tuple(extract(slot)) for slot in slots] for slots in all_slots]\n",
820 | "test['slots'] = extracted_slots"
821 | ]
822 | },
823 | {
824 | "cell_type": "code",
825 | "execution_count": 184,
826 | "metadata": {
827 | "collapsed": true
828 | },
829 | "outputs": [],
830 | "source": [
831 | "def to_frame(slots):\n",
832 | " frame = list(dont_know)\n",
833 | " s = dict(slots)\n",
834 | " \n",
835 | " for i,x in enumerate(frame):\n",
836 | " if x in s.keys():\n",
837 | " frame[i] = s[x]\n",
838 | " \n",
839 | " return tuple(frame)"
840 | ]
841 | },
842 | {
843 | "cell_type": "code",
844 | "execution_count": 185,
845 | "metadata": {
846 | "collapsed": false
847 | },
848 | "outputs": [],
849 | "source": [
850 | "test['predicted'] = [to_frame(slot) for slot in test.slots]"
851 | ]
852 | },
853 | {
854 | "cell_type": "code",
855 | "execution_count": 186,
856 | "metadata": {
857 | "collapsed": false
858 | },
859 | "outputs": [
860 | {
861 | "data": {
862 | "text/html": [
863 | "| \n", 397 | " | restaurant | \n", 398 | "key | \n", 399 | "value | \n", 400 | "
|---|---|---|---|
| 3 | \n", 405 | "saint_johns_chop_house | \n", 406 | "r_cuisin | \n", 407 | "british | \n", 408 | "
| 4 | \n", 411 | "saint_johns_chop_house | \n", 412 | "r_locat | \n", 413 | "west | \n", 414 | "
| 7 | \n", 417 | "saint_johns_chop_house | \n", 418 | "r_price | \n", 419 | "moder | \n", 420 | "
| 10 | \n", 423 | "prezzo | \n", 424 | "r_cuisin | \n", 425 | "italian | \n", 426 | "
| 11 | \n", 429 | "prezzo | \n", 430 | "r_locat | \n", 431 | "west | \n", 432 | "
\n",
864 | "\n",
865 | " \n",
866 | "
\n",
912 | "
"
913 | ],
914 | "text/plain": [
915 | " text \\\n",
916 | "0 [i, want, a, moder, price, restaur, in, the, w... \n",
917 | "1 [cheap, restaur, in, the, north, part, of, town] \n",
918 | "2 [cheap, restaur, in, the, south, part, of, town] \n",
919 | "3 [cheap, restaur, serv, indian, food] \n",
920 | "4 [thai, food] \n",
921 | "\n",
922 | " frame slots \\\n",
923 | "0 (r_cuisin, west, moder) [(r_price, moder), (r_locat, west)] \n",
924 | "1 (r_cuisin, north, cheap) [(r_price, cheap), (r_locat, north)] \n",
925 | "2 (r_cuisin, south, cheap) [(r_price, cheap), (r_locat, south)] \n",
926 | "3 (indian, r_locat, cheap) [(r_price, cheap), (r_cuisin, indian)] \n",
927 | "4 (thai, r_locat, r_price) [(r_cuisin, thai)] \n",
928 | "\n",
929 | " predicted \n",
930 | "0 (r_cuisin, west, moder) \n",
931 | "1 (r_cuisin, north, cheap) \n",
932 | "2 (r_cuisin, south, cheap) \n",
933 | "3 (indian, r_locat, cheap) \n",
934 | "4 (thai, r_locat, r_price) "
935 | ]
936 | },
937 | "execution_count": 186,
938 | "metadata": {},
939 | "output_type": "execute_result"
940 | }
941 | ],
942 | "source": [
943 | "test[:5]"
944 | ]
945 | },
946 | {
947 | "cell_type": "code",
948 | "execution_count": 173,
949 | "metadata": {
950 | "collapsed": false
951 | },
952 | "outputs": [],
953 | "source": [
954 | "predicted = [w for frame in test.predicted for w in frame]\n",
955 | "actual = [w for frame in test.frame for w in frame]"
956 | ]
957 | },
958 | {
959 | "cell_type": "code",
960 | "execution_count": 187,
961 | "metadata": {
962 | "collapsed": false
963 | },
964 | "outputs": [
965 | {
966 | "data": {
967 | "text/plain": [
968 | "0.96954732510288066"
969 | ]
970 | },
971 | "execution_count": 187,
972 | "metadata": {},
973 | "output_type": "execute_result"
974 | }
975 | ],
976 | "source": [
977 | "accuracy_score(actual, predicted)"
978 | ]
979 | },
980 | {
981 | "cell_type": "code",
982 | "execution_count": 193,
983 | "metadata": {
984 | "collapsed": false
985 | },
986 | "outputs": [
987 | {
988 | "name": "stdout",
989 | "output_type": "stream",
990 | "text": [
991 | " | r |\n",
992 | " | _ r r |\n",
993 | " | c _ _ e |\n",
994 | " | u l c p m n s x |\n",
995 | " | i o h r o e o w o p |\n",
996 | " | s c e i d a r e u e |\n",
997 | " | i a a c e s t s t n |\n",
998 | " | n t p e r t h t h s |\n",
999 | "---------+-----------------------------------------------------------------------+\n",
1000 | "r_cuisin | <18.9%> . . . . . . . . . |\n",
1001 | " r_locat | . <14.7%> . . . . . 0.1% 0.6% . |\n",
1002 | " cheap | . . <11.9%> 0.2% . . . . . . |\n",
1003 | " r_price | . . 0.1% <10.5%> 0.2% . . . . 0.1% |\n",
1004 | " moder | . . . 0.2% <8.2%> . . . . . |\n",
1005 | " east | . . . . . <6.4%> . . . . |\n",
1006 | " north | . . . . . . <5.1%> . . . |\n",
1007 | " west | . 0.2% . . . . . <3.3%> . . |\n",
1008 | " south | . . . . . . . . <3.0%> . |\n",
1009 | " expens | . . . . . . . . . <1.9%>|\n",
1010 | "---------+-----------------------------------------------------------------------+\n",
1011 | "(row = reference; col = test)\n",
1012 | "\n"
1013 | ]
1014 | }
1015 | ],
1016 | "source": [
1017 | "cm = nltk.ConfusionMatrix(actual, predicted)\n",
1018 | "print(cm.pretty_format(sort_by_count=True, show_percents=True, truncate=10))"
1019 | ]
1020 | },
1021 | {
1022 | "cell_type": "code",
1023 | "execution_count": 207,
1024 | "metadata": {
1025 | "collapsed": false
1026 | },
1027 | "outputs": [
1028 | {
1029 | "data": {
1030 | "text/html": [
1031 | "| \n", 868 | " | text | \n", 869 | "frame | \n", 870 | "slots | \n", 871 | "predicted | \n", 872 | "
|---|---|---|---|---|
| 0 | \n", 877 | "[i, want, a, moder, price, restaur, in, the, w... | \n", 878 | "(r_cuisin, west, moder) | \n", 879 | "[(r_price, moder), (r_locat, west)] | \n", 880 | "(r_cuisin, west, moder) | \n", 881 | "
| 1 | \n", 884 | "[cheap, restaur, in, the, north, part, of, town] | \n", 885 | "(r_cuisin, north, cheap) | \n", 886 | "[(r_price, cheap), (r_locat, north)] | \n", 887 | "(r_cuisin, north, cheap) | \n", 888 | "
| 2 | \n", 891 | "[cheap, restaur, in, the, south, part, of, town] | \n", 892 | "(r_cuisin, south, cheap) | \n", 893 | "[(r_price, cheap), (r_locat, south)] | \n", 894 | "(r_cuisin, south, cheap) | \n", 895 | "
| 3 | \n", 898 | "[cheap, restaur, serv, indian, food] | \n", 899 | "(indian, r_locat, cheap) | \n", 900 | "[(r_price, cheap), (r_cuisin, indian)] | \n", 901 | "(indian, r_locat, cheap) | \n", 902 | "
| 4 | \n", 905 | "[thai, food] | \n", 906 | "(thai, r_locat, r_price) | \n", 907 | "[(r_cuisin, thai)] | \n", 908 | "(thai, r_locat, r_price) | \n", 909 | "
\n",
1032 | "\n",
1033 | " \n",
1034 | "
\n",
1472 | "
"
1474 | ],
1475 | "text/plain": [
1476 | " text \\\n",
1477 | "1 [cheap, restaur, in, the, north, part, of, town] \n",
1478 | "2 [cheap, restaur, in, the, south, part, of, town] \n",
1479 | "3 [cheap, restaur, serv, indian, food] \n",
1480 | "7 [im, look, for, a, cheap, restaur, in, the, no... \n",
1481 | "10 [cheap, restaur] \n",
1482 | "12 [i, want, a, cheap, restaur, in, the, west, pa... \n",
1483 | "14 [i, am, look, for, a, cheap, restaur, in, the,... \n",
1484 | "15 [im, look, for, a, cheap, restaur, serv, inter... \n",
1485 | "17 [look, for, a, cheap, restaur, in, the, south,... \n",
1486 | "20 [look, for, someth, cheap, in, the, north, sid... \n",
1487 | "33 [im, look, for, a, cheap, restaur, in, the, so... \n",
1488 | "40 [i, want, a, cheap, restaur, in, the, south, p... \n",
1489 | "44 [i, need, a, cheap, restaur, in, the, south, p... \n",
1490 | "46 [i, want, a, cheap, restaur, in, the, east, pa... \n",
1491 | "57 [breath, id, like, a, cheap, restaur, in, the,... \n",
1492 | "61 [im, look, for, a, cheap, restaur, in, the, we... \n",
1493 | "62 [i, would, like, to, find, a, cheap, restaur, ... \n",
1494 | "68 [cheap, restaur, in, the, north, part, of, town] \n",
1495 | "71 [i, would, like, a, cheap, restaur, in, the, n... \n",
1496 | "72 [i, would, like, a, cheap, restaur, in, the, w... \n",
1497 | "76 [im, look, for, a, cheap, restaur, in, the, we... \n",
1498 | "82 [im, look, for, a, cheap, restaur, in, the, so... \n",
1499 | "83 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1500 | "84 [cheap, restaur, serv, spanish, food] \n",
1501 | "86 [im, look, for, a, cheap, restaur, in, the, no... \n",
1502 | "89 [im, look, for, a, cheap, restaur, in, the, we... \n",
1503 | "92 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1504 | "96 [i, need, a, cheap, restaur, in, the, west, pa... \n",
1505 | "98 [im, look, for, a, cheap, restaur, in, the, no... \n",
1506 | "99 [im, look, for, a, cheap, restaur, in, the, no... \n",
1507 | ".. ... \n",
1508 | "337 [look, for, a, cheap, restaur, in, the, east, ... \n",
1509 | "340 [cheap, restaur, west, part, of, town] \n",
1510 | "343 [im, look, for, a, cheap, restaur, and, it, sh... \n",
1511 | "346 [im, look, for, a, cheap, restaur, in, the, we... \n",
1512 | "350 [cheap, restaur, south, part, of, town] \n",
1513 | "351 [iam, look, for, a, cheap, restaur, and, it, s... \n",
1514 | "352 [uh, i, want, a, cheap, restaur, and, it, shou... \n",
1515 | "353 [im, look, for, a, cheap, restaur, in, the, so... \n",
1516 | "354 [i, would, like, a, cheap, restaur, in, the, s... \n",
1517 | "356 [can, i, have, a, cheap, restaur, in, the, wes... \n",
1518 | "358 [i, am, look, for, a, cheap, restaur, in, the,... \n",
1519 | "360 [a, want, a, cheap, restaur, in, the, north, p... \n",
1520 | "365 [cheap, restaur, in, th, east, part, of, town] \n",
1521 | "366 [im, look, for, a, cheap, restaur, and, it, sh... \n",
1522 | "369 [cheap, restaur, in, th, east, part, of, town] \n",
1523 | "371 [cheap, restaur, in, the, east, part, of, town] \n",
1524 | "372 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1525 | "374 [look, for, someth, cheap, on, the, east, part... \n",
1526 | "377 [im, look, for, a, cheap, restaur, serv, medit... \n",
1527 | "378 [im, look, for, a, cheap, restaur, in, the, so... \n",
1528 | "384 [im, look, for, a, cheap, restaur, that, serv,... \n",
1529 | "389 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1530 | "393 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1531 | "396 [cheap, restaur, east, part, of, town] \n",
1532 | "398 [look, for, a, cheap, restaur, in, the, east, ... \n",
1533 | "400 [cheap, restaur, on, the, east, part, of, town] \n",
1534 | "406 [cheap, restaur, in, the, east, part, of, town] \n",
1535 | "410 [i, need, a, cheap, restaur, in, the, east, pa... \n",
1536 | "412 [cheap, restaur, east, part, of, town] \n",
1537 | "413 [im, look, for, a, cheap, restaur, in, the, ea... \n",
1538 | "\n",
1539 | " frame \\\n",
1540 | "1 (r_cuisin, north, cheap) \n",
1541 | "2 (r_cuisin, south, cheap) \n",
1542 | "3 (indian, r_locat, cheap) \n",
1543 | "7 (r_cuisin, north, cheap) \n",
1544 | "10 (r_cuisin, r_locat, cheap) \n",
1545 | "12 (r_cuisin, west, cheap) \n",
1546 | "14 (r_cuisin, east, cheap) \n",
1547 | "15 (intern, r_locat, cheap) \n",
1548 | "17 (r_cuisin, south, cheap) \n",
1549 | "20 (r_cuisin, north, cheap) \n",
1550 | "33 (r_cuisin, r_locat, cheap) \n",
1551 | "40 (r_cuisin, r_locat, cheap) \n",
1552 | "44 (r_cuisin, south, cheap) \n",
1553 | "46 (r_cuisin, east, cheap) \n",
1554 | "57 (r_cuisin, south, cheap) \n",
1555 | "61 (r_cuisin, west, cheap) \n",
1556 | "62 (r_cuisin, south, cheap) \n",
1557 | "68 (r_cuisin, north, cheap) \n",
1558 | "71 (r_cuisin, north, cheap) \n",
1559 | "72 (r_cuisin, west, cheap) \n",
1560 | "76 (r_cuisin, west, cheap) \n",
1561 | "82 (r_cuisin, south, cheap) \n",
1562 | "83 (r_cuisin, east, cheap) \n",
1563 | "84 (spanish, r_locat, cheap) \n",
1564 | "86 (r_cuisin, north, cheap) \n",
1565 | "89 (r_cuisin, west, cheap) \n",
1566 | "92 (r_cuisin, east, cheap) \n",
1567 | "96 (r_cuisin, west, cheap) \n",
1568 | "98 (r_cuisin, north, cheap) \n",
1569 | "99 (r_cuisin, north, cheap) \n",
1570 | ".. ... \n",
1571 | "337 (r_cuisin, east, cheap) \n",
1572 | "340 (r_cuisin, west, cheap) \n",
1573 | "343 (r_cuisin, north, cheap) \n",
1574 | "346 (r_cuisin, west, cheap) \n",
1575 | "350 (r_cuisin, south, cheap) \n",
1576 | "351 (r_cuisin, north, cheap) \n",
1577 | "352 (r_cuisin, north, cheap) \n",
1578 | "353 (r_cuisin, south, cheap) \n",
1579 | "354 (r_cuisin, r_locat, cheap) \n",
1580 | "356 (r_cuisin, west, cheap) \n",
1581 | "358 (r_cuisin, west, cheap) \n",
1582 | "360 (r_cuisin, north, cheap) \n",
1583 | "365 (r_cuisin, east, cheap) \n",
1584 | "366 (r_cuisin, east, cheap) \n",
1585 | "369 (r_cuisin, east, cheap) \n",
1586 | "371 (r_cuisin, east, cheap) \n",
1587 | "372 (r_cuisin, east, cheap) \n",
1588 | "374 (r_cuisin, east, cheap) \n",
1589 | "377 (mediterranean, r_locat, cheap) \n",
1590 | "378 (r_cuisin, south, cheap) \n",
1591 | "384 (vietnames, r_locat, cheap) \n",
1592 | "389 (r_cuisin, east, cheap) \n",
1593 | "393 (r_cuisin, east, cheap) \n",
1594 | "396 (r_cuisin, east, cheap) \n",
1595 | "398 (r_cuisin, east, cheap) \n",
1596 | "400 (r_cuisin, east, cheap) \n",
1597 | "406 (r_cuisin, east, cheap) \n",
1598 | "410 (r_cuisin, east, cheap) \n",
1599 | "412 (r_cuisin, east, cheap) \n",
1600 | "413 (r_cuisin, east, cheap) \n",
1601 | "\n",
1602 | " slots \\\n",
1603 | "1 [(r_price, cheap), (r_locat, north)] \n",
1604 | "2 [(r_price, cheap), (r_locat, south)] \n",
1605 | "3 [(r_price, cheap), (r_cuisin, indian)] \n",
1606 | "7 [(r_price, cheap), (r_locat, north)] \n",
1607 | "10 [(r_price, cheap)] \n",
1608 | "12 [(r_price, cheap), (r_locat, west)] \n",
1609 | "14 [(r_price, cheap), (r_locat, east)] \n",
1610 | "15 [(r_price, cheap), (r_cuisin, intern)] \n",
1611 | "17 [(r_price, cheap), (r_locat, south)] \n",
1612 | "20 [(r_price, cheap), (r_locat, north)] \n",
1613 | "33 [(r_price, cheap), (r_locat, south)] \n",
1614 | "40 [(r_price, cheap), (r_locat, south)] \n",
1615 | "44 [(r_price, cheap), (r_locat, south)] \n",
1616 | "46 [(r_price, cheap), (r_locat, east)] \n",
1617 | "57 [(r_price, cheap), (r_locat, south)] \n",
1618 | "61 [(r_price, cheap), (r_locat, west)] \n",
1619 | "62 [(r_price, cheap), (r_locat, south)] \n",
1620 | "68 [(r_price, cheap), (r_locat, north)] \n",
1621 | "71 [(r_price, cheap), (r_locat, north)] \n",
1622 | "72 [(r_price, cheap), (r_locat, west)] \n",
1623 | "76 [(r_price, cheap), (r_locat, west)] \n",
1624 | "82 [(r_price, cheap), (r_locat, south)] \n",
1625 | "83 [(r_price, cheap), (r_locat, east)] \n",
1626 | "84 [(r_price, cheap), (r_cuisin, spanish)] \n",
1627 | "86 [(r_price, cheap), (r_locat, north)] \n",
1628 | "89 [(r_price, cheap), (r_locat, west)] \n",
1629 | "92 [(r_price, cheap), (r_locat, east)] \n",
1630 | "96 [(r_price, cheap), (r_locat, west)] \n",
1631 | "98 [(r_price, cheap), (r_locat, north)] \n",
1632 | "99 [(r_price, cheap), (r_locat, north)] \n",
1633 | ".. ... \n",
1634 | "337 [(r_price, cheap), (r_locat, east)] \n",
1635 | "340 [(r_price, cheap), (r_locat, west)] \n",
1636 | "343 [(r_price, cheap), (r_locat, north)] \n",
1637 | "346 [(r_price, cheap), (r_locat, west)] \n",
1638 | "350 [(r_price, cheap), (r_locat, south)] \n",
1639 | "351 [(r_price, cheap), (r_locat, north)] \n",
1640 | "352 [(r_price, cheap), (r_locat, north)] \n",
1641 | "353 [(r_price, cheap), (r_locat, south)] \n",
1642 | "354 [(r_price, cheap), (r_locat, south)] \n",
1643 | "356 [(r_price, cheap), (r_locat, west)] \n",
1644 | "358 [(r_price, cheap), (r_locat, west)] \n",
1645 | "360 [(r_price, cheap), (r_locat, north)] \n",
1646 | "365 [(r_price, cheap), (r_locat, east)] \n",
1647 | "366 [(r_price, cheap), (r_locat, east)] \n",
1648 | "369 [(r_price, cheap), (r_locat, east)] \n",
1649 | "371 [(r_price, cheap), (r_locat, east)] \n",
1650 | "372 [(r_price, cheap), (r_locat, east)] \n",
1651 | "374 [(r_price, cheap), (r_locat, east)] \n",
1652 | "377 [(r_price, cheap), (r_cuisin, mediterranean)] \n",
1653 | "378 [(r_price, cheap), (r_locat, south)] \n",
1654 | "384 [(r_price, cheap), (r_cuisin, vietnames)] \n",
1655 | "389 [(r_price, cheap), (r_locat, east)] \n",
1656 | "393 [(r_price, cheap), (r_locat, east)] \n",
1657 | "396 [(r_price, cheap), (r_locat, east)] \n",
1658 | "398 [(r_price, cheap), (r_locat, east)] \n",
1659 | "400 [(r_price, cheap), (r_locat, east)] \n",
1660 | "406 [(r_price, cheap), (r_locat, east)] \n",
1661 | "410 [(r_price, cheap), (r_locat, east)] \n",
1662 | "412 [(r_price, cheap), (r_locat, east)] \n",
1663 | "413 [(r_price, cheap), (r_locat, east)] \n",
1664 | "\n",
1665 | " predicted \n",
1666 | "1 (r_cuisin, north, cheap) \n",
1667 | "2 (r_cuisin, south, cheap) \n",
1668 | "3 (indian, r_locat, cheap) \n",
1669 | "7 (r_cuisin, north, cheap) \n",
1670 | "10 (r_cuisin, r_locat, cheap) \n",
1671 | "12 (r_cuisin, west, cheap) \n",
1672 | "14 (r_cuisin, east, cheap) \n",
1673 | "15 (intern, r_locat, cheap) \n",
1674 | "17 (r_cuisin, south, cheap) \n",
1675 | "20 (r_cuisin, north, cheap) \n",
1676 | "33 (r_cuisin, south, cheap) \n",
1677 | "40 (r_cuisin, south, cheap) \n",
1678 | "44 (r_cuisin, south, cheap) \n",
1679 | "46 (r_cuisin, east, cheap) \n",
1680 | "57 (r_cuisin, south, cheap) \n",
1681 | "61 (r_cuisin, west, cheap) \n",
1682 | "62 (r_cuisin, south, cheap) \n",
1683 | "68 (r_cuisin, north, cheap) \n",
1684 | "71 (r_cuisin, north, cheap) \n",
1685 | "72 (r_cuisin, west, cheap) \n",
1686 | "76 (r_cuisin, west, cheap) \n",
1687 | "82 (r_cuisin, south, cheap) \n",
1688 | "83 (r_cuisin, east, cheap) \n",
1689 | "84 (spanish, r_locat, cheap) \n",
1690 | "86 (r_cuisin, north, cheap) \n",
1691 | "89 (r_cuisin, west, cheap) \n",
1692 | "92 (r_cuisin, east, cheap) \n",
1693 | "96 (r_cuisin, west, cheap) \n",
1694 | "98 (r_cuisin, north, cheap) \n",
1695 | "99 (r_cuisin, north, cheap) \n",
1696 | ".. ... \n",
1697 | "337 (r_cuisin, east, cheap) \n",
1698 | "340 (r_cuisin, west, cheap) \n",
1699 | "343 (r_cuisin, north, cheap) \n",
1700 | "346 (r_cuisin, west, cheap) \n",
1701 | "350 (r_cuisin, south, cheap) \n",
1702 | "351 (r_cuisin, north, cheap) \n",
1703 | "352 (r_cuisin, north, cheap) \n",
1704 | "353 (r_cuisin, south, cheap) \n",
1705 | "354 (r_cuisin, south, cheap) \n",
1706 | "356 (r_cuisin, west, cheap) \n",
1707 | "358 (r_cuisin, west, cheap) \n",
1708 | "360 (r_cuisin, north, cheap) \n",
1709 | "365 (r_cuisin, east, cheap) \n",
1710 | "366 (r_cuisin, east, cheap) \n",
1711 | "369 (r_cuisin, east, cheap) \n",
1712 | "371 (r_cuisin, east, cheap) \n",
1713 | "372 (r_cuisin, east, cheap) \n",
1714 | "374 (r_cuisin, east, cheap) \n",
1715 | "377 (mediterranean, r_locat, cheap) \n",
1716 | "378 (r_cuisin, south, cheap) \n",
1717 | "384 (vietnames, r_locat, cheap) \n",
1718 | "389 (r_cuisin, east, cheap) \n",
1719 | "393 (r_cuisin, east, cheap) \n",
1720 | "396 (r_cuisin, east, cheap) \n",
1721 | "398 (r_cuisin, east, cheap) \n",
1722 | "400 (r_cuisin, east, cheap) \n",
1723 | "406 (r_cuisin, east, cheap) \n",
1724 | "410 (r_cuisin, east, cheap) \n",
1725 | "412 (r_cuisin, east, cheap) \n",
1726 | "413 (r_cuisin, east, cheap) \n",
1727 | "\n",
1728 | "[145 rows x 4 columns]"
1729 | ]
1730 | },
1731 | "execution_count": 207,
1732 | "metadata": {},
1733 | "output_type": "execute_result"
1734 | }
1735 | ],
1736 | "source": [
1737 | "test[test.text.map(lambda s: 'cheap' in s)]"
1738 | ]
1739 | },
1740 | {
1741 | "cell_type": "code",
1742 | "execution_count": 202,
1743 | "metadata": {
1744 | "collapsed": false
1745 | },
1746 | "outputs": [
1747 | {
1748 | "data": {
1749 | "text/plain": [
1750 | "['id',\n",
1751 | " 'like',\n",
1752 | " 'a',\n",
1753 | " 'cheap',\n",
1754 | " 'restaur',\n",
1755 | " 'in',\n",
1756 | " 'the',\n",
1757 | " 'south',\n",
1758 | " 'part',\n",
1759 | " 'of',\n",
1760 | " 'town']"
1761 | ]
1762 | },
1763 | "execution_count": 202,
1764 | "metadata": {},
1765 | "output_type": "execute_result"
1766 | }
1767 | ],
1768 | "source": [
1769 | "test[test.text.map(lambda s: 'south' in s)]['text'][284]"
1770 | ]
1771 | },
1772 | {
1773 | "cell_type": "code",
1774 | "execution_count": null,
1775 | "metadata": {
1776 | "collapsed": true
1777 | },
1778 | "outputs": [],
1779 | "source": []
1780 | }
1781 | ],
1782 | "metadata": {
1783 | "kernelspec": {
1784 | "display_name": "Python 3",
1785 | "language": "python",
1786 | "name": "python3"
1787 | },
1788 | "language_info": {
1789 | "codemirror_mode": {
1790 | "name": "ipython",
1791 | "version": 3
1792 | },
1793 | "file_extension": ".py",
1794 | "mimetype": "text/x-python",
1795 | "name": "python",
1796 | "nbconvert_exporter": "python",
1797 | "pygments_lexer": "ipython3",
1798 | "version": "3.6.0"
1799 | }
1800 | },
1801 | "nbformat": 4,
1802 | "nbformat_minor": 2
1803 | }
1804 |
--------------------------------------------------------------------------------
/notebooks/resources/restaurants_props.pkl:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/resources/restaurants_props.pkl
--------------------------------------------------------------------------------
/notebooks/resources/utts_refs.pkl:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/resources/utts_refs.pkl
--------------------------------------------------------------------------------
/notebooks/screenshots/dialog-system.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/dialog-system.png
--------------------------------------------------------------------------------
/notebooks/screenshots/global-and-local-list.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/global-and-local-list.png
--------------------------------------------------------------------------------
/notebooks/screenshots/local-list.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/local-list.png
--------------------------------------------------------------------------------
/notebooks/screenshots/mary-john-example.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/mary-john-example.png
--------------------------------------------------------------------------------
/notebooks/screenshots/prezzo.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/prezzo.png
--------------------------------------------------------------------------------
/notebooks/screenshots/qa2-multiple-list.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/qa2-multiple-list.png
--------------------------------------------------------------------------------
/notebooks/screenshots/simple-relation.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/simple-relation.png
--------------------------------------------------------------------------------
/notebooks/screenshots/state-graph-1.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/state-graph-1.png
--------------------------------------------------------------------------------
/notebooks/screenshots/state-graph-2.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/state-graph-2.png
--------------------------------------------------------------------------------
/notebooks/screenshots/v4-mary.png:
--------------------------------------------------------------------------------
https://raw.githubusercontent.com/Hyperparticle/graph-nlu/2aa7ef3ce67e4dadd5d1b89b9d7bf40d3d53d9fc/notebooks/screenshots/v4-mary.png
--------------------------------------------------------------------------------
/requirements.txt:
--------------------------------------------------------------------------------
1 | ipython
2 | jupyter
3 | neo4j-driver
4 | numpy
5 | nltk
6 | pandas
7 | scipy
8 | scikit-learn
--------------------------------------------------------------------------------
| \n", 1036 | " | text | \n", 1037 | "frame | \n", 1038 | "slots | \n", 1039 | "predicted | \n", 1040 | "
|---|---|---|---|---|
| 1 | \n", 1045 | "[cheap, restaur, in, the, north, part, of, town] | \n", 1046 | "(r_cuisin, north, cheap) | \n", 1047 | "[(r_price, cheap), (r_locat, north)] | \n", 1048 | "(r_cuisin, north, cheap) | \n", 1049 | "
| 2 | \n", 1052 | "[cheap, restaur, in, the, south, part, of, town] | \n", 1053 | "(r_cuisin, south, cheap) | \n", 1054 | "[(r_price, cheap), (r_locat, south)] | \n", 1055 | "(r_cuisin, south, cheap) | \n", 1056 | "
| 3 | \n", 1059 | "[cheap, restaur, serv, indian, food] | \n", 1060 | "(indian, r_locat, cheap) | \n", 1061 | "[(r_price, cheap), (r_cuisin, indian)] | \n", 1062 | "(indian, r_locat, cheap) | \n", 1063 | "
| 7 | \n", 1066 | "[im, look, for, a, cheap, restaur, in, the, no... | \n", 1067 | "(r_cuisin, north, cheap) | \n", 1068 | "[(r_price, cheap), (r_locat, north)] | \n", 1069 | "(r_cuisin, north, cheap) | \n", 1070 | "
| 10 | \n", 1073 | "[cheap, restaur] | \n", 1074 | "(r_cuisin, r_locat, cheap) | \n", 1075 | "[(r_price, cheap)] | \n", 1076 | "(r_cuisin, r_locat, cheap) | \n", 1077 | "
| 12 | \n", 1080 | "[i, want, a, cheap, restaur, in, the, west, pa... | \n", 1081 | "(r_cuisin, west, cheap) | \n", 1082 | "[(r_price, cheap), (r_locat, west)] | \n", 1083 | "(r_cuisin, west, cheap) | \n", 1084 | "
| 14 | \n", 1087 | "[i, am, look, for, a, cheap, restaur, in, the,... | \n", 1088 | "(r_cuisin, east, cheap) | \n", 1089 | "[(r_price, cheap), (r_locat, east)] | \n", 1090 | "(r_cuisin, east, cheap) | \n", 1091 | "
| 15 | \n", 1094 | "[im, look, for, a, cheap, restaur, serv, inter... | \n", 1095 | "(intern, r_locat, cheap) | \n", 1096 | "[(r_price, cheap), (r_cuisin, intern)] | \n", 1097 | "(intern, r_locat, cheap) | \n", 1098 | "
| 17 | \n", 1101 | "[look, for, a, cheap, restaur, in, the, south,... | \n", 1102 | "(r_cuisin, south, cheap) | \n", 1103 | "[(r_price, cheap), (r_locat, south)] | \n", 1104 | "(r_cuisin, south, cheap) | \n", 1105 | "
| 20 | \n", 1108 | "[look, for, someth, cheap, in, the, north, sid... | \n", 1109 | "(r_cuisin, north, cheap) | \n", 1110 | "[(r_price, cheap), (r_locat, north)] | \n", 1111 | "(r_cuisin, north, cheap) | \n", 1112 | "
| 33 | \n", 1115 | "[im, look, for, a, cheap, restaur, in, the, so... | \n", 1116 | "(r_cuisin, r_locat, cheap) | \n", 1117 | "[(r_price, cheap), (r_locat, south)] | \n", 1118 | "(r_cuisin, south, cheap) | \n", 1119 | "
| 40 | \n", 1122 | "[i, want, a, cheap, restaur, in, the, south, p... | \n", 1123 | "(r_cuisin, r_locat, cheap) | \n", 1124 | "[(r_price, cheap), (r_locat, south)] | \n", 1125 | "(r_cuisin, south, cheap) | \n", 1126 | "
| 44 | \n", 1129 | "[i, need, a, cheap, restaur, in, the, south, p... | \n", 1130 | "(r_cuisin, south, cheap) | \n", 1131 | "[(r_price, cheap), (r_locat, south)] | \n", 1132 | "(r_cuisin, south, cheap) | \n", 1133 | "
| 46 | \n", 1136 | "[i, want, a, cheap, restaur, in, the, east, pa... | \n", 1137 | "(r_cuisin, east, cheap) | \n", 1138 | "[(r_price, cheap), (r_locat, east)] | \n", 1139 | "(r_cuisin, east, cheap) | \n", 1140 | "
| 57 | \n", 1143 | "[breath, id, like, a, cheap, restaur, in, the,... | \n", 1144 | "(r_cuisin, south, cheap) | \n", 1145 | "[(r_price, cheap), (r_locat, south)] | \n", 1146 | "(r_cuisin, south, cheap) | \n", 1147 | "
| 61 | \n", 1150 | "[im, look, for, a, cheap, restaur, in, the, we... | \n", 1151 | "(r_cuisin, west, cheap) | \n", 1152 | "[(r_price, cheap), (r_locat, west)] | \n", 1153 | "(r_cuisin, west, cheap) | \n", 1154 | "
| 62 | \n", 1157 | "[i, would, like, to, find, a, cheap, restaur, ... | \n", 1158 | "(r_cuisin, south, cheap) | \n", 1159 | "[(r_price, cheap), (r_locat, south)] | \n", 1160 | "(r_cuisin, south, cheap) | \n", 1161 | "
| 68 | \n", 1164 | "[cheap, restaur, in, the, north, part, of, town] | \n", 1165 | "(r_cuisin, north, cheap) | \n", 1166 | "[(r_price, cheap), (r_locat, north)] | \n", 1167 | "(r_cuisin, north, cheap) | \n", 1168 | "
| 71 | \n", 1171 | "[i, would, like, a, cheap, restaur, in, the, n... | \n", 1172 | "(r_cuisin, north, cheap) | \n", 1173 | "[(r_price, cheap), (r_locat, north)] | \n", 1174 | "(r_cuisin, north, cheap) | \n", 1175 | "
| 72 | \n", 1178 | "[i, would, like, a, cheap, restaur, in, the, w... | \n", 1179 | "(r_cuisin, west, cheap) | \n", 1180 | "[(r_price, cheap), (r_locat, west)] | \n", 1181 | "(r_cuisin, west, cheap) | \n", 1182 | "
| 76 | \n", 1185 | "[im, look, for, a, cheap, restaur, in, the, we... | \n", 1186 | "(r_cuisin, west, cheap) | \n", 1187 | "[(r_price, cheap), (r_locat, west)] | \n", 1188 | "(r_cuisin, west, cheap) | \n", 1189 | "
| 82 | \n", 1192 | "[im, look, for, a, cheap, restaur, in, the, so... | \n", 1193 | "(r_cuisin, south, cheap) | \n", 1194 | "[(r_price, cheap), (r_locat, south)] | \n", 1195 | "(r_cuisin, south, cheap) | \n", 1196 | "
| 83 | \n", 1199 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1200 | "(r_cuisin, east, cheap) | \n", 1201 | "[(r_price, cheap), (r_locat, east)] | \n", 1202 | "(r_cuisin, east, cheap) | \n", 1203 | "
| 84 | \n", 1206 | "[cheap, restaur, serv, spanish, food] | \n", 1207 | "(spanish, r_locat, cheap) | \n", 1208 | "[(r_price, cheap), (r_cuisin, spanish)] | \n", 1209 | "(spanish, r_locat, cheap) | \n", 1210 | "
| 86 | \n", 1213 | "[im, look, for, a, cheap, restaur, in, the, no... | \n", 1214 | "(r_cuisin, north, cheap) | \n", 1215 | "[(r_price, cheap), (r_locat, north)] | \n", 1216 | "(r_cuisin, north, cheap) | \n", 1217 | "
| 89 | \n", 1220 | "[im, look, for, a, cheap, restaur, in, the, we... | \n", 1221 | "(r_cuisin, west, cheap) | \n", 1222 | "[(r_price, cheap), (r_locat, west)] | \n", 1223 | "(r_cuisin, west, cheap) | \n", 1224 | "
| 92 | \n", 1227 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1228 | "(r_cuisin, east, cheap) | \n", 1229 | "[(r_price, cheap), (r_locat, east)] | \n", 1230 | "(r_cuisin, east, cheap) | \n", 1231 | "
| 96 | \n", 1234 | "[i, need, a, cheap, restaur, in, the, west, pa... | \n", 1235 | "(r_cuisin, west, cheap) | \n", 1236 | "[(r_price, cheap), (r_locat, west)] | \n", 1237 | "(r_cuisin, west, cheap) | \n", 1238 | "
| 98 | \n", 1241 | "[im, look, for, a, cheap, restaur, in, the, no... | \n", 1242 | "(r_cuisin, north, cheap) | \n", 1243 | "[(r_price, cheap), (r_locat, north)] | \n", 1244 | "(r_cuisin, north, cheap) | \n", 1245 | "
| 99 | \n", 1248 | "[im, look, for, a, cheap, restaur, in, the, no... | \n", 1249 | "(r_cuisin, north, cheap) | \n", 1250 | "[(r_price, cheap), (r_locat, north)] | \n", 1251 | "(r_cuisin, north, cheap) | \n", 1252 | "
| ... | \n", 1255 | "... | \n", 1256 | "... | \n", 1257 | "... | \n", 1258 | "... | \n", 1259 | "
| 337 | \n", 1262 | "[look, for, a, cheap, restaur, in, the, east, ... | \n", 1263 | "(r_cuisin, east, cheap) | \n", 1264 | "[(r_price, cheap), (r_locat, east)] | \n", 1265 | "(r_cuisin, east, cheap) | \n", 1266 | "
| 340 | \n", 1269 | "[cheap, restaur, west, part, of, town] | \n", 1270 | "(r_cuisin, west, cheap) | \n", 1271 | "[(r_price, cheap), (r_locat, west)] | \n", 1272 | "(r_cuisin, west, cheap) | \n", 1273 | "
| 343 | \n", 1276 | "[im, look, for, a, cheap, restaur, and, it, sh... | \n", 1277 | "(r_cuisin, north, cheap) | \n", 1278 | "[(r_price, cheap), (r_locat, north)] | \n", 1279 | "(r_cuisin, north, cheap) | \n", 1280 | "
| 346 | \n", 1283 | "[im, look, for, a, cheap, restaur, in, the, we... | \n", 1284 | "(r_cuisin, west, cheap) | \n", 1285 | "[(r_price, cheap), (r_locat, west)] | \n", 1286 | "(r_cuisin, west, cheap) | \n", 1287 | "
| 350 | \n", 1290 | "[cheap, restaur, south, part, of, town] | \n", 1291 | "(r_cuisin, south, cheap) | \n", 1292 | "[(r_price, cheap), (r_locat, south)] | \n", 1293 | "(r_cuisin, south, cheap) | \n", 1294 | "
| 351 | \n", 1297 | "[iam, look, for, a, cheap, restaur, and, it, s... | \n", 1298 | "(r_cuisin, north, cheap) | \n", 1299 | "[(r_price, cheap), (r_locat, north)] | \n", 1300 | "(r_cuisin, north, cheap) | \n", 1301 | "
| 352 | \n", 1304 | "[uh, i, want, a, cheap, restaur, and, it, shou... | \n", 1305 | "(r_cuisin, north, cheap) | \n", 1306 | "[(r_price, cheap), (r_locat, north)] | \n", 1307 | "(r_cuisin, north, cheap) | \n", 1308 | "
| 353 | \n", 1311 | "[im, look, for, a, cheap, restaur, in, the, so... | \n", 1312 | "(r_cuisin, south, cheap) | \n", 1313 | "[(r_price, cheap), (r_locat, south)] | \n", 1314 | "(r_cuisin, south, cheap) | \n", 1315 | "
| 354 | \n", 1318 | "[i, would, like, a, cheap, restaur, in, the, s... | \n", 1319 | "(r_cuisin, r_locat, cheap) | \n", 1320 | "[(r_price, cheap), (r_locat, south)] | \n", 1321 | "(r_cuisin, south, cheap) | \n", 1322 | "
| 356 | \n", 1325 | "[can, i, have, a, cheap, restaur, in, the, wes... | \n", 1326 | "(r_cuisin, west, cheap) | \n", 1327 | "[(r_price, cheap), (r_locat, west)] | \n", 1328 | "(r_cuisin, west, cheap) | \n", 1329 | "
| 358 | \n", 1332 | "[i, am, look, for, a, cheap, restaur, in, the,... | \n", 1333 | "(r_cuisin, west, cheap) | \n", 1334 | "[(r_price, cheap), (r_locat, west)] | \n", 1335 | "(r_cuisin, west, cheap) | \n", 1336 | "
| 360 | \n", 1339 | "[a, want, a, cheap, restaur, in, the, north, p... | \n", 1340 | "(r_cuisin, north, cheap) | \n", 1341 | "[(r_price, cheap), (r_locat, north)] | \n", 1342 | "(r_cuisin, north, cheap) | \n", 1343 | "
| 365 | \n", 1346 | "[cheap, restaur, in, th, east, part, of, town] | \n", 1347 | "(r_cuisin, east, cheap) | \n", 1348 | "[(r_price, cheap), (r_locat, east)] | \n", 1349 | "(r_cuisin, east, cheap) | \n", 1350 | "
| 366 | \n", 1353 | "[im, look, for, a, cheap, restaur, and, it, sh... | \n", 1354 | "(r_cuisin, east, cheap) | \n", 1355 | "[(r_price, cheap), (r_locat, east)] | \n", 1356 | "(r_cuisin, east, cheap) | \n", 1357 | "
| 369 | \n", 1360 | "[cheap, restaur, in, th, east, part, of, town] | \n", 1361 | "(r_cuisin, east, cheap) | \n", 1362 | "[(r_price, cheap), (r_locat, east)] | \n", 1363 | "(r_cuisin, east, cheap) | \n", 1364 | "
| 371 | \n", 1367 | "[cheap, restaur, in, the, east, part, of, town] | \n", 1368 | "(r_cuisin, east, cheap) | \n", 1369 | "[(r_price, cheap), (r_locat, east)] | \n", 1370 | "(r_cuisin, east, cheap) | \n", 1371 | "
| 372 | \n", 1374 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1375 | "(r_cuisin, east, cheap) | \n", 1376 | "[(r_price, cheap), (r_locat, east)] | \n", 1377 | "(r_cuisin, east, cheap) | \n", 1378 | "
| 374 | \n", 1381 | "[look, for, someth, cheap, on, the, east, part... | \n", 1382 | "(r_cuisin, east, cheap) | \n", 1383 | "[(r_price, cheap), (r_locat, east)] | \n", 1384 | "(r_cuisin, east, cheap) | \n", 1385 | "
| 377 | \n", 1388 | "[im, look, for, a, cheap, restaur, serv, medit... | \n", 1389 | "(mediterranean, r_locat, cheap) | \n", 1390 | "[(r_price, cheap), (r_cuisin, mediterranean)] | \n", 1391 | "(mediterranean, r_locat, cheap) | \n", 1392 | "
| 378 | \n", 1395 | "[im, look, for, a, cheap, restaur, in, the, so... | \n", 1396 | "(r_cuisin, south, cheap) | \n", 1397 | "[(r_price, cheap), (r_locat, south)] | \n", 1398 | "(r_cuisin, south, cheap) | \n", 1399 | "
| 384 | \n", 1402 | "[im, look, for, a, cheap, restaur, that, serv,... | \n", 1403 | "(vietnames, r_locat, cheap) | \n", 1404 | "[(r_price, cheap), (r_cuisin, vietnames)] | \n", 1405 | "(vietnames, r_locat, cheap) | \n", 1406 | "
| 389 | \n", 1409 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1410 | "(r_cuisin, east, cheap) | \n", 1411 | "[(r_price, cheap), (r_locat, east)] | \n", 1412 | "(r_cuisin, east, cheap) | \n", 1413 | "
| 393 | \n", 1416 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1417 | "(r_cuisin, east, cheap) | \n", 1418 | "[(r_price, cheap), (r_locat, east)] | \n", 1419 | "(r_cuisin, east, cheap) | \n", 1420 | "
| 396 | \n", 1423 | "[cheap, restaur, east, part, of, town] | \n", 1424 | "(r_cuisin, east, cheap) | \n", 1425 | "[(r_price, cheap), (r_locat, east)] | \n", 1426 | "(r_cuisin, east, cheap) | \n", 1427 | "
| 398 | \n", 1430 | "[look, for, a, cheap, restaur, in, the, east, ... | \n", 1431 | "(r_cuisin, east, cheap) | \n", 1432 | "[(r_price, cheap), (r_locat, east)] | \n", 1433 | "(r_cuisin, east, cheap) | \n", 1434 | "
| 400 | \n", 1437 | "[cheap, restaur, on, the, east, part, of, town] | \n", 1438 | "(r_cuisin, east, cheap) | \n", 1439 | "[(r_price, cheap), (r_locat, east)] | \n", 1440 | "(r_cuisin, east, cheap) | \n", 1441 | "
| 406 | \n", 1444 | "[cheap, restaur, in, the, east, part, of, town] | \n", 1445 | "(r_cuisin, east, cheap) | \n", 1446 | "[(r_price, cheap), (r_locat, east)] | \n", 1447 | "(r_cuisin, east, cheap) | \n", 1448 | "
| 410 | \n", 1451 | "[i, need, a, cheap, restaur, in, the, east, pa... | \n", 1452 | "(r_cuisin, east, cheap) | \n", 1453 | "[(r_price, cheap), (r_locat, east)] | \n", 1454 | "(r_cuisin, east, cheap) | \n", 1455 | "
| 412 | \n", 1458 | "[cheap, restaur, east, part, of, town] | \n", 1459 | "(r_cuisin, east, cheap) | \n", 1460 | "[(r_price, cheap), (r_locat, east)] | \n", 1461 | "(r_cuisin, east, cheap) | \n", 1462 | "
| 413 | \n", 1465 | "[im, look, for, a, cheap, restaur, in, the, ea... | \n", 1466 | "(r_cuisin, east, cheap) | \n", 1467 | "[(r_price, cheap), (r_locat, east)] | \n", 1468 | "(r_cuisin, east, cheap) | \n", 1469 | "
145 rows × 4 columns
\n", 1473 | "