├── .github └── PULL_REQUEST_TEMPLATE.md ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── _config.yml ├── cqr_kvret_dev_public.json ├── cqr_kvret_test_public.json ├── cqr_kvret_train_public.json └── dialog2-crop.png /.github/PULL_REQUEST_TEMPLATE.md: -------------------------------------------------------------------------------- 1 | *Issue #, if available:* 2 | 3 | *Description of changes:* 4 | 5 | 6 | By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice. 7 | -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- 1 | ## Code of Conduct 2 | This project has adopted the [Amazon Open Source Code of Conduct](https://aws.github.io/code-of-conduct). 3 | For more information see the [Code of Conduct FAQ](https://aws.github.io/code-of-conduct-faq) or contact 4 | opensource-codeofconduct@amazon.com with any additional questions or comments. 5 | -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | # Contributing Guidelines 2 | 3 | Thank you for your interest in contributing to our project. Whether it's a bug report, new feature, correction, or additional 4 | documentation, we greatly value feedback and contributions from our community. 5 | 6 | Please read through this document before submitting any issues or pull requests to ensure we have all the necessary 7 | information to effectively respond to your bug report or contribution. 8 | 9 | 10 | ## Reporting Bugs/Feature Requests 11 | 12 | We welcome you to use the GitHub issue tracker to report bugs or suggest features. 13 | 14 | When filing an issue, please check [existing open](https://github.com/alexa/alexa-dataset-contextual-query-rewrite/issues), or [recently closed](https://github.com/alexa/alexa-dataset-contextual-query-rewrite/issues?utf8=%E2%9C%93&q=is%3Aissue%20is%3Aclosed%20), issues to make sure somebody else hasn't already 15 | reported the issue. Please try to include as much information as you can. Details like these are incredibly useful: 16 | 17 | * A reproducible test case or series of steps 18 | * The version of our code being used 19 | * Any modifications you've made relevant to the bug 20 | * Anything unusual about your environment or deployment 21 | 22 | 23 | ## Contributing via Pull Requests 24 | Contributions via pull requests are much appreciated. Before sending us a pull request, please ensure that: 25 | 26 | 1. You are working against the latest source on the *master* branch. 27 | 2. You check existing open, and recently merged, pull requests to make sure someone else hasn't addressed the problem already. 28 | 3. You open an issue to discuss any significant work - we would hate for your time to be wasted. 29 | 30 | To send us a pull request, please: 31 | 32 | 1. Fork the repository. 33 | 2. Modify the source; please focus on the specific change you are contributing. If you also reformat all the code, it will be hard for us to focus on your change. 34 | 3. Ensure local tests pass. 35 | 4. Commit to your fork using clear commit messages. 36 | 5. Send us a pull request, answering any default questions in the pull request interface. 37 | 6. Pay attention to any automated CI failures reported in the pull request, and stay involved in the conversation. 38 | 39 | GitHub provides additional document on [forking a repository](https://help.github.com/articles/fork-a-repo/) and 40 | [creating a pull request](https://help.github.com/articles/creating-a-pull-request/). 41 | 42 | 43 | ## Finding contributions to work on 44 | Looking at the existing issues is a great way to find something to contribute on. As our projects, by default, use the default GitHub issue labels (enhancement/bug/duplicate/help wanted/invalid/question/wontfix), looking at any ['help wanted'](https://github.com/alexa/alexa-dataset-contextual-query-rewrite/labels/help%20wanted) issues is a great place to start. 45 | 46 | 47 | ## Code of Conduct 48 | This project has adopted the [Amazon Open Source Code of Conduct](https://aws.github.io/code-of-conduct). 49 | For more information see the [Code of Conduct FAQ](https://aws.github.io/code-of-conduct-faq) or contact 50 | opensource-codeofconduct@amazon.com with any additional questions or comments. 51 | 52 | 53 | ## Security issue notifications 54 | If you discover a potential security issue in this project we ask that you notify AWS/Amazon Security via our [vulnerability reporting page](http://aws.amazon.com/security/vulnerability-reporting/). Please do **not** create a public github issue. 55 | 56 | 57 | ## Licensing 58 | 59 | See the [LICENSE](https://github.com/alexa/alexa-dataset-contextual-query-rewrite/blob/master/LICENSE) file for our project's licensing. We will ask you to confirm the licensing of your contribution. 60 | 61 | We may ask you to sign a [Contributor License Agreement (CLA)](http://en.wikipedia.org/wiki/Contributor_License_Agreement) for larger changes. 62 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | MIT-0 License 2 | 3 | Copyright 2019 Amazon.com, Inc. or its affiliates. All Rights Reserved. 4 | 5 | Permission is hereby granted, free of charge, to any person obtaining a copy of this 6 | software and associated documentation files (the "Software"), to deal in the Software 7 | without restriction, including without limitation the rights to use, copy, modify, 8 | merge, publish, distribute, sublicense, and/or sell copies of the Software, and to 9 | permit persons to whom the Software is furnished to do so. 10 | 11 | THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, 12 | INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A 13 | PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT 14 | HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION 15 | OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE 16 | SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. 17 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Contextual Query Rewrite (CQR) Dataset for Spoken Dialogue 2 | 3 | ![Contextual Query Rewrite](https://github.com/alexa/alexa-dataset-contextual-query-rewrite/blob/master/dialog2-crop.png) 4 | 5 | ## Motivation 6 | Dialogue assistants are used by millions of people today to fulfill a variety of tasks. Such assistants also serve as a digital marketplace where any developer can build a domain-specific, task-oriented, dialogue agent offering a service such as booking cabs, ordering food, listening to music, shopping etc. Also, these agents may interact with each other, when completing a task on behalf of the user. Accomplishing this task requires understanding the context of a dialogue, communicating the conversational state to multiple agents, and updating the state as the conversation proceeds. However, this is challenging given that different agents use their own domain specific schemas and meaning representations. In this dataset, we explore using natural language as an API for communicating across agents, thereby eliminating the need to learn or adapt to diverse schema mappings. Instead, we show how one can leverage the syntactic/semantic regularities imposed by the language itself as a way to track the dialogue state. 7 | 8 | This work is detailed in the following [paper](https://arxiv.org/pdf/1903.05164.pdf) 9 | ```shell 10 | @inproceedings{rastogi2019scaling, 11 | title={Scaling Multi-Domain Dialogue State Tracking via Query Reformulation}, 12 | author={Rastogi, Pushpendre and Gupta, Arpit and Chen, Tongfei and Mathias, Lambert}, 13 | booktitle={Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics}, 14 | year={2019}, 15 | publisher={Association for Computational Linguistics}, 16 | } 17 | ``` 18 | 19 | 20 | To create this dataset, we used a dataset that Stanford makes publicly available for download at the following link: [Stanford Dialogue Corpus](https://nlp.stanford.edu/blog/a-new-multi-turn-multi-domain-task-oriented-dialogue-dataset/). Our dataset contains MTurk, crowd-sourced rewrites of dialogues in the Stanford dataset to facilitate research in dialogue state tracking using natural language as the interface. For details of the contextual query rewrite dataset creation please refer to this [paper](https://arxiv.org/pdf/1903.11783.pdf). 21 | 22 | 23 | 24 | 25 | ## Format 26 | The dataset is in JSON format, where each line is a JSON record. The JSON key 'reformulation' contains the additions made in this dataset. The ```refomulation``` are created at the end of each dialogue defined as ```"end_dialogue": true``` The structure under ```reformulation``` contains the following keys: 27 | 1. ```base_utt_idx``` - this is the index of the utterances in the original dialogue that is selected for rewrite. 28 | 2. ```flag``` - indicating the categories of referring expressions. 29 | 3. ```gold_slots``` - the gold standard slots to be used in the rewrite. 30 | 4. ```mturk_reformulations``` - a list of crowd-sourced rewrites from MTurk. 31 | 5. ```reformulated_utt``` - gold rewrites. 32 | 33 | ## License Summary 34 | 35 | This sample code is made available under a modified MIT license. See the LICENSE file. 36 | -------------------------------------------------------------------------------- /_config.yml: -------------------------------------------------------------------------------- 1 | theme: jekyll-theme-cayman -------------------------------------------------------------------------------- /dialog2-crop.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/alexa/alexa-dataset-contextual-query-rewrite/824b77aa499e0898ce60849f4c739a7265302358/dialog2-crop.png --------------------------------------------------------------------------------