├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── data ├── tools.csv └── train.csv └── docs └── ToolVerifier.png /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- 1 | # Code of Conduct 2 | 3 | ## Our Pledge 4 | 5 | In the interest of fostering an open and welcoming environment, we as 6 | contributors and maintainers pledge to make participation in our project and 7 | our community a harassment-free experience for everyone, regardless of age, body 8 | size, disability, ethnicity, sex characteristics, gender identity and expression, 9 | level of experience, education, socio-economic status, nationality, personal 10 | appearance, race, religion, or sexual identity and orientation. 11 | 12 | ## Our Standards 13 | 14 | Examples of behavior that contributes to creating a positive environment 15 | include: 16 | 17 | * Using welcoming and inclusive language 18 | * Being respectful of differing viewpoints and experiences 19 | * Gracefully accepting constructive criticism 20 | * Focusing on what is best for the community 21 | * Showing empathy towards other community members 22 | 23 | Examples of unacceptable behavior by participants include: 24 | 25 | * The use of sexualized language or imagery and unwelcome sexual attention or 26 | advances 27 | * Trolling, insulting/derogatory comments, and personal or political attacks 28 | * Public or private harassment 29 | * Publishing others' private information, such as a physical or electronic 30 | address, without explicit permission 31 | * Other conduct which could reasonably be considered inappropriate in a 32 | professional setting 33 | 34 | ## Our Responsibilities 35 | 36 | Project maintainers are responsible for clarifying the standards of acceptable 37 | behavior and are expected to take appropriate and fair corrective action in 38 | response to any instances of unacceptable behavior. 39 | 40 | Project maintainers have the right and responsibility to remove, edit, or 41 | reject comments, commits, code, wiki edits, issues, and other contributions 42 | that are not aligned to this Code of Conduct, or to ban temporarily or 43 | permanently any contributor for other behaviors that they deem inappropriate, 44 | threatening, offensive, or harmful. 45 | 46 | ## Scope 47 | 48 | This Code of Conduct applies within all project spaces, and it also applies when 49 | an individual is representing the project or its community in public spaces. 50 | Examples of representing a project or community include using an official 51 | project e-mail address, posting via an official social media account, or acting 52 | as an appointed representative at an online or offline event. Representation of 53 | a project may be further defined and clarified by project maintainers. 54 | 55 | This Code of Conduct also applies outside the project spaces when there is a 56 | reasonable belief that an individual's behavior may have a negative impact on 57 | the project or its community. 58 | 59 | ## Enforcement 60 | 61 | Instances of abusive, harassing, or otherwise unacceptable behavior may be 62 | reported by contacting the project team at . All 63 | complaints will be reviewed and investigated and will result in a response that 64 | is deemed necessary and appropriate to the circumstances. The project team is 65 | obligated to maintain confidentiality with regard to the reporter of an incident. 66 | Further details of specific enforcement policies may be posted separately. 67 | 68 | Project maintainers who do not follow or enforce the Code of Conduct in good 69 | faith may face temporary or permanent repercussions as determined by other 70 | members of the project's leadership. 71 | 72 | ## Attribution 73 | 74 | This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4, 75 | available at https://www.contributor-covenant.org/version/1/4/code-of-conduct.html 76 | 77 | [homepage]: https://www.contributor-covenant.org 78 | 79 | For answers to common questions about this code of conduct, see 80 | https://www.contributor-covenant.org/faq -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- 1 | # Contributing to EditEval 2 | We want to make contributing to this project as easy and transparent as 3 | possible. 4 | 5 | ## Pull Requests 6 | We actively welcome your pull requests. 7 | 8 | 1. Fork the repo and create your branch from `main`. 9 | 2. If you've added code that should be tested, add tests. 10 | 3. If you've changed APIs, update the documentation. 11 | 4. Ensure the test suite passes. 12 | 5. Make sure your code lints. 13 | 6. If you haven't already, complete the Contributor License Agreement ("CLA"). 14 | 15 | ## Contributor License Agreement ("CLA") 16 | In order to accept your pull request, we need you to submit a CLA. You only need 17 | to do this once to work on any of Facebook's open source projects. 18 | 19 | Complete your CLA here: 20 | 21 | ## Issues 22 | We use GitHub issues to track public bugs. Please ensure your description is 23 | clear and has sufficient instructions to be able to reproduce the issue. 24 | 25 | Facebook has a [bounty program](https://www.facebook.com/whitehat/) for the safe 26 | disclosure of security bugs. In those cases, please go through the process 27 | outlined on that page and do not file a public issue. 28 | 29 | ## License 30 | By contributing to EditEval, you agree that your contributions will be licensed 31 | under the LICENSE file in the root directory of this source tree. 32 | -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- 1 | Creative Commons Legal Code 2 | 3 | CC0 1.0 Universal 4 | 5 | CREATIVE COMMONS CORPORATION IS NOT A LAW FIRM AND DOES NOT PROVIDE 6 | LEGAL SERVICES. DISTRIBUTION OF THIS DOCUMENT DOES NOT CREATE AN 7 | ATTORNEY-CLIENT RELATIONSHIP. CREATIVE COMMONS PROVIDES THIS 8 | INFORMATION ON AN "AS-IS" BASIS. CREATIVE COMMONS MAKES NO WARRANTIES 9 | REGARDING THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS 10 | PROVIDED HEREUNDER, AND DISCLAIMS LIABILITY FOR DAMAGES RESULTING FROM 11 | THE USE OF THIS DOCUMENT OR THE INFORMATION OR WORKS PROVIDED 12 | HEREUNDER. 13 | 14 | Statement of Purpose 15 | 16 | The laws of most jurisdictions throughout the world automatically confer 17 | exclusive Copyright and Related Rights (defined below) upon the creator 18 | and subsequent owner(s) (each and all, an "owner") of an original work of 19 | authorship and/or a database (each, a "Work"). 20 | 21 | Certain owners wish to permanently relinquish those rights to a Work for 22 | the purpose of contributing to a commons of creative, cultural and 23 | scientific works ("Commons") that the public can reliably and without fear 24 | of later claims of infringement build upon, modify, incorporate in other 25 | works, reuse and redistribute as freely as possible in any form whatsoever 26 | and for any purposes, including without limitation commercial purposes. 27 | These owners may contribute to the Commons to promote the ideal of a free 28 | culture and the further production of creative, cultural and scientific 29 | works, or to gain reputation or greater distribution for their Work in 30 | part through the use and efforts of others. 31 | 32 | For these and/or other purposes and motivations, and without any 33 | expectation of additional consideration or compensation, the person 34 | associating CC0 with a Work (the "Affirmer"), to the extent that he or she 35 | is an owner of Copyright and Related Rights in the Work, voluntarily 36 | elects to apply CC0 to the Work and publicly distribute the Work under its 37 | terms, with knowledge of his or her Copyright and Related Rights in the 38 | Work and the meaning and intended legal effect of CC0 on those rights. 39 | 40 | 1. Copyright and Related Rights. A Work made available under CC0 may be 41 | protected by copyright and related or neighboring rights ("Copyright and 42 | Related Rights"). Copyright and Related Rights include, but are not 43 | limited to, the following: 44 | 45 | i. the right to reproduce, adapt, distribute, perform, display, 46 | communicate, and translate a Work; 47 | ii. moral rights retained by the original author(s) and/or performer(s); 48 | iii. publicity and privacy rights pertaining to a person's image or 49 | likeness depicted in a Work; 50 | iv. rights protecting against unfair competition in regards to a Work, 51 | subject to the limitations in paragraph 4(a), below; 52 | v. rights protecting the extraction, dissemination, use and reuse of data 53 | in a Work; 54 | vi. database rights (such as those arising under Directive 96/9/EC of the 55 | European Parliament and of the Council of 11 March 1996 on the legal 56 | protection of databases, and under any national implementation 57 | thereof, including any amended or successor version of such 58 | directive); and 59 | vii. other similar, equivalent or corresponding rights throughout the 60 | world based on applicable law or treaty, and any national 61 | implementations thereof. 62 | 63 | 2. Waiver. To the greatest extent permitted by, but not in contravention 64 | of, applicable law, Affirmer hereby overtly, fully, permanently, 65 | irrevocably and unconditionally waives, abandons, and surrenders all of 66 | Affirmer's Copyright and Related Rights and associated claims and causes 67 | of action, whether now known or unknown (including existing as well as 68 | future claims and causes of action), in the Work (i) in all territories 69 | worldwide, (ii) for the maximum duration provided by applicable law or 70 | treaty (including future time extensions), (iii) in any current or future 71 | medium and for any number of copies, and (iv) for any purpose whatsoever, 72 | including without limitation commercial, advertising or promotional 73 | purposes (the "Waiver"). Affirmer makes the Waiver for the benefit of each 74 | member of the public at large and to the detriment of Affirmer's heirs and 75 | successors, fully intending that such Waiver shall not be subject to 76 | revocation, rescission, cancellation, termination, or any other legal or 77 | equitable action to disrupt the quiet enjoyment of the Work by the public 78 | as contemplated by Affirmer's express Statement of Purpose. 79 | 80 | 3. Public License Fallback. Should any part of the Waiver for any reason 81 | be judged legally invalid or ineffective under applicable law, then the 82 | Waiver shall be preserved to the maximum extent permitted taking into 83 | account Affirmer's express Statement of Purpose. In addition, to the 84 | extent the Waiver is so judged Affirmer hereby grants to each affected 85 | person a royalty-free, non transferable, non sublicensable, non exclusive, 86 | irrevocable and unconditional license to exercise Affirmer's Copyright and 87 | Related Rights in the Work (i) in all territories worldwide, (ii) for the 88 | maximum duration provided by applicable law or treaty (including future 89 | time extensions), (iii) in any current or future medium and for any number 90 | of copies, and (iv) for any purpose whatsoever, including without 91 | limitation commercial, advertising or promotional purposes (the 92 | "License"). The License shall be deemed effective as of the date CC0 was 93 | applied by Affirmer to the Work. Should any part of the License for any 94 | reason be judged legally invalid or ineffective under applicable law, such 95 | partial invalidity or ineffectiveness shall not invalidate the remainder 96 | of the License, and in such case Affirmer hereby affirms that he or she 97 | will not (i) exercise any of his or her remaining Copyright and Related 98 | Rights in the Work or (ii) assert any associated claims and causes of 99 | action with respect to the Work, in either case contrary to Affirmer's 100 | express Statement of Purpose. 101 | 102 | 4. Limitations and Disclaimers. 103 | 104 | a. No trademark or patent rights held by Affirmer are waived, abandoned, 105 | surrendered, licensed or otherwise affected by this document. 106 | b. Affirmer offers the Work as-is and makes no representations or 107 | warranties of any kind concerning the Work, express, implied, 108 | statutory or otherwise, including without limitation warranties of 109 | title, merchantability, fitness for a particular purpose, non 110 | infringement, or the absence of latent or other defects, accuracy, or 111 | the present or absence of errors, whether or not discoverable, all to 112 | the greatest extent permissible under applicable law. 113 | c. Affirmer disclaims responsibility for clearing rights of other persons 114 | that may apply to the Work or any use thereof, including without 115 | limitation any person's Copyright and Related Rights in the Work. 116 | Further, Affirmer disclaims responsibility for obtaining any necessary 117 | consents, permissions or other rights required for any use of the 118 | Work. 119 | d. Affirmer understands and acknowledges that Creative Commons is not a 120 | party to this document and has no duty or obligation with respect to 121 | this CC0 or use of the Work. -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # TOOLVERIFIER: Generalization to New Tools via Self-Verification 2 | 3 | This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection. 4 | 5 | ## Framework 6 | ![CONWEA-Framework](docs/ToolVerifier.png) 7 | 8 | ## Data 9 | 10 | **ToolSelect** data is synthetic training data generated for tool selection task using Llama-2 70B and Llama-2-Chat-70B. 11 | It consists of 555 samples corresponding to 173 tools. 12 | Each training sample is composed of a user instruction, a candidate set of tools that includes the 13 | ground truth tool, and a reasoning note elucidating the correct choice of tool. 14 | For example, 15 | ``` 16 | User: 10 reviews for "Harry Potter and the Philosopher's Stone". 17 | ### 18 | Tool Choices: Bank Account Number generator = The Bank Account Number tool generates a random bank account number for a bank. 19 | Train Ticket Purchase = The Train Ticket Purchase tool gets train tickets for a train, provided stations, and date information. 20 | The Cricket Score tool = The Cricket Score tool gets the score for a match that is happening at a given location and date. 21 | Book Review = The Book Review tool gets the top-rated book reviews for a particular book. 22 | Grocery Shopping with discounts = The Grocery Shopping tool calculates the expense of grocery shopping based on the menu. 23 | Stock Price at location and date = The Stock Price tool gets the stock price for a company at a given location and date. 24 | Movie Recommendation = The Movie Recommendation tool recommends movies based on the user's preferences. 25 | News = The News tool gets the top news for a particular topic or query. 26 | ### 27 | Thought: I recommended the Book Review tool because the user asked for reviews of a specific book, "Harry Potter and the Philosopher's Stone". The Book Review tool is designed to provide top-rated book reviews for a particular book, making it the most suitable tool for this request. It will retrieve the top 10 reviews for the book, as requested by the user. 28 | Act: CALLTOOL["Book Review"] 29 | ``` 30 | 31 | ### Files 32 | The `data/` folder has 2 files: 33 | * `train.csv` - this file contains the training samples. 34 | * `tools.csv` - this file contains names and descriptions of the generated synthetic tools. 35 | 36 | To learn more about the data generation procedure, we direct readers to section 2.1 of our paper. 37 | 38 | Paper: https://arxiv.org/abs/2402.14158 39 | 40 | ## Citation 41 | ``` 42 | @article{mekala2024toolverifier, 43 | title={TOOLVERIFIER: Generalization to New Tools via Self-Verification}, 44 | author={Mekala, Dheeraj and Weston, Jason and Lanchantin, Jack and Raileanu, Roberta and Lomeli, Maria and Shang, Jingbo and Dwivedi-Yu, Jane}, 45 | journal={arXiv preprint arXiv:2402.14158}, 46 | year={2024} 47 | } 48 | ``` 49 | ## Licensing 50 | See our LICENSE file for licensing details. 51 | -------------------------------------------------------------------------------- /data/tools.csv: -------------------------------------------------------------------------------- 1 | Name,Description 2 | Bank Account Number generator,The Bank Account Number tool generates a random bank account number for a bank. 3 | Train Ticket Purchase,"The Train Ticket Purchase tool gets train tickets for a train, provided from and to stations, and date information." 4 | The Cricket Score tool,The Cricket Score tool gets the score for a match that happened at a given location and date. 5 | Book Review,The Book Review tool gets the top-rated book reviews for a particular book. 6 | Grocery Shopping with discounts,The Grocery Shopping tool calculates the expense of grocery shopping based on the menu. 7 | Stock Price at location and date,The Stock Price tool gets the stock price for a company at a given location and date. 8 | Movie Recommendation,"The Movie Recommendation tool recommends movies based on the user's age, preferred genres, and the actors" 9 | News,The News tool gets the top news for a particular topic or query. 10 | Age by date,The Age tool gets the age of a person given their name and date. 11 | Sun-Rise Time tool,Sun Rise Time tool computes the time at which the sun rises at a given location and date. 12 | Taxi Booking tool,"The Taxi Booking tool books a taxi for a given location, date, and car model." 13 | Birthday Date of a given person,BirthdayDate tool is used to get the birthday date of a given person. 14 | Stock Trading,Makes a stock trading transaction. 15 | Stock Name by Sector,The Stock Name tool gets the stocks whose price is less than given number in a particular sector 16 | Bank Account Balance Finder,"The Bank Account Balance tool returns the balance in a user's bank account at a given date, provided the name of the bank account." 17 | Travel Cost compute,The Travel Cost tool calculates the cost of travel from one city to another given travel dates. 18 | Daily Horoscope Tool,The Daily Horoscope tool returns the daily horoscope for a user for the current day. 19 | Birthday Date,Gets the birthday date given name 20 | Sun Rise Time,The Sun rise time tool gets the sun rise time at a given location on a given date 21 | Travel Distance tool,Travel Distance tool computes the distance between two locations. 22 | Language Translate,Translates the given text from one language to another language. 23 | Airline Seat Selector by airline,"The Airline Seat Selector tool returns a seat for a given airline, flight number, date and class." 24 | Traffic Report for a location and date,The Traffic Report tool reports the traffic for a given location and date. 25 | Train Ticket Purchase With Seats,"The Train Ticket Purchase tool books train tickets for a particular train given its number, origin, destination stations, seat numbers, class preference, and date information." 26 | Car Finder,"The Car Finder tool finds the cars based on the model, make and the search radius." 27 | Movie Review By Date,The Movie Review tool gets top-rated movie reviews for a particular movie that are published on this date. 28 | Book Review By Date,The Book Review tool gets the top-rated book reviews for a particular book that are published on this date. 29 | Hotel Reservations tool,"The Hotel Reservations tool books a room in a hotel for a given location, date, and number of nights." 30 | Shipping cost tool,The Shipping tool computes the cost to ship a product from a location to another. 31 | Convert Currency,The Currency Converter tool converts one currency to another. 32 | Travel Distance between two locations,The Travel Distance tool calculates the distance between two locations. 33 | Location,Gets the location of a place 34 | Pizza Order,The Pizza Order tool orders a pizza with provided toppings and size. 35 | Translate from one to other,Translates from one language to another 36 | Travel Duration,Returns the travel duration between two locations. 37 | The Currency Converter,The Currency Converter tool converts currency from one to another. 38 | Car,The Car tool gets the car model for a given car number plate. 39 | Stock Name,The Stock Name tool gets the stocks whose price is less than given number 40 | Stock buy,The Stock Trading tool allows users to buy stocks on a given date. 41 | Calculator Expression,The Calculator tool calculates the given expression. 42 | Sun Set Time,The Sun set time tool gets the sun set time at a given location on a given date 43 | Book Review By Day,The Book Review tool gets the top-rated book reviews for a particular book that are published on this day. 44 | Currency Converter,The Currency Converter tool converts a foreign currency to another currency. 45 | Car Finder Location,"The Car Finder tool finds the car for a given location, date, and model." 46 | Car Rental with driver,"The Car Rental tool rents a car for a given location, date, model with driver" 47 | Shipping,The Shipping tool finds the shipping charges for a location 48 | Clothing Recommendation for weather,"The Clothing Recommendation tool recommends clothing for a user based on weather, time, location, and gender." 49 | Job Search with Salary,"The Job Search tool searches for a job based on the location, job title, and salary." 50 | Travel Duration tool,The Travel Duration tool computes the travel duration between two locations. 51 | Currency Converter tool,The Currency Converter tool converts one currency to another currency. 52 | Travel Distance Compute,The Travel Distance tool computes the distance between two locations. 53 | Shipping cost compute,Shipping the package from source location to destination location 54 | Date,Gets today's date 55 | Restaurant Finder,"The Restaurant Finder tool finds the restaurants based on its location, cuisine and the number of people." 56 | Restaurant Reservations tool,The Restaurant Reservation tool makes reservations at a given restaurant at a given location and date. 57 | Movie Recommendation tool,"The Movie Recommendation tool gives movie recommendations to users based on their age, gender, and the day and time information when they want to watch." 58 | Hotel Reservations,The Hotel Reservations tool reserves a room at a given hotel in a given location and provided date. 59 | Pizza Order for location & date,"The Pizza Order tool orders a pizza for a given location, date, pizza size, and ingredients." 60 | Daily Horoscope,The Daily Horoscope tool returns the horoscope based on the date of birth of the user. 61 | Car Rental,"The Car Rental tool rents a car for a given location, date, and model." 62 | Hotel deal,The Hotel deal tool gets the best hotel deals for a given location and date. 63 | Translate,The Translate tool translates a sentence from one language to another. 64 | Movie Review for movie,The Movie Review tool gets the top-rated movie reviews for a particular movie. 65 | Train information,The Train tool gives information about a train. 66 | Movie Finder By Date,"The Movie Finder tool finds the movies based on its title, rating and release date." 67 | Stock Name tool,The Stock Name tool gets the stock name for a ticker 68 | Restaurant Reservations,"The Restaurant Reservations tool reserves a table at a given restaurant name, date, and time." 69 | Bank Account Number Retriever,The Bank Account tool gets the bank account number for a given customer name and bank name. 70 | Calculate EMI tool,"The EMI tool calculates the EMI for a loan based on the amount, rate of interest and duration of the loan." 71 | Car Rental with insurance,"The Car Rental tool rents a car for a given location, date, model with insurance" 72 | Calendar,The Calendar tool gets the details of a meeting 73 | Stock Price,The Stock Price tool gets the price of a given stock at a given date. 74 | Location for Lat Long,Gives the location for the given latitude and longitude. 75 | Bank Account Balance Tool,The Bank Account Balance tool gets the current balance in a given account number in a given bank 76 | Train search,The Train tool returns the trains from the source to the destination on a particular date. 77 | Train,The Train tool gets the train number for a given train name. 78 | Calculator basic,The Calculator tool performs basic calculations. 79 | Calendar date,The Calendar tool computes the date of the first day of the week that contains the specified date. 80 | Movie Finder,The Movie Finder tool finds the movies based on its title and rating. 81 | Sun Rise Time For location & date,Sun Rise Time tool returns sun rise time for a location and a date 82 | Flight Booking,"The Flight Booking tool books a flight for a given origin, destination, date, and number of tickets" 83 | Sun Rise Time Date Location,Gives the time at which the sun rises for a given date and location. 84 | Travel Cost,Returns the cost of travel given origin and destination places. 85 | Restaurant Finder with rating,"The Restaurant Finder tool finds the restaurants based on its location, cuisine, the number of people and rating." 86 | Latest News,The News tool gives the latest news in a given category. 87 | Job Search by Salary,"The Job Search tool searches for a job based on the location, job title, and salary." 88 | Airline Seat Selector,The Airline Seat Selector tool gets the airline seats based on the row and column. 89 | Cricket Score,The Cricket Score tool provides live cricket scores for an ongoing match. 90 | Sun Set Time Date Location,Gives the time at which the sun sets at a location on a date. 91 | Movie Review,The Movie Review tool gets top-rated movie reviews for a particular movie. 92 | Sun Set Time For location & date,Sun set time for a location and date. 93 | Bank Name,The Bank Name tool gives the name of the bank in which the provided person name has an account 94 | Weather forecast,The Weather tool gets the weather forecast for a given location and date. 95 | Calculate EMI,"The Calculate EMI tool calculates EMI for a given loan amount, yearly interest rate and loan tenure." 96 | Clothing Recommendation,"The Clothing Recommendation tool finds the recommended clothes based on the user's gender, preferred clothing style, size, and age." 97 | Traffic Report,The Traffic Report tool gets traffic report for a given location and date. 98 | Order Pizza,"The Pizza Order tool orders a pizza for a given location, date, and size" 99 | Airline Seat Selector by Flight Number,The Airline Seat Selector tool selects a seat for a passenger in a given flight. 100 | Car Type,The Car tool returns the type of car. 101 | Calculator Tool,"The Calculator tool can be used to add, subtract, multiply, and divide the numbers." 102 | Movie Recommendation for date and location,The Movie Recommendation tool recommends a movie for a given date and location. 103 | Bank Name for parameters,"The BankName tool gets the name of the bank based on the branch name, state, and city information." 104 | Traffic Report Date Time,"The Traffic Report tool gets traffic report for a given location, date and time." 105 | Travel Distance,Returns the travel distance between two locations. 106 | Hotel,The Hotel tool gets the hotel details for a given hotel name in a location. 107 | Pizza,"The Pizza tool orders a pizza for a given person name, delivery location, and date." 108 | Weather Date for location and date,The Weather Date tool returns the weather for a given location and date. 109 | Book a taxi,"Book a taxi for a given location, date, time and number of passengers" 110 | Movie Ticket Purchase for date,"The Movie Ticket Purchase tool buys a movie ticket for a given movie, date, and location." 111 | Flight Number Date,"The Flight Number tool gets the flight number for a given flight name, origin, destination, and date." 112 | Movie Finder by actor or director,The Movie Finder tool returns the most popular movies for a particular actor or director. 113 | Traffic Report generator,The Traffic Report tool generates the traffic report for a particular location and date. 114 | Job numbers,The Job tool gives the number of job openings available in a location. 115 | Job Search,The Job Search tool searches for a job based on the location and job title. 116 | Bank Name for account number,The Bank Name tool gets the name of the bank based on an account number 117 | Taxi Estimator Tool,"The Taxi Estimator tool estimates the taxi fare for a given trip, date, and car model." 118 | Airline Seat Selector via Flight Number,The Airline Seat Selector tool helps to select a seat in a particular flight. 119 | Bank Account Balance,The Bank Account Balance tool shows the balance present in an account given its account number and bank name. 120 | Taxi Estimator for one location to other,The Taxi Estimator tool gives an estimate of how much it would cost to travel from one location to another in a taxi. 121 | Find restaurants tool,The Find restaurants tool tool finds the restaurants at a given location and date. 122 | Date tool,The Date tool returns the date in the specified format. 123 | EMI tool,"The EMI tool computes the EMI for a loan of a given amount, for a given tenure, and interest rate." 124 | Age,The Age tool gets the age of a person given their name 125 | Top 5 News,The News tool gets the top 5 news for a given location and date. 126 | Restaurant Finder with price,"The Restaurant Finder tool finds the restaurants based on its location, cuisine and the number of people." 127 | Birthday Date of a person,The Birthday Date tool gets the birthday date for a person. 128 | Job Search Date,"The Job Search tool searches for a job based on the location, job title, and date." 129 | Book flight tool,The Book flight tool books a flight between two cities for a given date. 130 | Travel Duration computation,Travel Duration tool computes the duration of a trip. 131 | Movie Ticket Purchase,"The Movie Ticket Purchase tool gets movie tickets for a movie, theater and date." 132 | Calculator,"The Calculator tool can add, subtract, multiply, divide two numbers" 133 | The Birthday Date Tool,The Birthday Date tool returns the date of birth of a person. 134 | Grocery Shopping for week,The Grocery Shopping tool helps to get the grocery list for the given week. 135 | Bank Account Number generate,The Bank Account Number tool generates a bank account number based on a bank name and the country. 136 | Taxi Estimator,The Taxi Estimator calculates the approximate fare based on the provided origin and destination. 137 | Flight Number for airline and date,Gets the number of flights for a particular airline on a particular date. 138 | Bank Name for a code,The Bank Name tool gets the name of the bank based on a bank code. 139 | Movie Ticket Purchase at theatre,The Movie Ticket Purchase tool purchases a movie ticket for a specific movie at a specific theatre on a specific date. 140 | Hotel tool,The Hotel tool lists the hotels at a given location 141 | Job,The Job tool gets the job of a person. 142 | Translate tool,The translate tool translates the input message to a given language 143 | Daily Horoscope for date and sign,Gives the daily horoscope for a particular date and sign. 144 | Location tool,The Location tool gives the location of a place. 145 | Calendar days,The Calendar tool gives the number of days between two dates. 146 | Taxi Booking,The Taxi Booking tool books a taxi based on the provided origin and destination at the provided time. 147 | Date format convertor,Date format convertor returns the date in the following format YYYY-MM-DD 148 | Weather Date,The Weather Date tool gets weather information for a specific location and date. 149 | Car price compute,"The Car tool computes the price of a car based on its brand, model, and year." 150 | Stock Price of a stock,The Stock Price tool gets the price of a stock at a particular date. 151 | Grocery Shopping,The Grocery Shopping tool calculates the expense of grocery shopping based on the menu. 152 | Size,The Size tool gets the size of a person given their name 153 | Travel Cost calculate,"The Travel Cost tool calculates the cost of a travel for a given location, date, and mode of transport." 154 | Stock Price at a date,The Stock Price tool gets the price of a particular stock at a particular date. 155 | EMI calculator,"The EMI calculator tool calculates the EMI for a given loan amount, interest rate, and tenure." 156 | Bank Account Number,The Bank Account Number tool gives the account number given the account holder's name 157 | Flight Number,"The Flight Number tool gets the flight number for a given flight name, origin, and destination." 158 | Car Information,The Car information tool gives information about a car. 159 | Clothing Recommendation Tool,The Clothing Recommendation tool returns a list of clothing that are most suitable for a given event 160 | Size Object,The Size tool gives the size of an object. 161 | News - top stories,The News tool returns the top stories for a particular date and location. 162 | Hotel Reservations for check in checkout,"The Hotel Reservation tool books a hotel for a given location, check in and check out dates." 163 | Book Review By Before Date,The Book Review tool gets the top-rated book reviews for a particular book that are published before this date. 164 | Humidity at timezone,Computes humidity at a given timezone on a date 165 | Humidity,Computes humidity at a location on a date 166 | Humidity Altitude Location date,Computes humidity at an altitude at a given location and date 167 | Movie Review By After Date,The Movie Review tool gets top-rated movie reviews for a particular movie that are published after this date. 168 | Movie Review By Before Date,The Movie Review tool gets top-rated movie reviews for a particular movie that are published before this date. 169 | Real Estate Finder for homes,"The Real Estate Finder tool searches for homes based on a location, price range, and bedrooms." 170 | Real Estate Finder,"The Real Estate Finder tool finds the Real Estate properties based on its location, size, and type." 171 | The Real Estate Finder,"Real Estate Finder finds properties at a given location, price, number of bathrooms, and bedrooms." 172 | Restaurant Recommender for time,"The Restaurant Recommender tool recommends a restaurant for a location, date, cuisine, number of people, and time." 173 | Restaurant Recommender,"The Restaurant Recommender tool recommends a restaurant based on a given location, cuisine, and price range" 174 | Restaurant Recommender for a criteria,"The Restaurant Recommender tool returns a list of restaurants at a location, for a given date, cuisine, price range, and rating of the restaurant." 175 | -------------------------------------------------------------------------------- /docs/ToolVerifier.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/facebookresearch/ToolVerifier/a000c57c33d0d0e0b3734b36517ed1fb8e171e1a/docs/ToolVerifier.png --------------------------------------------------------------------------------