{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "
\n",
" \n",
"
\n",
" Docs\n",
" |\n",
" GitHub\n",
" |\n",
" Community\n",
"
| \n", " | reference | \n", "query | \n", "response | \n", "is_hallucination | \n", "
|---|---|---|---|---|
| 0 | \n", "() is a prefecture-level city in northwestern Anhui province, China.Gaozhou is a county-level city in southwestern Guangdong Province, China. | \n", "Can Fuyang and Gaozhou be found in the same province? | \n", "no | \n", "False | \n", "
| 1 | \n", "() is a prefecture-level city in northwestern Anhui province, China.Gaozhou is a county-level city in southwestern Guangdong Province, China. | \n", "Can Fuyang and Gaozhou be found in the same province? | \n", "Yes, Fuyang and Gaozhou are in the same province. | \n", "True | \n", "
| 2 | \n", "\"808\" was a success in the United States becoming the group's first top ten hit peaking at number eight on the \"Billboard\" Hot 100 and top five peaking at number four on the Hot R&B/Hip-Hop Singles.The \"Billboard\" Hot 100 is the music industry standard record chart in the United States for singles, published weekly by \"Billboard\" magazine. | \n", "808 peaked at number eight on what? | \n", "Billboard\" Hot 100 | \n", "False | \n", "
| 3 | \n", "\"808\" was a success in the United States becoming the group's first top ten hit peaking at number eight on the \"Billboard\" Hot 100 and top five peaking at number four on the Hot R&B/Hip-Hop Singles.The \"Billboard\" Hot 100 is the music industry standard record chart in the United States for singles, published weekly by \"Billboard\" magazine. | \n", "808 peaked at number eight on what? | \n", "\"808\" peaked at number nine on \"Billboard\" Hot 100. | \n", "True | \n", "
| 4 | \n", "\"Arms\" then made a comeback in 2017 reaching #36 on the iTunes chart passing Auli'i Cravalho's \"How Far I'll Go\" from the Disney movie \"Moana\" (2017).Moana ( ) is a 2016 American 3D computer-animated musical fantasy-adventure film produced by Walt Disney Animation Studios and released by Walt Disney Pictures. | \n", "Arms is a song by American singer-songwriter Christina Perri, in 2017, it passed Auli'i Cravalho's, \"How Far I'll Go\" from which 2016, American 3D computer-animated Disney movie? | \n", "Moana | \n", "False | \n", "
| \n", " | input | \n", "reference | \n", "output | \n", "is_hallucination | \n", "label | \n", "explanation | \n", "
|---|---|---|---|---|---|---|
| 0 | \n", "What fraudulent company was listed on both the Alberta Stock Exchange and the Toronto Stock Exchange? | \n", "The Alberta Stock Exchange (ASE) was a stock exchange based in Calgary, Alberta established in 1913. The ASE was the original listing exchange for Bre-X, one of the biggest corporate frauds in Canadian history. Bre-X bought the Busang site in March 1993 and in October 1995 announced significant amounts of gold had been discovered, sending its stock price soaring. Originally a penny stock, its stock price reached a peak at CAD $286.50 (split adjusted) in May 1996 on the Toronto Stock Exchange (TSE), with a total capitalization of over CAD $6 billion. | \n", "The ASE did not list any fraudulent company. | \n", "True | \n", "hallucinated | \n", "The query asks for the fraudulent company that was listed on both the Alberta Stock Exchange and the Toronto Stock Exchange. The reference text clearly states that Bre-X, a company involved in one of the biggest corporate frauds in Canadian history, was originally listed on the Alberta Stock Exchange and its stock price reached a peak on the Toronto Stock Exchange. However, the answer states that the ASE did not list any fraudulent company, which contradicts the information provided in the reference text. | \n", "
| 1 | \n", "\"Simple Song #3\" is the lead single from a 2015 Italian comedy film set where? | \n", "\"Simple Song#3\" or \"Simple Song Number 3\" is an original song sung by South Korean singer Sumi Jo. It is the director's second English language film, and stars Michael Caine and Harvey Keitel as best friends who reflect on their lives while holidaying in the Swiss Alps. | \n", "\"Simple Song #3\" is a lead single from a 2015 Italian comedy film set in the Caribbean. | \n", "True | \n", "hallucinated | \n", "The reference text states that the film, which features the song 'Simple Song #3', is set in the Swiss Alps. However, the answer claims that the film is set in the Caribbean. This is a contradiction, and therefore the answer is not factual based on the reference text. | \n", "
| 2 | \n", "What is the name of the business connected to the Treasure Island Hotel and Casino that is owned by General Growth Properties Inc? | \n", "Treasure Island Hotel & Casino (also known as \"TI\") is a hotel and casino located on the Las Vegas Strip in Paradise, Nevada, USA with 2,664 rooms and 220 suites, and is connected by tram to The Mirage as well as pedestrian bridge to the Fashion Show Mall shopping center.Fashion Show Mall is a shopping mall located on the Las Vegas Strip in Paradise, Nevada, and is owned by General Growth Properties Inc. The mall spans 1888151 sqft of space, with more than 250 stores and seven anchors, and hosts weekend fashion shows on a retractable runway with the mall's central atrium, hence the name. | \n", "Fashion Show Mall | \n", "False | \n", "factual | \n", "The query asks for the name of the business connected to the Treasure Island Hotel and Casino that is owned by General Growth Properties Inc. The reference text mentions that the Treasure Island Hotel & Casino is connected by a pedestrian bridge to the Fashion Show Mall shopping center, which is owned by General Growth Properties Inc. Therefore, the answer 'Fashion Show Mall' is based on the information provided in the reference text. | \n", "
| 3 | \n", "Charles Wallace Murray is a major character in a fantasy/science fiction series of how many young adult novels written by Madeleine L'Engle? | \n", "Charles Wallace Murry is a major character in Madeleine L'Engle's Time Quintet series of young adult science fiction novels.The Time Quintet is a fantasy/science fiction series of five young adult novels written by Madeleine L'Engle. | \n", "five | \n", "False | \n", "factual | \n", "The query asks for the number of young adult novels in the fantasy/science fiction series by Madeleine L'Engle in which Charles Wallace Murry is a major character. The reference text clearly states that Charles Wallace Murry is a major character in the Time Quintet series by Madeleine L'Engle, which consists of five young adult novels. Therefore, the answer 'five' is directly supported by the reference text. | \n", "
| 4 | \n", "In which city is the headquarters of the company which John Schnatter is a spokesman of located in? | \n", "John H. Schnatter (born November 22, 1961) is an American entrepreneur and the founder, CEO, and spokesman of Papa John's International, Inc. It runs the third largest take-out and pizza delivery restaurant chain in the United States, with headquarters in Jeffersontown, Kentucky, a suburb of Louisville. | \n", "The headquarters is located in Kentucky. | \n", "True | \n", "hallucinated | \n", "The query asks for the city where the headquarters of the company that John Schnatter is a spokesman for is located. The reference text states that the headquarters of Papa John's International, Inc., the company for which John Schnatter is a spokesman, is in Jeffersontown, Kentucky. The answer states that the headquarters is located in Kentucky. While this is technically true, it does not fully answer the query, which specifically asks for the city. Therefore, the answer is not entirely factual. | \n", "