{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "
\n", "

\n", " \"phoenix\n", "
\n", " Docs\n", " |\n", " GitHub\n", " |\n", " Community\n", "

\n", "
\n", "

Tool Calling Evals

\n", "\n", "The purpose of this notebook is:\n", "\n", "- to evaluate the multi-step LLM logic involved in tool calling,\n", "- to provide an experimental framework for users to iterate and improve on the default evaluation template.\n", "\n", "## Install Dependencies and Import Libraries" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "id": "jAaGehi7tvft" }, "outputs": [], "source": [ "%pip install -qq \"arize-phoenix==6.1.0\" \"llama-index-llms-openai==0.2.2\" \"openai===1.57.0\" gcsfs==2024.10.0 nest_asyncio==1.6.0 langchain==0.3.10 langchain-openai==0.2.11 openinference-instrumentation-langchain==0.1.29 'httpx<0.28'" ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "cellView": "form", "id": "KvBTXtxRt26b" }, "outputs": [], "source": [ "import os\n", "from getpass import getpass\n", "\n", "if not (openai_api_key := os.getenv(\"OPENAI_API_KEY\")):\n", " openai_api_key = getpass(\"πŸ”‘ Enter your OpenAI API key: \")\n", "\n", "os.environ[\"OPENAI_API_KEY\"] = openai_api_key" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "id": "cUeYzQU6t6D-" }, "outputs": [], "source": [ "import nest_asyncio\n", "import pandas as pd\n", "\n", "from phoenix.evals import (\n", " TOOL_CALLING_PROMPT_RAILS_MAP,\n", " TOOL_CALLING_PROMPT_TEMPLATE,\n", " OpenAIModel,\n", " llm_classify,\n", ")\n", "\n", "nest_asyncio.apply()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Generate App Usage Data\n", "\n", "Let's begin by generating some data to use for our evaluation. Let's pretend we have a chatbot for an ecommerce company that is armed with a set of functions to lookup products and orders." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "id": "csndng-xRrqA" }, "outputs": [], "source": [ "GEN_TEMPLATE = \"\"\"\n", "You are an assistant that generates complex customer service questions. You will try to answer the question with the tool if possible,\n", "do your best to answer, ask for more information only if needed.\n", "The questions should often involve:\n", "\n", "Please reference the product names, the product details, product IDS and product information.\n", "\n", "Multiple Categories: Questions that could logically fall into more than one category (e.g., combining product details with a discount code).\n", "Vague Details: Questions with limited or vague information that require clarification to categorize correctly.\n", "Mixed Intentions: Queries where the customer’s goal or need is unclear or seems to conflict within the question itself.\n", "Indirect Language: Use of indirect or polite phrasing that obscures the direct need or request (e.g., using \"I was wondering if...\" or \"Perhaps you could help me with...\").\n", "For specific categories:\n", "\n", "Track Package: Include vague timing references (e.g., \"recently\" or \"a while ago\") instead of specific dates.\n", "Product Comparison and Product Search: Include generic descriptors without specific product names or IDs (e.g., \"high-end smartphones\" or \"energy-efficient appliances\").\n", "Apply Discount Code: Include questions about discounts that might apply to hypothetical or past situations, or without mentioning if they have made a purchase.\n", "Product Details: Ask for comparisons or details that involve multiple products or categories ambiguously (e.g., \"Tell me about your range of electronics that are good for home office setups\").\n", "Examples of More Challenging Questions\n", "Multiple Categories\n", "\n", "\"I recently bought a samsung 106i smart phone, and I was wondering if there's a way to check what deals I might have missed or if my order is on its way?\"\n", "\"Could you tell me if the samsung 15H adapater in my last order are covered under warranty and if they have shipped yet?\"\n", "Vague Details\n", "\n", "\"There's an issue with one of the Vizio 14Y TV I think I bought last monthβ€”what should I do?\"\n", "\"I need help with a iPhone 16H I ordered, or maybe I'm just looking for something new. Can you help?\"\n", "Mixed Intentions\n", "\n", "\"I'm not sure if I should ask for a refund or just find out when it will arrive. What do you suggest?\"\n", "\"Could you help me decide whether to upgrade my product or just track the current one?\"\n", "Indirect Language\n", "\n", "\"I was wondering if you might assist me in figuring out a problem I have with an order, or maybe it's more of a query?\"\n", "\"Perhaps you could help me understand the benefits of your premium products compared to the regular ones?\"\n", "\n", "Some questions should be straightforward uses of the provided functions\n", "\n", "Respond with a list, one question per line. Do not include any numbering at the beginning of each line. Do not include any category headings.\n", "Generate 20 questions.\n", "\"\"\"" ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "id": "PmB4rLLbuHaN" }, "outputs": [], "source": [ "model = OpenAIModel(model=\"gpt-4o\", max_tokens=1300)" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "id": "jkixHyS-uSSj" }, "outputs": [], "source": [ "resp = model(GEN_TEMPLATE)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "mNDJeuOTyjDA", "outputId": "35a31086-2720-46f2-f7df-3aa055f5d6d5" }, "outputs": [], "source": [ "split_response = resp.strip().split(\"\\n\")\n", "\n", "questions_df = pd.DataFrame(split_response, columns=[\"questions\"])\n", "print(questions_df)" ] }, { "cell_type": "markdown", "metadata": { "id": "YOIstO10ynOw" }, "source": [ "# Define a tool-calling agent with Langchain\n", "\n", "Now we'll define the chatbot agent using Langchain to attach the functions as tools." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "ceIKijABB8Z_", "outputId": "e2ba4645-b326-41eb-9d27-056a7914e95f" }, "outputs": [], "source": [ "from langchain.agents import AgentType, initialize_agent\n", "from langchain.prompts.chat import ChatPromptTemplate, MessagesPlaceholder\n", "from langchain.tools import tool\n", "from langchain_openai import ChatOpenAI\n", "from openinference.instrumentation.langchain import LangChainInstrumentor\n", "\n", "import phoenix as px\n", "from phoenix.otel import register" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We'll also enable tracing with Phoenix using our Langchain auto-instrumentor to capture telemetry that we can later evaluate." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 71 }, "id": "21G13sdkCVLg", "outputId": "e2e3b7a9-e484-4043-87b6-365562c4f004" }, "outputs": [], "source": [ "(session := px.launch_app()).view()\n", "tracer_provider = register()\n", "LangChainInstrumentor(tracer_provider=tracer_provider).instrument(skip_dep_check=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Now we'll define our basic functions using pydantic. The actual logic of the functions doesn't matter in this evaluation scenario, since we won't be evaluating anything beyond the function generation step." ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "id": "uZBUQTqZFj4r" }, "outputs": [], "source": [ "## function definitions using pydantic decorator\n", "\n", "\n", "@tool\n", "def product_comparison(product_a_id: str, product_b_id: str) -> dict:\n", " \"\"\"\n", " Compare features of two products.\n", "\n", " Parameters:\n", " product_a_id (str): The unique identifier of Product A.\n", " product_b_id (str): The unique identifier of Product B.\n", "\n", " Returns:\n", " dict: A dictionary containing the comparison of the two products.\n", " \"\"\"\n", "\n", " if product_a_id == \"\" or product_b_id == \"\":\n", " return {\"error\": \"missing product id\"}\n", "\n", " # Implement the function logic here\n", " return {\"comparison\": \"Similar\"}\n", "\n", "\n", "@tool\n", "def product_details(product_id: str) -> dict:\n", " \"\"\"\n", " Get detailed features on one product.\n", "\n", " Parameters:\n", " product_id (str): The unique identifier of the Product.\n", "\n", " Returns:\n", " dict: A dictionary containing product details.\n", " \"\"\"\n", "\n", " if product_id == \"\":\n", " return {\"error\": \"missing product id\"}\n", "\n", " # Implement the function logic here\n", " return {\"name\": \"Product Name\", \"price\": \"$12.50\", \"Availability\": \"In Stock\"}\n", "\n", "\n", "@tool\n", "def apply_discount_code(order_id: int, discount_code: str) -> dict:\n", " \"\"\"\n", " Applies a discount code to an order.\n", "\n", " Parameters:\n", " order_id (str): The unique identifier of the order.\n", " discount_code (str): The discount code to apply.\n", "\n", " Returns:\n", " dict: A dictionary containing the updated order details.\n", " \"\"\"\n", "\n", " if order_id == \"\" or discount_code == \"\":\n", " return {\"error\": \"missing order id or discount code\"}\n", "\n", " # Implement the function logic here\n", " return {\"applied\": \"True\"}\n", "\n", "\n", "@tool\n", "def product_search(\n", " query: str,\n", " category: str = None,\n", " min_price: float = 0.0,\n", " max_price: float = None,\n", " page: int = 1,\n", " page_size: int = 20,\n", ") -> dict:\n", " \"\"\"\n", " Search for products based on criteria.\n", "\n", " Parameters:\n", " query (str): The search query string.\n", " category (str, optional): The category to filter the search. Default is None.\n", " min_price (float, optional): The minimum price of the products to search. Default is 0.\n", " max_price (float, optional): The maximum price of the products to search. Default is None.\n", " page (int, optional): The page number for pagination. Default is 1.\n", " page_size (int, optional): The number of results per page. Default is 20.\n", "\n", " Returns:\n", " dict: A dictionary containing the search results and pagination info.\n", " \"\"\"\n", "\n", " if query == \"\":\n", " return {\"error\": \"missing query\"}\n", "\n", " # Implement the function logic here\n", " return {\"results\": [], \"pagination\": {\"total\": 0, \"page\": 1, \"page_size\": 20}}\n", "\n", "\n", "@tool\n", "def customer_support(issue_type: str) -> dict:\n", " \"\"\"\n", " Get contact information for customer support regarding an issue.\n", "\n", " Parameters:\n", " issue_type (str): The type of issue (e.g., billing, technical support).\n", "\n", " Returns:\n", " dict: A dictionary containing the contact information for customer support.\n", " \"\"\"\n", "\n", " if issue_type == \"\":\n", " return {\"error\": \"missing issue type\"}\n", "\n", " # Implement the function logic here\n", " return {\"contact\": issue_type}\n", "\n", "\n", "@tool\n", "def track_package(tracking_number: int) -> dict:\n", " \"\"\"\n", " Track the status of a package based on the tracking number.\n", "\n", " Parameters:\n", " tracking_number (str): The tracking number of the package.\n", "\n", " Returns:\n", " dict: A dictionary containing the tracking status of the package.\n", " \"\"\"\n", " if tracking_number == \"\":\n", " return {\"error\": \"missing tracking number\"}\n", "\n", " # Implement the function logic here\n", " return {\"status\": \"Delivered\"}\n", "\n", "\n", "tools = [\n", " product_comparison,\n", " product_search,\n", " customer_support,\n", " track_package,\n", " apply_discount_code,\n", " product_details,\n", "]" ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "id": "8rXNA8ApCt7C" }, "outputs": [], "source": [ "llm = ChatOpenAI(model=\"gpt-4o\")\n", "prompt = ChatPromptTemplate.from_messages(\n", " [\n", " (\"system\", \"You are a helpful assistant\"),\n", " (\"human\", \"{input}\"),\n", " MessagesPlaceholder(variable_name=\"agent_scratchpad\"),\n", " ]\n", ")" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "5b3PM7P2Izn4", "outputId": "d04949ce-c245-48a3-e3ce-9a8d16358b68" }, "outputs": [], "source": [ "agent_executor = initialize_agent(tools, llm, agent=AgentType.OPENAI_FUNCTIONS)" ] }, { "cell_type": "markdown", "metadata": { "id": "DOkDJEVmLMrN" }, "source": [ "# Run Agent on each question\n", "\n", "With our agent defined, we can now run it across each generated question." ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "id": "ZRb9QODuLUcR" }, "outputs": [], "source": [ "questions_df[\"response\"] = questions_df[\"questions\"].apply(agent_executor.invoke)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 1000 }, "collapsed": true, "id": "xS3HPR4sPY-J", "outputId": "7f2752ca-52a4-4a73-9286-87bb6eb8bdcd" }, "outputs": [], "source": [ "questions_df" ] }, { "cell_type": "markdown", "metadata": { "id": "qcD7yrdq9xio" }, "source": [ "# Evaluate Tool Calls\n", "\n", "Now that we have some example runs of our agent to analyze, we can start the evaluation process. We'll start by exporting all of those spans from Phoenix" ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "id": "o4ehVNIx90RJ" }, "outputs": [], "source": [ "from phoenix.trace import SpanEvaluations\n", "from phoenix.trace.dsl import SpanQuery" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Since we'll only be evaluating the inputs, outputs, and function call columns, let's extract those into an easier to use df. Helpfully, Phoenix provides a method to query your span data and directly export only the values you care about." ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "id": "JXuodhcq90RT" }, "outputs": [], "source": [ "query = (\n", " SpanQuery()\n", " .where(\n", " # Filter for the `LLM` span kind.\n", " # The filter condition is a string of valid Python boolean expression.\n", " \"span_kind == 'LLM'\",\n", " )\n", " .select(\n", " # Extract and rename the following span attributes\n", " question=\"llm.input_messages\",\n", " tool_call=\"llm.function_call\",\n", " )\n", ")\n", "trace_df = px.Client().query_spans(query)\n", "trace_df[\"tool_call\"] = trace_df[\"tool_call\"].fillna(\"No tool used\")" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "trace_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We'll also need to pass in our tool definitions to the evaluator:" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "tool_definitions = \"\"\n", "\n", "for current_tool in tools:\n", " tool_definitions += f\"\"\"\n", " {current_tool.name}: {current_tool.description}\n", " \"\"\"\n", "\n", "print(tool_definitions)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Next, we define the evaluator model to use" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "id": "bgaGKUsj90RU" }, "outputs": [], "source": [ "eval_model = OpenAIModel(model=\"gpt-4o\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "And we're ready to call our evaluator! The method below takes in the dataframe of traces to evaluate, our built in evaluation prompt, the eval model to use, and a rails object to snap responses from our model to a set of binary classification responses.\n", "\n", "We'll also instruct our model to provide explanations for its responses." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 49, "referenced_widgets": [ "7c5e67d77f224d469f0cafaeefa22de7", "3a2180ddbcde4c369c7c68fde07963e7", "d631ceb26c344aec9e6863216dc12629", "87cd56dc90fb480aa07fa4f4c7b179fe", "da1c4e572e9e471eb14e76af6918eaaa", "507f58f089eb4b9e978ccf686da1d6a2", "9d3a99a9a0474ab3945d1ef11a71c95a", "ef425181ab7840acae6751080be4069a", "f7f827c5e96b4709949a056ac3fc015c", "6b7b8f5f4b534101b148acf6dc1a2a8e", "dbcb7019f9714cc0845db888c1c70d73" ] }, "id": "GvtW9NGK90RU", "outputId": "173c0d42-b86a-476f-919e-a785fd523af1" }, "outputs": [], "source": [ "rails = list(TOOL_CALLING_PROMPT_RAILS_MAP.values())\n", "\n", "response_classifications = llm_classify(\n", " dataframe=trace_df,\n", " template=TOOL_CALLING_PROMPT_TEMPLATE.template.replace(\"{tool_definitions}\", tool_definitions),\n", " model=eval_model,\n", " rails=rails,\n", " provide_explanation=True,\n", ")\n", "response_classifications[\"score\"] = response_classifications.apply(\n", " lambda x: 1 if x[\"label\"] == \"correct\" else 0, axis=1\n", ")" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 1000 }, "id": "pf2OkgnCLwT-", "outputId": "80bb4bc4-5026-40cb-ca34-b04ac37a79ae" }, "outputs": [], "source": [ "response_classifications" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Finally, we'll export these responses back into Phoenix to view them in the UI." ] }, { "cell_type": "code", "execution_count": 22, "metadata": { "id": "_A5LWDzd90RU" }, "outputs": [], "source": [ "px.Client().log_evaluations(\n", " SpanEvaluations(eval_name=\"Tool Calling Eval\", dataframe=response_classifications),\n", ")" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "print(\"View your evals in the Spans section of the UI here:\", px.Client().web_url)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "From here, you could iterate on different agent logic and prompts to improve performance, or you could further decompose the evaluation into individual steps looking first at Routing, then Parameter Extraction, then Code Generation to determine where to focus.\n", "\n", "Happy building!" ] } ], "metadata": { "colab": { "collapsed_sections": [ "qcD7yrdq9xio", "m5_aA0tMJjN8", "CpYA4ZCIGHvu" ], "provenance": [] }, "kernelspec": { "display_name": ".venv", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.11" }, "widgets": { "application/vnd.jupyter.widget-state+json": { "0203197d25fc4b049b96dacf650a91ca": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "0709742231364662b0c5508b344911a6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "093fd5ef62104927b3af6616b2e36297": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_2968e3974ef541a0869e2abc82b5f8d4", "IPY_MODEL_2544ce94733941e784625af211fb7a63", "IPY_MODEL_3531871d60e646009fe593718a4e4540" ], "layout": "IPY_MODEL_0f61cb45e2f948bab5a60dc4ed6740bd" } }, "0f1210815b42447db80fdb8397b317eb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_5531048114cc4fa1b0bfe42a1dbc1892", "placeholder": "​", "style": "IPY_MODEL_b6030183c20749c39d8f50c67eb61d15", "value": "llm_classify " } }, "0f61cb45e2f948bab5a60dc4ed6740bd": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "0f81903f51fa405b8f99ede8cea37809": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "1409ec2aa9074804abd2fd9133812e7a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "1a5f38e1cf714ef4a257ebc03605e57b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_c9e2548004d74ad6a441a2c77b7ab552", "IPY_MODEL_599b526ba23f4b4398e79d2637f4fbda", "IPY_MODEL_5d72660fc39242f88bf37d18d7ba87b2" ], "layout": "IPY_MODEL_d00cea1d056944b5a88c39ccb3346c72" } }, "2544ce94733941e784625af211fb7a63": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_9f4faac324114001b185c7739f5208f7", "max": 6, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_563df320fc3543a999cf011b7c23397b", "value": 6 } }, "264cd797d26b49e1b80ada49bca34982": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_0f1210815b42447db80fdb8397b317eb", "IPY_MODEL_e7612d5b60d1406bad66fc7ed38b83b2", "IPY_MODEL_eb5c633e181847c7b2c0617cf8c8e864" ], "layout": "IPY_MODEL_a61c0f65a4ff45d9870d9cb53eb47681" } }, "2968e3974ef541a0869e2abc82b5f8d4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_b6207438b4a94c97937e80602a21fa8b", "placeholder": "​", "style": "IPY_MODEL_938ffc9a86674af98c64c6b58196f284", "value": "llm_classify " } }, "29e49f03d57744deace90fbd9aea45d6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "2ab5eb108f35472db65366f1fa104875": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "2eb6c256bddf49b8b56f0b132beee530": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "3531871d60e646009fe593718a4e4540": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_0f81903f51fa405b8f99ede8cea37809", "placeholder": "​", "style": "IPY_MODEL_e961654dde5243caba995b8abb02bf5c", "value": " 6/6 (100.0%) | ⏳ 7:16:26<00:00 |  3.88it/s" } }, "3a2180ddbcde4c369c7c68fde07963e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_507f58f089eb4b9e978ccf686da1d6a2", "placeholder": "​", "style": "IPY_MODEL_9d3a99a9a0474ab3945d1ef11a71c95a", "value": "llm_classify " } }, "498c13abdd47452aa80fd0663358b9aa": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "4fe6bff26f6c4237b2a1f49d5c464afa": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "507f58f089eb4b9e978ccf686da1d6a2": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "5531048114cc4fa1b0bfe42a1dbc1892": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "563df320fc3543a999cf011b7c23397b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "599b526ba23f4b4398e79d2637f4fbda": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_2eb6c256bddf49b8b56f0b132beee530", "max": 6, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_498c13abdd47452aa80fd0663358b9aa", "value": 6 } }, "5d72660fc39242f88bf37d18d7ba87b2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_29e49f03d57744deace90fbd9aea45d6", "placeholder": "​", "style": "IPY_MODEL_ef8aebebb9214fcb8d1d8a0484bc5111", "value": " 6/6 (100.0%) | ⏳ 00:03<00:00 |  3.72it/s" } }, "6b7b8f5f4b534101b148acf6dc1a2a8e": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "72d14410c39a4a88848c9692a8d56e1f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "7c5e67d77f224d469f0cafaeefa22de7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_3a2180ddbcde4c369c7c68fde07963e7", "IPY_MODEL_d631ceb26c344aec9e6863216dc12629", "IPY_MODEL_87cd56dc90fb480aa07fa4f4c7b179fe" ], "layout": "IPY_MODEL_da1c4e572e9e471eb14e76af6918eaaa" } }, "81d223d385ac45e2a7f1ea6866b09689": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_aae90183804d4d32b1cf1223abea86ae", "placeholder": "​", "style": "IPY_MODEL_c78743779aea4f92a36dac22c01eabd4", "value": " 6/6 (100.0%) | ⏳ 7:16:30<00:00 |  2.85it/s" } }, "87cd56dc90fb480aa07fa4f4c7b179fe": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_6b7b8f5f4b534101b148acf6dc1a2a8e", "placeholder": "​", "style": "IPY_MODEL_dbcb7019f9714cc0845db888c1c70d73", "value": " 48/48 (100.0%) | ⏳ 00:13<00:00 |  5.60it/s" } }, "8a9f950ab78b4a289f19dcb21f0cf05a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HBoxModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HBoxModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HBoxView", "box_style": "", "children": [ "IPY_MODEL_91ac20ec428e4390953148a709a3c353", "IPY_MODEL_900108edb2674a7da36cdda869e241e7", "IPY_MODEL_81d223d385ac45e2a7f1ea6866b09689" ], "layout": "IPY_MODEL_1409ec2aa9074804abd2fd9133812e7a" } }, "8f00a20991c541b798879173620e4cb0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "900108edb2674a7da36cdda869e241e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_4fe6bff26f6c4237b2a1f49d5c464afa", "max": 6, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_93d233b8f8fd425b90aeba162697b098", "value": 6 } }, "91ac20ec428e4390953148a709a3c353": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_2ab5eb108f35472db65366f1fa104875", "placeholder": "​", "style": "IPY_MODEL_ac89a80f376b4a909638c00257cf9031", "value": "llm_classify " } }, "938ffc9a86674af98c64c6b58196f284": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "93d233b8f8fd425b90aeba162697b098": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "981864f59ce648e3a33b362655b8546a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } }, "9d3a99a9a0474ab3945d1ef11a71c95a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "9f4faac324114001b185c7739f5208f7": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "a61c0f65a4ff45d9870d9cb53eb47681": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "aae90183804d4d32b1cf1223abea86ae": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ac89a80f376b4a909638c00257cf9031": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "b6030183c20749c39d8f50c67eb61d15": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "b6207438b4a94c97937e80602a21fa8b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "c78743779aea4f92a36dac22c01eabd4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "c9e2548004d74ad6a441a2c77b7ab552": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_eb954ab02aaa489a947d35e261bfe2cd", "placeholder": "​", "style": "IPY_MODEL_8f00a20991c541b798879173620e4cb0", "value": "llm_classify " } }, "d00cea1d056944b5a88c39ccb3346c72": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "d631ceb26c344aec9e6863216dc12629": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_ef425181ab7840acae6751080be4069a", "max": 48, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_f7f827c5e96b4709949a056ac3fc015c", "value": 48 } }, "da1c4e572e9e471eb14e76af6918eaaa": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "dbcb7019f9714cc0845db888c1c70d73": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "e7612d5b60d1406bad66fc7ed38b83b2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "FloatProgressModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "FloatProgressModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "ProgressView", "bar_style": "success", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_72d14410c39a4a88848c9692a8d56e1f", "max": 6, "min": 0, "orientation": "horizontal", "style": "IPY_MODEL_981864f59ce648e3a33b362655b8546a", "value": 6 } }, "e961654dde5243caba995b8abb02bf5c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "eb5c633e181847c7b2c0617cf8c8e864": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "HTMLModel", "state": { "_dom_classes": [], "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "HTMLModel", "_view_count": null, "_view_module": "@jupyter-widgets/controls", "_view_module_version": "1.5.0", "_view_name": "HTMLView", "description": "", "description_tooltip": null, "layout": "IPY_MODEL_0709742231364662b0c5508b344911a6", "placeholder": "​", "style": "IPY_MODEL_0203197d25fc4b049b96dacf650a91ca", "value": " 6/6 (100.0%) | ⏳ 00:04<00:00 |  4.13it/s" } }, "eb954ab02aaa489a947d35e261bfe2cd": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ef425181ab7840acae6751080be4069a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.2.0", "model_name": "LayoutModel", "state": { "_model_module": "@jupyter-widgets/base", "_model_module_version": "1.2.0", "_model_name": "LayoutModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "LayoutView", "align_content": null, "align_items": null, "align_self": null, "border": null, "bottom": null, "display": null, "flex": null, "flex_flow": null, "grid_area": null, "grid_auto_columns": null, "grid_auto_flow": null, "grid_auto_rows": null, "grid_column": null, "grid_gap": null, "grid_row": null, "grid_template_areas": null, "grid_template_columns": null, "grid_template_rows": null, "height": null, "justify_content": null, "justify_items": null, "left": null, "margin": null, "max_height": null, "max_width": null, "min_height": null, "min_width": null, "object_fit": null, "object_position": null, "order": null, "overflow": null, "overflow_x": null, "overflow_y": null, "padding": null, "right": null, "top": null, "visibility": null, "width": null } }, "ef8aebebb9214fcb8d1d8a0484bc5111": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "DescriptionStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "DescriptionStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "description_width": "" } }, "f7f827c5e96b4709949a056ac3fc015c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.5.0", "model_name": "ProgressStyleModel", "state": { "_model_module": "@jupyter-widgets/controls", "_model_module_version": "1.5.0", "_model_name": "ProgressStyleModel", "_view_count": null, "_view_module": "@jupyter-widgets/base", "_view_module_version": "1.2.0", "_view_name": "StyleView", "bar_color": null, "description_width": "" } } } } }, "nbformat": 4, "nbformat_minor": 0 }