Data labeling example
This notebook shows how to use EDSL to automate data labeling and content analysis. Using a dataset of mock customer service tickets as an example, we design a data labeling task as a survey of questions about the tickets that we administer to a language model, generating a summary dataset.
The steps are: 1. Technical setup 2. Identifying data for review 3. Constructing questions about the data 4. Delivering the questions to language models 5. Analyzing the responses
Technical setup
Before running the code below please see instructions on:
Storing API Keys for the language models that you want to use
We also have a Starter Tutorial about EDSL basics.
[1]:
# ! pip install edsl
Selecting data for review
First we identify some data for review. Data can be created using the EDSL tools or imported from other sources. For purposes of this demo we import a set of hypothetical customer tickets for a transportation app:
[2]:
tickets = [
"I just realized I left my phone in the car on my last ride. Can you help me get it back?",
"I'm unhappy with my recent experience. The driver was very rude and unprofessional.",
"I was charged more than the estimated fare for my trip yesterday. Can you explain why?",
"The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.",
"My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment.",
"I had a great experience with my driver today! Very friendly and efficient service.",
"I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect.",
"The app keeps crashing every time I try to book a ride. Please fix this issue.",
"My driver was exceptional - safe driving, polite, and the car was spotless. Kudos!",
"I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.",
"The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service.",
"Impressed with the quick response to my ride request and the driver's professionalism.",
"I was charged for a ride I never took. Please refund me as soon as possible.",
"The promo code I tried to use didn't work. Can you assist with this?",
"There was a suspicious smell in the car, and I'm worried about hygiene standards.",
"My driver was very considerate, especially helping me with my luggage. Appreciate the great service!",
"The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.",
"I want to compliment my driver's excellent navigation and time management during rush hour.",
"The vehicle didn't match the description in the app. It was confusing and concerning.",
"I faced an issue with payment processing after my last ride. Can you look into this?",
]
Constructing questions about the data
Next we create some questions about the data. EDSL provides classes for a variety of common question types, including multiple choice, free text, checkbox, linear scale and many others. We import the question type classes that we want to use and then construct questions in the relevant templates. We use a {{ placeholder }} in each question text in order to parameterize the questions with the individual ticket contents. For more details about constructing questions, please see the Questions section of the docs.
[3]:
from edsl.questions import (
QuestionMultipleChoice,
QuestionCheckBox,
QuestionFreeText,
QuestionList,
QuestionYesNo,
QuestionLinearScale,
)
[4]:
question_issues = QuestionCheckBox(
question_name="issues",
question_text="Check all of the issues mentioned in this ticket: {{ ticket }}",
question_options=[
"safety",
"cleanliness",
"driver performance",
"GPS/route",
"lost item",
"other",
],
)
[5]:
question_primary_issue = QuestionFreeText(
question_name="primary_issue",
question_text="What is the primary issue in this ticket? Ticket: {{ ticket }}",
)
[6]:
question_accident = QuestionMultipleChoice(
question_name="accident",
question_text="If the primary issue in this ticket is safety, was there an accident where someone was hurt? Ticket: {{ ticket }}",
question_options=["Yes", "No", "Not applicable"],
)
[7]:
question_sentiment = QuestionMultipleChoice(
question_name="sentiment",
question_text="What is the sentiment of this ticket? Ticket: {{ ticket }}",
question_options=[
"Very positive",
"Somewhat positive",
"Neutral",
"Somewhat negative",
"Very negative",
],
)
[8]:
question_refund = QuestionYesNo(
question_name="refund",
question_text="Does the customer ask for a refund in this ticket? Ticket: {{ ticket }}",
)
[9]:
question_priority = QuestionLinearScale(
question_name="priority",
question_text="On a scale from 0 to 5, what is the priority level of this ticket? Ticket: {{ ticket }}",
question_options=[0, 1, 2, 3, 4, 5],
option_labels={0: "Lowest", 5: "Highest"},
)
Building a survey
We combine the questions into a survey in order to administer them together:
[10]:
from edsl import Survey
survey = Survey(
questions=[
question_issues,
question_primary_issue,
question_accident,
question_sentiment,
question_refund,
question_priority,
]
)
(Survey questions are administered asynchronously by default. To learn about adding conditional logic such as skip/stop rules and targeted memory, please see the Surveys section of the docs.)
We can review our questions in a readable format, or export them as a survey to use with human respondents or at other survey platforms:
[11]:
survey
[11]:
{
"questions": [
{
"question_name": "issues",
"question_text": "Check all of the issues mentioned in this ticket: {{ ticket }}",
"min_selections": null,
"max_selections": null,
"question_options": [
"safety",
"cleanliness",
"driver performance",
"GPS/route",
"lost item",
"other"
],
"question_type": "checkbox",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
},
{
"question_name": "primary_issue",
"question_text": "What is the primary issue in this ticket? Ticket: {{ ticket }}",
"question_type": "free_text",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
},
{
"question_name": "accident",
"question_text": "If the primary issue in this ticket is safety, was there an accident where someone was hurt? Ticket: {{ ticket }}",
"question_options": [
"Yes",
"No",
"Not applicable"
],
"question_type": "multiple_choice",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
},
{
"question_name": "sentiment",
"question_text": "What is the sentiment of this ticket? Ticket: {{ ticket }}",
"question_options": [
"Very positive",
"Somewhat positive",
"Neutral",
"Somewhat negative",
"Very negative"
],
"question_type": "multiple_choice",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
},
{
"question_name": "refund",
"question_text": "Does the customer ask for a refund in this ticket? Ticket: {{ ticket }}",
"question_options": [
"Yes",
"No"
],
"question_type": "yes_no",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
},
{
"question_name": "priority",
"question_text": "On a scale from 0 to 5, what is the priority level of this ticket? Ticket: {{ ticket }}",
"question_options": [
0,
1,
2,
3,
4,
5
],
"option_labels": {
"0": "Lowest",
"5": "Highest"
},
"question_type": "linear_scale",
"edsl_version": "0.1.23",
"edsl_class_name": "QuestionBase"
}
],
"memory_plan": {
"survey_question_names": [
"issues",
"primary_issue",
"accident",
"sentiment",
"refund",
"priority"
],
"survey_question_texts": [
"Check all of the issues mentioned in this ticket: {{ ticket }}",
"What is the primary issue in this ticket? Ticket: {{ ticket }}",
"If the primary issue in this ticket is safety, was there an accident where someone was hurt? Ticket: {{ ticket }}",
"What is the sentiment of this ticket? Ticket: {{ ticket }}",
"Does the customer ask for a refund in this ticket? Ticket: {{ ticket }}",
"On a scale from 0 to 5, what is the priority level of this ticket? Ticket: {{ ticket }}"
],
"data": {}
},
"rule_collection": {
"rules": [
{
"current_q": 0,
"expression": "True",
"next_q": 1,
"priority": -1,
"question_name_to_index": {
"issues": 0
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
},
{
"current_q": 1,
"expression": "True",
"next_q": 2,
"priority": -1,
"question_name_to_index": {
"issues": 0,
"primary_issue": 1
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
},
{
"current_q": 2,
"expression": "True",
"next_q": 3,
"priority": -1,
"question_name_to_index": {
"issues": 0,
"primary_issue": 1,
"accident": 2
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
},
{
"current_q": 3,
"expression": "True",
"next_q": 4,
"priority": -1,
"question_name_to_index": {
"issues": 0,
"primary_issue": 1,
"accident": 2,
"sentiment": 3
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
},
{
"current_q": 4,
"expression": "True",
"next_q": 5,
"priority": -1,
"question_name_to_index": {
"issues": 0,
"primary_issue": 1,
"accident": 2,
"sentiment": 3,
"refund": 4
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
},
{
"current_q": 5,
"expression": "True",
"next_q": 6,
"priority": -1,
"question_name_to_index": {
"issues": 0,
"primary_issue": 1,
"accident": 2,
"sentiment": 3,
"refund": 4,
"priority": 5
},
"before_rule": false,
"edsl_version": "0.1.23",
"edsl_class_name": "Rule"
}
],
"num_questions": 6
},
"question_groups": {},
"edsl_version": "0.1.23",
"edsl_class_name": "Survey"
}
Designing AI agents
A key feature of EDSL is the ability to create personas for AI agents that the language models are prompted to use in generating responses to the questions. This is done by passing a dictionary of traits to Agent objects:
[12]:
from edsl import Agent
agent = Agent(
traits={
"persona": "You are an expert customer service agent.",
"years_experience": 15,
}
)
Selecting language models
EDSL allows us to select the language models to use in generating results. To see all available models:
[13]:
from edsl import Model
Model.available()
[13]:
[['01-ai/Yi-34B-Chat', 'deep_infra', 0],
['Austism/chronos-hermes-13b-v2', 'deep_infra', 1],
['Gryphe/MythoMax-L2-13b', 'deep_infra', 2],
['Gryphe/MythoMax-L2-13b-turbo', 'deep_infra', 3],
['HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1', 'deep_infra', 4],
['Phind/Phind-CodeLlama-34B-v2', 'deep_infra', 5],
['bigcode/starcoder2-15b', 'deep_infra', 6],
['bigcode/starcoder2-15b-instruct-v0.1', 'deep_infra', 7],
['claude-3-haiku-20240307', 'anthropic', 8],
['claude-3-opus-20240229', 'anthropic', 9],
['claude-3-sonnet-20240229', 'anthropic', 10],
['codellama/CodeLlama-34b-Instruct-hf', 'deep_infra', 11],
['codellama/CodeLlama-70b-Instruct-hf', 'deep_infra', 12],
['cognitivecomputations/dolphin-2.6-mixtral-8x7b', 'deep_infra', 13],
['databricks/dbrx-instruct', 'deep_infra', 14],
['deepinfra/airoboros-70b', 'deep_infra', 15],
['gemini-pro', 'google', 16],
['google/codegemma-7b-it', 'deep_infra', 17],
['google/gemma-1.1-7b-it', 'deep_infra', 18],
['gpt-3.5-turbo', 'openai', 19],
['gpt-3.5-turbo-0125', 'openai', 20],
['gpt-3.5-turbo-0301', 'openai', 21],
['gpt-3.5-turbo-0613', 'openai', 22],
['gpt-3.5-turbo-1106', 'openai', 23],
['gpt-3.5-turbo-16k', 'openai', 24],
['gpt-3.5-turbo-16k-0613', 'openai', 25],
['gpt-3.5-turbo-instruct', 'openai', 26],
['gpt-3.5-turbo-instruct-0914', 'openai', 27],
['gpt-4', 'openai', 28],
['gpt-4-0125-preview', 'openai', 29],
['gpt-4-0613', 'openai', 30],
['gpt-4-1106-preview', 'openai', 31],
['gpt-4-1106-vision-preview', 'openai', 32],
['gpt-4-turbo', 'openai', 33],
['gpt-4-turbo-2024-04-09', 'openai', 34],
['gpt-4-turbo-preview', 'openai', 35],
['gpt-4-vision-preview', 'openai', 36],
['gpt-4o', 'openai', 37],
['gpt-4o-2024-05-13', 'openai', 38],
['lizpreciatior/lzlv_70b_fp16_hf', 'deep_infra', 39],
['llava-hf/llava-1.5-7b-hf', 'deep_infra', 40],
['meta-llama/Llama-2-13b-chat-hf', 'deep_infra', 41],
['meta-llama/Llama-2-70b-chat-hf', 'deep_infra', 42],
['meta-llama/Llama-2-7b-chat-hf', 'deep_infra', 43],
['meta-llama/Meta-Llama-3-70B-Instruct', 'deep_infra', 44],
['meta-llama/Meta-Llama-3-8B-Instruct', 'deep_infra', 45],
['microsoft/WizardLM-2-7B', 'deep_infra', 46],
['microsoft/WizardLM-2-8x22B', 'deep_infra', 47],
['mistralai/Mistral-7B-Instruct-v0.1', 'deep_infra', 48],
['mistralai/Mistral-7B-Instruct-v0.2', 'deep_infra', 49],
['mistralai/Mixtral-8x22B-Instruct-v0.1', 'deep_infra', 50],
['mistralai/Mixtral-8x22B-v0.1', 'deep_infra', 51],
['mistralai/Mixtral-8x7B-Instruct-v0.1', 'deep_infra', 52],
['openchat/openchat_3.5', 'deep_infra', 53]]
Here we select GPT 4 (which is also used by default if no model is specified for a survey):
[14]:
model = Model("gpt-4-1106-preview")
Conducting the analysis
With our data and questions we’re now ready to package our survey and deliver it to an AI. We do this by inserting the contents of each ticket into each question as an independent “scenario” for review, and then running the survey.
[15]:
from edsl import Scenario
scenarios = [Scenario({"ticket": t}) for t in tickets]
We run the survey by chaining the components with the by method and then calling the run method:
[17]:
results = survey.by(scenarios).by(agent).by(model).run()
Inspecting the results
EDSL comes with built-in methods for analyzing results. For more details on working with results, please see the Results section of the docs.
To inspect the components of results:
[18]:
results.columns
[18]:
['agent.agent_instruction',
'agent.agent_name',
'agent.persona',
'agent.years_experience',
'answer.accident',
'answer.issues',
'answer.primary_issue',
'answer.priority',
'answer.refund',
'answer.sentiment',
'comment.accident_comment',
'comment.issues_comment',
'comment.priority_comment',
'comment.refund_comment',
'comment.sentiment_comment',
'iteration.iteration',
'model.frequency_penalty',
'model.logprobs',
'model.max_tokens',
'model.model',
'model.presence_penalty',
'model.temperature',
'model.top_logprobs',
'model.top_p',
'prompt.accident_system_prompt',
'prompt.accident_user_prompt',
'prompt.issues_system_prompt',
'prompt.issues_user_prompt',
'prompt.primary_issue_system_prompt',
'prompt.primary_issue_user_prompt',
'prompt.priority_system_prompt',
'prompt.priority_user_prompt',
'prompt.refund_system_prompt',
'prompt.refund_user_prompt',
'prompt.sentiment_system_prompt',
'prompt.sentiment_user_prompt',
'question_options.accident_question_options',
'question_options.issues_question_options',
'question_options.primary_issue_question_options',
'question_options.priority_question_options',
'question_options.refund_question_options',
'question_options.sentiment_question_options',
'question_text.accident_question_text',
'question_text.issues_question_text',
'question_text.primary_issue_question_text',
'question_text.priority_question_text',
'question_text.refund_question_text',
'question_text.sentiment_question_text',
'question_type.accident_question_type',
'question_type.issues_question_type',
'question_type.primary_issue_question_type',
'question_type.priority_question_type',
'question_type.refund_question_type',
'question_type.sentiment_question_type',
'raw_model_response.accident_raw_model_response',
'raw_model_response.issues_raw_model_response',
'raw_model_response.primary_issue_raw_model_response',
'raw_model_response.priority_raw_model_response',
'raw_model_response.refund_raw_model_response',
'raw_model_response.sentiment_raw_model_response',
'scenario.edsl_class_name',
'scenario.edsl_version',
'scenario.ticket']
We can select just the responses to the questions to display:
[19]:
results.select(
"ticket", "issues", "primary_issue", "accident", "sentiment", "refund", "priority"
).print()
| scenario.ticket | answer.issues | answer.primary_issue | answer.accident | answer.sentiment | answer.refund | answer.priority |
|---|---|---|---|---|---|---|
| I just realized I left my phone in the car on my last ride. Can you help me get it back? | ['lost item'] | The primary issue is that the customer has left their phone in the car during their last ride and is seeking assistance to retrieve it. | Not applicable | Somewhat negative | No | 4 |
| I'm unhappy with my recent experience. The driver was very rude and unprofessional. | ['driver performance'] | The primary issue in this ticket is that the customer experienced rudeness and unprofessional behavior from a driver. | No | Very negative | No | 4 |
| I was charged more than the estimated fare for my trip yesterday. Can you explain why? | ['other'] | The primary issue in this ticket is that the customer was charged an amount exceeding the estimated fare for their trip and is seeking an explanation for the discrepancy. | Not applicable | Somewhat negative | No | 3 |
| The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training. | ['safety', 'driver performance'] | The primary issue is that the car seat provided was not properly installed, which led to concerns about the child's safety. The customer is requesting that drivers receive proper training on how to install car seats correctly. | No | Somewhat negative | No | 5 |
| My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment. | ['driver performance', 'GPS/route'] | The primary issue in the ticket is that the customer's driver took a longer route than necessary, which led to an increased fare. The customer is requesting a fare adjustment due to this inconvenience. | No | Somewhat negative | No | 3 |
| I had a great experience with my driver today! Very friendly and efficient service. | ['driver performance'] | There is no issue reported in this ticket. The customer is providing positive feedback about their great experience with the driver. | Not applicable | Very positive | No | 0 |
| I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect. | ['cleanliness'] | The primary issue in this ticket is the customer's dissatisfaction with the cleanliness of the vehicle, which did not meet their expected standard. | No | Somewhat negative | No | 3 |
| The app keeps crashing every time I try to book a ride. Please fix this issue. | ['other'] | The primary issue is that the app is crashing during the ride booking process. | Not applicable | Somewhat negative | No | 4 |
| My driver was exceptional - safe driving, polite, and the car was spotless. Kudos! | ['safety', 'cleanliness', 'driver performance'] | There is no issue reported in this ticket. The customer is providing positive feedback about their exceptional experience with the driver. | No | Very positive | No | 0 |
| I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately. | ['safety', 'driver performance'] | The primary issue in the ticket is that the customer felt unsafe due to the driver's erratic behavior during the ride. | No | Very negative | No | 5 |
| The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service. | ['driver performance', 'GPS/route'] | The primary issue in this ticket is that the driver refused to follow the customer's preferred route, which the customer believes is shorter, leading to dissatisfaction with the service provided. | No | Somewhat negative | No | 2 |
| Impressed with the quick response to my ride request and the driver's professionalism. | ['driver performance'] | There appears to be no issue in the ticket. The customer is expressing satisfaction with the quick response to their ride request and the driver's professionalism. | Not applicable | Very positive | No | 0 |
| I was charged for a ride I never took. Please refund me as soon as possible. | ['other'] | The primary issue in the ticket is that the customer has been charged for a ride they did not take and is requesting a prompt refund. | Not applicable | Very negative | Yes | 4 |
| The promo code I tried to use didn't work. Can you assist with this? | ['other'] | The primary issue is that the customer attempted to use a promo code which did not work, and they are requesting assistance to resolve this issue. | Not applicable | Somewhat negative | No | 2 |
| There was a suspicious smell in the car, and I'm worried about hygiene standards. | ['cleanliness', 'other'] | The primary issue in the ticket is a concern regarding a suspicious smell in the car, which has raised worries about the vehicle's hygiene standards. | No | Somewhat negative | No | 4 |
| My driver was very considerate, especially helping me with my luggage. Appreciate the great service! | ['driver performance'] | There is no issue reported in this ticket. The customer is expressing appreciation for the considerate service provided by the driver. | Not applicable | Very positive | No | 0 |
| The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location. | ['GPS/route'] | The primary issue in this ticket is that the app's GPS functionality is providing inaccurate directions, leading the driver to an incorrect pick-up location. | No | Somewhat negative | No | 4 |
| I want to compliment my driver's excellent navigation and time management during rush hour. | ['driver performance', 'GPS/route'] | The primary issue in this ticket is not a problem but a positive feedback. The customer wants to compliment their driver for excellent navigation and time management during rush hour. | Not applicable | Very positive | No | 0 |
| The vehicle didn't match the description in the app. It was confusing and concerning. | ['other'] | The primary issue in the ticket is that the vehicle provided did not match the description given in the app, which led to confusion and concern for the customer. | No | Somewhat negative | No | 3 |
| I faced an issue with payment processing after my last ride. Can you look into this? | ['other'] | The primary issue in the ticket is a problem with payment processing that occurred after the customer's last ride. | Not applicable | Somewhat negative | No | 4 |
We can apply some lables to our table:
[20]:
(
results.select(
"ticket",
"issues",
"primary_issue",
"accident",
"sentiment",
"refund",
"priority",
).print(
pretty_labels={
"scenario.ticket": "Ticket",
"answer.issues": "Issues",
"answer.primary_issue": "Primary issue",
"answer.accident": "Accident",
"answer.sentiment": "Sentiment",
"answer.refund": "Refund request",
"answer.priority": "Priority",
}
)
)
| Ticket | Issues | Primary issue | Accident | Sentiment | Refund request | Priority |
|---|---|---|---|---|---|---|
| I just realized I left my phone in the car on my last ride. Can you help me get it back? | ['lost item'] | The primary issue is that the customer has left their phone in the car during their last ride and is seeking assistance to retrieve it. | Not applicable | Somewhat negative | No | 4 |
| I'm unhappy with my recent experience. The driver was very rude and unprofessional. | ['driver performance'] | The primary issue in this ticket is that the customer experienced rudeness and unprofessional behavior from a driver. | No | Very negative | No | 4 |
| I was charged more than the estimated fare for my trip yesterday. Can you explain why? | ['other'] | The primary issue in this ticket is that the customer was charged an amount exceeding the estimated fare for their trip and is seeking an explanation for the discrepancy. | Not applicable | Somewhat negative | No | 3 |
| The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training. | ['safety', 'driver performance'] | The primary issue is that the car seat provided was not properly installed, which led to concerns about the child's safety. The customer is requesting that drivers receive proper training on how to install car seats correctly. | No | Somewhat negative | No | 5 |
| My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment. | ['driver performance', 'GPS/route'] | The primary issue in the ticket is that the customer's driver took a longer route than necessary, which led to an increased fare. The customer is requesting a fare adjustment due to this inconvenience. | No | Somewhat negative | No | 3 |
| I had a great experience with my driver today! Very friendly and efficient service. | ['driver performance'] | There is no issue reported in this ticket. The customer is providing positive feedback about their great experience with the driver. | Not applicable | Very positive | No | 0 |
| I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect. | ['cleanliness'] | The primary issue in this ticket is the customer's dissatisfaction with the cleanliness of the vehicle, which did not meet their expected standard. | No | Somewhat negative | No | 3 |
| The app keeps crashing every time I try to book a ride. Please fix this issue. | ['other'] | The primary issue is that the app is crashing during the ride booking process. | Not applicable | Somewhat negative | No | 4 |
| My driver was exceptional - safe driving, polite, and the car was spotless. Kudos! | ['safety', 'cleanliness', 'driver performance'] | There is no issue reported in this ticket. The customer is providing positive feedback about their exceptional experience with the driver. | No | Very positive | No | 0 |
| I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately. | ['safety', 'driver performance'] | The primary issue in the ticket is that the customer felt unsafe due to the driver's erratic behavior during the ride. | No | Very negative | No | 5 |
| The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service. | ['driver performance', 'GPS/route'] | The primary issue in this ticket is that the driver refused to follow the customer's preferred route, which the customer believes is shorter, leading to dissatisfaction with the service provided. | No | Somewhat negative | No | 2 |
| Impressed with the quick response to my ride request and the driver's professionalism. | ['driver performance'] | There appears to be no issue in the ticket. The customer is expressing satisfaction with the quick response to their ride request and the driver's professionalism. | Not applicable | Very positive | No | 0 |
| I was charged for a ride I never took. Please refund me as soon as possible. | ['other'] | The primary issue in the ticket is that the customer has been charged for a ride they did not take and is requesting a prompt refund. | Not applicable | Very negative | Yes | 4 |
| The promo code I tried to use didn't work. Can you assist with this? | ['other'] | The primary issue is that the customer attempted to use a promo code which did not work, and they are requesting assistance to resolve this issue. | Not applicable | Somewhat negative | No | 2 |
| There was a suspicious smell in the car, and I'm worried about hygiene standards. | ['cleanliness', 'other'] | The primary issue in the ticket is a concern regarding a suspicious smell in the car, which has raised worries about the vehicle's hygiene standards. | No | Somewhat negative | No | 4 |
| My driver was very considerate, especially helping me with my luggage. Appreciate the great service! | ['driver performance'] | There is no issue reported in this ticket. The customer is expressing appreciation for the considerate service provided by the driver. | Not applicable | Very positive | No | 0 |
| The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location. | ['GPS/route'] | The primary issue in this ticket is that the app's GPS functionality is providing inaccurate directions, leading the driver to an incorrect pick-up location. | No | Somewhat negative | No | 4 |
| I want to compliment my driver's excellent navigation and time management during rush hour. | ['driver performance', 'GPS/route'] | The primary issue in this ticket is not a problem but a positive feedback. The customer wants to compliment their driver for excellent navigation and time management during rush hour. | Not applicable | Very positive | No | 0 |
| The vehicle didn't match the description in the app. It was confusing and concerning. | ['other'] | The primary issue in the ticket is that the vehicle provided did not match the description given in the app, which led to confusion and concern for the customer. | No | Somewhat negative | No | 3 |
| I faced an issue with payment processing after my last ride. Can you look into this? | ['other'] | The primary issue in the ticket is a problem with payment processing that occurred after the customer's last ride. | Not applicable | Somewhat negative | No | 4 |
EDSL also comes with methods for accessing results as a dataframe or SQL table:
[21]:
df = results.to_pandas()
df
[21]:
| agent.agent_instruction | agent.agent_name | agent.persona | agent.years_experience | answer.accident | answer.issues | answer.primary_issue | answer.priority | answer.refund | answer.sentiment | ... | question_type.sentiment_question_type | raw_model_response.accident_raw_model_response | raw_model_response.issues_raw_model_response | raw_model_response.primary_issue_raw_model_response | raw_model_response.priority_raw_model_response | raw_model_response.refund_raw_model_response | raw_model_response.sentiment_raw_model_response | scenario.edsl_class_name | scenario.edsl_version | scenario.ticket | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['lost item'] | The primary issue is that the customer has lef... | 4 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIDVzpogKRTvred7xXgGLElAqn... | {'id': 'chatcmpl-9PuaIMwhphiISoyZIrdg7JeK5iwxk... | {'id': 'chatcmpl-9PuaIdoG3nuiXfY3ppOGXiN0V8uYV... | {'id': 'chatcmpl-9PuaI2S676vf1HFXBOEwoMkLamfm9... | {'id': 'chatcmpl-9PuaIgmAih5cbvg9P0P9MmUJlUUPx... | {'id': 'chatcmpl-9PuaIwQ4yDeHbCncrSfecKsjQJYCg... | Scenario | 0.1.23 | I just realized I left my phone in the car on ... |
| 1 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['driver performance'] | The primary issue in this ticket is that the c... | 4 | No | Very negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIw4uQEqZKstoPGvb5hJh3OAnV... | {'id': 'chatcmpl-9PuaIQHe3mPj1NHhIiDyZl2F1TBdY... | {'id': 'chatcmpl-9PuaISZkTYLiAYqM5hgXCsVuunIVy... | {'id': 'chatcmpl-9PuaIops5rP6vdZSXjsca0u93iEqs... | {'id': 'chatcmpl-9PuaIZ1ZpO4k9xf4WuXI4NQ8F28hV... | {'id': 'chatcmpl-9PuaIpYEYhp6mWGvZKqnJQfuIxWiN... | Scenario | 0.1.23 | I'm unhappy with my recent experience. The dri... |
| 2 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['other'] | The primary issue in this ticket is that the c... | 3 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIvrkrgQioEq9ckQphh3sF5hst... | {'id': 'chatcmpl-9PuaIIGvi2Te62Wun7iTzZWbWbTxB... | {'id': 'chatcmpl-9PuaIeNQPbWqNi6TsXLrwAUlzcXqM... | {'id': 'chatcmpl-9PuaINiBjHonmuO0HMOGgXRfoEas2... | {'id': 'chatcmpl-9PuaIUU15ZMQfSsIvAqWl8VUv6JUv... | {'id': 'chatcmpl-9PuaIItdwNGolYqNndxzUrejGpklv... | Scenario | 0.1.23 | I was charged more than the estimated fare for... |
| 3 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['safety', 'driver performance'] | The primary issue is that the car seat provide... | 5 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaI7Y7ySWH8VhxOOvuux2ywwz5v... | {'id': 'chatcmpl-9PuaIRsav26gGPVM75DAtyZJqD9T9... | {'id': 'chatcmpl-9PuaInEkqKtQCGLZHwayXVvQDQ1aU... | {'id': 'chatcmpl-9PuaIOQisWiaw71LsD3FtrE3U7QC4... | {'id': 'chatcmpl-9PuaIqddYIvmkQa04lknJ9CAyWZWD... | {'id': 'chatcmpl-9PuaIX3MMrGIk5DUHd8qoorNOqFUI... | Scenario | 0.1.23 | The car seat provided was not properly install... |
| 4 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['driver performance', 'GPS/route'] | The primary issue in the ticket is that the cu... | 3 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaICFuvncAkjriLxw2mezX1z0wj... | {'id': 'chatcmpl-9PuaI6GV47gMi6Q5v1u2ESnr2heqw... | {'id': 'chatcmpl-9PuaImGt2oMLpQU4UFrfgQcDd56Fm... | {'id': 'chatcmpl-9PuaIj7eHa86GS0lspcy9NY9ZGM21... | {'id': 'chatcmpl-9PuaIDgN1iAAnlHfq0bgviKFXkmQk... | {'id': 'chatcmpl-9PuaIgvJ97JjWD91C0NM6wnzDkdQO... | Scenario | 0.1.23 | My driver took a longer route than necessary, ... |
| 5 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['driver performance'] | There is no issue reported in this ticket. The... | 0 | No | Very positive | ... | multiple_choice | {'id': 'chatcmpl-9PuaIAE4yQWe9Q45hJviLHgqBQyPf... | {'id': 'chatcmpl-9PuaIFwSRgkO3VQQRvhfPi5hUhppj... | {'id': 'chatcmpl-9PuaI3OR6P9vDJZGz9C2i6CcmXnPu... | {'id': 'chatcmpl-9PuaITxsKnfMA15FlHu16MOWZx7Rh... | {'id': 'chatcmpl-9PuaIlZYlKP1jjzgaPJrf4U4vplso... | {'id': 'chatcmpl-9PuaIYW8bk0Za8qnWwNKLibD8vdZ8... | Scenario | 0.1.23 | I had a great experience with my driver today!... |
| 6 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['cleanliness'] | The primary issue in this ticket is the custom... | 3 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaI2EgcWVXS7KNO373LCbkizoE6... | {'id': 'chatcmpl-9PuaIA7DARDLt1Z3NQBNGvMf4Vheu... | {'id': 'chatcmpl-9PuaIAZftmRifNvwXdCkTOemGRNaR... | {'id': 'chatcmpl-9PuaIQ5SJyD2QcENuQW0Mb8DfmrbW... | {'id': 'chatcmpl-9PuaIHlqTv3TPpvGqYc23tje19t9O... | {'id': 'chatcmpl-9PuaIYacAzZw3MBMPFoeF0GDTc0wt... | Scenario | 0.1.23 | I'm concerned about the vehicle's cleanliness.... |
| 7 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['other'] | The primary issue is that the app is crashing ... | 4 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIcx6BNF62GziXx6bKM95YKatG... | {'id': 'chatcmpl-9PuaIk01WXIuM2BQqc2nSt2J9HTBv... | {'id': 'chatcmpl-9PuaInJ5AFrjFTuzlC7mfAAcvGCpl... | {'id': 'chatcmpl-9PuaIH9X1FZ07ljKG8T4x0p7glOCr... | {'id': 'chatcmpl-9PuaIZpUYzU9sLIbwhbIFpsymbNcY... | {'id': 'chatcmpl-9PuaIJEXfrNjB0Nu7K7xFIfqAPoV6... | Scenario | 0.1.23 | The app keeps crashing every time I try to boo... |
| 8 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['safety', 'cleanliness', 'driver performance'] | There is no issue reported in this ticket. The... | 0 | No | Very positive | ... | multiple_choice | {'id': 'chatcmpl-9PuaIIloYTIb0ktuGYHOwC6OHYhT8... | {'id': 'chatcmpl-9PuaI3itvW7HJu4w6nQgL6CB23oyu... | {'id': 'chatcmpl-9PuaIoMjeMhWzCd5QhU2v9OiIJ4N0... | {'id': 'chatcmpl-9PuaIzYJtxpwV4Z32c4VxrfcejnE9... | {'id': 'chatcmpl-9PuaKgw5tQl70DDfXXIUShEVtXUnn... | {'id': 'chatcmpl-9PuaIQCVg0IWuBqWv6PLXo0LImlak... | Scenario | 0.1.23 | My driver was exceptional - safe driving, poli... |
| 9 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['safety', 'driver performance'] | The primary issue in the ticket is that the cu... | 5 | No | Very negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaISw60nPw5z4WqeXvigYXCRqB9... | {'id': 'chatcmpl-9PuaIm5WmtJi3vae8w83TzC6JZmj3... | {'id': 'chatcmpl-9PuaInJFGbntLQ545D1ps83XiuApm... | {'id': 'chatcmpl-9PuaITFrkU4Q94WxlNCu8vM3cKz1N... | {'id': 'chatcmpl-9PuaIoMxaX8GNUge0UnAyaypOTQcY... | {'id': 'chatcmpl-9PuaIrMAi3K9vWRT5zkiwvh7nKOfr... | Scenario | 0.1.23 | I felt unsafe during my ride due to the driver... |
| 10 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['driver performance', 'GPS/route'] | The primary issue in this ticket is that the d... | 2 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIebbCk1lN9DDZHv0RB78DnUuL... | {'id': 'chatcmpl-9PuaIwo9J0ptw0okIIgPTsxy8k6Wr... | {'id': 'chatcmpl-9PuaI50JmcNOEgNZZpO1no8Tbm0Z0... | {'id': 'chatcmpl-9PuaI3jWlfbHxLG4f5RK4ybdimlCU... | {'id': 'chatcmpl-9PuaItR63bbevBccYWhc3qs8wlShv... | {'id': 'chatcmpl-9PuaIsc4UzNUZkg0BoxsYxnTdNOLK... | Scenario | 0.1.23 | The driver refused to follow my preferred rout... |
| 11 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['driver performance'] | There appears to be no issue in the ticket. Th... | 0 | No | Very positive | ... | multiple_choice | {'id': 'chatcmpl-9PuaILd87INTS5sOExfoMz1Gk6Ai4... | {'id': 'chatcmpl-9PuaImOLiUKV5ZdAGdq1NdJRVF6Hf... | {'id': 'chatcmpl-9PuaIjQGJE7rm6HgR9JJ9ERylbSnA... | {'id': 'chatcmpl-9PuaIXZ5K6ai2lYyZNcuJ4eR251F7... | {'id': 'chatcmpl-9PuaI5ysSUPsIXrCNRhSk0ZsoFZXP... | {'id': 'chatcmpl-9PuaI0HcLhD4UrYVljSGgnRiKdRNm... | Scenario | 0.1.23 | Impressed with the quick response to my ride r... |
| 12 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['other'] | The primary issue in the ticket is that the cu... | 4 | Yes | Very negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaILRkHVMw9fRbByhnVKbLqp1Z5... | {'id': 'chatcmpl-9PuaIoLS6EvANJcHU2qvqAeKKf9XJ... | {'id': 'chatcmpl-9PuaIjUyyyRVwOk6ztRKWoFPQovzq... | {'id': 'chatcmpl-9PuaIm1MWyAXsGkGuBVfV6JIqrKyn... | {'id': 'chatcmpl-9PuaIClbbgNwCMKkxDC2SAepx0O9X... | {'id': 'chatcmpl-9PuaIvo0VtlT2HcEBylk5BRR4nixL... | Scenario | 0.1.23 | I was charged for a ride I never took. Please ... |
| 13 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['other'] | The primary issue is that the customer attempt... | 2 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaI9iuFT4Rrw4n2IljKTnJVr9xk... | {'id': 'chatcmpl-9PuaI9mK3lCfxsBvzIh4OZY6tiGfh... | {'id': 'chatcmpl-9PuaITldolgb8xIaoCMgQEPA3Gn7Z... | {'id': 'chatcmpl-9PuaII4emF0FNuF5QRzbXTfcDJv60... | {'id': 'chatcmpl-9PuaIePybNjGUWh3qeUQCmOkmSSgc... | {'id': 'chatcmpl-9PuaI9CeMe6JjKAHnXDDAdij5VEcJ... | Scenario | 0.1.23 | The promo code I tried to use didn't work. Can... |
| 14 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['cleanliness', 'other'] | The primary issue in the ticket is a concern r... | 4 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaI688JyafBsDlzttmWTUE4wlCp... | {'id': 'chatcmpl-9PuaIvElwf7ZCDyvyqwYLy0XBSkmL... | {'id': 'chatcmpl-9PuaIbmPzIiTWmeqabSYO1ztFJkm5... | {'id': 'chatcmpl-9PuaIvUTH57STsXEHziFqJiPvF6Xl... | {'id': 'chatcmpl-9PuaIs66blLsyQGcjdF9gXGSE65t5... | {'id': 'chatcmpl-9PuaIv8BvPKtpe18hrcjLw3gKLClC... | Scenario | 0.1.23 | There was a suspicious smell in the car, and I... |
| 15 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['driver performance'] | There is no issue reported in this ticket. The... | 0 | No | Very positive | ... | multiple_choice | {'id': 'chatcmpl-9PuaILF85PXNtcf2qqDl3iQuBZNvn... | {'id': 'chatcmpl-9PuaICNOPQkoFelQpGVzrRNxLHm4M... | {'id': 'chatcmpl-9PuaIgzgcwW1kmmtqSpLYvNpuTG0w... | {'id': 'chatcmpl-9PuaIT5ESOVLT5oNysUtOTekS9EgB... | {'id': 'chatcmpl-9PuaIbYXykbqHaCa0rfESmwVMLezU... | {'id': 'chatcmpl-9PuaIx1VO9wL4JfxUEzMcXjmKaxVb... | Scenario | 0.1.23 | My driver was very considerate, especially hel... |
| 16 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['GPS/route'] | The primary issue in this ticket is that the a... | 4 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaID7Rd7Bu93bgG9zOyM3gG9nDl... | {'id': 'chatcmpl-9PuaIoVHxhCSq9FniTNYh3FNebpNZ... | {'id': 'chatcmpl-9PuaIocFgKNLBaXbuWkt6WhVK16hx... | {'id': 'chatcmpl-9PuaI7kby79qZBvVCF0vRTNhgzPPJ... | {'id': 'chatcmpl-9PuaIPUk7U0H6wYGzBoR1bygqeTsb... | {'id': 'chatcmpl-9PuaIXU9T2EWlW15zpdqEZVvUulaA... | Scenario | 0.1.23 | The app's GPS seems inaccurate. It directed th... |
| 17 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['driver performance', 'GPS/route'] | The primary issue in this ticket is not a prob... | 0 | No | Very positive | ... | multiple_choice | {'id': 'chatcmpl-9PuaIoxOlvkU2ixqitrxjqwGTeL0i... | {'id': 'chatcmpl-9PuaIjDrPqUIew8TQdEgMtx4vlE4c... | {'id': 'chatcmpl-9PuaIkpQKy2AIAUFX4rLTtet7Js7W... | {'id': 'chatcmpl-9PuaIFP3v0Z8Nn3h2jreNMnklZ06i... | {'id': 'chatcmpl-9PuaIAvusWH954QISQ9HZghpNqa6Q... | {'id': 'chatcmpl-9PuaIvO5iOMiOEgNAAxONUvVWYzXZ... | Scenario | 0.1.23 | I want to compliment my driver's excellent nav... |
| 18 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | No | ['other'] | The primary issue in the ticket is that the ve... | 3 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaIxkomzCF3iY85XT9CMW6UNlFY... | {'id': 'chatcmpl-9PuaI3x5koCtLnsfCkxZj7efNSDHW... | {'id': 'chatcmpl-9PuaIsVqx5EKdA7sCncHqtTfqTgrN... | {'id': 'chatcmpl-9PuaI171YpPLm0OdbSwMF61PW3XQ1... | {'id': 'chatcmpl-9PuaIb5owPnKLXx52cS1iMVCpVFvT... | {'id': 'chatcmpl-9PuaIdAJFOQAu5qtRZZyXo55qkEKQ... | Scenario | 0.1.23 | The vehicle didn't match the description in th... |
| 19 | You are answering questions as if you were a h... | Agent_0 | You are an expert customer service agent. | 15 | Not applicable | ['other'] | The primary issue in the ticket is a problem w... | 4 | No | Somewhat negative | ... | multiple_choice | {'id': 'chatcmpl-9PuaI4Swm8YH0ZLxruk9H5rees4pp... | {'id': 'chatcmpl-9PuaIZ1SlHqWVz2IaWwgWFKLYbUQy... | {'id': 'chatcmpl-9PuaI7H7RcFdZcSX4Png5IcLcNLmI... | {'id': 'chatcmpl-9PuaIl6VU5R6pO6pa8aR8qe4CB9QP... | {'id': 'chatcmpl-9PuaIYLzpCkfKbd3qFejCsOUwVMOA... | {'id': 'chatcmpl-9PuaIYfQAVmyLrqcTuoSMuu99WSHE... | Scenario | 0.1.23 | I faced an issue with payment processing after... |
20 rows × 63 columns
We can also access results as a SQL table:
[22]:
results.sql("select * from self", shape="wide")
[22]:
| accident | accident_comment | accident_question_options | accident_question_text | accident_question_type | accident_raw_model_response | accident_system_prompt | accident_user_prompt | agent_instruction | agent_name | ... | sentiment_question_text | sentiment_question_type | sentiment_raw_model_response | sentiment_system_prompt | sentiment_user_prompt | temperature | ticket | top_logprobs | top_p | years_experience | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | Not applicable | The ticket is regarding a lost phone, which is... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIDVzpogKRTvred7xXgGLElAqn... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIwQ4yDeHbCncrSfecKsjQJYCg... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I just realized I left my phone in the car on ... | 3 | 1 | 15 |
| 1 | No | The ticket mentions an issue with the driver b... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIw4uQEqZKstoPGvb5hJh3OAnV... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIpYEYhp6mWGvZKqnJQfuIxWiN... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I'm unhappy with my recent experience. The dri... | 3 | 1 | 15 |
| 2 | Not applicable | The ticket is regarding a fare discrepancy, no... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIvrkrgQioEq9ckQphh3sF5hst... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIItdwNGolYqNndxzUrejGpklv... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I was charged more than the estimated fare for... | 3 | 1 | 15 |
| 3 | No | No accident was reported, only a concern for c... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaI7Y7ySWH8VhxOOvuux2ywwz5v... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIX3MMrGIk5DUHd8qoorNOqFUI... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The car seat provided was not properly install... | 3 | 1 | 15 |
| 4 | No | The primary issue mentioned in the ticket does... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaICFuvncAkjriLxw2mezX1z0wj... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIgvJ97JjWD91C0NM6wnzDkdQO... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | My driver took a longer route than necessary, ... | 3 | 1 | 15 |
| 5 | Not applicable | The ticket mentions a positive experience with... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIAE4yQWe9Q45hJviLHgqBQyPf... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIYW8bk0Za8qnWwNKLibD8vdZ8... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I had a great experience with my driver today!... | 3 | 1 | 15 |
| 6 | No | The primary issue mentioned in the ticket rela... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaI2EgcWVXS7KNO373LCbkizoE6... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIYacAzZw3MBMPFoeF0GDTc0wt... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I'm concerned about the vehicle's cleanliness.... | 3 | 1 | 15 |
| 7 | Not applicable | The ticket is regarding a technical issue with... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIcx6BNF62GziXx6bKM95YKatG... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIJEXfrNjB0Nu7K7xFIfqAPoV6... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The app keeps crashing every time I try to boo... | 3 | 1 | 15 |
| 8 | No | The ticket indicates a positive experience wit... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIIloYTIb0ktuGYHOwC6OHYhT8... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIQCVg0IWuBqWv6PLXo0LImlak... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | My driver was exceptional - safe driving, poli... | 3 | 1 | 15 |
| 9 | No | The ticket mentions a feeling of unsafety due ... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaISw60nPw5z4WqeXvigYXCRqB9... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIrMAi3K9vWRT5zkiwvh7nKOfr... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I felt unsafe during my ride due to the driver... | 3 | 1 | 15 |
| 10 | No | The issue reported does not indicate that an a... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIebbCk1lN9DDZHv0RB78DnUuL... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIsc4UzNUZkg0BoxsYxnTdNOLK... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The driver refused to follow my preferred rout... | 3 | 1 | 15 |
| 11 | Not applicable | The ticket does not mention any accidents or s... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaILd87INTS5sOExfoMz1Gk6Ai4... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaI0HcLhD4UrYVljSGgnRiKdRNm... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | Impressed with the quick response to my ride r... | 3 | 1 | 15 |
| 12 | Not applicable | The issue described in the ticket is related t... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaILRkHVMw9fRbByhnVKbLqp1Z5... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIvo0VtlT2HcEBylk5BRR4nixL... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I was charged for a ride I never took. Please ... | 3 | 1 | 15 |
| 13 | Not applicable | The issue described in the ticket is related t... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaI9iuFT4Rrw4n2IljKTnJVr9xk... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaI9CeMe6JjKAHnXDDAdij5VEcJ... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The promo code I tried to use didn't work. Can... | 3 | 1 | 15 |
| 14 | No | The ticket mentions a suspicious smell in the ... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaI688JyafBsDlzttmWTUE4wlCp... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIv8BvPKtpe18hrcjLw3gKLClC... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | There was a suspicious smell in the car, and I... | 3 | 1 | 15 |
| 15 | Not applicable | The ticket does not mention any accidents or s... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaILF85PXNtcf2qqDl3iQuBZNvn... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIx1VO9wL4JfxUEzMcXjmKaxVb... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | My driver was very considerate, especially hel... | 3 | 1 | 15 |
| 16 | No | The ticket describes an issue with GPS inaccur... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaID7Rd7Bu93bgG9zOyM3gG9nDl... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIXU9T2EWlW15zpdqEZVvUulaA... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The app's GPS seems inaccurate. It directed th... | 3 | 1 | 15 |
| 17 | Not applicable | The ticket is a compliment to the driver, indi... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIoxOlvkU2ixqitrxjqwGTeL0i... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIvO5iOMiOEgNAAxONUvVWYzXZ... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I want to compliment my driver's excellent nav... | 3 | 1 | 15 |
| 18 | No | The ticket indicates a mismatch between the ve... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaIxkomzCF3iY85XT9CMW6UNlFY... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIdAJFOQAu5qtRZZyXo55qkEKQ... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | The vehicle didn't match the description in th... | 3 | 1 | 15 |
| 19 | Not applicable | The issue described in the ticket pertains to ... | ['Yes', 'No', 'Not applicable'] | If the primary issue in this ticket is safety,... | multiple_choice | {'id': 'chatcmpl-9PuaI4Swm8YH0ZLxruk9H5rees4pp... | You are answering questions as if you were a h... | You are being asked the following question: If... | You are answering questions as if you were a h... | Agent_0 | ... | What is the sentiment of this ticket? Ticket: ... | multiple_choice | {'id': 'chatcmpl-9PuaIYfQAVmyLrqcTuoSMuu99WSHE... | You are answering questions as if you were a h... | You are being asked the following question: Wh... | 0.5 | I faced an issue with payment processing after... | 3 | 1 | 15 |
20 rows × 63 columns
To export results to a CSV file:
[23]:
results.to_csv("data_labeling_example.csv")