Data labeling

This notebook shows how to conduct data labeling and content analysis using EDSL, an open-source library for simulating surveys, experiments and other research with AI agents and large language models.

Using a dataset of mock customer service tickets as an example, we demonstrate how to:

1. Import data into EDSL

2. Create questions about the data

3. Design an AI agent to answer the questions

4. Select a language model to generate responses

5. Analyze results as a formatted dataset

This workflow can be visualized as follows:

Technical setup

Before running the code below please ensure that you have completed setup:

• Install EDSL.

• Create a Coop account and activate remote inference OR store your own API Keys for language models that you want to use.

Our Starter Tutorial also provides examples of EDSL basic components.

Selecting data for review

First we identify some data for review. Data can be created using the EDSL tools or imported from other sources. For purposes of this demo we import a set of hypothetical customer tickets for a transportation app:

tickets = [
    "I just realized I left my phone in the car on my last ride. Can you help me get it back?",
    "I'm unhappy with my recent experience. The driver was very rude and unprofessional.",
    "I was charged more than the estimated fare for my trip yesterday. Can you explain why?",
    "The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.",
    "My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment.",
    "I had a great experience with my driver today! Very friendly and efficient service.",
    "I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect.",
    "The app keeps crashing every time I try to book a ride. Please fix this issue.",
    "My driver was exceptional - safe driving, polite, and the car was spotless. Kudos!",
    "I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.",
    "The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service.",
    "Impressed with the quick response to my ride request and the driver's professionalism.",
    "I was charged for a ride I never took. Please refund me as soon as possible.",
    "The promo code I tried to use didn't work. Can you assist with this?",
    "There was a suspicious smell in the car, and I'm worried about hygiene standards.",
    "My driver was very considerate, especially helping me with my luggage. Appreciate the great service!",
    "The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.",
    "I want to compliment my driver's excellent navigation and time management during rush hour.",
    "The vehicle didn't match the description in the app. It was confusing and concerning.",
    "I faced an issue with payment processing after my last ride. Can you look into this?",
]

Constructing questions about the data

Next we create some questions about the data. EDSL provides a variety of question types that we can choose from based on the form of the response that we want to get back from the model (multiple choice, free text, checkbox, linear scale, etc.). Learn more about question types.

Note that we use a {{ placeholder }} in each question text in order to parameterize the questions with the individual ticket contents in the next step:

from edsl import (
    QuestionMultipleChoice,
    QuestionCheckBox,
    QuestionFreeText,
    QuestionList,
    QuestionYesNo,
    QuestionLinearScale,
)

question_issues = QuestionCheckBox(
    question_name="issues",
    question_text="Check all of the issues mentioned in this ticket: {{ ticket }}",
    question_options=[
        "safety",
        "cleanliness",
        "driver performance",
        "GPS/route",
        "lost item",
        "other",
    ],
)

question_primary_issue = QuestionFreeText(
    question_name="primary_issue",
    question_text="What is the primary issue in this ticket? Ticket: {{ ticket }}",
)

question_accident = QuestionMultipleChoice(
    question_name="accident",
    question_text="If the primary issue in this ticket is safety, was there an accident where someone was hurt? Ticket: {{ ticket }}",
    question_options=["Yes", "No", "Not applicable"],
)

question_sentiment = QuestionMultipleChoice(
    question_name="sentiment",
    question_text="What is the sentiment of this ticket? Ticket: {{ ticket }}",
    question_options=[
        "Very positive",
        "Somewhat positive",
        "Neutral",
        "Somewhat negative",
        "Very negative",
    ],
)

question_refund = QuestionYesNo(
    question_name="refund",
    question_text="Does the customer ask for a refund in this ticket? Ticket: {{ ticket }}",
)

question_priority = QuestionLinearScale(
    question_name="priority",
    question_text="On a scale from 0 to 5, what is the priority level of this ticket? Ticket: {{ ticket }}",
    question_options=[0, 1, 2, 3, 4, 5],
    option_labels={0: "Lowest", 5: "Highest"},
)

Building a survey

We combine the questions into a survey in order to administer them together:

from edsl import Survey

survey = Survey(
    questions=[
        question_issues,
        question_primary_issue,
        question_accident,
        question_sentiment,
        question_refund,
        question_priority,
    ]
)

Survey questions are administered asynchronously by default. Learn more about adding conditional logic and memory to your survey.

We can review our questions in a readable format, or export them as a survey to use with human respondents or at other survey platforms:

survey

Survey # questions: 6; question_name list: ['issues', 'primary_issue', 'accident', 'sentiment', 'refund', 'priority'];

	question_name	use_code	question_type	question_text	option_labels	question_options
0	issues	True	checkbox	Check all of the issues mentioned in this ticket: {{ ticket }}	nan	['safety', 'cleanliness', 'driver performance', 'GPS/route', 'lost item', 'other']
1	primary_issue	nan	free_text	What is the primary issue in this ticket? Ticket: {{ ticket }}	nan	nan
2	accident	nan	multiple_choice	If the primary issue in this ticket is safety, was there an accident where someone was hurt? Ticket: {{ ticket }}	nan	['Yes', 'No', 'Not applicable']
3	sentiment	nan	multiple_choice	What is the sentiment of this ticket? Ticket: {{ ticket }}	nan	['Very positive', 'Somewhat positive', 'Neutral', 'Somewhat negative', 'Very negative']
4	refund	nan	yes_no	Does the customer ask for a refund in this ticket? Ticket: {{ ticket }}	nan	['No', 'Yes']
5	priority	nan	linear_scale	On a scale from 0 to 5, what is the priority level of this ticket? Ticket: {{ ticket }}	{0: 'Lowest', 5: 'Highest'}	[0, 1, 2, 3, 4, 5]

Designing AI agents

A key feature of EDSL is the ability to create personas for AI agents that the language models are prompted to use in generating responses to the questions. This is done by passing a dictionary of traits to Agent objects:

from edsl import Agent

agent = Agent(
    traits={
        "persona": "You are an expert customer service agent.",
        "years_experience": 15,
    }
)
agent

Agent

	key	value
0	traits:persona	You are an expert customer service agent.
1	traits:years_experience	15

Selecting language models

EDSL allows us to select the language models to use in generating results. See the `model pricing page <>`__ for pricing and performance information for available models.

Here we select gpt-4o (if no model is specified, the default model is used – run Model() to verify the current default model):

from edsl import Model

model = Model("gpt-4o")
model

LanguageModel

	key	value
0	model	gpt-4o
1	parameters:temperature	0.500000
2	parameters:max_tokens	1000
3	parameters:top_p	1
4	parameters:frequency_penalty	0
5	parameters:presence_penalty	0
6	parameters:logprobs	False
7	parameters:top_logprobs	3
8	inference_service	openai

Adding data to the questions

We add the contents of each ticket into each question as an independent “scenario” for review. This allows us to create versions of the questions for each job post and deliver them to the model all at once:

from edsl import ScenarioList

scenarios = ScenarioList.from_list("ticket", tickets)
scenarios

ScenarioList scenarios: 20; keys: ['ticket'];

	ticket
0	I just realized I left my phone in the car on my last ride. Can you help me get it back?
1	I'm unhappy with my recent experience. The driver was very rude and unprofessional.
2	I was charged more than the estimated fare for my trip yesterday. Can you explain why?
3	The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.
4	My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment.
5	I had a great experience with my driver today! Very friendly and efficient service.
6	I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect.
7	The app keeps crashing every time I try to book a ride. Please fix this issue.
8	My driver was exceptional - safe driving, polite, and the car was spotless. Kudos!
9	I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.
10	The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service.
11	Impressed with the quick response to my ride request and the driver's professionalism.
12	I was charged for a ride I never took. Please refund me as soon as possible.
13	The promo code I tried to use didn't work. Can you assist with this?
14	There was a suspicious smell in the car, and I'm worried about hygiene standards.
15	My driver was very considerate, especially helping me with my luggage. Appreciate the great service!
16	The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.
17	I want to compliment my driver's excellent navigation and time management during rush hour.
18	The vehicle didn't match the description in the app. It was confusing and concerning.
19	I faced an issue with payment processing after my last ride. Can you look into this?

Running the survey

We run the survey by adding the scenarios, agent and model with the by() method and then calling the run() method:

results = survey.by(scenarios).by(agent).by(model).run()

▼ Job Status (2025-02-07 20:21:43)

Job UUID	ee348b94-dd2e-4d55-ba30-7edc6e6597b5
Progress Bar URL	https://www.expectedparrot.com/home/remote-job-progress/ee348b94-dd2e-4d55-ba30-7edc6e6597b5
Exceptions Report URL	None
Results UUID	d024aa83-7fcc-48c2-b2fd-1a0c702f8f9b
Results URL	https://www.expectedparrot.com/content/d024aa83-7fcc-48c2-b2fd-1a0c702f8f9b

✓Current Status: Job completed and Results stored on Coop: https://www.expectedparrot.com/content/d024aa83-7fcc-48c2-b2fd-1a0c702f8f9b

This generates a formatted dataset of Results that includes information about all the components, including the prompts and responses. We can see a list of all the components:

results.columns

	0
0	agent.agent_index
1	agent.agent_instruction
2	agent.agent_name
3	agent.persona
4	agent.years_experience
5	answer.accident
6	answer.issues
7	answer.primary_issue
8	answer.priority
9	answer.refund
10	answer.sentiment
11	cache_keys.accident_cache_key
12	cache_keys.issues_cache_key
13	cache_keys.primary_issue_cache_key
14	cache_keys.priority_cache_key
15	cache_keys.refund_cache_key
16	cache_keys.sentiment_cache_key
17	cache_used.accident_cache_used
18	cache_used.issues_cache_used
19	cache_used.primary_issue_cache_used
20	cache_used.priority_cache_used
21	cache_used.refund_cache_used
22	cache_used.sentiment_cache_used
23	comment.accident_comment
24	comment.issues_comment
25	comment.primary_issue_comment
26	comment.priority_comment
27	comment.refund_comment
28	comment.sentiment_comment
29	generated_tokens.accident_generated_tokens
30	generated_tokens.issues_generated_tokens
31	generated_tokens.primary_issue_generated_tokens
32	generated_tokens.priority_generated_tokens
33	generated_tokens.refund_generated_tokens
34	generated_tokens.sentiment_generated_tokens
35	iteration.iteration
36	model.frequency_penalty
37	model.inference_service
38	model.logprobs
39	model.max_tokens
40	model.model
41	model.model_index
42	model.presence_penalty
43	model.temperature
44	model.top_logprobs
45	model.top_p
46	prompt.accident_system_prompt
47	prompt.accident_user_prompt
48	prompt.issues_system_prompt
49	prompt.issues_user_prompt
50	prompt.primary_issue_system_prompt
51	prompt.primary_issue_user_prompt
52	prompt.priority_system_prompt
53	prompt.priority_user_prompt
54	prompt.refund_system_prompt
55	prompt.refund_user_prompt
56	prompt.sentiment_system_prompt
57	prompt.sentiment_user_prompt
58	question_options.accident_question_options
59	question_options.issues_question_options
60	question_options.primary_issue_question_options
61	question_options.priority_question_options
62	question_options.refund_question_options
63	question_options.sentiment_question_options
64	question_text.accident_question_text
65	question_text.issues_question_text
66	question_text.primary_issue_question_text
67	question_text.priority_question_text
68	question_text.refund_question_text
69	question_text.sentiment_question_text
70	question_type.accident_question_type
71	question_type.issues_question_type
72	question_type.primary_issue_question_type
73	question_type.priority_question_type
74	question_type.refund_question_type
75	question_type.sentiment_question_type
76	raw_model_response.accident_cost
77	raw_model_response.accident_one_usd_buys
78	raw_model_response.accident_raw_model_response
79	raw_model_response.issues_cost
80	raw_model_response.issues_one_usd_buys
81	raw_model_response.issues_raw_model_response
82	raw_model_response.primary_issue_cost
83	raw_model_response.primary_issue_one_usd_buys
84	raw_model_response.primary_issue_raw_model_response
85	raw_model_response.priority_cost
86	raw_model_response.priority_one_usd_buys
87	raw_model_response.priority_raw_model_response
88	raw_model_response.refund_cost
89	raw_model_response.refund_one_usd_buys
90	raw_model_response.refund_raw_model_response
91	raw_model_response.sentiment_cost
92	raw_model_response.sentiment_one_usd_buys
93	raw_model_response.sentiment_raw_model_response
94	scenario.scenario_index
95	scenario.ticket

Analyzing results

EDSL comes with built-in methods for analyzing results. Here we filter, sort, select and print components in a table:

(
    results
    .filter("priority in [4, 5]")
    .sort_by("issues", "sentiment")
    .select("ticket", "issues", "primary_issue", "accident", "sentiment", "refund", "priority")
)

	scenario.ticket	answer.issues	answer.primary_issue	answer.accident	answer.sentiment	answer.refund	answer.priority
0	There was a suspicious smell in the car, and I'm worried about hygiene standards.	['cleanliness', 'other']	The primary issue in this ticket is a concern about hygiene standards due to a suspicious smell in the car. The customer is worried that the smell might indicate a lack of cleanliness or possible contamination. Addressing this concern would involve investigating the source of the smell and ensuring the vehicle meets hygiene standards.	No	Somewhat negative	No	4
1	I'm unhappy with my recent experience. The driver was very rude and unprofessional.	['driver performance']	The primary issue in this ticket is the behavior of the driver, who was described as rude and unprofessional. Addressing this concern would involve investigating the incident further, reaching out to the customer for more details, and taking appropriate action to ensure such behavior is not repeated.	No	Very negative	No	4
2	The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.	['driver performance', 'GPS/route']	The primary issue in this ticket is that the app's GPS is inaccurate, which resulted in directing the driver to the wrong pick-up location. This is a critical functionality problem that needs to be addressed to ensure the app provides accurate navigation and location services.	Not applicable	Somewhat negative	No	4
3	I just realized I left my phone in the car on my last ride. Can you help me get it back?	['lost item']	The primary issue in this ticket is that the customer left their phone in the car during their last ride and needs assistance in retrieving it.	Not applicable	Somewhat negative	No	4
4	The app keeps crashing every time I try to book a ride. Please fix this issue.	['other']	The primary issue in this ticket is that the app crashes whenever the user attempts to book a ride. This is causing a disruption in their ability to use the service, and they are requesting a fix for this problem.	Not applicable	Somewhat negative	No	4
5	I was charged for a ride I never took. Please refund me as soon as possible.	['other']	The primary issue in this ticket is an incorrect charge. The customer was charged for a ride they claim they never took, and they are requesting a refund for this charge.	Not applicable	Somewhat negative	Yes	4
6	The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.	['safety', 'driver performance']	The primary issue in this ticket is the improper installation of the car seat by the driver, which made the customer feel that their child's safety was at risk. The customer is requesting that drivers receive proper training to ensure car seats are installed correctly.	No	Very negative	No	5
7	I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.	['safety', 'driver performance']	The primary issue in this ticket is the customer's feeling of being unsafe due to the driver's erratic behavior during the ride. This is a serious concern that needs to be addressed promptly to ensure the safety and comfort of passengers.	Not applicable	Very negative	No	5

We can apply some lables to our table:

(
    results.select(
        "ticket",
        "issues",
        "primary_issue",
        "accident",
        "sentiment",
        "refund",
        "priority",
    ).print(
        pretty_labels={
            "scenario.ticket": "Ticket",
            "answer.issues": "Issues",
            "answer.primary_issue": "Primary issue",
            "answer.accident": "Accident",
            "answer.sentiment": "Sentiment",
            "answer.refund": "Refund request",
            "answer.priority": "Priority",
        }
    )
)

	Ticket	Issues	Primary issue	Accident	Sentiment	Refund request	Priority
0	I just realized I left my phone in the car on my last ride. Can you help me get it back?	['lost item']	The primary issue in this ticket is that the customer left their phone in the car during their last ride and needs assistance in retrieving it.	Not applicable	Somewhat negative	No	4
1	I'm unhappy with my recent experience. The driver was very rude and unprofessional.	['driver performance']	The primary issue in this ticket is the behavior of the driver, who was described as rude and unprofessional. Addressing this concern would involve investigating the incident further, reaching out to the customer for more details, and taking appropriate action to ensure such behavior is not repeated.	No	Very negative	No	4
2	I was charged more than the estimated fare for my trip yesterday. Can you explain why?	['other']	The primary issue in this ticket is a discrepancy between the estimated fare and the actual amount charged for the user's trip. The customer is seeking an explanation for why they were charged more than the estimated fare provided.	Not applicable	Somewhat negative	No	3
3	The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.	['safety', 'driver performance']	The primary issue in this ticket is the improper installation of the car seat by the driver, which made the customer feel that their child's safety was at risk. The customer is requesting that drivers receive proper training to ensure car seats are installed correctly.	No	Very negative	No	5
4	My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment.	['driver performance', 'GPS/route']	The primary issue in this ticket is a request for a fare adjustment due to the driver taking a longer route than necessary, which resulted in a higher fare for the customer.	Not applicable	Somewhat negative	No	2
5	I had a great experience with my driver today! Very friendly and efficient service.	['driver performance']	The ticket you provided doesn't seem to indicate an issue. Instead, it appears to be positive feedback about a great experience with a driver who provided friendly and efficient service. If there's anything else you'd like to address or need assistance with, feel free to let me know!	Not applicable	Very positive	No	0
6	I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect.	['cleanliness']	The primary issue in this ticket is the cleanliness of the vehicle not meeting the customer's expected standard. The customer is expressing concern about the condition in which the vehicle was presented to them.	No	Somewhat negative	No	2
7	The app keeps crashing every time I try to book a ride. Please fix this issue.	['other']	The primary issue in this ticket is that the app crashes whenever the user attempts to book a ride. This is causing a disruption in their ability to use the service, and they are requesting a fix for this problem.	Not applicable	Somewhat negative	No	4
8	My driver was exceptional - safe driving, polite, and the car was spotless. Kudos!	['safety', 'cleanliness', 'driver performance']	This ticket doesn't seem to have an issue. Instead, it is a positive feedback about the driver's exceptional service, highlighting safe driving, politeness, and a clean car. It's always great to receive such commendations!	Not applicable	Very positive	No	0
9	I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.	['safety', 'driver performance']	The primary issue in this ticket is the customer's feeling of being unsafe due to the driver's erratic behavior during the ride. This is a serious concern that needs to be addressed promptly to ensure the safety and comfort of passengers.	Not applicable	Very negative	No	5
10	The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service.	['driver performance', 'GPS/route']	The primary issue in this ticket is the driver's refusal to follow the customer's preferred route, which the customer believes is shorter. This has led to the customer's dissatisfaction with the service.	Not applicable	Very negative	No	2
11	Impressed with the quick response to my ride request and the driver's professionalism.	['driver performance']	The ticket you provided doesn't seem to indicate any issue. In fact, it appears to be a positive feedback highlighting the quick response to the ride request and the driver's professionalism. If there is an underlying concern or issue not mentioned, please provide additional details so I can assist you further.	Not applicable	Very positive	No	0
12	I was charged for a ride I never took. Please refund me as soon as possible.	['other']	The primary issue in this ticket is an incorrect charge. The customer was charged for a ride they claim they never took, and they are requesting a refund for this charge.	Not applicable	Somewhat negative	Yes	4
13	The promo code I tried to use didn't work. Can you assist with this?	['other']	The primary issue in this ticket is that the customer is experiencing a problem with a promotional code that they attempted to use, which did not work as expected. The customer is seeking assistance to resolve this issue.	Not applicable	Somewhat negative	No	2
14	There was a suspicious smell in the car, and I'm worried about hygiene standards.	['cleanliness', 'other']	The primary issue in this ticket is a concern about hygiene standards due to a suspicious smell in the car. The customer is worried that the smell might indicate a lack of cleanliness or possible contamination. Addressing this concern would involve investigating the source of the smell and ensuring the vehicle meets hygiene standards.	No	Somewhat negative	No	4
15	My driver was very considerate, especially helping me with my luggage. Appreciate the great service!	['driver performance']	The primary issue in this ticket is actually not an issue at all. It seems to be a positive feedback or compliment regarding the driver's service. The customer appreciates the driver's considerate behavior and assistance with their luggage.	Not applicable	Very positive	No	0
16	The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.	['driver performance', 'GPS/route']	The primary issue in this ticket is that the app's GPS is inaccurate, which resulted in directing the driver to the wrong pick-up location. This is a critical functionality problem that needs to be addressed to ensure the app provides accurate navigation and location services.	Not applicable	Somewhat negative	No	4
17	I want to compliment my driver's excellent navigation and time management during rush hour.	['driver performance', 'GPS/route']	The primary issue in this ticket is not a complaint or problem but rather a positive feedback or compliment. The customer is expressing appreciation for the driver's excellent navigation and time management skills during rush hour.	Not applicable	Very positive	No	0
18	The vehicle didn't match the description in the app. It was confusing and concerning.	['other']	The primary issue in this ticket is that the vehicle provided did not match the description given in the app. This discrepancy led to confusion and concern for the customer. Addressing this issue would involve ensuring that the app's vehicle descriptions are accurate and up-to-date to prevent similar situations in the future.	Not applicable	Somewhat negative	No	3
19	I faced an issue with payment processing after my last ride. Can you look into this?	['other']	The primary issue in this ticket is a problem with payment processing following the customer's last ride. The customer is requesting assistance to investigate and resolve the payment issue.	Not applicable	Somewhat negative	No	3

EDSL also comes with methods for accessing results as a dataframe or SQL table:

df = (
    results
    .select(
        "issues",
        "primary_issue",
        "accident",
        "sentiment",
        "refund",
        "priority"
    )
    .to_pandas(remove_prefix=True)
)
df

	issues	primary_issue	accident	sentiment	refund	priority
0	['lost item']	The primary issue in this ticket is that the c...	Not applicable	Somewhat negative	No	4
1	['driver performance']	The primary issue in this ticket is the behavi...	No	Very negative	No	4
2	['other']	The primary issue in this ticket is a discrepa...	Not applicable	Somewhat negative	No	3
3	['safety', 'driver performance']	The primary issue in this ticket is the improp...	No	Very negative	No	5
4	['driver performance', 'GPS/route']	The primary issue in this ticket is a request ...	Not applicable	Somewhat negative	No	2
5	['driver performance']	The ticket you provided doesn't seem to indica...	Not applicable	Very positive	No	0
6	['cleanliness']	The primary issue in this ticket is the cleanl...	No	Somewhat negative	No	2
7	['other']	The primary issue in this ticket is that the a...	Not applicable	Somewhat negative	No	4
8	['safety', 'cleanliness', 'driver performance']	This ticket doesn't seem to have an issue. Ins...	Not applicable	Very positive	No	0
9	['safety', 'driver performance']	The primary issue in this ticket is the custom...	Not applicable	Very negative	No	5
10	['driver performance', 'GPS/route']	The primary issue in this ticket is the driver...	Not applicable	Very negative	No	2
11	['driver performance']	The ticket you provided doesn't seem to indica...	Not applicable	Very positive	No	0
12	['other']	The primary issue in this ticket is an incorre...	Not applicable	Somewhat negative	Yes	4
13	['other']	The primary issue in this ticket is that the c...	Not applicable	Somewhat negative	No	2
14	['cleanliness', 'other']	The primary issue in this ticket is a concern ...	No	Somewhat negative	No	4
15	['driver performance']	The primary issue in this ticket is actually n...	Not applicable	Very positive	No	0
16	['driver performance', 'GPS/route']	The primary issue in this ticket is that the a...	Not applicable	Somewhat negative	No	4
17	['driver performance', 'GPS/route']	The primary issue in this ticket is not a comp...	Not applicable	Very positive	No	0
18	['other']	The primary issue in this ticket is that the v...	Not applicable	Somewhat negative	No	3
19	['other']	The primary issue in this ticket is a problem ...	Not applicable	Somewhat negative	No	3

We can also access results as a SQL table:

results.sql("""
select ticket, issues, primary_issue, accident, sentiment, refund, priority
from self
""")

	ticket	issues	primary_issue	accident	sentiment	refund	priority
0	I just realized I left my phone in the car on my last ride. Can you help me get it back?	['lost item']	The primary issue in this ticket is that the customer left their phone in the car during their last ride and needs assistance in retrieving it.	Not applicable	Somewhat negative	No	4
1	I'm unhappy with my recent experience. The driver was very rude and unprofessional.	['driver performance']	The primary issue in this ticket is the behavior of the driver, who was described as rude and unprofessional. Addressing this concern would involve investigating the incident further, reaching out to the customer for more details, and taking appropriate action to ensure such behavior is not repeated.	No	Very negative	No	4
2	I was charged more than the estimated fare for my trip yesterday. Can you explain why?	['other']	The primary issue in this ticket is a discrepancy between the estimated fare and the actual amount charged for the user's trip. The customer is seeking an explanation for why they were charged more than the estimated fare provided.	Not applicable	Somewhat negative	No	3
3	The car seat provided was not properly installed, and I felt my child was at risk. Please ensure driver training.	['safety', 'driver performance']	The primary issue in this ticket is the improper installation of the car seat by the driver, which made the customer feel that their child's safety was at risk. The customer is requesting that drivers receive proper training to ensure car seats are installed correctly.	No	Very negative	No	5
4	My driver took a longer route than necessary, resulting in a higher fare. I request a fare adjustment.	['driver performance', 'GPS/route']	The primary issue in this ticket is a request for a fare adjustment due to the driver taking a longer route than necessary, which resulted in a higher fare for the customer.	Not applicable	Somewhat negative	No	2
5	I had a great experience with my driver today! Very friendly and efficient service.	['driver performance']	The ticket you provided doesn't seem to indicate an issue. Instead, it appears to be positive feedback about a great experience with a driver who provided friendly and efficient service. If there's anything else you'd like to address or need assistance with, feel free to let me know!	Not applicable	Very positive	No	0
6	I'm concerned about the vehicle's cleanliness. It was not up to the standard I expect.	['cleanliness']	The primary issue in this ticket is the cleanliness of the vehicle not meeting the customer's expected standard. The customer is expressing concern about the condition in which the vehicle was presented to them.	No	Somewhat negative	No	2
7	The app keeps crashing every time I try to book a ride. Please fix this issue.	['other']	The primary issue in this ticket is that the app crashes whenever the user attempts to book a ride. This is causing a disruption in their ability to use the service, and they are requesting a fix for this problem.	Not applicable	Somewhat negative	No	4
8	My driver was exceptional - safe driving, polite, and the car was spotless. Kudos!	['safety', 'cleanliness', 'driver performance']	This ticket doesn't seem to have an issue. Instead, it is a positive feedback about the driver's exceptional service, highlighting safe driving, politeness, and a clean car. It's always great to receive such commendations!	Not applicable	Very positive	No	0
9	I felt unsafe during my ride due to the driver's erratic behavior. This needs to be addressed immediately.	['safety', 'driver performance']	The primary issue in this ticket is the customer's feeling of being unsafe due to the driver's erratic behavior during the ride. This is a serious concern that needs to be addressed promptly to ensure the safety and comfort of passengers.	Not applicable	Very negative	No	5
10	The driver refused to follow my preferred route, which is shorter. I'm not satisfied with the service.	['driver performance', 'GPS/route']	The primary issue in this ticket is the driver's refusal to follow the customer's preferred route, which the customer believes is shorter. This has led to the customer's dissatisfaction with the service.	Not applicable	Very negative	No	2
11	Impressed with the quick response to my ride request and the driver's professionalism.	['driver performance']	The ticket you provided doesn't seem to indicate any issue. In fact, it appears to be a positive feedback highlighting the quick response to the ride request and the driver's professionalism. If there is an underlying concern or issue not mentioned, please provide additional details so I can assist you further.	Not applicable	Very positive	No	0
12	I was charged for a ride I never took. Please refund me as soon as possible.	['other']	The primary issue in this ticket is an incorrect charge. The customer was charged for a ride they claim they never took, and they are requesting a refund for this charge.	Not applicable	Somewhat negative	Yes	4
13	The promo code I tried to use didn't work. Can you assist with this?	['other']	The primary issue in this ticket is that the customer is experiencing a problem with a promotional code that they attempted to use, which did not work as expected. The customer is seeking assistance to resolve this issue.	Not applicable	Somewhat negative	No	2
14	There was a suspicious smell in the car, and I'm worried about hygiene standards.	['cleanliness', 'other']	The primary issue in this ticket is a concern about hygiene standards due to a suspicious smell in the car. The customer is worried that the smell might indicate a lack of cleanliness or possible contamination. Addressing this concern would involve investigating the source of the smell and ensuring the vehicle meets hygiene standards.	No	Somewhat negative	No	4
15	My driver was very considerate, especially helping me with my luggage. Appreciate the great service!	['driver performance']	The primary issue in this ticket is actually not an issue at all. It seems to be a positive feedback or compliment regarding the driver's service. The customer appreciates the driver's considerate behavior and assistance with their luggage.	Not applicable	Very positive	No	0
16	The app's GPS seems inaccurate. It directed the driver to the wrong pick-up location.	['driver performance', 'GPS/route']	The primary issue in this ticket is that the app's GPS is inaccurate, which resulted in directing the driver to the wrong pick-up location. This is a critical functionality problem that needs to be addressed to ensure the app provides accurate navigation and location services.	Not applicable	Somewhat negative	No	4
17	I want to compliment my driver's excellent navigation and time management during rush hour.	['driver performance', 'GPS/route']	The primary issue in this ticket is not a complaint or problem but rather a positive feedback or compliment. The customer is expressing appreciation for the driver's excellent navigation and time management skills during rush hour.	Not applicable	Very positive	No	0
18	The vehicle didn't match the description in the app. It was confusing and concerning.	['other']	The primary issue in this ticket is that the vehicle provided did not match the description given in the app. This discrepancy led to confusion and concern for the customer. Addressing this issue would involve ensuring that the app's vehicle descriptions are accurate and up-to-date to prevent similar situations in the future.	Not applicable	Somewhat negative	No	3
19	I faced an issue with payment processing after my last ride. Can you look into this?	['other']	The primary issue in this ticket is a problem with payment processing following the customer's last ride. The customer is requesting assistance to investigate and resolve the payment issue.	Not applicable	Somewhat negative	No	3

To export results to a CSV file:

results.to_csv("data_labeling_example.csv")

File written to data_labeling_example.csv

Posting content to the Coop

We can post any objects to the Coop, including this notebook. Objects can be updated or modified at your Coop account, and shared with others or stored privately (default visibility is unlisted):

results.push(description = "Customer service tickets data labeling example", visibility="public")

{'description': 'Customer service tickets data labeling example',
 'object_type': 'results',
 'url': 'https://www.expectedparrot.com/content/4e8c7d9a-5308-477f-ab77-753d92ef3b9c',
 'uuid': '4e8c7d9a-5308-477f-ab77-753d92ef3b9c',
 'version': '0.1.43.dev1',
 'visibility': 'public'}

survey.push(description = "Customer service tickets data labeling example survey", visibility="public")

{'description': 'Customer service tickets data labeling example survey',
 'object_type': 'survey',
 'url': 'https://www.expectedparrot.com/content/6a455202-bd14-46d3-b1c4-09422cb954a0',
 'uuid': '6a455202-bd14-46d3-b1c4-09422cb954a0',
 'version': '0.1.43.dev1',
 'visibility': 'public'}

We can post this notebook as well:

from edsl import Notebook

n = Notebook(path="data_labeling_example.ipynb")

info = n.push(description="Data labeling example", visibility="public")
info

{'description': 'Data labeling example',
 'object_type': 'notebook',
 'url': 'https://www.expectedparrot.com/content/c7327ffc-2a10-4d87-af8d-ca3c7bce81de',
 'uuid': 'c7327ffc-2a10-4d87-af8d-ca3c7bce81de',
 'version': '0.1.43.dev1',
 'visibility': 'public'}

To update an object at the Coop:

n = Notebook(path="data_labeling_example.ipynb") # resave

n.patch(uuid = info["uuid"], value = n)

{'status': 'success'}