Getting Started with UDT Courses
Create Training Courses for Labeling Datasets
This video has everything you need to know!
You'll want to have a dataset before you begin! No labels are needed.
You can create UDT courses online in a couple easy steps. First navigate to universaldatatool.com/courses, then click "Create a Course".
Create a Course
Now you just need to upload your dataset. You can drag and drop or select your dataset here. The samples will be used to construct tests!
Upload the Dataset
You should now be inside the course editor!
Every course has an Instructor URL and a Student URL. Your Instructor URL has a secret code in it that allows you to come back, view passing students and edit the course. So don't lose it! After you create a course it should be in your address bar.
Here's an example of an Instructor URL:
And here's an example of a Student URL:
See how the Instructor URL is longer and has an "edit_key"?
We can now add sections, tests, exercises, quizzes and explanations to create a full training course.
Anytime you see this icon, you can create a new course item.
Create a new course item
After clicking the Icon, you can select a new item to create
It's just markdown! Put whatever you want inside to explain the motivation of your dataset or specific details. Maybe start with a general overview, then do a deep dive in a second section.
Quizzes are used to make sure that your labelers read the preceding paragraph.
A quiz quickly tests the knowledge of your labelers.
Tests and exercises are the bread and butter of a UDT course. They make sure your labelers actually know how to label with real examples.
Most people just pick samples randomly :shrug:
Here you can add solutions to the dataset. If your dataset already has labels, they'll automatically be imported. Your labelers will be tested on these solutions!
Label some data!
Configure your test with instructions, make it a practice exercise etc.
Share your course using the "Go to Course" button at the top of the page. That will take you to a page that you can send to all of your labelers.
After a student successfully completes the course, they'll be prompted to enter their email. Their email will now appear in the "Passing Students" dialog.
View the passing students