Getting Started with UDT Courses
Create Training Courses for Labeling Datasets
Last updated
Create Training Courses for Labeling Datasets
Last updated
You'll want to have a dataset before you begin! No labels are needed.
You can create UDT courses online in a couple easy steps. First navigate to universaldatatool.com/courses, then click "Create a Course".
Now you just need to upload your dataset. You can drag and drop or select your dataset here. The samples will be used to construct tests!
You should now be inside the course editor!
Every course has an Instructor URL and a Student URL. Your Instructor URL has a secret code in it that allows you to come back, view passing students and edit the course. So don't lose it! After you create a course it should be in your address bar.
Here's an example of an Instructor URL:
And here's an example of a Student URL:
https://universaldatatool.com/courses/course/8f55e988-e2ba-4411-8540-dcd5fd96592d
See how the Instructor URL is longer and has an "edit_key"?
We can now add sections, tests, exercises, quizzes and explanations to create a full training course.
Anytime you see this icon, you can create a new course item.
It's just markdown! Put whatever you want inside to explain the motivation of your dataset or specific details. Maybe start with a general overview, then do a deep dive in a second section.
Quizzes are used to make sure that your labelers read the preceding paragraph.
Tests and exercises are the bread and butter of a UDT course. They make sure your labelers actually know how to label with real examples.
Here you can add solutions to the dataset. If your dataset already has labels, they'll automatically be imported. Your labelers will be tested on these solutions!
Configure your test with instructions, make it a practice exercise etc.
Share your course using the "Go to Course" button at the top of the page. That will take you to a page that you can send to all of your labelers.
After a student successfully completes the course, they'll be prompted to enter their email. Their email will now appear in the "Passing Students" dialog.
Check out the github repository for on-premise instructions!
