Universal Data Tool
Search…
Building and Labeling Datasets
Importing Data
The Format .udt.json
Machine Learning
Integrate with Any Web Page
Train your Workforce
Getting Started with UDT Courses
Create Training Courses for Labeling Datasets
This video has everything you need to know!
Creating a Course
You'll want to have a dataset before you begin! No labels are needed.
You can create UDT courses online in a couple easy steps. First navigate to universaldatatool.com/courses, then click "Create a Course".
Create a Course
Now you just need to upload your dataset. You can drag and drop or select your dataset here. The samples will be used to construct tests!
Upload the Dataset
You should now be inside the course editor!
Editing a Course
Every course has an Instructor URL and a Student URL. Your Instructor URL has a secret code in it that allows you to come back, view passing students and edit the course. So don't lose it! After you create a course it should be in your address bar.
Here's an example of an Instructor URL:
And here's an example of a Student URL:
See how the Instructor URL is longer and has an "edit_key"?
We can now add sections, tests, exercises, quizzes and explanations to create a full training course.
Creating a Course Item
Anytime you see this icon, you can create a new course item.
Create a new course item
After clicking the Icon, you can select a new item to create
Markdown Descriptions
It's just markdown! Put whatever you want inside to explain the motivation of your dataset or specific details. Maybe start with a general overview, then do a deep dive in a second section.
Question / Quizzes
Quizzes are used to make sure that your labelers read the preceding paragraph.
A quiz quickly tests the knowledge of your labelers.
Tests / Exercises
Tests and exercises are the bread and butter of a UDT course. They make sure your labelers actually know how to label with real examples.
1. Select the samples
Most people just pick samples randomly :shrug:
2. Edit the Solution
Here you can add solutions to the dataset. If your dataset already has labels, they'll automatically be imported. Your labelers will be tested on these solutions!
Label some data!
3. Configure the Test
Configure your test with instructions, make it a practice exercise etc.
Sharing a Course with Labelers
Share your course using the "Go to Course" button at the top of the page. That will take you to a page that you can send to all of your labelers.
After a student successfully completes the course, they'll be prompted to enter their email. Their email will now appear in the "Passing Students" dialog.
View the passing students
Running On-Premise
​