In the first two parts of this article series, we discovered the cost of annotating images and videos yourself or with an in-house team. This part investigates the finances and resources you need to outsource the data annotation to the labeling service.
However, let's first revisit our practical scenario: Imagine a leading robotics scientist developing a smart home assistant to distinguish between dirt and valuable objects in a home environment. Life's chaos often includes scattered toys, misplaced glasses, pet fur, and god knows what else. The proposed robot aims to clean efficiently and assist in locating misplaced items. Such functionality could benefit the elderly by helping them keep track of their possessions, for example. So, there is a niche for such products.
As the project's lead, you are instrumental in guiding a compact research team that has gathered a dataset of 100,000 images, each depicting different room settings with items scattered across the floor. According to publicly available data, this dataset size is typical for robotics projects, ranging from thousands to millions of images.
With an average of 23 objects per image, the task involves annotating approximately 2.3 million objects. This series of articles explores various strategies for managing this large-scale annotation challenge, including do-it-yourself approaches, forming an in-house team, outsourcing, and utilizing crowdsourcing techniques.
Welcome to the third part of our series, which explores the costs of outsourcing data annotation to cover the scientist's labeling needs.
Let's start with a brief introduction and a statement that all data labeling companies operate similarly, with some variations that can significantly impact the quality of their labeling services. The devil is in the details. And CVAT.ai is not an exception. If the named scientist comes to us before jumping into the work, we will request some information from him and his team.
To be precise, this is how the whole workflow will look, separated by stage and with time estimations. It might differ for different companies, so we are talking from our experience.
We are not shy to state that our experience is vast and one of the best in the market, as we not only provide data labeling services but also own our data annotation platform. For clients, this means that we are flexible and can continuously adjust CVAT to make the annotation and validation process more efficient. Our clients can use the same platform internally and easily extend annotations. They also just log in to see how the data annotation process is going for them.
But enough about us, let's see what annotation stages are there.
We commit to initiating a PoC within one day of data reception and will provide detailed estimates and calculations within 3-5 days, depending on the project scope. Our initial project budget assessment is conducted with a high degree of accuracy. According to our experience, the final project cost typically deviates from the initial estimate by at most 10%.
Document processing on our end will be completed within a week, barring any delays from the client. We immediately begin training and data annotation for expedited projects, bypassing bureaucratic delays.
Most projects reach completion within one month.
We guarantee high-quality results to our clients because, before committing to specific obligations, we conduct experiments that help us understand the results we can deliver and how to improve them.
We take full responsibility for a quality check; we can offer the following services for better results:
Final validation and the conclusive report from our end will be completed within one week.
Following our previous article, in case there are no client delays and unexpected events, the whole process for the described project will take approximately 50 work days, 10 weeks, or 2.3 months. Of course, it depends on each case's requirements and circumstances.
By entrusting us with your project, you commission a high-quality service with a pre-defined and documented guaranteed outcome. The client's role is limited to observing the process, accepting recommended changes from our side, reviewing the delivered data, and providing feedback on the results of the validated work. We take on all internal processes and guarantee the project's quality and timely delivery.
Well, that’s a tricky question because the price heavily depends on the amount of data and the specific needs: the quality, the type of annotation, deadlines, and many more.
Let’s use data publicly available online to estimate the cost of annotating 2,300,000 objects or 100,000 images. However, here's the issue—labeling service providers often lack transparency, and there aren't many published prices. Thus, we can only rely on fragments of information from sources like KILI Technology or Mindkosh to make our estimates. The number will usually be above $300,000 because semantic segmentation, used for this task, is one of the most expensive annotation types for now.
But how much will it cost if the client comes to CVAT.ai? We used a flexible approach when we needed this amount of data to be annotated. Our pricing is built on the following assumptions:
.
The final cost of annotating 2,300,000 objects in CVAT.ai depends on the chosen approach. Using the "Per Object" method, the initial pricing begins at a set rate per unit. Due to the large volume, discounts ranging from 5% to 30% will be applied, reflecting our commitment to building long-term partnerships. By utilizing the highest discount tier, the total cost for annotating all objects will be approximately $225,400. This is an approximation, and the final price may vary based on the client's specific needs. Regardless of the exact cost, the results will be of the highest quality and delivered promptly.
In general, you should expect the outsourcing price to be more than 1.5 times the cost of a potential in-house data annotation team. Hiring your data annotation team is one of the ways to achieve a better price while maintaining high quality. Read You hire annotators and annotate with your team for tips.
In summary, outsourcing your data annotation tasks to a professional service offers significant benefits in terms of time efficiency, quality assurance, and overall project management. While costs can vary based on project specifics, CVAT.ai provides a flexible pricing model that caters to different needs, ensuring high-quality results within a reasonable budget. With discounts available for larger volumes, we can offer competitive pricing without compromising quality.
Ready to label data with CVAT.ai? Email us: labeling@cvat.ai!
Ensure you have all the necessary information—download our detailed takeaway now!
Not a CVAT.ai user? Click through and sign up here
Do not want to miss updates and news? Have any questions? Join our community: