-
Notifications
You must be signed in to change notification settings - Fork 3.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
streaming export #9084
base: develop
Are you sure you want to change the base?
streaming export #9084
Conversation
bdda455
to
fa321ce
Compare
a98e1b0
to
27465f3
Compare
fa321ce
to
e45b4c1
Compare
e45b4c1
to
9524e7a
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## develop #9084 +/- ##
===========================================
+ Coverage 73.32% 73.34% +0.01%
===========================================
Files 449 449
Lines 45875 45882 +7
Branches 3915 3915
===========================================
+ Hits 33640 33652 +12
+ Misses 12235 12230 -5
🚀 New features to boost your workflow:
|
def595c
to
1830690
Compare
# Conflicts: # cvat/requirements/base.in # cvat/requirements/base.txt
# Conflicts: # cvat/requirements/base.in # cvat/requirements/base.txt
# Conflicts: # cvat/apps/dataset_manager/bindings.py # cvat/apps/dataset_manager/formats/coco.py # cvat/apps/dataset_manager/formats/imagenet.py # cvat/apps/dataset_manager/formats/yolo.py # cvat/requirements/base.in # cvat/requirements/base.txt
I've noticed export performance degradation in streaming mode for COCO formats, about 2-3x in my cases. As I understand it, the problem is in |
|
Motivation and context
When we export a dataset, all annotations are kept in RAM. It may be a problem if they are large.
Enabling streaming export for task or job data, for yolo formats
depends on cvat-ai/datumaro#81, cvat-ai/datumaro#90, cvat-ai/datumaro#94
How has this been tested?
Checklist
develop
branchLicense
Feel free to contact the maintainers if that's a concern.