OpenMMLab

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

976f399ea2 [Refactor] Refactor detection dataset metainfo to lowercase and update detection metric logics (#98) * [Refactor] Refactor detection dataset metainfo to lowercase * minor fix * update * support keep coco eval information and support load CLASSES to avoid BC * update typehint and docstring * add logger in cocodetection * add RELATION_MATRIX to avoid bc-breaking * Update mmeval/metrics/coco_detection.py Co-authored-by: RangiLyu <lyuchqi@gmail.com> * fix comments * empty log level info->warning * default log level change to INFO * fix comments * Update mmeval/metrics/coco_detection.py Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com> * fix comments * fix comments * fix logic * fix typo * add comments for get_classes * suppport logger * update ut * add requiorements * update requirements * using rich to print table * Update mmeval/metrics/coco_detection.py Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com> * fix comments * rename test coco detection ut * add print results flag * minor fix * Update mmeval/metrics/coco_detection.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/oid_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/voc_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> --------- Co-authored-by: RangiLyu <lyuchqi@gmail.com> Co-authored-by: Qian Zhao <112053249+C1rN09@users.noreply.github.com> Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
a9cf49b16b [Feature] Add CharRecallPrecision for OCR Task (#96) * [Feature] Adapt MMEval for CharRecallPersion WordAccuracy OneMinusNDE * fix comment * add api doc * fix doc comment * fix comment * fix comment
Compare 2 commits »

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

2cae3884b4 [Refactor] Refactor single and multi label metrics (#81) * refactor single and multi label metrics * fix according to comments * minor fix * minor fix * minor fix * minor fix * fix bc-breaking

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

9f01f47f69 Make scipy as a runtime dependency (#109) * make scipy as a runtime dependency * fix as comments

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

250c4bcd3f [Feature] Add logger argument in BaseMetric (#102) * add logger in BaseMetric * clean all metrics to use self.logger provided by BaseMetric * fix as comments * fix as comments * fix lint
95a431f656 [Fix] CircleCI fail due to plum-dispatch v2.0.0 (#108)
a03e046897 [Feature] Add WordAccuracy for OCR Task (#94) * [Feature] Add WordAccuracy for OCR Task * add api and fix comment * fix doc comment * fix comment * fix comment
a05c685a65 [Feature] Support NIQE (#80) * support niqe * add ut * fix typo * fix video niqe * fix comments * rename * fix comments * add docs * fix ut * update comments * update comments * update comments * update comments * update comments * add data to wheele package * update comments * update comments --------- Co-authored-by: C1rN09 <zhaoqian@pjlab.org.cn>
2c60fa0787 [Feature] Add KeypointNME metric (#93) * [Feat] Add KeypointNME * Update nme metric, examples and docs * Update examples, tests and assertions * Update support_matrix doc * Restore support_matrix doc * Update comments & examples according to comments * Remove unnecessary checks * Add checks for `norm_item` * Update list format * Update unit test * Rename parameters * Changes according to comments * fix lint --------- Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Compare 10 commits »

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

cf34dbcef3 [Refactor] Rename metrics (#83) * refactor(all): rename metrics * add deprecation warning * refine example code in __getattr__
f1c8677a88 [Enhancement] Update the test case style of PCKAccuracy (#68) * update test_pck_accuracy.py * add more test case
42f0bb44ca Use official isort (#86)
5bd89db264 [Feature] Add ROUGE metric (#72) * Add lowercase super parameter * Add lowercase super parameter * Add lowercase super parameter * Add lowercase super parameter
Compare 4 commits »

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

7a12a708c2 [Fix] Upgrade the version of isort to fix lint error (#85) * [Fix] Upgrade the version of isort to fix lint error * isort 5.12.0 does not support python3.7

1 year ago

OpenMMLab synced commits to main at OpenMMLab/mmeval from mirror

d7846cd5a8 [Feature] Add DOTAMeanAP metric (#65) * add dota_map * add dota_map docstrings * modify some docstrings * modify some docstrings * add rotated iou calculation with mmcv backend * modify some function names * Update mmeval/metrics/dota_map.py change log warning level from info to debug to avoid warning repeatly Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * implement filter_by_bboxes_area as a class method * implement filter_by_bboxes_area as a class method * Update mmeval/metrics/dota_map.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * modify function name from filter_by_bboxes_area to _filter_by_bboxes_area * fix a bug thta occurs when mmcv is installed * add qbox support * modify docstrings for quadrilateral boxes support * Apply suggestions from code review * fix lint * Update mmeval/metrics/dota_map.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Update mmeval/metrics/dota_map.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Update mmeval/metrics/voc_map.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * modify DOTAMeanAP docstrings * modify VOCMeanAP docstrings * add DOTAMeanAP to metrics.rst * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * add docstring in mmeval/metrics/utils/bbox_overlaps_rotated.py * add some test cases and some assertion * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/dota_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * add opencv-python in requirements/runtime.txt * fix: use try_import to import cv2 * Update mmeval/metrics/dota_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/dota_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * fix a bug caused by static function * modify docstring of filter_by_bboxes_area_rotated Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/voc_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/dota_map.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * Update mmeval/metrics/utils/bbox_overlaps_rotated.py Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> * add test_metric_accurate function in test_dota_map.py --------- Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com> Co-authored-by: yancong <xych6@outlook.com>
e635ba6338 [Feature] Add ConnectivityError metric (#79) * add connectivity error * Apply suggestions from code review Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Correct the Args * Change metrics to lowercase * Change metrics to lowercase Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
0e8fce2a8b [Feature] Add MattingMSE metric (#71) * add mattingmse * modify config.yml * Modify some details * Add test_matting_mse.py and simplify matting_mse.py. * Synchronize config.yml in the main branch * improve the document * Fine-tune docstring * Apply suggestions from code review Modify format statement Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * update * Update mmeval/metrics/matting_mse.py * Update matting_mse.py update * Change metrics to lowercase Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
d14a5ef0e7 [Feature] Add GradientError metric (#78) * add gradient error * update docstring and type hints * update * use try_import * Update gradient_error.py update * update * update Examples * update test * Apply suggestions from code review update Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Update mmeval/metrics/gradient_error.py Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * Correct the Args * update test * Change metrics to lowercase * update * Update mmeval/metrics/gradient_error.py * Apply suggestions from code review Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
eb92639c64 [Feature] Add SAD metric (#76) * add matting_sad * update Examples * update * Apply suggestions from code review Modify the details. Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * change mattingsad to sad * universalize * Apply suggestions from code review Optimize details Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> * update * Update mmeval/metrics/sad.py Co-authored-by: LeoXing1996 <xingzn1996@hotmail.com> * Update tests/test_metrics/test_sad.py * Change metrics to lowercase Co-authored-by: yancong <32220263+ice-tong@users.noreply.github.com> Co-authored-by: LeoXing1996 <xingzn1996@hotmail.com>
Compare 5 commits »