dronefreak commited on
Commit
2ea781e
·
verified ·
1 Parent(s): 3c452b2

Add model-index metadata (HF Evaluation Results widget)

Browse files
Files changed (1) hide show
  1. README.md +102 -22
README.md CHANGED
@@ -26,6 +26,32 @@ metrics:
26
  - f1
27
 
28
  base_model: "Ultralytics/YOLOv9"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ---
30
 
31
 
@@ -89,26 +115,26 @@ Metrics reported in this model card are computed on the ExDark **test** split, u
89
 
90
  Every model DetectionBench has trained and evaluated on ExDark so far, for full transparency -- see [DetectionBench](https://github.com/dronefreak/DetectionBench) for the smaller, curated comparison set used on the project README.
91
 
92
- | Rank | Model | mAP@50 | mAP@50-95 | Precision | Recall |
93
- | -------------------------- | --------------------- | ------------- | --------------- | ----------------- | -------------- |
94
- | 1 | RF-DETR Small | 88.98 | 61.67 | 83.07 | 81.89 |
95
- | 2 | RF-DETR Medium | 88.64 | 62.55 | 86.6 | 79.46 |
96
- | 3 | RF-DETR Nano | 85.27 | 58.01 | 85.18 | 74.67 |
97
- | 4 | YOLOv26l | 77.51 | 50.88 | 80.71 | 70.72 |
98
- | 5 | YOLOv26m | 76.54 | 50.02 | 82.29 | 68.83 |
99
- | 6 | YOLOv8x | 75.4 | 48.39 | 81.53 | 65.86 |
100
- | 7 | YOLOv8l | 75.26 | 48.48 | 81.44 | 67.58 |
101
- | 8 | YOLOv8m | 74.69 | 48.05 | 78.4 | 69.17 |
102
- | 9 | YOLOv11x | 74.41 | 48.98 | 81.87 | 67.05 |
103
- | 10 | YOLOv9m | 74.17 | 47.38 | 76.27 | 67.94 |
104
- | 11 | YOLOv26s | 74.0 | 48.32 | 79.11 | 65.59 |
105
- | 12 | YOLOv11l | 73.44 | 47.56 | 78.57 | 67.09 |
106
- | 13 | YOLOv11s | 73.35 | 46.8 | 77.93 | 66.38 |
107
- | 14 | YOLOv11m | 73.17 | 47.16 | 74.83 | 67.23 |
108
- | 15 | YOLOv8s | 73.01 | 45.85 | 78.26 | 65.13 |
109
- | 16 | YOLOv26n | 72.7 | 46.27 | 81.0 | 62.67 |
110
- | 17 | YOLOv8n | 71.29 | 44.78 | 78.25 | 62.76 |
111
- | 18 | YOLOv11n | 70.36 | 44.72 | 76.18 | 61.15 |
112
  ---
113
 
114
  ## Per-Class Performance
@@ -270,8 +296,8 @@ If you use this model in your research, please consider citing:
270
 
271
  1. The ExDark dataset (see below)
272
  2. The original YOLOv9m architecture (see below)
273
- 3. DetectionBench, the training/evaluation framework used to produce this checkpoint
274
-
275
  ```
276
  @article{Exdark,
277
  title = {Getting to Know Low-light Images with The Exclusively Dark Dataset},
@@ -292,7 +318,61 @@ If you use this model in your research, please consider citing:
292
  year={2024}
293
  }
294
  ```
 
 
 
 
 
 
 
 
 
 
 
295
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
296
  ```bibtex
297
  @software{Saksena_DetectionBench_2026,
298
  author = {Saksena, Saumya Kumaar},
 
26
  - f1
27
 
28
  base_model: "Ultralytics/YOLOv9"
29
+
30
+ model-index:
31
+ - name: YOLOv9m Finetuned on ExDark
32
+ results:
33
+ - task:
34
+ type: object-detection
35
+ name: Object Detection
36
+ dataset:
37
+ name: ExDark
38
+ type: exdark
39
+ metrics:
40
+ - type: mAP50
41
+ value: 74.17
42
+ name: mAP@50 (test split)
43
+ - type: mAP50-95
44
+ value: 47.38
45
+ name: mAP@50-95 (test split)
46
+ - type: precision
47
+ value: 76.27
48
+ name: Precision (test split)
49
+ - type: recall
50
+ value: 67.94
51
+ name: Recall (test split)
52
+ source:
53
+ url: https://github.com/dronefreak/DetectionBench
54
+ name: DetectionBench
55
  ---
56
 
57
 
 
115
 
116
  Every model DetectionBench has trained and evaluated on ExDark so far, for full transparency -- see [DetectionBench](https://github.com/dronefreak/DetectionBench) for the smaller, curated comparison set used on the project README.
117
 
118
+ | Model | mAP@50 | mAP@50-95 | Precision | Recall |
119
+ | --------------------- | ------------- | --------------- | ----------------- | -------------- |
120
+ | RF-DETR Small | 88.98 | 61.67 | 83.07 | 81.89 |
121
+ | RF-DETR Medium | 88.64 | 62.55 | 86.6 | 79.46 |
122
+ | RF-DETR Nano | 85.27 | 58.01 | 85.18 | 74.67 |
123
+ | YOLOv26l | 77.51 | 50.88 | 80.71 | 70.72 |
124
+ | YOLOv26m | 76.54 | 50.02 | 82.29 | 68.83 |
125
+ | YOLOv8x | 75.4 | 48.39 | 81.53 | 65.86 |
126
+ | YOLOv8l | 75.26 | 48.48 | 81.44 | 67.58 |
127
+ | YOLOv8m | 74.69 | 48.05 | 78.4 | 69.17 |
128
+ | YOLOv11x | 74.41 | 48.98 | 81.87 | 67.05 |
129
+ | YOLOv9m | 74.17 | 47.38 | 76.27 | 67.94 |
130
+ | YOLOv26s | 74.0 | 48.32 | 79.11 | 65.59 |
131
+ | YOLOv11l | 73.44 | 47.56 | 78.57 | 67.09 |
132
+ | YOLOv11s | 73.35 | 46.8 | 77.93 | 66.38 |
133
+ | YOLOv11m | 73.17 | 47.16 | 74.83 | 67.23 |
134
+ | YOLOv8s | 73.01 | 45.85 | 78.26 | 65.13 |
135
+ | YOLOv26n | 72.7 | 46.27 | 81.0 | 62.67 |
136
+ | YOLOv8n | 71.29 | 44.78 | 78.25 | 62.76 |
137
+ | YOLOv11n | 70.36 | 44.72 | 76.18 | 61.15 |
138
  ---
139
 
140
  ## Per-Class Performance
 
296
 
297
  1. The ExDark dataset (see below)
298
  2. The original YOLOv9m architecture (see below)
299
+ 3. The other model architectures shown in the Model Zoo/External Comparison tables above, if you reference their results
300
+ 4. DetectionBench, the training/evaluation framework used to produce this checkpoint
301
  ```
302
  @article{Exdark,
303
  title = {Getting to Know Low-light Images with The Exclusively Dark Dataset},
 
318
  year={2024}
319
  }
320
  ```
321
+ Other architectures compared against on ExDark in this model card:
322
+ ### RF-DETR
323
+
324
+ ```bibtex
325
+ @inproceedings{robinson2026rfdetr,
326
+ title = {RF-DETR: Real-Time Detection Transformer},
327
+ author = {Robinson, Isaac and Robicheaux, Peter and Popov, Matvei and Ramanan, Deva and Peri, Neehar},
328
+ booktitle = {International Conference on Learning Representations (ICLR)},
329
+ year = {2026},
330
+ url = {https://arxiv.org/abs/2511.09554}
331
+ }
332
 
333
+ @article{oquab2023dinov2,
334
+ title={DINOv2: Learning Robust Visual Features without Supervision},
335
+ author={Oquab, Maxime and Darcet, Timoth{\'e}e and Moutakanni, Theo and Vo, Huy and Szafraniec, Marc and Khalidov, Vasil and Fernandez, Pierre and Haziza, Daniel and Massa, Francisco and El-Nouby, Alaaeldin and others},
336
+ journal={arXiv preprint arXiv:2304.07193},
337
+ year={2023}
338
+ }
339
+ ```
340
+ ### YOLOv11
341
+
342
+ ```bibtex
343
+ No official YOLO11 research paper has been published by Ultralytics; the most commonly cited independent architectural analysis is used instead:
344
+
345
+ @article{khanam2024yolov11,
346
+ title={YOLOv11: An Overview of the Key Architectural Enhancements},
347
+ author={Khanam, Rahima and Hussain, Muhammad},
348
+ journal={arXiv preprint arXiv:2410.17725},
349
+ year={2024}
350
+ }
351
+ ```
352
+ ### YOLOv26
353
+
354
+ ```bibtex
355
+ @article{jocher2026yolo26,
356
+ title={Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models},
357
+ author={Jocher, Glenn and Qiu, Jing and Liu, Mengyu and Lyu, Shuai and Akyon, Fatih Cagatay and Kalfaoglu, Muhammet Esat},
358
+ journal={arXiv preprint arXiv:2606.03748},
359
+ year={2026}
360
+ }
361
+ ```
362
+ ### YOLOv8
363
+
364
+ ```bibtex
365
+ No official YOLOv8 research paper has been published by Ultralytics; this is their own recommended software citation instead:
366
+
367
+ @software{jocher2023yolov8,
368
+ author = {Glenn Jocher and Ayush Chaurasia and Jing Qiu},
369
+ title = {Ultralytics YOLOv8},
370
+ version = {8.0.0},
371
+ year = {2023},
372
+ url = {https://github.com/ultralytics/ultralytics},
373
+ license = {AGPL-3.0}
374
+ }
375
+ ```
376
  ```bibtex
377
  @software{Saksena_DetectionBench_2026,
378
  author = {Saksena, Saumya Kumaar},