Submission ID: 2f3c9cf7

sp_sg_retrieval_masked

Processed: 21-06-11. Download link: 2f3c9cf7c8cfd156-sp_sg_retrieval_masked.json.json

This page ranks the submission against all others using the same number of keypoints, regardless of descriptor size. Please hover over table headers for descriptions on metrics and full scene names.


Metadata


Phototourism dataset / Stereo track


mAA at 10 degrees: 0.58070 (±0.00000 over 1 run(s) / ±0.15477 over 9 scenes)
Rank (per category): 25 (of 87)

Scene Features Matches
(raw)
Matches
(final)
Rep. @ 3 px. MS @ 3 px. mAA(5o) mAA(10o)
BM 1537.0 309.9 0.408
Rank: 80/87
0.782
Rank: 82/87
0.35543 (±0.00000)
Rank: 7/87
0.51044 (±0.00000)
Rank: 7/87
FCS 1906.2 499.3 0.360
Rank: 70/87
0.766
Rank: 76/87
0.62051 (±0.00000)
Rank: 37/87
0.74422 (±0.00000)
Rank: 37/87
LMS 1120.6 377.0 0.347
Rank: 78/87
0.592
Rank: 80/87
0.68004 (±0.00000)
Rank: 1/87
0.79553 (±0.00000)
Rank: 1/87
LB 1513.5 296.6 0.337
Rank: 74/87
0.652
Rank: 74/87
0.53560 (±0.00000)
Rank: 7/87
0.66498 (±0.00000)
Rank: 2/87
MC 1759.7 338.2 0.373
Rank: 77/87
0.745
Rank: 80/87
0.30302 (±0.00000)
Rank: 7/87
0.44404 (±0.00000)
Rank: 51/87
MR 1277.3 276.7 0.393
Rank: 56/87
0.788
Rank: 79/87
0.19983 (±0.00000)
Rank: 67/87
0.29415 (±0.00000)
Rank: 66/87
PSM 1874.0 370.1 0.296
Rank: 69/87
0.596
Rank: 45/87
0.29829 (±0.00000)
Rank: 2/87
0.45075 (±0.00000)
Rank: 2/87
SF 1761.6 504.9 0.338
Rank: 70/87
0.702
Rank: 76/87
0.51410 (±0.00000)
Rank: 22/87
0.65651 (±0.00000)
Rank: 25/87
SPC 1737.8 361.5 0.330
Rank: 78/87
0.666
Rank: 78/87
0.50547 (±0.00000)
Rank: 29/87
0.66571 (±0.00000)
Rank: 33/87
Avg 1609.7 370.5 0.354
Rank: 78/87
0.699
Rank: 78/87
0.44581 (±0.00000)
Rank: 21/87
0.58070 (±0.00000)
Rank: 25/87




Phototourism dataset / Multiview track


mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.10961 over 9 scenes)
Rank (per category): 3 (of 87)

Scene Features Matches
(input)
Registration
Ratio (%)
Number of
Landmarks
Track Length ATE mAA(50) mAA(100)
BM 1537.0 314.67 99.93
Rank: 24/87
1399.74
Rank: 54/87
4.919
Rank: 42/87
0.34335
Rank: 15/87
0.59562 (±0.00000)
Rank: 16/87
0.73006 (±0.00000)
Rank: 18/87
FCS 1906.2 507.02 98.67
Rank: 8/87
2328.88
Rank: 49/87
4.833
Rank: 51/87
0.22157
Rank: 3/87
0.76177 (±0.00000)
Rank: 7/87
0.81712 (±0.00000)
Rank: 8/87
LMS 1120.6 403.63 99.20
Rank: 42/87
1335.53
Rank: 65/87
5.602
Rank: 31/87
0.24804
Rank: 2/87
0.86456 (±0.00000)
Rank: 14/87
0.90997 (±0.00000)
Rank: 17/87
LB 1513.5 353.96 98.36
Rank: 1/87
1388.43
Rank: 54/87
5.257
Rank: 34/87
0.49704
Rank: 52/87
0.70024 (±0.00000)
Rank: 39/87
0.79969 (±0.00000)
Rank: 38/87
MC 1759.7 333.87 100.00
Rank: 1/87
1692.52
Rank: 54/87
4.749
Rank: 59/87
0.29726
Rank: 1/87
0.61269 (±0.00000)
Rank: 1/87
0.74720 (±0.00000)
Rank: 1/87
MR 1277.3 272.50 95.41
Rank: 13/87
1155.77
Rank: 69/87
4.861
Rank: 31/87
0.55509
Rank: 57/87
0.38527 (±0.00000)
Rank: 51/87
0.51606 (±0.00000)
Rank: 42/87
PSM 1874.0 369.46 99.88
Rank: 1/87
2157.46
Rank: 48/87
4.430
Rank: 36/87
0.30739
Rank: 6/87
0.68388 (±0.00000)
Rank: 1/87
0.77242 (±0.00000)
Rank: 1/87
SF 1761.6 495.60 99.93
Rank: 13/87
2325.13
Rank: 48/87
4.972
Rank: 29/87
0.29018
Rank: 38/87
0.78775 (±0.00000)
Rank: 2/87
0.86572 (±0.00000)
Rank: 12/87
SPC 1737.8 373.04 100.00
Rank: 1/87
1849.11
Rank: 52/87
4.814
Rank: 56/87
0.40378
Rank: 9/87
0.79003 (±0.00000)
Rank: 1/87
0.87410 (±0.00000)
Rank: 1/87
Avg 1609.7 380.42 99.04
Rank: 5/87
1736.95
Rank: 54/87
4.938
Rank: 45/87
0.35152
Rank: 1/87
0.68687 (±0.00000)
Rank: 1/87
0.78137 (±0.00000)
Rank: 3/87



Prague Parks dataset / Stereo track


mAA at 10 degrees: 0.83640 (±0.00000 over 1 run(s) / ±0.05133 over 3 scenes)
Rank (per category): 1 (of 87)

Scene Features Matches
(raw)
Matches
(final)
Rep. @ 3 px. MS @ 3 px. mAA(5o) mAA(10o)
Lizard 1488.2 304.0 0.028
Rank: 64/87
0.010
Rank: 37/87
0.71817 (±0.00000)
Rank: 1/87
0.82732 (±0.00000)
Rank: 1/87
Pond 2001.3 361.5 0.048
Rank: 54/87
0.043
Rank: 69/87
0.67375 (±0.00000)
Rank: 2/87
0.77856 (±0.00000)
Rank: 1/87
Tree 1896.6 234.0 0.028
Rank: 65/87
0.024
Rank: 36/87
0.83046 (±0.00000)
Rank: 1/87
0.90331 (±0.00000)
Rank: 1/87
Avg 1795.4 299.8 0.034
Rank: 65/87
0.026
Rank: 63/87
0.74079 (±0.00000)
Rank: 1/87
0.83640 (±0.00000)
Rank: 1/87




Prague Parks dataset / Multiview track


mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.15093 over 3 scenes)
Rank (per category): 41 (of 87)

Scene Features Matches
(input)
Registration
Ratio (%)
Number of
Landmarks
Track Length ATE mAA(50) mAA(100)
Lizard 1488.2 366.74 85.30
Rank: 19/87
1003.49
Rank: 39/87
3.453
Rank: 11/87
13.99969
Rank: 18/87
0.60093 (±0.00000)
Rank: 2/87
0.67767 (±0.00000)
Rank: 8/87
Pond 2001.3 344.87 72.50
Rank: 1/87
805.97
Rank: 49/87
3.140
Rank: 6/87
0.45229
Rank: 70/87
0.28758 (±0.00000)
Rank: 28/87
0.31522 (±0.00000)
Rank: 32/87
Tree 1896.6 229.45 69.89
Rank: 51/87
479.12
Rank: 43/87
3.014
Rank: 23/87
6.56886
Rank: 68/87
0.39713 (±0.00000)
Rank: 53/87
0.43328 (±0.00000)
Rank: 54/87
Avg 1795.4 313.69 75.90
Rank: 6/87
762.86
Rank: 45/87
3.202
Rank: 5/87
7.00695
Rank: 62/87
0.42855 (±0.00000)
Rank: 40/87
0.47539 (±0.00000)
Rank: 41/87



Google Urban dataset / Stereo track


mAA at 10 degrees: 0.36607 (±0.00000 over 1 run(s) / ±0.13891 over 17 scenes)
Rank (per category): 33 (of 87)

Scene Features Matches
(raw)
Matches
(final)
mAA(5o) mAA(10o)
Amsterdam (AMS) 1727.7 213.9 0.20804 (±0.00000)
Rank: 34/87
0.36696 (±0.00000)
Rank: 32/87
Bangkok (BGK) 1240.5 239.6 0.04715 (±0.00000)
Rank: 42/87
0.13300 (±0.00000)
Rank: 46/87
Barcelona (BCN) 1185.7 179.8 0.12601 (±0.00000)
Rank: 16/87
0.19744 (±0.00000)
Rank: 33/87
Buenos Aires (BAR) 1239.2 173.8 0.20822 (±0.00000)
Rank: 34/87
0.38767 (±0.00000)
Rank: 11/87
Cambridge (CAM) 1196.3 141.3 0.24110 (±0.00000)
Rank: 34/87
0.38801 (±0.00000)
Rank: 40/87
Cannes (CAN) 1164.0 156.6 0.25714 (±0.00000)
Rank: 47/87
0.35576 (±0.00000)
Rank: 47/87
Chicago (CHI) 1178.6 100.2 0.09139 (±0.00000)
Rank: 41/87
0.20526 (±0.00000)
Rank: 39/87
Helsinki (HEL) 1337.2 329.0 0.31237 (±0.00000)
Rank: 41/87
0.48557 (±0.00000)
Rank: 43/87
Madrid (MAD) 1223.0 137.6 0.08207 (±0.00000)
Rank: 24/87
0.21672 (±0.00000)
Rank: 6/87
Mountain View (MTV) 1093.4 164.7 0.30469 (±0.00000)
Rank: 1/87
0.47070 (±0.00000)
Rank: 1/87
New Orleans (NOR) 1001.3 108.3 0.23136 (±0.00000)
Rank: 35/87
0.35710 (±0.00000)
Rank: 32/87
San Francisco (SF) 1163.6 174.5 0.20315 (±0.00000)
Rank: 21/87
0.35827 (±0.00000)
Rank: 18/87
Singapore (SG) 1175.7 151.3 0.28924 (±0.00000)
Rank: 34/87
0.42025 (±0.00000)
Rank: 33/87
Sydney (SYD) 1331.1 193.9 0.34760 (±0.00000)
Rank: 14/87
0.52052 (±0.00000)
Rank: 1/87
Tokyo (TOK) 1355.3 281.2 0.59020 (±0.00000)
Rank: 31/87
0.73725 (±0.00000)
Rank: 27/87
Toronto (TOR) 1287.7 195.2 0.17440 (±0.00000)
Rank: 35/87
0.31920 (±0.00000)
Rank: 35/87
Zurich (ZRH) 1156.6 200.7 0.21443 (±0.00000)
Rank: 42/87
0.30344 (±0.00000)
Rank: 40/87
Average (Avg) 1238.6 184.8 0.23109 (±0.00000)
Rank: 33/87
0.36607 (±0.00000)
Rank: 33/87




Google Urban dataset / Multiview track


mAA at 10 degrees: N/A (±0.00000 over 1 run(s) / ±0.17038 over 17 scenes)
Rank (per category): 33 (of 87)

Scene Features Matches
(input)
Registration
Ratio (%)
Number of
Landmarks
Track Length ATE mAA(50) mAA(100)
AMS 1727.7 147.87 91.60
Rank: 31/87
1046.09
Rank: 40/87
3.766
Rank: 29/87
25.52768
Rank: 34/87
0.34727 (±0.00000)
Rank: 23/87
0.46885 (±0.00000)
Rank: 21/87
BGK 1240.5 163.58 95.60
Rank: 35/87
1159.66
Rank: 45/87
3.917
Rank: 3/87
13.27819
Rank: 25/87
0.02807 (±0.00000)
Rank: 25/87
0.08526 (±0.00000)
Rank: 27/87
BCN 1185.7 107.34 79.23
Rank: 42/87
709.81
Rank: 39/87
3.669
Rank: 34/87
24.61398
Rank: 16/87
0.10411 (±0.00000)
Rank: 36/87
0.16358 (±0.00000)
Rank: 37/87
BAR 1239.2 110.29 87.97
Rank: 15/87
833.14
Rank: 35/87
3.474
Rank: 6/87
16.01970
Rank: 26/87
0.20864 (±0.00000)
Rank: 1/87
0.34678 (±0.00000)
Rank: 1/87
CAM 1196.3 93.84 80.75
Rank: 38/87
629.35
Rank: 43/87
3.612
Rank: 9/87
22.98774
Rank: 14/87
0.19538 (±0.00000)
Rank: 12/87
0.27219 (±0.00000)
Rank: 19/87
CAN 1164.0 89.99 68.19
Rank: 40/87
366.56
Rank: 43/87
3.389
Rank: 36/87
11.07034
Rank: 7/87
0.06257 (±0.00000)
Rank: 28/87
0.10447 (±0.00000)
Rank: 31/87
CHI 1178.6 88.62 83.61
Rank: 39/87
324.23
Rank: 36/87
4.081
Rank: 36/87
44.07541
Rank: 9/87
0.04160 (±0.00000)
Rank: 42/87
0.11245 (±0.00000)
Rank: 38/87
HEL 1337.2 237.75 93.27
Rank: 38/87
1392.96
Rank: 44/87
4.095
Rank: 7/87
13.17171
Rank: 15/87
0.35303 (±0.00000)
Rank: 13/87
0.47209 (±0.00000)
Rank: 24/87
MAD 1223.0 92.12 88.17
Rank: 37/87
788.47
Rank: 43/87
3.456
Rank: 1/87
5.89140
Rank: 27/87
0.10991 (±0.00000)
Rank: 6/87
0.21733 (±0.00000)
Rank: 12/87
MTV 1093.4 122.71 92.19
Rank: 20/87
855.31
Rank: 41/87
3.954
Rank: 6/87
18.01549
Rank: 51/87
0.32730 (±0.00000)
Rank: 1/87
0.46632 (±0.00000)
Rank: 1/87
NOR 1001.3 75.91 77.92
Rank: 36/87
530.21
Rank: 42/87
3.366
Rank: 25/87
11.28106
Rank: 20/87
0.22185 (±0.00000)
Rank: 32/87
0.31442 (±0.00000)
Rank: 31/87
SF 1163.6 122.04 92.45
Rank: 34/87
869.09
Rank: 41/87
3.753
Rank: 18/87
21.02563
Rank: 38/87
0.26824 (±0.00000)
Rank: 30/87
0.40564 (±0.00000)
Rank: 32/87
SG 1175.7 98.37 69.43
Rank: 40/87
527.55
Rank: 44/87
3.228
Rank: 37/87
17.49337
Rank: 32/87
0.15579 (±0.00000)
Rank: 37/87
0.20246 (±0.00000)
Rank: 38/87
SYD 1331.1 126.30 85.61
Rank: 35/87
890.62
Rank: 39/87
3.589
Rank: 20/87
23.33500
Rank: 47/87
0.28990 (±0.00000)
Rank: 24/87
0.38862 (±0.00000)
Rank: 18/87
TOK 1355.3 178.94 93.20
Rank: 18/87
1362.33
Rank: 39/87
3.835
Rank: 6/87
14.28084
Rank: 20/87
0.67833 (±0.00000)
Rank: 6/87
0.75036 (±0.00000)
Rank: 8/87
TOR 1287.7 130.15 87.19
Rank: 33/87
877.42
Rank: 39/87
3.523
Rank: 1/87
17.89227
Rank: 36/87
0.19993 (±0.00000)
Rank: 21/87
0.32653 (±0.00000)
Rank: 23/87
ZRH 1156.6 124.22 81.70
Rank: 40/87
1012.37
Rank: 39/87
3.393
Rank: 34/87
14.60501
Rank: 10/87
0.08501 (±0.00000)
Rank: 35/87
0.13124 (±0.00000)
Rank: 38/87
Avg 1238.6 124.12 85.18
Rank: 36/87
833.83
Rank: 42/87
3.653
Rank: 24/87
18.50381
Rank: 17/87
0.21629 (±0.00000)
Rank: 32/87
0.30756 (±0.00000)
Rank: 33/87