Team | Evaluation date | Algorithm | Version | Runtime-fantasy | F1 on fantasy | Runtime-private | F1 on private | Aggregate F1 | |
---|---|---|---|---|---|---|---|---|---|
0 | Sunlight | 2025-07-13 | unetc | v7 | 0:24:31 | 0.78391260410437 | 1:51:43 | 0.7162494760503502 | 0.736548 |
1 | Sunlight | 2025-07-12 | unetc | v6 | 0:24:28 | 0.7163501537572368 | 1:14:28 | 0.7270210733086339 | 0.723820 |
2 | UAMBiDALab | 2025-07-10 | trufor | v1.1 | 0:51:19 | 0.6204511200997092 | 1:18:41 | 0.7569658860449113 | 0.716011 |
3 | UAMBiDALab | 2025-07-13 | trufor | v1.1.1 | 0:53:20 | 0.6204511200997092 | 1:19:17 | 0.7569658860449113 | 0.716011 |
4 | UAMBiDALab | 2025-07-11 | trufor | v1.2 | 0:56:36 | 0.6172262067328489 | 1:23:06 | 0.7484698147095614 | 0.709097 |
5 | Sunlight | 2025-07-13 | unetc | v9 | 0:26:08 | 0.7241511589928639 | 1:50:57 | 0.7025258327323171 | 0.709013 |
6 | Sunlight | 2025-07-11 | unetc | v5 | 0:23:45 | 0.6925186688348057 | 0:51:09 | 0.7157791392565083 | 0.708801 |
7 | UAMBiDALab | 2025-07-08 | trufor | v0.5 | 0:48:29 | 0.6009414958258137 | 1:22:46 | 0.7480589720007134 | 0.703924 |
8 | UAMBiDALab | 2025-07-04 | trufor | v0.4 | 0:50:45 | 0.6194585545030314 | 1:17:43 | 0.7368855562710357 | 0.701657 |
9 | VISION | 2025-06-10 | trufor | v1 | 1:02:18 | 0.6117324838968435 | 1:30:46 | 0.7378285553501286 | 0.700000 |
10 | UAMBiDALab | 2025-06-25 | trufor | v0.1 | 0:51:06 | 0.6066837169058622 | 1:17:03 | 0.738370960340094 | 0.698865 |
11 | Sunlight | 2025-07-14 | unetc | v10 | 0:26:55 | 0.6848903245343969 | 1:30:24 | 0.6985724358885013 | 0.694468 |
12 | UAMBiDALab | 2025-07-14 | trufor | v1.4 | 0:51:40 | 0.5802616415212029 | 1:17:16 | 0.7380111037310845 | 0.690686 |
13 | UAMBiDALab | 2025-07-06 | trufor | v1.0 | 0:47:41 | 0.5703313740681977 | 1:19:30 | 0.73261655936279 | 0.683931 |
14 | UAMBiDALab | 2025-06-26 | trufor | v0.2 | 0:49:04 | 0.6731575076360716 | 1:25:03 | 0.6739457127543353 | 0.673709 |
15 | UAMBiDALab | 2025-06-27 | trufor | v0.2 | 0:48:24 | 0.6731575076360716 | 1:17:07 | 0.6739457127543353 | 0.673709 |
16 | AG | 2025-07-02 | trudoc | v5 | 8:30:49 | 0.6862783664612659 | 11:34:53 | 0.6618887933602785 | 0.669206 |
17 | UAMBiDALab | 2025-07-01 | trufor | v0.3 | 0:45:48 | 0.5936567200523416 | 1:22:07 | 0.7010164174037081 | 0.668809 |
18 | AG | 2025-07-12 | edgedoc | v15 | 0:56:39 | 0.6663633492185677 | 1:27:56 | 0.6690228687046174 | 0.668225 |
19 | AG | 2025-07-14 | edgedoc | v18 | 1:35:05 | 0.6614199834759975 | 1:45:22 | 0.6570974618640031 | 0.658394 |
20 | AG | 2025-07-14 | edgedoc | v17 | 0:45:11 | 0.6500991367187622 | 1:23:47 | 0.6599665364760681 | 0.657006 |
21 | AG | 2025-06-29 | trudoc | v3 | 7:16:53 | 0.6428768291777835 | 10:34:00 | 0.6475015501472108 | 0.646114 |
22 | AG | 2025-06-27 | trudoc | v2 | 3:32:07 | 0.6497955426884248 | 4:51:06 | 0.6444306535633824 | 0.646040 |
23 | AG | 2025-07-04 | trudoc | v7 | 3:34:01 | 0.6457045407223966 | 4:43:05 | 0.6342069063441274 | 0.637656 |
24 | AG | 2025-07-08 | edgedoc | v10 | 0:57:15 | 0.5592443663478522 | 1:16:19 | 0.6704869267947299 | 0.637114 |
25 | AG | 2025-07-10 | edgedoc_v13 | v2 | 0:52:33 | 0.5727235731280546 | 1:24:51 | 0.6616765663120384 | 0.634991 |
26 | AG | 2025-07-11 | edgedoc_v14 | v2 | 0:55:51 | 0.5727235731280546 | 1:35:33 | 0.6616765663120384 | 0.634991 |
27 | AG | 2025-07-09 | edgedoc | v11 | 0:56:46 | 0.57472848371757 | 1:30:40 | 0.6552252673010425 | 0.631076 |
28 | UAMBiDALab | 2025-07-14 | trufor | v2.1 | 0:44:11 | 0.5936287151989061 | 1:15:25 | 0.6281442823531234 | 0.617790 |
29 | baseline | 2025-06-01 | trufor | v0.1 | 0:44:46 | 0.5898009453750437 | 1:09:49 | 0.6274328723240761 | 0.616143 |
30 | Reagvis | 2025-06-19 | trufor | v2 | 0:58:16 | 0.5898009453750437 | 1:22:18 | 0.6274328723240761 | 0.616143 |
31 | UAMBiDALab | 2025-06-23 | trufor | v0.0 | 0:58:01 | 0.5898009453750437 | 1:22:26 | 0.6274328723240761 | 0.616143 |
32 | Reagvis | 2025-06-25 | trufor | v1 | 0:53:36 | 0.5898009453750437 | 1:20:20 | 0.6274328723240761 | 0.616143 |
33 | LatentVibesOnly | 2025-06-25 | trufor | v0.0 | 0:52:48 | 0.5898009453750437 | 1:26:10 | 0.6274328723240761 | 0.616143 |
34 | AG | 2025-06-26 | trufor | v1 | 0:58:26 | 0.5898009453750437 | 1:21:31 | 0.6274328723240761 | 0.616143 |
35 | Reagvis | 2025-07-03 | vlm_tuned_2_version | v1 | 0:55:32 | 0.5898009453750437 | 1:36:22 | 0.6274328723240761 | 0.616143 |
36 | hardik | 2025-07-03 | tuned | v1 | 0:59:31 | 0.5898009453750437 | 1:28:16 | 0.6274328723240761 | 0.616143 |
37 | Sunlight | 2025-07-06 | trufor | v0.3 | 0:54:21 | 0.5898009453750437 | 0:45:30 | 0.6274328723240761 | 0.616143 |
38 | Deepakto | 2025-07-08 | baseline | v0.1 | 0:47:44 | 0.5898009453750437 | 1:09:59 | 0.6274328723240761 | 0.616143 |
39 | Deepakto | 2025-07-10 | trufor | v0.2 | 0:54:30 | 0.5898009453750437 | 1:18:30 | 0.6274328723240761 | 0.616143 |
40 | ens-epfl | 2025-07-14 | peunet | v2.25 | 0:22:38 | 0.5634039904480761 | 0:41:36 | 0.6195108908471354 | 0.602679 |
41 | Sunlight | 2025-07-07 | unetc | v1 | 0:27:00 | 0.6126570402331014 | 1:12:04 | 0.5976766089191126 | 0.602171 |
42 | Sunlight | 2025-07-08 | unetc | v2 | 0:09:15 | 0.6126570402331014 | 1:35:00 | 0.5976766089191126 | 0.602171 |
43 | Fake-Hunters | 2025-07-01 | bionet | v2 | 0:04:26 | 0.5493777434348279 | 0:28:35 | 0.5896946730916813 | 0.577600 |
44 | SuperIdolSmile | 2025-06-22 | unet | v0.1 | 0:12:17 | 0.5635784925443205 | 0:52:13 | 0.5693047971614335 | 0.567587 |
45 | AG | 2025-07-13 | edgedoc | v16 | 1:27:07 | 0.5918175321639736 | 1:48:18 | 0.5388705432462977 | 0.554755 |
46 | IDNT | 2025-07-14 | docauth | v0.12 | 0:06:16 | 0.5339141142472696 | 0:53:13 | 0.5504448403227907 | 0.545486 |
47 | IDNT | 2025-07-10 | docauth | v0.9 | 0:08:22 | 0.5322330995274056 | 1:14:35 | 0.5503341675219111 | 0.544904 |
48 | IDNT | 2025-07-09 | docauth | v0.8 | 0:07:42 | 0.5312804806257717 | 1:12:30 | 0.550332231632516 | 0.544617 |
49 | IDNT | 2025-07-11 | docauth | v0.10 | 0:05:47 | 0.5291548813460378 | 0:46:20 | 0.5504004126234175 | 0.544027 |
50 | IDNT | 2025-07-13 | docauth | v0.11 | 0:05:49 | 0.5290757481681359 | 0:44:12 | 0.5503993690699694 | 0.544002 |
51 | IDNT | 2025-06-17 | docauth | v0.2 | 0:42:55 | 0.5290764864232252 | 5:38:01 | 0.550052600889806 | 0.543760 |
52 | SuperIdolSmile | 2025-06-24 | unet | v0.2 | 0:12:04 | 0.6011759371015422 | 0:52:34 | 0.518479385848684 | 0.543288 |
53 | IDNT | 2025-06-30 | docauth | v0.3 | 0:06:29 | 0.5251472117349903 | 0:53:38 | 0.549962364219666 | 0.542518 |
54 | IDNT | 2025-07-14 | docauth | v0.13 | 0:06:35 | 0.5189553624170558 | 0:54:31 | 0.5482860695282471 | 0.539487 |
55 | AG | 2025-07-07 | edgedoc | v9 | 2:52:48 | 0.5513390983835543 | 3:22:37 | 0.5253623335386236 | 0.533155 |
56 | KU-Forgeye | 2025-07-11 | forgerydetection | v5 | 0:06:04 | 0.5202362995180636 | 0:45:41 | 0.5381362843556258 | 0.532766 |
57 | Reagvis | 2025-06-26 | tuned_vlm | v1 | 1:09:15 | 0.5174756230739598 | 2:12:05 | 0.5380995708923922 | 0.531912 |
58 | KU-Forgeye | 2025-07-14 | forgerydetection | v8 | 0:07:08 | 0.5084587304491563 | 1:00:12 | 0.5260465398925886 | 0.520770 |
59 | KU-Forgeye | 2025-07-13 | forgerydetection | v7 | 0:07:11 | 0.5126859401699192 | 1:00:18 | 0.520584577518668 | 0.518215 |
60 | IDCH | 2025-07-04 | trufor_augmented | v0.1 | 0:06:39 | 0.2629827806996036 | 0:47:18 | 0.1714349184560774 | 0.198899 |
61 | AG | 2025-07-06 | trudoc | v8 | 3:30:51 | 0.2042233214367976 | 4:20:51 | 0.13766095947572288 | 0.157630 |
62 | KU-Forgeye | 2025-07-10 | forgerydetection | v4 | 0:06:03 | 0.06763833909892532 | 0:43:13 | 0.1529232123126082 | 0.127338 |
63 | VisGen | 2025-07-14 | scu-net | v1 | 0:05:42 | 0.035723586318595124 | 0:06:12 | 0.16439219695195906 | 0.125792 |
64 | IDNT | 2025-06-12 | docauth | v0.1 | 0:05:41 | 0.037968039935447895 | 0:44:24 | 0.001865660617373547 | 0.012696 |
66 | ens-epfl | 2025-06-07 | wtm | v1 | 3:09:07 | 0.4999999974999987 | timed out >12h | nan | nan |
65 | Fake-Hunters | 2025-06-27 | bionet | v1 | 0:00:05 | No scores for any images | 0:02:57 | No scores for any images | nan |
67 | AG | 2025-06-29 | trudoc | v4 | timed out >12h | nan | timed out >12h | nan | nan |
68 | Sunlight | 2025-07-04 | trufor | v0.2 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
69 | Reagvis | 2025-07-07 | trufor | v2 | CUDA out of memory | nan | CUDA out of memory | nan | nan |
70 | Reagvis | 2025-07-08 | trufor | v2.3 | CUDA out of memory | nan | CUDA out of memory | nan | nan |
71 | KU-Forgeye | 2025-07-08 | forgerydetection | v1 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
72 | LatentVibesOnly | 2025-07-09 | segformer | v0.1 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
73 | Reagvis | 2025-07-09 | vision | v10 | CUDA out of memory | nan | CUDA out of memory | nan | nan |
74 | KU-Forgeye | 2025-07-09 | forgerydetection | v3 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
75 | hardik | 2025-07-10 | trufor_new | v1 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
76 | AG | 2025-07-11 | edgedoc | v14 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
77 | VisGen | 2025-07-11 | densenet121-twohead | v1 | Tried downloading model on airgapped machine | nan | Tried downloading model on airgapped machine | nan | nan |
78 | ens-epfl | 2025-07-11 | trufor_wtm | v2.0 | CUDA out of memory | nan | in integration.py, cannot access local variable 'score' | nan | nan |
79 | hardik | 2025-07-11 | trufor_validation | v10 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
80 | ens-epfl | 2025-07-12 | unet | v2.25 | in integration.py, cannot access local variable 'score' | nan | in integration.py, cannot access local variable 'score' | nan | nan |
81 | VisGen | 2025-07-13 | twoheadefficientnet | v1.1 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |
82 | hardik | 2025-07-13 | trufor_validation_version | v10 | No results; could not connect to docker | nan | No results; could not connect to docker | nan | nan |