Evaluation (P: 680K, EP: 40)
===== Evaluating group: Tests (tests/audio) =====
Profanity files: 1
Clean files: 0
Device: cuda
Evaluating profanity files...
Profanity: 100%|██████████████████████████████████| 1/1 [00:01<00:00, 1.95s/it]
=== Binary Profanity Detection Summary ===
Group: Tests (tests/audio)
Total samples: 1
TP (profane correctly detected): 1
FN (profane missed): 0
TN (clean correctly detected): 0
FP (clean falsely profane): 0
Binary accuracy: 1.0000
=== Profanity Word Identification Summary ===
Group: Tests (tests/audio)
Total profanity samples: 1
Correct word predictions: 1
Word accuracy (threshold=0.35): 1.0000
Word top-1 accuracy (no threshold): 1.0000
============================================
===== Evaluating group: TAPAD (TAPAD/audio) =====
Profanity files: 26365
Clean files: 0
Device: cuda
Evaluating profanity files...
Profanity: 100%|██████████████████████████████| 412/412 [00:56<00:00, 7.32it/s]
=== Binary Profanity Detection Summary ===
Group: TAPAD (TAPAD/audio)
Total samples: 26365
TP (profane correctly detected): 26335
FN (profane missed): 30
TN (clean correctly detected): 0
FP (clean falsely profane): 0
Binary accuracy: 0.9989
=== Profanity Word Identification Summary ===
Group: TAPAD (TAPAD/audio)
Total profanity samples: 26365
Correct word predictions: 22275
Word accuracy (threshold=0.35): 0.8449
Word top-1 accuracy (no threshold): 0.8711
--- Misclassified (Binary) ---
FN (should be profane): data/profanity/TAPAD/audio/en/1/assbanger.wav (p_profane=0.0373)
FN (should be profane): data/profanity/TAPAD/audio/en/1/cockmongruel.wav (p_profane=0.4161)
FN (should be profane): data/profanity/TAPAD/audio/en/1/coon.wav (p_profane=0.6945)
FN (should be profane): data/profanity/TAPAD/audio/en/1/cunnilingus.wav (p_profane=0.6782)
FN (should be profane): data/profanity/TAPAD/audio/en/1/munging.wav (p_profane=0.4586)
FN (should be profane): data/profanity/TAPAD/audio/en/1/poon.wav (p_profane=0.3384)
FN (should be profane): data/profanity/TAPAD/audio/en/1/poonani.wav (p_profane=0.5764)
FN (should be profane): data/profanity/TAPAD/audio/en/1/punanny.wav (p_profane=0.4066)
FN (should be profane): data/profanity/TAPAD/audio/en/1/schlong.wav (p_profane=0.3059)
FN (should be profane): data/profanity/TAPAD/audio/en/1/shitting.wav (p_profane=0.5911)
FN (should be profane): data/profanity/TAPAD/audio/my/ass-hat.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/ass-jabber.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/ass-pirate.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/blow job.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/butt plug.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/butt-pirate.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/camel toe.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/dick-sneeze.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/douche-fag.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/dumb ass.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/hard on.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/jerk off.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/jungle bunny.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/nut sack.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/pissed off.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/porch monkey.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/my/sand nigger.mp3 (p_profane=0.0011)
FN (should be profane): data/profanity/TAPAD/audio/pt-br/dipshit.mp3 (p_profane=0.1271)
FN (should be profane): data/profanity/TAPAD/audio/pt/dipshit.mp3 (p_profane=0.1271)
FN (should be profane): data/profanity/TAPAD/audio/vi/dicktickler.mp3 (p_profane=0.4038)
--- Misclassified (Words) ---
data/profanity/TAPAD/audio/af/asssucker.mp3: expected='asssucker', predicted='asslicker', conf=0.4173
data/profanity/TAPAD/audio/af/asswipe.mp3: expected='asswipe', predicted='assmuncher', conf=0.4483
data/profanity/TAPAD/audio/af/buttfucker.mp3: expected='buttfucker', predicted='buttfucka', conf=0.5326
data/profanity/TAPAD/audio/af/chode.mp3: expected='chode', predicted='__unknown__', conf=0.2672
data/profanity/TAPAD/audio/af/cocknugget.mp3: expected='cocknugget', predicted='__unknown__', conf=0.2401
data/profanity/TAPAD/audio/af/cooter.mp3: expected='cooter', predicted='puto', conf=0.4474
data/profanity/TAPAD/audio/af/dickweed.mp3: expected='dickweed', predicted='dickmilk', conf=0.5217
data/profanity/TAPAD/audio/af/douche-fag.mp3: expected='douchefag', predicted='__unknown__', conf=0.2034
data/profanity/TAPAD/audio/af/fag.mp3: expected='fag', predicted='fuck', conf=0.4058
data/profanity/TAPAD/audio/af/fuckbag.mp3: expected='fuckbag', predicted='fuckbutt', conf=0.4827
data/profanity/TAPAD/audio/af/fucked.mp3: expected='fucked', predicted='__unknown__', conf=0.3261
data/profanity/TAPAD/audio/af/fuckwad.mp3: expected='fuckwad', predicted='fucknut', conf=0.7002
data/profanity/TAPAD/audio/af/fuckwit.mp3: expected='fuckwit', predicted='fucknut', conf=0.5668
data/profanity/TAPAD/audio/af/gayfuckist.mp3: expected='gayfucker', predicted='__unknown__', conf=0.2905
data/profanity/TAPAD/audio/af/gook.mp3: expected='gook', predicted='cock', conf=0.4098
data/profanity/TAPAD/audio/af/gringo.mp3: expected='gringo', predicted='__unknown__', conf=0.3005
data/profanity/TAPAD/audio/af/guido.mp3: expected='guido', predicted='gaydo', conf=0.3826
data/profanity/TAPAD/audio/af/jerk off.mp3: expected='jerkoff', predicted='jagoff', conf=0.5113
data/profanity/TAPAD/audio/af/jungle bunny.mp3: expected='jungle bunny', predicted='__unknown__', conf=0.3219
data/profanity/TAPAD/audio/af/kyke.mp3: expected='kyke', predicted='kike', conf=0.5355
data/profanity/TAPAD/audio/af/minge.mp3: expected='minge', predicted='__unknown__', conf=0.2151
data/profanity/TAPAD/audio/af/motherfucking.mp3: expected='motherfucking', predicted='motherfucker', conf=0.8109
data/profanity/TAPAD/audio/af/muffdiver.mp3: expected='muffdiver', predicted='__unknown__', conf=0.3491
data/profanity/TAPAD/audio/af/nut sack.mp3: expected='nutsack', predicted='slut', conf=0.3574
data/profanity/TAPAD/audio/af/poon.mp3: expected='poon', predicted='coon', conf=0.4594
data/profanity/TAPAD/audio/af/porch monkey.mp3: expected='porch monkey', predicted='honkey', conf=0.5200
data/profanity/TAPAD/audio/af/prick.mp3: expected='prick', predicted='clit', conf=0.3869
data/profanity/TAPAD/audio/af/puto.mp3: expected='puto', predicted='__unknown__', conf=0.3148
data/profanity/TAPAD/audio/af/shitcanned.mp3: expected='shitcanned', predicted='__unknown__', conf=0.3387
data/profanity/TAPAD/audio/af/spic.mp3: expected='spic', predicted='__unknown__', conf=0.3374
data/profanity/TAPAD/audio/af/spick.mp3: expected='spick', predicted='spic', conf=0.3510
data/profanity/TAPAD/audio/af/va-j-j.mp3: expected='vajj', predicted='__unknown__', conf=0.2657
data/profanity/TAPAD/audio/af/vag.mp3: expected='vag', predicted='fuck', conf=0.4675
data/profanity/TAPAD/audio/af/whore.mp3: expected='whore', predicted='ho', conf=0.6236
data/profanity/TAPAD/audio/ar/asscracker.mp3: expected='asscracker', predicted='__unknown__', conf=0.2572
data/profanity/TAPAD/audio/ar/assface.mp3: expected='assface', predicted='__unknown__', conf=0.3075
data/profanity/TAPAD/audio/ar/asshead.mp3: expected='asshead', predicted='asshat', conf=0.8661
data/profanity/TAPAD/audio/ar/asshopper.mp3: expected='asshopper', predicted='__unknown__', conf=0.2643
data/profanity/TAPAD/audio/ar/bitchass.mp3: expected='bitchass', predicted='bitches', conf=0.5592
data/profanity/TAPAD/audio/ar/bumblefuck.mp3: expected='bumblefuck', predicted='goddamnit', conf=0.9513
data/profanity/TAPAD/audio/ar/butt plug.mp3: expected='buttplug', predicted='__unknown__', conf=0.3312
data/profanity/TAPAD/audio/ar/buttfucka.mp3: expected='buttfucka', predicted='dickfucker', conf=0.7498
data/profanity/TAPAD/audio/ar/buttfucker.mp3: expected='buttfucker', predicted='dickfucker', conf=0.6867
data/profanity/TAPAD/audio/ar/camel toe.mp3: expected='cameltoe', predicted='__unknown__', conf=0.2665
data/profanity/TAPAD/audio/ar/chinc.mp3: expected='chink', predicted='__unknown__', conf=0.1109
data/profanity/TAPAD/audio/ar/choad.mp3: expected='chode', predicted='__unknown__', conf=0.2703
data/profanity/TAPAD/audio/ar/clit.mp3: expected='clit', predicted='__unknown__', conf=0.2437
data/profanity/TAPAD/audio/ar/clitface.mp3: expected='clitface', predicted='__unknown__', conf=0.2552
data/profanity/TAPAD/audio/ar/cockmongruel.mp3: expected='cockmongruel', predicted='cockmongler', conf=0.4896
data/profanity/TAPAD/audio/ar/cocknugget.mp3: expected='cocknugget', predicted='cockjockey', conf=0.4919
... and 4040 more
============================================
insidiousfiddler released this