Robustness recording condition

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

0.0% passed tests (0 passed / 2 failed).

0.0% passed tests (0 passed / 2 failed).

50.0% passed tests (1 passed / 1 failed).

0.0% passed tests (0 passed / 2 failed).

Percentage Unchanged Predictions Recording Condition

Threshold: 0.8

Data

Percentage Unchanged Predictions Recording Condition

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

imda-nsc-read-speech-balanced-2.6.0-headset-boundary

0.80

0.77

0.82

0.75

imda-nsc-read-speech-balanced-2.6.0-headset-mobile

0.78

0.71

0.71

0.63

mean

0.79

0.74

0.76

0.69

Visualization

Confusion Matrix showing the shift from the predictions of the baseline recording condition audio to the predictions of the different recording condition audio.

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary27.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary22.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary28.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary29.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile27.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile22.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile28.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile29.png