Robustness recording condition

Overall scores

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

Overall Score

0.0% passed tests (0 passed / 2 failed).

0.0% passed tests (0 passed / 2 failed).

50.0% passed tests (1 passed / 1 failed).

0.0% passed tests (0 passed / 2 failed).

100.0% passed tests (2 passed / 0 failed).

Percentage Unchanged Predictions Recording Condition

Threshold: 0.8

Data

Percentage Unchanged Predictions Recording Condition

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

imda-nsc-read-speech-balanced-2.6.0-headset-boundary

0.73

0.77

0.88

0.79

0.84

imda-nsc-read-speech-balanced-2.6.0-headset-mobile

0.58

0.59

0.74

0.64

0.81

mean

0.66

0.68

0.81

0.72

0.82

Visualization

Difference of predictions for baseline recording condition audio and different recording condition audio. The allowed prediction difference \(\delta < 0.05\) is highlighted in green in the upper plot. The lower plot shows the distributions of the two predictions.

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary1.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary4.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary5.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary6.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-boundary7.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile1.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile4.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile5.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile6.png
../../../_images/visualization_imda-nsc-read-speech-balanced-2.6.0-headset-mobile7.png