Robustness simulated recording condition

Overall scores

CNN14

w2v2-b

hubert-b

axlstm

Overall Score

0.0% passed tests (0 passed / 6 failed).

0.0% passed tests (0 passed / 6 failed).

0.0% passed tests (0 passed / 6 failed).

0.0% passed tests (0 passed / 6 failed).

Percentage Unchanged Predictions Simulated Position

Threshold: 0.8

Data

Percentage Unchanged Predictions Simulated Position

CNN14

w2v2-b

hubert-b

axlstm

emovo-1.2.1-emotion.test

0.49

0.58

0.62

0.54

imda-nsc-read-speech-balanced-2.6.0-headset

0.62

0.64

0.78

0.61

timit-1.4.1-files

0.37

0.72

0.73

0.53

mean

0.49

0.65

0.71

0.56

Percentage Unchanged Predictions Simulated Room

Threshold: 0.8

Data

Percentage Unchanged Predictions Simulated Room

CNN14

w2v2-b

hubert-b

axlstm

emovo-1.2.1-emotion.test

0.36

0.46

0.58

0.44

imda-nsc-read-speech-balanced-2.6.0-headset

0.44

0.66

0.70

0.48

timit-1.4.1-files

0.34

0.63

0.70

0.42

mean

0.38

0.58

0.66

0.45

Visualization Simulated Position

Difference of predictions for audio with a baseline simulated position and audio with a different simulated position. The allowed prediction difference \(\delta < 0.05\) is highlighted in green in the upper plot. The lower plot shows the distributions of the two predictions.

CNN14

w2v2-b

hubert-b

axlstm

../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test1.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test2.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test3.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset1.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset2.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset3.png
../../../_images/visualization-simulated-position_timit-1.4.1-files.png
../../../_images/visualization-simulated-position_timit-1.4.1-files1.png
../../../_images/visualization-simulated-position_timit-1.4.1-files2.png
../../../_images/visualization-simulated-position_timit-1.4.1-files3.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test1.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test2.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test3.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset1.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset2.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset3.png
../../../_images/visualization-simulated-room_timit-1.4.1-files.png
../../../_images/visualization-simulated-room_timit-1.4.1-files1.png
../../../_images/visualization-simulated-room_timit-1.4.1-files2.png
../../../_images/visualization-simulated-room_timit-1.4.1-files3.png