Robustness simulated recording condition

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

0.0% passed tests (0 passed / 6 failed).

0.0% passed tests (0 passed / 6 failed).

33.3% passed tests (2 passed / 4 failed).

0.0% passed tests (0 passed / 6 failed).

Percentage Unchanged Predictions Simulated Position

Threshold: 0.8

Data

Percentage Unchanged Predictions Simulated Position

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

emovo-1.2.1-emotion.test

0.77

0.72

0.78

0.74

imda-nsc-read-speech-balanced-2.6.0-headset

0.80

0.77

0.86

0.79

timit-1.4.1-files

0.70

0.75

0.84

0.78

mean

0.76

0.75

0.83

0.77

Percentage Unchanged Predictions Simulated Room

Threshold: 0.8

Data

Percentage Unchanged Predictions Simulated Room

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

emovo-1.2.1-emotion.test

0.65

0.64

0.76

0.65

imda-nsc-read-speech-balanced-2.6.0-headset

0.66

0.69

0.78

0.67

timit-1.4.1-files

0.61

0.71

0.77

0.50

mean

0.64

0.68

0.77

0.61

Visualization Simulated Position

Confusion Matrix showing the shift from the predictions of audio with a baseline simulated position to the predictions of audio with a different simulated position.

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test27.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test22.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test28.png
../../../_images/visualization-simulated-position_emovo-1.2.1-emotion.test29.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset27.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset22.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset28.png
../../../_images/visualization-simulated-position_imda-nsc-read-speech-balanced-2.6.0-headset29.png
../../../_images/visualization-simulated-position_timit-1.4.1-files27.png
../../../_images/visualization-simulated-position_timit-1.4.1-files22.png
../../../_images/visualization-simulated-position_timit-1.4.1-files28.png
../../../_images/visualization-simulated-position_timit-1.4.1-files29.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test27.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test22.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test28.png
../../../_images/visualization-simulated-room_emovo-1.2.1-emotion.test29.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset27.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset22.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset28.png
../../../_images/visualization-simulated-room_imda-nsc-read-speech-balanced-2.6.0-headset29.png
../../../_images/visualization-simulated-room_timit-1.4.1-files27.png
../../../_images/visualization-simulated-room_timit-1.4.1-files22.png
../../../_images/visualization-simulated-room_timit-1.4.1-files28.png
../../../_images/visualization-simulated-room_timit-1.4.1-files29.png