Robustness background noise

55.0% passed tests (33 passed / 27 failed).

Change Uar Babble Noise

Threshold: -0.05

Data

Change UAR Babble Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.03

emovo-1.2.1-emotion.test

0.02

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.02

meld-1.3.1-emotion.categories.test.gold_standard

-0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.02

mean

0.00

Change Uar Coughing

Threshold: -0.05

Data

Change UAR Coughing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.04

emovo-1.2.1-emotion.test

-0.04

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.06

meld-1.3.1-emotion.categories.test.gold_standard

-0.02

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.10

mean

-0.04

Change Uar Environmental Noise

Threshold: -0.05

Data

Change UAR Environmental Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.01

emovo-1.2.1-emotion.test

0.02

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.01

meld-1.3.1-emotion.categories.test.gold_standard

0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.02

mean

-0.00

Change Uar Music

Threshold: -0.05

Data

Change UAR Music

crema-d-1.2.0-emotion.categories.test.gold_standard

-0.00

emovo-1.2.1-emotion.test

0.01

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.00

meld-1.3.1-emotion.categories.test.gold_standard

0.01

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.01

mean

0.00

Change Uar Sneezing

Threshold: -0.05

Data

Change UAR Sneezing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.06

emovo-1.2.1-emotion.test

-0.00

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.04

meld-1.3.1-emotion.categories.test.gold_standard

-0.03

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.10

mean

-0.02

Change Uar White Noise

Threshold: -0.05

Data

Change UAR White Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

-0.03

emovo-1.2.1-emotion.test

0.02

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.03

meld-1.3.1-emotion.categories.test.gold_standard

0.01

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.02

mean

-0.01

Percentage Unchanged Predictions Babble Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions Babble Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.91

emovo-1.2.1-emotion.test

0.80

iemocap-2.3.0-emotion.categories.test.gold_standard

0.89

meld-1.3.1-emotion.categories.test.gold_standard

0.93

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.80

mean

0.87

Percentage Unchanged Predictions Coughing

Threshold: 0.9

Data

Percentage Unchanged Predictions Coughing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.82

emovo-1.2.1-emotion.test

0.56

iemocap-2.3.0-emotion.categories.test.gold_standard

0.66

meld-1.3.1-emotion.categories.test.gold_standard

0.78

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.53

mean

0.67

Percentage Unchanged Predictions Environmental Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions Environmental Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.95

emovo-1.2.1-emotion.test

0.84

iemocap-2.3.0-emotion.categories.test.gold_standard

0.89

meld-1.3.1-emotion.categories.test.gold_standard

0.90

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.84

mean

0.88

Percentage Unchanged Predictions Music

Threshold: 0.9

Data

Percentage Unchanged Predictions Music

crema-d-1.2.0-emotion.categories.test.gold_standard

0.96

emovo-1.2.1-emotion.test

0.83

iemocap-2.3.0-emotion.categories.test.gold_standard

0.90

meld-1.3.1-emotion.categories.test.gold_standard

0.92

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.84

mean

0.89

Percentage Unchanged Predictions Sneezing

Threshold: 0.9

Data

Percentage Unchanged Predictions Sneezing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.81

emovo-1.2.1-emotion.test

0.54

iemocap-2.3.0-emotion.categories.test.gold_standard

0.65

meld-1.3.1-emotion.categories.test.gold_standard

0.77

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.50

mean

0.65

Percentage Unchanged Predictions White Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions White Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.91

emovo-1.2.1-emotion.test

0.79

iemocap-2.3.0-emotion.categories.test.gold_standard

0.86

meld-1.3.1-emotion.categories.test.gold_standard

0.82

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.79

mean

0.83

Visualization Babble Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added babble noise.

../../../_images/visualization-babble-noise_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-babble-noise_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-babble-noise_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-babble-noise_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-babble-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png

Visualization Coughing

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added coughing.

../../../_images/visualization-coughing_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-coughing_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-coughing_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-coughing_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-coughing_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png

Visualization Environmental Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added environmental noise.

../../../_images/visualization-environmental-noise_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-environmental-noise_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-environmental-noise_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-environmental-noise_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-environmental-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png

Visualization Music

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added music.

../../../_images/visualization-music_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-music_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-music_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-music_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-music_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png

Visualization Sneezing

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added sneezing.

../../../_images/visualization-sneezing_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-sneezing_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-sneezing_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-sneezing_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-sneezing_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png

Visualization White Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added white noise.

../../../_images/visualization-white-noise_crema-d-1.2.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-white-noise_emovo-1.2.1-emotion.test4.png
../../../_images/visualization-white-noise_iemocap-2.3.0-emotion.categories.test.gold_standard4.png
../../../_images/visualization-white-noise_meld-1.3.1-emotion.categories.test.gold_standard4.png
../../../_images/visualization-white-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png