Robustness background noise

56.7% passed tests (34 passed / 26 failed).

Change Uar Babble Noise

Threshold: -0.05

Data

Change UAR Babble Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

-0.01

emovo-1.2.1-emotion.test

0.04

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.01

meld-1.3.1-emotion.categories.test.gold_standard

-0.01

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.04

mean

-0.01

Change Uar Coughing

Threshold: -0.05

Data

Change UAR Coughing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.04

emovo-1.2.1-emotion.test

0.01

iemocap-2.3.0-emotion.categories.test.gold_standard

0.01

meld-1.3.1-emotion.categories.test.gold_standard

-0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.06

mean

0.00

Change Uar Environmental Noise

Threshold: -0.05

Data

Change UAR Environmental Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.00

emovo-1.2.1-emotion.test

0.04

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.00

meld-1.3.1-emotion.categories.test.gold_standard

-0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.05

mean

-0.00

Change Uar Music

Threshold: -0.05

Data

Change UAR Music

crema-d-1.2.0-emotion.categories.test.gold_standard

0.01

emovo-1.2.1-emotion.test

0.01

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.01

meld-1.3.1-emotion.categories.test.gold_standard

-0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.05

mean

-0.01

Change Uar Sneezing

Threshold: -0.05

Data

Change UAR Sneezing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.02

emovo-1.2.1-emotion.test

-0.01

iemocap-2.3.0-emotion.categories.test.gold_standard

0.01

meld-1.3.1-emotion.categories.test.gold_standard

0.01

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.03

mean

0.00

Change Uar White Noise

Threshold: -0.05

Data

Change UAR White Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.04

emovo-1.2.1-emotion.test

-0.00

iemocap-2.3.0-emotion.categories.test.gold_standard

0.00

meld-1.3.1-emotion.categories.test.gold_standard

-0.02

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.12

mean

-0.02

Percentage Unchanged Predictions Babble Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions Babble Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.94

emovo-1.2.1-emotion.test

0.85

iemocap-2.3.0-emotion.categories.test.gold_standard

0.93

meld-1.3.1-emotion.categories.test.gold_standard

0.90

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.72

mean

0.87

Percentage Unchanged Predictions Coughing

Threshold: 0.9

Data

Percentage Unchanged Predictions Coughing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.91

emovo-1.2.1-emotion.test

0.79

iemocap-2.3.0-emotion.categories.test.gold_standard

0.84

meld-1.3.1-emotion.categories.test.gold_standard

0.81

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.69

mean

0.81

Percentage Unchanged Predictions Environmental Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions Environmental Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.93

emovo-1.2.1-emotion.test

0.82

iemocap-2.3.0-emotion.categories.test.gold_standard

0.92

meld-1.3.1-emotion.categories.test.gold_standard

0.88

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.71

mean

0.85

Percentage Unchanged Predictions Music

Threshold: 0.9

Data

Percentage Unchanged Predictions Music

crema-d-1.2.0-emotion.categories.test.gold_standard

0.95

emovo-1.2.1-emotion.test

0.82

iemocap-2.3.0-emotion.categories.test.gold_standard

0.93

meld-1.3.1-emotion.categories.test.gold_standard

0.90

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.72

mean

0.86

Percentage Unchanged Predictions Sneezing

Threshold: 0.9

Data

Percentage Unchanged Predictions Sneezing

crema-d-1.2.0-emotion.categories.test.gold_standard

0.92

emovo-1.2.1-emotion.test

0.83

iemocap-2.3.0-emotion.categories.test.gold_standard

0.86

meld-1.3.1-emotion.categories.test.gold_standard

0.83

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.75

mean

0.84

Percentage Unchanged Predictions White Noise

Threshold: 0.9

Data

Percentage Unchanged Predictions White Noise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.85

emovo-1.2.1-emotion.test

0.68

iemocap-2.3.0-emotion.categories.test.gold_standard

0.84

meld-1.3.1-emotion.categories.test.gold_standard

0.75

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.46

mean

0.72

Visualization Babble Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added babble noise.

../../../_images/visualization-babble-noise_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-babble-noise_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-babble-noise_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-babble-noise_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-babble-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png

Visualization Coughing

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added coughing.

../../../_images/visualization-coughing_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-coughing_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-coughing_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-coughing_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-coughing_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png

Visualization Environmental Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added environmental noise.

../../../_images/visualization-environmental-noise_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-environmental-noise_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-environmental-noise_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-environmental-noise_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-environmental-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png

Visualization Music

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added music.

../../../_images/visualization-music_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-music_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-music_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-music_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-music_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png

Visualization Sneezing

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added sneezing.

../../../_images/visualization-sneezing_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-sneezing_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-sneezing_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-sneezing_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-sneezing_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png

Visualization White Noise

Confusion Matrix showing the shift from the predictions of the clean audio to the predictions of the audio with added white noise.

../../../_images/visualization-white-noise_crema-d-1.2.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-white-noise_emovo-1.2.1-emotion.test5.png
../../../_images/visualization-white-noise_iemocap-2.3.0-emotion.categories.test.gold_standard5.png
../../../_images/visualization-white-noise_meld-1.3.1-emotion.categories.test.gold_standard5.png
../../../_images/visualization-white-noise_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png