Robustness background noise¶
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
|---|---|---|---|---|
Overall Score |
25.0% passed tests (6 passed / 18 failed). |
41.7% passed tests (10 passed / 14 failed). |
41.7% passed tests (10 passed / 14 failed). |
29.2% passed tests (7 passed / 17 failed). |
Change Ccc Babble Noise¶
Data |
Change CCC Babble Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.04 |
-0.01 |
-0.00 |
0.00 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.08 |
-0.00 |
-0.01 |
-0.07 |
mean |
-0.02 |
-0.01 |
-0.01 |
-0.04 |
Change Ccc Coughing¶
Data |
Change CCC Coughing |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.02 |
-0.01 |
-0.02 |
-0.04 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.05 |
-0.06 |
-0.07 |
-0.05 |
mean |
-0.02 |
-0.03 |
-0.05 |
-0.04 |
Change Ccc Environmental Noise¶
Data |
Change CCC Environmental Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.01 |
-0.02 |
-0.01 |
-0.03 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.06 |
-0.01 |
-0.01 |
-0.05 |
mean |
-0.02 |
-0.01 |
-0.01 |
-0.04 |
Change Ccc Music¶
Data |
Change CCC Music |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.03 |
-0.02 |
-0.01 |
-0.02 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.05 |
-0.01 |
-0.01 |
-0.05 |
mean |
-0.01 |
-0.01 |
-0.01 |
-0.04 |
Change Ccc Sneezing¶
Data |
Change CCC Sneezing |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.04 |
0.01 |
-0.03 |
-0.02 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.05 |
-0.04 |
-0.07 |
-0.04 |
mean |
-0.01 |
-0.01 |
-0.05 |
-0.03 |
Change Ccc White Noise¶
Data |
Change CCC White Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.08 |
-0.05 |
-0.02 |
0.01 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
-0.17 |
-0.06 |
-0.04 |
-0.06 |
mean |
-0.05 |
-0.06 |
-0.03 |
-0.02 |
Percentage Unchanged Predictions Babble Noise¶
Data |
Percentage Unchanged Predictions Babble Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.73 |
0.91 |
0.84 |
0.54 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.58 |
0.89 |
0.81 |
0.53 |
mean |
0.66 |
0.90 |
0.82 |
0.54 |
Percentage Unchanged Predictions Coughing¶
Data |
Percentage Unchanged Predictions Coughing |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.71 |
0.49 |
0.51 |
0.52 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.70 |
0.46 |
0.47 |
0.65 |
mean |
0.70 |
0.47 |
0.49 |
0.58 |
Percentage Unchanged Predictions Environmental Noise¶
Data |
Percentage Unchanged Predictions Environmental Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.69 |
0.82 |
0.81 |
0.59 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.64 |
0.82 |
0.83 |
0.57 |
mean |
0.67 |
0.82 |
0.82 |
0.58 |
Percentage Unchanged Predictions Music¶
Data |
Percentage Unchanged Predictions Music |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.71 |
0.87 |
0.86 |
0.56 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.64 |
0.86 |
0.87 |
0.55 |
mean |
0.68 |
0.86 |
0.86 |
0.56 |
Percentage Unchanged Predictions Sneezing¶
Data |
Percentage Unchanged Predictions Sneezing |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.73 |
0.54 |
0.36 |
0.50 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.64 |
0.48 |
0.38 |
0.62 |
mean |
0.69 |
0.51 |
0.37 |
0.56 |
Percentage Unchanged Predictions White Noise¶
Data |
Percentage Unchanged Predictions White Noise |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
iemocap-2.3.0-emotion.dimensions.test.gold_standard |
0.39 |
0.52 |
0.63 |
0.37 |
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard |
0.39 |
0.49 |
0.56 |
0.42 |
mean |
0.39 |
0.51 |
0.59 |
0.40 |
Visualization Babble Noise¶
Difference of predictions for clean audio and audio with added babble noise. The allowed prediction difference is highlighted in green in the upper plot. The lower plot shows the distributions of the two predictions.
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|