Robustness spectral tilt¶
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|
|---|---|---|---|---|
Overall Score |
65.0% passed tests (13 passed / 7 failed). |
90.0% passed tests (18 passed / 2 failed). |
75.0% passed tests (15 passed / 5 failed). |
65.0% passed tests (13 passed / 7 failed). |
Change Uar Downward Tilt¶
Data |
Change UAR Downward Tilt |
|||
|---|---|---|---|---|
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
-0.01 |
-0.01 |
0.01 |
-0.04 |
emovo-1.2.1-emotion.test |
0.05 |
0.02 |
0.00 |
0.02 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
-0.03 |
-0.01 |
-0.00 |
-0.01 |
meld-1.3.1-emotion.categories.test.gold_standard |
-0.00 |
0.01 |
-0.00 |
-0.00 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
-0.01 |
0.00 |
-0.00 |
-0.02 |
mean |
0.00 |
0.00 |
0.00 |
-0.01 |
Change Uar Upward Tilt¶
Data |
Change UAR Upward Tilt |
|||
|---|---|---|---|---|
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.01 |
-0.03 |
-0.02 |
0.02 |
emovo-1.2.1-emotion.test |
0.01 |
-0.01 |
-0.02 |
-0.03 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
0.06 |
-0.02 |
-0.03 |
-0.01 |
meld-1.3.1-emotion.categories.test.gold_standard |
-0.02 |
-0.01 |
-0.02 |
-0.02 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
-0.04 |
-0.01 |
-0.02 |
0.00 |
mean |
0.00 |
-0.02 |
-0.02 |
-0.01 |
Percentage Unchanged Predictions Downward Tilt¶
Data |
Percentage Unchanged Predictions Downward Tilt |
|||
|---|---|---|---|---|
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.96 |
0.90 |
0.97 |
0.87 |
emovo-1.2.1-emotion.test |
0.82 |
0.92 |
0.95 |
0.85 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
0.90 |
0.92 |
0.97 |
0.85 |
meld-1.3.1-emotion.categories.test.gold_standard |
0.82 |
0.90 |
0.94 |
0.86 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
0.86 |
0.94 |
0.97 |
0.83 |
mean |
0.87 |
0.92 |
0.96 |
0.85 |
Percentage Unchanged Predictions Upward Tilt¶
Data |
Percentage Unchanged Predictions Upward Tilt |
|||
|---|---|---|---|---|
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.84 |
0.83 |
0.95 |
0.78 |
emovo-1.2.1-emotion.test |
0.79 |
0.85 |
0.92 |
0.81 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
0.77 |
0.82 |
0.91 |
0.80 |
meld-1.3.1-emotion.categories.test.gold_standard |
0.66 |
0.85 |
0.85 |
0.83 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
0.72 |
0.89 |
0.92 |
0.77 |
mean |
0.76 |
0.85 |
0.91 |
0.80 |
Visualization Downward Tilt¶
Confusion Matrix showing the shift from the predictions of original audio to the predictions of audio with a downward spectral tilt.
CNN14-cat |
w2v2-b-cat |
hubert-b-cat |
axlstm-cat |
|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|