Robustness spectral tilt¶
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|
|---|---|---|---|---|
Overall Score |
90.0% passed tests (18 passed / 2 failed). |
95.0% passed tests (19 passed / 1 failed). |
90.0% passed tests (18 passed / 2 failed). |
80.0% passed tests (16 passed / 4 failed). |
Change Uar Downward Tilt¶
Data |
Change UAR Downward Tilt |
|||
|---|---|---|---|---|
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.01 |
0.01 |
0.03 |
0.02 |
emovo-1.2.1-emotion.test |
-0.02 |
0.01 |
0.00 |
0.00 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
-0.00 |
0.00 |
0.00 |
-0.00 |
meld-1.3.1-emotion.categories.test.gold_standard |
-0.01 |
-0.01 |
0.01 |
0.01 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
-0.00 |
0.00 |
-0.00 |
-0.00 |
mean |
-0.00 |
0.00 |
0.01 |
0.01 |
Change Uar Upward Tilt¶
Data |
Change UAR Upward Tilt |
|||
|---|---|---|---|---|
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.02 |
0.00 |
-0.01 |
-0.02 |
emovo-1.2.1-emotion.test |
-0.02 |
-0.01 |
-0.02 |
0.01 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
-0.01 |
-0.01 |
-0.01 |
-0.00 |
meld-1.3.1-emotion.categories.test.gold_standard |
-0.00 |
-0.02 |
-0.03 |
-0.02 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
-0.01 |
-0.00 |
-0.01 |
-0.01 |
mean |
-0.00 |
-0.01 |
-0.02 |
-0.01 |
Percentage Unchanged Predictions Downward Tilt¶
Data |
Percentage Unchanged Predictions Downward Tilt |
|||
|---|---|---|---|---|
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.91 |
0.94 |
0.91 |
0.88 |
emovo-1.2.1-emotion.test |
0.93 |
0.97 |
0.97 |
0.93 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
0.94 |
0.96 |
0.96 |
0.93 |
meld-1.3.1-emotion.categories.test.gold_standard |
0.90 |
0.93 |
0.92 |
0.84 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
0.93 |
0.97 |
0.93 |
0.94 |
mean |
0.92 |
0.95 |
0.94 |
0.90 |
Percentage Unchanged Predictions Upward Tilt¶
Data |
Percentage Unchanged Predictions Upward Tilt |
|||
|---|---|---|---|---|
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|
crema-d-1.2.0-emotion.categories.test.gold_standard |
0.88 |
0.88 |
0.86 |
0.77 |
emovo-1.2.1-emotion.test |
0.84 |
0.91 |
0.90 |
0.87 |
iemocap-2.3.0-emotion.categories.test.gold_standard |
0.87 |
0.90 |
0.90 |
0.83 |
meld-1.3.1-emotion.categories.test.gold_standard |
0.85 |
0.86 |
0.87 |
0.77 |
msppodcast-2.6.0-emotion.categories.test-1.gold_standard |
0.90 |
0.94 |
0.90 |
0.89 |
mean |
0.87 |
0.90 |
0.89 |
0.83 |
Visualization Downward Tilt¶
Confusion Matrix showing the shift from the predictions of original audio to the predictions of audio with a downward spectral tilt.
w2v2-L-cat |
hubert-L-cat |
wavlm-cat |
data2vec-cat |
|---|---|---|---|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|