Robustness spectral tilt

Overall scores

	w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat
Overall Score	90.0% passed tests (18 passed / 2 failed).	90.0% passed tests (18 passed / 2 failed).	80.0% passed tests (16 passed / 4 failed).	85.0% passed tests (17 passed / 3 failed).	70.0% passed tests (14 passed / 6 failed).

Change Uar Downward Tilt

Threshold: -0.02

Data	Change UAR Downward Tilt
	w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	-0.01	0.01	0.00	0.03	-0.01
emovo-1.2.1-emotion.test	0.02	-0.02	0.02	0.01	0.02
iemocap-2.3.0-emotion.categories.test.gold_standard	-0.01	-0.00	0.01	0.00	-0.00
meld-1.3.1-emotion.categories.test.gold_standard	0.01	-0.01	0.00	0.00	0.01
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.00	-0.00	-0.00	-0.00	-0.00
mean	0.00	-0.00	0.01	0.01	0.00

Change Uar Upward Tilt

Threshold: -0.02

Data	Change UAR Upward Tilt
	w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	-0.03	0.02	-0.02	-0.01	0.00
emovo-1.2.1-emotion.test	-0.01	-0.02	-0.03	0.01	0.00
iemocap-2.3.0-emotion.categories.test.gold_standard	-0.02	-0.01	-0.01	-0.00	-0.02
meld-1.3.1-emotion.categories.test.gold_standard	-0.01	-0.00	-0.00	-0.02	-0.03
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	-0.01	-0.01	-0.02	-0.02	-0.02
mean	-0.02	-0.00	-0.02	-0.01	-0.01

Percentage Unchanged Predictions Downward Tilt

Threshold: 0.8

Data	Percentage Unchanged Predictions Downward Tilt
	w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.90	0.91	0.90	0.96	0.97
emovo-1.2.1-emotion.test	0.92	0.93	0.94	0.96	0.93
iemocap-2.3.0-emotion.categories.test.gold_standard	0.92	0.94	0.95	0.96	0.93
meld-1.3.1-emotion.categories.test.gold_standard	0.90	0.90	0.92	0.92	0.83
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.94	0.93	0.95	0.95	0.91
mean	0.92	0.92	0.93	0.95	0.91

Percentage Unchanged Predictions Upward Tilt

Threshold: 0.8

Data	Percentage Unchanged Predictions Upward Tilt
	w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.83	0.88	0.76	0.94	0.93
emovo-1.2.1-emotion.test	0.85	0.84	0.85	0.87	0.82
iemocap-2.3.0-emotion.categories.test.gold_standard	0.82	0.87	0.86	0.87	0.74
meld-1.3.1-emotion.categories.test.gold_standard	0.85	0.85	0.84	0.74	0.78
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.89	0.90	0.90	0.85	0.80
mean	0.85	0.87	0.84	0.85	0.81

Visualization Downward Tilt

Confusion Matrix showing the shift from the predictions of original audio to the predictions of audio with a downward spectral tilt.

w2v2-b-cat	w2v2-L-cat	w2v2-L-robust-cat	w2v2-L-vox-cat	w2v2-L-xls-r-cat