Correctness classification¶

Overall scores¶
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
Overall Score	52.0% passed tests (52 passed / 48 failed).	64.0% passed tests (64 passed / 36 failed).	72.0% passed tests (72 passed / 28 failed).	51.0% passed tests (51 passed / 49 failed).

Precision Per Class¶

Threshold: 0.5¶
Data	anger				happiness				neutral				sadness
Data	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.38	0.53	0.64	0.43	0.29	0.33	0.64	0.26	0.81	0.87	0.88	0.84	0.09	0.15	0.12	0.09
danish-emotional-speech-1.1.1-emotion.test	0.57	0.62	0.92	0.75	0.58	0.68	0.76	0.42	0.39	0.33	0.36	0.34	0.47	0.55	0.40	0.56
emodb-1.2.0-emotion.categories.test.gold_standard	0.75	0.68	1.00	0.67	0.44	0.50	0.64	0.29	0.84	0.75	0.90	0.74	0.76	0.90	1.00	1.00
emovo-1.2.1-emotion.test	0.56	0.54	0.75	0.61	0.43	0.86	0.79	0.46	0.46	0.47	0.44	0.43	0.89	0.97	0.94	0.96
iemocap-2.3.0-emotion.categories.test.gold_standard	0.75	0.79	0.85	0.78	0.26	0.33	0.34	0.28	0.77	0.67	0.72	0.67	0.47	0.56	0.60	0.53
meld-1.3.1-emotion.categories.test.gold_standard	0.33	0.40	0.43	0.35	0.22	0.25	0.27	0.23	0.75	0.77	0.77	0.69	0.23	0.33	0.32	0.28
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.36	0.42	0.36	0.39	0.67	0.75	0.70	0.73	0.80	0.78	0.81	0.75	0.18	0.24	0.26	0.22
msppodcast-2.6.0-emotion.categories.test-2.gold_standard	0.10	0.18	0.18	0.14	0.53	0.63	0.51	0.59	0.74	0.72	0.75	0.72	0.10	0.20	0.13	0.12
polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard	0.69	0.67	0.86	0.76	0.46	0.58	0.91	0.59	0.62	0.45	0.54	0.40	1.00	1.00	1.00	0.90
ravdess-1.1.2-emotion.speech.test	0.57	0.62	1.00	0.55	0.00	0.00	0.70	0.00	0.00	0.24	0.37	0.24	0.46	0.70	0.84	0.59
mean	0.51	0.55	0.70	0.54	0.39	0.49	0.63	0.38	0.62	0.60	0.65	0.58	0.46	0.56	0.56	0.53

Threshold: 0.5¶
Data	anger				happiness				neutral				sadness
Data	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.72	0.65	0.81	0.83	0.29	0.25	0.51	0.12	0.11	0.59	0.43	0.23	0.87	0.72	0.82	0.79
danish-emotional-speech-1.1.1-emotion.test	0.46	0.29	0.21	0.17	0.27	0.29	0.50	0.48	0.42	0.83	0.81	0.69	0.77	0.33	0.35	0.35
emodb-1.2.0-emotion.categories.test.gold_standard	0.65	0.98	0.69	0.75	0.59	0.07	1.00	0.26	0.59	0.89	1.00	0.85	0.93	0.70	0.96	0.74
emovo-1.2.1-emotion.test	0.74	0.87	0.79	0.74	0.37	0.14	0.39	0.15	0.55	0.89	0.92	0.92	0.57	0.33	0.36	0.31
iemocap-2.3.0-emotion.categories.test.gold_standard	0.64	0.66	0.69	0.69	0.53	0.54	0.48	0.37	0.21	0.52	0.58	0.44	0.87	0.68	0.79	0.81
meld-1.3.1-emotion.categories.test.gold_standard	0.41	0.47	0.56	0.41	0.76	0.73	0.79	0.60	0.08	0.25	0.21	0.29	0.31	0.35	0.35	0.33
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.73	0.73	0.83	0.73	0.75	0.69	0.77	0.67	0.46	0.65	0.51	0.59	0.51	0.51	0.57	0.55
msppodcast-2.6.0-emotion.categories.test-2.gold_standard	0.51	0.55	0.53	0.49	0.44	0.41	0.55	0.41	0.51	0.74	0.51	0.68	0.35	0.36	0.46	0.25
polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard	0.45	0.65	0.78	0.48	0.82	0.55	0.78	0.42	0.62	0.82	1.00	0.95	0.57	0.22	0.40	0.22
ravdess-1.1.2-emotion.speech.test	0.84	0.88	0.69	0.81	0.00	0.00	0.59	0.00	0.00	0.56	0.88	0.31	0.94	0.59	0.66	0.81
mean	0.61	0.67	0.66	0.61	0.48	0.37	0.64	0.35	0.36	0.67	0.69	0.59	0.67	0.48	0.57	0.52

Threshold: 0.5¶
Data	Unweighted Average Precision
Data	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.39	0.47	0.57	0.41
danish-emotional-speech-1.1.1-emotion.test	0.50	0.55	0.61	0.52
emodb-1.2.0-emotion.categories.test.gold_standard	0.70	0.71	0.89	0.68
emovo-1.2.1-emotion.test	0.59	0.71	0.73	0.62
iemocap-2.3.0-emotion.categories.test.gold_standard	0.56	0.59	0.63	0.56
meld-1.3.1-emotion.categories.test.gold_standard	0.38	0.44	0.44	0.39
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.50	0.55	0.53	0.52
msppodcast-2.6.0-emotion.categories.test-2.gold_standard	0.37	0.43	0.39	0.39
polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard	0.70	0.67	0.83	0.66
ravdess-1.1.2-emotion.speech.test	0.26	0.39	0.73	0.35
mean	0.49	0.55	0.64	0.51

Threshold: 0.5¶
Data	Unweighted Average Recall
Data	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
crema-d-1.2.0-emotion.categories.test.gold_standard	0.50	0.55	0.64	0.49
danish-emotional-speech-1.1.1-emotion.test	0.48	0.43	0.47	0.42
emodb-1.2.0-emotion.categories.test.gold_standard	0.69	0.66	0.91	0.65
emovo-1.2.1-emotion.test	0.56	0.56	0.61	0.53
iemocap-2.3.0-emotion.categories.test.gold_standard	0.56	0.60	0.64	0.58
meld-1.3.1-emotion.categories.test.gold_standard	0.39	0.45	0.48	0.41
msppodcast-2.6.0-emotion.categories.test-1.gold_standard	0.61	0.65	0.67	0.63
msppodcast-2.6.0-emotion.categories.test-2.gold_standard	0.45	0.51	0.51	0.46
polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard	0.62	0.56	0.74	0.52
ravdess-1.1.2-emotion.speech.test	0.45	0.51	0.70	0.48
mean	0.53	0.55	0.64	0.52