Fairness pitch

Overall scores

	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
Overall Score	100.0% passed tests (27 passed / 0 failed).	96.3% passed tests (26 passed / 1 failed).	92.6% passed tests (25 passed / 2 failed).	96.3% passed tests (26 passed / 1 failed).

Precision Per Class High Pitch

Precision high pitch - precision combined.

Threshold: 0.1

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	-0.03	-0.04	-0.04	-0.06	-0.04	-0.03	-0.06	-0.01	0.03	0.02	0.03	0.01	-0.02	-0.05	-0.05	-0.03
mean	-0.03	-0.04	-0.04	-0.06	-0.04	-0.03	-0.06	-0.01	0.03	0.02	0.03	0.01	-0.02	-0.05	-0.05	-0.03

Precision Per Class Low Pitch

Precision low pitch - precision combined.

Threshold: 0.1

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	0.05	0.16	0.11	0.11	0.06	0.05	0.12	0.04	-0.04	-0.04	-0.03	-0.02	0.03	0.09	0.03	0.03
mean	0.05	0.16	0.11	0.11	0.06	0.05	0.12	0.04	-0.04	-0.04	-0.03	-0.02	0.03	0.09	0.03	0.03

Precision Per Class Medium Pitch

Precision medium pitch - precision combined.

Threshold: 0.1

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	0.01	-0.01	-0.00	0.02	0.01	0.00	-0.00	-0.02	0.03	0.03	0.02	0.02	-0.01	-0.02	0.04	0.02
mean	0.01	-0.01	0.00	0.02	0.01	0.00	0.00	-0.02	0.03	0.03	0.02	0.02	-0.01	-0.02	0.04	0.02

Recall Per Class High Pitch

Recall high pitch - recall combined.

Threshold: 0.225

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	0.06	0.08	-0.03	-0.14	0.06	0.03	0.09	-0.01	-0.16	-0.12	-0.21	-0.09	0.02	0.04	-0.01	0.06
mean	0.06	0.08	-0.03	-0.14	0.06	0.03	0.09	-0.01	-0.16	-0.12	-0.21	-0.09	0.02	0.04	-0.01	0.06

Recall Per Class Low Pitch

Recall low pitch - recall combined.

Threshold: 0.225

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	-0.22	-0.16	-0.03	-0.05	-0.12	-0.09	-0.12	-0.04	0.12	0.13	0.18	0.07	0.17	0.06	0.14	0.09
mean	-0.22	-0.16	-0.03	-0.05	-0.12	-0.09	-0.12	-0.04	0.12	0.13	0.18	0.07	0.17	0.06	0.14	0.09

Recall Per Class Medium Pitch

Recall medium pitch - recall combined.

Threshold: 0.225

Data	anger				happiness				neutral				sadness
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	0.16	0.08	0.06	0.19	0.06	0.06	0.03	0.05	0.04	-0.00	0.03	0.01	-0.20	-0.11	-0.13	-0.15
mean	0.16	0.08	0.06	0.19	0.06	0.06	0.03	0.05	0.04	0.00	0.03	0.01	-0.20	-0.11	-0.13	-0.15

Unweighted Average Recall High Pitch

UAR high pitch - UAR combined.

Threshold: 0.075

Data	Unweighted Average Recall High Pitch
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	-0.01	0.01	-0.04	-0.05
mean	-0.01	0.01	-0.04	-0.05

Unweighted Average Recall Low Pitch

UAR low pitch - UAR combined.

Threshold: 0.075

Data	Unweighted Average Recall Low Pitch
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	-0.01	-0.01	0.04	0.02
mean	-0.01	-0.01	0.04	0.02

Unweighted Average Recall Medium Pitch

UAR medium pitch - UAR combined.

Threshold: 0.075

Data	Unweighted Average Recall Medium Pitch
	w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat
msppodcast-2.6.1-emotion.categories.test-1.gold_standard	0.01	0.01	-0.00	0.03
mean	0.01	0.01	0.00	0.03

Visualization

w2v2-L-cat	hubert-L-cat	wavlm-cat	data2vec-cat