Fairness pitch

Overall scores

	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
Overall Score	100.0% passed tests (15 passed / 0 failed).	100.0% passed tests (15 passed / 0 failed).	100.0% passed tests (15 passed / 0 failed).	86.7% passed tests (13 passed / 2 failed).	93.3% passed tests (14 passed / 1 failed).

Concordance Correlation Coeff High Pitch

CCC high pitch - CCC combined.

Threshold: 0.1

Data	Concordance Correlation Coeff High Pitch
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard	-0.05	-0.08	-0.04	-0.13	-0.11
mean	-0.05	-0.08	-0.04	-0.13	-0.11

Concordance Correlation Coeff Low Pitch

CCC low pitch - CCC combined.

Threshold: 0.1

Data	Concordance Correlation Coeff Low Pitch
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard	-0.02	0.01	0.02	0.03	0.02
mean	-0.02	0.01	0.02	0.03	0.02

Concordance Correlation Coeff Medium Pitch

CCC medium pitch - CCC combined.

Threshold: 0.1

Data	Concordance Correlation Coeff Medium Pitch
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard	0.06	0.07	0.02	0.12	0.08
mean	0.06	0.07	0.02	0.12	0.08

Precision Per Bin High Pitch

Precision per bin high pitch - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						-0.03	-0.02	-0.02	-0.07	-0.05	-0.01	-0.06	-0.01	-0.09	-0.07
mean						-0.03	-0.02	-0.02	-0.07	-0.05	-0.01	-0.06	-0.01	-0.09	-0.07

Precision Per Bin Low Pitch

Precision per bin low pitch - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						-0.00	-0.01	0.03	0.02	0.02	-0.01	0.03	-0.01	0.03	0.03
mean						0.00	-0.01	0.03	0.02	0.02	-0.01	0.03	-0.01	0.03	0.03

Precision Per Bin Medium Pitch

Precision per bin medium pitch - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						0.04	0.03	-0.01	0.05	0.03	0.02	0.04	0.02	0.06	0.04
mean						0.04	0.03	-0.01	0.05	0.03	0.02	0.04	0.02	0.06	0.04

Recall Per Bin High Pitch

Recall per bin high pitch - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						-0.05	-0.10	0.01	-0.12	-0.05	-0.01	-0.01	-0.03	-0.06	-0.07
mean						-0.05	-0.10	0.01	-0.12	-0.05	-0.01	-0.01	-0.03	-0.06	-0.07

Recall Per Bin Low Pitch

Recall per bin low pitch - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						0.09	0.10	-0.01	0.09	0.08	-0.04	-0.03	0.05	-0.00	0.01
mean						0.09	0.10	-0.01	0.09	0.08	-0.04	-0.03	0.05	0.00	0.01

Recall Per Bin Medium Pitch

Recall per bin medium pitch - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.125

Data	(-inf, 0.25]					(0.25, 0.5]					(0.5, 0.75]					(0.75, inf]
	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox	w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard						-0.03	0.00	-0.01	0.03	-0.03	0.05	0.05	-0.02	0.07	0.06
mean						-0.03	0.00	-0.01	0.03	-0.03	0.05	0.05	-0.02	0.07	0.06

Visualization

w2v2-b	w2v2-L	w2v2-L-robust	w2v2-L-xls-r	w2v2-L-vox