Fairness sex

Overall scores

	w2v2-L	hubert-L	wavlm	data2vec
Overall Score	96.9% passed tests (31 passed / 1 failed).	96.9% passed tests (31 passed / 1 failed).	96.9% passed tests (31 passed / 1 failed).	90.6% passed tests (29 passed / 3 failed).

Concordance Correlation Coeff Female

CCC female - CCC combined.

Threshold: 0.075

Data	Concordance Correlation Coeff Female
	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	0.00	-0.01	-0.01	-0.00
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard	-0.05	-0.03	-0.02	-0.05
mean	-0.03	-0.02	-0.01	-0.03

Concordance Correlation Coeff Male

CCC male - CCC combined.

Threshold: 0.075

Data	Concordance Correlation Coeff Male
	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	-0.00	0.01	0.01	0.00
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard	0.04	0.02	0.01	0.04
mean	0.02	0.01	0.01	0.02

Precision Per Bin Female

Precision per bin female - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data	(-inf, 0.25]				(0.25, 0.5]				(0.5, 0.75]				(0.75, inf]
	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	-0.03	0.03	0.01	-0.03	0.03	0.01	-0.01	0.01	0.00	-0.01	0.01	-0.01	0.06	0.04	0.15	0.03
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard					0.08	0.09	0.07	0.12	-0.01	0.00	0.01	-0.01	0.11	0.11	0.09	0.00
mean	-0.03	0.03	0.01	-0.03	0.06	0.05	0.03	0.07	-0.01	-0.01	0.01	-0.01	0.08	0.07	0.12	0.01

Precision Per Bin Male

Precision per bin male - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data	(-inf, 0.25]				(0.25, 0.5]				(0.5, 0.75]				(0.75, inf]
	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	0.01	-0.01	-0.01	0.01	-0.03	-0.01	0.01	-0.01	-0.00	0.01	-0.01	0.01	-0.04	-0.03	-0.08	-0.03
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard					-0.04	-0.06	-0.05	-0.05	0.01	-0.00	-0.01	0.02	-0.05	-0.05	-0.06	-0.00
mean	0.01	-0.01	-0.01	0.01	-0.04	-0.03	-0.02	-0.03	0.01	0.01	-0.01	0.01	-0.04	-0.04	-0.07	-0.01

Recall Per Bin Female

Recall per bin female - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data	(-inf, 0.25]				(0.25, 0.5]				(0.5, 0.75]				(0.75, inf]
	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	-0.04	-0.01	-0.02	-0.03	0.04	-0.01	0.03	0.01	0.03	0.04	0.02	0.02	-0.03	-0.04	-0.06	0.01
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard					-0.07	-0.03	-0.04	-0.11	0.09	0.08	0.07	0.06	-0.08	-0.08	0.01	0.00
mean	-0.04	-0.01	-0.02	-0.03	-0.02	-0.02	-0.01	-0.05	0.06	0.06	0.05	0.04	-0.06	-0.06	-0.02	0.01

Recall Per Bin Male

Recall per bin male - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data	(-inf, 0.25]				(0.25, 0.5]				(0.5, 0.75]				(0.75, inf]
	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec	w2v2-L	hubert-L	wavlm	data2vec
iemocap-2.3.0-full	0.04	0.01	0.02	0.03	-0.04	0.01	-0.03	-0.01	-0.03	-0.04	-0.02	-0.02	0.03	0.04	0.06	-0.01
msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard					0.07	0.03	0.04	0.11	-0.09	-0.08	-0.07	-0.06	0.08	0.08	-0.01	0.00
mean	0.04	0.01	0.02	0.03	0.02	0.02	0.01	0.05	-0.06	-0.06	-0.05	-0.04	0.06	0.06	0.02	-0.01

Visualization

w2v2-L	hubert-L	wavlm	data2vec