Fairness sex

Overall scores

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

Overall Score

90.6% passed tests (29 passed / 3 failed).

96.9% passed tests (31 passed / 1 failed).

100.0% passed tests (32 passed / 0 failed).

96.9% passed tests (31 passed / 1 failed).

93.8% passed tests (30 passed / 2 failed).

Concordance Correlation Coeff Female

CCC female - CCC combined.

Threshold: 0.075

Data

Concordance Correlation Coeff Female

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

-0.00

0.00

-0.00

0.00

-0.00

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

-0.02

-0.05

-0.03

-0.05

-0.03

mean

-0.01

-0.03

-0.01

-0.03

-0.01

Concordance Correlation Coeff Male

CCC male - CCC combined.

Threshold: 0.075

Data

Concordance Correlation Coeff Male

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

0.00

-0.00

0.00

-0.00

0.00

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

0.01

0.04

0.02

0.04

0.02

mean

0.01

0.02

0.01

0.02

0.01

Precision Per Bin Female

Precision per bin female - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

-0.01

-0.03

0.05

-0.01

-0.12

0.01

0.03

0.03

0.01

0.02

0.01

0.00

-0.01

-0.01

-0.00

0.05

0.06

0.02

0.04

0.07

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

0.12

0.08

0.02

0.10

0.11

-0.01

-0.01

-0.00

-0.01

-0.00

0.08

0.11

0.08

0.08

0.07

mean

-0.01

-0.03

0.05

-0.01

-0.12

0.07

0.06

0.03

0.06

0.07

0.00

-0.01

-0.01

-0.01

0.00

0.07

0.08

0.05

0.06

0.07

Precision Per Bin Male

Precision per bin male - precision per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

0.00

0.01

-0.02

0.00

0.04

-0.01

-0.03

-0.03

-0.01

-0.02

-0.01

-0.00

0.01

0.01

0.00

-0.04

-0.04

-0.02

-0.03

-0.05

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

-0.06

-0.04

-0.02

-0.05

-0.06

0.01

0.01

0.01

0.01

0.00

-0.05

-0.05

-0.04

-0.04

-0.05

mean

0.00

0.01

-0.02

0.00

0.04

-0.03

-0.04

-0.03

-0.03

-0.04

0.00

0.01

0.01

0.01

0.00

-0.04

-0.04

-0.03

-0.04

-0.05

Recall Per Bin Female

Recall per bin female - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

-0.05

-0.04

-0.02

-0.06

-0.01

0.02

0.04

0.01

0.01

-0.00

0.04

0.03

0.03

0.04

0.04

-0.01

-0.03

0.00

-0.04

-0.01

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

-0.07

-0.07

-0.03

-0.09

-0.07

0.10

0.09

0.05

0.09

0.08

-0.04

-0.08

-0.09

-0.07

-0.02

mean

-0.05

-0.04

-0.02

-0.06

-0.01

-0.03

-0.02

-0.01

-0.04

-0.04

0.07

0.06

0.04

0.07

0.06

-0.03

-0.06

-0.04

-0.06

-0.01

Recall Per Bin Male

Recall per bin male - recall per bin combined. Bins with too few samples are skipped.

Threshold: 0.1

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

iemocap-2.3.0-full

0.05

0.04

0.02

0.06

0.01

-0.02

-0.04

-0.01

-0.01

0.00

-0.04

-0.03

-0.03

-0.04

-0.04

0.01

0.03

0.00

0.04

0.01

msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard

0.07

0.07

0.03

0.09

0.07

-0.10

-0.09

-0.05

-0.09

-0.08

0.04

0.08

0.09

0.07

0.02

mean

0.05

0.04

0.02

0.06

0.01

0.03

0.02

0.01

0.04

0.04

-0.07

-0.06

-0.04

-0.07

-0.06

0.03

0.06

0.04

0.06

0.01

Visualization

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

../../../_images/visualization_iemocap-2.3.0-full_female12.png
../../../_images/visualization_iemocap-2.3.0-full_female15.png
../../../_images/visualization_iemocap-2.3.0-full_female16.png
../../../_images/visualization_iemocap-2.3.0-full_female17.png
../../../_images/visualization_iemocap-2.3.0-full_female18.png
../../../_images/visualization_iemocap-2.3.0-full_male12.png
../../../_images/visualization_iemocap-2.3.0-full_male15.png
../../../_images/visualization_iemocap-2.3.0-full_male16.png
../../../_images/visualization_iemocap-2.3.0-full_male17.png
../../../_images/visualization_iemocap-2.3.0-full_male18.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_female12.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_female15.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_female16.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_female17.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_female18.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_male12.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_male15.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_male16.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_male17.png
../../../_images/visualization_msppodcast-2.6.1-emotion.dimensions.test-1.gold_standard_male18.png