Fairness sex

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

100.0% passed tests (36 passed / 0 failed).

100.0% passed tests (36 passed / 0 failed).

100.0% passed tests (36 passed / 0 failed).

97.2% passed tests (35 passed / 1 failed).

Precision Per Class Female

Precision female - Precision combined.

Threshold: 0.075

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

-0.01

-0.01

-0.01

-0.03

0.06

-0.00

0.02

0.04

0.06

0.04

0.06

-0.01

0.01

0.01

0.01

-0.03

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.04

-0.02

-0.02

-0.05

-0.02

-0.05

-0.03

-0.01

0.05

0.05

0.04

0.01

-0.00

-0.01

-0.02

-0.03

mean

-0.03

-0.01

-0.01

-0.04

0.02

-0.03

-0.00

0.01

0.06

0.04

0.05

0.00

0.01

0.00

-0.01

-0.03

Precision Per Class Male

Precision male - Precision combined.

Threshold: 0.075

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

0.01

0.02

0.01

0.03

-0.07

0.00

-0.02

-0.03

-0.06

-0.04

-0.06

0.01

-0.01

-0.01

-0.01

0.03

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.07

0.02

0.02

0.09

0.02

0.07

0.04

0.01

-0.04

-0.03

-0.03

-0.00

0.00

0.02

0.02

0.04

mean

0.04

0.02

0.01

0.06

-0.03

0.04

0.01

-0.01

-0.05

-0.04

-0.04

0.01

-0.01

0.01

0.01

0.04

Recall Per Class Female

Recall female - Recall combined.

Threshold: 0.175

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

-0.04

0.02

0.03

0.01

0.03

-0.02

0.02

0.02

0.03

0.02

0.02

0.01

0.04

0.02

0.00

-0.04

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.01

-0.05

0.01

-0.03

0.02

0.03

0.06

0.04

-0.00

-0.07

-0.08

-0.14

-0.12

-0.04

-0.01

-0.11

mean

-0.01

-0.02

0.02

-0.01

0.03

0.00

0.04

0.03

0.01

-0.03

-0.03

-0.07

-0.04

-0.01

-0.01

-0.07

Recall Per Class Male

Recall female - Recall combined.

Threshold: 0.175

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

0.04

-0.02

-0.03

-0.01

-0.03

0.02

-0.02

-0.02

-0.03

-0.02

-0.02

-0.01

-0.04

-0.02

0.00

0.04

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.01

0.05

-0.01

0.03

-0.02

-0.03

-0.06

-0.04

0.00

0.07

0.08

0.14

0.12

0.04

0.01

0.11

mean

0.01

0.02

-0.02

0.01

-0.03

-0.00

-0.04

-0.03

-0.01

0.03

0.03

0.07

0.04

0.01

0.01

0.07

Unweighted Average Recall Female

UAR Female - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Female

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

0.01

0.01

0.02

0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

-0.02

-0.03

-0.01

-0.06

mean

-0.01

-0.01

0.01

-0.03

Unweighted Average Recall Male

UAR Male - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Male

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

iemocap-2.3.0-full

-0.01

-0.01

-0.02

-0.00

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.02

0.03

0.01

0.06

mean

0.01

0.01

-0.01

0.03

Visualization

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization_iemocap-2.3.0-full_female27.png
../../../_images/visualization_iemocap-2.3.0-full_female22.png
../../../_images/visualization_iemocap-2.3.0-full_female28.png
../../../_images/visualization_iemocap-2.3.0-full_female29.png
../../../_images/visualization_iemocap-2.3.0-full_male27.png
../../../_images/visualization_iemocap-2.3.0-full_male22.png
../../../_images/visualization_iemocap-2.3.0-full_male28.png
../../../_images/visualization_iemocap-2.3.0-full_male29.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_female5.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_female.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_female6.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_female7.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_male5.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_male.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_male6.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard_male7.png