Fairness pitch

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

100.0% passed tests (27 passed / 0 failed).

100.0% passed tests (27 passed / 0 failed).

100.0% passed tests (27 passed / 0 failed).

96.3% passed tests (26 passed / 1 failed).

Precision Per Class High Pitch

Precision high pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.02

-0.02

-0.05

-0.02

-0.04

-0.06

-0.06

-0.04

0.05

0.04

0.05

0.07

0.01

-0.00

-0.01

-0.01

mean

-0.02

-0.02

-0.05

-0.02

-0.04

-0.06

-0.06

-0.04

0.05

0.04

0.05

0.07

0.01

0.00

-0.01

-0.01

Precision Per Class Low Pitch

Precision low pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.09

0.02

0.08

0.04

0.03

0.06

0.05

0.03

-0.07

-0.04

-0.03

-0.01

-0.00

0.01

0.04

0.04

mean

0.09

0.02

0.08

0.04

0.03

0.06

0.05

0.03

-0.07

-0.04

-0.03

-0.01

0.00

0.01

0.04

0.04

Precision Per Class Medium Pitch

Precision medium pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.00

0.01

0.03

0.02

0.02

0.04

0.06

0.03

0.04

0.03

0.01

-0.01

-0.01

-0.01

-0.02

-0.02

mean

0.00

0.01

0.03

0.02

0.02

0.04

0.06

0.03

0.04

0.03

0.01

-0.01

-0.01

-0.01

-0.02

-0.02

Recall Per Class High Pitch

Recall high pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.05

0.06

-0.02

0.13

-0.01

0.07

0.12

0.07

-0.12

-0.16

-0.16

-0.19

0.06

0.04

0.06

0.03

mean

0.05

0.06

-0.02

0.13

-0.01

0.07

0.12

0.07

-0.12

-0.16

-0.16

-0.19

0.06

0.04

0.06

0.03

Recall Per Class Low Pitch

Recall low pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.05

-0.13

-0.21

-0.25

-0.08

-0.10

-0.12

-0.04

0.04

0.11

0.14

0.15

0.14

0.04

0.07

0.08

mean

-0.05

-0.13

-0.21

-0.25

-0.08

-0.10

-0.12

-0.04

0.04

0.11

0.14

0.15

0.14

0.04

0.07

0.08

Recall Per Class Medium Pitch

Recall medium pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.00

0.06

0.22

0.13

0.09

0.03

0.00

-0.03

0.08

0.05

0.03

0.04

-0.20

-0.09

-0.13

-0.11

mean

0.00

0.06

0.22

0.13

0.09

0.03

0.00

-0.03

0.08

0.05

0.03

0.04

-0.20

-0.09

-0.13

-0.11

Unweighted Average Recall High Pitch

UAR high pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall High Pitch

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.00

0.01

0.00

0.01

mean

0.00

0.01

0.00

0.01

Unweighted Average Recall Low Pitch

UAR low pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Low Pitch

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.01

-0.02

-0.03

-0.01

mean

0.01

-0.02

-0.03

-0.01

Unweighted Average Recall Medium Pitch

UAR medium pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Medium Pitch

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.01

0.01

0.03

0.01

mean

-0.01

0.01

0.03

0.01

Visualization

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high5.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high6.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high7.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low5.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low6.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low7.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium5.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium6.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium7.png