Fairness pitch

Overall scores

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

Overall Score

100.0% passed tests (27 passed / 0 failed).

100.0% passed tests (27 passed / 0 failed).

100.0% passed tests (27 passed / 0 failed).

96.3% passed tests (26 passed / 1 failed).

100.0% passed tests (27 passed / 0 failed).

Precision Per Class High Pitch

Precision high pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.02

-0.03

-0.03

-0.04

-0.02

-0.06

-0.04

-0.01

-0.05

-0.08

0.04

0.03

0.02

0.03

0.05

-0.00

-0.02

-0.03

-0.02

-0.02

mean

-0.02

-0.03

-0.03

-0.04

-0.02

-0.06

-0.04

-0.01

-0.05

-0.08

0.04

0.03

0.02

0.03

0.05

0.00

-0.02

-0.03

-0.02

-0.02

Precision Per Class Low Pitch

Precision low pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.02

0.05

0.08

0.11

0.04

0.06

0.06

0.03

0.08

0.06

-0.04

-0.04

-0.03

-0.02

-0.02

0.01

0.03

0.05

0.05

0.05

mean

0.02

0.05

0.08

0.11

0.04

0.06

0.06

0.03

0.08

0.06

-0.04

-0.04

-0.03

-0.02

-0.02

0.01

0.03

0.05

0.05

0.05

Precision Per Class Medium Pitch

Precision medium pitch - precision combined.

Threshold: 0.1

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.01

0.01

-0.00

0.01

0.01

0.04

0.01

-0.01

0.00

0.02

0.03

0.03

0.02

0.01

-0.00

-0.01

-0.01

-0.02

-0.02

-0.01

mean

0.01

0.01

0.00

0.01

0.01

0.04

0.01

-0.01

0.00

0.02

0.03

0.03

0.02

0.01

0.00

-0.01

-0.01

-0.02

-0.02

-0.01

Recall Per Class High Pitch

Recall high pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.06

0.06

0.03

-0.05

0.11

0.07

0.06

0.04

0.04

-0.08

-0.16

-0.16

-0.10

-0.17

-0.22

0.04

0.02

0.03

0.07

0.21

mean

0.06

0.06

0.03

-0.05

0.11

0.07

0.06

0.04

0.04

-0.08

-0.16

-0.16

-0.10

-0.17

-0.22

0.04

0.02

0.03

0.07

0.21

Recall Per Class Low Pitch

Recall low pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.13

-0.22

-0.11

-0.14

-0.17

-0.10

-0.12

-0.08

-0.08

0.05

0.11

0.12

0.10

0.16

0.16

0.04

0.17

0.14

0.12

-0.03

mean

-0.13

-0.22

-0.11

-0.14

-0.17

-0.10

-0.12

-0.08

-0.08

0.05

0.11

0.12

0.10

0.16

0.16

0.04

0.17

0.14

0.12

-0.03

Recall Per Class Medium Pitch

Recall medium pitch - recall combined.

Threshold: 0.225

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.06

0.16

0.08

0.19

0.06

0.03

0.06

0.04

0.04

0.03

0.05

0.04

0.00

0.01

0.06

-0.09

-0.20

-0.17

-0.20

-0.18

mean

0.06

0.16

0.08

0.19

0.06

0.03

0.06

0.04

0.04

0.03

0.05

0.04

0.00

0.01

0.06

-0.09

-0.20

-0.17

-0.20

-0.18

Unweighted Average Recall High Pitch

UAR high pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall High Pitch

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.01

-0.01

0.00

-0.03

0.01

mean

0.01

-0.01

0.00

-0.03

0.01

Unweighted Average Recall Low Pitch

UAR low pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Low Pitch

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

-0.02

-0.01

0.01

0.01

0.00

mean

-0.02

-0.01

0.01

0.01

0.00

Unweighted Average Recall Medium Pitch

UAR medium pitch - UAR combined.

Threshold: 0.075

Data

Unweighted Average Recall Medium Pitch

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

msppodcast-2.6.1-emotion.categories.test-1.gold_standard

0.01

0.01

-0.01

0.01

-0.01

mean

0.01

0.01

-0.01

0.01

-0.01

Visualization

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high1.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high2.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high3.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_high4.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low1.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low2.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low3.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_low4.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium1.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium2.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium3.png
../../../_images/visualization_msppodcast-2.6.1-emotion.categories.test-1.gold_standard_medium4.png