Correctness distribution

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

52.5% passed tests (21 passed / 19 failed).

70.0% passed tests (28 passed / 12 failed).

52.5% passed tests (21 passed / 19 failed).

67.5% passed tests (27 passed / 13 failed).

Relative Difference Per Class

Threshold: 0.15

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

crema-d-1.2.0-emotion.categories.test.gold_standard

0.05

0.03

0.02

-0.04

-0.06

-0.01

-0.06

-0.04

-0.69

-0.56

-0.70

-0.47

0.69

0.54

0.74

0.55

danish-emotional-speech-1.1.1-emotion.test

-0.09

-0.02

-0.11

-0.19

-0.19

-0.14

-0.23

-0.19

0.00

0.05

0.00

0.38

0.27

0.11

0.34

-0.01

emodb-1.2.0-emotion.categories.test.gold_standard

0.25

-0.04

0.12

0.12

-0.13

0.08

-0.12

-0.13

-0.10

-0.02

-0.03

-0.07

-0.01

-0.01

0.04

0.07

emovo-1.2.1-emotion.test

0.13

0.16

0.18

0.08

-0.17

-0.09

-0.21

-0.16

-0.15

-0.04

0.02

0.01

0.18

-0.03

0.02

0.07

iemocap-2.3.0-emotion.categories.test.gold_standard

-0.04

-0.08

-0.10

-0.19

-0.09

0.13

0.02

0.04

-0.19

-0.20

-0.24

0.12

0.32

0.15

0.32

0.04

meld-1.3.1-emotion.categories.test.gold_standard

0.34

-0.02

-0.02

-0.02

0.05

0.42

0.29

0.39

-0.49

-0.48

-0.44

-0.33

0.10

0.08

0.17

-0.04

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.09

0.06

0.05

0.06

-0.10

0.04

-0.09

-0.03

-0.16

-0.22

-0.16

-0.23

0.16

0.12

0.19

0.20

msppodcast-2.6.0-emotion.categories.test-2.gold_standard

0.13

0.10

0.08

0.04

-0.21

-0.05

-0.16

-0.10

-0.11

-0.21

-0.18

-0.18

0.18

0.15

0.25

0.25

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.18

-0.02

0.04

0.03

-0.25

0.12

-0.11

-0.08

0.04

-0.08

0.15

0.00

0.04

-0.02

-0.09

0.05

ravdess-1.1.2-emotion.speech.test

0.10

0.13

-0.04

-0.11

-0.29

-0.29

-0.29

-0.02

0.08

-0.10

-0.14

0.11

0.11

0.25

0.46

0.02

mean

0.11

0.03

0.02

-0.02

-0.14

0.02

-0.10

-0.03

-0.18

-0.19

-0.17

-0.07

0.20

0.13

0.24

0.12

Visualization

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard45.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard27.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard46.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard47.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test35.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test27.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test36.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test37.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard35.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard27.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard36.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard37.png
../../../_images/visualization_emovo-1.2.1-emotion.test45.png
../../../_images/visualization_emovo-1.2.1-emotion.test27.png
../../../_images/visualization_emovo-1.2.1-emotion.test46.png
../../../_images/visualization_emovo-1.2.1-emotion.test47.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard45.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard27.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard46.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard47.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard55.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard27.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard56.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard57.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard33.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard5.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard34.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard35.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard13.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard5.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard14.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard15.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard35.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard27.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard36.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard37.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test35.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test27.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test36.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test37.png