Correctness consistency

54.1% passed tests (20 passed / 17 failed).

Samples In Expected High Range

Proportion of samples whose predictions fall into the expected value range of >= 0.55

Threshold: 0.75

Data

anger

fear

surprise

crema-d-1.2.0-emotion.categories.test.gold_standard

0.70

0.43

danish-emotional-speech-1.1.1-emotion.test

0.38

0.19

emodb-1.2.0-emotion.categories.test.gold_standard

1.00

0.91

emovo-1.2.1-emotion.test

0.94

0.40

0.60

iemocap-2.3.0-emotion.categories.test.gold_standard

0.75

0.41

meld-1.3.1-emotion.categories.test.gold_standard

0.89

0.74

0.78

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.88

0.30

ravdess-1.1.2-emotion.speech.test

0.91

0.72

1.00

mean

0.81

0.56

0.64

Samples In Expected Low Range

Proportion of samples whose predictions fall into the expected value range of <= 0.45

Threshold: 0.75

Data

boredom

sadness

crema-d-1.2.0-emotion.categories.test.gold_standard

0.51

danish-emotional-speech-1.1.1-emotion.test

0.88

emodb-1.2.0-emotion.categories.test.gold_standard

0.69

1.00

emovo-1.2.1-emotion.test

0.76

iemocap-2.3.0-emotion.categories.test.gold_standard

0.66

meld-1.3.1-emotion.categories.test.gold_standard

0.22

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.92

0.98

ravdess-1.1.2-emotion.speech.test

0.62

mean

0.80

0.70

Samples In Expected Neutral Range

Proportion of samples whose predictions fall into the expected value range of [0.3, 0.6]

Threshold: 0.75

Data

neutral

crema-d-1.2.0-emotion.categories.test.gold_standard

0.91

danish-emotional-speech-1.1.1-emotion.test

0.56

emodb-1.2.0-emotion.categories.test.gold_standard

0.93

emovo-1.2.1-emotion.test

0.85

iemocap-2.3.0-emotion.categories.test.gold_standard

0.93

meld-1.3.1-emotion.categories.test.gold_standard

0.76

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.82

ravdess-1.1.2-emotion.speech.test

0.88

mean

0.83

Visualization

Distribution of dimensional model predictions for samples with different categorical emotions. The expected range of model predictions is highlighted by the green brackground.

../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard3.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test3.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard3.png
../../../_images/visualization_emovo-1.2.1-emotion.test3.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard3.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard3.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard3.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test3.png