Correctness classification

Overall scores

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

Overall Score

49.0% passed tests (49 passed / 51 failed).

52.0% passed tests (52 passed / 48 failed).

66.0% passed tests (66 passed / 34 failed).

50.0% passed tests (50 passed / 50 failed).

48.0% passed tests (48 passed / 52 failed).

Precision Per Class

Threshold: 0.5

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

crema-d-1.2.0-emotion.categories.test.gold_standard

0.49

0.38

0.62

0.62

0.60

0.30

0.29

0.47

0.50

0.00

0.85

0.81

0.90

0.44

0.64

0.09

0.09

0.10

0.07

0.07

danish-emotional-speech-1.1.1-emotion.test

0.60

0.57

0.64

0.70

0.61

0.52

0.58

0.68

1.00

0.00

0.40

0.39

0.34

0.16

0.35

0.44

0.47

0.41

0.33

0.37

emodb-1.2.0-emotion.categories.test.gold_standard

0.73

0.75

0.77

0.69

0.69

0.39

0.44

0.90

1.00

1.00

0.75

0.84

0.74

0.96

0.95

0.80

0.76

0.95

0.84

0.79

emovo-1.2.1-emotion.test

0.50

0.56

0.70

0.48

0.48

0.45

0.43

0.81

0.75

0.00

0.48

0.46

0.46

0.59

0.52

0.78

0.89

0.86

0.67

0.62

iemocap-2.3.0-emotion.categories.test.gold_standard

0.77

0.75

0.82

0.91

0.81

0.23

0.26

0.28

0.20

0.24

0.65

0.77

0.69

0.68

0.71

0.45

0.47

0.55

0.39

0.40

meld-1.3.1-emotion.categories.test.gold_standard

0.33

0.33

0.42

0.37

0.27

0.22

0.22

0.24

0.20

0.19

0.69

0.75

0.74

0.73

0.67

0.22

0.23

0.29

0.16

0.19

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.35

0.36

0.43

0.35

0.23

0.65

0.67

0.70

0.66

0.66

0.78

0.80

0.82

0.71

0.69

0.16

0.18

0.27

0.15

0.14

msppodcast-2.6.0-emotion.categories.test-2.gold_standard

0.10

0.10

0.17

0.11

0.09

0.53

0.53

0.60

0.58

0.58

0.73

0.74

0.74

0.69

0.67

0.09

0.10

0.18

0.06

0.07

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.78

0.69

0.81

0.52

0.52

0.54

0.46

0.67

0.83

1.00

0.71

0.62

0.51

0.85

0.77

0.78

1.00

1.00

0.59

0.66

ravdess-1.1.2-emotion.speech.test

0.62

0.57

0.79

0.62

0.63

0.00

0.00

0.67

0.00

0.00

0.20

0.00

0.30

0.31

0.31

0.47

0.46

0.51

0.52

0.50

mean

0.53

0.51

0.62

0.54

0.49

0.38

0.39

0.60

0.57

0.37

0.62

0.62

0.62

0.61

0.63

0.43

0.46

0.51

0.38

0.38

Recall Per Class

Threshold: 0.5

Data

anger

happiness

neutral

sadness

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

crema-d-1.2.0-emotion.categories.test.gold_standard

0.60

0.72

0.74

0.60

0.74

0.23

0.29

0.37

0.01

0.00

0.20

0.11

0.34

0.01

0.02

0.90

0.87

0.89

1.00

0.95

danish-emotional-speech-1.1.1-emotion.test

0.54

0.46

0.27

0.40

0.44

0.23

0.27

0.44

0.06

0.00

0.48

0.42

0.75

0.06

0.35

0.63

0.77

0.29

1.00

0.85

emodb-1.2.0-emotion.categories.test.gold_standard

0.65

0.65

0.98

1.00

1.00

0.56

0.59

0.33

0.07

0.04

0.67

0.59

0.96

0.81

0.74

0.74

0.93

0.74

0.96

1.00

emovo-1.2.1-emotion.test

0.82

0.74

0.83

0.86

0.93

0.30

0.37

0.26

0.04

0.00

0.39

0.55

0.94

0.43

0.37

0.69

0.57

0.38

0.96

0.82

iemocap-2.3.0-emotion.categories.test.gold_standard

0.57

0.64

0.66

0.52

0.68

0.47

0.53

0.62

0.38

0.30

0.29

0.21

0.39

0.14

0.22

0.76

0.87

0.72

0.92

0.89

meld-1.3.1-emotion.categories.test.gold_standard

0.29

0.41

0.51

0.40

0.63

0.73

0.76

0.73

0.58

0.39

0.10

0.08

0.19

0.07

0.12

0.39

0.31

0.37

0.43

0.33

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.63

0.73

0.73

0.55

0.67

0.73

0.75

0.78

0.65

0.48

0.44

0.46

0.57

0.49

0.48

0.52

0.51

0.57

0.50

0.47

msppodcast-2.6.0-emotion.categories.test-2.gold_standard

0.43

0.51

0.53

0.45

0.57

0.45

0.44

0.48

0.30

0.20

0.48

0.51

0.67

0.55

0.53

0.43

0.35

0.36

0.31

0.32

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.72

0.45

0.55

0.85

0.92

0.80

0.82

0.85

0.12

0.08

0.50

0.62

0.95

0.42

0.57

0.70

0.57

0.18

1.00

0.92

ravdess-1.1.2-emotion.speech.test

0.91

0.84

0.81

0.88

0.91

0.00

0.00

0.06

0.00

0.00

0.06

0.00

0.50

0.25

0.31

0.88

0.94

0.78

0.88

0.78

mean

0.62

0.61

0.66

0.65

0.75

0.45

0.48

0.49

0.22

0.15

0.36

0.36

0.63

0.32

0.37

0.66

0.67

0.53

0.80

0.73

Unweighted Average Precision

Threshold: 0.5

Data

Unweighted Average Precision

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

crema-d-1.2.0-emotion.categories.test.gold_standard

0.43

0.39

0.52

0.41

0.33

danish-emotional-speech-1.1.1-emotion.test

0.49

0.50

0.51

0.55

0.33

emodb-1.2.0-emotion.categories.test.gold_standard

0.67

0.70

0.84

0.87

0.86

emovo-1.2.1-emotion.test

0.55

0.59

0.71

0.62

0.40

iemocap-2.3.0-emotion.categories.test.gold_standard

0.52

0.56

0.58

0.54

0.54

meld-1.3.1-emotion.categories.test.gold_standard

0.36

0.38

0.42

0.37

0.33

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.49

0.50

0.55

0.47

0.43

msppodcast-2.6.0-emotion.categories.test-2.gold_standard

0.36

0.37

0.42

0.36

0.35

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.70

0.70

0.75

0.70

0.74

ravdess-1.1.2-emotion.speech.test

0.32

0.26

0.57

0.36

0.36

mean

0.49

0.49

0.59

0.53

0.47

Unweighted Average Recall

Threshold: 0.5

Data

Unweighted Average Recall

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

crema-d-1.2.0-emotion.categories.test.gold_standard

0.48

0.50

0.58

0.41

0.43

danish-emotional-speech-1.1.1-emotion.test

0.47

0.48

0.44

0.38

0.41

emodb-1.2.0-emotion.categories.test.gold_standard

0.65

0.69

0.75

0.71

0.69

emovo-1.2.1-emotion.test

0.55

0.56

0.60

0.57

0.53

iemocap-2.3.0-emotion.categories.test.gold_standard

0.52

0.56

0.60

0.49

0.52

meld-1.3.1-emotion.categories.test.gold_standard

0.38

0.39

0.45

0.37

0.37

msppodcast-2.6.0-emotion.categories.test-1.gold_standard

0.58

0.61

0.66

0.55

0.52

msppodcast-2.6.0-emotion.categories.test-2.gold_standard

0.45

0.45

0.51

0.40

0.40

polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard

0.68

0.62

0.63

0.60

0.62

ravdess-1.1.2-emotion.speech.test

0.46

0.45

0.54

0.50

0.50

mean

0.52

0.53

0.58

0.50

0.50

Visualization

w2v2-b-cat

w2v2-L-cat

w2v2-L-robust-cat

w2v2-L-vox-cat

w2v2-L-xls-r-cat

../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard22.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard23.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard24.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard25.png
../../../_images/visualization_crema-d-1.2.0-emotion.categories.test.gold_standard26.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test22.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test23.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test24.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test25.png
../../../_images/visualization_danish-emotional-speech-1.1.1-emotion.test26.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard22.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard23.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard24.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard25.png
../../../_images/visualization_emodb-1.2.0-emotion.categories.test.gold_standard26.png
../../../_images/visualization_emovo-1.2.1-emotion.test22.png
../../../_images/visualization_emovo-1.2.1-emotion.test23.png
../../../_images/visualization_emovo-1.2.1-emotion.test24.png
../../../_images/visualization_emovo-1.2.1-emotion.test25.png
../../../_images/visualization_emovo-1.2.1-emotion.test26.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard22.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard23.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard24.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard25.png
../../../_images/visualization_iemocap-2.3.0-emotion.categories.test.gold_standard26.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard22.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard23.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard24.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard25.png
../../../_images/visualization_meld-1.3.1-emotion.categories.test.gold_standard26.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard1.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard2.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard3.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-1.gold_standard4.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard1.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard2.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard3.png
../../../_images/visualization_msppodcast-2.6.0-emotion.categories.test-2.gold_standard4.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard22.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard23.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard24.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard25.png
../../../_images/visualization_polish-emotional-speech-1.1.1-emotion.categories.test.gold_standard26.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test22.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test23.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test24.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test25.png
../../../_images/visualization_ravdess-1.1.2-emotion.speech.test26.png