Fairness accent

Overall scores

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

Overall Score

96.0% passed tests (119 passed / 5 failed).

100.0% passed tests (124 passed / 0 failed).

98.4% passed tests (122 passed / 2 failed).

100.0% passed tests (124 passed / 0 failed).

Relative Difference Per Class

Threshold: 0.225

Data

anger

happiness

neutral

sadness

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

speech-accent-archive-2.2.0-amharic

-0.05

-0.01

-0.01

-0.01

-0.04

-0.09

-0.03

-0.03

0.08

0.00

0.04

0.03

0.01

0.10

0.00

0.01

speech-accent-archive-2.2.0-arabic

-0.00

-0.00

0.00

-0.00

0.01

-0.00

-0.01

-0.01

-0.05

-0.02

-0.06

0.08

0.05

0.03

0.07

-0.07

speech-accent-archive-2.2.0-bengali

-0.02

0.02

0.02

-0.01

-0.05

-0.02

-0.01

-0.03

-0.06

-0.08

0.01

0.04

0.12

0.08

-0.02

0.01

speech-accent-archive-2.2.0-bulgarian

-0.05

0.00

-0.01

-0.01

-0.06

-0.08

-0.03

-0.03

-0.14

0.06

0.00

-0.02

0.25

0.02

0.03

0.07

speech-accent-archive-2.2.0-cantonese

-0.03

0.01

0.00

0.01

-0.01

0.02

0.01

-0.01

-0.06

-0.00

-0.01

0.07

0.09

-0.03

0.00

-0.07

speech-accent-archive-2.2.0-dutch

0.00

-0.01

-0.01

-0.01

0.04

-0.02

0.01

0.07

0.03

0.06

0.08

0.00

-0.08

-0.02

-0.09

-0.06

speech-accent-archive-2.2.0-english

-0.01

0.02

-0.01

-0.01

-0.01

-0.03

-0.01

-0.05

0.01

0.08

0.09

0.00

0.01

-0.06

-0.07

0.05

speech-accent-archive-2.2.0-farsi

-0.05

0.00

-0.01

-0.01

0.12

-0.02

-0.06

-0.02

-0.14

0.02

0.11

0.05

0.07

-0.00

-0.04

-0.02

speech-accent-archive-2.2.0-french

-0.04

-0.01

-0.01

-0.01

0.04

-0.00

-0.04

-0.01

-0.11

-0.11

-0.16

-0.04

0.11

0.13

0.20

0.06

speech-accent-archive-2.2.0-german

0.05

-0.01

-0.01

0.00

0.20

0.05

0.03

-0.02

-0.01

0.03

-0.01

0.00

-0.24

-0.07

-0.01

0.01

speech-accent-archive-2.2.0-greek

0.05

0.01

0.02

0.00

0.03

-0.00

0.02

0.04

0.07

0.08

0.02

-0.08

-0.15

-0.09

-0.06

0.04

speech-accent-archive-2.2.0-hindi

0.03

-0.01

-0.01

0.01

-0.00

0.07

0.07

-0.02

-0.15

-0.22

-0.08

-0.03

0.12

0.17

0.01

0.04

speech-accent-archive-2.2.0-italian

0.02

-0.01

-0.01

0.02

0.01

0.04

0.04

-0.02

-0.04

-0.00

-0.01

-0.00

0.01

-0.03

-0.02

0.00

speech-accent-archive-2.2.0-japanese

-0.02

-0.00

-0.01

-0.01

-0.03

0.01

0.02

-0.03

0.12

0.11

0.06

0.00

-0.06

-0.12

-0.07

0.04

speech-accent-archive-2.2.0-korean

-0.01

-0.00

-0.01

-0.01

0.01

0.08

0.02

-0.01

0.04

0.08

0.03

0.13

-0.04

-0.16

-0.04

-0.11

speech-accent-archive-2.2.0-macedonian

0.10

-0.00

0.00

0.04

0.06

0.06

0.06

-0.02

-0.00

0.04

0.19

0.17

-0.16

-0.10

-0.25

-0.18

speech-accent-archive-2.2.0-mandarin

0.05

0.03

0.03

-0.00

0.01

0.13

0.02

0.02

0.06

-0.17

0.09

0.00

-0.12

0.00

-0.13

-0.02

speech-accent-archive-2.2.0-nepali

-0.00

-0.01

0.00

-0.00

-0.03

-0.02

0.01

0.03

0.22

0.01

-0.01

-0.07

-0.19

0.02

-0.00

0.04

speech-accent-archive-2.2.0-polish

-0.01

0.04

0.01

0.00

0.02

-0.01

-0.05

-0.05

-0.09

0.03

-0.01

0.04

0.08

-0.05

0.05

0.00

speech-accent-archive-2.2.0-portuguese

-0.03

-0.01

-0.01

-0.01

-0.05

-0.05

-0.04

0.00

0.05

-0.01

-0.04

0.01

0.03

0.07

0.08

0.00

speech-accent-archive-2.2.0-romanian

-0.03

-0.01

-0.01

0.00

-0.01

-0.07

-0.03

-0.05

-0.21

0.17

-0.01

-0.04

0.25

-0.09

0.05

0.08

speech-accent-archive-2.2.0-russian

-0.05

-0.01

-0.01

-0.01

-0.03

0.06

0.04

0.06

0.05

-0.03

0.06

-0.02

0.03

-0.02

-0.08

-0.04

speech-accent-archive-2.2.0-serbian

-0.05

-0.01

-0.01

-0.01

0.02

-0.07

-0.05

-0.02

-0.03

-0.01

-0.14

-0.17

0.07

0.09

0.20

0.21

speech-accent-archive-2.2.0-spanish

-0.00

-0.01

-0.01

-0.01

0.02

-0.05

-0.04

-0.02

-0.05

-0.07

-0.15

-0.04

0.03

0.13

0.19

0.07

speech-accent-archive-2.2.0-swedish

-0.05

-0.01

-0.01

-0.01

-0.04

0.08

0.04

0.07

0.06

-0.02

-0.03

-0.07

0.03

-0.04

0.00

0.02

speech-accent-archive-2.2.0-tagalog

-0.00

0.01

-0.01

0.01

-0.05

-0.01

0.03

0.08

0.03

-0.05

-0.05

-0.05

0.02

0.05

0.03

-0.04

speech-accent-archive-2.2.0-thai

0.05

-0.00

0.01

0.02

-0.05

-0.02

-0.02

-0.00

0.06

0.02

0.02

0.03

-0.06

0.00

-0.02

-0.04

speech-accent-archive-2.2.0-turkish

0.09

0.03

0.00

0.07

0.04

0.02

0.04

0.12

-0.04

0.10

0.13

-0.06

-0.09

-0.16

-0.17

-0.13

speech-accent-archive-2.2.0-ukrainian

-0.00

-0.00

0.02

-0.01

-0.03

0.03

0.00

0.00

0.03

0.02

0.03

-0.01

0.01

-0.05

-0.05

0.02

speech-accent-archive-2.2.0-urdu

0.05

-0.00

0.01

-0.01

-0.03

0.02

0.05

0.03

0.26

0.03

0.12

-0.04

-0.27

-0.04

-0.17

0.02

speech-accent-archive-2.2.0-vietnamese

-0.00

0.01

-0.01

-0.01

-0.04

-0.06

-0.06

-0.04

-0.06

-0.06

-0.19

0.01

0.10

0.11

0.26

0.04

mean

-0.00

0.00

-0.00

0.00

0.00

0.00

0.00

0.00

-0.00

0.00

0.00

-0.00

0.00

-0.00

-0.00

0.00

Visualization

CNN14-cat

w2v2-b-cat

hubert-b-cat

axlstm-cat

../../../_images/visualization_speech-accent-archive-2.2.0-amharic27.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic22.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic28.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic29.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic27.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic22.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic28.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic29.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali27.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali22.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali28.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali29.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese27.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese22.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese28.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese29.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch27.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch22.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch28.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch29.png
../../../_images/visualization_speech-accent-archive-2.2.0-english27.png
../../../_images/visualization_speech-accent-archive-2.2.0-english22.png
../../../_images/visualization_speech-accent-archive-2.2.0-english28.png
../../../_images/visualization_speech-accent-archive-2.2.0-english29.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi27.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi22.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi28.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi29.png
../../../_images/visualization_speech-accent-archive-2.2.0-french27.png
../../../_images/visualization_speech-accent-archive-2.2.0-french22.png
../../../_images/visualization_speech-accent-archive-2.2.0-french28.png
../../../_images/visualization_speech-accent-archive-2.2.0-french29.png
../../../_images/visualization_speech-accent-archive-2.2.0-german27.png
../../../_images/visualization_speech-accent-archive-2.2.0-german22.png
../../../_images/visualization_speech-accent-archive-2.2.0-german28.png
../../../_images/visualization_speech-accent-archive-2.2.0-german29.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek27.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek22.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek28.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek29.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi27.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi22.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi28.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi29.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese27.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese22.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese28.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese29.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean27.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean22.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean28.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean29.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin27.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin22.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin28.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin29.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali27.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali22.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali28.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali29.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish27.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish22.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish28.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish29.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese27.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese22.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese28.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese29.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish27.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish22.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish28.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish29.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish27.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish22.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish28.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish29.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog27.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog22.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog28.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog29.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai27.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai22.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai28.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai29.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish27.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish22.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish28.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish29.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian27.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian22.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian28.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian29.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu27.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu22.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu28.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu29.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese27.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese22.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese28.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese29.png