Fairness accent

Overall scores

CNN14

w2v2-b

hubert-b

axlstm

Overall Score

98.1% passed tests (152 passed / 3 failed).

98.7% passed tests (153 passed / 2 failed).

100.0% passed tests (155 passed / 0 failed).

100.0% passed tests (155 passed / 0 failed).

Mean Value

Threshold: 0.075

Data

Mean Value

CNN14

w2v2-b

hubert-b

axlstm

speech-accent-archive-2.2.0-amharic

-0.01

-0.02

-0.01

0.02

speech-accent-archive-2.2.0-arabic

-0.02

0.02

-0.00

0.02

speech-accent-archive-2.2.0-bengali

-0.05

-0.04

-0.05

-0.02

speech-accent-archive-2.2.0-bulgarian

-0.02

-0.00

-0.00

-0.00

speech-accent-archive-2.2.0-cantonese

-0.05

-0.03

-0.01

0.03

speech-accent-archive-2.2.0-dutch

-0.01

0.02

0.05

0.01

speech-accent-archive-2.2.0-english

-0.03

-0.00

0.01

-0.01

speech-accent-archive-2.2.0-farsi

0.04

0.02

0.01

-0.01

speech-accent-archive-2.2.0-french

0.02

-0.03

-0.01

0.00

speech-accent-archive-2.2.0-german

0.05

0.04

0.02

-0.01

speech-accent-archive-2.2.0-greek

-0.01

0.02

0.01

-0.00

speech-accent-archive-2.2.0-hindi

0.04

0.00

0.00

-0.00

speech-accent-archive-2.2.0-italian

-0.03

0.01

0.01

0.01

speech-accent-archive-2.2.0-japanese

0.03

0.02

0.00

-0.02

speech-accent-archive-2.2.0-korean

0.02

0.03

0.01

0.02

speech-accent-archive-2.2.0-macedonian

-0.01

0.00

0.03

0.02

speech-accent-archive-2.2.0-mandarin

0.02

0.01

-0.00

0.01

speech-accent-archive-2.2.0-nepali

-0.02

-0.01

-0.03

0.00

speech-accent-archive-2.2.0-polish

0.00

0.01

0.01

-0.01

speech-accent-archive-2.2.0-portuguese

0.00

-0.02

-0.01

0.02

speech-accent-archive-2.2.0-romanian

0.01

-0.03

-0.01

-0.01

speech-accent-archive-2.2.0-russian

-0.02

0.02

0.03

0.00

speech-accent-archive-2.2.0-serbian

0.03

-0.01

0.01

-0.02

speech-accent-archive-2.2.0-spanish

0.01

-0.05

0.01

-0.03

speech-accent-archive-2.2.0-swedish

0.05

0.04

0.05

0.04

speech-accent-archive-2.2.0-tagalog

-0.03

-0.03

-0.04

-0.01

speech-accent-archive-2.2.0-thai

-0.03

-0.01

-0.01

-0.04

speech-accent-archive-2.2.0-turkish

0.03

0.00

-0.00

0.02

speech-accent-archive-2.2.0-ukrainian

-0.00

0.03

0.02

0.00

speech-accent-archive-2.2.0-urdu

-0.03

0.00

0.01

0.00

speech-accent-archive-2.2.0-vietnamese

0.02

-0.00

-0.04

-0.02

mean

-0.00

0.00

0.00

0.00

Relative Difference Per Bin

Bins with too few samples are skipped.

Threshold: 0.225

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

CNN14

w2v2-b

hubert-b

axlstm

CNN14

w2v2-b

hubert-b

axlstm

CNN14

w2v2-b

hubert-b

axlstm

CNN14

w2v2-b

hubert-b

axlstm

speech-accent-archive-2.2.0-amharic

-0.01

-0.00

-0.01

-0.01

-0.01

0.11

0.07

-0.06

0.05

-0.09

-0.04

0.05

-0.02

-0.01

-0.03

0.01

speech-accent-archive-2.2.0-arabic

-0.01

-0.00

0.01

-0.01

0.08

-0.02

-0.01

-0.05

-0.05

0.01

-0.00

0.03

-0.02

0.01

0.00

0.03

speech-accent-archive-2.2.0-bengali

-0.00

-0.00

0.00

0.02

0.20

0.14

0.22

0.06

-0.18

-0.14

-0.21

-0.10

-0.02

0.00

-0.01

0.01

speech-accent-archive-2.2.0-bulgarian

-0.01

-0.00

-0.01

-0.01

0.18

0.01

0.08

-0.00

-0.20

-0.01

-0.05

0.00

0.04

0.01

-0.01

0.00

speech-accent-archive-2.2.0-cantonese

-0.00

0.01

0.00

-0.01

0.23

0.10

0.02

-0.08

-0.19

-0.11

-0.03

0.08

-0.03

0.00

0.01

0.01

speech-accent-archive-2.2.0-dutch

-0.01

-0.00

-0.01

0.01

0.04

-0.03

-0.19

-0.09

0.01

0.05

0.20

0.08

-0.03

-0.01

0.00

0.00

speech-accent-archive-2.2.0-english

0.00

-0.00

-0.01

0.01

0.07

0.03

-0.05

0.05

-0.07

-0.02

0.07

-0.05

-0.00

-0.01

-0.01

-0.01

speech-accent-archive-2.2.0-farsi

0.00

-0.00

0.00

-0.01

-0.17

-0.10

-0.13

0.08

0.16

0.11

0.15

-0.06

0.01

-0.01

-0.03

-0.01

speech-accent-archive-2.2.0-french

-0.01

-0.00

0.00

-0.01

0.01

0.16

0.03

-0.03

-0.00

-0.15

-0.02

0.04

0.01

-0.01

-0.02

-0.00

speech-accent-archive-2.2.0-german

0.00

-0.00

-0.01

-0.02

-0.16

-0.16

-0.07

0.06

0.08

0.18

0.06

-0.02

0.08

-0.01

0.02

-0.01

speech-accent-archive-2.2.0-greek

0.03

-0.00

-0.01

0.02

0.03

-0.08

-0.02

-0.04

-0.02

0.10

0.04

0.02

-0.03

-0.01

-0.01

0.00

speech-accent-archive-2.2.0-hindi

-0.01

-0.00

-0.01

-0.01

-0.05

-0.04

0.01

0.03

-0.04

0.06

0.01

-0.02

0.11

-0.01

-0.00

-0.00

speech-accent-archive-2.2.0-italian

0.05

-0.00

-0.01

-0.02

0.03

-0.00

-0.01

0.01

-0.08

0.02

0.00

0.01

-0.01

-0.01

0.01

0.00

speech-accent-archive-2.2.0-japanese

-0.01

-0.00

-0.01

0.01

-0.04

-0.09

-0.00

0.10

0.05

0.10

0.01

-0.09

0.01

-0.01

-0.00

-0.01

speech-accent-archive-2.2.0-korean

-0.01

-0.00

0.00

-0.00

-0.11

-0.10

-0.03

-0.04

0.11

0.10

0.03

0.02

0.01

0.00

-0.00

0.02

speech-accent-archive-2.2.0-macedonian

-0.00

0.01

0.01

0.00

-0.03

-0.04

-0.15

-0.08

0.01

0.00

0.12

0.08

0.01

0.03

0.02

-0.00

speech-accent-archive-2.2.0-mandarin

-0.01

0.01

0.01

-0.02

-0.07

-0.06

0.06

-0.01

0.07

0.03

-0.11

0.03

0.01

0.02

0.04

-0.00

speech-accent-archive-2.2.0-nepali

0.04

-0.00

0.02

0.00

0.01

0.06

0.11

-0.02

-0.03

-0.06

-0.12

0.03

-0.01

0.00

-0.01

-0.01

speech-accent-archive-2.2.0-polish

-0.01

-0.00

-0.01

0.01

0.05

-0.08

0.01

-0.00

-0.06

0.09

-0.04

0.01

0.02

-0.01

0.04

-0.01

speech-accent-archive-2.2.0-portuguese

0.04

0.02

0.00

0.01

-0.08

0.07

0.02

-0.02

0.02

-0.08

-0.02

0.01

0.01

-0.01

-0.00

-0.00

speech-accent-archive-2.2.0-romanian

0.02

-0.00

-0.01

0.01

-0.12

0.10

0.08

0.01

0.13

-0.10

-0.07

-0.03

-0.03

0.00

-0.00

0.00

speech-accent-archive-2.2.0-russian

-0.01

-0.00

-0.01

0.01

-0.00

-0.11

-0.12

-0.09

0.03

0.13

0.13

0.09

-0.02

-0.01

0.01

-0.01

speech-accent-archive-2.2.0-serbian

-0.01

-0.00

0.00

0.02

-0.08

0.01

-0.12

0.03

0.08

-0.01

0.11

-0.05

0.02

0.00

0.01

0.00

speech-accent-archive-2.2.0-spanish

0.02

0.01

-0.01

0.02

-0.10

0.18

-0.02

0.05

0.11

-0.18

0.02

-0.06

-0.03

-0.01

0.01

-0.01

speech-accent-archive-2.2.0-swedish

-0.01

-0.00

-0.01

-0.03

-0.27

-0.23

-0.13

-0.06

0.28

0.23

0.09

0.09

-0.00

0.01

0.05

0.00

speech-accent-archive-2.2.0-tagalog

0.01

0.03

0.05

0.00

0.12

0.04

0.08

0.04

-0.12

-0.06

-0.11

-0.03

-0.01

-0.01

-0.01

-0.01

speech-accent-archive-2.2.0-thai

-0.01

0.01

0.00

0.05

0.16

0.05

0.03

0.04

-0.12

-0.06

-0.01

-0.08

-0.03

0.00

-0.02

-0.01

speech-accent-archive-2.2.0-turkish

-0.01

0.01

0.00

-0.02

-0.05

-0.02

-0.01

0.01

0.01

-0.01

-0.00

0.01

0.05

0.03

0.01

-0.00

speech-accent-archive-2.2.0-ukrainian

-0.01

0.01

-0.01

-0.02

0.09

-0.14

-0.10

0.03

-0.08

0.10

0.12

-0.01

0.00

0.03

-0.01

-0.00

speech-accent-archive-2.2.0-urdu

0.01

-0.00

-0.01

-0.02

0.12

-0.01

0.04

0.02

-0.11

0.01

-0.04

0.01

-0.02

0.00

0.01

-0.01

speech-accent-archive-2.2.0-vietnamese

-0.01

-0.00

0.01

0.02

-0.16

0.01

0.10

0.06

0.18

0.00

-0.08

-0.10

-0.01

-0.01

-0.03

0.02

mean

0.00

0.00

-0.00

0.00

-0.00

-0.01

-0.01

0.00

0.00

0.01

0.01

-0.00

0.00

-0.00

0.00

-0.00

Visualization

CNN14

w2v2-b

hubert-b

axlstm

../../../_images/visualization_speech-accent-archive-2.2.0-amharic33.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic34.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic35.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic36.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic33.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic34.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic35.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic36.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali33.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali34.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali35.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali36.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese33.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese35.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese36.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch33.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch34.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch35.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch36.png
../../../_images/visualization_speech-accent-archive-2.2.0-english33.png
../../../_images/visualization_speech-accent-archive-2.2.0-english34.png
../../../_images/visualization_speech-accent-archive-2.2.0-english35.png
../../../_images/visualization_speech-accent-archive-2.2.0-english36.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi33.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi34.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi35.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi36.png
../../../_images/visualization_speech-accent-archive-2.2.0-french33.png
../../../_images/visualization_speech-accent-archive-2.2.0-french34.png
../../../_images/visualization_speech-accent-archive-2.2.0-french35.png
../../../_images/visualization_speech-accent-archive-2.2.0-french36.png
../../../_images/visualization_speech-accent-archive-2.2.0-german33.png
../../../_images/visualization_speech-accent-archive-2.2.0-german34.png
../../../_images/visualization_speech-accent-archive-2.2.0-german35.png
../../../_images/visualization_speech-accent-archive-2.2.0-german36.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek33.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek34.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek35.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek36.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi33.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi34.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi35.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi36.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese33.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese35.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese36.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean33.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean34.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean35.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean36.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin33.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin34.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin35.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin36.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali33.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali34.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali35.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali36.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish33.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish35.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish36.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese33.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese35.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese36.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish33.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish35.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish36.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish33.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish35.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish36.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog33.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog34.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog35.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog36.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai33.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai34.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai35.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai36.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish33.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish35.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish36.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian33.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian35.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian36.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu33.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu34.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu35.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu36.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese33.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese35.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese36.png