Fairness accent

Overall scores

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

Overall Score

98.7% passed tests (153 passed / 2 failed).

96.8% passed tests (90 passed / 3 failed).

100.0% passed tests (124 passed / 0 failed).

92.7% passed tests (115 passed / 9 failed).

95.7% passed tests (89 passed / 4 failed).

Mean Value

Threshold: 0.075

Data

Mean Value

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

speech-accent-archive-2.2.0-amharic

-0.02

-0.01

-0.03

-0.02

-0.03

speech-accent-archive-2.2.0-arabic

0.02

-0.01

0.01

-0.03

-0.00

speech-accent-archive-2.2.0-bengali

-0.04

-0.05

-0.04

-0.08

-0.04

speech-accent-archive-2.2.0-bulgarian

-0.00

-0.03

-0.01

-0.03

-0.04

speech-accent-archive-2.2.0-cantonese

-0.03

-0.02

-0.01

-0.02

-0.04

speech-accent-archive-2.2.0-dutch

0.02

0.01

0.04

0.00

0.02

speech-accent-archive-2.2.0-english

-0.00

-0.02

0.02

-0.01

0.01

speech-accent-archive-2.2.0-farsi

0.02

0.04

0.01

0.05

0.03

speech-accent-archive-2.2.0-french

-0.03

-0.02

-0.01

-0.01

-0.01

speech-accent-archive-2.2.0-german

0.04

0.02

0.03

0.04

0.04

speech-accent-archive-2.2.0-greek

0.02

0.02

0.02

0.02

0.01

speech-accent-archive-2.2.0-hindi

0.00

-0.01

0.00

-0.04

0.00

speech-accent-archive-2.2.0-italian

0.01

-0.01

-0.00

-0.02

0.00

speech-accent-archive-2.2.0-japanese

0.02

0.02

0.00

0.04

0.02

speech-accent-archive-2.2.0-korean

0.03

0.01

0.01

0.01

0.03

speech-accent-archive-2.2.0-macedonian

0.00

0.02

0.02

0.03

0.02

speech-accent-archive-2.2.0-mandarin

0.01

-0.02

0.01

0.00

-0.00

speech-accent-archive-2.2.0-nepali

-0.01

-0.02

-0.01

-0.03

-0.02

speech-accent-archive-2.2.0-polish

0.01

0.03

0.02

0.02

0.03

speech-accent-archive-2.2.0-portuguese

-0.02

0.01

-0.01

0.03

0.01

speech-accent-archive-2.2.0-romanian

-0.03

0.01

-0.02

0.02

-0.00

speech-accent-archive-2.2.0-russian

0.02

0.01

0.03

0.01

0.01

speech-accent-archive-2.2.0-serbian

-0.01

0.03

-0.00

0.04

0.02

speech-accent-archive-2.2.0-spanish

-0.05

-0.03

-0.02

-0.01

-0.01

speech-accent-archive-2.2.0-swedish

0.04

0.07

0.03

0.07

0.06

speech-accent-archive-2.2.0-tagalog

-0.03

-0.02

-0.01

-0.04

-0.02

speech-accent-archive-2.2.0-thai

-0.01

-0.01

-0.00

-0.02

-0.02

speech-accent-archive-2.2.0-turkish

0.00

0.01

0.01

-0.00

0.00

speech-accent-archive-2.2.0-ukrainian

0.03

-0.01

-0.01

0.00

-0.01

speech-accent-archive-2.2.0-urdu

0.00

0.02

0.02

0.02

0.02

speech-accent-archive-2.2.0-vietnamese

-0.00

-0.01

-0.03

0.01

0.00

mean

0.00

0.00

0.00

0.00

0.00

Relative Difference Per Bin

Bins with too few samples are skipped.

Threshold: 0.225

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

speech-accent-archive-2.2.0-amharic

-0.00

0.01

0.11

0.05

0.15

0.02

0.12

-0.09

-0.05

-0.15

-0.02

-0.12

-0.01

-0.00

speech-accent-archive-2.2.0-arabic

-0.00

0.01

-0.02

0.07

-0.02

0.16

0.01

0.01

-0.07

0.02

-0.17

-0.01

0.01

-0.00

speech-accent-archive-2.2.0-bengali

-0.00

0.01

0.14

0.22

0.20

0.32

0.18

-0.14

-0.23

-0.20

-0.33

-0.18

0.00

-0.00

speech-accent-archive-2.2.0-bulgarian

-0.00

-0.00

0.01

0.22

0.01

0.23

0.16

-0.01

-0.22

-0.00

-0.22

-0.16

0.01

-0.00

speech-accent-archive-2.2.0-cantonese

0.01

-0.00

0.10

0.14

0.06

0.13

0.24

-0.11

-0.14

-0.05

-0.13

-0.24

0.00

-0.00

speech-accent-archive-2.2.0-dutch

-0.00

-0.00

-0.03

-0.03

-0.14

0.03

-0.16

0.05

0.03

0.11

-0.02

0.16

-0.01

0.02

speech-accent-archive-2.2.0-english

-0.00

-0.00

0.03

0.09

-0.05

0.03

-0.10

-0.02

-0.09

0.04

-0.03

0.10

-0.01

0.01

speech-accent-archive-2.2.0-farsi

-0.00

-0.00

-0.10

-0.19

-0.08

-0.29

-0.13

0.11

0.19

0.08

0.29

0.13

-0.01

-0.00

speech-accent-archive-2.2.0-french

-0.00

-0.00

0.16

0.10

0.09

0.06

0.06

-0.15

-0.10

-0.08

-0.06

-0.06

-0.01

-0.00

speech-accent-archive-2.2.0-german

-0.00

-0.00

-0.16

-0.08

-0.15

-0.17

-0.16

0.18

0.08

0.15

0.18

0.16

-0.01

-0.00

speech-accent-archive-2.2.0-greek

-0.00

-0.00

-0.08

-0.14

-0.11

-0.07

-0.06

0.10

0.15

0.11

0.07

0.06

-0.01

-0.00

speech-accent-archive-2.2.0-hindi

-0.00

-0.00

-0.04

0.04

0.02

0.13

0.04

0.06

-0.04

-0.01

-0.12

-0.04

-0.01

-0.00

speech-accent-archive-2.2.0-italian

-0.00

-0.00

-0.00

0.01

0.03

0.05

0.05

0.02

-0.01

-0.04

-0.05

-0.05

-0.01

0.01

speech-accent-archive-2.2.0-japanese

-0.00

-0.00

-0.09

-0.17

-0.00

-0.15

-0.10

0.10

0.17

0.01

0.15

0.10

-0.01

-0.00

speech-accent-archive-2.2.0-korean

-0.00

-0.00

-0.10

-0.06

-0.09

-0.04

-0.10

0.10

0.06

0.08

0.04

0.11

0.00

0.01

speech-accent-archive-2.2.0-macedonian

0.01

0.02

-0.04

-0.19

-0.10

-0.24

-0.13

0.00

0.19

0.10

0.22

0.12

0.03

-0.00

speech-accent-archive-2.2.0-mandarin

0.01

-0.00

-0.06

0.11

-0.05

0.01

-0.03

0.03

-0.11

0.05

-0.00

0.02

0.02

-0.00

speech-accent-archive-2.2.0-nepali

-0.00

-0.00

0.06

0.11

0.10

0.19

0.10

-0.06

-0.11

-0.09

-0.19

-0.10

0.00

-0.00

speech-accent-archive-2.2.0-polish

-0.00

-0.00

-0.08

-0.18

-0.07

-0.11

-0.12

0.09

0.18

0.07

0.12

0.12

-0.01

-0.00

speech-accent-archive-2.2.0-portuguese

0.02

-0.00

0.07

-0.10

0.06

-0.12

-0.12

-0.08

0.10

-0.05

0.12

0.12

-0.01

-0.00

speech-accent-archive-2.2.0-romanian

-0.00

-0.00

0.10

-0.04

0.07

-0.00

0.01

-0.10

0.04

-0.06

0.00

-0.01

0.00

-0.00

speech-accent-archive-2.2.0-russian

-0.00

-0.00

-0.11

-0.07

-0.19

-0.08

-0.07

0.13

0.07

0.17

0.09

0.07

-0.01

0.01

speech-accent-archive-2.2.0-serbian

-0.00

-0.00

0.01

-0.17

0.03

-0.12

-0.02

-0.01

0.17

-0.03

0.12

0.02

0.00

-0.00

speech-accent-archive-2.2.0-spanish

0.01

-0.00

0.18

0.16

0.09

0.10

0.06

-0.18

-0.16

-0.10

-0.09

-0.05

-0.01

0.01

speech-accent-archive-2.2.0-swedish

-0.00

-0.00

-0.23

-0.36

-0.10

-0.33

-0.28

0.23

0.37

0.08

0.33

0.28

0.01

0.03

speech-accent-archive-2.2.0-tagalog

0.03

0.03

0.04

0.15

-0.01

0.08

0.05

-0.06

-0.15

0.01

-0.11

-0.05

-0.01

-0.00

speech-accent-archive-2.2.0-thai

0.01

-0.00

0.05

0.05

0.03

0.08

0.17

-0.06

-0.05

-0.02

-0.08

-0.17

0.00

-0.00

speech-accent-archive-2.2.0-turkish

0.01

-0.00

-0.02

-0.01

-0.09

0.02

0.02

-0.01

0.01

0.09

-0.01

-0.02

0.03

-0.00

speech-accent-archive-2.2.0-ukrainian

0.01

-0.00

-0.14

0.02

0.05

-0.01

0.06

0.10

-0.02

-0.04

0.02

-0.06

0.03

-0.00

speech-accent-archive-2.2.0-urdu

-0.00

-0.00

-0.01

-0.04

-0.10

-0.10

-0.06

0.01

0.04

0.11

0.10

0.06

0.00

-0.00

speech-accent-archive-2.2.0-vietnamese

-0.00

-0.00

0.01

0.03

0.13

-0.06

0.02

0.00

-0.03

-0.12

0.06

-0.02

-0.01

-0.00

mean

0.00

0.00

-0.01

-0.01

-0.01

-0.01

-0.01

0.01

0.01

0.01

0.01

0.01

-0.00

0.00

Visualization

w2v2-b

w2v2-L

w2v2-L-robust

w2v2-L-xls-r

w2v2-L-vox

../../../_images/visualization_speech-accent-archive-2.2.0-amharic34.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic37.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic38.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic39.png
../../../_images/visualization_speech-accent-archive-2.2.0-amharic40.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic34.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic37.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic38.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic39.png
../../../_images/visualization_speech-accent-archive-2.2.0-arabic40.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali34.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali37.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali38.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali39.png
../../../_images/visualization_speech-accent-archive-2.2.0-bengali40.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-bulgarian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese37.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese38.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese39.png
../../../_images/visualization_speech-accent-archive-2.2.0-cantonese40.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch34.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch37.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch38.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch39.png
../../../_images/visualization_speech-accent-archive-2.2.0-dutch40.png
../../../_images/visualization_speech-accent-archive-2.2.0-english34.png
../../../_images/visualization_speech-accent-archive-2.2.0-english37.png
../../../_images/visualization_speech-accent-archive-2.2.0-english38.png
../../../_images/visualization_speech-accent-archive-2.2.0-english39.png
../../../_images/visualization_speech-accent-archive-2.2.0-english40.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi34.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi37.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi38.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi39.png
../../../_images/visualization_speech-accent-archive-2.2.0-farsi40.png
../../../_images/visualization_speech-accent-archive-2.2.0-french34.png
../../../_images/visualization_speech-accent-archive-2.2.0-french37.png
../../../_images/visualization_speech-accent-archive-2.2.0-french38.png
../../../_images/visualization_speech-accent-archive-2.2.0-french39.png
../../../_images/visualization_speech-accent-archive-2.2.0-french40.png
../../../_images/visualization_speech-accent-archive-2.2.0-german34.png
../../../_images/visualization_speech-accent-archive-2.2.0-german37.png
../../../_images/visualization_speech-accent-archive-2.2.0-german38.png
../../../_images/visualization_speech-accent-archive-2.2.0-german39.png
../../../_images/visualization_speech-accent-archive-2.2.0-german40.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek34.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek37.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek38.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek39.png
../../../_images/visualization_speech-accent-archive-2.2.0-greek40.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi34.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi37.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi38.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi39.png
../../../_images/visualization_speech-accent-archive-2.2.0-hindi40.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-italian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese37.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese38.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese39.png
../../../_images/visualization_speech-accent-archive-2.2.0-japanese40.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean34.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean37.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean38.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean39.png
../../../_images/visualization_speech-accent-archive-2.2.0-korean40.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-macedonian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin34.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin37.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin38.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin39.png
../../../_images/visualization_speech-accent-archive-2.2.0-mandarin40.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali34.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali37.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali38.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali39.png
../../../_images/visualization_speech-accent-archive-2.2.0-nepali40.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish37.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish38.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish39.png
../../../_images/visualization_speech-accent-archive-2.2.0-polish40.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese37.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese38.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese39.png
../../../_images/visualization_speech-accent-archive-2.2.0-portuguese40.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-romanian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-russian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-serbian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish37.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish38.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish39.png
../../../_images/visualization_speech-accent-archive-2.2.0-spanish40.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish37.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish38.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish39.png
../../../_images/visualization_speech-accent-archive-2.2.0-swedish40.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog34.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog37.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog38.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog39.png
../../../_images/visualization_speech-accent-archive-2.2.0-tagalog40.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai34.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai37.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai38.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai39.png
../../../_images/visualization_speech-accent-archive-2.2.0-thai40.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish34.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish37.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish38.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish39.png
../../../_images/visualization_speech-accent-archive-2.2.0-turkish40.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian34.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian37.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian38.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian39.png
../../../_images/visualization_speech-accent-archive-2.2.0-ukrainian40.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu34.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu37.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu38.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu39.png
../../../_images/visualization_speech-accent-archive-2.2.0-urdu40.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese34.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese37.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese38.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese39.png
../../../_images/visualization_speech-accent-archive-2.2.0-vietnamese40.png