Fairness linguistic sentiment

97.9% passed tests (94 passed / 2 failed).

Bin Proportion Shift Difference Negative Sentiment

Shift in bin proportions for negative sentiment for specific language - Average of the shift in bin proportions for negative sentiment for all languages. The full expression leading to the test score is displayed in parentheses. Bins with too few samples are skipped.

Threshold: 0.075

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

checklist-synth-1.0.0-words-in-context-de

-0.07 (-0.07 - -0.01)

0.06 (0.07 - 0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-en

0.01 (0.01 - -0.01)

-0.00 (0.01 - 0.01)

-0.01 (-0.02 - -0.00)

checklist-synth-1.0.0-words-in-context-es

-0.00 (-0.01 - -0.01)

-0.00 (0.01 - 0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-fr

0.04 (0.03 - -0.01)

-0.04 (-0.03 - 0.01)

0.00 (-0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-it

0.01 (0.00 - -0.01)

-0.04 (-0.03 - 0.01)

0.03 (0.03 - -0.00)

checklist-synth-1.0.0-words-in-context-ja

0.01 (0.00 - -0.01)

0.01 (0.02 - 0.01)

-0.01 (-0.02 - -0.00)

checklist-synth-1.0.0-words-in-context-pt

0.00 (-0.00 - -0.01)

-0.00 (0.00 - 0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-zh

0.01 (0.00 - -0.01)

0.01 (0.02 - 0.01)

-0.02 (-0.02 - -0.00)

mean

0.00

0.00

-0.00

Bin Proportion Shift Difference Neutral Sentiment

Shift in bin proportions for neutral sentiment for specific language - Average of the shift in bin proportions for neutral sentiment for all languages The full expression leading to the test score is displayed in parentheses. Bins with too few samples are skipped.

Threshold: 0.075

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

checklist-synth-1.0.0-words-in-context-de

0.08 (0.09 - 0.01)

-0.07 (-0.09 - -0.02)

-0.01 (0.00 - 0.01)

checklist-synth-1.0.0-words-in-context-en

0.02 (0.03 - 0.01)

0.01 (-0.01 - -0.02)

-0.03 (-0.02 - 0.01)

checklist-synth-1.0.0-words-in-context-es

-0.05 (-0.04 - 0.01)

0.06 (0.04 - -0.02)

-0.01 (0.00 - 0.01)

checklist-synth-1.0.0-words-in-context-fr

-0.02 (-0.01 - 0.01)

0.04 (0.01 - -0.02)

-0.01 (-0.00 - 0.01)

checklist-synth-1.0.0-words-in-context-it

-0.01 (0.00 - 0.01)

-0.04 (-0.06 - -0.02)

0.05 (0.06 - 0.01)

checklist-synth-1.0.0-words-in-context-ja

-0.01 (0.00 - 0.01)

0.01 (-0.02 - -0.02)

0.00 (0.01 - 0.01)

checklist-synth-1.0.0-words-in-context-pt

0.01 (0.02 - 0.01)

0.01 (-0.01 - -0.02)

-0.01 (-0.00 - 0.01)

checklist-synth-1.0.0-words-in-context-zh

-0.01 (0.00 - 0.01)

-0.01 (-0.03 - -0.02)

0.01 (0.02 - 0.01)

mean

0.00

0.00

-0.00

Bin Proportion Shift Difference Positive Sentiment

Shift in bin proportions for positive sentiment for specific language - Average of the shift in bin proportions for positive sentiment for all languages. The full expression leading to the test score is displayed in parentheses. Bins with too few samples are skipped.

Threshold: 0.075

Data

(-inf, 0.25]

(0.25, 0.5]

(0.5, 0.75]

(0.75, inf]

checklist-synth-1.0.0-words-in-context-de

0.03 (0.03 - 0.00)

-0.04 (-0.03 - 0.00)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-en

-0.02 (-0.02 - 0.00)

-0.00 (-0.00 - 0.00)

0.03 (0.02 - -0.00)

checklist-synth-1.0.0-words-in-context-es

0.02 (0.02 - 0.00)

-0.02 (-0.02 - 0.00)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-fr

-0.03 (-0.03 - 0.00)

0.03 (0.03 - 0.00)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-it

-0.00 (0.00 - 0.00)

0.06 (0.06 - 0.00)

-0.06 (-0.06 - -0.00)

checklist-synth-1.0.0-words-in-context-ja

-0.00 (0.00 - 0.00)

-0.01 (-0.01 - 0.00)

0.02 (0.01 - -0.00)

checklist-synth-1.0.0-words-in-context-pt

-0.00 (-0.00 - 0.00)

-0.00 (0.00 - 0.00)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-zh

-0.00 (0.00 - 0.00)

-0.01 (-0.01 - 0.00)

0.01 (0.01 - -0.00)

mean

0.00

0.00

0.00

Mean Shift Difference Negative Sentiment

Mean shift for negative sentiment for specific language - Average of the mean shift for negative sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.025

Data

Mean Shift Difference Negative Sentiment

checklist-synth-1.0.0-words-in-context-de

0.01 (0.01 - -0.00)

checklist-synth-1.0.0-words-in-context-en

-0.01 (-0.01 - -0.00)

checklist-synth-1.0.0-words-in-context-es

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-fr

-0.01 (-0.01 - -0.00)

checklist-synth-1.0.0-words-in-context-it

0.01 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-ja

-0.00 (-0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-pt

0.01 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-zh

-0.01 (-0.01 - -0.00)

mean

0.00

Mean Shift Difference Neutral Sentiment

Mean shift for neutral sentiment for specific language - Average of the mean shift for neutral sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.025

Data

Mean Shift Difference Neutral Sentiment

checklist-synth-1.0.0-words-in-context-de

-0.01 (-0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-en

-0.04 (-0.04 - 0.00)

checklist-synth-1.0.0-words-in-context-es

0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-fr

-0.01 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-it

0.01 (0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-ja

0.02 (0.02 - 0.00)

checklist-synth-1.0.0-words-in-context-pt

0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-zh

0.02 (0.02 - 0.00)

mean

-0.00

Mean Shift Difference Positive Sentiment

Mean shift for positive sentiment for specific language - Average of the mean shift for positive sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.025

Data

Mean Shift Difference Positive Sentiment

checklist-synth-1.0.0-words-in-context-de

-0.00 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-en

0.02 (0.03 - 0.00)

checklist-synth-1.0.0-words-in-context-es

-0.01 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-fr

0.01 (0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-it

-0.01 (-0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-ja

-0.01 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-pt

-0.01 (-0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-zh

0.00 (0.00 - 0.00)

mean

-0.00

Visualization

../../../_images/visualization_checklist-synth-1.0.0-words-in-context-de2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-en2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-es2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-fr2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-it2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-ja2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-pt2.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-zh2.png