Fairness linguistic sentiment

97.9% passed tests (94 passed / 2 failed).

Class Proportion Shift Difference Negative Sentiment

Shift in class proportions for negative sentiment for specific language - Average of the shift in class proportions for negative sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.075

Data

anger

happiness

neutral

sadness

checklist-synth-1.0.0-words-in-context-de

0.00 (0.00 - -0.00)

0.02 (0.01 - -0.01)

-0.01 (-0.00 - 0.01)

-0.00 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-en

0.00 (0.00 - -0.00)

0.02 (0.01 - -0.01)

-0.02 (-0.01 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-es

0.01 (0.00 - -0.00)

-0.00 (-0.01 - -0.01)

-0.00 (0.01 - 0.01)

-0.00 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-fr

-0.00 (-0.00 - -0.00)

-0.03 (-0.04 - -0.01)

0.04 (0.05 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-it

0.00 (0.00 - -0.00)

-0.01 (-0.02 - -0.01)

0.01 (0.02 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-ja

-0.02 (-0.02 - -0.00)

0.00 (-0.01 - -0.01)

0.01 (0.02 - 0.01)

0.01 (0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-pt

0.01 (0.01 - -0.00)

0.04 (0.03 - -0.01)

-0.05 (-0.04 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-zh

-0.01 (-0.01 - -0.00)

-0.02 (-0.03 - -0.01)

0.03 (0.04 - 0.01)

0.00 (0.00 - 0.00)

mean

-0.00

0.00

0.00

0.00

Class Proportion Shift Difference Neutral Sentiment

Shift in class proportions for neutral sentiment for specific language - Average of the shift in class proportions for neutral sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.075

Data

anger

happiness

neutral

sadness

checklist-synth-1.0.0-words-in-context-de

-0.01 (0.00 - 0.01)

0.01 (-0.01 - -0.02)

-0.01 (0.00 - 0.01)

0.01 (0.01 - 0.00)

checklist-synth-1.0.0-words-in-context-en

-0.01 (0.00 - 0.01)

-0.01 (-0.03 - -0.02)

0.02 (0.03 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-es

-0.02 (-0.01 - 0.01)

-0.02 (-0.04 - -0.02)

0.04 (0.05 - 0.01)

-0.00 (-0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-fr

-0.02 (-0.01 - 0.01)

0.06 (0.04 - -0.02)

-0.03 (-0.02 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-it

-0.01 (-0.00 - 0.01)

0.05 (0.03 - -0.02)

-0.03 (-0.02 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-ja

0.09 (0.10 - 0.01)

-0.09 (-0.12 - -0.02)

0.01 (0.02 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-pt

-0.04 (-0.03 - 0.01)

-0.02 (-0.04 - -0.02)

0.07 (0.07 - 0.01)

-0.00 (0.00 - 0.00)

checklist-synth-1.0.0-words-in-context-zh

0.04 (0.05 - 0.01)

0.02 (0.00 - -0.02)

-0.06 (-0.05 - 0.01)

-0.00 (-0.00 - 0.00)

mean

0.00

0.00

0.00

0.00

Class Proportion Shift Difference Positive Sentiment

Shift in class proportions for positive sentiment for specific language - Average of the shift in class proportions for positive sentiment for all languages. The full expression leading to the test score is displayed in parentheses.

Threshold: 0.075

Data

anger

happiness

neutral

sadness

checklist-synth-1.0.0-words-in-context-de

0.00 (0.00 - -0.00)

-0.02 (-0.00 - 0.02)

0.02 (0.00 - -0.01)

0.00 (-0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-en

0.00 (0.00 - -0.00)

-0.01 (0.01 - 0.02)

0.01 (-0.01 - -0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-es

0.00 (-0.00 - -0.00)

0.01 (0.03 - 0.02)

-0.01 (-0.03 - -0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-fr

0.01 (0.01 - -0.00)

0.01 (0.03 - 0.02)

-0.03 (-0.04 - -0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-it

0.00 (-0.00 - -0.00)

-0.01 (0.01 - 0.02)

0.00 (-0.01 - -0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-ja

-0.01 (-0.02 - -0.00)

0.03 (0.05 - 0.02)

-0.01 (-0.03 - -0.01)

-0.01 (-0.01 - -0.00)

checklist-synth-1.0.0-words-in-context-pt

0.00 (-0.00 - -0.00)

-0.03 (-0.01 - 0.02)

0.03 (0.01 - -0.01)

0.00 (0.00 - -0.00)

checklist-synth-1.0.0-words-in-context-zh

-0.01 (-0.01 - -0.00)

0.01 (0.03 - 0.02)

-0.00 (-0.02 - -0.01)

0.00 (-0.00 - -0.00)

mean

-0.00

-0.00

0.00

-0.00

Visualization

../../../_images/visualization_checklist-synth-1.0.0-words-in-context-de27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-en27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-es27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-fr27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-it27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-ja27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-pt27.png
../../../_images/visualization_checklist-synth-1.0.0-words-in-context-zh27.png