Robustness recording condition¶
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
|---|---|---|---|---|
Overall Score |
0.0% passed tests (0 passed / 2 failed). |
0.0% passed tests (0 passed / 2 failed). |
0.0% passed tests (0 passed / 2 failed). |
0.0% passed tests (0 passed / 2 failed). |
Percentage Unchanged Predictions Recording Condition¶
Data |
Percentage Unchanged Predictions Recording Condition |
|||
|---|---|---|---|---|
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|
imda-nsc-read-speech-balanced-2.6.0-headset-boundary |
0.29 |
0.72 |
0.77 |
0.48 |
imda-nsc-read-speech-balanced-2.6.0-headset-mobile |
0.30 |
0.56 |
0.72 |
0.41 |
mean |
0.29 |
0.64 |
0.74 |
0.44 |
Visualization¶
Difference of predictions for baseline recording condition audio and different recording condition audio. The allowed prediction difference \(\delta < 0.05\) is highlighted in green in the upper plot. The lower plot shows the distributions of the two predictions.
CNN14 |
w2v2-b |
hubert-b |
axlstm |
|---|---|---|---|
|
|
|
|
|
|
|
|