t1
| Token name | freq(w) |
| token1 | 0.12 |
| token2 | 0.9 |
| token3 | 1.2 |
| token4 | 0.02 |
| token5 | 0.08 |
| token6 | 1.2 |
| token7 | 0.63 |
| token8 | 0.27 |
| token9 | 0.42 |
| token10 | 1.2 |
| token11 | 0.36 |
| token12 | 1.04 |
| token13 | 0.15 |
| token14 | 0.14 |
| token15 | 0.2 |
| token16 | 1.96 |
| token17 | 0.24 |
| token18 | 0.51 |
| token19 | 0.15 |
| token20 | 0.02 |
| token21 | 2.16 |
| token22 | 1.2 |
| token23 | 1.14 |
| token24 | 1.17 |
| token25 | 2.07 |
| token26 | 0.54 |
| token27 | 1.92 |
| token28 | 0.96 |
| token29 | 1.38 |
| token30 | 0.76 |
t2
| Token name | freq(w) |
| token1 | 1.62 |
| token2 | 1.4 |
| token3 | 1.26 |
| token4 | 0.56 |
| token5 | 1.4 |
| token6 | 1.08 |
| token7 | 1.15 |
| token8 | 1.05 |
| token9 | 0.06 |
| token10 | 1.84 |
| token11 | 0.09 |
| token12 | 0.3 |
| token13 | 0.2 |
| token14 | 1.3 |
| token15 | 0.66 |
| token16 | 0.07 |
| token17 | 0.28 |
| token18 | 1.17 |
| token19 | 1.19 |
| token20 | 1.36 |
| token21 | 0.03 |
| token22 | 0.18 |
| token23 | 1.3 |
| token24 | 0.27 |
| token25 | 1.62 |
| token26 | 0.6 |
| token27 | 0.96 |
| token28 | 2.7 |
| token29 | 0.6 |
| token30 | 0.24 |
t1
| Token name | freq(w) | Bb | DCG |
| token1 | 0.12 | 5.4 | 80.34216 |
| token2 | 0.9 | 2.8 | 57.77998 |
| token3 | 1.2 | 1.2 | 34.12511 |
| token4 | 0.02 | 5.8 | 82.96604 |
| token5 | 0.08 | 5.6 | 81.67398 |
| token6 | 1.2 | 1.4 | 37.89103 |
| token7 | 0.63 | 3.2 | 62.11168 |
| token8 | 0.27 | 4.2 | 71.35535 |
| token9 | 0.42 | 3.8 | 67.89103 |
| token10 | 1.2 | 1.6 | 41.35535 |
| token11 | 0.36 | 4 | 69.65784 |
| token12 | 1.04 | 2.4 | 52.96604 |
| token13 | 0.15 | 4.8 | 76.08159 |
| token14 | 0.14 | 5.2 | 78.96805 |
| token15 | 0.2 | 4.6 | 74.5628 |
| token16 | 1.96 | 0.6 | 20.34216 |
| token17 | 0.24 | 4.4 | 72.98878 |
| token18 | 0.51 | 3.6 | 66.04902 |
| token19 | 0.15 | 5 | 77.54888 |
| token20 | 0.02 | 6 | 84.22065 |
| token21 | 2.16 | 0.2 | 7.89103 |
| token22 | 1.2 | 1.8 | 44.5628 |
| token23 | 1.14 | 2.2 | 50.34216 |
| token24 | 1.17 | 2 | 47.54888 |
| token25 | 2.07 | 0.4 | 14.5628 |
| token26 | 0.54 | 3.4 | 64.12511 |
| token27 | 1.92 | 0.8 | 25.43991 |
| token28 | 0.96 | 2.6 | 55.43991 |
| token29 | 1.38 | 1 | 30 |
| token30 | 0.76 | 3 | 60 |
t2
| Token name | freq(w) | b | DCG |
| token1 | 1.62 | 0.6 | 20.34216 |
| token2 | 1.4 | 1 | 30 |
| token3 | 1.26 | 2 | 47.54888 |
| token4 | 0.56 | 4 | 69.65784 |
| token5 | 1.4 | 1.2 | 34.12511 |
| token6 | 1.08 | 2.8 | 57.77998 |
| token7 | 1.15 | 2.6 | 55.43991 |
| token8 | 1.05 | 3 | 60 |
| token9 | 0.06 | 5.8 | 82.96604 |
| token10 | 1.84 | 0.4 | 14.5628 |
| token11 | 0.09 | 5.4 | 80.34216 |
| token12 | 0.3 | 4.2 | 71.35535 |
| token13 | 0.2 | 5 | 77.54888 |
| token14 | 1.3 | 1.6 | 41.35535 |
| token15 | 0.66 | 3.4 | 64.12511 |
| token16 | 0.07 | 5.6 | 81.67398 |
| token17 | 0.28 | 4.4 | 72.98878 |
| token18 | 1.17 | 2.4 | 52.96604 |
| token19 | 1.19 | 2.2 | 50.34216 |
| token20 | 1.36 | 1.4 | 37.89103 |
| token21 | 0.03 | 6 | 84.22065 |
| token22 | 0.18 | 5.2 | 78.96805 |
| token23 | 1.3 | 1.8 | 44.5628 |
| token24 | 0.27 | 4.6 | 74.5628 |
| token25 | 1.62 | 0.8 | 25.43991 |
| token26 | 0.6 | 3.6 | 66.04902 |
| token27 | 0.96 | 3.2 | 62.11168 |
| token28 | 2.7 | 0.2 | 7.89103 |
| token29 | 0.6 | 3.8 | 67.89103 |
| token30 | 0.24 | 4.8 | 76.08159 |
Itt történik a vágás prog
Nem azonos a két keresett kifejezés