t1
| Token name | freq(w) |
| token1 | 0.12 |
| token2 | 2.3 |
| token3 | 2.08 |
| token4 | 1.5 |
| token5 | 0.45 |
| token6 | 2.03 |
| token7 | 1.5 |
| token8 | 0.06 |
| token9 | 1.44 |
| token10 | 0.28 |
| token11 | 0.06 |
| token12 | 1.96 |
| token13 | 0.96 |
| token14 | 0.35 |
| token15 | 2.7 |
| token16 | 1.16 |
| token17 | 1.2 |
| token18 | 0.14 |
| token19 | 0.08 |
| token20 | 0.08 |
| token21 | 0.42 |
| token22 | 2.25 |
| token23 | 1.33 |
| token24 | 0.48 |
| token25 | 2.9 |
| token26 | 0.08 |
| token27 | 0.64 |
| token28 | 1.44 |
| token29 | 0.84 |
| token30 | 1.53 |
| token31 | 0.12 |
t2
| Token name | freq(w) |
| token1 | 0.11 |
| token2 | 0.9 |
| token3 | 0.75 |
| token4 | 0.16 |
| token5 | 0.2 |
| token6 | 1.12 |
| token7 | 0.15 |
| token8 | 0.08 |
| token9 | 0.08 |
| token10 | 0.85 |
| token11 | 0.72 |
| token12 | 1.05 |
| token13 | 0.63 |
| token14 | 0.69 |
| token15 | 2.4 |
| token16 | 1.76 |
| token17 | 1.2 |
| token18 | 0.65 |
| token19 | 0.45 |
| token20 | 0.56 |
| token21 | 1.47 |
| token22 | 0.55 |
| token23 | 1.08 |
| token24 | 1.84 |
| token25 | 0.8 |
| token26 | 0.72 |
| token27 | 0.32 |
| token28 | 1.6 |
| token29 | 0.54 |
| token30 | 0.27 |
| token31 | 0.39 |
t1
| Token name | freq(w) | Bb | DCG |
| token1 | 0.12 | 4.83875 | 78.91545 |
| token2 | 2.3 | 0.58065 | 20.47606 |
| token3 | 2.08 | 0.96775 | 30.27296 |
| token4 | 1.5 | 1.74195 | 45.11127 |
| token5 | 0.45 | 3.871 | 70.81076 |
| token6 | 2.03 | 1.1613 | 34.46888 |
| token7 | 1.5 | 1.9355 | 48.16179 |
| token8 | 0.06 | 5.8065 | 85.77431 |
| token9 | 1.44 | 2.12905 | 51.01747 |
| token10 | 0.28 | 4.45165 | 75.84748 |
| token11 | 0.06 | 6.00005 | 87.02832 |
| token12 | 1.96 | 1.35485 | 38.30469 |
| token13 | 0.96 | 3.0968 | 63.06942 |
| token14 | 0.35 | 4.2581 | 74.23079 |
| token15 | 2.7 | 0.3871 | 14.63423 |
| token16 | 1.16 | 2.90325 | 60.90495 |
| token17 | 1.2 | 2.7097 | 58.63038 |
| token18 | 0.14 | 4.6452 | 77.40777 |
| token19 | 0.08 | 5.22585 | 81.7864 |
| token20 | 0.08 | 5.4194 | 83.15559 |
| token21 | 0.42 | 4.06455 | 72.55346 |
| token22 | 2.25 | 0.7742 | 25.64223 |
| token23 | 1.33 | 2.51615 | 56.2339 |
| token24 | 0.48 | 3.67745 | 68.99739 |
| token25 | 2.9 | 0.19355 | 7.91303 |
| token26 | 0.08 | 5.61295 | 84.48411 |
| token27 | 0.64 | 3.4839 | 67.10738 |
| token28 | 1.44 | 2.3226 | 53.70169 |
| token29 | 0.84 | 3.29035 | 65.13396 |
| token30 | 1.53 | 1.5484 | 41.83734 |
| token31 | 0.12 | 5.0323 | 80.37395 |
t2
| Token name | freq(w) | b | DCG |
| token1 | 0.11 | 5.61295 | 84.48411 |
| token2 | 0.9 | 1.9355 | 48.16179 |
| token3 | 0.75 | 2.51615 | 56.2339 |
| token4 | 0.16 | 5.22585 | 81.7864 |
| token5 | 0.2 | 5.0323 | 80.37395 |
| token6 | 1.12 | 1.35485 | 38.30469 |
| token7 | 0.15 | 5.4194 | 83.15559 |
| token8 | 0.08 | 5.8065 | 85.77431 |
| token9 | 0.08 | 6.00005 | 87.02832 |
| token10 | 0.85 | 2.12905 | 51.01747 |
| token11 | 0.72 | 2.7097 | 58.63038 |
| token12 | 1.05 | 1.74195 | 45.11127 |
| token13 | 0.63 | 3.4839 | 67.10738 |
| token14 | 0.69 | 3.0968 | 63.06942 |
| token15 | 2.4 | 0.19355 | 7.91303 |
| token16 | 1.76 | 0.58065 | 20.47606 |
| token17 | 1.2 | 1.1613 | 34.46888 |
| token18 | 0.65 | 3.29035 | 65.13396 |
| token19 | 0.45 | 4.2581 | 74.23079 |
| token20 | 0.56 | 3.67745 | 68.99739 |
| token21 | 1.47 | 0.96775 | 30.27296 |
| token22 | 0.55 | 3.871 | 70.81076 |
| token23 | 1.08 | 1.5484 | 41.83734 |
| token24 | 1.84 | 0.3871 | 14.63423 |
| token25 | 0.8 | 2.3226 | 53.70169 |
| token26 | 0.72 | 2.90325 | 60.90495 |
| token27 | 0.32 | 4.6452 | 77.40777 |
| token28 | 1.6 | 0.7742 | 25.64223 |
| token29 | 0.54 | 4.06455 | 72.55346 |
| token30 | 0.27 | 4.83875 | 78.91545 |
| token31 | 0.39 | 4.45165 | 75.84748 |
Itt történik a vágás prog
t2
| Token name |
| token2 |
| token12 |
Nem azonos a két keresett kifejezés