t1
| Token name | freq(w) |
| token1 | 0.77 |
| token2 | 2.16 |
| token3 | 0.18 |
| token4 | 0.07 |
| token5 | 0.7 |
| token6 | 0.18 |
| token7 | 2.1 |
| token8 | 1.92 |
| token9 | 0.1 |
| token10 | 0.3 |
| token11 | 1.71 |
| token12 | 0.2 |
| token13 | 2.61 |
| token14 | 0.65 |
| token15 | 1.8 |
| token16 | 1.54 |
| token17 | 2.8 |
| token18 | 0.76 |
| token19 | 0.18 |
| token20 | 2.24 |
| token21 | 0.05 |
| token22 | 0.04 |
| token23 | 0.51 |
| token24 | 0.29 |
| token25 | 1.28 |
| token26 | 0.36 |
| token27 | 1.5 |
| token28 | 0.48 |
| token29 | 0.16 |
| token30 | 0.63 |
| token31 | 0.64 |
t2
| Token name | freq(w) |
| token1 | 0.12 |
| token2 | 0.1 |
| token3 | 0.39 |
| token4 | 0.08 |
| token5 | 1.82 |
| token6 | 0.34 |
| token7 | 1.1 |
| token8 | 0.6 |
| token9 | 1.2 |
| token10 | 2.25 |
| token11 | 0.21 |
| token12 | 1.1 |
| token13 | 0.44 |
| token14 | 0.05 |
| token15 | 1.75 |
| token16 | 1.45 |
| token17 | 0.88 |
| token18 | 0.6 |
| token19 | 1.14 |
| token20 | 0.99 |
| token21 | 0.9 |
| token22 | 0.48 |
| token23 | 0.13 |
| token24 | 1.26 |
| token25 | 0.6 |
| token26 | 1.76 |
| token27 | 0.16 |
| token28 | 0.72 |
| token29 | 0.96 |
| token30 | 0.04 |
| token31 | 0.64 |
t1
| Token name | freq(w) | Bb | DCG |
| token1 | 0.77 | 2.3226 | 53.70169 |
| token2 | 2.16 | 0.7742 | 25.64223 |
| token3 | 0.18 | 4.6452 | 77.40777 |
| token4 | 0.07 | 5.61295 | 84.48411 |
| token5 | 0.7 | 2.7097 | 58.63038 |
| token6 | 0.18 | 4.83875 | 78.91545 |
| token7 | 2.1 | 0.96775 | 30.27296 |
| token8 | 1.92 | 1.1613 | 34.46888 |
| token9 | 0.1 | 5.4194 | 83.15559 |
| token10 | 0.3 | 4.06455 | 72.55346 |
| token11 | 1.71 | 1.5484 | 41.83734 |
| token12 | 0.2 | 4.45165 | 75.84748 |
| token13 | 2.61 | 0.3871 | 14.63423 |
| token14 | 0.65 | 2.90325 | 60.90495 |
| token15 | 1.8 | 1.35485 | 38.30469 |
| token16 | 1.54 | 1.74195 | 45.11127 |
| token17 | 2.8 | 0.19355 | 7.91303 |
| token18 | 0.76 | 2.51615 | 56.2339 |
| token19 | 0.18 | 5.0323 | 80.37395 |
| token20 | 2.24 | 0.58065 | 20.47606 |
| token21 | 0.05 | 5.8065 | 85.77431 |
| token22 | 0.04 | 6.00005 | 87.02832 |
| token23 | 0.51 | 3.4839 | 67.10738 |
| token24 | 0.29 | 4.2581 | 74.23079 |
| token25 | 1.28 | 2.12905 | 51.01747 |
| token26 | 0.36 | 3.871 | 70.81076 |
| token27 | 1.5 | 1.9355 | 48.16179 |
| token28 | 0.48 | 3.67745 | 68.99739 |
| token29 | 0.16 | 5.22585 | 81.7864 |
| token30 | 0.63 | 3.29035 | 65.13396 |
| token31 | 0.64 | 3.0968 | 63.06942 |
t2
| Token name | freq(w) | b | DCG |
| token1 | 0.12 | 5.22585 | 81.7864 |
| token2 | 0.1 | 5.4194 | 83.15559 |
| token3 | 0.39 | 4.2581 | 74.23079 |
| token4 | 0.08 | 5.61295 | 84.48411 |
| token5 | 1.82 | 0.3871 | 14.63423 |
| token6 | 0.34 | 4.45165 | 75.84748 |
| token7 | 1.1 | 1.74195 | 45.11127 |
| token8 | 0.6 | 3.29035 | 65.13396 |
| token9 | 1.2 | 1.35485 | 38.30469 |
| token10 | 2.25 | 0.19355 | 7.91303 |
| token11 | 0.21 | 4.6452 | 77.40777 |
| token12 | 1.1 | 1.9355 | 48.16179 |
| token13 | 0.44 | 4.06455 | 72.55346 |
| token14 | 0.05 | 5.8065 | 85.77431 |
| token15 | 1.75 | 0.7742 | 25.64223 |
| token16 | 1.45 | 0.96775 | 30.27296 |
| token17 | 0.88 | 2.7097 | 58.63038 |
| token18 | 0.6 | 3.4839 | 67.10738 |
| token19 | 1.14 | 1.5484 | 41.83734 |
| token20 | 0.99 | 2.12905 | 51.01747 |
| token21 | 0.9 | 2.51615 | 56.2339 |
| token22 | 0.48 | 3.871 | 70.81076 |
| token23 | 0.13 | 5.0323 | 80.37395 |
| token24 | 1.26 | 1.1613 | 34.46888 |
| token25 | 0.6 | 3.67745 | 68.99739 |
| token26 | 1.76 | 0.58065 | 20.47606 |
| token27 | 0.16 | 4.83875 | 78.91545 |
| token28 | 0.72 | 2.90325 | 60.90495 |
| token29 | 0.96 | 2.3226 | 53.70169 |
| token30 | 0.04 | 6.00005 | 87.02832 |
| token31 | 0.64 | 3.0968 | 63.06942 |
Itt történik a vágás prog
t1
| Token name |
| token16 |
| token27 |
t2
| Token name |
| token7 |
| token12 |
Nem azonos a két keresett kifejezés