Loading results/trial/baseline.log +83 −85 Original line number Diff line number Diff line [ INFO ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties [ INFO ] WSIEvaluator - Run started at 22:02 [ INFO ] Dataset - Loading the datasets/trial/ [ INFO ] Dataset - Loading the topics data datasets/trial/ [ INFO ] Configuration - Loading /eval.properties FROM /home/students/hoffmann/FSEM/absinth/WSI-Evaluator/config/eval.properties [ INFO ] WSIEvaluator - Run started at 22:48 [ INFO ] Dataset - Loading the datasets/trial [ INFO ] Dataset - Loading the topics data datasets/trial [ INFO ] Dataset - Loading the subtopics data [ INFO ] Dataset - Loading the snippets data [ INFO ] Dataset - Loading the relations data Loading @@ -23,26 +23,26 @@ subtopic-recall@K default: 100 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 7 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 4, 5, 6, 9, 11, 12, 13, 14, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 42, 43, 44, 45, 47, 49, 50, 51, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 97, 98, 100] The cluster 5 contains the snippets: [2, 8, 10, 31, 37, 46, 72, 74, 96] The cluster 3 contains the snippets: [3, 41, 52, 53, 55, 82] The cluster 4 contains the snippets: [7, 20, 28, 67, 69, 75] The cluster 1 contains the snippets: [1, 4, 5, 6, 9, 11, 12, 13, 14, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 41, 43, 44, 45, 47, 49, 50, 51, 52, 53, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 74, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100] The cluster 4 contains the snippets: [7, 20, 28, 42, 67, 69, 75, 80, 95] The cluster 5 contains the snippets: [2, 8, 10, 31, 37, 46, 72, 96] The cluster 6 contains the snippets: [17, 48, 56, 60, 76] The cluster 7 contains the snippets: [54, 62, 99] The cluster 3 contains the snippets: [3, 55] The cluster 2 contains the snippets: [34] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 41, 20, 8, 48, 62, 5, 52, 28, 10, 56, 99, 6, 53, 67, 31, 60, 9, 55, 69, 37, 76, 11, 82, 75, 46, 12, 72, 13, 74, 14, 96, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 42, 43, 44, 45, 47, 49, 50, 51, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 97, 98, 100] Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 55, 20, 8, 48, 62, 5, 28, 10, 56, 99, 6, 42, 31, 60, 9, 67, 37, 76, 11, 69, 46, 12, 75, 72, 13, 80, 96, 14, 95, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 41, 43, 44, 45, 47, 49, 50, 51, 52, 53, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 74, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "soul food" =============== ============ Value of Rand Index = 0.4218181818181818 ================================= ============ Partial average Rand Index = 0.4218181818181818 ====== ============ Value of Adjusted Rand Index = -0.13342828523132788 ================================= ============ Partial average of Adjusted Rand Index = -0.13342828523132788 ================================= ============ Value of Jaccard Index = 0.32051282051282054 ================================= ============ Partial average of Jaccard Index = 0.32051282051282054 ====== ============ Precision = 0.79, Recall = 0.8494623655913979, F1 = 0.8186528497409327 ============ ============ Value of Rand Index = 0.43555555555555553 ================================= ============ Partial average Rand Index = 0.43555555555555553 ====== ============ Value of Adjusted Rand Index = -0.11789493285568241 ================================= ============ Partial average of Adjusted Rand Index = -0.11789493285568241 ================================= ============ Value of Jaccard Index = 0.3422787193973635 ================================= ============ Partial average of Jaccard Index = 0.3422787193973635 ====== ============ Precision = 0.8, Recall = 0.8602150537634409, F1 = 0.8290155440414508 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== Loading @@ -58,30 +58,29 @@ Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 41, 20, 8, 48, 62, 5, 52, 28, 10, 56 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 5 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 80, 81, 83, 84, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 98, 99, 100] The cluster 2 contains the snippets: [12, 47, 53, 67, 75, 79, 82, 97] The cluster 3 contains the snippets: [85, 95] The cluster 4 contains the snippets: [34] The cluster 5 contains the snippets: [16] ================== 4 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 55, 56, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100] The cluster 2 contains the snippets: [47, 57, 58, 97] The cluster 3 contains the snippets: [40] The cluster 4 contains the snippets: [16] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [1, 12, 85, 34, 16, 2, 47, 95, 3, 53, 4, 67, 5, 75, 6, 79, 7, 82, 8, 97, 9, 10, 11, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 80, 81, 83, 84, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 98, 99, 100] Resulting list: [1, 47, 40, 16, 2, 57, 3, 58, 4, 97, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 55, 56, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "the block" =============== ============ Value of Rand Index = 0.6139393939393939 ================================= ============ Partial average Rand Index = 0.5178787878787878 ====== ============ Value of Adjusted Rand Index = 0.1643434476034962 ================================= ============ Partial average of Adjusted Rand Index = 0.01545758118608416 ================================= ============ Value of Jaccard Index = 0.5545454545454546 ================================= ============ Partial average of Jaccard Index = 0.4375291375291376 ====== ============ Value of Rand Index = 0.5363636363636364 ================================= ============ Partial average Rand Index = 0.4859595959595959 ====== ============ Value of Adjusted Rand Index = -0.035640189321070756 ================================= ============ Partial average of Adjusted Rand Index = -0.07676756108837658 ================================= ============ Value of Jaccard Index = 0.5160269928300295 ================================= ============ Partial average of Jaccard Index = 0.42915285611369647 ====== ============ Precision = 0.19, Recall = 0.7037037037037037, F1 = 0.2992125984251969 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== ============ number of created clusters: 5 ============ ============ average size of the created clusters: 20.0 ============ ============ number of created clusters: 4 ============ ============ average size of the created clusters: 25.0 ============ =========================================================================== [ WARN ] WSIEvaluator - Loading @@ -92,34 +91,33 @@ Resulting list: [1, 12, 85, 34, 16, 2, 47, 95, 3, 53, 4, 67, 5, 75, 6, 79, 7, 82 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 9 snippet clusters: ==================== The cluster 1 contains the snippets: [2, 5, 10, 14, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 28, 29, 30, 35, 37, 42, 43, 44, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 74, 75, 76, 77, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 95, 96, 97] The cluster 4 contains the snippets: [4, 9, 13, 39, 40, 45, 46, 49, 60, 82, 100] The cluster 8 contains the snippets: [15, 32, 54, 63, 71, 72, 79, 89, 99] The cluster 2 contains the snippets: [3, 27, 31, 36, 38, 41, 47, 56] The cluster 6 contains the snippets: [1, 11, 33, 59, 62] The cluster 5 contains the snippets: [8, 12, 73, 78] The cluster 9 contains the snippets: [6, 57, 85, 93] The cluster 3 contains the snippets: [7, 34] The cluster 7 contains the snippets: [98] ================== 8 snippet clusters: ==================== The cluster 1 contains the snippets: [5, 6, 10, 14, 16, 17, 18, 20, 21, 22, 23, 24, 25, 26, 28, 29, 30, 34, 35, 37, 40, 42, 43, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 96, 97, 100] The cluster 4 contains the snippets: [4, 9, 13, 19, 41, 45, 46, 49, 57, 60, 78, 82] The cluster 5 contains the snippets: [1, 2, 11, 33, 39, 44, 59, 62, 72, 73] The cluster 2 contains the snippets: [3, 8, 27, 31, 38, 56, 95] The cluster 7 contains the snippets: [15, 32, 36, 54, 63, 89, 99] The cluster 8 contains the snippets: [12, 85, 93] The cluster 3 contains the snippets: [7] The cluster 6 contains the snippets: [98] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [2, 3, 7, 4, 8, 1, 98, 15, 6, 5, 27, 34, 9, 12, 11, 32, 57, 10, 31, 13, 73, 33, 54, 85, 14, 36, 39, 78, 59, 63, 93, 16, 38, 40, 62, 71, 17, 41, 45, 72, 18, 47, 46, 79, 19, 56, 49, 89, 20, 60, 99, 21, 82, 22, 100, 23, 24, 25, 26, 28, 29, 30, 35, 37, 42, 43, 44, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 74, 75, 76, 77, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 95, 96, 97] Resulting list: [5, 3, 7, 4, 1, 98, 15, 12, 6, 8, 9, 2, 32, 85, 10, 27, 13, 11, 36, 93, 14, 31, 19, 33, 54, 16, 38, 41, 39, 63, 17, 56, 45, 44, 89, 18, 95, 46, 59, 99, 20, 49, 62, 21, 57, 72, 22, 60, 73, 23, 78, 24, 82, 25, 26, 28, 29, 30, 34, 35, 37, 40, 42, 43, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 96, 97, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "stephen king" =============== ============ Value of Rand Index = 0.3375757575757576 ================================= ============ Partial average Rand Index = 0.4577777777777778 ====== ============ Value of Adjusted Rand Index = -0.013200341132411225 ================================= ============ Partial average of Adjusted Rand Index = 0.005904940413252365 ================================= ============ Value of Jaccard Index = 0.33163473298002444 ================================= ============ Partial average of Jaccard Index = 0.4022310026794332 ====== ============ Value of Rand Index = 0.37373737373737376 ================================= ============ Partial average Rand Index = 0.44855218855218854 ====== ============ Value of Adjusted Rand Index = -0.013509095426785465 ================================= ============ Partial average of Adjusted Rand Index = -0.05568140586784621 ================================= ============ Value of Jaccard Index = 0.36850682420044817 ================================= ============ Partial average of Jaccard Index = 0.4089375121426137 ====== ============ Precision = 0.99, Recall = 1.0, F1 = 0.9949748743718593 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== ============ number of created clusters: 9 ============ ============ average size of the created clusters: 11.11111111111111 ============ ============ number of created clusters: 8 ============ ============ average size of the created clusters: 12.5 ============ =========================================================================== [ WARN ] WSIEvaluator - Loading @@ -140,11 +138,11 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "cool water" =============== ============ Value of Rand Index = 0.6050505050505051 ================================= ============ Partial average Rand Index = 0.4945959595959596 ====== ============ Partial average Rand Index = 0.48767676767676765 ====== ============ Value of Adjusted Rand Index = 0.02423016804345094 ================================= ============ Partial average of Adjusted Rand Index = 0.010486247320802009 ================================= ============ Partial average of Adjusted Rand Index = -0.035703512390021924 ================================= ============ Value of Jaccard Index = 0.5967409240924092 ================================= ============ Partial average of Jaccard Index = 0.45085848303267717 ====== ============ Partial average of Jaccard Index = 0.4558883651300626 ====== ============ Precision = 0.21, Recall = 0.84, F1 = 0.3359999999999999 ============ [ WARN ] WSIEvaluator - Loading @@ -157,9 +155,9 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, =========== Final average value of S-recall@K: ============= 1 0.3958 2 0.6250 3 0.6250 4 0.6250 2 0.5417 3 0.5417 4 0.5417 5 0.6250 6 0.7083 7 0.7083 Loading @@ -178,25 +176,25 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 20 0.7917 21 0.7917 22 0.7917 23 0.7917 24 0.7917 23 0.8542 24 0.8542 25 0.8542 26 0.8542 27 0.8542 28 0.8542 29 0.8542 30 0.8542 31 0.8542 32 0.8542 33 0.8542 34 0.8542 30 0.9375 31 0.9375 32 0.9375 33 0.9375 34 0.9375 35 0.9375 36 0.9375 37 0.9375 38 0.9375 39 0.9375 40 0.9375 41 0.9375 40 1.0000 41 1.0000 42 1.0000 43 1.0000 44 1.0000 Loading Loading @@ -258,35 +256,35 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 100 1.0000 =========== Final average value of S-precision@r: ============= 0.4000 0.6667 0.4500 0.4841 0.5000 0.3611 0.5500 0.2481 0.6000 0.2372 0.6500 0.2091 0.7000 0.1464 0.7500 0.1336 0.8000 0.1249 0.8500 0.1175 0.9000 0.1111 0.9500 0.1054 0.4000 0.5778 0.4500 0.4464 0.5000 0.3423 0.5500 0.2009 0.6000 0.2118 0.6500 0.1898 0.7000 0.1521 0.7500 0.1381 0.8000 0.1292 0.8500 0.1215 0.9000 0.1149 0.9500 0.1091 1.0000 0.0267 =========== Final average value of F1: ===================== average F1 = 0.6636355295257614 average F1 = 0.6663112571041688 =========== Final average value of Rand Index: ============= average Rand Index = 0.4945959595959596 average Rand Index = 0.48767676767676765 =========== Final average value of Adjusted Rand Index: ==== average Adj Rand Index = 0.010486247320802009 average Adj Rand Index = -0.035703512390021924 =========== Final average value of Jaccard Index: ========== average Jaccard Index = 0.45085848303267717 average Jaccard Index = 0.4558883651300626 ================ Statistics: ==================================== ============ average number of created clusters: 5.75 ============ average cluster size: 23.849206349206348 ============ average number of created clusters: 5.25 ============ average cluster size: 25.44642857142857 [ WARN ] WSIEvaluator - Simulation started at: 22:02 and completed at 22:02 Execution time: 0.503 sec [ WARN ] WSIEvaluator - Simulation started at: 22:48 and completed at 22:49 Execution time: 2.254 sec Loading
results/trial/baseline.log +83 −85 Original line number Diff line number Diff line [ INFO ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties [ INFO ] WSIEvaluator - Run started at 22:02 [ INFO ] Dataset - Loading the datasets/trial/ [ INFO ] Dataset - Loading the topics data datasets/trial/ [ INFO ] Configuration - Loading /eval.properties FROM /home/students/hoffmann/FSEM/absinth/WSI-Evaluator/config/eval.properties [ INFO ] WSIEvaluator - Run started at 22:48 [ INFO ] Dataset - Loading the datasets/trial [ INFO ] Dataset - Loading the topics data datasets/trial [ INFO ] Dataset - Loading the subtopics data [ INFO ] Dataset - Loading the snippets data [ INFO ] Dataset - Loading the relations data Loading @@ -23,26 +23,26 @@ subtopic-recall@K default: 100 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 7 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 4, 5, 6, 9, 11, 12, 13, 14, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 42, 43, 44, 45, 47, 49, 50, 51, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 97, 98, 100] The cluster 5 contains the snippets: [2, 8, 10, 31, 37, 46, 72, 74, 96] The cluster 3 contains the snippets: [3, 41, 52, 53, 55, 82] The cluster 4 contains the snippets: [7, 20, 28, 67, 69, 75] The cluster 1 contains the snippets: [1, 4, 5, 6, 9, 11, 12, 13, 14, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 41, 43, 44, 45, 47, 49, 50, 51, 52, 53, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 74, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100] The cluster 4 contains the snippets: [7, 20, 28, 42, 67, 69, 75, 80, 95] The cluster 5 contains the snippets: [2, 8, 10, 31, 37, 46, 72, 96] The cluster 6 contains the snippets: [17, 48, 56, 60, 76] The cluster 7 contains the snippets: [54, 62, 99] The cluster 3 contains the snippets: [3, 55] The cluster 2 contains the snippets: [34] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 41, 20, 8, 48, 62, 5, 52, 28, 10, 56, 99, 6, 53, 67, 31, 60, 9, 55, 69, 37, 76, 11, 82, 75, 46, 12, 72, 13, 74, 14, 96, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 42, 43, 44, 45, 47, 49, 50, 51, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 77, 78, 79, 80, 81, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 97, 98, 100] Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 55, 20, 8, 48, 62, 5, 28, 10, 56, 99, 6, 42, 31, 60, 9, 67, 37, 76, 11, 69, 46, 12, 75, 72, 13, 80, 96, 14, 95, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 41, 43, 44, 45, 47, 49, 50, 51, 52, 53, 57, 58, 59, 61, 63, 64, 65, 66, 68, 70, 71, 73, 74, 77, 78, 79, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "soul food" =============== ============ Value of Rand Index = 0.4218181818181818 ================================= ============ Partial average Rand Index = 0.4218181818181818 ====== ============ Value of Adjusted Rand Index = -0.13342828523132788 ================================= ============ Partial average of Adjusted Rand Index = -0.13342828523132788 ================================= ============ Value of Jaccard Index = 0.32051282051282054 ================================= ============ Partial average of Jaccard Index = 0.32051282051282054 ====== ============ Precision = 0.79, Recall = 0.8494623655913979, F1 = 0.8186528497409327 ============ ============ Value of Rand Index = 0.43555555555555553 ================================= ============ Partial average Rand Index = 0.43555555555555553 ====== ============ Value of Adjusted Rand Index = -0.11789493285568241 ================================= ============ Partial average of Adjusted Rand Index = -0.11789493285568241 ================================= ============ Value of Jaccard Index = 0.3422787193973635 ================================= ============ Partial average of Jaccard Index = 0.3422787193973635 ====== ============ Precision = 0.8, Recall = 0.8602150537634409, F1 = 0.8290155440414508 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== Loading @@ -58,30 +58,29 @@ Resulting list: [1, 34, 3, 7, 2, 17, 54, 4, 41, 20, 8, 48, 62, 5, 52, 28, 10, 56 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 5 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 80, 81, 83, 84, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 98, 99, 100] The cluster 2 contains the snippets: [12, 47, 53, 67, 75, 79, 82, 97] The cluster 3 contains the snippets: [85, 95] The cluster 4 contains the snippets: [34] The cluster 5 contains the snippets: [16] ================== 4 snippet clusters: ==================== The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 55, 56, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100] The cluster 2 contains the snippets: [47, 57, 58, 97] The cluster 3 contains the snippets: [40] The cluster 4 contains the snippets: [16] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [1, 12, 85, 34, 16, 2, 47, 95, 3, 53, 4, 67, 5, 75, 6, 79, 7, 82, 8, 97, 9, 10, 11, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 68, 69, 70, 71, 72, 73, 74, 76, 77, 78, 80, 81, 83, 84, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 98, 99, 100] Resulting list: [1, 47, 40, 16, 2, 57, 3, 58, 4, 97, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 48, 49, 50, 51, 52, 53, 54, 55, 56, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "the block" =============== ============ Value of Rand Index = 0.6139393939393939 ================================= ============ Partial average Rand Index = 0.5178787878787878 ====== ============ Value of Adjusted Rand Index = 0.1643434476034962 ================================= ============ Partial average of Adjusted Rand Index = 0.01545758118608416 ================================= ============ Value of Jaccard Index = 0.5545454545454546 ================================= ============ Partial average of Jaccard Index = 0.4375291375291376 ====== ============ Value of Rand Index = 0.5363636363636364 ================================= ============ Partial average Rand Index = 0.4859595959595959 ====== ============ Value of Adjusted Rand Index = -0.035640189321070756 ================================= ============ Partial average of Adjusted Rand Index = -0.07676756108837658 ================================= ============ Value of Jaccard Index = 0.5160269928300295 ================================= ============ Partial average of Jaccard Index = 0.42915285611369647 ====== ============ Precision = 0.19, Recall = 0.7037037037037037, F1 = 0.2992125984251969 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== ============ number of created clusters: 5 ============ ============ average size of the created clusters: 20.0 ============ ============ number of created clusters: 4 ============ ============ average size of the created clusters: 25.0 ============ =========================================================================== [ WARN ] WSIEvaluator - Loading @@ -92,34 +91,33 @@ Resulting list: [1, 12, 85, 34, 16, 2, 47, 95, 3, 53, 4, 67, 5, 75, 6, 79, 7, 82 [ WARN ] WSIEvaluator - ClusteredSnippets: ================== 9 snippet clusters: ==================== The cluster 1 contains the snippets: [2, 5, 10, 14, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 28, 29, 30, 35, 37, 42, 43, 44, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 74, 75, 76, 77, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 95, 96, 97] The cluster 4 contains the snippets: [4, 9, 13, 39, 40, 45, 46, 49, 60, 82, 100] The cluster 8 contains the snippets: [15, 32, 54, 63, 71, 72, 79, 89, 99] The cluster 2 contains the snippets: [3, 27, 31, 36, 38, 41, 47, 56] The cluster 6 contains the snippets: [1, 11, 33, 59, 62] The cluster 5 contains the snippets: [8, 12, 73, 78] The cluster 9 contains the snippets: [6, 57, 85, 93] The cluster 3 contains the snippets: [7, 34] The cluster 7 contains the snippets: [98] ================== 8 snippet clusters: ==================== The cluster 1 contains the snippets: [5, 6, 10, 14, 16, 17, 18, 20, 21, 22, 23, 24, 25, 26, 28, 29, 30, 34, 35, 37, 40, 42, 43, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 96, 97, 100] The cluster 4 contains the snippets: [4, 9, 13, 19, 41, 45, 46, 49, 57, 60, 78, 82] The cluster 5 contains the snippets: [1, 2, 11, 33, 39, 44, 59, 62, 72, 73] The cluster 2 contains the snippets: [3, 8, 27, 31, 38, 56, 95] The cluster 7 contains the snippets: [15, 32, 36, 54, 63, 89, 99] The cluster 8 contains the snippets: [12, 85, 93] The cluster 3 contains the snippets: [7] The cluster 6 contains the snippets: [98] [ INFO ] WSIEvaluator - ================== Starting Evaluation ================== Resulting list: [2, 3, 7, 4, 8, 1, 98, 15, 6, 5, 27, 34, 9, 12, 11, 32, 57, 10, 31, 13, 73, 33, 54, 85, 14, 36, 39, 78, 59, 63, 93, 16, 38, 40, 62, 71, 17, 41, 45, 72, 18, 47, 46, 79, 19, 56, 49, 89, 20, 60, 99, 21, 82, 22, 100, 23, 24, 25, 26, 28, 29, 30, 35, 37, 42, 43, 44, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 74, 75, 76, 77, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 95, 96, 97] Resulting list: [5, 3, 7, 4, 1, 98, 15, 12, 6, 8, 9, 2, 32, 85, 10, 27, 13, 11, 36, 93, 14, 31, 19, 33, 54, 16, 38, 41, 39, 63, 17, 56, 45, 44, 89, 18, 95, 46, 59, 99, 20, 49, 62, 21, 57, 72, 22, 60, 73, 23, 78, 24, 82, 25, 26, 28, 29, 30, 34, 35, 37, 40, 42, 43, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 81, 83, 84, 86, 87, 88, 90, 91, 92, 94, 96, 97, 100] [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "stephen king" =============== ============ Value of Rand Index = 0.3375757575757576 ================================= ============ Partial average Rand Index = 0.4577777777777778 ====== ============ Value of Adjusted Rand Index = -0.013200341132411225 ================================= ============ Partial average of Adjusted Rand Index = 0.005904940413252365 ================================= ============ Value of Jaccard Index = 0.33163473298002444 ================================= ============ Partial average of Jaccard Index = 0.4022310026794332 ====== ============ Value of Rand Index = 0.37373737373737376 ================================= ============ Partial average Rand Index = 0.44855218855218854 ====== ============ Value of Adjusted Rand Index = -0.013509095426785465 ================================= ============ Partial average of Adjusted Rand Index = -0.05568140586784621 ================================= ============ Value of Jaccard Index = 0.36850682420044817 ================================= ============ Partial average of Jaccard Index = 0.4089375121426137 ====== ============ Precision = 0.99, Recall = 1.0, F1 = 0.9949748743718593 ============ [ WARN ] WSIEvaluator - ================ Statistics: ==================================== ============ number of created clusters: 9 ============ ============ average size of the created clusters: 11.11111111111111 ============ ============ number of created clusters: 8 ============ ============ average size of the created clusters: 12.5 ============ =========================================================================== [ WARN ] WSIEvaluator - Loading @@ -140,11 +138,11 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, [ WARN ] WSIEvaluator - ================ Results of Rand Index for the topic "cool water" =============== ============ Value of Rand Index = 0.6050505050505051 ================================= ============ Partial average Rand Index = 0.4945959595959596 ====== ============ Partial average Rand Index = 0.48767676767676765 ====== ============ Value of Adjusted Rand Index = 0.02423016804345094 ================================= ============ Partial average of Adjusted Rand Index = 0.010486247320802009 ================================= ============ Partial average of Adjusted Rand Index = -0.035703512390021924 ================================= ============ Value of Jaccard Index = 0.5967409240924092 ================================= ============ Partial average of Jaccard Index = 0.45085848303267717 ====== ============ Partial average of Jaccard Index = 0.4558883651300626 ====== ============ Precision = 0.21, Recall = 0.84, F1 = 0.3359999999999999 ============ [ WARN ] WSIEvaluator - Loading @@ -157,9 +155,9 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, =========== Final average value of S-recall@K: ============= 1 0.3958 2 0.6250 3 0.6250 4 0.6250 2 0.5417 3 0.5417 4 0.5417 5 0.6250 6 0.7083 7 0.7083 Loading @@ -178,25 +176,25 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 20 0.7917 21 0.7917 22 0.7917 23 0.7917 24 0.7917 23 0.8542 24 0.8542 25 0.8542 26 0.8542 27 0.8542 28 0.8542 29 0.8542 30 0.8542 31 0.8542 32 0.8542 33 0.8542 34 0.8542 30 0.9375 31 0.9375 32 0.9375 33 0.9375 34 0.9375 35 0.9375 36 0.9375 37 0.9375 38 0.9375 39 0.9375 40 0.9375 41 0.9375 40 1.0000 41 1.0000 42 1.0000 43 1.0000 44 1.0000 Loading Loading @@ -258,35 +256,35 @@ Resulting list: [1, 14, 2, 54, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 100 1.0000 =========== Final average value of S-precision@r: ============= 0.4000 0.6667 0.4500 0.4841 0.5000 0.3611 0.5500 0.2481 0.6000 0.2372 0.6500 0.2091 0.7000 0.1464 0.7500 0.1336 0.8000 0.1249 0.8500 0.1175 0.9000 0.1111 0.9500 0.1054 0.4000 0.5778 0.4500 0.4464 0.5000 0.3423 0.5500 0.2009 0.6000 0.2118 0.6500 0.1898 0.7000 0.1521 0.7500 0.1381 0.8000 0.1292 0.8500 0.1215 0.9000 0.1149 0.9500 0.1091 1.0000 0.0267 =========== Final average value of F1: ===================== average F1 = 0.6636355295257614 average F1 = 0.6663112571041688 =========== Final average value of Rand Index: ============= average Rand Index = 0.4945959595959596 average Rand Index = 0.48767676767676765 =========== Final average value of Adjusted Rand Index: ==== average Adj Rand Index = 0.010486247320802009 average Adj Rand Index = -0.035703512390021924 =========== Final average value of Jaccard Index: ========== average Jaccard Index = 0.45085848303267717 average Jaccard Index = 0.4558883651300626 ================ Statistics: ==================================== ============ average number of created clusters: 5.75 ============ average cluster size: 23.849206349206348 ============ average number of created clusters: 5.25 ============ average cluster size: 25.44642857142857 [ WARN ] WSIEvaluator - Simulation started at: 22:02 and completed at 22:02 Execution time: 0.503 sec [ WARN ] WSIEvaluator - Simulation started at: 22:48 and completed at 22:49 Execution time: 2.254 sec
