Newer results. Try5 on different dataset.

[ INFO  ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties

[ INFO  ] WSIEvaluator - Run started at 17:13

[ INFO  ] Dataset - Loading the datasets/trial  

[ INFO  ] Dataset - Loading the topics data datasets/trial

[ INFO  ] Dataset - Loading the subtopics data

[ INFO  ] Dataset - Loading the snippets data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] WSIEvaluator - 

===================================================

Starting the evaluation 

===================================================

[ INFO  ] WSIEvaluator - 

===================================================

subtopic-recall@K default: 100

===================================================

[ WARN  ] WSIEvaluator - 

============= Query 1 : "soul food" ==============

[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================

[ WARN  ] WSIEvaluator - ClusteredSnippets:

================== 3 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 4, 5, 7, 9, 10, 11, 12, 13, 14, 17, 20, 24, 25, 26, 27, 30, 33, 35, 37, 38, 39, 41, 42, 43, 45, 46, 47, 48, 49, 50, 52, 53, 56, 58, 60, 61, 63, 64, 65, 67, 69, 70, 71, 72, 74, 75, 76, 78, 80, 82, 83, 85, 88, 90, 91, 93, 94, 95, 96, 97, 98]

The cluster 2 contains the snippets: [3, 6, 8, 18, 19, 21, 22, 23, 28, 34, 36, 40, 44, 51, 55, 68, 73, 77, 79, 81, 84, 86, 87, 92, 100]

The cluster 3 contains the snippets: [15, 31, 32, 54, 62, 66, 99]

[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 3, 15, 2, 6, 31, 4, 8, 32, 5, 18, 54, 7, 19, 62, 9, 21, 66, 10, 22, 99, 11, 23, 12, 28, 13, 34, 14, 36, 17, 40, 20, 44, 24, 51, 25, 55, 26, 68, 27, 73, 30, 77, 33, 79, 35, 81, 37, 84, 38, 86, 39, 87, 41, 92, 42, 100, 43, 45, 46, 47, 48, 49, 50, 52, 53, 56, 58, 60, 61, 63, 64, 65, 67, 69, 70, 71, 72, 74, 75, 76, 78, 80, 82, 83, 85, 88, 90, 91, 93, 94, 95, 96, 97, 98, 16, 29, 57, 59, 89]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "soul food" ===============

============ Value of Rand Index = 0.5935353535353536 =================================

============ Partial average Rand Index = 0.5935353535353536 ======

============ Value of Adjusted Rand Index = 0.2078401481738628 =================================

============ Partial average of Adjusted Rand Index = 0.2078401481738628 =================================

============ Value of Jaccard Index = 0.45355784899511137 =================================

============ Partial average of Jaccard Index = 0.45355784899511137 ======

============ Precision = 0.8, Recall = 0.8172043010752689, F1 = 0.8085106382978724 ============

[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 3 ============ 

============ average size of the created clusters: 31.666666666666668 ============ 

===========================================================================

[ WARN  ] WSIEvaluator - 

============= Query 2 : "the block" ==============

[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================

[ WARN  ] WSIEvaluator - ClusteredSnippets:

================== 3 snippet clusters: ====================

The cluster 1 contains the snippets: [2, 3, 4, 5, 6, 8, 9, 11, 13, 14, 15, 16, 19, 20, 22, 23, 24, 25, 26, 27, 28, 30, 31, 34, 35, 37, 38, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 52, 54, 58, 59, 60, 61, 63, 64, 65, 67, 68, 69, 70, 73, 74, 77, 80, 81, 84, 85, 86, 89, 90, 92, 94, 95, 96, 99]

The cluster 3 contains the snippets: [12, 21, 29, 32, 36, 43, 53, 55, 57, 62, 66, 72, 75, 76, 78, 79, 82, 83, 91, 93, 97, 100]

The cluster 2 contains the snippets: [7, 33, 39, 56, 71, 87, 88, 98]

[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [2, 7, 12, 3, 33, 21, 4, 39, 29, 5, 56, 32, 6, 71, 36, 8, 87, 43, 9, 88, 53, 11, 98, 55, 13, 57, 14, 62, 15, 66, 16, 72, 19, 75, 20, 76, 22, 78, 23, 79, 24, 82, 25, 83, 26, 91, 27, 93, 28, 97, 30, 100, 31, 34, 35, 37, 38, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 52, 54, 58, 59, 60, 61, 63, 64, 65, 67, 68, 69, 70, 73, 74, 77, 80, 81, 84, 85, 86, 89, 90, 92, 94, 95, 96, 99, 1, 10, 17, 18]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "the block" ===============

============ Value of Rand Index = 0.6096969696969697 =================================

============ Partial average Rand Index = 0.6016161616161617 ======

============ Value of Adjusted Rand Index = 0.22217541028673304 =================================

============ Partial average of Adjusted Rand Index = 0.2150077792302979 =================================

============ Value of Jaccard Index = 0.4598825831702544 =================================

============ Partial average of Jaccard Index = 0.4567202160826829 ======

============ Precision = 0.20833333333333334, Recall = 0.7407407407407407, F1 = 0.3252032520325203 ============

[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 3 ============ 

============ average size of the created clusters: 32.0 ============ 

===========================================================================

[ WARN  ] WSIEvaluator - 

============= Query 3 : "stephen king" ==============

[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================

[ WARN  ] WSIEvaluator - ClusteredSnippets:

================== 2 snippet clusters: ====================

The cluster 2 contains the snippets: [3, 4, 6, 7, 11, 12, 15, 16, 17, 20, 22, 24, 25, 26, 27, 29, 30, 32, 33, 34, 35, 36, 37, 38, 40, 41, 44, 46, 47, 48, 49, 50, 51, 54, 55, 56, 59, 60, 61, 62, 63, 64, 66, 68, 69, 70, 71, 72, 74, 76, 77, 79, 82, 83, 85, 86, 87, 89, 91, 93, 94, 95, 96, 97, 99]

The cluster 1 contains the snippets: [1, 2, 5, 8, 9, 10, 13, 14, 18, 19, 21, 23, 28, 31, 39, 42, 43, 45, 53, 57, 58, 65, 67, 73, 75, 78, 80, 81, 84, 88, 90, 92, 98, 100]

[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 3, 2, 4, 5, 6, 8, 7, 9, 11, 10, 12, 13, 15, 14, 16, 18, 17, 19, 20, 21, 22, 23, 24, 28, 25, 31, 26, 39, 27, 42, 29, 43, 30, 45, 32, 53, 33, 57, 34, 58, 35, 65, 36, 67, 37, 73, 38, 75, 40, 78, 41, 80, 44, 81, 46, 84, 47, 88, 48, 90, 49, 92, 50, 98, 51, 100, 54, 55, 56, 59, 60, 61, 62, 63, 64, 66, 68, 69, 70, 71, 72, 74, 76, 77, 79, 82, 83, 85, 86, 87, 89, 91, 93, 94, 95, 96, 97, 99, 52]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "stephen king" ===============

============ Value of Rand Index = 0.5276767676767676 =================================

============ Partial average Rand Index = 0.576969696969697 ======

============ Value of Adjusted Rand Index = -0.00965607780138522 =================================

============ Partial average of Adjusted Rand Index = 0.14011982688640354 =================================

============ Value of Jaccard Index = 0.5243133265513733 =================================

============ Partial average of Jaccard Index = 0.4792512529055797 ======

============ Precision = 0.98989898989899, Recall = 0.98989898989899, F1 = 0.98989898989899 ============

[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 2 ============ 

============ average size of the created clusters: 49.5 ============ 

===========================================================================

[ WARN  ] WSIEvaluator - 

============= Query 4 : "cool water" ==============

[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================

[ WARN  ] WSIEvaluator - ClusteredSnippets:

================== 1 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 4, 6, 7, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 28, 29, 30, 32, 33, 34, 36, 37, 38, 39, 41, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 70, 71, 72, 74, 75, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 88, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100]

[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 4, 6, 7, 11, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 28, 29, 30, 32, 33, 34, 36, 37, 38, 39, 41, 42, 43, 44, 45, 47, 48, 49, 52, 53, 54, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 70, 71, 72, 74, 75, 76, 77, 78, 79, 80, 81, 83, 84, 85, 86, 88, 90, 91, 92, 93, 94, 95, 96, 98, 99, 100, 3, 5, 8, 9, 10, 12, 25, 26, 27, 31, 35, 40, 46, 50, 51, 55, 56, 69, 73, 82, 87, 89, 97]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "cool water" ===============

============ Value of Rand Index = 0.6121212121212121 =================================

============ Partial average Rand Index = 0.5857575757575757 ======

============ Value of Adjusted Rand Index = 0.17574083154775647 =================================

============ Partial average of Adjusted Rand Index = 0.14902507805174176 =================================

============ Value of Jaccard Index = 0.5251051199604254 =================================

============ Partial average of Jaccard Index = 0.49071471966929114 ======

============ Precision = 0.15584415584415584, Recall = 0.48, F1 = 0.23529411764705882 ============

[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 1 ============ 

============ average size of the created clusters: 77.0 ============ 

===========================================================================

[ INFO  ] WSIEvaluator - 

=========== Final average value of S-recall@K: =============

1 0.3958

2 0.5417

3 0.6250

4 0.6250

5 0.6250

6 0.6250

7 0.6250

8 0.6250

9 0.6250

10 0.7083

11 0.8542

12 0.8542

13 0.8542

14 0.8542

15 0.8542

16 0.9167

17 0.9167

18 0.9167

19 0.9167

20 0.9167

21 0.9167

22 0.9167

23 0.9167

24 0.9167

25 0.9167

26 0.9167

27 0.9167

28 0.9167

29 0.9167

30 0.9167

31 0.9167

32 0.9167

33 0.9167

34 0.9167

35 0.9167

36 0.9167

37 0.9167

38 0.9167

39 0.9167

40 0.9167

41 0.9167

42 0.9167

43 0.9167

44 0.9167

45 0.9167

46 0.9167

47 0.9167

48 0.9167

49 0.9167

50 0.9167

51 0.9167

52 0.9167

53 0.9167

54 0.9167

55 0.9167

56 0.9167

57 0.9167

58 0.9167

59 0.9167

60 0.9167

61 0.9167

62 0.9167

63 0.9167

64 0.9167

65 0.9167

66 0.9167

67 0.9167

68 0.9167

69 0.9167

70 0.9167

71 0.9167

72 0.9167

73 0.9167

74 0.9167

75 0.9167

76 0.9167

77 0.9167

78 0.9167

79 0.9167

80 1.0000

81 1.0000

82 1.0000

83 1.0000

84 1.0000

85 1.0000

86 1.0000

87 1.0000

88 1.0000

89 1.0000

90 1.0000

91 1.0000

92 1.0000

93 1.0000

94 1.0000

95 1.0000

96 1.0000

97 1.0000

98 1.0000

99 1.0000

100 1.0000

=========== Final average value of S-precision@r: =============

0.4000 0.6222

0.4500 0.4798

0.5000 0.3708

0.5500 0.2717

0.6000 0.2375

0.6500 0.2119

0.7000 0.1455

0.7500 0.1471

0.8000 0.1374

0.8500 0.1291

0.9000 0.1218

0.9500 0.1154

1.0000 0.0267

=========== Final average value of F1: =====================

average F1 = 0.6293233944294127

=========== Final average value of Rand Index: =============

average Rand Index = 0.5857575757575757

=========== Final average value of Adjusted Rand Index: ====

average Adj Rand Index = 0.14902507805174176

=========== Final average value of Jaccard Index: ==========

average Jaccard Index = 0.49071471966929114

================ Statistics: ====================================

============ average number of created clusters: 2.25

============ average cluster size: 47.54166666666667

[ WARN  ] WSIEvaluator - Simulation started at: 17:13 and completed at 17:13

Execution time: 1.773 sec