Commit 0ba4bece authored by Victor Zimmermann's avatar Victor Zimmermann
Browse files

First results for ablation studies.

parent 2e49c32c

results/node_edge_ablation/10-5.log

0 → 100644
+282 −0
Original line number Diff line number Diff line 
[ INFO  ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties

[ INFO  ] WSIEvaluator - Run started at 13:00

[ INFO  ] Dataset - Loading the datasets/trial/  

[ INFO  ] Dataset - Loading the topics data datasets/trial/

[ INFO  ] Dataset - Loading the subtopics data

[ INFO  ] Dataset - Loading the snippets data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] WSIEvaluator - 

===================================================

Starting the evaluation 

===================================================

[ INFO  ] WSIEvaluator - 

===================================================

subtopic-recall@K default: 100

===================================================

[ WARN  ] WSIEvaluator - 

============= Query 1 : "soul food" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 1 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 7, 8, 10, 12, 14, 17, 20, 28, 31, 34, 37, 46, 48, 49, 52, 55, 56, 60, 67, 69, 72, 74, 75, 76, 78, 80, 85, 94, 95, 96, 13, 50, 54, 58, 62, 65, 70, 71, 91, 97, 98, 99]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 3, 4, 5, 7, 8, 10, 12, 14, 17, 20, 28, 31, 34, 37, 46, 48, 49, 52, 55, 56, 60, 67, 69, 72, 74, 75, 76, 78, 80, 85, 94, 95, 96, 13, 50, 54, 58, 62, 65, 70, 71, 91, 97, 98, 99, 6, 9, 11, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 33, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 47, 51, 53, 57, 59, 61, 63, 64, 66, 68, 73, 77, 79, 81, 82, 83, 84, 86, 87, 88, 89, 90, 92, 93, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "soul food" ===============

============ Value of Rand Index = 0.5068686868686869 =================================

============ Partial average Rand Index = 0.5068686868686869 ======

============ Value of Adjusted Rand Index = 0.016245371473777942 =================================

============ Partial average of Adjusted Rand Index = 0.016245371473777942 =================================

============ Value of Jaccard Index = 0.3872991967871486 =================================

============ Partial average of Jaccard Index = 0.3872991967871486 ======

============ Precision = 0.9148936170212766, Recall = 0.46236559139784944, F1 = 0.6142857142857143 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 1 ============ 

============ average size of the created clusters: 47.0 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 2 : "the block" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 9 snippet clusters: ====================

The cluster 1 contains the snippets: [3, 4, 8, 9, 11, 13, 14, 19, 23, 24, 25, 30, 32, 33, 35, 36, 40, 42, 44, 45, 46, 48, 49, 50, 51, 52, 54, 55, 57, 58, 61, 62, 65, 69, 70, 72, 74, 80, 86, 89, 92, 93, 96, 97, 99, 63, 81]

The cluster 3 contains the snippets: [2, 12, 20, 34, 43, 47, 53, 66, 75, 79, 82, 85, 91, 94, 6, 21, 22, 29, 76, 98]

The cluster 4 contains the snippets: [26, 27, 38, 60, 73, 77, 15, 16, 37, 39, 59, 84, 100]

The cluster 5 contains the snippets: [7, 18, 71, 87]

The cluster 2 contains the snippets: [90, 67, 68]

The cluster 6 contains the snippets: [17, 95]

The cluster 7 contains the snippets: [5, 41]

The cluster 8 contains the snippets: [78, 83]

The cluster 9 contains the snippets: [56, 28]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [3, 90, 2, 26, 7, 17, 5, 78, 56, 4, 67, 12, 27, 18, 95, 41, 83, 28, 8, 68, 20, 38, 71, 9, 34, 60, 87, 11, 43, 73, 13, 47, 77, 14, 53, 15, 19, 66, 16, 23, 75, 37, 24, 79, 39, 25, 82, 59, 30, 85, 84, 32, 91, 100, 33, 94, 35, 6, 36, 21, 40, 22, 42, 29, 44, 76, 45, 98, 46, 48, 49, 50, 51, 52, 54, 55, 57, 58, 61, 62, 65, 69, 70, 72, 74, 80, 86, 89, 92, 93, 96, 97, 99, 63, 81, 1, 10, 31, 64, 88]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "the block" ===============

============ Value of Rand Index = 0.5442424242424242 =================================

============ Partial average Rand Index = 0.5255555555555556 ======

============ Value of Adjusted Rand Index = 0.14063240688183584 =================================

============ Partial average of Adjusted Rand Index = 0.07843888917780689 =================================

============ Value of Jaccard Index = 0.2993788819875776 =================================

============ Partial average of Jaccard Index = 0.3433390393873631 ======

============ Precision = 0.22105263157894736, Recall = 0.7777777777777778, F1 = 0.3442622950819672 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 9 ============ 

============ average size of the created clusters: 10.555555555555555 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 3 : "stephen king" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 2 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 23, 24, 25, 27, 28, 29, 32, 33, 35, 36, 38, 39, 42, 43, 45, 48, 49, 50, 51, 54, 55, 57, 58, 59, 60, 62, 63, 67, 69, 71, 72, 73, 76, 82, 83, 85, 88, 89, 92, 93, 95, 96, 97, 98, 99, 100, 4, 26, 30, 40, 46, 68, 70, 75, 80, 81, 94]

The cluster 2 contains the snippets: [7, 31, 34, 41, 44, 47, 56, 64, 86, 91, 5, 22, 37, 53, 84, 87, 90]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 7, 2, 31, 3, 34, 6, 41, 8, 44, 9, 47, 10, 56, 11, 64, 12, 86, 13, 91, 14, 5, 15, 22, 16, 37, 17, 53, 18, 84, 19, 87, 20, 90, 21, 23, 24, 25, 27, 28, 29, 32, 33, 35, 36, 38, 39, 42, 43, 45, 48, 49, 50, 51, 54, 55, 57, 58, 59, 60, 62, 63, 67, 69, 71, 72, 73, 76, 82, 83, 85, 88, 89, 92, 93, 95, 96, 97, 98, 99, 100, 4, 26, 30, 40, 46, 68, 70, 75, 80, 81, 94, 52, 61, 65, 66, 74, 77, 78, 79]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "stephen king" ===============

============ Value of Rand Index = 0.610909090909091 =================================

============ Partial average Rand Index = 0.554006734006734 ======

============ Value of Adjusted Rand Index = 0.051025838112694566 =================================

============ Partial average of Adjusted Rand Index = 0.06930120548943612 =================================

============ Value of Jaccard Index = 0.6035405516673528 =================================

============ Partial average of Jaccard Index = 0.4300728768140263 ======

============ Precision = 1.0, Recall = 0.9292929292929293, F1 = 0.9633507853403142 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 2 ============ 

============ average size of the created clusters: 46.0 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 4 : "cool water" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 1 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "cool water" ===============

============ Value of Rand Index = 0.6034343434343434 =================================

============ Partial average Rand Index = 0.5663636363636364 ======

============ Value of Adjusted Rand Index = 0.0 =================================

============ Partial average of Adjusted Rand Index = 0.05197590411707709 =================================

============ Value of Jaccard Index = 0.6034343434343434 =================================

============ Partial average of Jaccard Index = 0.47341324346910557 ======

============ Precision = 0.21, Recall = 0.84, F1 = 0.3359999999999999 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 1 ============ 

============ average size of the created clusters: 100.0 ============ 

===========================================================================



[ INFO  ] WSIEvaluator - 



=========== Final average value of S-recall@K: =============

1 0.3125

2 0.3958

3 0.5417

4 0.6250

5 0.6250

6 0.6250

7 0.7083

8 0.7917

9 0.8750

10 0.8750

11 0.8750

12 0.8750

13 0.8750

14 0.8750

15 0.8750

16 0.8750

17 0.8750

18 0.8750

19 0.8750

20 0.8750

21 0.8750

22 0.8750

23 0.8750

24 0.8750

25 0.8750

26 0.8750

27 0.8750

28 0.8750

29 0.8750

30 0.8750

31 0.8750

32 0.8750

33 0.8750

34 0.8750

35 0.8750

36 0.9375

37 0.9375

38 0.9375

39 0.9375

40 0.9375

41 0.9375

42 0.9375

43 0.9375

44 0.9375

45 0.9375

46 0.9375

47 0.9375

48 0.9375

49 0.9375

50 0.9375

51 0.9375

52 0.9375

53 1.0000

54 1.0000

55 1.0000

56 1.0000

57 1.0000

58 1.0000

59 1.0000

60 1.0000

61 1.0000

62 1.0000

63 1.0000

64 1.0000

65 1.0000

66 1.0000

67 1.0000

68 1.0000

69 1.0000

70 1.0000

71 1.0000

72 1.0000

73 1.0000

74 1.0000

75 1.0000

76 1.0000

77 1.0000

78 1.0000

79 1.0000

80 1.0000

81 1.0000

82 1.0000

83 1.0000

84 1.0000

85 1.0000

86 1.0000

87 1.0000

88 1.0000

89 1.0000

90 1.0000

91 1.0000

92 1.0000

93 1.0000

94 1.0000

95 1.0000

96 1.0000

97 1.0000

98 1.0000

99 1.0000

100 1.0000



=========== Final average value of S-precision@r: =============

0.4000 0.6131

0.4500 0.3833

0.5000 0.3667

0.5500 0.2298

0.6000 0.2322

0.6500 0.2072

0.7000 0.1876

0.7500 0.1719

0.8000 0.1588

0.8500 0.1477

0.9000 0.1383

0.9500 0.1300

1.0000 0.0267



=========== Final average value of F1: =====================

average F1 = 0.6591476643118489



=========== Final average value of Rand Index: =============

average Rand Index = 0.5663636363636364



=========== Final average value of Adjusted Rand Index: ====

average Adj Rand Index = 0.05197590411707709



=========== Final average value of Jaccard Index: ==========

average Jaccard Index = 0.47341324346910557



================ Statistics: ====================================

============ average number of created clusters: 3.25

============ average cluster size: 50.888888888888886



[ WARN  ] WSIEvaluator - Simulation started at: 13:00 and completed at 13:00

Execution time: 0.388 sec

results/node_edge_ablation/12-4.log

0 → 100644
+282 −0
Original line number Diff line number Diff line 
[ INFO  ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties

[ INFO  ] WSIEvaluator - Run started at 13:19

[ INFO  ] Dataset - Loading the datasets/trial/  

[ INFO  ] Dataset - Loading the topics data datasets/trial/

[ INFO  ] Dataset - Loading the subtopics data

[ INFO  ] Dataset - Loading the snippets data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] WSIEvaluator - 

===================================================

Starting the evaluation 

===================================================

[ INFO  ] WSIEvaluator - 

===================================================

subtopic-recall@K default: 100

===================================================

[ WARN  ] WSIEvaluator - 

============= Query 1 : "soul food" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 1 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 7, 8, 10, 12, 14, 17, 20, 28, 31, 33, 34, 37, 46, 48, 49, 52, 55, 56, 60, 67, 69, 72, 74, 75, 76, 78, 80, 93, 95, 96, 98, 13, 38, 50, 54, 58, 62, 65, 70, 71, 83, 91, 94, 97, 99]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 3, 4, 5, 7, 8, 10, 12, 14, 17, 20, 28, 31, 33, 34, 37, 46, 48, 49, 52, 55, 56, 60, 67, 69, 72, 74, 75, 76, 78, 80, 93, 95, 96, 98, 13, 38, 50, 54, 58, 62, 65, 70, 71, 83, 91, 94, 97, 99, 6, 9, 11, 15, 16, 18, 19, 21, 22, 23, 24, 25, 26, 27, 29, 30, 32, 35, 36, 39, 40, 41, 42, 43, 44, 45, 47, 51, 53, 57, 59, 61, 63, 64, 66, 68, 73, 77, 79, 81, 82, 84, 85, 86, 87, 88, 89, 90, 92, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "soul food" ===============

============ Value of Rand Index = 0.522020202020202 =================================

============ Partial average Rand Index = 0.522020202020202 ======

============ Value of Adjusted Rand Index = 0.045201277155199386 =================================

============ Partial average of Adjusted Rand Index = 0.045201277155199386 =================================

============ Value of Jaccard Index = 0.3997970573313039 =================================

============ Partial average of Jaccard Index = 0.3997970573313039 ======

============ Precision = 0.92, Recall = 0.4946236559139785, F1 = 0.6433566433566434 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 1 ============ 

============ average size of the created clusters: 50.0 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 2 : "the block" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 9 snippet clusters: ====================

The cluster 1 contains the snippets: [3, 4, 8, 11, 13, 14, 19, 23, 24, 25, 30, 32, 33, 35, 36, 40, 42, 44, 45, 46, 48, 49, 50, 51, 54, 55, 57, 58, 61, 62, 65, 69, 70, 71, 72, 74, 80, 86, 89, 90, 93, 95, 96, 97, 99, 15, 63, 81, 98]

The cluster 4 contains the snippets: [2, 12, 20, 47, 53, 66, 75, 79, 82, 85, 91, 94, 6, 21, 22, 29, 67, 76]

The cluster 3 contains the snippets: [9, 26, 27, 38, 60, 73, 77, 37, 39, 59, 84, 100]

The cluster 8 contains the snippets: [5, 16, 31, 43, 52, 56, 28]

The cluster 5 contains the snippets: [7, 18, 87, 88]

The cluster 6 contains the snippets: [78, 83, 92]

The cluster 9 contains the snippets: [17, 64, 68]

The cluster 2 contains the snippets: [41]

The cluster 7 contains the snippets: [34]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [3, 41, 9, 2, 7, 78, 34, 5, 17, 4, 26, 12, 18, 83, 16, 64, 8, 27, 20, 87, 92, 31, 68, 11, 38, 47, 88, 43, 13, 60, 53, 52, 14, 73, 66, 56, 19, 77, 75, 28, 23, 37, 79, 24, 39, 82, 25, 59, 85, 30, 84, 91, 32, 100, 94, 33, 6, 35, 21, 36, 22, 40, 29, 42, 67, 44, 76, 45, 46, 48, 49, 50, 51, 54, 55, 57, 58, 61, 62, 65, 69, 70, 71, 72, 74, 80, 86, 89, 90, 93, 95, 96, 97, 99, 15, 63, 81, 98, 1, 10]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "the block" ===============

============ Value of Rand Index = 0.556969696969697 =================================

============ Partial average Rand Index = 0.5394949494949495 ======

============ Value of Adjusted Rand Index = 0.16215365953770278 =================================

============ Partial average of Adjusted Rand Index = 0.10367746834645108 =================================

============ Value of Jaccard Index = 0.3183089835250233 =================================

============ Partial average of Jaccard Index = 0.35905302042816356 ======

============ Precision = 0.20408163265306123, Recall = 0.7407407407407407, F1 = 0.32 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 9 ============ 

============ average size of the created clusters: 10.88888888888889 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 3 : "stephen king" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 2 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 6, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 23, 24, 25, 27, 28, 29, 32, 33, 35, 36, 38, 39, 40, 42, 43, 45, 48, 49, 50, 51, 54, 55, 57, 58, 59, 60, 62, 63, 67, 69, 71, 72, 73, 76, 78, 79, 82, 83, 85, 88, 89, 92, 93, 95, 96, 97, 98, 99, 100, 4, 30, 46, 66, 68, 70, 75]

The cluster 2 contains the snippets: [7, 8, 31, 34, 41, 44, 47, 56, 64, 86, 91, 5, 22, 26, 37, 53, 80, 81, 84, 87, 90, 94]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 7, 2, 8, 3, 31, 6, 34, 9, 41, 10, 44, 11, 47, 12, 56, 13, 64, 14, 86, 15, 91, 16, 5, 17, 22, 18, 26, 19, 37, 20, 53, 21, 80, 23, 81, 24, 84, 25, 87, 27, 90, 28, 94, 29, 32, 33, 35, 36, 38, 39, 40, 42, 43, 45, 48, 49, 50, 51, 54, 55, 57, 58, 59, 60, 62, 63, 67, 69, 71, 72, 73, 76, 78, 79, 82, 83, 85, 88, 89, 92, 93, 95, 96, 97, 98, 99, 100, 4, 30, 46, 66, 68, 70, 75, 52, 61, 65, 74, 77]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "stephen king" ===============

============ Value of Rand Index = 0.597979797979798 =================================

============ Partial average Rand Index = 0.5589898989898989 ======

============ Value of Adjusted Rand Index = 0.05091665235887761 =================================

============ Partial average of Adjusted Rand Index = 0.0860905296839266 =================================

============ Value of Jaccard Index = 0.5901132852729145 =================================

============ Partial average of Jaccard Index = 0.4360731087097472 ======

============ Precision = 1.0, Recall = 0.9595959595959596, F1 = 0.979381443298969 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 2 ============ 

============ average size of the created clusters: 47.5 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 4 : "cool water" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 1 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "cool water" ===============

============ Value of Rand Index = 0.6034343434343434 =================================

============ Partial average Rand Index = 0.57010101010101 ======

============ Value of Adjusted Rand Index = 0.0 =================================

============ Partial average of Adjusted Rand Index = 0.06456789726294494 =================================

============ Value of Jaccard Index = 0.6034343434343434 =================================

============ Partial average of Jaccard Index = 0.47791341739089627 ======

============ Precision = 0.21, Recall = 0.84, F1 = 0.3359999999999999 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 1 ============ 

============ average size of the created clusters: 100.0 ============ 

===========================================================================



[ INFO  ] WSIEvaluator - 



=========== Final average value of S-recall@K: =============

1 0.3125

2 0.3958

3 0.4583

4 0.6250

5 0.6250

6 0.6250

7 0.6250

8 0.7917

9 0.7917

10 0.7917

11 0.7917

12 0.7917

13 0.7917

14 0.7917

15 0.7917

16 0.7917

17 0.7917

18 0.7917

19 0.7917

20 0.7917

21 0.7917

22 0.7917

23 0.7917

24 0.7917

25 0.7917

26 0.7917

27 0.7917

28 0.7917

29 0.7917

30 0.7917

31 0.7917

32 0.7917

33 0.7917

34 0.7917

35 0.7917

36 0.8750

37 0.9375

38 0.9375

39 0.9375

40 0.9375

41 0.9375

42 0.9375

43 0.9375

44 0.9375

45 0.9375

46 0.9375

47 0.9375

48 0.9375

49 0.9375

50 0.9375

51 0.9375

52 0.9375

53 0.9375

54 0.9375

55 0.9375

56 1.0000

57 1.0000

58 1.0000

59 1.0000

60 1.0000

61 1.0000

62 1.0000

63 1.0000

64 1.0000

65 1.0000

66 1.0000

67 1.0000

68 1.0000

69 1.0000

70 1.0000

71 1.0000

72 1.0000

73 1.0000

74 1.0000

75 1.0000

76 1.0000

77 1.0000

78 1.0000

79 1.0000

80 1.0000

81 1.0000

82 1.0000

83 1.0000

84 1.0000

85 1.0000

86 1.0000

87 1.0000

88 1.0000

89 1.0000

90 1.0000

91 1.0000

92 1.0000

93 1.0000

94 1.0000

95 1.0000

96 1.0000

97 1.0000

98 1.0000

99 1.0000

100 1.0000



=========== Final average value of S-precision@r: =============

0.4000 0.6042

0.4500 0.3741

0.5000 0.3111

0.5500 0.1997

0.6000 0.2052

0.6500 0.1827

0.7000 0.1503

0.7500 0.1376

0.8000 0.1276

0.8500 0.1192

0.9000 0.1120

0.9500 0.1058

1.0000 0.0267



=========== Final average value of F1: =====================

average F1 = 0.6596935950580349



=========== Final average value of Rand Index: =============

average Rand Index = 0.57010101010101



=========== Final average value of Adjusted Rand Index: ====

average Adj Rand Index = 0.06456789726294494



=========== Final average value of Jaccard Index: ==========

average Jaccard Index = 0.47791341739089627



================ Statistics: ====================================

============ average number of created clusters: 3.25

============ average cluster size: 52.09722222222222



[ WARN  ] WSIEvaluator - Simulation started at: 13:19 and completed at 13:19

Execution time: 0.371 sec

results/node_edge_ablation/14-3.log

0 → 100644
+283 −0

File added.

Preview size limit exceeded, changes collapsed.

results/node_edge_ablation/6-7.log

0 → 100644
+279 −0

File added.

Preview size limit exceeded, changes collapsed.

results/node_edge_ablation/8-6.log

0 → 100644
+282 −0

File added.

Preview size limit exceeded, changes collapsed.