Commit 66f42594 authored by Victor Zimmermann's avatar Victor Zimmermann
Browse files

Merge branch 'master' of https://gitlab.cl.uni-heidelberg.de/zimmermann/absinth

parents 5fa8e1ff cf6dfdb0

results/dataset_1/system.log

0 → 100644
+3392 −0

File added.

Preview size limit exceeded, changes collapsed.

results/all-in-one.log→results/misc/all-in-one.log

+0 −0

File moved.

View file

results/misc/baseline_trial.log

0 → 100644
+297 −0
Original line number Diff line number Diff line 
[ INFO  ] Configuration - Loading /eval.properties FROM /home/students/zimmermann/Courses/ws17/fsem/absinth/WSI-Evaluator/config/eval.properties

[ INFO  ] WSIEvaluator - Run started at 21:42

[ INFO  ] Dataset - Loading the datasets/trial/  

[ INFO  ] Dataset - Loading the topics data datasets/trial/

[ INFO  ] Dataset - Loading the subtopics data

[ INFO  ] Dataset - Loading the snippets data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] Dataset - Loading the relations data

[ INFO  ] WSIEvaluator - 

===================================================

Starting the evaluation 

===================================================

[ INFO  ] WSIEvaluator - 

===================================================

subtopic-recall@K default: 100

===================================================

[ WARN  ] WSIEvaluator - 

============= Query 1 : "soul food" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 7 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 4, 5, 6, 8, 9, 11, 12, 13, 14, 16, 18, 19, 23, 24, 25, 26, 29, 33, 36, 39, 40, 44, 47, 49, 51, 58, 59, 61, 64, 65, 66, 70, 71, 73, 74, 78, 81, 83, 84, 85, 86, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100]

The cluster 6 contains the snippets: [15, 17, 20, 21, 22, 27, 30, 32, 35, 38, 43, 45, 48, 50, 56, 60, 63, 68, 69, 76, 77, 79, 99]

The cluster 3 contains the snippets: [3, 41, 52, 53, 55, 57, 82, 87]

The cluster 4 contains the snippets: [7, 28, 42, 67, 75, 80, 95]

The cluster 5 contains the snippets: [2, 10, 31, 37, 46, 72, 96]

The cluster 7 contains the snippets: [54, 62]

The cluster 2 contains the snippets: [34]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 34, 3, 7, 2, 15, 54, 4, 41, 28, 10, 17, 62, 5, 52, 42, 31, 20, 6, 53, 67, 37, 21, 8, 55, 75, 46, 22, 9, 57, 80, 72, 27, 11, 82, 95, 96, 30, 12, 87, 32, 13, 35, 14, 38, 16, 43, 18, 45, 19, 48, 23, 50, 24, 56, 25, 60, 26, 63, 29, 68, 33, 69, 36, 76, 39, 77, 40, 79, 44, 99, 47, 49, 51, 58, 59, 61, 64, 65, 66, 70, 71, 73, 74, 78, 81, 83, 84, 85, 86, 88, 89, 90, 91, 92, 93, 94, 97, 98, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "soul food" ===============

============ Value of Rand Index = 0.40444444444444444 =================================

============ Partial average Rand Index = 0.40444444444444444 ======

============ Value of Adjusted Rand Index = -0.09019243089001731 =================================

============ Partial average of Adjusted Rand Index = -0.09019243089001731 =================================

============ Value of Jaccard Index = 0.23088964257761543 =================================

============ Partial average of Jaccard Index = 0.23088964257761543 ======

============ Precision = 0.79, Recall = 0.8494623655913979, F1 = 0.8186528497409327 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 7 ============ 

============ average size of the created clusters: 14.285714285714286 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 2 : "the block" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 5 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 3, 4, 5, 6, 9, 10, 11, 13, 14, 16, 17, 18, 19, 22, 23, 24, 25, 26, 27, 28, 30, 31, 35, 36, 38, 39, 40, 41, 42, 44, 45, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 66, 67, 68, 69, 70, 72, 73, 74, 76, 77, 80, 81, 82, 84, 86, 87, 88, 93, 94, 96, 97, 99, 100]

The cluster 2 contains the snippets: [2, 7, 12, 15, 20, 21, 29, 32, 33, 37, 43, 46, 47, 53, 65, 71, 75, 78, 79, 83, 85, 91, 92, 95, 98]

The cluster 3 contains the snippets: [8, 89]

The cluster 4 contains the snippets: [34]

The cluster 5 contains the snippets: [90]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 2, 8, 34, 90, 3, 7, 89, 4, 12, 5, 15, 6, 20, 9, 21, 10, 29, 11, 32, 13, 33, 14, 37, 16, 43, 17, 46, 18, 47, 19, 53, 22, 65, 23, 71, 24, 75, 25, 78, 26, 79, 27, 83, 28, 85, 30, 91, 31, 92, 35, 95, 36, 98, 38, 39, 40, 41, 42, 44, 45, 48, 49, 50, 51, 52, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 66, 67, 68, 69, 70, 72, 73, 74, 76, 77, 80, 81, 82, 84, 86, 87, 88, 93, 94, 96, 97, 99, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "the block" ===============

============ Value of Rand Index = 0.5301010101010101 =================================

============ Partial average Rand Index = 0.4672727272727273 ======

============ Value of Adjusted Rand Index = 0.04384254764053656 =================================

============ Partial average of Adjusted Rand Index = -0.02317494162474038 =================================

============ Value of Jaccard Index = 0.41292276627965674 =================================

============ Partial average of Jaccard Index = 0.3219062044286361 ======

============ Precision = 0.19, Recall = 0.7037037037037037, F1 = 0.2992125984251969 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 5 ============ 

============ average size of the created clusters: 20.0 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 3 : "stephen king" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 9 snippet clusters: ====================

The cluster 1 contains the snippets: [6, 10, 16, 18, 20, 21, 24, 25, 26, 29, 30, 35, 37, 40, 42, 43, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 83, 84, 86, 88, 90, 91, 92, 94, 95, 96, 97, 100]

The cluster 4 contains the snippets: [4, 9, 13, 14, 17, 19, 23, 28, 41, 45, 46, 49, 57, 60, 82, 89]

The cluster 8 contains the snippets: [15, 22, 32, 54, 56, 62, 63, 72, 81, 87, 99]

The cluster 2 contains the snippets: [3, 8, 27, 31, 34, 38, 78]

The cluster 6 contains the snippets: [1, 2, 11, 33, 36, 39, 59]

The cluster 9 contains the snippets: [12, 85, 93]

The cluster 7 contains the snippets: [5, 98]

The cluster 5 contains the snippets: [44, 73]

The cluster 3 contains the snippets: [7]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [6, 3, 7, 4, 44, 1, 5, 15, 12, 10, 8, 9, 73, 2, 98, 22, 85, 16, 27, 13, 11, 32, 93, 18, 31, 14, 33, 54, 20, 34, 17, 36, 56, 21, 38, 19, 39, 62, 24, 78, 23, 59, 63, 25, 28, 72, 26, 41, 81, 29, 45, 87, 30, 46, 99, 35, 49, 37, 57, 40, 60, 42, 82, 43, 89, 47, 48, 50, 51, 52, 53, 55, 58, 61, 64, 65, 66, 67, 68, 69, 70, 71, 74, 75, 76, 77, 79, 80, 83, 84, 86, 88, 90, 91, 92, 94, 95, 96, 97, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "stephen king" ===============

============ Value of Rand Index = 0.3022222222222222 =================================

============ Partial average Rand Index = 0.41225589225589226 ======

============ Value of Adjusted Rand Index = -0.011752024089891821 =================================

============ Partial average of Adjusted Rand Index = -0.019367302446457527 =================================

============ Value of Jaccard Index = 0.2952458681901653 =================================

============ Partial average of Jaccard Index = 0.31301942568247915 ======

============ Precision = 0.99, Recall = 1.0, F1 = 0.9949748743718593 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 9 ============ 

============ average size of the created clusters: 11.11111111111111 ============ 

===========================================================================



[ WARN  ] WSIEvaluator - 

============= Query 4 : "cool water" ==============



[ INFO  ] WSIEvaluator - 

============== Cluster creation phase ==================



[ WARN  ] WSIEvaluator - ClusteredSnippets:



================== 7 snippet clusters: ====================

The cluster 1 contains the snippets: [1, 2, 3, 4, 6, 8, 9, 11, 12, 15, 16, 17, 20, 21, 22, 23, 24, 25, 26, 28, 29, 30, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 43, 44, 45, 48, 49, 50, 52, 55, 56, 58, 59, 60, 61, 62, 64, 66, 69, 70, 71, 72, 73, 74, 75, 76, 79, 80, 82, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 97, 98, 99, 100]

The cluster 3 contains the snippets: [7, 10, 13, 18, 19, 27, 31, 42, 51, 57, 67, 77, 78, 81, 83, 95]

The cluster 6 contains the snippets: [5, 46, 53]

The cluster 4 contains the snippets: [65, 68]

The cluster 2 contains the snippets: [14, 54]

The cluster 5 contains the snippets: [47]

The cluster 7 contains the snippets: [63]



[ INFO  ] WSIEvaluator - 

==================  Starting Evaluation  ==================

Resulting list: [1, 14, 7, 65, 47, 5, 63, 2, 54, 10, 68, 46, 3, 13, 53, 4, 18, 6, 19, 8, 27, 9, 31, 11, 42, 12, 51, 15, 57, 16, 67, 17, 77, 20, 78, 21, 81, 22, 83, 23, 95, 24, 25, 26, 28, 29, 30, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 43, 44, 45, 48, 49, 50, 52, 55, 56, 58, 59, 60, 61, 62, 64, 66, 69, 70, 71, 72, 73, 74, 75, 76, 79, 80, 82, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 96, 97, 98, 99, 100]

[ WARN  ] WSIEvaluator - 

================ Results of Rand Index for the topic "cool water" ===============

============ Value of Rand Index = 0.575959595959596 =================================

============ Partial average Rand Index = 0.4531818181818182 ======

============ Value of Adjusted Rand Index = 0.1206833078736125 =================================

============ Partial average of Adjusted Rand Index = 0.01564535013355998 =================================

============ Value of Jaccard Index = 0.47433007763586277 =================================

============ Partial average of Jaccard Index = 0.3533470886708251 ======

============ Precision = 0.21, Recall = 0.84, F1 = 0.3359999999999999 ============



[ WARN  ] WSIEvaluator - 

================ Statistics: ====================================

============ number of created clusters: 7 ============ 

============ average size of the created clusters: 14.285714285714286 ============ 

===========================================================================



[ INFO  ] WSIEvaluator - 



=========== Final average value of S-recall@K: =============

1 0.3958

2 0.6250

3 0.6250

4 0.6250

5 0.6250

6 0.6250

7 0.6250

8 0.6250

9 0.6250

10 0.6250

11 0.6250

12 0.6250

13 0.6250

14 0.6250

15 0.6250

16 0.7083

17 0.7083

18 0.7083

19 0.7083

20 0.7917

21 0.7917

22 0.7917

23 0.7917

24 0.7917

25 0.7917

26 0.7917

27 0.7917

28 0.8542

29 0.8542

30 0.8542

31 0.8542

32 0.8542

33 0.8542

34 0.8542

35 0.8542

36 0.8542

37 0.8542

38 0.8542

39 0.9375

40 0.9375

41 0.9375

42 0.9375

43 0.9375

44 0.9375

45 0.9375

46 0.9375

47 0.9375

48 1.0000

49 1.0000

50 1.0000

51 1.0000

52 1.0000

53 1.0000

54 1.0000

55 1.0000

56 1.0000

57 1.0000

58 1.0000

59 1.0000

60 1.0000

61 1.0000

62 1.0000

63 1.0000

64 1.0000

65 1.0000

66 1.0000

67 1.0000

68 1.0000

69 1.0000

70 1.0000

71 1.0000

72 1.0000

73 1.0000

74 1.0000

75 1.0000

76 1.0000

77 1.0000

78 1.0000

79 1.0000

80 1.0000

81 1.0000

82 1.0000

83 1.0000

84 1.0000

85 1.0000

86 1.0000

87 1.0000

88 1.0000

89 1.0000

90 1.0000

91 1.0000

92 1.0000

93 1.0000

94 1.0000

95 1.0000

96 1.0000

97 1.0000

98 1.0000

99 1.0000

100 1.0000



=========== Final average value of S-precision@r: =============

0.4000 0.5625

0.4500 0.4281

0.5000 0.3148

0.5500 0.2156

0.6000 0.1967

0.6500 0.1738

0.7000 0.1132

0.7500 0.1034

0.8000 0.0977

0.8500 0.0929

0.9000 0.0886

0.9500 0.0849

1.0000 0.0267



=========== Final average value of F1: =====================

average F1 = 0.6636355295257614



=========== Final average value of Rand Index: =============

average Rand Index = 0.4531818181818182



=========== Final average value of Adjusted Rand Index: ====

average Adj Rand Index = 0.01564535013355998



=========== Final average value of Jaccard Index: ==========

average Jaccard Index = 0.3533470886708251



================ Statistics: ====================================

============ average number of created clusters: 7.0

============ average cluster size: 14.92063492063492



[ WARN  ] WSIEvaluator - Simulation started at: 21:42 and completed at 21:42

Execution time: 0.582 sec

results/misc/dataset_with_colouring.log

0 → 100644
+3257 −0

File added.

Preview size limit exceeded, changes collapsed.

results/out4.log→results/misc/out4.log

+0 −0

File moved.

View file