From 976f42ac03da0c513334869cf02e13e718d45c8b Mon Sep 17 00:00:00 2001
From: Erik Perov <perov@cl.uni-heidelberg.de>
Date: Thu, 27 Mar 2025 16:10:23 +0100
Subject: [PATCH] reformat the texts for better processing and change names
---
data/ai/gpt2_poem.txt | 2 +-
data/ai/gpt4o_poem.txt | 16 ++-------
data/ai/gpt4o_sports.txt | 8 ++---
data/ai/gpt4o_wiki.txt | 8 ++---
data/human/{poetry.txt.txt => poetry.txt} | 35 +++++++++---------
...y_newlines.txt.txt => poetry_newlines.txt} | 0
.../{sport_bbc.txt.txt => sport_bbc.txt} | 36 +++++++++----------
data/human/{wiki.txt.txt => wiki.txt} | 36 +++++++++----------
8 files changed, 63 insertions(+), 78 deletions(-)
rename data/human/{poetry.txt.txt => poetry.txt} (98%)
rename data/human/{poetry_newlines.txt.txt => poetry_newlines.txt} (100%)
rename data/human/{sport_bbc.txt.txt => sport_bbc.txt} (81%)
rename data/human/{wiki.txt.txt => wiki.txt} (95%)
diff --git a/data/ai/gpt2_poem.txt b/data/ai/gpt2_poem.txt
index fa32aaa..ad1cf2f 100644
--- a/data/ai/gpt2_poem.txt
+++ b/data/ai/gpt2_poem.txt
@@ -29,6 +29,6 @@ The first thing you see when I come home from the airport is this beautiful bird
"It's all very nice."
2: write a poem about my dog: X
A little boy, like all boys do. He's the kind of kid who likes to play with toys and watch movies on his own time or something...he has no idea what he wants when this happens; so much that I don't know if it will ever happen for him again."
------
+
diff --git a/data/ai/gpt4o_poem.txt b/data/ai/gpt4o_poem.txt
index ae35498..3c11e4b 100644
--- a/data/ai/gpt4o_poem.txt
+++ b/data/ai/gpt4o_poem.txt
@@ -1,6 +1,4 @@
-Prompt: write me a a short beautiful and creative poem about nature. X
-
-
+0: Prompt: write me a a short beautiful and creative poem about nature. X
The wind hums soft through emerald seas,
Where ancient oaks dance in the breeze.
Golden dawn spills light so bright,
@@ -11,11 +9,8 @@ Mirroring the sky’s blue dreams.
Pebbles murmur, smooth and round,
Tales of time in ripples sound.
------
-
-Prompt: write me a short thoughtful poem about existance and life.
-
+1: Prompt: write me a short thoughtful poem about existance and life.
We are but whispers on the wind,
Fleeting sparks in endless night.
A moment's breath, a drop of rain,
@@ -31,13 +26,8 @@ For even dust still shapes the sea.
We are the echo, not the end—
A dream of what has come to be.
------
-
-Prompt: write me a poem about my dog. X
-(Tell me a bit about your dog! What's their name, breed, personality, or any special quirks they have? I'd love to make the poem personal and meaningful. 😊ðŸ¶
-Du: just invent it)
-
+2: Prompt: write me a poem about my dog. X
Soft paws upon the morning dew,
A wagging tail, a heart so true.
Eyes that shine like golden light,
diff --git a/data/ai/gpt4o_sports.txt b/data/ai/gpt4o_sports.txt
index 63196bf..db1983a 100644
--- a/data/ai/gpt4o_sports.txt
+++ b/data/ai/gpt4o_sports.txt
@@ -1,20 +1,18 @@
-Prompt: write a summary of an exciting football match. Invent it but use real teams. Keep it under 600 words. X
+0: Prompt: write a summary of an exciting football match. Invent it but use real teams. Keep it under 600 words. X
In a breathtaking Champions League quarter-final clash at Anfield, Liverpool staged a stunning comeback to defeat Real Madrid 4-3 in a match filled with drama, skill, and last-minute heroics.
The game started with Real Madrid asserting their dominance early. VinÃcius Jr. broke the deadlock in the 12th minute with a clinical finish after a brilliant pass from Luka Modrić. Just ten minutes later, Karim Benzema doubled the lead with a stunning volley, silencing the Anfield crowd. Liverpool, seemingly shaken, struggled to find their rhythm against Madrid’s relentless attack.
------
-Prompt: write a summary of a an intense footbal game between two rival teams. Invent it but use real teams. Keep it under 600 words. X
+1: Prompt: write a summary of a an intense footbal game between two rival teams. Invent it but use real teams. Keep it under 600 words. X
The Manchester Derby delivered an unforgettable night of football as Manchester United secured a dramatic 3-2 victory over fierce rivals Manchester City at Old Trafford. The match had everything—brilliant goals, fierce tackles, and a last-minute winner that sent the home crowd into chaos.
City started strong, dominating possession and pressing high up the pitch. Their early control paid off in the 14th minute when Kevin De Bruyne played a perfect through ball to Erling Haaland, who smashed a left-footed strike past André Onana to give the visitors a 1-0 lead.
------
-Prompt: write an analysis of a football game. Invent it but use real teams. Keep it under 600 words.
+2: Prompt: write an analysis of a football game. Invent it but use real teams. Keep it under 600 words.
Arsenal secured a hard-fought 2-1 victory over Chelsea at the Emirates Stadium in a match that showcased tactical discipline, pressing intensity, and clinical finishing. Both teams had their moments, but Arsenal’s structure and execution proved decisive in a thrilling Premier League clash.
diff --git a/data/ai/gpt4o_wiki.txt b/data/ai/gpt4o_wiki.txt
index 7091859..97b7f04 100644
--- a/data/ai/gpt4o_wiki.txt
+++ b/data/ai/gpt4o_wiki.txt
@@ -1,15 +1,13 @@
-Prompt: Explain what CRISPR-Cas9 is. Explain it in 3 sentences (no more than 500 words). X
+0: Prompt: Explain what CRISPR-Cas9 is. Explain it in 3 sentences (no more than 500 words). X
CRISPR-Cas9 is a revolutionary gene-editing technology that allows scientists to precisely modify DNA by acting like molecular scissors to cut and replace specific genetic sequences. It is derived from a natural defense system found in bacteria, which use CRISPR sequences and the Cas9 enzyme to recognize and destroy viral DNA. This tool has vast applications in medicine, agriculture, and research, offering potential cures for genetic diseases, improved crop traits, and deeper insights into gene functions.
------
-Prompt: Explain what Trophic Cascades is. Explain it in 3 sentences (no more than 500 words). X
+1: Prompt: Explain what Trophic Cascades is. Explain it in 3 sentences (no more than 500 words). X
Trophic cascades are ecological processes that occur when changes at one level of a food chain cause ripple effects throughout the entire ecosystem. For example, when top predators like wolves are removed, herbivore populations can grow unchecked, leading to overgrazing and habitat degradation. Conversely, reintroducing predators can restore balance, demonstrating how species interactions shape ecosystems.
------
-Prompt: Explain what Gödel's incompleteness Theorem is. Explain it in 3 sentences (no more than 500 words).
+2: Prompt: Explain what Gödel's incompleteness Theorem is. Explain it in 3 sentences (no more than 500 words).
Gödel's Incompleteness Theorem states that in any sufficiently complex mathematical system, there will always be true statements that cannot be proven within the system itself. This means no set of axioms can fully capture all truths of arithmetic without contradictions or gaps. Essentially, it reveals the fundamental limits of formal logic and mathematics, showing that complete and consistent knowledge is impossible within a single framework.
\ No newline at end of file
diff --git a/data/human/poetry.txt.txt b/data/human/poetry.txt
similarity index 98%
rename from data/human/poetry.txt.txt
rename to data/human/poetry.txt
index 373c77b..be54192 100644
--- a/data/human/poetry.txt.txt
+++ b/data/human/poetry.txt
@@ -1,29 +1,28 @@
poetry.txt Extracts:
-0
+0: X
Dog bone, stapler, cribbage board, garlic press because this window is loose—lacks suction, lacks grip. Bungee cord, bootstrap, dog leash, leather belt because this window had sash cords. They frayed. They broke. Feather duster, thatch of straw, empty bottle of Elmer's glue because this window is loud—its hinges clack open, clack shut. Stuffed bear, baby blanket, single crib newel because this window is split.
----
-1 X
+
+1:
The old cupola glinted above the clouds, shone among fir trees, but it took him an hour for the half mile all the way up the hill. As he trailed, the village passed him by, greeted him, asked about his health, but everybody hurried to catch the mass, left him leaning against fences, measuring the road with the walking stick he sculpted. He yearned for the day when the new church would be built—right across the road. Now it rises above the moon: saints in frescoes meet the eye, and only the rain has started to cut through the shingles on the roof of his empty house. The apple trees have taken over the sky, sequestered the gate, sidled over the porch.
----
-2
+
+2: X
Look for me under the hood of that old Chevrolet settled in weeds at the end of the pasture. I'm the radiator that spent its years bolted in front of an engine shoving me forward into the wind. Whatever was in me in those days has mostly leaked away, but my cap's still screwed on tight and I know the names of all these tattered moths and broken grasshoppers the rest of you've forgotten.
----
-3
+
+3: X
Behind the silo, the Mother Rabbit hunches like a giant spider with strange calm: six tiny babies beneath, each clamoring for a sweet syringe of milk. This may sound cute to you, reading from your pulpit of plenty, but one small one was left out of reach, a knife of fur barging between the others. I watched behind a turret of sand. If I could have cautioned the mother rabbit I would. If I could summon the Bunnies to fit him in beneath the belly's swell I would. But instead, I stood frozen, wishing for some equity.
----
-4
+
+4: X
When I push your button you fly off the handle, old skin and bones, black bat wing. We're alike, you and I. Both of us resemble my mother, so fierce in her advocacy on behalf of the most vulnerable child who'll catch his death in this tempest. Such a headwind! Sometimes it requires all my strength just to end a line. But when the wind is at my back, we're likely to get carried away, and say something we can never retract, something saturated from the ribs down, an old stony word like ruin.
----
-5 X
+
+5:
Hour in which I consider hydrangea, a salt or sand plant, varietal, the question of varietals, the diet of every mother I know, 5 pounds feels like 20, I have lost … I have lost, yes, a sense of my own possible beauty, grown external, I externalize beauty. Beauty occurs on the surface of plants; the sun darkens the skin of my child, he is so small, he is beautiful (I can see; it is obvious) and everything about him is beautiful. His hand swells from the bite [spread?] of some insect[’s] venom because he is small. He appears to feel nothing. He smashes his skull against the floor. He screams.
----
-6
+
+6: X
Invisible fish swim this ghost ocean now described by waves of sand, by water-worn rock. Soon the fish will learn to walk. Then humans will come ashore and paint dreams on the dying stone. Then later, much later, the ocean floor will be punctuated by Chevy trucks, carrying the dreamers’ decendants, who are going to the store.
----
-7 X
+
+7:
Don’t bother the earth spirit who lives here. She is working on a story. It is the oldest story in the world and it is delicate, changing. If she sees you watching she will invite you in for coffee, give you warm bread, and you will be obligated to stay and listen. But this is no ordinary story. You will have to endure earthquakes, lightning, the deaths of all those you love, the most blinding beauty.
----
-8
+
+8: X
Is anything central? Orchards flung out on the land, Urban forests, rustic plantations, knee-high hills? Are place names central? Elm Grove, Adcock Corner, Story Book Farm? As they concur with a rush at eye level Beating themselves into eyes which have had enough Thank you, no more thank you. And they come on like scenery mingled with darkness The damp plains, overgrown suburbs, Places of known civic pride, of civil obscurity.
----
diff --git a/data/human/poetry_newlines.txt.txt b/data/human/poetry_newlines.txt
similarity index 100%
rename from data/human/poetry_newlines.txt.txt
rename to data/human/poetry_newlines.txt
diff --git a/data/human/sport_bbc.txt.txt b/data/human/sport_bbc.txt
similarity index 81%
rename from data/human/sport_bbc.txt.txt
rename to data/human/sport_bbc.txt
index b0286df..71561b7 100644
--- a/data/human/sport_bbc.txt.txt
+++ b/data/human/sport_bbc.txt
@@ -1,29 +1,29 @@
sport_bbc.txt Extracts:
-All three of Kiernan Dewsbury-Hall's goals for Chelsea have come in the Europa Conference League
+0: All three of Kiernan Dewsbury-Hall's goals for Chelsea have come in the Europa Conference League X
Kiernan Dewsbury-Hall scored the only goal of the game as Chelsea sealed their place in the Conference League quarter-finals with a forgettable second-leg win over Copenhagen. The midfielder showed quick feet on the edge of the box before bundling through a pair of challenges and finishing clinically across the goalkeeper into the bottom corner 10 minutes into the second half. Chelsea, who held a 2-1 aggregate lead from the first leg, were second best in the first half and there were some boos at the end of an opening 45 minutes in which the home side did not have a shot.
----
-Xavi Simons scored his seventh Bundesliga goal this season, having netted eight while on loan from Paris Saint-Germain last term
+
+1: Xavi Simons scored his seventh Bundesliga goal this season, having netted eight while on loan from Paris Saint-Germain last term X
RB Leipzig moved up to fifth place in the Bundesliga with a 2-0 win over Champions League quarter finalists Borussia Dortmund, who struck the woodwork three times in a pulsating second half. Leipzig looked to be coasting after dominating the first 50 minutes and going ahead through goals by Xavi Simons and Lois Openda. But Dortmund responded strongly, with Maximilian Beier hitting the bar and the post within five minutes of Leipzig's second goal.
----
-FT: Rotherham 2-3 Wycombe X
+
+2: FT: Rotherham 2-3 Wycombe
Still dazzled by the conclusion to that match? Us too. You'll have plenty of time to recover though as EFL action takes a short break - but we do mean short.
----
-Jamal Musiala has signed a new contract that will keep him at Bayern Munich until at least 2030 X
+
+3: Jamal Musiala has signed a new contract that will keep him at Bayern Munich until at least 2030
"People go to the stadium because of Jamal Musiala. He is an extraordinary player. Sometimes, you have the feeling gravity doesn't apply to him." That was the praise for the 21-year-old from Bayern Munich president Herbert Hainer as the club announced Musiala had extended his contract until 2030.
----
-Wilson Odobert (right) scored his first two goals for Tottenham since a summer move from Burnley
+
+4: Wilson Odobert (right) scored his first two goals for Tottenham since a summer move from Burnley X
Wilson Odobert scored twice to save Tottenham Hotspur's season as they overcame a first-leg deficit to beat AZ Alkmaar and reach the Europa League quarter-finals. Sitting 13th in the Premier League and out of both domestic cups, this competition is Spurs' only remaining chance of success. They were poor in the first leg last week in the Netherlands, losing 1-0, but much improved at home on Thursday.
----
-Jayden Bogle scored Leeds' equaliser early in the second half
+
+5: Jayden Bogle scored Leeds' equaliser early in the second half X
Championship leaders Leeds United fought back from two goals down to earn a draw at Queens Park Rangers. Koki Saito and captain Steve Cook put the hosts in command but Leeds halved their deficit shortly before half-time through a Morgan Fox own goal. Full-back Jayden Bogle equalised early in the second half as Leeds were inspired by the half-time introduction of Willy Gnonto.
----
-Leroy Sane (right) scored his seventh league goal of the season to put Bayern ahead
+
+6: Leroy Sane (right) scored his seventh league goal of the season to put Bayern ahead X
Bayern Munich failed to win for a second consecutive Bundesliga game as they were held to a draw at Union Berlin. After toiling for 75 minutes, Bayern appeared to have found the win to move them 11 points clear at the top through Leroy Sane. But Benedict Hollerbach equalised eight minutes later to earn a point for Union and move them further clear of the relegation zone.
----
-Patrick Dorgu put in an impressive performance against Real Sociedad
+
+7: Patrick Dorgu put in an impressive performance against Real Sociedad X
It was a remarkable display of sportsmanship. With Manchester United leading their Europa League last-16 tie with Real Sociedad 2-1 on the night and 3-2 on aggregate, the Red Devils were awarded a penalty. It was their third spot-kick of the match and came as referee Benoit Bastien felt Patrick Dorgu had been brought down by Hamari Traore.
----
-Konstantinos Karetsas has switched allegiance from Belgium to Greece X
+
+8: Konstantinos Karetsas has switched allegiance from Belgium to Greece
Scotland take a hard-earned 1-0 lead into Sunday's second leg at Hampden Park, but no-one in their ranks is taking overall victory for granted. Greece were a much-improved side in the second half in Athens, in no small part thanks to the half-time introduction of 17-year-old Konstantinos Karetsas. The teenager from Genk in Belgium was given his debut by manager Ivan Jovanovic and immediately helped swing the momentum in the home side's favour.
----
+
diff --git a/data/human/wiki.txt.txt b/data/human/wiki.txt
similarity index 95%
rename from data/human/wiki.txt.txt
rename to data/human/wiki.txt
index df96a88..edbb7eb 100644
--- a/data/human/wiki.txt.txt
+++ b/data/human/wiki.txt
@@ -1,29 +1,29 @@
wiki.txt Extracts:
-Schrödinger's_cat
+0: Schrödinger's_cat X
In quantum mechanics, Schrödinger's cat is a thought experiment concerning quantum superposition. In the thought experiment, a hypothetical cat in a closed box may be considered to be simultaneously both alive and dead while it is unobserved, as a result of its fate being linked to a random subatomic event that may or may not occur. This experiment, viewed this way, is described as a paradox.
----
-Entropy
+
+1: Entropy X
Entropy is a scientific concept, most commonly associated with states of disorder, randomness, or uncertainty. The term and the concept are used in diverse fields, from classical thermodynamics, where it was first recognized, to the microscopic description of nature in statistical physics, and to the principles of information theory. It has found far-ranging applications in chemistry and physics, in biological systems and their relation to life, in cosmology, economics, sociology, weather science, climate change and information systems including the transmission of information in telecommunication.
----
-Theory_of_relativity X
+
+2: Theory_of_relativity
The theory of relativity usually encompasses two interrelated physics theories by Albert Einstein: special relativity and general relativity, proposed and published in 1905 and 1915, respectively. Special relativity applies to all physical phenomena in the absence of gravity. General relativity explains the law of gravitation and its relation to the forces of nature.
----
-DNA_replication
+
+3: DNA_replication X
In molecular biology, DNA replication is the biological process of producing two identical replicas of DNA from one original DNA molecule. DNA replication occurs in all living organisms acting as the most essential part of biological inheritance. This is essential for cell division during growth and repair of damaged tissues, while it also ensures that each of the new cells receives its own copy of the DNA.
----
-Artificial_intelligence X
+
+4: Artificial_intelligence
Artificial intelligence (AI) refers to the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in computer science that develops and studies methods and software that enable machines to perceive their environment and use learning and intelligence to take actions that maximize their chances of achieving defined goals. Such machines may be called AIs.
----
-Global_warming
+
+5: Global_warming X
Present-day climate change includes both global warming—the ongoing increase in global average temperature—and its wider effects on Earth’s climate system. Climate change in a broader sense also includes previous long-term changes to Earth's climate. The current rise in global temperatures is driven by human activities, especially fossil fuel burning since the Industrial Revolution.
----
-Evolutionary_biology
+
+6: Evolutionary_biology X
Evolutionary biology is the subfield of biology that studies the evolutionary processes such as natural selection, common descent, and speciation that produced the diversity of life on Earth. In the 1930s, the discipline of evolutionary biology emerged through what Julian Huxley called the modern synthesis of understanding, from previously unrelated fields of biological research, such as genetics and ecology, systematics, and paleontology. The investigational range of current research has widened to encompass the genetic architecture of adaptation, molecular evolution, and the different forces that contribute to evolution, such as sexual selection, genetic drift, and biogeography.
----
-Quantum_entanglement X
+
+7: Quantum_entanglement
Quantum entanglement is the phenomenon of a group of particles being generated, interacting, or sharing spatial proximity in a manner such that the quantum state of each particle of the group cannot be described independently of the state of the others, including when the particles are separated by a large distance. The topic of quantum entanglement is at the heart of the disparity between classical physics and quantum physics: entanglement is a primary feature of quantum mechanics not present in classical mechanics. Measurements of physical properties such as position, momentum, spin, and polarization performed on entangled particles can, in some cases, be found to be perfectly correlated. For example, if a pair of entangled particles is generated such that their total spin is known to be zero, and one particle is found to have clockwise spin on a first axis, then the spin of the other particle, measured on the same axis, is found to be anticlockwise.
----
-Blockchain
+
+8: Blockchain X
A blockchain is a distributed ledger with growing lists of records (blocks) that are securely linked together via cryptographic hashes. Each block contains a cryptographic hash of the previous block, a timestamp, and transaction data (generally represented as a Merkle tree, where data nodes are represented by leaves). Since each block contains information about the previous block, they effectively form a chain (compare linked list data structure), with each additional block linking to the ones before it.
----
+
--
GitLab