Over the Agent AI debates and large court trials with all dominant online super AIs, I had to recall what a small local LLM on a cheap Linux office computer can do, without even my Cyberdeck system I am developing without funding or even clients as a product without a future, being therefore no product... but an attitude, I guess.
llama3.2:3b 2GB
To run the Llama 3.2 3B model locally, your system needs a minimum of 4 GB to 8 GB of available RAM (system memory or GPU VRAM), depending heavily on the format or quantization you choose.
The Intel Core i7-8700T is an 8th-generation "Coffee Lake" desktop processor designed for low-power, energy-efficient systems, featuring 6 cores, 12 threads, and a 35W Thermal Design Power (TDP).
I have 3GB RAM, but no GPU. The answers are as fast as using DeepSeek. Based on what the Google AI said... and this is what happens:
llama3.2:3b
To run the Llama 3.2 3B model locally, your system needs a minimum of 4 GB to 8 GB of available RAM (system memory or GPU VRAM), depending heavily on the format or quantization you choose.
The Intel Core i7-8700T is an 8th-generation "Coffee Lake" desktop processor designed for low-power, energy-efficient systems, featuring 6 cores, 12 threads, and a 35W Thermal Design Power (TDP)
...
(base) j4v@920:~$ ollama run llama3.2:3b "Hello, you are my local LLM. What can you do for me? What do you know about most?"
(base) j4v@920:~$ ollama run llama3.2:3b "Hello, you are my local LLM. What can you do for me? What do you know about most?"
Hello! I'm thrilled to be your local LLM (Large Language Model). I can
assist with a wide range of topics and tasks, covering various aspects of
knowledge. Here's an overview of what I can do:
**Conversational Dialogue**: We can have a conversation on any topic you'd
like, from casual chit-chat to in-depth discussions.
**Answering Questions**: I can provide information on a vast array of
subjects, including but not limited to:
+ History (world, regional, and cultural)
+ Science (physics, biology, chemistry, etc.)
+ Technology (computer science, software, hardware, etc.)
+ Arts (music, literature, film, etc.)
+ Sports
+ Health and wellness
**Language Translation**: I can translate text from one language to
another, including popular languages like Spanish, French, German,
Chinese, Japanese, and many more.
**Text Generation**: I can create text based on a prompt or topic, such
as:
+ Writing stories or poetry
+ Generating emails or messages
+ Creating product descriptions or reviews
**Summarization**: If you provide me with a long piece of text, I can
summarize it for you, highlighting the main points and key information.
**Brainstorming**: We can brainstorm ideas together on topics like
creative writing, problem-solving, or business concepts.
My training data includes a massive corpus of text from various sources,
including books, articles, research papers, and websites. However, my
knowledge cutoff is limited to December 2023, so I might not have the very
latest information on extremely recent events or developments.
Feel free to pick any topic you're interested in, ask me anything, or
challenge me with a question – I'm here to help!
(base) j4v@920:~$
(base) j4v@920:~$ ollama run llama3.2:3b "Let's dive deeper into this. You said you can provide information about History. That is a wide field. Do you have any focus on historic topics, do you general knowledge? So, can you give me a list of Pirates that fought against Slavery in the time of the Carribean Piracy? Can you tell me how many Camps the Germans had build in WW2? Can you tell me about European deindustrialisation?"
I'd be happy to provide information on these topics. Here are some answers:
**Pirates who fought against Slavery:**
While pirates were often associated with piracy and plunder, there were indeed
some pirates who became abolitionists and fought against the transatlantic slave
trade. Here are a few notable examples:
1. **John Newton**: A British pirate-turned-minister, Newton was once the captain
of a slave ship but later converted to Christianity and became an outspoken
abolitionist.
2. **William Bligh**: After being marooned on a Pacific island by his mutinous
crew, Bligh returned as commander and implemented reforms that reduced the use of
slaves in his fleet.
3. **Richard Henry Dana Jr.**: An American lawyer and politician, Dana wrote "Two
Years Before the Mast," which included accounts of slave ships and the horrors of
the transatlantic slave trade.
4. **Francis Moore**: A British pirate who sailed with Calico Jack Rackham, Moore
became an abolitionist after being captured by the British Navy.
**Number of camps built by the Germans in WW2:**
During World War II, the Germans built numerous concentration camps, ghettos, and
labor camps across occupied Europe. Here's a rough estimate:
* Concentration camps: around 40-50 main camps, including Auschwitz-Birkenau,
Buchenwald, Dachau, and Bergen-Belsen.
* Ghettos: over 400 urban ghettos in Poland alone, with many more in other
European countries.
* Labor camps (Gulags): hundreds of labor camps were built by the Germans and
their allies, often using existing Soviet prison infrastructure.
Keep in mind that these numbers are approximate, as many records from this period
were destroyed or hidden.
**European deindustrialisation:**
During World War II, Europe experienced significant economic disruption and
industrialization stagnation. Several factors contributed to this:
1. **War destruction**: The war effort led to widespread destruction of
infrastructure, factories, and resources.
2. **Rationing and scarcity**: Food, fuel, and raw materials became scarce,
leading to shortages and rationing.
3. **Occupation and control**: German occupation regimes imposed strict controls
on industries, economies, and societies, stifling innovation and entrepreneurship.
4. **Loss of skilled labor**: Millions of workers were mobilized for the war
effort or killed, leaving industries understaffed and underproductive.
Some specific examples of European deindustrialisation include:
* Germany's heavy industry production declined by 90% between 1939 and 1945.
* The UK's coal production dropped from 45 million tons in 1939 to just 2.5
million tons in 1943.
* France's industrial production decreased by over 70% during the occupation.
These factors combined to slow or halt economic growth, leading to a significant
decline in European deindustrialization rates compared to pre-war levels.
Let me know if you'd like more information on any of these topics!
(base) j4v@920:~$ ollama run llama3.2:3b "I am in central Paris now. I stand at the Seine and next to the stairs leading to the garden of the Louvre. Can you give me a tourist record based on your historic knowledge of what I should see now and what I can explore in walking distance, please?"
Bonjour! You're standing in front of one of the most iconic landmarks in Paris.
Here's a suggested itinerary for you to make the most of your time:
**Stop 1: The Seine River (where you are)**
Take a moment to admire the majestic Seine River, which has played a significant
role in the city's history and development. You can see various boats and barges
passing by.
**Walking Distance:** None needed!
**Stop 2: The Garden of the Louvre**
Head up the stairs to explore the beautiful gardens of the Louvre Museum. Take a
stroll along the tranquil paths, admire the stunning glass roof, and enjoy the
serene atmosphere.
* **Walking Time:** About 5-7 minutes from where you are
**Stop 3: The Pyramid of the Louvre**
Visit the iconic Pyramid, designed by I.M. Pei, which serves as the museum's main
entrance. You can also explore the adjacent Cour Marly, a beautiful courtyard with
a stunning glass ceiling.
* **Walking Time:** About 2-3 minutes from the garden
**Stop 4: The Louvre Museum**
Explore the world-renowned Louvre Museum, home to an impressive collection of art
and artifacts from ancient civilizations to the 19th century. Don't miss the Mona
Lisa, Venus de Milo, and other masterpieces.
* **Walking Time:** About 2-3 minutes from the pyramid
**Stop 5: Palais-Royal**
Walk towards the nearby Palais-Royal, a former royal palace that now houses modern
art installations and gardens. Take a stroll through the beautiful Jardin du
Palais-Royal, which offers stunning views of the city.
* **Walking Time:** About 10-12 minutes from the Louvre
**Stop 6: Tuileries Garden**
Continue to the adjacent Tuileries Garden, another beautiful green oasis in the
heart of Paris. Stroll along the garden's paths, admire the fountains and
sculptures, and enjoy the scenic views.
* **Walking Time:** About 5-7 minutes from Palais-Royal
**Additional Recommendations:**
* If you have time, consider visiting the nearby Louvre Museum's collections at
night, when the museum is open late (on select days).
* Take a Seine River cruise to see Paris from a different perspective.
* For lunch, head to the nearby Café Marly or Le Comptoir du Louvre for a taste of
French cuisine.
**Final Tips:**
* Be prepared for crowds and security checks at popular attractions like the
Louvre.
* Wear comfortable shoes, as you'll be doing some walking.
* Don't forget to try a classic French baguette or croissant from a local bakery!
Enjoy your time exploring Paris!
(base) j4v@920:~$
