How To Host AI Locally

AI chatbots are taking over the world. But if you want to guarantee your privacy when using them, running an LLM locally is going to be your best bet. In this video I collaborate with The Hated One to show you how, and to explain some AI terminology so that you understand what's going on.

00:00 Your Data is Used to Train Chatbots
01:11 Understanding AI Models
01:28 LLM
02:23 Parameters
03:34 Size
04:51 AI Engine and UX
07:15 Tutorial, courtesy of The Hated One
08:07 Ollama
12:40 Open Web UI installation
13:23 Docker
15:30 Setting up Open Web UI
16:38 Choose to Take Control of Your Data

The biggest advantage of open source models is that you can fine tune them using your own instructions while keeping all data private and confidential. Why trust your data to someone else when you don’t have to?

A huge thank you to The Hated One for his tutorial.
You can find his playlist for staying anonymous here:
https://www.youtube.com/watch?v=G_QsQp7DyjE&list=PLR_ghQEN2SgDLpuLMLa_0hjJZgrlHoi0a

Brought to you by NBTV team members: The Hated One, Reuben Yap, Lee Rennie, Cube Boy, Sam Ettaro, Will Sandoval and Naomi Brockwell

To support NBTV, visit:
https://www.nbtv.media/support
(tax-deductible in the US)

Visit our shop!
https://Shop.NBTV.media

Our eBook "Beginner's Introduction To Privacy:
https://amzn.to/3WDSfku

Beware of scammers, I will never give you a phone number or reach out to you with investment advice. I do not give investment advice.

Watch this on Odysee!
https://odysee.com/@NaomiBrockwell:4/Local-LLM:d
________________________________________________________________________
Here are a bunch of products I like and use. Using these links helps support the channel and future videos!

Recommended Books:

Beginner's Introduction To Privacy - Naomi Brockwell
https://amzn.to/3WDSfku

Permanent Record - Edward Snowden
https://amzn.to/305negc

What has the government done to our money - Rothbard
https://amzn.to/2KMzmcu

Extreme Privacy - Michael Bazzel (The best privacy book I've ever read)
https://amzn.to/3BLZ1gq
Digital version: https://inteltechniques.com/book7.html (non affiliate link)

No Place to Hide: Edward Snowden, the NSA, and the U.S. Surveillance State - Glenn Greenwald
https://amzn.to/2UQmJ4m

Some of my favorite products to help protect your privacy!

Brave browser: https://brave.com/nao076

Faraday bag (signal stopping, to protect your fob, credit card, computer, and phone)
https://amzn.to/3z02UiF

Data Blocker (if you're charging your phone in an unknown port, use this so that no data is transferred)
https://amzn.to/2SVh0J2

Camera tape (electrical tape is the best tape for covering phone and computer cameras)
https://amzn.to/3Xn8xBn

USB-C to ethernet adapter:
https://amzn.to/2lOVBoy

Privacy Screens (use your phone and computer in public? Keep your information safe!)

Computer: (Search for the size right for your computer)
MacBook Air 13" https://amzn.to/3VQvpZ7
HP/Dell/Acer/Asus/Lenovo 15.6" https://amzn.to/3KK1Oda
Lenovo Thinkpad/HP Elitebook/Dell 14" https://amzn.to/4enT2zq

Phone: (Search for the size for your phone, decide whether you want glass or plastic!)
Galaxy s24 - https://amzn.to/3VGgb8H
iPhone 15 - https://amzn.to/45vCd1h
Pixel 8 - https://amzn.to/3KFDuJF