Running local LLMs on macOS - the easy way
If your Mac has enough unified memory to run some decent models ā why not do so? How, you ask? Well, there is a very easy way (moreā¦)

Discoholic šŖ©
hello vonnie

ā
The Bowery Presents

oozey mess
taylor price
No title available

romaā
No title available
let's talk about Bridgerton tea, my ask is open
official daine visual archive
No title available

Jar Jar Binks Fan Club

Andulka

blake kathryn
icyghini twinkie
Xuebing Du
ojovivo
š

@theartofmadeline

seen from United States
seen from Tunisia

seen from United States

seen from Türkiye

seen from United States
seen from United States

seen from United States

seen from United States

seen from United Kingdom
seen from United States

seen from Malaysia

seen from Malaysia

seen from United States

seen from Vietnam
seen from Malaysia

seen from Ecuador

seen from Philippines
seen from Kuwait
seen from Brazil
seen from France
@mvmn
Running local LLMs on macOS - the easy way
If your Mac has enough unified memory to run some decent models ā why not do so? How, you ask? Well, there is a very easy way (moreā¦)
Using local AI as an OCR
I have a collection of CDs, and I wanted to make an index of those CDs with regards to where they are on my shelves. Iāve photographed them and needed an OCR to feed the photos to ā to extract the titles Since AI is all the rage now, I was looking for a multimodal LLM that could do that ā and so far stopped at qwen2.5vl, which I could run on my 64GB unified memory M4 MacBook The process isā¦
Telegram-desktop in Docker (Podman) on macOS ARM/M CPUs
I do not trust Telegram to have access to my local file system. So first and foremost, if you install Telegram client on macOS ā install it via Mac App Store. This should provide some isolation. But I want to be certain. Thus I found a way to run Telegram in docker. I use Podman instead of Docker desktop, but that doesnāt matter much. What matters is that we can run Telegram client (AKAā¦
Use GPhoto2Server camera preview in OBS
One can use GPhoto2Server to capture video feed from digital cameras as an input in OBS In order to do so, run GPhoto2Server, and in OBS studio add āMedia Sourceā with this configuration: Disable ālocal fileā checkbox Set āInputā to be http://localhost:8080/stream.mjpeg Optionally set Network Buffering to 0 and reconnect delay to 1S Continue reading Use GPhoto2Server camera preview inĀ OBS
View On WordPress