What kind of reasoning makes this worthwhile?

I have a personal, fully offline and local version of Windows Recall basically, but good, made using macOS built-in OCR and LLM. The reasoning requirements are tiny (just interpret the screen based on the OCR, do rolling de-duplication and summarization), but they are non-zero. The tool is valuable to me and it being dep-free and fully offline and local just gives me a good feeling.

Would you ever consider writing up or sharing your setup?

The ingredients are:

1. Bun.Cron API to run a script every minute

2. Bun.$ (Bun Shell) to execute the macOS command to take a screenshot (I do this for all connected screens at that moment)

3. Bun.Image to downscale everything to 1x in case some of the screenshots are 2x

4. Bun Shell again to run a JXA AppleScript thing to use the Vision Framework or whatever it is called to OCR the image into a file

5. Bun Shell to run the Swift compiler in the one-off eval mode with inline Swift helper that runs the Foundation Models Framework built-in LLM with a system prompt that tells it what the OCR said and instructs it to glean what may be on the screen (can't do this with JXA because the models are not exposed with ObjC APIs)

6. For each screenshot, continuously, take the previous day summary file and the last OCR/context results and produce a new summary of the day

I plan on adding extra information from the OS like the currently opened windows, currently focused window, time of day etc. into the mix, but so far it hasn't been needed. It produces reports of a good enough quality for me.

I `grep` these daily summaries whenever I need to recall a link I saw or a find what channel a message I spotted was in or take another look at that one tab I already closed, maybe re-open it by its OCR'd URL etc.

You were downvoted but yes, hoping a state-controlled, authoritarian, single party politically led, genocidal government will ”step up” to better less-political research is faith without reason and ignorant of history

All of those also describe America, but in typical American extravagance, there's two parties

Which country are you alluding to?

Not only failed, but then commit a fraudulent activity to cover up their sins leading to a systemic destruction of society and theft of taxes

Do you use Kiro specs? I have been loving using Kiro for the same reasons, and and just starting to use the spec feature.

I wonder what the cause of this was? Microsoft Politics? Bureaucracy? Forced move to azure?

My guess would be a obnoxious and lethal mixture of all of the above.

Also AI mandates.

I think people become more conservative as they get wealthier. Getting older just correlates with increasing wealth.

"The purpose of a system is what it does". Dangerous principle to apply too literally but almost always worth considering. In this case, the purpose of abstinence-only education is to increase teenage births and the purpose of modern sex education is to decrease it.

Bloggers quoting bloggers quoting instagrammers quoting TikTok

Can’t hear the video for some reason. Did they abort for a technical issue or weather or something else?

> Employers spent company money

Wow! How dare they.