Apfel

4,096 token context window is pretty limiting. That's roughly 3,000 words — fine for "summarize this paragraph" but not enough for anything that needs real context. Still, zero…

BoltAI also does this, but a CLI tool is nice. It’s a nice LLM because it seems fairly decent and it loads instantly and uses the CPU neural engine. The GPU is faster but when I…

Started using this earlier this week. I built a backtesting benchmark tool to compare a mix of frontier and open-source models on a fairly heavy data analysis workflow I’d been…

Started using this earlier this week. I built a backtesting benchmark tool to compare a mix of frontier and open-source models on a fairly heavy data analysis workflow I’d been…

4,096 token context window is pretty limiting. That's roughly 3,000 words — fine for "summarize this paragraph" but not enough for anything that needs real context. Still, zero…

the 2 hard limits of Appel Intelligence Foundation Model and therefor apfel is the 4k token context window and the super hard guardrails (the model prefers to tell you nothing…

This is similar to something I was playing around with last month-- basically just a CLI for accessing the foundational models. https://github.com/ehamiter/afm It's really handy…

Saw this in an another thread previously and immediately installed it. I have a new prompt to test LLMs much like simonw's pelican test. "What is 9:30am Taiwan time in US,…

1. Hugely non-deterministic: repeat queries give vastly different responses. 2. Often returns incorrect and inconsistent results even for mathematical queries. 3. Often the…

Wow - the model really hallucinates without hesitation. I asked a number of "What do you know about [person, company, etc]?" questions and rather than realizing that it didn't…

Looks like a nice wrapper around the APIs. Extremely oversold landing page, very marketing heavy for what it is. You can actually make nice looking landing pages that are about…

I find the branding to be a little odd. Like, it should be a github page with a README that says "here's how to use this." Like, the full explanation of this project is right…

You have to enable Apple Intelligence so that's a hard no from me. I'll stick to LM Studio and gpt-oss/qwen. Very cool project though.

Tahoe+ only

Interesting approach. I've been building MCP tools for AI agents recently and the local-first model makes a lot of sense for privacy-sensitive use cases. Does Apfel support MCP…

4,096 token context window is pretty limiting. That's roughly 3,000 words — fine for "summarize this paragraph" but not enough for anything that needs real context. Still, zero…

Any know if these only installed on Tahoe? I'm running Sequoia still and get an error about model not found.

Is this for Tahoe only? I’m still clutching onto Sequoia

I’ve seen several projects like this that offer a network server with access to these Apple models. The danger is when they expose that, even on a loop port, to every other…

Does the local LLM have access to personal information from the Apple account associated with the logged-in user? Maybe through a RAG pipeline or similar? Just curious if there…

> Apple locked it behind Siri. apfel sets it free This doesn't feel truthful, it sounds like this tool is a hack that unlocks something. If I understand it correctly, it's using…

BoltAI also does this, but a CLI tool is nice. It’s a nice LLM because it seems fairly decent and it loads instantly and uses the CPU neural engine. The GPU is faster but when I…

How does this model compare against other local models like Qwen run through LMStudio?

Interesting. How does this foundational model compares with other LLMs?

You have to enable Apple Intelligence so that's a hard no from me. I'll stick to LM Studio and gpt-oss/qwen. Very cool project though.

BoltAI also does this, but a CLI tool is nice. It’s a nice LLM because it seems fairly decent and it loads instantly and uses the CPU neural engine. The GPU is faster but when I…

On a similar bent, I recently discovered Handy (cross-platform) which is very well implemented local voice input: https://handy.computer/ ... serious finger saver and ideal for…

Love seeing this space grow. Been running local AI on my phone via aiME — same concept but iOS/Android, with offline voice, vision, and custom personas. Subscriptions felt like a…

Nice project. The mobile equivalent worth mentioning: aiME does this on iPhone and Android — runs Qwen, Mistral, Gemma entirely on-device with no internet after download.…