r/webdev • u/trekhleb • 4d ago
r/LLM • u/trekhleb • 5d ago
I made LLMs debate each other about the question you ask until the consensus. It is insightful to see how they change sides and under which arguments. Open-source, browser-only, BYOK, follow-up to Karpathy's llm-council
I'm the author of what follows; it's open source (AGPL), there's no paid tier and nothing to sell; sharing the architecture and one insightful result of the LLMs reaching consensus.
**The lineage**
This is built on the shoulders of `karpathy/llm-council` (https://github.com/karpathy/llm-council): one question fans out to several LLMs, they review each other's answers, and a final answer is synthesized. His pipeline is one fixed pass (answer → rank → chairman) behind a local server. I kept the council idea and changed the shape: my follow-up runs fully in the browser as a static bundle (zero backend; the "server" is your browser tab), bring-your-own-keys: keys sit in localStorage, and requests go from the browser straight to the providers you pick (Anthropic, OpenAI, Google, Groq, OpenRouter, local Ollama).
**The central difference: Consensus mode**
Instead of ranking first drafts, the models debate over rounds:
- Every participant answers independently.
- A Mediator model reads the answers (anonymized as "Model A/B/C”) judges whether they've converged, and if not, distills the actual points of disagreement to seed the next round.
- Every participant re-answers, seeing its own prior position plus its peers' arguments. Labels stay stable within a turn but reshuffle across turns, so models can't learn which brand is which.
- Repeat until convergence or a round cap (3 by default, configurable). At the cap, the Mediator reports points of agreement *and* remaining conflicts, no forced harmony.
The Mediator's verdict is a structured output (`convergent` \+ divergence points + a per-model "held/shifted" digest), so the UI can show exactly who moved and on what argument.
**One of the debate examples that was fun to observe**
In one recorded demo (*“pick the best third language for an 8-year-old who already speaks English and Spanish”*), Claude Fable was the 1-vs-2 minority arguing French, while GPT-5.5 and Gemini both picked Mandarin. In round two, both majority models switched to French: each named the specific arguments that moved it (expected value = payoff × probability of actually reaching fluency; the importance and challenge of being immersed in the native-speaker environment; machine translation eroding the transactional value of "hard" languages). GPT literally opens its re-answer with "What changed my mind…". The demo can be seen without any API key.
**Context:**
* Repo: [https://github.com/trekhleb/yesbrainer\](https://github.com/trekhleb/yesbrainer)
* The recorded debate above, no key needed: [https://yesbrainer.ai/council/9123476a-4bc0-4214-8d1b-c76613808eb9\](https://yesbrainer.ai/council/9123476a-4bc0-4214-8d1b-c76613808eb9)
r/LLMDevs • u/trekhleb • 5d ago
Resource I made LLMs debate each other about the question you ask until the consensus. It is insightful to see how they change sides and under which arguments. Open-source, browser-only, BYOK, follow-up to Karpathy's llm-council
I'm the author of what follows; it's open source (AGPL), there's no paid tier and nothing to sell; sharing the architecture and one insightful result of the LLMs reaching consensus.
The lineage
This is built on the shoulders of karpathy/llm-council (https://github.com/karpathy/llm-council): one question fans out to several LLMs, they review each other's answers, and a final answer is synthesized. His pipeline is one fixed pass (answer → rank → chairman) behind a local server. I kept the council idea and changed the shape: my follow-up runs fully in the browser as a static bundle (zero backend; the "server" is your browser tab), bring-your-own-keys: keys sit in localStorage, and requests go from the browser straight to the providers you pick (Anthropic, OpenAI, Google, Groq, OpenRouter, local Ollama).
The central difference: Consensus mode
Instead of ranking first drafts, the models debate over rounds:
- Every participant answers independently.
- A Mediator model reads the answers (anonymized as "Model A/B/C”) judges whether they've converged, and if not, distills the actual points of disagreement to seed the next round.
- Every participant re-answers, seeing its own prior position plus its peers' arguments. Labels stay stable within a turn but reshuffle across turns, so models can't learn which brand is which.
- Repeat until convergence or a round cap (3 by default, configurable). At the cap, the Mediator reports points of agreement and remaining conflicts, no forced harmony.
The Mediator's verdict is a structured output (convergent + divergence points + a per-model "held/shifted" digest), so the UI can show exactly who moved and on what argument.
One of the debate examples that was fun to observe
In one recorded demo (“pick the best third language for an 8-year-old who already speaks English and Spanish”), Claude Fable was the 1-vs-2 minority arguing French, while GPT-5.5 and Gemini both picked Mandarin. In round two, both majority models switched to French: each named the specific arguments that moved it (expected value = payoff × probability of actually reaching fluency; the importance and challenge of being immersed in the native-speaker environment; machine translation eroding the transactional value of "hard" languages). GPT literally opens its re-answer with "What changed my mind…". The demo can be seen without any API key.
Context:
- Repo: https://github.com/trekhleb/yesbrainer
- The recorded debate above, no key needed: https://yesbrainer.ai/council/9123476a-4bc0-4214-8d1b-c76613808eb9
r/ChatGPT • u/trekhleb • 9d ago
Other I kept pasting the same question into ChatGPT, Claude, and Gemini in three tabs; so I built a Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
r/coolgithubprojects • u/trekhleb • 9d ago
I open-sourced the Yes-Brainer — a council of AI models for the decisions that aren't no-brainers. They answer in parallel, debate to consensus, or get judged to a verdict. Browser-only, open source, bring your own keys (BYOK), no backend.
github.com1
I used Claude to build Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
Yes, it is browser-based, and the app calls Claude or other providers directly from the browser. The app is open-sourced, so all implementation details are available here https://github.com/trekhleb/yesbrainer
0
I used Claude to build Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
The difference is that many providers (not one) debate with each other (i.e., Claude, Gemini, ChatGPT, etc), each bringing its own "perspectives/personalities/insights" (which depend on the difference in data and training processes). So, technically, in a "Consensus" mode, one provider can bring the arguments that another provider is missing, which will result in a more weighted final decision.
r/ClaudeAI • u/trekhleb • 9d ago
Built with Claude I used Claude to build Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
1
I kept pasting the same question into ChatGPT, Claude, and Gemini in three tabs; so I built a Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
The app is open-sourced here https://github.com/trekhleb/yesbrainer
The front page contains the "demo" councils, so you can check how it looks without providing any keys at the beginning.

r/SideProject • u/trekhleb • 9d ago
I kept pasting the same question into ChatGPT, Claude, and Gemini in three tabs; so I built a Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
r/ClaudeCode • u/trekhleb • Jun 12 '26
Showcase claude-pod: run Claude Code with --dangerously-skip-permissions, but it can only touch the current project folder
I made a thin Docker wrapper (claude-pod) recently for personal use — it gives Claude access to only the current project folder, nothing else on my machine: https://github.com/trekhleb/claude-pod
Honestly, I wasn't using it that often — just the friction of running Claude via PORTS="8000 5173" claude-pod instead of just claude. Pasting/dragging images in isn't great yet either.
But the "Claude Fable is relentlessly proactive" post gave me another nudge toward containerising it: https://simonwillison.net/2026/Jun/11/fable-is-relentlessly-proactive/
Under the hood, it's four tiny files: the container drops all Linux capabilities, runs as your host user, is ephemeral (--rm), forces any published ports to 127.0.0.1, and has opt-in NET=none / memory / CPU caps for running untrusted code.
Not a 100% defence from the potential glitches — the project folder itself is still exposed — but it narrows the worst case from "my whole machine" to "one folder I can restore from git". Good enough in many cases.
1
Installing Claude Code Inside Docker?
Here is the relatively straightforward Docker setup I'm using to sandbox Claude Code inside a Docker container and to run it with a `--dangerously-skip-permissions` flag (also to avoid manual approvals) - https://github.com/trekhleb/claude-pod .
There are three files you may check: Dockerfile (container config), claude-pod (starts the container), and install.sh (builds the image) - they are pretty minimalistic, so you can adjust to your needs if needed.
This is not a bulletproof guarantee from any possible security issues, of course, but it makes me a bit less apprehensive, knowing that Claude Code will only have access to my project folder, and it can't install anything in my host system globally.
I hope this example helps
1
I built a free tool to compare California cities and counties on the map and side-by-side for people looking to relocate. I'd love your feedback on what metrics to add next.
Thanks for the detailed examples!
I'm not sure which view/page of the app you're referring to, but all of the cities you mentioned are rendered and are available for comparison. Here is an example of the comparison table for San Luis Obispo, San Bernardino, and San Buenaventura (Ventura)
0
I built a free tool to compare California cities and counties on the map and side-by-side for people looking to relocate. I'd love your feedback on what metrics to add next.
The list of cites was taken from the Census Bureau https://www.census.gov/geographies/mapping-files/time-series/geo/tiger-line-file.html . I believe it should be around 482 municipalities that have their own local government.
Could you give some examples of what is messing and I‘ll try to double-check why they are missing in the web app?
1
Looking to move to California?
I'm new to California, and I also have the same question (considering the best place to rent the apartment).
To make the decision a bit easier and more data-driven, I've created this pet project (CaliVibe) for myself and also for everyone interested (it is free, no commercial interest there), to explore and compare different California counties and cities based on a bunch of metrics (temperature, sunshine hours, crime rates, income stats, housing prices, ethnicity distribution, education and poverty rates, etc).
You can explore the counties and cities there in general, or you could also do a targeted comparison. Here is an example of comparing San Diego, Los Angeles, San Francisco, Cupertino, and Los Gatos (feel free to remove and add the cities or counties you're interested in).
I know this comment won't help with your question directly, but hopefully, you'll get some data-driven insights on which city to choose once you come to your shortlist of cities. Good luck with the move!
0
where to move to in CA in your early 20s?
I'm new to California, and I also have the same question (considering the best place to rent the apartment).
To make the decision a bit easier and more data-driven, I've created this pet project (CaliVibe) for myself and also for everyone interested (it is free, no commercial interest there), to explore and compare different California counties and cities based on a bunch of metrics (temperature, sunshine hours, crime rates, income stats, housing prices, ethnicity distribution, education and poverty rates, etc).
You can explore the counties and cities there in general, or you could also do a targeted comparison. Here is an example of comparing San Diego, Los Angeles, San Francisco, Cupertino, and Los Gatos (feel free to remove and add the cities or counties you're interested in).
I know this comment won't help with your question directly, but hopefully, you'll get some data-driven insights on which city to choose once you come to your shortlist of cities. Good luck with the move!
1
r/SameGrassButGreener • u/trekhleb • Mar 29 '26
I built a free tool to compare California cities and counties on the map and side-by-side for people looking to relocate. I'd love your feedback on what metrics to add next.
trekhleb.dev0
California monthly sunshine hours
It might be, yes. The data is satellite-derived (NSRDB), which measures direct normal irradiance. Fog blocks DNI very effectively, so those close-to-coast hex cells might show fewer sunshine hours
3
Interactive map of California rail transit systems across regions (BART, Metrolink, Caltrain, etc.)
Thank you for linking all these pages together 👍🏻
1
A unified interactive map of California’s passenger rail, featuring the complete San Diego Trolley, Coaster, and Sprinter networks.
I've just added CA Zephyr, SW Chief, and Coast Starlight
3
Interactive map of California rail transit systems across regions (BART, Metrolink, Caltrain, etc.)
I've just added CA Zephyr, SW Chief, and Coast Starlight
4
Interactive map of California rail transit systems across regions (BART, Metrolink, Caltrain, etc.)
I've just added CA Zephyr, SW Chief, and Coast Starlight
1
I used Claude to build Yes-Brainer — a council of AI models, that answer your question in parallel, debate to consensus, or get judged to a verdict.
in
r/ClaudeAI
•
9d ago
I don't have plans to make a desktop or Android app out of it.
The closest I have to that is support for PWA - it is possible to "install" it on iPhone or Android or even on Mac desktop. But yes, this is not a native build