I tested a consortium of qwens on the brainfuck test and it solved it, while the single models fail.

MOEs are a single model. An 'expert' is a subset of layers chosen by a router model for each token. This makes them run faster. A consortium is a type of parallel reasoning that uses multiple of the same or different models to generate parallel response and find the best one.

All models have a jagged frontier with weird skill gaps. A consortium can bridge those gaps and increase performance on the frontier.