Check out FlexOlmo, AI2’s new framework for model training, data collaboration and AI-based mixture-of-experts (MoE) architecture. “Collaborative Model Training.” These are the type of solutions we need to continue to push AI forward to the masses. Not only could this be used to create more powerful and specialized models, it could then potentially be deployed with less computing needs …. while solving for the ongoing issue of data control and security.
The Allen Institute for Artificial Intelligence (AI2) is a non-profit research institute which has provided valuable contributions to AI including their OLMO 2 open source AI models.