0G Retrains 107B Model in Public as Decentralized AI Enters a New Phase

with little attention. 0G says it crossed an important threshold months ago. Now it is retraining the same model in public, with the goal of showing what decentralized AI can actually deliver and why its earlier result deserved more attention. In July 2025, 0G trained a 107 billion parameter model called DiLoCoX-107B with China Mobile. The research later appeared on arXiv after peer review. According to the paper, the system reached 357 times better communication efficiency than traditional AllReduce methods. Even so, the result barely landed in the market. The team says the timing worked against it. Mid-2025 crypto attention was fixed on mainnet launches and token stories, while technical results drew far less interest. The work was serious, but it did not get much traction outside a small circle following the field closely. Now, with decentralized AI back in focus, 0G wants to bring the result back into view. A public retraining effort This time, the company is putting the retraining process out in the open. 0G plans to document each stage, including checkpoints, convergence metrics, and data sourcing. It also says the run will be verified through Trusted Execution Environments using zerogAuth. Once the work is complete, the model weights will be open sourced. Ultimately, 0G wants to show that decentralized AI can be audited, reproduced, and verified in a way most closed systems cannot match. More than a parameter race A lot of AI coverage still revolves around parameter counts. Bigger numbers attract attention, but 0G argues that a model’s value comes from the full system around it. For the team, the real test starts with training and continues through verification, storage, serving, and integration into working products. One of the main technical points is communication efficiency. DiLoCoX uses pipeline parallelism, a dual optimizer policy for local and global updates, a one-step delay overlap mechanism, and adaptive gradient compression. In plain terms, the ...