TOP AI Network Biweekly Report: November 27, 2024 -December 10, 2024
Technical Progress
Iteration of Decentralized AI Inference Services
In the iteration of decentralized AI inference services, we propose a duration-based computing power scheduling solution, which enables the possibility of more efficient and low-latency inference services.
Traditional solutions often struggle to balance performance and decentralization. They either sacrifice decentralization to improve performance or fail to support efficient applications due to insufficient performance. To address this, we have designed a technical architecture that combines flexible GPU resource scheduling with on-chain verification.
Based on a dynamic allocation algorithm for computing power according to task duration, we ensure the efficiency of model inference. At the same time, on-chain contracts are used to verify the entire process of node access, task execution, and result auditing, ensuring the transparency and security of the service.
Get TOP AI Network Official’s stories in your inbox
Join Medium for free to get updates from this writer.
This solution optimizes several key areas: the node access process is more efficient and supports verification; models can be distributedly loaded after upload, reducing deployment time; and the scheduling algorithm prioritizes nodes that have already loaded the target model, minimizing initialization delay. Additionally, the computing power leasing adopts a flexible duration-based model, improving resource utilization and reducing task response times. These explorations provide a more balanced technical path for decentralized AI applications, retaining the core advantages of decentralization while significantly improving inference service performance.
Community Update
TOP AI Network is scheduled to host an AMA session with a crypto community this week. TOP AI’s Senior Architect, Error, will be the guest speaker, sharing updates on TOP AI’s progress and future plans, as well as answering questions from the community. The latest information will be shared in our community channels and on Twitter. Stay tuned and feel free to follow us!
Beta Version Is Now Open
We are excited to offer the beta version of our decentralized AI MaaS platform. This version provides access to a curated selection of AI models, allowing users to upload and utilize models freely. We also invite technically skilled users to explore the platform and experiment with its features. If you’re interested, please contact us to receive a trial code for access.
About TOP AI Network
Established in 2018, TOP AI Network (formerly TOP Network) focuses on serving a broad user base, delivering a high-demand user experience, and supporting large-scale, cost-sensitive businesses. Aiming to be the blockchain infrastructure for DePIN with AI computing power, it supports Web3.0, DePIN, and gaming sectors requiring high transaction throughput, speed, low fees, and excellent user experience.
TOP Chain employs sharding technology and a three-layer network to deliver a powerful blockchain with low costs, low entry barriers, and high throughput, effectively meeting real-time performance needs, especially for AI businesses.
Moreover, TOP AI Network is a decentralized AI Model-as-a-Service (MaaS) platform that enables AI model developers to host their AI models without the need to invest in expensive hardware and software. TOP AI also enables businesses to rapidly deploy pre-trained AI models or fine-tune existing ones using their private data, creating customized AI models that generate private knowledge and reasoning.
Find More
Official Website | Telegram | Twitter | Medium | Reddit | Email
