The Evolution of Blockchain Data Indexing: From Nodes to Intelligent Full-Chain Services

1. Introduction

Since the birth of the first batch of on-chain applications in 2017, various decentralized applications have flourished. When discussing these applications, have we ever considered the source of the data they use?

In 2024, AI and Web3 become hot topics. For artificial intelligence, data is the foundation of its growth and evolution. Without massive amounts of data, even the most sophisticated AI algorithms cannot showcase their intelligence.

This article will delve into the development history of blockchain data indexing and compare the established protocol The Graph with the emerging Chainbase and Space and Time, discussing their similarities and differences in data services and product architecture.

2. The Evolution of Data Indexing: From Blockchain Nodes to Full Chain Database

2.1 Data Source: Blockchain Node

Blockchain nodes are the foundation of the entire network, responsible for recording, storing, and propagating all on-chain transaction data. However, ordinary users find it difficult to build and maintain nodes themselves, as this not only requires professional skills but also incurs high costs. As a result, most users choose to rely on third-party services.

RPC node providers have emerged, managing nodes and providing data access through RPC endpoints. Public RPC endpoints are free but have rate limits, while private RPC endpoints offer better performance but are less efficient. Nonetheless, the standard API interfaces provided by node providers lower the barrier for users to access on-chain data.

2.2 Data Parsing: From Raw Data to Usable Data

The data obtained from blockchain nodes is typically raw data that is encrypted and encoded. Directly processing this data requires a significant amount of technical knowledge and computational resources. The data parsing process converts complex raw data into a format that is easy to understand and manipulate, which is a key step in the entire data indexing process.

Evolution of Data Indexers 2.3

As the volume of Blockchain data increases, the demand for data indexers is growing. Indexers simplify the data retrieval process by organizing on-chain data and providing a unified query interface. Different types of indexers include:

1. Full Node Indexer
2. Lightweight Indexer
3. Dedicated Indexer
4. Aggregator Indexer

Faced with a large amount of data, mainstream indexer protocols support multi-chain indexing and customize data parsing frameworks for different applications. Compared to traditional RPC endpoints, indexers offer more efficient data indexing and query capabilities.

2.4 Full Chain Database: Aligning to Stream Priority

As application demands become more complex, basic data indexers struggle to meet diverse query needs. Blockchain data service providers have begun to build blockchain data streams, such as The Graph's Substreams and Chainbase's real-time data lakes. These services aim to provide real-time data parsing and more comprehensive querying capabilities.

3. AI + Database? In-depth comparison of The Graph, Chainbase, Space and Time

3.1 The Graph

The Graph provides multi-chain data indexing and query services through a decentralized network of nodes. Its core is Subgraph (, which defines how to extract and transform data from the blockchain. The network consists of indexers, curators, delegators, and developers, ensuring the system operates through economic incentives.

The Graph is actively embracing AI technologies, such as AutoAgora for optimizing pricing strategies, Allocation Optimizer for improving resource allocation, and AgentC for supporting natural language queries.

![Reading, indexing to analysis, a brief overview of the Web3 data indexing track])https://img-cdn.gateio.im/webp-social/moments-b343cab5112c1a3d52f4e72122ae0df2.webp(

) 3.2 Chainbase

Chainbase is a full-chain data network that integrates multi-chain data into one platform. Its features include:

• Real-time Data Lake
• Dual-chain architecture based on Eigenlayer AVS
• The innovative "manuscripts" data format standard
• Theia, the encryption world model combined with AI

Chainbase empowers through AI, providing smarter data services and in-depth data insights.

![Reading, indexing to analysis, a brief overview of the Web3 data indexing track]###https://img-cdn.gateio.im/webp-social/moments-97443cbd177ac4ffd1665da670ffbf12.webp(

) 3.3 Space and Time

Space and Time###SxT( is committed to building a verifiable computing layer that expands zero-knowledge proof technology. Its core innovation is Proof of SQL, ensuring that SQL queries executed on decentralized data warehouses are verifiable and tamper-proof.

SxT collaborates with Microsoft AI Lab to develop generative AI tools that support users in processing blockchain data through natural language.

![Reading, indexing to analysis, a brief overview of the Web3 data indexing track])https://img-cdn.gateio.im/webp-social/moments-0742180b7da8a9dcddafc465a4dba9cb.webp(

Conclusion and Outlook

Blockchain data indexing technology evolves from node data sources, through data parsing and indexer development, ultimately progressing to AI-enabled full-chain data services. With advancements in technologies such as AI and zero-knowledge proofs, blockchain data services will become smarter and more secure, continuing to support industry innovation as a foundational infrastructure.