时间:2024-02-27|浏览:234
The market for Data Availability (DA) projects is witnessing rapid expansion, leading to a fiercely competitive environment. Notable players in this sector include Celestia, EigenLayer, Avail, NearDA, Covalent, and several others.
Based on the analysis from HTX Research, the core technology behind DA is not as demanding as it appears. The simplest form of DA can be achieved with a single machine, while more complex approaches, such as Celestia, employ decentralized sampling methods. Essentially, DA revolves around storage, which incurs high costs. If Ethereum-level security services are not strictly necessary, selecting a DA provider becomes a trade-off between cost and security.
The principle is the higher the value of the service, the more secure the DA should be.
Presented by HTX Research, this report offers an in-depth analysis of the background, ecosystem, and future development of the DA Wars. It also includes V God’s insights on DA and categorizes different DA projects. Based on a comprehensive analysis of the DA landscape, HTX Research believes that the future of DA may be decentralized and that having 7-8 major DA providers might be sufficient for the future market.
1. The Emergence of the DA Problem
1.1 What Is DA
In simple terms, Data Availability (DA) refers to the block producer publishing all transaction data of the block to the network, enabling validators to download it. If a block producer publishes complete data and allows validators to download it, we say the data is available. However, if the block producer withholds some data so that validators cannot download the complete data, we say the data is unavailable.
1.2 Two Key Aspects of the DA Problem: Security and Cost
After examining the definition of DA, it becomes clear that it consists of two crucial aspects:
First, to ensure the security of the verification mechanism; second, to reduce the cost of publishing data.
Ensure the security of the verification mechanism
To ensure secure verification, current L2 sequencers typically publish L2 status data and transaction data on the highly secure Ethereum network, relying on Ethereum for settlement and DA.
Therefore, the DA Layer is where L2 actually publishes transaction data. Currently, mainstream L2 solutions utilize Ethereum as the DA Layer.
Reduce the cost of publishing data
At present, L2 simply relies on Ethereum for DA and settlement. While this approach offers sufficient security, it also incurs substantial costs. This poses the second challenge for L2: how to reduce the cost of publishing data.
2. Cost Structure of DA and Approaches to Reduce Costs and Enhance Efficiency
From the introduction in Chapter 1, we can see that one of the important concerns in DA is how to reduce costs.
Therefore, if you aim to make L2 cheaper overall, you must reduce the cost of publishing data. So, how to reduce costs? There are two main methods:
Reduce the cost of publishing data on L1, such as the upcoming EIP-4844 upgrade of Ethereum.
Following the example of Rollup, which separates transaction execution from L1, DA can also be decoupled from L1 to reduce costs. In other words, Ethereum is not utilized as the DA Layer.
Therefore, all parties have made considerable efforts to reduce costs. After comparing the currently available plans, the cost of Near DA is the lowest, at about $0.0016 per block, followed by Celestia, EngenLayer, EIP4844, and so on.
3. Vitalik’s View on DA
3.1 Ethereum Foundation and Vitalik Buterin Support Use of Ethereum for DA
After Celestia went viral, the co-founder of Ethereum, Vitalik Buterin implied that Ethereum’s L2 projects must utilize DA on the Ethereum blockchain. Subsequently, Ethereum Foundation researcher Dankrad Feist stated in a tweet that it’s not a Ethereum Rollup without using Ethereum as the DA Layer, and therefore, it’s not L2.
In that case, Arbitrum Nova and Mantle should be “delisted” from the L2 projects because they only disclose transaction data on DAC, outside the Ethereum blockchain.
At the same time, Dankrad also mentioned that solutions like Plasmas and state channels that do not require on-chain data availability (DA) to ensure security are still considered L2, but Validium (ZKRollup that does not use Ethereum as the DA Layer) is not considered L2.
3.2 Vitalik’s Compromise: Ethereum Rollups Utilizing External Data Chains for DA Classified as Ethereum Validium
Later, in a response on his X, Vitalik Buterin stated, “Being a Validium is a correct choice for many apps, and using good distributed DA guarantee systems can be a good way to increase the practical security of a Validium.”
Moreover, he believes that the core of being a rollup is the unconditional security guarantee: you can get your assets out even if everyone else colludes against you, and you can’t get that if DA relies on an external system.
3.3 Consolidating Control over DA through ENS: Vitalik’s Vision
The ENS domain name service will define a set of interaction logic. Users will only need to enter a short domain name to automatically connect to the associated long address corresponding to the ENS smart contract, thus addressing the pain points of complex, difficult-to-remember, and hard-to-identify EOA addresses. It should be noted that this set of domain name services of ENS points to the future expansion market with larger user traffic, especially some Mass Adoption user groups. L2 is the future for Ethereum to expand and absorb large traffic.
Vitalik believes that if ENS’s domain name resolution solution doesn’t extend to L2 and remains restricted to the Ethereum mainnet level, it will be difficult to open up space for imagination. Based on this background, he emphasized the importance of ENS on X, “It needs to be affordable!” ENS will naturally consider providing a complete set of data parsing solutions for L2, allowing users to directly perform domain name resolution and data search on L2. This reduces the dependence on their respective L2 centralized gateways.
It is not difficult to see that for users to use the ENS domain name normally on L2, the prerequisite is to access and verify the global data on the Ethereum mainnet. This means that to enjoy the set of services of ENS, you must use the orthodox Ethereum DA capability, and those L2 solutions based on OP Stack’s shortcut and placing DA on third-party platforms such as Celestia are not compatible with ENS. Having said that, it is not difficult to understand Vitalik’s intention. In short, Vitalik is striving to use ENS to define a standardized set of interoperability specifications for L2 platforms, while simultaneously tightening control over DA.
3.4 Vitalik Discussing Plasma’s Resurgence
In Vitalik Buterin’s article, he discusses the various L2 scaling solutions originally proposed for Ethereum, including Plasma, Rollup, Validium, and Parallel. Vitalik’s vision for scaling entails a balanced development of these solutions, tailored to different application scenarios. However, the current market landscape is predominantly shaped by the Rollup solution, which is becoming increasingly competitive.
Plasma, a sidechain solution, periodically syncs Merkle state data with the main network. It is a scaling solution that depends on the main network for data and computation. This allows Layer 2 to scale efficiently through a highly centralized approach and the design of a complex ledger model, while also leveraging the system capabilities of the main network validators. Vitalik’s new article revisits Plasma and introduces a ZK+Plasma scaling solution, which is evidently another strategic move in the L2 landscape.
3.5 Summary
All of Vitalik’s actions can be summarized as:
Vitalik Buterin has acknowledged the high demand for DAs, but he is reluctant to cede market share to Celestia. Initially focusing on security concerns, he highlighted the importance of the ENS, but encountered resistance from the market. Despite his efforts, many users continue to prefer first-party DAs. He then suggested that Validium could be a viable alternative, only to revisit the older Plasma solution days later, aiming to steer the market towards exploring the ZK+Plasma direction. In essence, Vitalik’s strategic maneuvers reflect a continuous endeavor to anchor the DA market within the Ethereum ecosystem.
4. Overview of DA Solutions and Various DA Projects
4.1 DA Solutions
Based on the provided content, we can see that there are many solutions for the DA Layer. Broadly, these solutions can be categorized into two main parts: on-chain and off-chain.
On-chain solutions
Refer to L2 solutions that still utilize Ethereum as the DA Layer, leveraging Ethereum to mitigate DA costs. This implies that Ethereum will evolve into a real-time bulletin board in the future, with data on the board being deleted after a certain period. L2 solutions must develop methods to independently store all data backups.
Off-chain solutions
Refer to strategies that no longer rely on Ethereum as the DA Layer, seeking more cost-effective methods to ensure DA. Based on variations in decentralization and security, off-chain solutions can be categorized into four types: Validium, Data Availability Committee (DAC), Volition, and general DA solutions.
4.2 Celestia
A pioneer in modular public chains, Celestia is built on the Cosmos SDK with a primary focus on DA. It stands as a competitive leader among DA projects that have already launched the mainnet.
Technical features
Data Availability Sampling (DAS)
DAS allows light nodes to verify DA without having to download the entire block. Light nodes download only the block headers, which limits their ability to verify the DA of a block since they lack access to the full block data. Celestia uses a two-dimensional Reed-Solomon (RS) encoding scheme to re-encode block data to enable DAS for light nodes. DAS works by having light nodes randomly sample a small portion of the block data. As light nodes complete more rounds of block data sampling, confidence in the availability of data increases. Once light nodes have successfully reached the predetermined confidence level (e.g., 99%), the data is considered available.
Namespaced Merkle Trees (NMT)
NMT allows the execution layer and settlement layer on Celestia to download only transactions that are relevant to them. Celestia partitions the data in a block into multiple namespaces. Each namespace corresponds to an application built on Celestia, such as a rollup. Each application only needs to download the data that is relevant to it, improving the efficiency of the network.
Celestia derives its primary revenue from applications through two main methods:
Blob Space Fees: Rollup applications utilize $TIA to pay for storing their data in Celestia’s blob space.
Gas Fees: Developers use $TIA as the gas token for Rollup transactions, similar to how ETH is used as gas in Ethereum-based Rollups.
Development Potential
The project has successfully launched and has achieved a high level of technical maturity.
It boasts exciting prospects for rewarding airdrops, targeting participants who have staked $TIA tokens. Projects such as Dymension and Altlayer specifically select $TIA stakers as recipients for their airdrops. Likely, more Ethereum L2 projects, modular blockchain solutions, and projects within the Cosmos ecosystem will adopt a similar airdrop strategy.
The ecosystem is enriched through collaborations with cross-chain bridges, settlement layer solutions, DeFi projects, gaming platforms, and oracles.
The list of collaborative partners in the DA domain continues to expand, and notable collaborators include Manta, Eclipse, Caldera, and Snapchain. In addition, it also integrated with Arbitrum Orbit, Polygon’s CDK, and the Aevo derivatives trading platform, among others.
4.3 EigenDA
EigenLayer is an Ethereum-based restaking protocol that enables users to restake their ETH, lsdETH, and LP Tokens on other sidechains, oracles, middleware, etc., as nodes and receive validation rewards. This allows third-party projects to leverage the security of the Ethereum mainnet, while ETH stakers can earn additional income, creating a win-win situation.
EigenDA is a decentralized DA service built on Ethereum using the EigenLayer Restaking framework. It serves as the inaugural Active Validation Service (AVS) on the EigenLayer platform. In contrast to Celestia or Avail, EigenDA doesn’t require bootstrapping a new set of validators. Ethereum validators have the freedom to choose to join EigenDA at their own discretion.
Technical Features
Enhancing Ethereum’s DA Capability: Blob Block Data and KZG Commitment
EigenDA leverages the upgraded Blob block data and KZG commitments introduced in the Cancun upgrade. The Rollup chain can generate erasure codes and KZG commitments for Blob Data, which are then published to the EigenDA contracts. The nodes within EigenDA ensure the subsequent DA capabilities for the chain. This significantly boosts Ethereum’s DA capabilities. Notably, EigenDA’s entire operation is built upon existing Ethereum infrastructure like Blob and KZG. Additionally, validation tasks for EigenDA nodes are performed by Ethereum Validators.
P2P Networks with No Central Authority
EigenDA nodes must re-stake ETH (or more precisely, stake ETH derivatives) in the EigenLayer contract on Ethereum Layer 1. EigenDA nodes are a subset of Ethereum validators. Then, after the DA buyer (e.g., rollup, also known as disperser) receives the data blob, it encodes it with erasure code and generates a KZG commitment, which is published and distributed for node confirmation. Afterwards, the disperser collects these signatures one by one, generates an aggregated signature, and publishes it to the EigenDA smart contract, which verifies the signature.
Adopting Delegated Proof-of-Stake (DPoS)
Instead of employing DA sampling, EigenDA utilizes the DPoS consensus mechanism to verify whether nodes genuinely store data. Anyone can submit proof to the EigenDA smart contract, which will be verified by the contract itself. If the verification is successful, the Lazy Validator is slashed.
Development Potential
Engaging in competition with Celestia, EigenDA has integrated several L2 projects, including Celo, Mantle, Fluent, Offshore, OP stack, among others, as collaborative partners.
Backed by Eigenlayer’s diverse ecosystem, which includes sorters, cross-chain bridges, oracle machines, and more.
4.4 Other DA Projects
4.4.1 Avail
Avail can efficiently sort and record transactions, provide storage and verification of DA, support EVM-compatible blockchains, and enable Rollups to publish data directly to Avail. Additionally, its light client network verification mechanism (to be introduced below) allows Rollups on Avail to verify the state through the light client network without relying on smart contracts and the underlying layer. Due to its modular nature, developers can store data on Avail and choose other networks for settlement.
Using the BABE and GRANDPA consensus mechanisms inherited from the Polkadot SDK.
Decentralized.
Avail adopts Nominated Proof of Stake (NPoS) which allows it to support up to 1,000 validators (in Mainnet). This mechanism, along with an effective reward distribution mechanism, minimizes the risk of stake centralization.
Avail is unique among all DA solutions in its ability to sample data from its light-client P2P network. Because of this feature, Avail provides an efficient and reliable backup mechanism that ensures DA even in the event of a failure.
Validity Proof: Avail utilizes KZG polynomial commitments.
Current Status: The Avail mainnet has not yet been launched.
4.4.2 Near DA
On November 8, 2023, the NEAR Foundation announced the launch of the NEAR DA Layer, which provides a robust, cost-effective DA for ETH rollups and Ethereum developers. The first users include Madara by StarkNet, Caldera, Fluent, Vistara, Dymension RollApps, and Movement Labs.
Security: Inherits the security of the Near network.
Cost Advantage: 100kB calldata on NEAR costs $0.0033.
Current Status: NEAR DA has integrated with Polygon CDK, empowering developers to build Ethereum ZK Rollups.
4.4.3 Covalent
Covalent is a blockchain data query service platform that can standardize data from multiple blockchains. Its unified API allows developers to reuse queries across supported networks, solving the problem of blockchain data being difficult to obtain.
After the Cancun upgrade, the Ethereum mainnet will only store L2 submitted state data for 1 month, after which it will be discarded. In order to maintain the decentralization of the network and establish the DAS light node mechanism, Celestia will also regularly discard the L2 submitted state data. However, in November last year, Covalent launched the “Ethereum Wayback Machine (EWM)” for long-term storage of L2 state data discarded by the blob. Covalent is responsible for reading the L2 state data.
Covalent goes beyond simple storage and integrates L2 data into its platform’s on-chain data API service. Covalent facilitates seamless user access to blockchain data, providing data service support for specific user groups such as blockchain data websites, government regulatory departments, AI researchers, and more.
Current Status: As of December 2023, Covalent supports over 210 blockchains and plans to support over 1000 blockchains by the end of 2024. Based on a recent Covalent DA report by Messari, it’s evident that Covalent boasts billions of data points, making it the best choice for applications requiring widely applicable and universally relevant data.
4.4.4 zkPorter
zkPorter, an off-chain DA solution optimized for decentralization, was launched by the Ethereum scaling solution zkSync. It handles DA through a hybrid approach that combines zkRollup and sharding ideas. zkPorter introduces an optional validator mechanism, where zkSync token holders stake tokens to later verify and sign blocks. In the absence of recent updates, zkPorter’s development has been closely watched. The GRVT chain, operating as a Layer3 application chain on the zkSync platform, is set to launch its mainnet in the first quarter of this year. Given the project’s reliance on zkPorter for data storage, there is speculation that zkPorter’s launch might precede that of GRVT.
4.5 Comparison of DA Projects
Technical aspects:
Technical aspects:
ProjectTechnical Feature
CelestiaIt utilizes a DAS scheme, adopts a two-dimensional RS erasure code encoding scheme to ensure data recoverability, enables light nodes to access block data through random sampling, and submits DA proofs in an Optimistic approach.
Ethereum (Proto-Danksharding)It also utilizes a DAS scheme and adopts a two-dimensional RS erasure code encoding scheme to ensure data recoverability. However, in contrast, Ethereum is set to employ the KZG commitment scheme for DA proofs. KZG (Kate Zaverucha Goldberg) polynomial commitment represents a zero-knowledge proof system. Similar to the distinction between Optimistic Rollup and ZK Rollup, Optimistic proofs feature a lower technical threshold for implementation, while KZG polynomial commitments demand a higher technical standard but offer faster proof submission speeds.
AvailIt also employs a DAS scheme, with a specific implementation similar to Proto-Danksharding, utilizing RS erasure code encoding scheme along with KZG polynomial commitments.
EigenDAIt is the flagship product of EigenLayer, and its solution shares similarities with Ethereum’s Proto-Danksharding, utilizing an RS erasure code encoding scheme along with KZG polynomial commitments.
Arbitrum NovaIt is completely different from the aforementioned four projects in terms of DA implementation. It employs the Data Availability Committee (DAC) mode, where transaction data is stored and provided by an external DAC. At least six out of the seven committee members submit BLS signatures to ensure data reliability. Compared to the DAS scheme, the DAC method incurs lower costs but sacrifices decentralization and security to some extent. However, it does not compete with the above projects and only represents a DA solution.
zkPorterIt integrates ZK Rollup and sharding in its design to address the DA problem. It has the capability to support any number of shards, with each shard able to select and establish its own DA scheme. This ensures greater flexibility in the development of smart contracts.
Performance aspects:
Among the aforementioned DA projects, the most competitive ones include Celestia, EigenLayer, Avail, and NearDA. Covalent, on the other hand, adopts an unconventional approach, leading to unique demand for its DA applications.
Of all the DA solutions, DAS coupled with KZG polynomial commitment emerges as the most mainstream approach. It ensures DA while simultaneously reducing node costs and enhancing proof efficiency.
From a technical standpoint, Ethereum Danksharding and Celestia stand out as the most decentralized solutions. They employ sampling technology, which effectively reduces node performance requirements while achieving high bandwidth. EigenDA follows closely with its use of sampling; however, it operates as a parasitic system on Ethereum, with its node count being a subset of Ethereum’s. Other DA projects, like NearDA, do not utilize sampling. For instance, the decentralization level of NearDA is equivalent to that of Near Protocol.
Celestia has chosen the Optimistic proof, which features a lower landing threshold and higher technical maturity compared to KZG polynomial commitment. However, its future technical potential may not match that of KZG polynomial commitment. In comparison with similar projects like Avail and EigenDA, Celestia’s development progress is currently faster, positioning it to launch its mainnet sooner. Nonetheless, Celestia will also confront direct competition from Ethereum following the Cancun upgrade.
As a L2 developer, the trade-off between DA authenticity and chain issuance cost is always a critical consideration. DA authenticity tends to be relatively passive in the commercial market, making it suitable for comprehensive L2 projects that prioritize security consensus issues and possess a certain brand background and market foundation. However, new and small L2 projects, especially those based on OP Stack for one-click chain issuance, strive to minimize costs as much as possible. For them, third-party DAs like Celestia are naturally a better choice. While Eigenlayer still struggles to reduce the actual development costs for L2 project developers.
However, for DA Layer projects, their scenarios are often singular, focusing on a business-to-business (B2B) model. These projects struggle to attract substantial liquidity compared to comprehensive public chains like Solana, which can draw decentralized applications (DApps) through consumer-to-consumer (C2C) scenarios. Without successful adoption by many Rollup projects, their ecosystem construction remains weak. Moreover, Celestia appears to lack significant capital backing. While the technical aspects of Celestia appear logical and feasible, its ultimate success hinges on its ability to integrate and flourish within the Ethereum ecosystem. Otherwise, its ambitious plans may languish unrealized, becoming mere illusions.
5. DA Layer and Modularity in Blockchain
DA Layers have always existed, whether in Bitcoin, Ethereum, or Solana blockchain. For example, in the Bitcoin network, data is stored directly on the blockchain. Fifteen years ago, Satoshi Nakamoto published the Bitcoin whitepaper and limited the block size to 1MB. The block size determines the maximum transaction data each block can accommodate. Later, SegWit, Taproot, and the Ordinal protocol, in a way, were also introduced to enhance DA on the BTC network.
In the Pre-4844 Ethereum network, all data transmitted from L2 to Layer 1 is stored in Calldata. While Rollup transfers computation security to L2, storage remains on Layer 1. Due to the limited storage capacity of Layer 1, the capacity of Rollup on Ethereum is constrained. The block size of Ethereum is about 150K-250K. Even if all the space is allocated to Rollup, the storage space remains limited, thereby constraining the throughput of L2. Therefore, Ethereum needs to adopt Proto-Danksharding, which enhances DA by introducing a new transaction type that includes blobs.
Therefore, it can be said that the DA Layer is actually an abstracted layer that accommodates the expansion needs of various blockchains and the increased requirements for DA. It reflects the evolution and development of blockchain technology, resembling the refinement of labor division in human development processes. Notably, modular blockchain decouples specific functional layers from a monolithic blockchain, outsourcing them to other blockchain networks, thus achieving further division of labor to a certain extent and enhancing efficiency.
Celestia Proposes the Modularity in Blockchain
The architecture of a traditional monolithic blockchain typically consists of four functional layers:
Execution Layer: The execution layer is mainly responsible for processing transactions and executing smart contracts. It includes transaction verification, execution, and state updates.
DA Layer: The DA Layer in a modular blockchain is responsible for ensuring that the data in the network is accessible and verifiable. It usually includes functions such as data storage, transmission, and verification to ensure the transparency and trust of the blockchain network.
Consensus Layer: The consensus layer is responsible for the protocol between nodes to achieve the consistency of data and transactions in the network. It verifies transactions and creates new blocks through a specific consensus algorithm (such as PoW or PoS).
Settlement Layer: The settlement layer is responsible for completing the final settlement of transactions, ensuring the transfer of assets, storing permanent records on the blockchain, and determining the final state of the blockchain.
Celestia first introduced the concept of modularity in blockchain, which involves decoupling different functional layers from the monolithic blockchain. This approach allows the blockchain to concentrate on the specific functions of each layer and effectively distribute the workload to maximize overall availability.
The statement does not assert that a modular blockchain is necessarily superior to a monolithic blockchain. Instead, it expresses a desire to examine the future development of blockchain from a modular perspective. This approach enables the exploration of a broader spectrum of possibilities and conjectures.
6. Speculations About the Future
6.1 Blockchain Combination: A Modular Perspective
In the previous paragraph, it was noted that a blockchain can be divided into four layers from a modular perspective: the execution layer, the DA Layer, the consensus layer, and the settlement layer.
Let’s take the Ethereum ecosystem as an example. In this context, the consensus layer refers to the Ethereum main chain.
In the Ethereum ecosystem, the potential number of possibilities for modular blockchain in the future can be determined using the formula: Number of possibilities = Number of execution layer solutions * Number of settlement layer solutions * Number of DA Layer solutions.
6.2 The Decentralized Nature of the DA Layer
DA Layers can emerge rapidly, akin to mushrooms after spring rain, due to the fact that DA isn’t overly difficult. The simplest approach to DA is to implement it on a single machine. The most complex method involves decentralized sampling, as seen with Celestia. Decentralization via sampling means that the more nodes there are, the greater the bandwidth (imagine a peer-to-peer movie download network). This also generates network effects, suggesting that there won’t be too many of these ‘decentralized sampling DAs’ in the end. However, there are no restrictions on other forms of DA, and their potential is boundless.
Let’s use an analogy: DA functions as storage, which can be costly. If you don’t require Ethereum-level security, selecting a DA provider becomes a trade-off between cost and security.
The principle is the higher the value of the service, the more secure the DA should be.
Therefore, future DAs may be decentralized. Even so, perhaps 7-8 major DAs might be sufficient.
6.3 The Potential of a Specialized DA Layer in ETH 3.0
The upgrade of Ethereum from 1.0 to 2.0 divided Ethereum into the execution layer and the consensus layer. The newly introduced blobs will also be incorporated into the consensus layer of the beacon chain.
In the future, possibly in the next Ethereum upgrade, driven by technological advancements and increased DA, Ethereum may incorporate a dedicated DA Layer on top of the execution and consensus layers. Alternatively, a dedicated data storage chain resembling a sharded chain may emerge in the next upgrade. These are speculative scenarios, and the actual direction of development remains to be seen.
— — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — —
This article is a product of diligent work by the HTX Research Team that is currently under HTX Ventures. HTX Ventures, the global investment division of HTX, integrates investment, incubation, and research to identify the best and brightest teams worldwide.
HTX Ventures presently backs over 200 projects spanning multiple blockchain sectors, with select high-quality initiatives already trading on the HTX exchange. Furthermore, as one of the most vigorous Fund of Funds (FOF) investors, HTX Ventures collaboratively forges the blockchain ecosystem alongside premier global blockchain funds, including IVC, Shima, and Animoca.
热点: DA
Cr