Notice: Polkadot has migrated to AssetHub. Balances, data, referenda, and other on-chain activity has moved to AssetHub.Learn more
**Proponent**: Subsquid Lab Official - FAyqRVLZmXVUU9pNeG8w8SxS5xRgN8FRGeWLL6u9S32TMHc
Short description: Ongoing costs for the running of high performance, scalable, and reliable data indexing infrastructure for most of the Polkadot and Kusama ecosystem (and growing).
Raw data: Archive Infrastructure metrics -October, November, December
Requested KSM: 3,594.64 KSM
Previous proposal
https://kusama.polkassembly.io/treasury/246
Motivation
Archives are an important piece of Polkadot and Kusama data infrastructure provided by Subsquid. They provide access to on-chain data in GraphQL format for all major parachains on Kusama and Polkadot, with more chains getting support as the ecosystem grows. They are being used as a data source for Squids and for efficient data exploration and ad-hoc queries. An up-to-date list of Archives is kept in a public Archive Registry
Achievements
Over the course of Q4, Subsquid released incremental upgrades to the SDK, including:
- improvements to the TypeScript boilerplate code generator
- direct support for polkadotJS types bundle format
- improvements to substrate metadata parsing
- support for oddYParity for signature parsing in EIP1559 and EIP2930 transactions
- Deployed new Archives, expanding the list of available networks to 48
Furthermore, the team has been researching impactful positive changes that have been, or will be released over the course of Q1 2023, as well as ameliorations to the command line tools.
Statistics
The data collection pipeline has undergone some changes, and because of this, there are some gaps in the available data (which also influence the weekly moving average in red).
With that being said, it is reasonable to assume a linear trend, and the red line represents a linear regression estimation of total queries over time. The gaps in the collected data are visible as "flattened" sections of the blue line in the chart:
Under this assumption, we can extrapolate these key metrics about Subsquid's Archive infrastructure, over the course of Q4 2023:
- served a total of 128,567,499 (~128.5 million) queries
- The highest daily total was 1,832,412 responses in a single 24 hour period
- The daily queries (both instantly measured, and the weekly window average) confirm a growing trend towards the end of the year, only partly due to the deployment of some new Archives
Full report here
Comments (3)
Requested
Proposal Passed
Subsquid provides and delivers, very happy to support. Just a suggestion for the future: a bounty on Polkadot seems fit, so it wouldn't rely on Kusama treasury and avoid having to make a new proposal every 3 months. Another one: a long term collaboration with IBP to provide hosting infra could bring a pretty much more cost efficient than a regular cloud provider :)
I agree, I don't think it's wise to keep coming to Kusama for this considering it's a long term project. I assume they're doing it out of convenience to get easy money transfers because it takes 28 days on Polkadot, but because this project is long term you now have 3 months to already prepare your bounty on Polkadot so consider that please. Thanks.
I stop by to inform the official Subsquid Lab team that we have objectively analyzed the proposal in Spanish on our YouTube channel so that the Spanish-speaking community becomes more and more involved in governance 2.0 and has access to all this information in different languages.
Thank you! Appreciated.