**Proponent**: Subsquid Lab Official - FAyqRVLZmXVUU9pNeG8w8SxS5xRgN8FRGeWLL6u9S32TMHc

**Short description**: Ongoing costs for the running of high performance, scalable, and reliable data indexing infrastructure for most of the Polkadot and Kusama ecosystem (and growing).

**Raw data**: [Archive Infrastructure metrics - July, August, September](https://docs.google.com/spreadsheets/d/e/2PACX-1vQBQPYlsB-2JLecP-0OXxfFEzlbPZsGGaFR5aCFLB1-KA7g6TqUnmHNM34dHl_yj9Xf9VWhw_gfUN58/pubhtml)

**Requested KSM**: 1,340.48 KSM

**Previous proposals**
[https://kusama.polkassembly.io/treasury/171](https://kusama.polkassembly.io/treasury/171)
[https://polkadot.polkassembly.io/treasury/134](https://polkadot.polkassembly.io/treasury/134)


# Motivation
Archives are an important piece of Polkadot and Kusama data infrastructure provided by Subsquid. They provide access to on-chain data in GraphQL format for all major parachains on Kusama and Polkadot, with more chains getting support as the ecosystem grows. They are being used as a data source for Squids and for efficient data exploration and ad-hoc queries. An up-to-date list of Archives is kept in a public Archive Registry

# Achievements
At the end of Q2 Subsquid released a new generation of Archives, together with a major version of the SDK, both code named “Fire Squid”.
The improvements brought by this release include:

- Substantial performance increase, with the ability to deploy a new Archive for a chain as big as Kusama, and the indexing to be ready in roughly a day
- Fire Squid Archives support batch requests, which lead to a hundredfold increase in performance of indexing project connecting to them (squids)
- Fire Squid Archives expose two separate gateways, configured and tuned for different uses (one for data exploration by humans, the other one specifically for programmatic and batch access)
- Fire Squid Archives “unwrap” proxy, sudo and batch calls, tracing the origin, but making them much easier to access them

Subsquid has also engaged in continuously improving the product, iteratively working on adding features, such as EVM Transactions indexing, and subscriptions to queries in the Graphql endpoints of indexing projects created with the Subsquid SDK (commonly called squids).

# Statistics
Between 2022-09-03 (when tracking has started) and 2022-09-30 Subsquid’s Archive infrastructure has collectively:

- Served a total of 129,468,038.2 (~129 million) queries in the month of September alone
- The highest daily total was 394,214,930 responses in a single 24 hour period
- Our 7 day average peaks above 5 million queries and adjusts around 3.3 million queries per day at the end of the period

Data from the month of October confirms the linear trend, allowing us to make assumptions for the months of July and August, given the steady growth of queries over time shown.

Full report [here](https://docs.google.com/document/d/e/2PACX-1vQji6zUckBRq3Q8H0xOSLjmFDUkKHckt9SiSIIMdCw_Ck_qpiAhFltGxnNavCmFJcebiBznKO_dleis/pub)

Please note: the discussion has been opened with a private wallet, to speed up the process. The actual Treasury Proposal will be created by the [Subsquid Lab Official](https://kusama.subscan.io/account/FAyqRVLZmXVUU9pNeG8w8SxS5xRgN8FRGeWLL6u9S32TMHc) wallet, like last time.

- Subsquid Lab is requesting funds to cover the ongoing costs of running data indexing infrastructure for Polkadot and Kusama.
- They have released a new generation of Archives called "Fire Squid" which have improved performance and support batch requests.
- Subsquid has served over 129 million queries in September alone, with a daily peak of almost 400 million queries.
- They are continuously improving their product and adding features like EVM Transactions indexing.
- The discussion is ongoing and the actual Treasury Proposal will be created by the Subsquid Lab Official wallet.

#1979 Proposal to allocate funds for public data-indexing infrastructure for Polkadot and Kusama (Q3 2022)