The popularity of blockchain brought about a multitude of blockchain systems: IOTA, Ethereum, Hyperledger Fabric, and others. These systems operate under different assumptions and have diverging design. A frequently asked question in this context is how their performance compare. Unfortunately, the knowledge gained towards answering this question is very partial [1,2,3].
The ultimate goal of this project is to build a unified testbed for benchmarking different blockchain systems. This high-level objective can be broken into more specific goals: generating the workload of transactions and injecting them, building a network for each system that lends itself to comparison, identifying the set of interesting metrics and monitoring them, identifying the set of interesting parameters. It is possible to define multiple subprojects in this direction. For example, it may be interesting to build a simulator for blockchain systems instead of running them for real.
References:
[1] Caliper
https://www.hyperledger.org/projects/caliper
[2] Tien Tuan Anh Dinh, Ji Wang, Gang Chen, Rui Liu, Beng Chin Ooi, and Kian-Lee Tan. 2017. BLOCKBENCH: A Framework for Analyzing Private Blockchains. In Proceedings of the 2017 ACM International Conference on Management of Data (SIGMOD '17). ACM, New York, NY, USA, 1085-1100. DOI: https://doi.org/10.1145/3035918.3064033
[3] Parth Thakkar, Senthil Nathan, Balaji Vishwanathan. Performance Benchmarking and Optimizing Hyperledger Fabric Blockchain Platform.