Skip to main content

RFP: Validator Selection Algorithm

Project Descriptionโ€‹

Together with colleagues from academia, we developed an interactive process for nominations to better find suitable validators and the study is published here. The process is non-opinionated, which means that we do not have any opinion on any validator ex ante. The score of a validator is purely derived by the choices of the nominators.

After having validated the results in the study, I'd like to see this implemented. For that, we need to set up a proper backend that exposes an API for other services to connect to.

Deliverables ๐Ÿ”ฉโ€‹

The aim of this project is only a backend. The final result will be a Python flask application exposing its functionality via RESTful API

  • Functionality:

    • Providing a pair of validators for comparison:
      • Input:
        • previous comparisons
      • Output:
        • next pair
        • current modelโ€™s quality
        • current model
    • Providing a ranking for a given model
      • Input:
        • model
      • Output:
        • ranking of validators
    • Accepting new data
      • Input:
        • validators.csv file that contains information of recent era data from trusted sources
  • Requirements:

    • Linux system with python 3 and listed packages installed
    • 2GB of RAM
    • GPU (optional)
    • Network configuration allowing for communication on a selected port
  • Testing

    • Test if the code behaves as expected.
  • Total Estimated Duration: 6 weeks
  • Full-time equivalent (FTE): 30 days
  • Total Costs: 9000 USD (provisional)

Milestone 1 (Implementation)โ€‹

  • Estimated Duration: 4 weeks
  • FTE: 20 days
  • Costs: 6000 USD
NumberDeliverableSpecification
1.Next pairDevelop an algorithm for efficient calculations of the next pair to be compared to maximize the modelโ€™s information gain.
2.Ranking calculationDevelop an algorithm calculating a score for each validator
3.New dataDevelop a function for the data preprocessing
4.Internal testingUnit tests covering the functionality and logic

Milestone 2 (Testing)โ€‹

  • Estimated Duration: 2 weeks
  • FTE: 10 days
  • Costs: 3000 USD
NumberDeliverableSpecification
1.DeploymentDeploy the code on a provided server.
2.Test live environmentTest the server efficiency and provide a report
3.PolishingReach out for feedback to the Grants Team. Integrate final feedback on functional, as well as cosmetic changes like the way data are provided, configuration, etc.