Consume metrics into DB/Prometheus for Econ Stress Test

[dckc]

What is the Problem Being Solved?

Econ Stress test needs a bunch of data in a convenient form.

Design

up to @arirubinstein and co

Security Considerations

gets a whole bunch of moving parts, including a private signing key, out of the equasion

Test Plan

manual, with, Nalin, @btulloh and co.

[dckc]

amm, vaults w/governance working via RPC

• ist-monitor2.mjs 2b8203f
• spreadsheet

TODO: PSM, Reserve, BLD Boost

Among the other targets from #5421:

• reserve Expose key Reserve Contract economic data via subscription #4651
• PSM Expose key PSM economic data via subscription #4968
• BLD Boost Expose key Build Boost economic data via subscription #4653
• Oracle / price authority Expose key Price Aggregator economic data via subscription #4652

We have all but Oracle available, to at least some extent:

$ agd query vstorage keys published
children:
- amm
- psm
- reserve
- stakeFactory
- vaultFactory

Oracle???

I'm not sure if we have clear plans for this one. p.s. yes, we do: #4652

That reminds me...

chainStorage for unprivileged contracts?

How do ordinary contracts publish their data for read-only RPC? chainStorage is currently privileged.

for follow-up, see #5687

[dckc]

6cd8054 is working pretty well. no individual vaults yet. nor reserve etc.

[dckc]

I'm not sure what to make of this:

PROOF VERIFICATION FAILURE; crashing follower (Error#4)
Error#4: {"code":-32603,"message":"Internal error","data":"min height 76703 can't be greater than max height 76702"}

for now, I set proof: 'none'

ist-monitor2.mjs 09d5a8d

p.s. @gibson042 suspects a timing issue with follow-up queries going out too early or some such.

[dckc]

I deployed it to GCP using a systemd user unit... it gets the starting / current values, but doesn't seem to update as new values come in.

ist-monitor.service

[dckc]

@arirubinstein I'd like to go over ist-monitor.service with you.

I went over ist-monitor2.mjs with @gibson042 ; using that as a throw-away prototype, the two of you should be able to put together a service that works for @btulloh and Nalin.

Using a google sheet is not necessary; whatever works for the customer is fine by me. But I'd be a little surprised if the "write CSV or JSON to stdout" approach works, since then the customer has to install and run the code and maintain updates.

[dckc]

@gibson042 re insertedAt vs. block time, I found the issue: #5508

[Tartuffo]

Handing off to @arirubinstein

[dckc]

dev work on this is planned for after we have a network running with the features in this release such as

• Smart wallet can trade with small # of users #5354
• add liquidity to an existing pool (with smart wallet) #5077

[dckc]

vault detail available via RPC on xnet

published.vaultFactory.manager0.vaults.vault2

$ ~/go/bin/agd --node=https://xnet.rpc.agoric.net:443 query vstorage data published.vaultFactory.manager0.vaults.vault2 -o json | jq '.value | fromjson | {body: .body | fromjson, slots}'

{
  "body": {
    "debtSnapshot": {
      "debt": {
        "brand": {
          "@qclass": "slot",
          "iface": "Alleged: IST brand",
          "index": 0
        },
        "value": {
          "@qclass": "bigint",
          "digits": "30300000"
        }
      },
      "interest": {
        "denominator": {
          "brand": {
            "@qclass": "slot",
            "index": 0
          },
          "value": {
            "@qclass": "bigint",
            "digits": "100"
          }
        },
        "numerator": {
          "brand": {
            "@qclass": "slot",
            "index": 0
          },
          "value": {
            "@qclass": "bigint",
            "digits": "100"
          }
        }
      }
    },
    "locked": {
      "brand": {
        "@qclass": "slot",
        "iface": "Alleged: IbcATOM brand",
        "index": 1
      },
      "value": {
        "@qclass": "bigint",
        "digits": "50000"
      }
    },
    "vaultState": "active"
  },
  "slots": [
    "board0074",
    "board03446"
  ]
}

[dckc]

@arirubinstein gave a demo of

• Agoric/metricsreader 018c35a

@nalinbhatt plans to try it out. Presuming that works out, I'm closing this. (Feel free to re-open if doesn't work and you can't otherwise find out how to get the data you need).