Geyser Plugin Runner Broken

[nilz3ro]

Issue

Tested on Ubuntu 24 with Rust 1.78.0 and Fedora 34 with Rust 1.75.0

When I run the geyser plugin runner with epoch-656.car I get the following output:

ubuntu@ip:~/yellowstone-faithful/geyser-plugin-runner$ cargo run ~/epoch-656.car ~/plugin-config.json 
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.38s
     Running `/home/ubuntu/yellowstone-faithful/target/debug/demo-rust-ipld-car /home/ubuntu/epoch-656.car /home/ubuntu/plugin-config.json`
Header bytes: [162, 101, 114, 111, 111, 116, 115, 129, 216, 42, 88, 37, 0, 1, 113, 18, 32, 69, 39, 94, 242, 176, 221, 96, 121, 143, 142, 241, 154, 248, 234, 114, 214, 170, 203, 0, 205, 150, 15, 152, 243, 134, 8, 20, 217, 253, 199, 204, 102, 103, 118, 101, 114, 115, 105, 111, 110, 1]
Entry notifications enabled
Slot: 283392000
___ DataFrame: Cid(bafyreidyi5hwdgkx2budmlvufp5urssn2trmwrtunazs5a43iugyak47oy)
___ DataFrame: Cid(bafyreib3cpod3v6bdshqvljak4gnghqysjikk6hm47rkhaesz3pctdjiym)
___ DataFrame: Cid(bafyreigaswbrjk2k5bq6wx5xjboqlsa3r5tcvrwsjnsifk5baz5kfan3u4)
___ DataFrame: Cid(bafyreiak7seibgrsvqo7sc5pc7mub2vboqabhtkdavx27frf6ncl7cws7y)
___ DataFrame: Cid(bafyreieoo3dvrlbmprxfect3ge56svxh4untkxxdqirwcjqe4h6vswv5ce)
___ DataFrame: Cid(bafyreif7pdpc7hsqt5pcvuycul7vjfpfubk5relu56ybt7wnejzp5a3dxy)
___ DataFrame: Cid(bafyreidyqzpk5xq5nxrr2wtdkl5t7d3yirudmscio4mj27keqg2vuluuxu)
___ DataFrame: Cid(bafyreigjhawf3jac5pvlrtc5hf26lzmn3vlathlvjpmu2l5qw5o6a2dhly)
___ DataFrame: Cid(bafyreidepne4ovn6x4yak5igtx6aqjxlns6375qd5rk4ldq523n5vfckvq)
___ DataFrame: Cid(bafyreidbwob2jlo372j5b3y3i6wimdbjiazukar43xxfiso6kvsu4gcj4m)
___ DataFrame: Cid(bafyreiel552kpch67nvtiuecvk5v7mneymrvgqe4aqsfv63ox5otftqmx4)
___ DataFrame: Cid(bafyreiab2d3f4iecsrgpzrk6zrme4alj5retsppitcqeg76rqzmxq3zntq)
___ DataFrame: Cid(bafyreigxtyvcapeov636lb7yfiqcl7g3fji5qb36xjlxe47f2rlnchw2lq)
___ DataFrame: Cid(bafyreibeafuojz3eu3apd75avfzotlmn2vnl6tqbtdpqpwx7wrr3zv5gyy)
___ DataFrame: Cid(bafyreifcdh6ncbfl7kq36um4hszmulaigl4keudlmzydl4wc66las6tgta)
___ DataFrame: Cid(bafyreibu3q7ai2z5faujsusxgnx5eklcfwjatduntpvl73bhneexcxeqhm)
___ DataFrame: Cid(bafyreifvsgpwy32h2m5brzqix4d7dkfd3ghrxi7626xcvsdvolarcxsqia)
___ DataFrame: Cid(bafyreihnjo22ym5r42qpiwaywebcpuekqnwen7obpblyqgm5xxrx4tarmm)
___ DataFrame: Cid(bafyreibykesqvzjpwanaytaqmrbmz5lgmiboyxqhgyq544jv2xl3g4sw4u)
___ DataFrame: Cid(bafyreibxnarwur7ldj6vx5cb6mpjgrwurixnrgtgp5yqqwaritlmxddddm)
___ DataFrame: Cid(bafyreiewmj2potp4tf55awjmb2nerbekuqjbzxmfwncfdfdk4pfhgrmnfa)
___ DataFrame: Cid(bafyreiaponlqdqd67f2zvyaim3wj5jlwdcr3djpfce3xjpt2ee6bi2llny)
___ DataFrame: Cid(bafyreiaf7ay7fm5zfmn4e56lmt3gi3e455tecajdvhr2pzdirlqqqzgcua)
___ DataFrame: Cid(bafyreiefvfzn7xmiloahwprwlz6zphcelcclt5jwnoffco5fltncga5qem)
___ DataFrame: Cid(bafyreidlcb7kmm246wedk2de3kzmaunbtp4c5cxao4khknei245ijkqjoe)
___ DataFrame: Cid(bafyreiftlwmu3elstxpbcfrm2xn2dpbszwzdjxn3d5nqtztsll23wirgoa)
___ DataFrame: Cid(bafyreihhl4lfleiuj7rgoblrdlr6ezkrpx4vmvna4v54amqywlaglxbkcm)
___ DataFrame: Cid(bafyreic4q7imyr5sfy3s7pvosknrx7lslzjn2e7etf4hoaa4a62buemcn4)
___ DataFrame: Cid(bafyreieoctp3klyi5ki7ovu6vywhtid23sd7rzghgmlisqacnuwzvn7qme)
___ DataFrame: Cid(bafyreiebgkormyp537hgynstq52pyazrrpovq5u6kpka7ybh5kse7xegmm)
___ DataFrame: Cid(bafyreifibprrrl6dit2hrb2w5sjecb677o4pc2zzj26fcai5fmwbc75z5u)
___ DataFrame: Cid(bafyreidhwci7skz6djo6nlbwt2nmyz4zmi5avjzmiaclugxfiler3egslq)
___ DataFrame: Cid(bafyreidoyfp3ncooquydslijjna7q7fggbrs7d6sepy42a7gzt6fzucoqe)
___ DataFrame: Cid(bafyreihlycnhw24pflqfkgimrbxgvn7mhir2sfufuntg7mzpxqsx6nrh4u)
___ DataFrame: Cid(bafyreifn4v5irndmmrkucsby32cupwfix5kgsrx26q5okfbeg5oj4iqqzy)
___ DataFrame: Cid(bafyreicqdtcnnxffyknhumq7j2evdsk7yq5nzlzyhrwikjtkeqyp4gj56y)
___ DataFrame: Cid(bafyreib4k6ev2srammfthj3xcugmf5qdi6ji32rfgy2hiterwlcrgkmf6e)
___ DataFrame: Cid(bafyreiazmydnxgpckdahby4g26owddzp6p3vgenz6lwebov2lfriovb5xq)
___ DataFrame: Cid(bafyreigmkmvlg5cw3s2sd4mszfkoqtsnftkidntraawwx2vr6s2jdxjhau)
___ DataFrame: Cid(bafyreichlcubme2ibcynop7errmcknxueu2iliyocgyltxxkw3og7rncxq)
___ DataFrame: Cid(bafyreihkv5vuybeahjdpi6rowkmy4d5kqqk2dyrnu2nb24uqtc4pxqgnlq)
___ DataFrame: Cid(bafyreidn6ewxwfavsfdimetpvk3itgi5avzy3sn3ezz5nxsssbjhllejhy)
___ DataFrame: Cid(bafyreibia5wsmxlwi6sa62ojwo32wzcayod7cgw4nu2w7pzipukz6xhkue)
___ DataFrame: Cid(bafyreihqltqqrceag7rfdawb6bqxcfxlyrxhml3hogw765fzdkqdo46yq4)
___ DataFrame: Cid(bafyreifvs2kus2b7jd454we5fy33ssi3fit2fpcbzhmunnipsr2unipj3m)
___ DataFrame: Cid(bafyreic5bni2u4wwsv3v56ai5lc7kqgrpfiei4oelipe5b3h4y7kehyybq)
___ DataFrame: Cid(bafyreihasd4e6b4ea22fzyitxjniauomo37eqwy5wx5jv3pzam4pd3bywu)
___ DataFrame: Cid(bafyreiau2n2757dzevobvxtgjfovhnek6dvf7zka6jrsyv2rfxtiyjllam)
___ DataFrame: Cid(bafyreicpagkfzmxao3hv6g4nn4a6i4yqy4jec3lxjqnlq6ca7i4ujzr6ri)
___ DataFrame: Cid(bafyreieyv46k4xfzs6umwcxmtvocf2ucugnr65h5pvmzinsghxy6sseine)
___ DataFrame: Cid(bafyreibdztancyubmhtmpjumsvo4v2xloug7gyyx27lz6rkh5blwbriyx4)
___ DataFrame: Cid(bafyreiascc3aa5qhjhy3x47r3hgychfept5ccczyowhqrjlop4zizsg4zy)
___ DataFrame: Cid(bafyreidxpdswuwkp567si4dfd6ph4p4sfklyv4cwhi2y54q47q3arldet4)
___ DataFrame: Cid(bafyreibftbhctljeyqetl2ai4imf6ezk43pjonzh5umxbb7xpfvvao7hxy)
___ DataFrame: Cid(bafyreihbygzcyv2n3agqdyk3yfxzzlcj2thvhqkvshn5wwqclwis3o74cy)
___ DataFrame: Cid(bafyreicm242kvp5ebuxmeok6coaarudo6i3dq42bqtorvfnhsbdbk52qja)
___ Rewards: Cid(bafyreiccuo3giuzjk4zy64enlkfqwuqjgmtcktkwykeng2k33omzbtonmq)
Slot: 283392001
Error: Custom { kind: UnexpectedEof, error: "incomplete frame" }

When I run the geyser plugin runner with epoch-100.car I get this output:

ubuntu@ip:~/yellowstone-faithful/geyser-plugin-runner$ cargo run ~/epoch-100.car ~/plugin-config.json 
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.36s
     Running `/home/ubuntu/yellowstone-faithful/target/debug/demo-rust-ipld-car /home/ubuntu/epoch-100.car /home/ubuntu/plugin-config.json`
Header bytes: [162, 101, 114, 111, 111, 116, 115, 129, 216, 42, 88, 37, 0, 1, 113, 18, 32, 48, 158, 155, 88, 187, 18, 186, 238, 41, 152, 61, 213, 238, 221, 124, 130, 156, 150, 186, 234, 248, 80, 57, 0, 71, 230, 7, 171, 71, 176, 50, 218, 103, 118, 101, 114, 115, 105, 111, 110, 1]
Entry notifications enabled
Slot: 43200000
Error: Custom { kind: Other, error: "Error decoding metadata: DecodeError { description: \"invalid tag value: 0\", stack: [] }" }

[linuskendall]

@nilz3ro thanks! this is likely due to #188 and #129.

It's also the case that for some epochs the metadata doesn't exist at all. The geyser runner should be able to ignore that missing metadata though, so we might need to fix that in the geyser runner @gagliardetto ?
This might be impacting these epochs:

• 1-156

We are working on repairing those car files in the archive as well as fixing the generation for epoch >633. This is is already mostly done and we'll be publishing updated car files for these epochs:

• 208
• 294
• 513
• 536
• > 633