Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: simulate RPC to dry-run a tx (XLS-69d) #5069

Open
wants to merge 58 commits into
base: develop
Choose a base branch
from

Conversation

mvadari
Copy link
Collaborator

@mvadari mvadari commented Jul 18, 2024

High Level Overview of Change

This PR adds a new API method, titled simulate, which executes a dry run of a transaction submission.

This PR also fixes #5070.

Context of Change

It is useful to take a transaction, simulate execution it in the current ledger, and return the metadata - but not persist the transaction in the ledger. This can be used for testing, analysis, and more.

XLS spec: XRPLF/XRPL-Standards#207

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Refactor (non-breaking change that only restructures code)
  • Performance (increase or change in throughput and/or latency)
  • Tests (you added tests for code that already exists, or your new feature included in this PR)
  • Documentation update
  • Chore (no impact to binary, e.g. .gitignore, formatting, dropping support for older tooling)
  • Release

API Impact

  • Public API: New feature (new methods and/or new fields)
  • Public API: Breaking change (in general, breaking changes should only impact the next api_version)
  • libxrpl change (any change that may affect libxrpl or dependents of libxrpl)
  • Peer protocol change (must be backward compatible or bump the peer protocol version)

Test Plan

Testing is still in progress. Unit tests are and will be added.

Current Status

This PR is complete and ready for review. You can build this branch and sync with the network of your choice (including Mainnet). The public is welcome to test and use this code (at your own risk). Next steps are code review and QA testing.

Copy link

codecov bot commented Jul 18, 2024

Codecov Report

Attention: Patch coverage is 99.24528% with 2 lines in your changes missing coverage. Please review.

Project coverage is 77.9%. Comparing base (ea1fffe) to head (acaffb1).

Files with missing lines Patch % Lines
src/xrpld/rpc/detail/TransactionSign.cpp 98.5% 1 Missing ⚠️
src/xrpld/rpc/handlers/Simulate.cpp 99.2% 1 Missing ⚠️
Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff            @@
##           develop   #5069    +/-   ##
========================================
  Coverage     77.9%   77.9%            
========================================
  Files          783     784     +1     
  Lines        66677   66877   +200     
  Branches      8108    8123    +15     
========================================
+ Hits         51921   52100   +179     
- Misses       14756   14777    +21     
Files with missing lines Coverage Δ
include/xrpl/protocol/ErrorCodes.h 100.0% <ø> (ø)
src/libxrpl/protocol/ErrorCodes.cpp 71.4% <ø> (ø)
src/libxrpl/protocol/InnerObjectFormats.cpp 100.0% <100.0%> (ø)
src/xrpld/app/ledger/detail/LedgerMaster.cpp 44.0% <100.0%> (+0.1%) ⬆️
src/xrpld/app/ledger/detail/OpenLedger.cpp 73.4% <100.0%> (+0.3%) ⬆️
src/xrpld/app/main/Main.cpp 79.8% <ø> (ø)
src/xrpld/app/misc/NetworkOPs.cpp 70.1% <100.0%> (+<0.1%) ⬆️
src/xrpld/app/misc/TxQ.h 98.2% <ø> (ø)
src/xrpld/app/misc/detail/TxQ.cpp 98.9% <100.0%> (+0.1%) ⬆️
src/xrpld/app/tx/applySteps.h 100.0% <ø> (ø)
... and 17 more

... and 13 files with indirect coverage changes

Impacted file tree graph

@mvadari mvadari requested review from godexsoft and removed request for godexsoft July 18, 2024 21:49
@intelliot intelliot changed the title feat: add simulate RPC (XLS-69d) feat: add simulate RPC to dry-run a tx (XLS-69d) Nov 8, 2024
@vlntb vlntb self-requested a review December 5, 2024 11:15
@@ -40,7 +40,7 @@ getFailHard(RPC::JsonContext const& context)
}

// {
// tx_json: <object>,
// tx_blob: <object>,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually it can take both, please change it to something like [tx_json|tx_blob]: <object>,

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


- The `feature` method now has a non-admin mode for users. (It was previously only available to admin connections.) The method returns an updated list of amendments, including their names and other information. ([#4781](https://github.com/XRPLF/rippled/pull/4781))
- `book_changes`: If the requested ledger version is not available on this node, a `ledgerNotFound` error is returned and the node does not attempt to acquire the ledger from the p2p network (as with other non-admin RPCs). Admins can still attempt to retrieve old ledgers with the `ledger_request` RPC.
Copy link
Collaborator

@oleks-rip oleks-rip Dec 5, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this document and changes are outdated, please re-base to the latest develop version and make any changes if need

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

// No need to initialize, since it's about to get set
bool didApply;
std::tie(parsed.ter, didApply) = ripple::apply(
auto result = ripple::apply(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

const

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@@ -1924,9 +1924,9 @@ applyAndTestResult(jtx::Env& env, OpenView& view, STTx const& tx, bool pass)
{
auto res = apply(env.app(), view, tx, ApplyFlags::tapNONE, env.journal);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

const

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed


{
// transaction with a higher base fee
Json::Value req;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A bit unclear, maybe request?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

req is used for all the other tests

BEAST_EXPECT(!RPC::contains_error(result));
BEAST_EXPECT(
req[jss::tx_json].isMember(jss::Fee) &&
req[jss::tx_json][jss::Fee] == 50000000);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How this magic number was calculated?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is the default owner reserve

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So use it, it can be obtained through env.current()->fees()

@@ -465,7 +465,7 @@ LedgerMaster::applyHeldTransactions()
ApplyFlags flags = tapNONE;
auto const result =
app_.getTxQ().apply(app_, view, it.second, flags, j);
if (result.second)
if (result.applied)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

any |= result.applied

@@ -29,6 +29,13 @@ class Application;
class STTx;
class TxQ;

struct TxApplyResult
{
TER ter;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please use _ for members, like ter_

Copy link
Collaborator

@oleks-rip oleks-rip left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -29,6 +29,13 @@ class Application;
class STTx;
class TxQ;

struct TxApplyResult
Copy link
Collaborator

@oleks-rip oleks-rip Dec 6, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This name is ambiguous. We have apply() from apply.h and doApply() from applySteps.h functions which return TxApplyResult. And applyTransaction() fucntion from apply.h which return ApplyResult

You should rename

ApplyResult - >  ApplyTransactionResult
TxApplyResult ->  ApplyResult

At least it will be closer to the function names

@@ -69,6 +69,12 @@ class ApplyContext
return *view_;
}

ApplyFlags const&
Copy link
Collaborator

@oleks-rip oleks-rip Dec 6, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please change to ApplyFlags flags() const

if (!isDryRun)
{
// add any new modified nodes to the modification set
for (auto& mod : newMod)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

auto const& mod

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

{
jvRequest[jss::tx_blob] = jvParams[0u].asString();
}
if (jvParams.size() == 2)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add new line space

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

{
tx[jss::Fee] = "0";
}
if (!tx.isMember(jss::Sequence))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please make a new line spaces among these if

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@@ -710,6 +709,104 @@ transactionFormatResultImpl(Transaction::pointer tpTrans, unsigned apiVersion)

//------------------------------------------------------------------------------

XRPAmount
getBaseFee(Application const& app, Config const& config, Json::Value tx)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

base fee is too general here. More like getTransactionMinimumBaseFee

@@ -710,6 +709,104 @@ transactionFormatResultImpl(Transaction::pointer tpTrans, unsigned apiVersion)

//------------------------------------------------------------------------------

XRPAmount
getBaseFee(Application const& app, Config const& config, Json::Value tx)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

tx value modified here, shouldn't it be passed as ref here and through getCurrentFee

}

Json::Value
getCurrentFee(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Current fee is to general here. Please consider more specialized name like getTransactionEscalatedFee

@@ -710,6 +709,104 @@ transactionFormatResultImpl(Transaction::pointer tpTrans, unsigned apiVersion)

//------------------------------------------------------------------------------

XRPAmount
getBaseFee(Application const& app, Config const& config, Json::Value tx)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This function is not exported, please make it static or put into anonymous namespace.

@@ -21,6 +21,7 @@
#define RIPPLE_TXQ_H_INCLUDED

#include <xrpld/app/tx/applySteps.h>
#include <xrpld/app/tx/detail/Transactor.h>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TxApplyResult declared in applySteps.h

@@ -133,6 +133,14 @@ preflight1(PreflightContext const& ctx)
NotTEC
preflight2(PreflightContext const& ctx)
{
if (ctx.flags & tapDRY_RUN) // simulation
{
if (ctx.tx.getSignature().empty())
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not checked for multisign?

return feeOrError;
tx_json[jss::Fee] = feeOrError;
}
if (!tx_json.isMember(sfSigningPubKey.jsonName))
Copy link
Collaborator

@oleks-rip oleks-rip Dec 10, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please add space here and among other c-independent if blocks

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed

@mvadari mvadari changed the title feat: add simulate RPC to dry-run a tx (XLS-69d) feat: simulate RPC to dry-run a tx (XLS-69d) Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Sign-and-submit mode doesn't autofill the correct tx fee (Version: rippled 2.1.0)
3 participants