Release v0.21.0 for beta 5 by xgreenx · Pull Request #1513 · FuelLabs/fuel-core

xgreenx · 2023-11-23T21:31:47Z

Version 0.21.0

This release focuses on preparing fuel-core for the mainnet environment:

Most of the changes improved the security and stability of the node.
The gas model was reworked to cover all aspects of execution.
The benchmarking system was significantly enhanced, covering worst scenarios.
A new set of benchmarks was added to track the accuracy of gas prices.
Optimized heavy operations and removed/replaced exploitable functionality.

Besides that, there are more concrete changes:

Unified naming conventions for all CLI arguments. Added dependencies between related fields to avoid misconfiguration in case of missing arguments. Added --debug flag that enables additional functionality like a debugger.
Improved telemetry to cover the internal work of services and added support for the Pyroscope, allowing it to generate real-time flamegraphs to track performance.
Improved stability of the P2P layer and adjusted the updating of reputation. The speed of block synchronization was significantly increased.
The node is more stable and resilient. Improved DoS resistance and resource management. Fixed critical bugs during state transition.
Reworked the Mint transaction to accumulate the fee from block production inside the contract defined by the block producer.

FuelVM received a lot of safety and stability improvements:

The audit helped identify some bugs and errors that have been successfully fixed.
Updated the gas price model to charge for resources used during the transaction lifecycle.
Added no_std and 32 bit system support. This opens doors for fraud proving in the future.
Removed the ChainId from the PredicateId calculation, allowing the use of predicates cross-chain.
Improvements in the performance of some storage-related opcodes.
Support the ECAL instruction that allows adding custom functionality to the VM. It can be used to create unique rollups or advanced indexers in the future.
Support of transaction policies provides additional safety for the user.
It also allows the implementation of a multi-dimensional price model in the future, making the transaction execution cheaper and allowing more transactions that don't affect storage.
Refactored errors, returning more detailed errors to the user, simplifying debugging.

Added

#1503: Add gtf opcode sanity check.
#1502: Added price benchmark for vm_initialization.
#1501: Add a CLI command for generating a fee collection contract.
#1492: Support backward iteration in the RocksDB. It allows backward queries that were not allowed before.
#1490: Add push and pop benchmarks.
#1485: Prepare rc release of fuel core v0.21
#1476: Add the majority of the "other" benchmarks for contract opcodes.
#1473: Expose fuel-core version as a constant
#1469: Added support of bloom filter for RocksDB tables and increased the block cache.
#1465: Improvements for keygen cli and crates
#1642: Added benchmark to measure the performance of contract state and contract ID calculation; use for gas costing.
#1457: Fixing incorrect measurement for fast(µs) opcodes.
#1456: Added flushing of the RocksDB during a graceful shutdown.
#1456: Added more logs to track the service lifecycle.
#1453: Add the majority of the "sanity" benchmarks for contract opcodes.
#1452: Added benchmark to measure the performance of contract root calculation when utilizing the maximum contract size; used for gas costing of contract root during predicate owner validation.
#1449: Fix coin pagination in e2e test client.
#1447: Add timeout for continuous e2e tests
#1444: Add "sanity" benchmarks for memory opcodes.
#1437: Add some transaction throughput tests for basic transfers.
#1436: Add a github action to continuously test beta-4.
#1433: Add "sanity" benchmarks for flow opcodes.
#1432: Add a new --api-request-timeout argument to control TTL for GraphQL requests.
#1430: Add "sanity" benchmarks for crypto opcodes.
#1426 Split keygen into a create and a binary.
#1419: Add additional "sanity" benchmarks for arithmetic op code instructions.
#1411: Added WASM and no_std compatibility.
#1405: Use correct names for service metrics.
#1400: Add releasy beta to fuel-core so that new commits to fuel-core master triggers fuels-rs.
#1371: Add new client function for querying the MessageStatus for a specific message (by Nonce).
#1356: Add peer reputation reporting to heartbeat code.
#1355: Added new metrics related to block importing, such as tps, sync delays etc.
#1339: Adds baseAssetId to FeeParameters in the GraphQL API.
#1331: Add peer reputation reporting to block import code.
#1324: Added pyroscope profiling to fuel-core, intended to be used by a secondary docker image that has debug symbols enabled.
#1309: Add documentation for running debug builds with CLion and Visual Studio Code.
#1308: Add support for loading .env files when compiling with the env feature. This allows users to conveniently supply CLI arguments in a secure and IDE-agnostic way.
#1304: Implemented submit_and_await_commit_with_receipts method for FuelClient.
#1286: Include readable names for test cases where missing.
#1274: Added tests to benchmark block synchronization.
#1263: Add gas benchmarks for ED19 and ECR1 instructions.

Changed

#1512: Internally simplify merkle_contract_state_range.
#1507: Updated chain configuration to be ready for beta 5 network. It includes opcode prices from the latest benchmark and contract for the block producer.
#1477: Upgraded the Rust version used in CI and containers to 1.73.0. Also includes associated Clippy changes.
#1469: Replaced usage of MemoryTransactionView by Checkpoint database in the benchmarks.
#1468: Bumped version of the fuel-vm to v0.40.0. It brings some breaking changes into consensus parameters API because of changes in the underlying types.
#1466: Handling overflows during arithmetic operations.
#1460: Change tracking branch from main to master for releasy tests.
#1454: Update gas benchmarks for opcodes that append receipts.
#1440: Don't report reserved nodes that send invalid transactions.
#1439: Reduced memory BMT consumption during creation of the header.
#1434: Continue gossiping transactions to reserved peers regardless of gossiping reputation score.
#1408: Update gas benchmarks for storage opcodes to use a pre-populated database to get more accurate worst-case costs.
#1399: The Relayer now queries Ethereum for its latest finalized block instead of using a configurable "finalization period" to presume finality.
#1397: Improved keygen. Created a crate to be included from forc plugins and upgraded internal library to drop requirement of protoc to build
#1395: Add DependentCost benchmarks for k256, s256 and mcpi instructions.
#1393: Increase heartbeat timeout from 2 to 60 seconds, as suggested in this issue.
#1392: Fixed an overflow in message_proof.
#1390: Up the ethers version to 2 to fix an issue with tungstenite.
#1383: Disallow usage of log crate internally in favor of tracing crate.
#1380: Add preliminary, hard-coded config values for heartbeat peer reputation, removing todo.
#1377: Remove DiscoveryEvent and use KademliaEvent directly in DiscoveryBehavior.
#1366: Improve caching during docker builds in CI by replacing gha
#1358: Upgraded the Rust version used in CI to 1.72.0. Also includes associated Clippy changes.
#1349: Updated peer-to-peer transactions API to support multiple blocks in a single request, and updated block synchronization to request multiple blocks based on the configured range of headers.
#1342: Add error handling for P2P requests to return None to requester and log error.
#1318: Modified block synchronization to use asynchronous task execution when retrieving block headers.
#1314: Removed types::ConsensusParameters in favour of fuel_tx:ConsensusParameters.
#1302: Removed the usage of flake and building of the bridge contract ABI.
It simplifies the maintenance and updating of the events, requiring only putting the event definition into the codebase of the relayer.
#1293: Parallelized the estimate_predicates endpoint to utilize all available threads.
#1270: Modify the way block headers are retrieved from peers to be done in batches.

Breaking

#1506: Added validation of the coin's fields during block production and validation. Before, it was possible to submit a transaction that didn't match the coin's values in the database, allowing printing/using unavailable assets.
#1491: Removed unused request and response variants from the Gossipsub implementation, as well as related definitions and tests. Specifically, this removes gossiping of ConsensusVote and NewBlock events.
#1472: Upgraded fuel-vm to v0.42.0. It introduces transaction policies that changes layout of the transaction. FOr more information check the v0.42.0 release.
#1470: Divide DependentCost into "light" and "heavy" operations.
#1464: Avoid possible truncation of higher bits. It may invalidate the code that truncated higher bits causing different behavior on 32-bit vs. 64-bit systems. The change affects some endpoints that now require lesser integers.
#1432: All subscriptions and requests have a TTL now. So each subscription lifecycle is limited in time. If the subscription is closed because of TTL, it means that you subscribed after your transaction had been dropped by the network.
#1407: The recipient is a ContractId instead of Address. The block producer should deploy its contract to receive the transaction fee. The collected fee is zero until the recipient contract is set.
#1407: The Mint transaction is reworked with new fields to support the account-base model. It affects serialization and deserialization of the transaction and also affects GraphQL schema.
#1407: The Mint transaction is the last transaction in the block instead of the first.
#1374: Renamed base_chain_height to da_height and return current relayer height instead of latest Fuel block height.
#1367: Update to the latest version of fuel-vm.
#1363: Change message_proof api to take nonce instead of message_id
#1355: Removed the metrics feature flag from the fuel-core crate, and metrics are now included by default.
#1339: Added a new required field called base_asset_id to the FeeParameters definition in ConsensusParameters, as well as default values for base_asset_id in the beta and dev chain specifications.
#1322:
The debug flag is added to the CLI. The flag should be used for local development only. Enabling debug mode:
- Allows GraphQL Endpoints to arbitrarily advance blocks.
- Enables debugger GraphQL Endpoints.
- Allows setting utxo_validation to false.
#1318: Removed the --sync-max-header-batch-requests CLI argument, and renamed --sync-max-get-txns to --sync-block-stream-buffer-size to better represent the current behavior in the import.
#1290: Standardize CLI args to use - instead of _.
#1279: Added a new CLI flag to enable the Relayer service --enable-relayer, and disabled the Relayer service by default. When supplying the --enable-relayer flag, the --relayer argument becomes mandatory, and omitting it is an error. Similarly, providing a --relayer argument without the --enable-relayer flag is an error. Lastly, providing the --keypair or --network arguments will also produce an error if the --enable-p2p flag is not set.
#1262: The ConsensusParameters aggregates all configuration data related to the consensus. It contains many fields that are segregated by the usage. The API of some functions was affected to use lesser types instead the whole ConsensusParameters. It is a huge breaking change requiring repetitively monotonically updating all places that use the ConsensusParameters. But during updating, consider that maybe you can use lesser types. Usage of them may simplify signatures of methods and make them more user-friendly and transparent.

Removed

Breaking

#1484: Removed --network CLI argument. Now the name of the network is fetched form chain configuration.
#1399: Removed relayer-da-finalization parameter from the relayer CLI.
#1338: Updated GraphQL client to use DependentCost for k256, mcpi, s256, scwq, swwq opcodes.
#1322: The manual_blocks_enabled flag is removed from the CLI. The analog is a debug flag.

What's Changed

Added changelog in the same way as we did for fuel-vm by @xgreenx in Added changelog in the same way as we did for fuel-vm #1287
Decompose consensus params struct by @MitchTurner in Decompose consensus params struct #1262
Replace all instances of _ in CLI long arguments with - by @MitchTurner in Replace all instances of _ in CLI long arguments with - #1290
[rpc] Parallelise estimate_predicates endpoint by @YusongWang in [rpc] Parallelise estimate_predicates endpoint #1293
Add readable test names to test cases by @MitchTurner in Add readable test names to test cases #1286
ED19 and ECR1 benchmarks by @Dentosal in ED19 and ECR1 benchmarks #1263
feat: Add enable-relayer flag to fuel-core CLI by @bvrooman in feat: Add enable-relayer flag to fuel-core CLI #1279
Small nits found during deploying and benchmarking by @xgreenx in Small nits found during deploying and benchmarking #1303
Implemented submit_and_await_commit_with_receipts method by @xgreenx in Implemented submit_and_await_commit_with_receipts method #1304
Removed the usage of flake and building of the bridge contract ABI by @xgreenx in Removed the usage of flake and building of the bridge contract ABI #1302
Download range of headers during syncing by @MitchTurner in Download range of headers during syncing #1270
feat: Enable .env file loading using env feature by @bvrooman in feat: Enable .env file loading using env feature #1308
chore: Remove types::ConsensusParameters by @bvrooman in chore: Remove types::ConsensusParameters #1314
docs: Debugging instructions using IDEs by @bvrooman in docs: Debugging instructions using IDEs #1309
test: Block Import benchmarks and test helpers by @bvrooman in test: Block Import benchmarks and test helpers #1274
Fix audit CI for webpki by @xgreenx in Fix audit CI for webpki #1319
chore: Single buffer block sync by @bvrooman in chore: Single buffer block sync #1318
Run unit tests without default features only for specific crates by @xgreenx in Run unit tests without default features only for specific crates #1321
Added support for debug CLI flag. by @xgreenx in Added support for debug CLI flag. #1322
Report Peers that give bad Block Info by @MitchTurner in Report Peers that give bad Block Info #1331
Pyroscope profiling by @Voxelot in Pyroscope profiling #1324
Add error handling for P2P requests to return None to requester and log error by @MitchTurner in Add error handling for P2P requests to return None to requester and log error #1342
Importer Metrics by @Voxelot in Importer Metrics #1355
chore: Upgrade to Rust 1.72.0 in CI by @bvrooman in chore: Upgrade to Rust 1.72.0 in CI #1358
chore: Upgrade fuel-vm to 0.37.0 by @bvrooman in chore: Upgrade fuel-vm to 0.37.0 #1338
docs: remove stale schema by @calldelegation in docs: remove stale schema #1362
Replace message_id with nonce in MessageProof query by @MitchTurner in Replace message_id with nonce in MessageProof query #1363
feat: Configurable base asset by @bvrooman in feat: Configurable base asset #1339
avoid gha caching for docker builds by @Voxelot in avoid gha caching for docker builds #1366
Add tracking for peer heartbeats by @MitchTurner in Add tracking for peer heartbeats #1356
docs: fix broken link in README by @PaulRBerg in docs: fix broken link in README #1357
Use right level of error for .env file and duplicated service by @xgreenx in Use right level of error for .env file and duplicated service #1372
Add query and handling for MessageStatus by @MitchTurner in Add query and handling for MessageStatus #1371
Renamed base_chain_height to da_height and return current relayer height instead of latest Fuel block height by @xgreenx in Renamed base_chain_height to da_height and return current relayer height instead of latest Fuel block height #1374
Remove DiscoveryEvent and use KademliaEvent instead by @MitchTurner in Remove DiscoveryEvent and use KademliaEvent instead #1377
Remove todo from code and provide some preliminary peer review config values by @MitchTurner in Remove todo from code and provide some preliminary peer review config values #1380
Clippy lint to disallow logging crate macros in favor of tracing by @Dentosal in Clippy lint to disallow logging crate macros in favor of tracing #1383
fuel-vm nostd update by @Dentosal in fuel-vm nostd update #1367
Up the ethers version to 2 to fix an issue with tungstenite by @xgreenx in Up the ethers version to 2 to fix an issue with tungstenite #1390
Increase heartbeat timeout to one minute by @Dentosal in Increase heartbeat timeout to one minute #1393
feat: batch transactions import by @bvrooman in feat: batch transactions import #1349
Fix an interger overflow in message_proof when looking beyond genesis by @Dentosal in Fix an interger overflow in message_proof when looking beyond genesis #1392
Improve keygen by @cr-fuel in Improve keygen #1397
Benchmark {k256, s256, mcpi} opcodes using DependentCost by @Dentosal in Benchmark {k256, s256, mcpi} opcodes using DependentCost #1395
Use correct names for service metrics by @xgreenx in Use correct names for service metrics #1405
feat: Retrieve finalized blocks from Ethereum by @bvrooman in feat: Retrieve finalized blocks from Ethereum #1399
Updated CI to run cargo update weekly by @xgreenx in Updated CI to run cargo update weekly #1415
CI cargo update weekly by @xgreenx in CI cargo update weekly #1416
Weekly cargo update by @github-actions in Weekly cargo update #1417
Fix typos by @GoodDaisy in Fix typos #1424
feat: Support no_std and WASM compilation for fuel-core crates by @bvrooman in feat: Support no_std and WASM compilation for fuel-core crates #1411
Create sanity benchmark checks for all the arithmetic op codes by @MitchTurner in Create sanity benchmark checks for all the arithmetic op codes #1419
Update benchmarking and collecting for scwq, swwq and srwq opcodes by @xgreenx in Update benchmarking and collecting for scwq, swwq and srwq opcodes #1427
Account-base fee collection by @xgreenx in Account-base fee collection #1407
Rollback modification of the chain specification by @xgreenx in Rollback modification of the chain specification #1429
Tx subscription cleanup (Tx subscription cleanup #1422) by @xgreenx in Tx subscription cleanup (#1422) #1432
Mark reserved peers as explicit for gossipsub to avoid reputation decreasing (Mark reserved peers as explicit for gossipsub to avoid reputation decreasing #1423) by @xgreenx in Mark reserved peers as explicit for gossipsub to avoid reputation decreasing (#1423) #1434
Weekly cargo update by @github-actions in Weekly cargo update #1438
ci: add beta releasy to fuel-core by @kayagokalp in ci: add beta releasy to fuel-core #1400
setup a cron job to test beta-4 continuously by @Voxelot in setup a cron job to test beta-4 continuously #1436
chore: Use MerkleRootCalculator when only BMT root is needed by @bvrooman in chore: Use MerkleRootCalculator when only BMT root is needed #1439
Crypto op code sanity checks by @MitchTurner in Crypto op code sanity checks #1430
Update gas benchmarks for some storage opcodes by @Dentosal in Update gas benchmarks for some storage opcodes #1408
Split keygen into a create and a binary by @cr-fuel in Split keygen into a create and a binary #1426
Basic Transfer TPS Benchmarking by @Voxelot in Basic Transfer TPS Benchmarking #1437
"flow" op code sanity benchmarks by @MitchTurner in "flow" op code sanity benchmarks #1433
Applying #1435 to master by @xgreenx in Applying #1435 to master #1440
"memory" opcode sanity checks by @MitchTurner in "memory" opcode sanity checks #1444
Add timeout to E2E test by @Voxelot in Add timeout to E2E test #1447
fix owns_coins to properly paginate by @Voxelot in fix owns_coins to properly paginate #1449
Fixing incorrect measurement for fast(µs) opcodes by @xgreenx in Fixing incorrect measurement for fast(µs) opcodes #1457
Call flush during end of the FuelService by @xgreenx in Call flush during end of the FuelService #1456
chore: fix releasy test tracking branch from main to master by @kayagokalp in chore: fix releasy test tracking branch from main to master #1460
Weekly cargo update by @github-actions in Weekly cargo update #1461
DB::repair breaks the table for checkpoints by @xgreenx in DB::repair breaks the table for checkpoints #1463
Avoid possible truncation of higher bits by @xgreenx in Avoid possible truncation of higher bits #1464
Bumping fuel-vm to v0.40.0 by @xgreenx in Bumping fuel-vm to v0.40.0 #1468
Improvements for keygen cli and crates by @cr-fuel in Improvements for keygen cli and crates #1465
Handling overflows during arithmetic operations by @xgreenx in Handling overflows during arithmetic operations #1466
test: Add contract code root benchmark by @bvrooman in test: Add contract code root benchmark #1452
test: Add state root and contract id benchmarks by @bvrooman in test: Add state root and contract id benchmarks #1462
Avoid storage caching in benchmarks by @xgreenx in Avoid storage caching in benchmarks #1469
Weekly cargo update by @github-actions in Weekly cargo update #1471
Expose fuel-core version as a constant by @Br1ght0ne in Expose fuel-core version as a constant #1473
Upgrade ed25519_dalek 1.0.1 -> 2.0.0 by @Dentosal in Upgrade ed25519_dalek 1.0.1 -> 2.0.0 #1475
chore: Upgrade Rust 1.73 by @bvrooman in chore: Upgrade Rust 1.73 #1477
Decrease number of iterations for sequential benchmarks by @xgreenx in Decrease number of iterations for sequential benchmarks #1480
Add mldv bench by @Dentosal in Add mldv bench #1481
feat: Separate light and heavy gas costs (core) by @bvrooman in feat: Separate light and heavy gas costs (core) #1483
chore: Remove network parameter from CLI by @bvrooman in chore: Remove network parameter from CLI #1484
Transaction policies support by @xgreenx in Transaction policies support #1472
stage release candidate for beta-5 by @Voxelot in stage release candidate for beta-5 #1485
setup docker auth for binary publishing by @Voxelot in setup docker auth for binary publishing #1488
Fix macos binary publishing by @xgreenx in Fix macos binary publishing #1489
Add documentation for our calculation of a reasonable gas fee for storage by @MitchTurner in Add documentation for our calculation of a _reasonable_ gas fee for storage #1478
"contract" op code sanity checks by @MitchTurner in "contract" op code sanity checks #1453
"other" op code sanity check by @MitchTurner in "other" op code sanity check #1476
Add push and pop benches by @MitchTurner in Add push and pop benches #1490
chore: Remove unused gossipsub items by @bvrooman in chore: Remove unused gossipsub items #1491
Adjusting of the prices benchmarks after sanity check benchmarks by @xgreenx in Adjusting of the prices benchmarks after sanity check benchmarks #1494
Weekly cargo update by @github-actions in Weekly cargo update #1498
Update benches that are affected by receipts by @Dentosal in Update benches that are affected by receipts #1454
Support backward iteration in the RocksDB by @xgreenx in Support backward iteration in the RocksDB #1492
Added validation of the coin's fields during block production and validation by @xgreenx in Added validation of the coin's fields during block production and validation #1506
Added price benchmark for vm_initialization by @xgreenx in Added price benchmark for vm_initialization #1502
Sanity-check gtf opcode by @MitchTurner in Sanity-check gtf opcode #1503
Tool for generating fee collection contract by @Voxelot in Tool for generating fee collection contract #1501
Chain config for beta 5 network by @xgreenx in Chain config for beta 5 network #1507
Remove usage of iter_all_filtered from merkle_contract_state_range by @Dentosal in Remove usage of iter_all_filtered from merkle_contract_state_range #1512

New Contributors

@YusongWang made their first contribution in [rpc] Parallelise estimate_predicates endpoint #1293
@calldelegation made their first contribution in docs: remove stale schema #1362
@PaulRBerg made their first contribution in docs: fix broken link in README #1357
@cr-fuel made their first contribution in Improve keygen #1397
@github-actions made their first contribution in Weekly cargo update #1417
@GoodDaisy made their first contribution in Fix typos #1424

Full Changelog: v0.20.8...v0.21.0

xgreenx · 2023-11-23T21:51:05Z

+    },
+};
+
+struct TestContext {


I simply moved it from the fuel-core-chain-config crate

xgreenx · 2023-11-23T21:51:33Z

 tracing = "0.1"

 [dev-dependencies]
-fuel-core = { workspace = true }


It causes cycle dependencies during publishing rust-lang/cargo#4242.

Release v0.21.0 for beta 5

31018fa

xgreenx requested a review from a team November 23, 2023 21:31

xgreenx self-assigned this Nov 23, 2023

xgreenx added 2 commits November 23, 2023 21:38

Cargo update

9ac821b

Remove cycle dependencies

5122417

xgreenx commented Nov 23, 2023

View reviewed changes

Remove \n

35e7c5e

bvrooman reviewed Nov 24, 2023

View reviewed changes

Comment thread CHANGELOG.md Outdated

Update CHANGELOG.md

20fbb87

bvrooman approved these changes Nov 24, 2023

View reviewed changes

bvrooman enabled auto-merge (squash) November 24, 2023 01:50

bvrooman merged commit 21cafe6 into master Nov 24, 2023

bvrooman deleted the release/v0.21.0 branch November 24, 2023 01:51

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release v0.21.0 for beta 5#1513

Release v0.21.0 for beta 5#1513
bvrooman merged 5 commits intomasterfrom
release/v0.21.0

xgreenx commented Nov 23, 2023 •

edited

Loading

Uh oh!

xgreenx Nov 23, 2023

Uh oh!

xgreenx Nov 23, 2023

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

xgreenx commented Nov 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Version 0.21.0

Added

Changed

Breaking

Removed

Breaking

What's Changed

New Contributors

Uh oh!

xgreenx Nov 23, 2023

Choose a reason for hiding this comment

Uh oh!

xgreenx Nov 23, 2023

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

xgreenx commented Nov 23, 2023 •

edited

Loading