Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
107 commits
Select commit Hold shift + click to select a range
ce1370f
bump fuel core
segfault-magnet Feb 20, 2025
5af6fbc
bump fuel core
segfault-magnet Feb 20, 2025
dd1c081
remove all that isn't used from the fuel block
segfault-magnet Feb 20, 2025
116868a
latest block via custom query
segfault-magnet Feb 20, 2025
70bb95e
block at height via custom query
segfault-magnet Feb 20, 2025
7354012
cleanup
segfault-magnet Feb 20, 2025
2684357
uncomment
segfault-magnet Feb 20, 2025
5f7f6fb
don't prune prematurely
segfault-magnet Feb 21, 2025
e74403b
add fuel simulator
MujkicA Feb 21, 2025
70ba25e
fix requests
MujkicA Feb 21, 2025
8ae9199
extract binary/docker starting logic into helper along with the
segfault-magnet Feb 21, 2025
291c06c
start simulator and test
segfault-magnet Feb 21, 2025
abe9c6f
simulator works
segfault-magnet Feb 22, 2025
0c7142c
can control block size and compressability via FE
segfault-magnet Feb 22, 2025
8762dcc
metrics are plotted on the control panel
segfault-magnet Feb 22, 2025
e45ba16
simulated fuel core to run via actix
segfault-magnet Feb 22, 2025
b3604a5
main server is now actix
segfault-magnet Feb 22, 2025
7c20526
cleanup deps
segfault-magnet Feb 22, 2025
a2b4fbf
remove e2e lib
segfault-magnet Feb 22, 2025
e2fc9f0
split up fuel core simulated node
segfault-magnet Feb 22, 2025
2fd8d60
reformat
segfault-magnet Feb 22, 2025
86ce42c
split up bench
segfault-magnet Feb 22, 2025
9c374e4
remove extra comments
segfault-magnet Feb 22, 2025
aca924d
cleanup main
segfault-magnet Feb 22, 2025
d9a2434
add integrity checks for scripts
segfault-magnet Feb 22, 2025
9263c7d
cleanup
segfault-magnet Feb 22, 2025
9e2931f
cleanup
segfault-magnet Feb 22, 2025
dc4a837
add test for simulated node to satisfy fuel adapter
segfault-magnet Feb 22, 2025
dc12cb4
fix CI
segfault-magnet Feb 22, 2025
c0b379e
fmt
segfault-magnet Feb 23, 2025
0a9d3a8
run edition migration
segfault-magnet Feb 23, 2025
cc9b19f
no need to change to a match
segfault-magnet Feb 23, 2025
b19955e
can use the 2024 expr in macro rules
segfault-magnet Feb 23, 2025
43fb7c5
fmt
segfault-magnet Feb 23, 2025
4ac6b07
Merge remote-tracking branch 'origin/master' into feat/gql_minimal_qu…
segfault-magnet Feb 24, 2025
c0dd24e
Merge remote-tracking branch 'origin/feat/gql_minimal_queries' into f…
segfault-magnet Feb 24, 2025
bf7203d
add import
segfault-magnet Feb 24, 2025
6f4a71d
undo changes in readme and config
segfault-magnet Feb 24, 2025
deb541d
revert more stuff
segfault-magnet Feb 24, 2025
9a41c53
fix merge
segfault-magnet Feb 24, 2025
327bd41
fix var
segfault-magnet Feb 24, 2025
70ca57d
fix setter
segfault-magnet Feb 24, 2025
09eb541
undo services
segfault-magnet Feb 24, 2025
65a30a3
undo blob encoder
segfault-magnet Feb 24, 2025
0fc3990
revert storage
segfault-magnet Feb 24, 2025
3825c27
undo sqlx prepare
segfault-magnet Feb 24, 2025
a851998
Merge remote-tracking branch 'origin/feat/gql_minimal_queries' into f…
segfault-magnet Feb 24, 2025
2769edc
Merge remote-tracking branch 'origin/feat/fuel-simulator' into feat/b…
segfault-magnet Feb 24, 2025
2980c0d
remove unused imports
segfault-magnet Feb 24, 2025
e453f97
explicit rust setup in e2e tests step
segfault-magnet Feb 24, 2025
cfb6d23
Merge remote-tracking branch 'origin/master' into feat/fuel-simulator
segfault-magnet Feb 25, 2025
c16f32e
Merge remote-tracking branch 'origin/feat/fuel-simulator' into feat/b…
segfault-magnet Feb 25, 2025
be4e902
remove lib.rs
segfault-magnet Feb 25, 2025
ea99414
Merge remote-tracking branch 'origin/feat/fuel-simulator' into feat/b…
segfault-magnet Feb 25, 2025
bdb9544
wip
segfault-magnet Feb 25, 2025
c101d5c
wip
segfault-magnet Feb 25, 2025
d8c61ea
migration
segfault-magnet Feb 25, 2025
115e63d
wip
segfault-magnet Feb 25, 2025
d0e91cc
comment
segfault-magnet Feb 26, 2025
ee983a8
add migration script for old data, allow more unhealthy lead time for
segfault-magnet Feb 26, 2025
7aea795
revert version bump
segfault-magnet Feb 26, 2025
d05c5e6
add migration test
segfault-magnet Feb 26, 2025
4470b25
updating the db preview script
segfault-magnet Feb 26, 2025
45c0a1a
only save the relationships png
segfault-magnet Feb 26, 2025
62a34ad
remove dot totally
segfault-magnet Feb 26, 2025
ced1880
cleanup
segfault-magnet Feb 26, 2025
3101549
rename
segfault-magnet Feb 26, 2025
9869f3a
comments
segfault-magnet Feb 26, 2025
d339a05
bundles now have a created at date
segfault-magnet Feb 27, 2025
b427bb0
Revert "bundles now have a created at date"
segfault-magnet Feb 27, 2025
af06d79
new idea
segfault-magnet Feb 27, 2025
87cd2a6
buildup detection implemented
segfault-magnet Mar 4, 2025
dcca551
remove todo
segfault-magnet Mar 4, 2025
ef2fa35
Merge remote-tracking branch 'origin/master' into feat/db_query_optim…
segfault-magnet Mar 4, 2025
04cd76b
update foundry
segfault-magnet Mar 4, 2025
a7ae5cd
orphan tables now present in relationship diagram
segfault-magnet Mar 4, 2025
deb5ead
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 4, 2025
52d1700
move to svg
segfault-magnet Mar 4, 2025
1fa5f54
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 4, 2025
b9c017c
remove CI check for db preview
segfault-magnet Mar 4, 2025
ca81705
update svg
segfault-magnet Mar 4, 2025
a41b586
remove db preview check step
segfault-magnet Mar 4, 2025
4686eb9
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 4, 2025
9196010
add back comment
segfault-magnet Mar 4, 2025
317dd2e
fix comments
segfault-magnet Mar 4, 2025
6698128
refactor
segfault-magnet Mar 4, 2025
406e643
change order of mods to improve git diff
segfault-magnet Mar 4, 2025
e7667d4
add duration expectation to stress test
segfault-magnet Mar 4, 2025
26f627b
Merge remote-tracking branch 'origin/master' into bug/schemaspy_orhpa…
segfault-magnet Mar 6, 2025
e7c0b51
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 6, 2025
bb8da83
update db preview
segfault-magnet Mar 6, 2025
80ada8c
Merge branch 'master' into bug/schemaspy_orhpan_tables_missing
segfault-magnet Mar 9, 2025
7a28ae3
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 9, 2025
2467def
Merge branch 'master' into bug/schemaspy_orhpan_tables_missing
segfault-magnet Mar 10, 2025
3c5ab90
remove html render of readme
segfault-magnet Mar 13, 2025
a88fbf4
Merge remote-tracking branch 'origin/bug/schemaspy_orhpan_tables_miss…
segfault-magnet Mar 13, 2025
ce20491
Merge remote-tracking branch 'origin/master' into feat/db_query_optim…
segfault-magnet Mar 13, 2025
02efed7
Merge branch 'master' into feat/db_query_optimization
segfault-magnet Mar 17, 2025
db95a59
Merge branch 'master' into feat/db_query_optimization
hal3e Apr 3, 2025
b117ad1
prepare queries before starting a transaction where possible
segfault-magnet Apr 9, 2025
92176ce
rename helper
segfault-magnet Apr 9, 2025
6ffff3a
make is_bundled false by default at the start of the migration script
segfault-magnet Apr 9, 2025
50b893e
update sqlx
segfault-magnet Apr 9, 2025
c53ca9f
rename lowest_sequence_of_unbundled_blocks to next_candidates_for_bun…
segfault-magnet Apr 9, 2025
4c6abd3
add comment
segfault-magnet Apr 9, 2025
85415bf
update sqlx cache for test queries
segfault-magnet Apr 9, 2025
c06e4eb
introduce byte limit struct for readability
segfault-magnet Apr 11, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

This file was deleted.

This file was deleted.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

107 changes: 56 additions & 51 deletions db_preview/relationships.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 4 additions & 2 deletions e2e/benches/src/handlers.rs
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
use super::*;
use crate::data::{AppData, ConfigForm};
use crate::template;
use crate::{
data::{AppData, ConfigForm},
template,
};

pub async fn serve_control_panel(data: web::Data<AppData>) -> HttpResponse {
let cfg = data.simulation_config.lock().await;
Expand Down
3 changes: 1 addition & 2 deletions e2e/benches/src/main.rs
Original file line number Diff line number Diff line change
@@ -1,5 +1,4 @@
use std::sync::Arc;
use std::time::Duration;
use std::{sync::Arc, time::Duration};

use actix_web::{App, HttpResponse, HttpServer, web};
use anyhow::Result;
Expand Down
3 changes: 2 additions & 1 deletion e2e/tests/tests/harness.rs
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ use std::{sync::Arc, time::Duration};

use anyhow::Result;
use e2e_helpers::whole_stack::{FuelNodeType, WholeStack};
use services::block_bundler::port::BytesLimit;
use tokio::{sync::Mutex, time::sleep_until};

#[tokio::test(flavor = "multi_thread")]
Expand Down Expand Up @@ -142,7 +143,7 @@ async fn state_submitting_finished(
};

let finished = db
.lowest_sequence_of_unbundled_blocks(0, 1)
.next_candidates_for_bundling(0, BytesLimit(1), u32::MAX)
.await?
.is_none()
&& db.oldest_nonfinalized_fragments(0, 1).await?.is_empty()
Expand Down
2 changes: 1 addition & 1 deletion helm/fuel-block-committer/templates/deployment.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ spec:
httpGet:
path: /health
port: http
initialDelaySeconds: 10
initialDelaySeconds: 60
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Had to bump it because the migration is expected to take around 60s to complete.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am curios is there a way to know how long will be migration on the real database from devnet/testnet/mainnet?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I ran something similar to this:

    SELECT COUNT(DISTINCT fb.height)
    FROM fuel_blocks fb
    JOIN bundles b ON fb.height BETWEEN b.start_height AND b.end_height;

on all of the databases. Longest execution time was around 50s.

We have a pruning period set to 8w currently so the amount of entries in the dbs doesn't change.

periodSeconds: 5
timeoutSeconds: 10
resources:
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
BEGIN;

-- 1. Add the column without enforcing NOT NULL initially
ALTER TABLE fuel_blocks
ADD COLUMN IF NOT EXISTS is_bundled BOOLEAN DEFAULT FALSE;

-- 2. Set is_bundled to true for blocks that fall within any bundle's range.
UPDATE fuel_blocks fb
SET is_bundled = true
FROM bundles b
WHERE fb.height BETWEEN b.start_height AND b.end_height;

-- 3. For blocks not updated above, set is_bundled to false
UPDATE fuel_blocks
SET is_bundled = false
WHERE is_bundled IS NULL;

-- 4. Make the column NOT NULL and set the default for future inserts.
ALTER TABLE fuel_blocks
ALTER COLUMN is_bundled SET NOT NULL;

-- Create the composite index.
CREATE INDEX IF NOT EXISTS idx_fuel_blocks_is_bundled_height
ON fuel_blocks(is_bundled, height);

COMMIT;
Loading
Loading