refactor: use temp table to refactor materialized cte

[xudong963]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Use temp table to refactor materialized cte:

1. We can eliminate many unnecessary codes and improve maintenance.
2. Add the setting persist_materialized_cte to decide if the cte is to persist storage or not. The default behavior is using the memory table. If the user's materialized cte results are large and may OOM, they can open the setting.
3. Support distribution materialized cte. TPCH 15 under cluser may be faster, but ci-benchmark is broken, will check later

• fixes: Refactor: use temp table to refactor materialized cte runtime. #16874 Feature: support spilling large materialized CTEs to temporary tables #16858 Feature: support distributed materialized CTE #16832

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

---

This change is 

[xudong963]

Wait #16941

[xudong963]

12_0005_changes_select:                                                 [ FAIL ] - result differs with:
--- /runner/_work/databend/databend/tests/suites/0_stateless/12_time_travel/12_0005_changes_select.result	2024-11-25 12:23:54.553130727 +0000
+++ /runner/_work/databend/databend/tests/suites/0_stateless/12_time_travel/12_0005_changes_select.stdout	2024-11-25 12:26:02.435793713 +0000
@@ -1,22 +1,15 @@
 latest snapshot should contain 2 rows
 2
 changes default snapshot at the first insertion
-1	1	DELETE	false
-2	1	DELETE	true
-2	2	INSERT	true
-3	3	INSERT	false
+Error: APIError: ResponseError with 1006: can not use temp table in http handler if cookie is not enabled
 changes default snapshot at the first insertion end the deletion
-1	1	DELETE	false
-2	1	DELETE	true
-2	2	INSERT	true
+Error: APIError: ResponseError with 1006: can not use temp table in http handler if cookie is not enabled
 changes append_only snapshot at the first insertion

can not use temp table in http handler if cookie is not enabled

http session for temp table has supported, is there a plan to update client? cc @everpcpc @sundy-li

[sundy-li]

http session for temp table has supported, is there a plan to update client?

@youngsofun to support it.

[everpcpc]

bendsql in runner upgraded to 0.23.1

[github-actions]

Docker Image for PR

• tag: pr-16900-eb8a5f4-1732782822

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-16900-15a36c4-1732791390

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-16900-a872110-1733200739

note: this image tag is only available for internal use,
please check the internal doc for more details.

[xudong963]

It seems that ci benchmark is broken. cc @everpcpc

[everpcpc]

It seems that ci benchmark is broken. cc @everpcpc

cc @zhang2014