Skip to content

Commit 3607cd7

Browse files
Linh NguyenGitHub Enterprise
authored andcommitted
Merge pull request #6515 from AdobeDocs/PLAT-227083/Dataflow-schedule-behaviour-not-stated-in-documentation
PLAT-227083/Dataflow-schedule-behaviour-not-stated-in-documentation[READY]
2 parents a645419 + 6430dfe commit 3607cd7

File tree

2 files changed

+17
-1
lines changed

2 files changed

+17
-1
lines changed

help/sources/tutorials/ui/dataflow/databases.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -114,14 +114,21 @@ See the table below for more information on scheduling configurations.
114114

115115
| Scheduling configuration | Description |
116116
| --- | --- |
117-
| Frequency | Configure frequency to indicate how often the dataflow should run. You can set your frequency to: <ul><li>**Once**: Set your frequency to `once` to create a one-time ingestion. Configurations for interval and backfill are unavailable when creating a one-time ingestion dataflow. By default, the scheduling frequency is set to once.</li><li>**Minute**: Set your frequency to `minute` to schedule your dataflow to ingest data on a per-minute basis.</li><li>**Hour**: Set your frequency to `hour` to schedule your dataflow to ingest data on a per-hour basis.</li><li>**Day**: Set your frequency to `day` to schedule your dataflow to ingest data on a per-day basis.</li><li>**Week**: Set your frequency to `week` to schedule your dataflow to ingest data on a per-week basis.</li></ul> |
117+
| Frequency | Configure frequency to indicate how often the dataflow should run. You can set your frequency to: <ul><li>**Once**: Set your frequency to `once` to create a one-time ingestion. Configurations for interval and backfill are unavailable when creating a one-time ingestion dataflow. By default, the scheduling frequency is set to once.</li><li>**Minute**: Set your frequency to `minute` to schedule your dataflow to ingest data on a per-minute basis.</li><li>**Hour**: Set your frequency to `hour` to schedule your dataflow to ingest data on a per-hour basis.</li><li>**Day**: Set your frequency to `day` to schedule your dataflow to ingest data on a per-day basis.</li><li>**Week**: Set your frequency to `week` to schedule your dataflow to ingest data on a per-week basis. For more information, read the section on [understanding weekly ingestion schedule] (#weekly).</li></ul> |
118118
| Interval | Once you select a frequency, you can then configure the interval setting to establish the time frame between every ingestion. For example, if you set your frequency to day and configure the interval to 15, then your dataflow will run every 15 days. You cannot set the interval to zero. The minimum accepted interval value for each frequency is as follows:<ul><li>**Once**: n/a</li><li>**Minute**: 15</li><li>**Hour**: 1</li><li>**Day**: 1</li><li>**Week**: 1</li></ul> |
119119
| Start Time | The timestamp for the projected run, presented in UTC time zone. |
120120
| Backfill | Backfill determines what data is initially ingested. If backfill is enabled, all current files in the specified path will be ingested during the first scheduled ingestion. If backfill is disabled, only the files that are loaded in between the first run of ingestion and the start time will be ingested. Files loaded prior to the start time will not be ingested. |
121121
| Load incremental data by | An option with a filtered set of source schema fields of type, date, or time. The field that you select for **[!UICONTROL Load incremental data by]** must have its date-time values in UTC timezone in order to correctly load incremental data. All table-based batch sources pick incremental data by comparing a delta column time stamp value to the corresponding flow run window UTC time, and then copying the data from the source, if any new data is found within the UTC time window. |
122122

123123
![backfill](../../../images/tutorials/dataflow/table-based/backfill.png)
124124

125+
### Understanding weekly ingestion schedule {#weekly}
126+
127+
When you choose to set your dataflow to run on a weekly schedule, the dataflow will run based on one of these scenarios:
128+
129+
* If your data source has been created but no data has been ingested yet, the first weekly dataflow will run 7 days after the source creation date. This 7-day interval always starts from when the source was created, regardless of when you set up the schedule. After the initial run, the dataflow will continue to execute on a weekly basis according to the configured schedule.
130+
* If data from your source has been previously ingested and you schedule it for weekly ingestion again, the next dataflow will run 7 days after the most recent successful ingestion.
131+
125132
## Review your dataflow
126133

127134
The **[!UICONTROL Review]** step appears, allowing you to review your new dataflow before it is created. Details are grouped within the following categories:

help/sources/tutorials/ui/update-dataflows.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,15 @@ The **[!UICONTROL Edit schedule]** dialog box provides you with options to updat
6363

6464
![A pop-up window that you can use to edit your dataflow's ingestion schedule.](../../images/tutorials/update-dataflows/edit_schedule.png)
6565

66+
Read the following section for details on how weekly ingestion schedules work.
67+
68+
#### Understanding weekly ingestion schedule {#weekly}
69+
70+
When you choose to set your dataflow to run on a weekly schedule, the dataflow will run based on one of these scenarios:
71+
72+
* If your data source has been created but no data has been ingested yet, the first weekly dataflow will run 7 days after the source creation date. This 7-day interval always starts from when the source was created, regardless of when you set up the schedule. After the initial run, the dataflow will continue to execute on a weekly basis according to the configured schedule.
73+
* If data from your source has been previously ingested and you schedule it for weekly ingestion again, the next dataflow will run 7 days after the most recent successful ingestion.
74+
6675
### Disable dataflow
6776

6877
You can disable your dataflow by using the same dropdown menu. To disable your dataflow, select **[!UICONTROL Disable dataflow]**.

0 commit comments

Comments
 (0)