Composite dataflows:
A composite dataflow is a combination of one or many source datasets and singular dataflows
Composite Dataflows can be created using the following steps:
1. Click on the "Dataflows" tab from the top menu bar.
2. Click the plus to create a new dataflow
3. Drag and drop the singular unions, joins, and transformations that you would like to use.
4. Drag and drop the desired data sets onto the canvas to create a dataflow.
5. Connect the datasets using the appropriate nodes (e.g., union, join, etc.).
6. Select the desired columns and date range or time interval for the output.
7. Click the "Save" button to save the dataflow.
8. Optionally, add a name for the job that is being executed.
9. Select the directory format (Parquet/CSV) and transfer mode (if applicable).
10. Click "Next" to execute the job.
Last updated