APPLY PIPELINE

The Apply Pipeline component allows you to group multiple pipeline components as a unit, which can be bypassed as a group.

Executes a pipeline block comprised of one or more pipeline components on the entire data set.

APPY PIPELINE
	(...)
	{ BYPASS }
;

Example 1

-- Get data from an RSS Feed
SELECT * FROM HTTP [Rss Feed] (GET /econi.xml) APPLY TX (//item);

-- Run a pipeline block that can be bypassed as a whole
-- This transformation block happens after all the data 
-- has been read from the HTTP source

APPLY PIPELINE (
	
	-- add a column as a string
	ADD COLUMN 'dateFound' WITH EXPRESSION '#utcnow()' IGNORE_IF_EXISTS;

	-- enforce a schema
	APPLY SCHEMA (
		datetime dateFound
		string(36) guid
		string(255) link
		_controlId|new column with a default value|#rndguid()
	);

);