Pipelines that use the Snowflake pipeline engine in the run configuration fail with an error.
While running a Data Quality pipeline with a run configuration using the Snowflake pipeline engine, it fails to execute successfully and gives an error. The status is displayed as Failed on the page. Click the row of the failed pipeline to view the Details panel. The error message is displayed when you click Show details at the bottom next to the failed status.
Problem:
The pipeline using the Snowflake pipeline engine fails to run successfully.
Error message:
Unload to named, user, and table stages has been disallowed. Unload to named, user, and table stages has been disallowed.
Workaround:
To prevent this issue, in Snowflake, set the parameter
PREVENT_UNLOAD_TO_INTERNAL_STAGES to FALSE
for the user running the pipeline. For instance, if the user is
DJOHN, use this command to set the parameter to false.
alter user DJOHN set PREVENT_UNLOAD_TO_INTERNAL_STAGES=FALSE
By default, this parameter is set to FALSE in Snowflake, and it is
typically enabled or disabled by the admin at the account level. In cases where it's
set to TRUE, you must override it and set it to
FALSE to avoid failure of pipelines while executing.