Data processing

Use these APIs to manage workflow-based processing, custom operators, data lineage, SQL execution, and data dashboards. Select the group that matches the processing resource or execution task you need to handle.

Choose a task

Task	Description
Configure workflows	Create and update workflow definitions, or pause, resume, and delete workflows.
Work with workflow templates	Inspect template definitions or create, replace, and delete templates.
Run and track workflow jobs	Start jobs, inspect results and node status, and control existing jobs.
Rerun from a node	Inspect a node rerun plan, then create, inspect, or cancel a rerun branch.
Retry workflow executions	Retry a workflow job or batch-retry selected or failed executions.
Create custom workflow operators	Maintain Python operators or built-in bindings, and test, enable, or disable operators.
Choose workflow operators	Inspect available operators, versions, and input and output definitions.
Expose operators through APIs	Publish an operator version and inspect, invoke, enable, or disable its service.
Trace files and processing results	Inspect lineage, nodes, and outputs, and manage versions for versioned outputs.
Run SQL and retrieve results	Submit SQL, inspect execution status, and read or download successful results.
Inspect database objects	Inspect database, table, and view definitions, or delete unused objects.
Save and version SQL	Save SQL drafts and finalized versions without executing the SQL.
Configure dashboards and charts	Create dashboards and charts, run charts, and read or download results.

Last updated on Sep 10, 2026