Platform › Integration
Data Pipelines
Extract from a source, apply the field mapping, load to a destination. An incremental pipeline remembers where it finished and starts there next time.
Where to find it
- Module: Platform
- Group: Connectivity
- Section: Integration
- Screen: Data Pipelines
Address in the console: /platform/pipelines
List · 10 columns · 12 fields on its form · 3 of them required · 1 action
What the list shows
These are the columns of the list, in the order they are drawn. Any of them can be sorted on, filtered on, hidden, or exported.
| Column | Kind | Field name |
|---|---|---|
| Pipeline | Code | code |
| Name | Text | name |
| Source | Code | source_resource |
| Destination | Code | destination_resource |
| Mode | Status | sync_mode |
| Mappings | Number | mappings |
| Records | Number | total_records_synced |
| Last run | Status | last_run_status |
| When | Date and time | last_run_at |
| Status | Status | status |
The form
What is asked for when a record is created here. Required fields are marked; a choice drawn from a configuration list is one an administrator can extend without a release.
| Field | Type | Choices | Notes |
|---|---|---|---|
| Pipeline code required | Text | ||
| Name required | Text | ||
| Source connection | Choice | Looked up from existing records | |
| Source resource required | Text | Extractable today: /accounting/journals, /accounting/ar-invoices, /scm/purchase-orders, /crm/prospects, /slcm/students, /ehr/appointments | |
| Destination connection | Choice | Looked up from existing records | |
| Destination resource | Text | ||
| Sync mode | Choice | Configuration list | |
| Cursor field | Text | What an incremental run advances on. | |
| Primary key | Text | ||
| Schedule (cron) | Text | ||
| Batch size | Number | ||
| Status | Choice | draft, active, paused, error, archived |
What you can do here
Run primary
Run this pipeline
The rules that apply here
Everything on this screen obeys the platform rules rather than rules of its own. The ones worth knowing before you use it:
- Narrowing a list — search, conditions, sort, totals, export and saved views.
- What may be changed — the five grounds a record may not be edited on.
- Companies and business units — what the switcher above this list is doing to it.
- Creating a record — required fields, where choices come from, and how the number is allocated.
- Importing a spreadsheet — this screen accepts one, and it runs through the same rules as typing.