DataMagic Sync Executions - Admin

DataMagic Syncs copy your LogicMonitor portal's data (all Devices, Websites, and much more) into a Magic Suite database, which ReportMagic can then query directly with SQL. Each time a Sync runs, it creates a Sync Execution, which does the work of that run.

To see them, open the Admin app and go to Products, then DataMagic. The page has two tabs:

  • Sync Executions: every run of every Sync, newest first
  • Syncs: the Syncs themselves, and what each one copies

You need to be a Tenant Admin to see either tab.

The toolbar

Button What it does
Refresh Reloads the list. A new Sync Execution appears after a refresh, and a message tells you when one has been created.
Search Finds Sync Executions by Sync name, Created By, Message or Triggered By.
Run Runs the selected Sync again, as a new Sync Execution using the Sync's current settings. Select one Sync Execution that has finished.
Cancel Cancels the selected Sync Executions. Each one must still be waiting to start or running.

The columns

Column Shows
ID The Sync Execution's number.
DataMagic Sync The Sync that ran.
Result Pending or Running until it finishes, then Success, Warning (a step failed), System Error or Cancelled.
Progress How far it has got, step by step. See below.
Started UTC When it started, in UTC.
Duration (hours) How long it took, in hours, once it has finished.
Message What the Sync is doing while it runs, and how each step went once it has finished.
Created By Who started it, when it was started with Run.
Triggered By How it was started, for example by the Sync's schedule or with Run.
Cancel Requested "Requested" when a cancel has been asked for but has not taken effect yet, then "Yes" once the Sync Execution is cancelled.

While a Sync Execution runs, its row updates by itself. On a narrow screen, some columns such as Started UTC and Duration are hidden; make the window wider to see them.

Progress

The Progress column shows how far each Sync Execution has got. Its bar has one piece for each step the Sync runs, in the order it runs them, and the steps are the ones switched on in the Sync's settings:

Step Runs when
Dimensions Sync To Database and Sync Dimensions are on
Events Sync To Database and Sync Events are on
Logs Sync To Database and Sync Logs are on
Time Series Data Sync To Database and Sync Time Series Data are on
File Sync To File is on

Each piece shows how its step is going:

The piece is Which means
Green The step finished successfully.
Amber The step failed, so the Sync finishes as a Warning.
Dark red The step was stopped by a System Error.
Cyan The step was cancelled while it was running.
Striped blue The step is running. Where the step reports a count, such as the DataSources it works through, the piece fills up as it goes.
Empty The step has not started yet, or did not run.

Around the bar:

  • Above the bar on the right: "Waiting to start", "Preparing", the running step and its count (for example "Time Series Data 12 / 340"), or, once the Sync has finished, the steps finished out of the total (for example "4 / 4")
  • Above the bar on the left, in grey: how long the Sync has been running, or how long it took once it has finished, for example "1h 50m"
  • Under the running step, a thin line shows how far the part of the step now running has got, for example the Resources of a dimension type. It starts again for each part
  • Hover over the bar to see each step and how it went

When a Sync is cancelled or stopped by a System Error, its Message says which step it was in, for example "Cancelled during the Dimensions step."

Before its database steps, a Sync checks that its database is ready, shown above the bar as "Preparing". If that check fails, the Sync finishes as a System Error, its database steps do not run, and its Message says why.

Note: Sync Executions from before version 4.7 have no saved progress, so their Progress cell is empty.

Reconnection

Reconnection

Reconnection

timed out

timed out

Attempt of

Reload
An unhandled error has occurred. Reload 🗙