Using the backend modules

The extension provides two backend modules. The "Data Import" is the main one, displaying all configurations and allowing to start imports manually. The second one, "Log", displays a list of all log entries generated during External Import runs.

Synchronizable tables

The first function of the "Data Import" BE module – called "Tables with synchronization" – displays a list of all synchronizable tables. The various features are summarized in the picture below.

BE module overview for synchronizable tables

Overview of the synchronizable tables view with all available functions

Viewing configuration details

Clicking on the information icon leads to a screen showing all the information about that particular configuration. The view consists of three tabs: the first one displays the general configuration, the second one displays the configuration for each column (including the additional fields) and the third one displays the list of steps that the process will go through, including any custom steps.

Inspecting TCA properties

Viewing the details of the TCA properties for External Import

If the configuration contains errors, they will be displayed in this detailed view.

Raised errors about wrong configuration

Viewing errors in the External Import configuration

Triggering a synchronization

Clicking on the synchronize data button will immediately start the synchronization of the corresponding table. This may take quite some time if the data to import is large. If you move away from the BE module during that time, the process will abort. At the end of the process, flash messages will appear with the results:

Results of synchronization

Flash messages show the results of the synchronization

Running in preview mode

Clicking on the preview button leads to the preview feature. For running a preview your first need to select a specific step from the process. The synchronization will run up to that step and stop. Preview data gets displayed if available. This depends on the step.

Again depending on the step, a download button may appear or not. If it does, you can use it to retrieve a CSV file of the records being imported, in their state at the end of the previewed step. This makes it easier to explore the data when there is a lot of it.

Most importantly nothing permanent happens in preview mode. For example, data is not stored into the database.

Preview of a synchronization

The synchronization is run up to the Transform Data step and preview data is dumped to the screen

Setting up the automatic schedule

The automatic scheduling facility relies on the Scheduler to run. On top of the normal Scheduler setup, there are some points you must pay particular attention to in the case of external import.

As can be seen in the above screenshot, the information whether the automatic synchronization is enabled or not is displayed for each table. It is possible to add or change that schedule, by clicking on the respective icons. This leads to an input form where you can choose a frequency, a task group and a start date (date of first execution; leave empty for immediate activation). The frequency can be entered as a number of seconds or using the same syntax as for cron jobs.

Automation input form

Input form for setting automated synchronization parameters

Clicking on the trash can icon cancels the automatic synchronization (a confirmation window will appear first).

At the top of the screen, before the list, it is possible to define a schedule for all tables. This means that all imports will be executed one after the other, in the order of priority.

Automating all tables

Setting automated synchronization for all tables

The same input form appears as for individual automation settings.

Non-synchronizable tables

The second function of the "Data Import" BE module – called "Tables without synchronization" – displays a list of non-synchronizable tables. This view is purely informative as no action can be taken for these tables. Only the detailed configuration information can be accessed.

BE module overview for non-synchronizable tables

Overview for non-synchronizable tables, with just the information icon

Logs

As its name implies, the "Log" module displays a list of all log entries generated during External Import runs. The list is sortable and searchable. Each entry has a context, which gives an idea on how the run took place, either triggered manually (via the backend module), run via the Scheduler or the command line, or called using the API. Any other status will appear as "Other".

There is also a duration associated with each log entry. This is actually the duration of the whole import run and will be the same for all log entries related to the same run.

There is not much more to it for now. It may gain new features in the future.

BE module overview for non-synchronizable tables

List of import log entries