Next >> << Prev

4. Groups and Jobs in Data Moving Tool

Groups and Jobs are the main objects you manipulate in DMT.

› Jobs represent the exports and loads performed by DMT.

› Groups are simply a way to organize jobs together (like files in folders).

Groups and Jobs List
 

Groups and Jobs are displayed in the left list of the Export Data and Transform & Load Data Tabs.

They look like folders and files and can be manipulated pretty much the same way than folders and files in the windows explorer (drag and drop, copy and paste, rename, etc).

Buttons at the bottom allow you to quickly access the most used commands (the rest of the commands can be accessed via the right click menu).

 

4.1. Running Groups and jobs


To Export Data, simply run an Export Group or Job and it will perform the following operations:

  • Connect to a data source
  • Export the requested data, and place it into a data file with the requested format.

To Load Data, simply run a Load Group or Job and it will perform the following operations:

  • Connect to a data source
  • Read a data file in the specified format
  • Load its content into the specified destination table

Groups and Jobs can be run in two ways:

On demand from the DMT client: Simply select the group or job in the list to run and click on the Run button at the bottom of the list. You can also right click and select the Run Job option

Automatically by the DMT Scheduler: When you start the DMT Scheduler, each Group and Job is run automatically according to their specific scheduling frequency.

 

4.2. Available Group and Job Types


Groups and Jobs can be of different types that determine their exact behavior when they run.

Below is a list of all available group and job types and their characteristics.

Jobs
TypeDescription
Standalone
Job

(Export or Load)

A standalone job is a job that's not part of a group. It can be run on demand from the DMT Client or automatically by the DMT scheduler.

  • Scheduling Parameters: Specific to the job
  • Data File: Specific to the job
Job
Within Group

(Export or Load)

When a job is part of a group, it behaves according to the type of group it belongs to (see below).
Groups
TypeDescription
Schedule
Group

(Export or Load)

A group in which all the jobs are run sequentially when the group is run. Jobs within a schedule group do not run independently from their group (unless they are run manually from the UI).

A schedule group can be run on demand from the DMT Client or automatically by the DMT scheduler.

A schedule group has scheduling parameters, run pre-conditions and pre or post processes to control its run.

Jobs within a schedule group:

  • Scheduling Parameters: Specific to the group
  • Data File: Specific to the job
Data
Group

(Export or Load)

A group in which all the jobs use the same data file (populate for exports or read for loads). A data group cannot be run as such, instead each of its job runs independently from the group. A data group "run" is considered completed when all its jobs have run.

A data group has no scheduling parameters, run pre-conditions and pre or post processes to control its run.

Jobs within a data group:

  • Scheduling Parameters: Specific to the job
  • Data File: Specific to the group
Schedule + Data
Group

(Export or Load)

A combination of a schedule and data group. All the jobs within the group are run sequentially when the group is run, and they populate (for exports) or read (for loads) the same data file.

A schedule + data group can be run on demand from the DMT Client or automatically by the DMT scheduler.

A schedule + data group has scheduling parameters, run pre-conditions and pre or post processes to control its run.

Jobs within a schedule + data group:

  • Scheduling Parameters: Specific to the group
  • Data File: Specific to the group
Multi Table
Group

(Load only)

A group in which all the jobs read the same data file and can populate different destination tables (in the same database).

Each line of the data file is read and loaded into multiple tables.

A multi table group can also be used to generate Parent/Child relationships across multiple tables (Note that at this time this functionality is only available for SQL Server databases).

A multi table group can be run on demand from the DMT Client or automatically by the DMT scheduler.

A multi table group is automatically a schedule + data group as well.

Jobs within a multi table group:

  • Scheduling Parameters: Specific to the group
  • Data File: Specific to the group
Logical
Group

(Export or Load)

A logical group is simply a logical entity containing jobs. It has no specific functionalities.

A logical group cannot be run neither on demand from the DMT Client nor automatically by the DMT scheduler.

Jobs within a logical group behaves exactly like standalone jobs:

  • Scheduling Parameters: Specific to the job
  • Data File: Specific to the job