Data Migration and ETL

Many batch applications run simple ETL (Extract, Transform, and Load) processes. Data from various sources are extracted, used in computations and derivations and then loaded into other files or databases. While in the past most of these activities were implemented in the form of individually handcrafted programs, Hatha Systems' technology allows a common and unified treatment. This will result in a simplified and more efficient process.

Hatha Systems' Knowledge Refinery™ offers the perfect solution for the discovery of the ETL specifications. In particular, the Hatha Knowledge Refinery™ can deliver the following:

• Discovery of the ETL steps and their conditions
  The Knowledge Refinery™ can be employed to analyze the existing JCL and find out the order and dependency of various steps in the process. It will automatically discover and expose the control flow of the batch processes. The analyst can make annotations right into the resulting diagrams, in order to refine the understanding of the processes.
• Discovery of inputs and outputs for every step in the process
  This is difficult to infer from a simple look at the sources. The real information about the inputs and the outputs is the result of symbolic parameter substitutions in the JCL and information from the programs being run. This is very hard to obtain manually, but very simple when employing Hatha Systems' Knowledge Refinery™.
• Discovery of the formats and content of the inputs and outputs of every step
  It may be time consuming to look in every exiting program employed in the process and determine the exact content and format of all inputs and outputs. In many cases this involves tens or even hundreds of data elements. Discovery and re-specification of these data elements would take a lot of time if done manually, but for each step it may be accomplished in minutes with the Knowledge Refinery™.
• Discovery of the transformations performed in each step
  The Hatha Systems' Knowledge Refinery™ helps discover the data flows for all data elements involved in each step. By looking at these data flows, an analyst can see immediately what transformations are performed.

Hatha Systems' Knowledge Refinery™ Data Flow Extraction