This page summarises the Asset Queries currently shipping with S2PX. Asset Queries are similar to MettleCI Compliance Queries in that they parse your DataStage Server Jobs' designs to identify design patterns that could impede S2PX’s ability to convert your Server Job to a Parallel equivalent that behaves identically.
The asset queries in S2PX are embedded within the MettleCI s2px analysis CLI command which is used for the pre-conversion identification of aspects of your DataStage Server jobs which will affect the conversion effort. The Asset Queries are classified below by the kind of information they produce and the actions they might prompt:
|
Query Classification |
Description |
|---|---|
|
Advisory |
Queries identifying Jobs with issues you may want to be informed of, but about which no action is either possible or required. |
|
Coverage |
Utility queries, useful for effort estimation, which describe the components of each Server Job which are not converted by S2PX. |
|
Custom Functions |
Queries identifying Jobs that don't contain custom Server routines and so potentially offering a quicker path to a Unit Testing result of their S2PX-generated Parallel equivalents. |
|
Decomposition |
Queries describing how many Parallel artefacts or Job Sequences your Server Job will be decomposed into as part of conversion. See Job Decomposition. |
|
Functions |
Queries identifying Jobs with issues relating to the use of functions. |
|
Known Issues |
Queries identifying where S2PX will unavoidably generate a solution susceptible to a defect in the DataStage Parallel environment. |
|
One Time Tasks |
Queries describing the conversion tasks that require remediation activity per artefact, rather than a remediation for each reference to that artefact. For example, a Custom Routine needs to be converted once, regardless of the number of times it is referenced within Jobs. |
|
Remediation |
Queries describing the conversion tasks that unavoidably require a human to make a DataStage design decision, and implement the change manually within one or more generated artefact(s). |
S2PX Asset Queries
|
Asset Query |
Server Asset Type |
Analysis Type |
Description |
|---|---|---|---|
|
Active Stages |
Remediation |
Identifies active stages that call a before- or after-stage routine, with call details |
|
|
Transformer stage |
Remediation |
Identifies Transformers which call |
|
|
Job, Shared Containers |
Remediation |
Identifies Jobs containing link metadata with column names containing specific characters |
|
|
Routines |
One-time task |
List custom routines used by jobs |
|
|
Database Connectors |
Remediation |
List of Connectors supporting Schema Reconciliation that have Fail on type mismatch property set to True |
|
|
Sequential File stage |
Advisory |
Checks if a Sequential file stage in a Server job is set to Fixed Width and has Line Endings NOT set to “none”. |
|
|
Folder stage |
Coverage |
Identify Folder stages using the ‘Preserve CRLF’ property |
|
|
Folder stage |
Known Issues |
Identify where Folder stages will generate a solution susceptible to a defect in the DataStage Parallel environment |
|
|
Hashed File stage |
One-time task |
Identifies Hashed Files output (write) stages where the Clear file before writing option has not been checked, and so the Hashed File represent data that persists between job invocations. |
|
|
Hashed File stage |
Hashed Files |
Identifies jobs featuring Hashed Files that do not read and write from the same stage. |
|
|
Hashed File stage |
Remediation |
Identifies Hashed Files stages using a SELECT clause. |
|
|
Hashed File stage |
Hashed Files |
Identifies jobs featuring Hashed Files that are both read from and written to, but the write operation appends to previous contents instead of overwriting. |
|
|
Hashed File stage |
One-time task |
Identifies Hashed Files used by each job (design-time list, may be parameterised) |
|
|
Hashed File stage |
Hashed Files |
Identifies jobs featuring Hashed Files that are either read from or written to, but not both |
|
|
Job |
Decomposition |
Identifies Jobs that use a Job Control Routine |
|
|
Job |
Decomposition |
Describes the number of Parallel Jobs and sequences converting each Server Job will generate. |
|
|
Job, Shared Containers |
Remediation |
Identifies Jobs using Link Partition stage with Partitioning Algorithm set to Hash |
|
|
Merge stage |
Coverage |
Template |
|
|
Custom Functions |
Custom Functions |
Identify Jobs that don't contain custom Server routines. |
|
|
Transformer stage |
Remediation |
Identifies all Server Transformer Stages using a Job Parameter or Stage Variable name featuring a DataStage Reserved word |
|
|
Row Merger Stage |
Remediation |
Reports Row Merger stages that have the Multiple Lines property enabled |
|
|
Row Merger stage |
Remediation |
Reports Row Merger stages that have the Fixed Width property enabled |
|
|
Row Splitter stage |
Remediation |
Reports Row Splitter stages that have the Multiple Lines property enabled |
|
|
Row Splitter stage |
Remediation |
Reports Row Splitter stages that have the Fixed Width property enabled |
|
|
Job, Shared Container |
Coverage |
Identifies Jobs where all of their constituent stage types are supported by S2PX |
|
|
Job, Shared Containers |
Remediation |
Identifies Jobs containing link metadata and/or stage variable with the same column/stage variable names but different cases. |
|
|
Sequential File stage |
Advisory |
Checks if a Sequential file stage in a Server job has a link where "First line is column headers" has been set. |
|
|
Sequential File stage |
Advisory |
Describes the Stage, Link and Column that are not set to the default Missing Column Action value. |
|
|
Sequential File stage |
Remediation |
Describes the Stage, Link and Column that are not set to the default Missing Column Action value. |
|
|
Sequential File stage |
Remediation |
Returns the name of any stage that is set use Named Pipes. |
|
|
Sequential File stage |
Remediation |
Sequential file output uses input link with ‘backup before’ property set. |
|
|
Sequential File stage |
Remediation |
Describes the Stage, file name and Link names involved in concurrent write operations to the same Sequential File. |
|
|
Sequential File stage |
Remediation |
Checks if a Sequential file stage in a Server job has an input link where "Omit Last New-Line" has been set. |
|
|
Sequential File stage |
Remediation |
Checks if a Sequential file stage in a Server job has a Sequential File configured to suppress Row truncation warnings. |
|
|
Job, Shared Container |
Functions |
List every call of Server only functions, custom routines and transforms using unsupported functions |
|
|
Sort stage |
Remediation |
Returns the stage, sort column and external map file name where an external map file has been included in the Sort Specification |
|
|
Sort stage |
One-time task |
Reports on stages where a Temporary Directory has been set to write temporary sort files |
|
|
Database Connectors and legacy Stages |
Remediation |
Reports any stages that have Enable Transaction Grouping enabled |
|
|
Transformer Stage |
Remediation |
Transformer reject links are not available in the Parallel engine |
|
|
Job, Shared Container |
Remediation |
A sub-set of DataStage Macros available in Server Jobs are not available in the Parallel engine. |
|
|
Job, Shared Container |
Remediation |
A sub-set of DataStage System Variables available in Server Jobs are not available in the Parallel engine. |
|
|
Job, Shared Container |
Advisory |
Server Jobs differentiating Null and empty strings which requires modifications to achieve in the Parallel engine. |