Skip to main content

YouTube
LinkedIn
www

Main

YouTube
LinkedIn
www

Main

What is S2PX?

Server to Parallel Migration: Read This First

S2PX Architecture and Workflow

Design Conversion Approach
Data Type Inference
Server Job Translation

S2PX Conversion Notes

Converting jobs with Job Control
Data Type Conversions
Differences between Server and Parallel VarChar
DataStage Macros
Dynamic Arrays
Null Handling
System Variables

Parallel Job Structural Differences

Introducing Parallel Job Structural Differences
Job Decomposition
Stage Decomposition
Replicating Server Job designs using containers
Parallel Job Naming
Translating Stages within Containers
Custom Routine Mapping
Performance of S2PX-Generated Parallel Jobs
Maintaining compatibility with scheduling solutions

Stage Type Conversions

Aggregator Stage
Complex Flat File Stage
Db2 Connector Stage
DRS Connector Stage
Folder Stage
FTP Plug-in Stage

Hashed File Stage

Hashed File Database Tables
Hashed File Migration Jobs
Hashed File Parameterisation

InterProcess Stage
Link Collector Stage
Link Partitioner Stage
Merge Stage
ODBC Connector Stage
Oracle Connector Stage
Pivot Stage
Row Merger Stage
Row Splitter Stage
Sequential File Stage
Sort Stage
Stored Procedure Stage
Sybase OC Stage
Teradata Connector Stage

Transformer Stage

Transformer Lookups
Transformer Reject Links

Web Services Client Stage
Web Services Transformer Stage
XML Input Stage
XML Output Stage
XML Transformer
WebSphere MQ Connector

Preparing to use S2PX

S2PX Prerequisites
Installing the S2PX tools
Using the S2PX Command Line

Running S2PX Analysis

Creating Server ISX Export Files for Analysis
Executing S2PX Analysis

The S2PX Analysis Excel Spreadsheet

Supported Server Jobs
Jobs Remediation
Function Calls
Connector Migration
Conversion Advisory
Hashed Files

Running S2PX Conversion

The S2PX configuration file
Generating Parallel Function Definitions
Creating Server DSX Export Files for Conversion
Executing S2PX Conversion
Conversion Logging

Frequently Asked Questions

Can S2PX automatically remove unsupported characters from column names?
Can the S2PX Analysis command produce a single output for multiple ISX files?
Do we need a dedicated server to run S2PX?
Do we need to export our DataStage assets in a certain order?
Do we need to upgrade MettleCI to use S2PX?
Does S2PX support conversion of Hashed File's nested sub-records?
How do I improve the performance of my S2PX-generated Parallel jobs?
How does S2PX support duplicate keys in Hashed Files?
What are the benefits of using S2PX alongside MettleCI?
What are the limitations of the S2PX tool?
When do we run CCMT?
What does S2PX generate for unsupported stages?
Where are the S2PX Asset Queries in the download?
Which versions of DataStage are supported by S2PX?
Why aren't hashed files converted to data sets?
Why are System Marks (@FM, @VM, @SM, @IM,@TM) translated to different ASCII codes?
Why does S2PX generate Parallel jobs which run in Sequential mode?
Why does S2PX replace Hashed Files with the DRS stage?
Do I need to install MettleCI Workbench to use S2PX?

Troubleshooting

Parallel Char function fails to convert numeric values greater than 127
S2PX produces java.lang.OutOfMemoryError
NullPointerException when converting MettleCI Unit Test Specifications
Unable to find executable ‘dsadm.exe’
Parallel Job failed with APT_CombineOperatorController,0: FatalError: Null value on the accessor interfacing to field "column"
Parallel Job failed to compile with 'The name <Job Status Macro> is reserved'

Reference

Sample config.yml file
Creating the HASH_DICTIONARY Table

S2PX Analysis Asset Queries

Active Stage Before or After Routines
Char Function Call
Column Name Contains Unsupported Characters
Custom Basic Transform Routines
Disable Schema Reconciliation
Fixed Width Sequential File With Line Termination
Folder Stage not preserving new lines
Folder Stage with input links
Hashed Files Non-Exclusive
Hashed File Not Clearing Before Writing
Hashed File Synchronisation
Hashed Files Unmatched Access
Hashed File with Selection
Hashed Files to be Migrated to DB
Job Control Routines
Job Growth due to Decomposition
Link Partition Using Hash Partitioning Algorithm
Merge Stage with Escape Character
No Custom Functions
Reserved Job Status Macros Used in Job Parameters
Reserved Words in Transformer Stages
Row Merger stages with Multiple Lines Property
Row Merger with Fixed Width Property
Row Splitter stages with Multiple Lines Property
Row Splitter with Fixed Width Property
S2PX Functionality Gap by Stage Type
Same Column Name with Different Cases
Sequential File Bad Column Headers
Sequential File Incomplete Column Abort
Sequential File Incomplete Column Handling
Sequential File Uses Named Pipes
Sequential File with Backup
Sequential File with Concurrent Write Operations
Sequential File with Omit Last NewLine
Sequential File with Suppress Truncation Warnings
Server Function Calls
Sort Specification with External Map File
Sort with Temporary Directory
Transaction Grouping Enabled
Transformer has Reject Links
Unsupported Macros
Unsupported System Variables
VarChar Null and Empty Overlap

S2PX Error Reference
Unofficial Support for running S2PX on macOS

S2PX Release History

Server-to-Parallel - S2PX Release v1.0
Server-to-Parallel - S2PX Release v1.1
Server-to-Parallel - S2PX Release v1.2
Server-to-Parallel - S2PX Release v1.3
Server-to-Parallel - S2PX Release v2.0

S2PX News

Breadcrumbs

On this Page

S2PX Conversion Notes

Converting jobs with Job Control
Data Type Conversions
Differences between Server and Parallel VarChar
DataStage Macros
Dynamic Arrays
Null Handling
System Variables

YouTube
LinkedIn
www

Copyright Data Migrators Pty Ltd
Powered by Scroll Sites & Atlassian Confluence