Unique

Distinguishes whether a data record is unique or a duplicate 

Unique tool has two outputs. The U (for Unique) stream and the D (for Duplicate) stream

Select Records

Can be used to choose a precise subset of input records. 

Sample

Extracts a specified portion of the records in the data stream.

Data Cleansing

Performs basic data cleansing operations such as removing unwanted characters, cleaning whitespace, replacing null values, removing punctuation, removing numbers, and modifying capitalization.

To remove numbers, check the numbers box in the configuration window.

To remove punctuation, check the punctuation box in the configuration window.

To remove white space check leading and trailing whitespace.

To modify the case check modify case and then in the drop down select any of the following.

To remove nulls check the checkboxes under replace nulls. You can check either of them and they’ll give you different options. For this example, I will check both of them.

Auto Field

Sets the field type to the smallest possible size. Basically, auto changing the field type to the optimal type and size.