Difference between revisions of "MetaData Process Rules"

From All n One's bxp software Wixi

Jump to: navigation, search
Line 1: Line 1:
MetaData Process rules are rules that allow for the processing of raw data.  There are quite a number of rules and parameters used for each rule.  Below is a list of the rules and how each one is set up.
+
= Overview =
  
= Data Cleanup Functions =
 
* Delete
 
* DeDupe
 
  
= Maths functions =
+
MetaData Process rules are rules that allow for the processing of raw dataThere are quite a number of rules and parameters used for each rule. Below is a list of the rules and how each one is set up. There is also a link off to the reference document for that function.
* Add
 
* Subtract
 
* Multiply
 
* Divide - Divide by 0 is always calculated to 0 for reporting purposes
 
* Modulus - Modulus maths, leaves the remainder
 
* Positive - Always makes a value positive
 
* Numeric - Forces the value to be numeric. Defaults to 0 if string or unrecognised
 
* Boolean - Forces the value to be BooleanDefaults to false if unrecognised.
 
 
 
= String Functions =
 
* Replace - Replaces one string with another
 
* RemoveNumbers - Removes all numbers from the values
 
* Trim - Removes leading and trailing spaces
 
* TitleCase - Used for tidying up names. Capitalises the first letter of each word.
 
* SentenceCase - Reformats the data into sentence case.
 
* Concat - Combines two strings in the order supplied
 
* Encapsulate - Surround a string with the values provided
 
* Fixed - Extracts a fixed amount from the string
 
* Append - Add to the end of the string
 
* Prepend - Add to the start of the string
 
 
 
= Date | Time Functions =
 
* DateTime - Format the time in Universal Date Time format yyyy-mm-dd hh:mm:ss
 
* Date - yyyy-mm-dd only
 
* Time - hh:mm:ss only
 
* Zulu - Zyyyy-mm-ddThh:mm:ss
 
* ReportTimeToSeconds - Converts report time to a seconds value
 
* TimeToSeconds - For normal dates, convert to a base second time for comparisons
 
* SecondsToReportTime - When using comparison dates, after subtractions, converts to a report time format
 
* Percentage - Divide 1 by 2, output formatted number * 100, limit to 2 decimal places
 
 
 
= Data Cumulative Functions =
 
* Sum
 
* Count
 
* IsUnique
 
 
 
= Data Transformation Functions =
 
* Convert_Title
 
* Convert_County
 
* Convert_Country
 
* Convert_StaffId
 
* Convert_DepartmentId
 
* Convert_SecurityGroupId
 
* Convert_DataField
 
 
 
= Data Transfer =
 
* CrossDatabase_Update
 
* CrossDatabase_Insert
 
  
 +
== String Management ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || String || [[MetaData_-_Processing_Rules_-_String_Management]]
 +
|-
 +
| String || Append || [[MetaData_-_Processing_Rules_-_String_Management#Append]]
 +
|-
 +
| String || Prepend || [[MetaData_-_Processing_Rules_-_String_Management#Prepend]]
 +
|-
 +
| String || Encapsulate || [[MetaData_-_Processing_Rules_-_String_Management#Encapsulate]]
 +
|-
 +
| String || Remove Numbers || [[MetaData_-_Processing_Rules_-_String_Management#Remove_Numbers]]
 +
|-
 +
| String || Strip Tags || [[MetaData_-_Processing_Rules_-_String_Management#Strip_Tags]]
 +
|-
 +
| String || Replace || [[MetaData_-_Processing_Rules_-_String_Management#Replace]]
 +
|-
 +
| String || Concatenation || [[MetaData_-_Processing_Rules_-_String_Management#Concatenation]]
 +
|-
 +
| String || Read From || [[MetaData_-_Processing_Rules_-_String_Management#Read_From]]
 +
|-
 +
| String || Read Until || [[MetaData_-_Processing_Rules_-_String_Management#Read_Until]]
 +
|-
 +
| String || Set Value || [[MetaData_-_Processing_Rules_-_String_Management#Set_Value]]
 +
|-
 +
|}
 +
== Mathematical Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || Mathematical || [[MetaData_-_Processing_Rules_-_Mathematical_Functions]]
 +
|-
 +
| Mathematical || Addition || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Addition]]
 +
|-
 +
| Mathematical || Subtraction || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Subtraction]]
 +
|-
 +
| Mathematical || Multiplication || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Multiplication]]
 +
|-
 +
| Mathematical || Division || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Division]]
 +
|-
 +
| Mathematical || Modulus || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Modulus]]
 +
|-
 +
| Mathematical || Numeric || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Numeric]]
 +
|-
 +
| Mathematical || Summation || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Summation]]
 +
|-
 +
| Mathematical || Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Count]]
 +
|-
 +
| Mathematical || Is Unique || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Is_Unique]]
 +
|-
 +
| Mathematical || Group Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Count]]
 +
|-
 +
| Mathematical || Group Sum || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Sum]]
 +
|-
 +
|}
 +
== Date Time Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || Date Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management]]
 +
|-
 +
| Date Time || Date || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date]]
 +
|-
 +
| Date Time || Date|Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime]]
 +
|-
 +
| Date Time || Date|Time Now || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime_Now]]
 +
|-
 +
| Date Time || Report Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Report_Time_To_Seconds]]
 +
|-
 +
| Date Time || Seconds To Report Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Seconds_To_Report_Time]]
 +
|-
 +
| Date Time || Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time]]
 +
|-
 +
| Date Time || Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time_To_Seconds]]
 +
|-
 +
| Date Time || ZULU || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#ZULU]]
 +
|-
 +
| Date Time || Day Between || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Day_Between]]
 +
|-
 +
| Date Time || Month To number || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Month_To_number]]
 +
|-
 +
|}
 +
== Data Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || Data || [[MetaData_-_Processing_Rules_-_Data_Management]]
 +
|-
 +
| Data || Deletion || [[MetaData_-_Processing_Rules_-_Data_Management#Deletion]]
 +
|-
 +
| Data || Remove Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Remove_Duplicate_Records]]
 +
|-
 +
| Data || Flag Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Flag_Duplicate_Records]]
 +
|-
 +
|}
 +
== Conversion Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || Conversion || [[MetaData_-_Processing_Rules_-_Data_Conversion]]
 +
|-
 +
| Conversion || Convert Data field || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Data_field]]
 +
|-
 +
| Conversion || Convert Form Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Form_Id]]
 +
|-
 +
| Conversion || Convert Client Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Client_Id]]
 +
|-
 +
|}
 +
== Cross Form Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || Cross Form || [[MetaData_-_Processing_Rules_-_Cross_Form]]
 +
|-
 +
| Cross Form || Copy To Destination || [[MetaData_-_Processing_Rules_-_Cross_Form#Copy_To_Destination]]
 +
|-
 +
| Cross Form || Cross Form Update || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update]]
 +
|-
 +
| Cross Form || Cross Form Insert || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Insert]]
 +
|-
 +
| Cross Form || Cross Form Update Simple/Custom || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Simple.2FCustom]]
 +
|-
 +
| Cross Form || Cross Form Update Smart || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Smart]]
 +
|-
 +
|}
 +
== CCL Specific Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || CCL Specific || [[MetaData_-_Processing_Rules_-_CCL_Specific]]
 +
|-
 +
| CCL Specific || Insert Into CCL Simple || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_Into_CCL_Simple]]
 +
|-
 +
| CCL Specific || Insert From CCL Custom || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_From_CCL_Custom]]
 +
|-
 +
|}
 +
== QA Specific Functions ==
 +
{| class="wikitable"
 +
! Type
 +
! Function
 +
! Link
 +
|-
 +
| Library || QA || [[MetaData_-_Processing_Rules_-_QA_Specific]]
 +
|-
 +
| QA || Cross Database QA Fail All Check || [[MetaData_-_Processing_Rules_-_QA_Specific#Cross_Database_QA_Fail_All_Check
 +
|-
 +
|}
  
  
 
[[Category:Module Specific:MetaData]]
 
[[Category:Module Specific:MetaData]]

Revision as of 23:05, 7 February 2017

1 Overview

MetaData Process rules are rules that allow for the processing of raw data. There are quite a number of rules and parameters used for each rule. Below is a list of the rules and how each one is set up. There is also a link off to the reference document for that function.

1.1 String Management

Type Function Link
Library String MetaData_-_Processing_Rules_-_String_Management
String Append MetaData_-_Processing_Rules_-_String_Management#Append
String Prepend MetaData_-_Processing_Rules_-_String_Management#Prepend
String Encapsulate MetaData_-_Processing_Rules_-_String_Management#Encapsulate
String Remove Numbers MetaData_-_Processing_Rules_-_String_Management#Remove_Numbers
String Strip Tags MetaData_-_Processing_Rules_-_String_Management#Strip_Tags
String Replace MetaData_-_Processing_Rules_-_String_Management#Replace
String Concatenation MetaData_-_Processing_Rules_-_String_Management#Concatenation
String Read From MetaData_-_Processing_Rules_-_String_Management#Read_From
String Read Until MetaData_-_Processing_Rules_-_String_Management#Read_Until
String Set Value MetaData_-_Processing_Rules_-_String_Management#Set_Value

1.2 Mathematical Functions

Type Function Link
Library Mathematical MetaData_-_Processing_Rules_-_Mathematical_Functions
Mathematical Addition MetaData_-_Processing_Rules_-_Mathematical_Functions#Addition
Mathematical Subtraction MetaData_-_Processing_Rules_-_Mathematical_Functions#Subtraction
Mathematical Multiplication MetaData_-_Processing_Rules_-_Mathematical_Functions#Multiplication
Mathematical Division MetaData_-_Processing_Rules_-_Mathematical_Functions#Division
Mathematical Modulus MetaData_-_Processing_Rules_-_Mathematical_Functions#Modulus
Mathematical Numeric MetaData_-_Processing_Rules_-_Mathematical_Functions#Numeric
Mathematical Summation MetaData_-_Processing_Rules_-_Mathematical_Functions#Summation
Mathematical Count MetaData_-_Processing_Rules_-_Mathematical_Functions#Count
Mathematical Is Unique MetaData_-_Processing_Rules_-_Mathematical_Functions#Is_Unique
Mathematical Group Count MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Count
Mathematical Group Sum MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Sum

1.3 Date Time Functions

Type Function Link
Library Date Time MetaData_-_Processing_Rules_-_Date_and_Time_Management
Date Time Date MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date
Date Time Time MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime
Date Time Time Now MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime_Now
Date Time Report Time To Seconds MetaData_-_Processing_Rules_-_Date_and_Time_Management#Report_Time_To_Seconds
Date Time Seconds To Report Time MetaData_-_Processing_Rules_-_Date_and_Time_Management#Seconds_To_Report_Time
Date Time Time MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time
Date Time Time To Seconds MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time_To_Seconds
Date Time ZULU MetaData_-_Processing_Rules_-_Date_and_Time_Management#ZULU
Date Time Day Between MetaData_-_Processing_Rules_-_Date_and_Time_Management#Day_Between
Date Time Month To number MetaData_-_Processing_Rules_-_Date_and_Time_Management#Month_To_number

1.4 Data Functions

Type Function Link
Library Data MetaData_-_Processing_Rules_-_Data_Management
Data Deletion MetaData_-_Processing_Rules_-_Data_Management#Deletion
Data Remove Duplicate Records MetaData_-_Processing_Rules_-_Data_Management#Remove_Duplicate_Records
Data Flag Duplicate Records MetaData_-_Processing_Rules_-_Data_Management#Flag_Duplicate_Records

1.5 Conversion Functions

Type Function Link
Library Conversion MetaData_-_Processing_Rules_-_Data_Conversion
Conversion Convert Data field MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Data_field
Conversion Convert Form Id MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Form_Id
Conversion Convert Client Id MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Client_Id

1.6 Cross Form Functions

Type Function Link
Library Cross Form MetaData_-_Processing_Rules_-_Cross_Form
Cross Form Copy To Destination MetaData_-_Processing_Rules_-_Cross_Form#Copy_To_Destination
Cross Form Cross Form Update MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update
Cross Form Cross Form Insert MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Insert
Cross Form Cross Form Update Simple/Custom MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Simple.2FCustom
Cross Form Cross Form Update Smart MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Smart

1.7 CCL Specific Functions

Type Function Link
Library CCL Specific MetaData_-_Processing_Rules_-_CCL_Specific
CCL Specific Insert Into CCL Simple MetaData_-_Processing_Rules_-_CCL_Specific#Insert_Into_CCL_Simple
CCL Specific Insert From CCL Custom MetaData_-_Processing_Rules_-_CCL_Specific#Insert_From_CCL_Custom

1.8 QA Specific Functions

Type Function Link
Library QA MetaData_-_Processing_Rules_-_QA_Specific
QA Cross Database QA Fail All Check [[MetaData_-_Processing_Rules_-_QA_Specific#Cross_Database_QA_Fail_All_Check