Difference between revisions of "MetaData Process Rules"

From All n One's bxp software Wixi

Jump to: navigation, search
 
(10 intermediate revisions by one other user not shown)
Line 1: Line 1:
MetaData Process rules are rules that allow for the processing of raw data.  There are quite a number of rules and parameters used for each rule.  Below is a list of the rules and how each one is set up.
+
= Overview =
  
= Data Cleanup Functions =
+
{| class="wikitable" style="width:100%;"
* Delete
+
! style="width:20%;" | Overview
* DeDupe
+
! style="width:20%;" | Retrieve
 +
! style="width:20%;" | Input
 +
! style="width:20%;" | Process
 +
! style="width:20%;" | Output
 +
|-
 +
| style="text-align:center;" | [[MetaData_-_Start_Here|Link]]
 +
| style="text-align:center;" | [[MetaData_-_Retrieve|Link]]
 +
| style="text-align:center;" | [[MetaData_Process_Input|Link]]
 +
| style="text-align:center;" | [[MetaData_Process_Rules|Link]]
 +
| style="text-align:center;" | [[MetaData_Process_Output|Link]]
 +
|-
 +
|}
  
= Maths functions =
 
* Add
 
* Subtract
 
* Multiply
 
* Divide - Divide by 0 is always calculated to 0 for reporting purposes
 
* Modulus - Modulus maths, leaves the remainder
 
* Positive - Always makes a value positive
 
* Numeric - Forces the value to be numeric. Defaults to 0 if string or unrecognised
 
* Boolean - Forces the value to be Boolean.  Defaults to false if unrecognised.
 
  
= String Functions =
+
MetaData Process rules are rules that allow for the processing of raw data. There are quite a number of rules and parameters used for each rule.  Below is a list of the rules and how each one is set up.  There is also a link off to the reference document for that function.
* Replace - Replaces one string with another
 
* RemoveNumbers - Removes all numbers from the values
 
* Trim - Removes leading and trailing spaces
 
* TitleCase - Used for tidying up names. Capitalises the first letter of each word.
 
* SentenceCase - Reformats the data into sentence case.
 
* Concat - Combines two strings in the order supplied
 
* Encapsulate - Surround a string with the values provided
 
* Fixed - Extracts a fixed amount from the string
 
* Append - Add to the end of the string
 
* Prepend - Add to the start of the string
 
  
= Date | Time Functions =
 
* DateTime - Format the time in Universal Date Time format yyyy-mm-dd hh:mm:ss
 
* Date - yyyy-mm-dd only
 
* Time - hh:mm:ss only
 
* Zulu - Zyyyy-mm-ddThh:mm:ss
 
* ReportTimeToSeconds - Converts report time to a seconds value
 
* TimeToSeconds - For normal dates, convert to a base second time for comparisons
 
* SecondsToReportTime - When using comparison dates, after subtractions, converts to a report time format
 
* Percentage - Divide 1 by 2, output formatted number * 100, limit to 2 decimal places
 
  
= Data Cumulative Functions =
 
* Sum
 
* Count
 
* IsUnique
 
  
= Data Transformation Functions =
+
= Function List =
* Convert_Title
 
* Convert_County
 
* Convert_Country
 
* Convert_StaffId
 
* Convert_DepartmentId
 
* Convert_SecurityGroupId
 
* Convert_DataField
 
  
= Data Transfer =
+
 
* CrossDatabase_Update
+
{| class="wikitable"
* CrossDatabase_Insert
+
! style="width:25%" | Type
 +
! style="width:50%" | Function
 +
! style="width:25%" | Link
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | String
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_String_Management|Link]]
 +
|-
 +
| String || Append || [[MetaData_-_Processing_Rules_-_String_Management#Append|Link]]
 +
|-
 +
| String || Prepend || [[MetaData_-_Processing_Rules_-_String_Management#Prepend|Link]]
 +
|-
 +
| String || Encapsulate || [[MetaData_-_Processing_Rules_-_String_Management#Encapsulate|Link]]
 +
|-
 +
| String || Remove Numbers || [[MetaData_-_Processing_Rules_-_String_Management#Remove_Numbers|Link]]
 +
|-
 +
| String || Strip Tags || [[MetaData_-_Processing_Rules_-_String_Management#Strip_Tags|Link]]
 +
|-
 +
| String || Replace || [[MetaData_-_Processing_Rules_-_String_Management#Replace|Link]]
 +
|-
 +
| String || Concatenation || [[MetaData_-_Processing_Rules_-_String_Management#Concatenation|Link]]
 +
|-
 +
| String || Read From || [[MetaData_-_Processing_Rules_-_String_Management#Read_From|Link]]
 +
|-
 +
| String || Read Until || [[MetaData_-_Processing_Rules_-_String_Management#Read_Until|Link]]
 +
|-
 +
| String || Set Value || [[MetaData_-_Processing_Rules_-_String_Management#Set_Value|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Mathematical
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Mathematical_Functions|Link]]
 +
|-
 +
| Mathematical || Addition || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Addition|Link]]
 +
|-
 +
| Mathematical || Subtraction || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Subtraction|Link]]
 +
|-
 +
| Mathematical || Multiplication || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Multiplication|Link]]
 +
|-
 +
| Mathematical || Division || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Division|Link]]
 +
|-
 +
| Mathematical || Modulus || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Modulus|Link]]
 +
|-
 +
| Mathematical || Numeric || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Numeric|Link]]
 +
|-
 +
| Mathematical || Summation || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Summation|Link]]
 +
|-
 +
| Mathematical || Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Count|Link]]
 +
|-
 +
| Mathematical || Is Unique || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Is_Unique|Link]]
 +
|-
 +
| Mathematical || Group Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Count|Link]]
 +
|-
 +
| Mathematical || Group Sum || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Sum|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Date Time
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Date_and_Time_Management|Link]]
 +
|-
 +
| Date Time || Date || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date|Link]]
 +
|-
 +
| Date Time || Date|Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime|Link]]
 +
|-
 +
| Date Time || Date|Time Now || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime_Now|Link]]
 +
|-
 +
| Date Time || Report Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Report_Time_To_Seconds|Link]]
 +
|-
 +
| Date Time || Seconds To Report Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Seconds_To_Report_Time|Link]]
 +
|-
 +
| Date Time || Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time|Link]]
 +
|-
 +
| Date Time || Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time_To_Seconds|Link]]
 +
|-
 +
| Date Time || ZULU || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#ZULU|Link]]
 +
|-
 +
| Date Time || Day Between || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Day_Between|Link]]
 +
|-
 +
| Date Time || Month To number || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Month_To_number|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Data  
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Data_Management|Link]]
 +
|-
 +
| Data || Deletion || [[MetaData_-_Processing_Rules_-_Data_Management#Deletion|Link]]
 +
|-
 +
| Data || Remove Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Remove_Duplicate_Records|Link]]
 +
|-
 +
| Data || Flag Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Flag_Duplicate_Records|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Conversion
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Data_Conversion|Link]]
 +
|-
 +
| Conversion || Convert Data field || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Data_field|Link]]
 +
|-
 +
| Conversion || Convert Form Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Form_Id|Link]]
 +
|-
 +
| Conversion || Convert Client Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Client_Id|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Cross Form
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Cross_Form|Link]]
 +
|-
 +
| Cross Form || Copy To Destination || [[MetaData_-_Processing_Rules_-_Cross_Form#Copy_To_Destination|Link]]
 +
|-
 +
| Cross Form || Cross Form Update || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update|Link]]
 +
|-
 +
| Cross Form || Cross Form Insert || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Insert|Link]]
 +
|-
 +
| Cross Form || Cross Form Update Simple/Custom || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Simple.2FCustom|Link]]
 +
|-
 +
| Cross Form || Cross Form Update Smart || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Smart|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | CCL Specific
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_CCL_Specific|Link]]
 +
|-
 +
| CCL Specific || Insert Into CCL Simple || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_Into_CCL_Simple|Link]]
 +
|-
 +
| CCL Specific || Insert From CCL Custom || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_From_CCL_Custom|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | QA
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_QA_Specific|Link]]
 +
|-
 +
| QA || Cross Database QA Fail All Check || [[MetaData_-_Processing_Rules_-_QA_Specific#Cross_Database_QA_Fail_All_Check|Link]]
 +
|-
 +
| style="color:green; background-color:#ffffcc;" | Library
 +
| style="color:green; background-color:#ffffcc;" | Comms
 +
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Comms|Link]]
 +
|-
 +
| Comms || Email Comms || [[MetaData_-_Processing_Rules_-_Comms#EmailComms|Link]]
 +
|-
 +
| Comms || SMS Comms || [[MetaData_-_Processing_Rules_-_Comms#SMSComms|Link]]
 +
|-
 +
|}
 +
 
 +
 
 +
[[Category:Module Specific:MetaData|Link]]

Latest revision as of 10:48, 23 February 2018

1 Overview

Overview Retrieve Input Process Output
Link Link Link Link Link


MetaData Process rules are rules that allow for the processing of raw data. There are quite a number of rules and parameters used for each rule. Below is a list of the rules and how each one is set up. There is also a link off to the reference document for that function.


2 Function List

Type Function Link
Library String Link
String Append Link
String Prepend Link
String Encapsulate Link
String Remove Numbers Link
String Strip Tags Link
String Replace Link
String Concatenation Link
String Read From Link
String Read Until Link
String Set Value Link
Library Mathematical Link
Mathematical Addition Link
Mathematical Subtraction Link
Mathematical Multiplication Link
Mathematical Division Link
Mathematical Modulus Link
Mathematical Numeric Link
Mathematical Summation Link
Mathematical Count Link
Mathematical Is Unique Link
Mathematical Group Count Link
Mathematical Group Sum Link
Library Date Time Link
Date Time Date Link
Date Time Time Link
Date Time Time Now Link
Date Time Report Time To Seconds Link
Date Time Seconds To Report Time Link
Date Time Time Link
Date Time Time To Seconds Link
Date Time ZULU Link
Date Time Day Between Link
Date Time Month To number Link
Library Data Link
Data Deletion Link
Data Remove Duplicate Records Link
Data Flag Duplicate Records Link
Library Conversion Link
Conversion Convert Data field Link
Conversion Convert Form Id Link
Conversion Convert Client Id Link
Library Cross Form Link
Cross Form Copy To Destination Link
Cross Form Cross Form Update Link
Cross Form Cross Form Insert Link
Cross Form Cross Form Update Simple/Custom Link
Cross Form Cross Form Update Smart Link
Library CCL Specific Link
CCL Specific Insert Into CCL Simple Link
CCL Specific Insert From CCL Custom Link
Library QA Link
QA Cross Database QA Fail All Check Link
Library Comms Link
Comms Email Comms Link
Comms SMS Comms Link