Changes

MetaData Process Rules

5,804 bytes added, 10:48, 23 February 2018
no edit summary
MetaData Process rules are rules that allow for the processing of raw data. There are quite a number of rules and parameters used for each rule. Below is a list of the rules and how each one is set up.= Overview =
Data Cleanup Functions=================={| class="wikitable" style="width:100%;"! style="width:20%;" | Overview! style="width:20%;" | Retrieve! style="width:20%;" | Input! style="width:20%;" | Process! style="width:20%;" | Output|-| style="text-align:center;" | [[MetaData_-_Start_Here|Link]]| style="text-align:center;" | [[MetaData_-_Retrieve|Link]]| style="text-align:center;" | [[MetaData_Process_Input|Link]]| style="text-align:center;" | [[MetaData_Process_Rules|Link]]| style="text-align:center;" | [[MetaData_Process_Output|Link]]Function: Delete|-Function: DeDupe|}
Maths functions==============================• Add• Subtract• Multiply• Divide Divide by 0 is always calculated to 0 MetaData Process rules are rules that allow for reporting purposes• Modulus Modulus maths, leaves the remainder• Positive Always makes processing of raw data. There are quite a value positive• Numeric Forces the value to be numericnumber of rules and parameters used for each rule. Defaults to 0 if string or unrecognised• Boolean Forces Below is a list of the value to be Booleanrules and how each one is set up. Defaults There is also a link off to false if unrecognisedthe reference document for that function.
String Functions
==============================
• Replace Replaces one string with another
• RemoveNumbers Removes all numbers from the values
• Trim Removes leading and trailing spaces
• TitleCase Used for tidying up names. Capitalises the first letter of each word.
• SentenceCase Reformats the data into sentence case.
• Concat Combines two strings in the order supplied
• Encapsulate Surround a string with the values provided
• Fixed Extracts a fixed amount from the string
• Append Add to the end of the string
• Prepend Add to the start of the string
= Function List =
Date | Time Functions
==============================
• DateTime Format the time in Universal Date Time format yyyy-mm-dd hh:mm:ss
• Date yyyy-mm-dd only
• Time hh:mm:ss only
• Zulu Zyyyy-mm-ddThh:mm:ss
• ReportTimeToSeconds Converts report time to a seconds value
• TimeToSeconds For normal dates, convert to a base second time for comparisons
• SecondsToReportTime When using comparison dates, after subtractions, converts to a report time format
• Percentage Divide 1 by 2, output formatted number * 100, limit to 2 decimal places
{| class="wikitable"
! style="width:25%" | Type
! style="width:50%" | Function
! style="width:25%" | Link
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | String
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_String_Management|Link]]
|-
| String || Append || [[MetaData_-_Processing_Rules_-_String_Management#Append|Link]]
|-
| String || Prepend || [[MetaData_-_Processing_Rules_-_String_Management#Prepend|Link]]
|-
| String || Encapsulate || [[MetaData_-_Processing_Rules_-_String_Management#Encapsulate|Link]]
|-
| String || Remove Numbers || [[MetaData_-_Processing_Rules_-_String_Management#Remove_Numbers|Link]]
|-
| String || Strip Tags || [[MetaData_-_Processing_Rules_-_String_Management#Strip_Tags|Link]]
|-
| String || Replace || [[MetaData_-_Processing_Rules_-_String_Management#Replace|Link]]
|-
| String || Concatenation || [[MetaData_-_Processing_Rules_-_String_Management#Concatenation|Link]]
|-
| String || Read From || [[MetaData_-_Processing_Rules_-_String_Management#Read_From|Link]]
|-
| String || Read Until || [[MetaData_-_Processing_Rules_-_String_Management#Read_Until|Link]]
|-
| String || Set Value || [[MetaData_-_Processing_Rules_-_String_Management#Set_Value|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Mathematical
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Mathematical_Functions|Link]]
|-
| Mathematical || Addition || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Addition|Link]]
|-
| Mathematical || Subtraction || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Subtraction|Link]]
|-
| Mathematical || Multiplication || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Multiplication|Link]]
|-
| Mathematical || Division || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Division|Link]]
|-
| Mathematical || Modulus || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Modulus|Link]]
|-
| Mathematical || Numeric || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Numeric|Link]]
|-
| Mathematical || Summation || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Summation|Link]]
|-
| Mathematical || Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Count|Link]]
|-
| Mathematical || Is Unique || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Is_Unique|Link]]
|-
| Mathematical || Group Count || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Count|Link]]
|-
| Mathematical || Group Sum || [[MetaData_-_Processing_Rules_-_Mathematical_Functions#Group_Sum|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Date Time
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Date_and_Time_Management|Link]]
|-
| Date Time || Date || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date|Link]]
|-
| Date Time || Date|Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime|Link]]
|-
| Date Time || Date|Time Now || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Date.7CTime_Now|Link]]
|-
| Date Time || Report Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Report_Time_To_Seconds|Link]]
|-
| Date Time || Seconds To Report Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Seconds_To_Report_Time|Link]]
|-
| Date Time || Time || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time|Link]]
|-
| Date Time || Time To Seconds || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Time_To_Seconds|Link]]
|-
| Date Time || ZULU || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#ZULU|Link]]
|-
| Date Time || Day Between || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Day_Between|Link]]
|-
| Date Time || Month To number || [[MetaData_-_Processing_Rules_-_Date_and_Time_Management#Month_To_number|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Data
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Data_Management|Link]]
|-
| Data || Deletion || [[MetaData_-_Processing_Rules_-_Data_Management#Deletion|Link]]
|-
| Data || Remove Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Remove_Duplicate_Records|Link]]
|-
| Data || Flag Duplicate Records || [[MetaData_-_Processing_Rules_-_Data_Management#Flag_Duplicate_Records|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Conversion
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Data_Conversion|Link]]
|-
| Conversion || Convert Data field || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Data_field|Link]]
|-
| Conversion || Convert Form Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Form_Id|Link]]
|-
| Conversion || Convert Client Id || [[MetaData_-_Processing_Rules_-_Data_Conversion#Convert_Client_Id|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Cross Form
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Cross_Form|Link]]
|-
| Cross Form || Copy To Destination || [[MetaData_-_Processing_Rules_-_Cross_Form#Copy_To_Destination|Link]]
|-
| Cross Form || Cross Form Update || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update|Link]]
|-
| Cross Form || Cross Form Insert || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Insert|Link]]
|-
| Cross Form || Cross Form Update Simple/Custom || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Simple.2FCustom|Link]]
|-
| Cross Form || Cross Form Update Smart || [[MetaData_-_Processing_Rules_-_Cross_Form#Cross_Form_Update_Smart|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | CCL Specific
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_CCL_Specific|Link]]
|-
| CCL Specific || Insert Into CCL Simple || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_Into_CCL_Simple|Link]]
|-
| CCL Specific || Insert From CCL Custom || [[MetaData_-_Processing_Rules_-_CCL_Specific#Insert_From_CCL_Custom|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | QA
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_QA_Specific|Link]]
|-
| QA || Cross Database QA Fail All Check || [[MetaData_-_Processing_Rules_-_QA_Specific#Cross_Database_QA_Fail_All_Check|Link]]
|-
| style="color:green; background-color:#ffffcc;" | Library
| style="color:green; background-color:#ffffcc;" | Comms
| style="color:green; background-color:#ffffcc;" | [[MetaData_-_Processing_Rules_-_Comms|Link]]
|-
| Comms || Email Comms || [[MetaData_-_Processing_Rules_-_Comms#EmailComms|Link]]
|-
| Comms || SMS Comms || [[MetaData_-_Processing_Rules_-_Comms#SMSComms|Link]]
|-
|}
Data Cumulative Functions
==============================
• Sum
• Count
• IsUnique
 Data Transformation Functions==============================• Convert_Title• Convert_County• Convert_Country• Convert_StaffId• Convert_DepartmentId• Convert_SecurityGroupId• Convert_DataField Data Transfer==============================Function[[Category: CrossDatabase_UpdateFunctionModule Specific: CrossDatabase_InsertMetaData|Link]]