Transformation - Validation & Enrichment Overview

Understand how data validation is completed during Transformation in Tide

Introduction

After a Bordereau submission has been through the Questionnaire process and its data has been standardised, it is then taken through the second stage of Transformation. This stage involves completing data validation checks and data enrichment steps.

The data validation checks are set centrally and are automatically applied to all Bordereaux being processed in Tide. 

Data enrichment steps are based on settings in the Bordereau Questionnaire or other centrally set enrichment processes. To learn about the centrally set enrichment processes, visit the Core Automated Enrichment‍ article. Enrichment settings are made at various points in the Questionnaire (for example, setting a default Country if no relevant column is supplied). To learn about how enrichment steps are set through the Questionnaire, visit the Transformation - Questionnaire topic.

Process Overview

Once the automated validation process is completed, then Tide will either have identified no errors, and the Bordereau will reach a Review status, or will identify errors and will then change to a Review Errors status. A notification will pop up on screen of the relevant User to notify them that one of the two statuses has been reached.

If the Bordereau has reached a Review Errors status, then you are a User of the relevant Transformation Company, then you can click on the status to open the errors. You can then either resolve the errors in Tide, or delete the Bordereau and re-submit a corrected Bordereau.

Resolving Errors

The below video tutorial shows you how to resolve errors in Tide. To learn more about how to resolve errors, visit the Resolve Errors article.‍ 

Data Enrichment

Data enrichment is based primarily on the answers and settings selected during completing the Bordereau Questionnaire.

Data validation takes place during the same process. There is often an interaction between these two processes, as once a field has been enriched, it can then be subject to validation (e.g. once a default Risk Country of United States has been populated through enrichment, it can then be used as part of a data validation rule which is conditional on the risk being located in the United States).

Understand the different stages of data Validation

Tide completes data validation in two main stages. Stage 1 completes initial core checks, once these are completed, then all further validation steps can take place.

During stage 1 a single error may be raised, and then once resolved, Tide will continue validation. Core stage 1 errors must be resolved to continue, and no Bordereau Summary screen is presented.

Once stage 2 has been reached then all validation checks are completed, and all errors presented in the Errors & Warnings tab in the Bordereau Summary screen. At this stage you can resolve errors identified in the order you wish. In certain circumstances further validation checks may be run once you've resolved an error; for example, if you correct a Country reference data value, then Tide will check the value in the associated State field is valid.

  • Stage 1 includes:
    • Identify the correct sheet(s) and header row(s)
    • Identify Contract Year of Account, including validation of Risk Inception Date and Year of Account fields used for this process
    • Identify the correct Reporting Channel and then validate Reporting Sequence Rules‍ (e.g. no missing reporting periods)
    • Key field validation in preparation for Stage 2 (e.g. Transaction Type, so that all Life-cycle Validation Checks‍  can be completed in Stage 2)
  • Stage 2 includes all remaining validation steps





Was this article helpful?

Can't find what you're looking for?

Contact Support