Skip to main content

Creating BigQuery Enrichment

Overview

BigQuery is a fully managed enterprise data warehouse that helps you manage and analyze your data. Skypoint provides a feature to enrich your customer data with data from the BigQuery enrichment connector.

Prerequisites

To configure BigQuery enrichment, the following prerequisites must be met:

  • You have an active customer profile.
  • Google BigQuery Service Account credentials for validation – Email, Project Id, Password.
  • P12 Key file access.

To create BigQuery enrichment

  1. In the left pane, go to Profile > Enrichment, and select the Discover tab.
  2. Choose BigQuery, click Enrich my data.

Alt text


  1. Read the Overview, click Next.

Alt text


The BigQuery enrichment consists of four steps, and you need to perform in the following order:

  1. Connect: Select the connection for enrichment.
  2. Required data: Choose a table containing customer profiles and related data from BigQuery to enrich.
  3. Attribute mapping: Map the related fields from the customer table and the BigQuery table to get the data based on the mapped fields.
  4. Review and run: Add the name for the enrichment and review the settings before running the enrichment.

Select and set up your BigQuery connection

You can create a connection that allows Skypoint instance to share data with another service.

  1. Click Add connection to add a new link. 
  2. If you want to change the existing BigQuery connection, select a Connection for enrichment from the drop-down list, then click Edit.

Alt text


  1. Enter a Display name.
  2. Enter your BigQuery Service Account credentials for validation – Email, Project Id, Password.
  3. Click Choose File to upload a P12 file.
ItemDescription
EmailOption to enter your email associated with Google BigQuery.
Project IdOption to enter Google cloud platform Project Id.
PasswordOption to enter your password.
Key FileOption to upload a P12 key file. P12 file uses Public Key Cryptography Standard (PKCS) encryption to store private key and other sensitive information.

Alt text


  1. Click Verify > Save > Next.

Select customer and BigQuery data set

  1. Choose a Customer data set from the drop-down list. For example, Profile, Audience.
  2. In the BigQuery Data drop-down list, choose a data set containing customer profiles related data from BigQuery. 
  3. Click Next

Alt text


Map your field name to the corresponding BigQuery table field

  1. Select the source table from the Source drop-down list.
  2. Select the BigQuery table from the Target drop-down list.
  3. Click Next.

Alt text


Name BigQuery enrichment, review, and run

  1. Enter Enrichment name > Output table name.
  2. Click Save Enrichment.

Alt text


  1. Click Run to start enriching the data.
  2. If you want to return, click Close.

Alt text


  1. After the run process, click the My Enrichments tab to see the BigQuery enrichment.

Alt text


  1. If necessary, do the following:
ToDo
Edit a workflow for previously created BigQuery enrichmentClick Edit.
Delete a workflowClick Delete.
Run the BigQuery enrichmentClick Run.
See the run history of the BigQuery enrichmentClick Run History.
Cancel the Run that is in progressClick Cancel Run.
View the items in the ListSelect List.
View the items in a specific Group (For example, Name, Enrichment, status)Select Group by.
  1. After the enrichment process, you can view details in the Tables and the customer section as follows:
  • To view details in the Tables section, do the following:

    1. In the left pane, go to the **Lakehouse** and click **Databases** to find your table in the **Gold** > **Enrichment** list.

    Alt text


    2. Click the table name to view attributes, data, and download the CSV file.

Alt text


  • To view details in the customer section, do the following:
    1. In the left pane, go to the **Profile**, click **Customers**.  
    2. Click on **Profile card**, and select the **All Attributes tab**.