Skip to main content

Connecting to SQL Server

Microsoft SQL Server is a proprietary relational database management system (RDBMS) by Microsoft, built to efficiently store and retrieve data for diverse applications. It supports transaction processing, BI, and analytics, scaling from single machines to large systems. SQL Server 2022 introduces features like Azure-based disaster recovery, Synapse Link, and enhanced scalability, ensuring performance, data integrity, and seamless business operations.

SkyPoint AI Platform (AIP) integrates with SQL Server via an inbuilt connector, enabling centralized data management, streamlined operations, and advanced analytics. This integration breaks data silos, supports direct data operations, and enhances governance for improved compliance and insights, providing a secure and efficient data management solution.

This document will guide you through the process of connecting SQL Server to the Skypoint AI.

Prerequisite

You need the following details to configure and import data using the SQLServer connector:

  • Server name
  • Database name
  • Port number
  • Username
  • Password

To import data using the SQL Server connector

Follow the below steps to create and configure a new dataflow for the SQL Server import connector:

  1. Navigate to Dataflow > Imports.

Alt image

  1. Click New dataflow as indicated by an arrow.

The Set dataflow name page appears.

Alt image

  1. Enter the desired name for the dataflow in the Name text field.
  2. Click Next to proceed.

The Choose connector page appears.

Alt image

Add SQL Server connector

  1. On the Choose Connector page, use the Search feature to locate and select the SQL Server Connector.
  2. Enter the Display Name for your dataflow in the provided text field.
  3. Optionally, add a Description in the designated text area.

Alt image

  1. Click Next to proceed.

The Configuration page appears.

Alt image

Connect to the SQL Server account

  1. Fill in the required details on the Configuration page.
  2. Click Connect.

Alt image

Once the connection is established, the connector can be used to import data from SQL Server tables.

  1. Scroll down to the Table Details section, select the checkboxes for the tables you wish to import, and use the dropdown menu to label them as either Data or Metadata.

Alt image

note

By default, all tables in the Table Details section are selected. You can choose to import only specific tables that are relevant to your data processing needs. For example, to import customer data, select tables containing details like name, email, address, and contact information.

ItemDescription
PurposeOption to assign a purpose (Data or Metadata) for each table.
DataLoads customer data
MetadataLoads Metadata
File nameDisplays the name of the file that you imported.
Entity nameDisplays the imported table name by default. You can rename it if required.
  1. Please scroll down to the bottom of the page to ensure all required tables are selected.

Alt image

  1. Click Save to apply the changes.

Alt image

Congratulations ! for saving the SQL Server connector dataflow, which appears on the Dataflow > Imports page.

Run, Edit, and Delete the imported data

Once the table is imported, you can execute, modify, and remove the imported table from the Dataflow. Follow the below steps:

  1. Go to the Dataflow > Imports page.

Alt image

ItemDescription
NameDisplays the name of the imported Dataflow.
TypeDisplays connector type symbol.
Connector NameDisplays connector name.
StatusIndicates whether the data is imported successfully.
Tables CountDisplays the number of tables imported.
Created DateDisplays date of creation.
Last Refresh TypeDisplays the refresh value: Full or Incremental.
Updated DateDisplays last modified date.
Last RefreshDisplays the latest refresh date, which updates each time you refresh the data.
ActionsProvides multiple options for managing dataflows.
  1. Select the horizontal ellipsis under the Actions column and do the following:
If you want toThen
Modify the DataflowSelect Edit and modify the Dataflow. Click Save to apply your changes.
Execute the DataflowSelect Run.
Bring the data to its previous stateSelect Rollback.
Delete the DataflowSelect Remove and then click the Delete button. All tables in the data source get deleted.
See the run history of the dataflowSelect Run history.
  1. Click Run to execute the dataflow. Once the execution is successful, the data pipeline status will update to Completed, as illustrated in the figure below.

Alt image

note

In the Dataflow's Run History Description, you can view error messages related to data import failures from a data source. Additionally, you can check the status, start time, and end time of the data pipeline execution.

Next step

After completing the data import, start the Master Data Management (MDM) - Resolve process to create a single, unified view of the data. With Skypoint MDM, you can ensure that your data is accurate, consistent, and reliable, making it easier to use for business processes, analytics, and reporting.