Redshift

Overview

The Redshift source supports Full Refresh syncs. Zenskar will copy all rows in the tables and columns you set up for replication.

This Redshift source connector is built on top of the source-jdbc code base and is configured to rely on JDBC 4.2 standard drivers provided by Amazon via Mulesoft here as described in Redshift documentation here.

Sync overview

Resulting schema

The Redshift source does not alter the schema present in your warehouse. Depending on the destination connected to this source, however, the schema may be altered. See the destination's documentation for more details.

Features

FeatureSupportedNotes
Full Refresh SyncYes
Incremental SyncYesCursor-based, using ORDER BY on a user-defined cursor column
Replicate Incremental DeletesNot supported in Redshift
Logical Replication (WAL)Not supported in Redshift
SSL SupportYes
SSH Tunnel ConnectionNo
NamespacesYesEnabled by default
Schema SelectionYesMultiple schemas may be used at one time. Keep empty to process all of existing schemas

Incremental Sync

The Redshift source connector supports incremental syncs. To setup an incremental sync for a table in Redshift, you must setup a user-defined cursor field such as an updated_at column. The connector relies on this column to know which records were updated since the last sync it ran.

Defining a cursor field allows you to run incremental-append syncs. To run incremental-dedupe syncs, you'll need to tell the connector which column(s) to use as a primary key. See the incremental-dedupe sync docs for more information.

πŸ•β€πŸ¦Ί Setup guide

Prerequisites

  1. Active Redshift cluster
  2. Allow connections from Zenksar to your Redshift cluster

βš™οΈ Set up the QuickBooks data source in Zenskar

βš™οΈ Set up data source and type

  1. Log into your Zenskar account.
  2. In the left navigation bar, navigate to Metering > Data Sources. In the top-right corner, click + ADD DATA SOURCE.
  3. In the Set Up Source section of the Add New Data Source page, enter a name for the MongoDB data source connection.
  4. Select Redshift from the Source Type dropdown.

βš™οΈ Configure data source

In the Source Config section of the Add New Data Source page, do the following:

πŸ“–

JDBC URL

The JDBC URL has the following format:

jdbc:redshift://<endpoint>:<port>/<database>.

  • Host: The host is the JDBC URL without the <port> and <database>.
  • Port: The port number that you specified when you launched the cluster. If you have a firewall, make sure that this port is open for you to use. Default is set to 5439.
  • Database: The database that you created for your cluster.
  • Password: The password that you created for your cluster.
  • Username: The user that you created for your cluster.
  • JDBC URL Params: Please refer AWS Redshift documentation regarding building the JDBC connection URL and options for JDBC driver version 2.1 configuration.