Get Data Moving 1
Results 1 to 7 of 7

Thread: Way to get real-time data from SQL Azure to Redshift

  1. #1
    francis_lodwick is offline Junior Member
    Join Date
    Aug 2015
    Posts
    6
    Rep Power
    0

    Way to get real-time data from SQL Azure to Redshift

    Hi,

    I have a problem at the moment getting data from a SQL Azure database into Redshift using Cloudbeam. Since SQL Azure does not have the functionality required for Cloudbeam to replicate (correct me if I'm wrong!), at present, the process involves taking a bacpac file backup of a backup the Azure database, restoring it to a local SQL Server and then replicating from that (full load), daily. This process is obviously very fragile, and we also want to move to a real-time solution.

    Does anyone have any ideas on how to achieve this? Is it possible to use an Azure Data Warehouse as a source database? Or is the only option to move away from Azure entirely, back to SQL Server?

    Francis

  2. #2
    stevenguyen is offline Senior Member
    Join Date
    May 2014
    Posts
    297
    Rep Power
    6
    Hello Francis,

    We could support Full Load to move all data from Azure to Redshift. But could not support CDC if this is from an Azure DB Service platform.

    Thanks,
    Steve

  3. #3
    francis_lodwick is offline Junior Member
    Join Date
    Aug 2015
    Posts
    6
    Rep Power
    0
    Thanks Steve. In the short-term, full-loading directly from Azure would be preferable to the roundabout process we have now. In setting up a new database source, I don't see an Azure-specific option: do I just use SQL Server? Is there anything else I need to know about setting up the Azure db as a source?

    In the long-term, do you have any ideas about whether SQL Azure will be able to support CDC? what about using Azure Data Warehouse as a source (rather than a target)?

    Francis

  4. #4
    thiagobruch is offline Junior Member
    Join Date
    Feb 2015
    Posts
    5
    Rep Power
    0
    Hi Francis,

    In order to use SQL Database in Azure as a Source, the ODBC Source configuration would have to be used.

    Please find the instructions below:
    1 In Windows (Administrative Tools => Data Sources (ODBC)) create a system Data Source using SQL Client and connecting to the Azure SQL Database.
    2 In Replicate, go to Manage Database and add a new Source Database
    3 Under Type, select ODBC.
    4 Under DSN, select the Data Source created on item 1.
    5 Add the username and password
    6 Under Provider Syntax, leave it blank.

    * Please be aware that the configuration above will work for Full Load tasks only.

    Sincerely,
    Thiago Bruch

  5. #5
    francis_lodwick is offline Junior Member
    Join Date
    Aug 2015
    Posts
    6
    Rep Power
    0
    Mr Bruch,

    Thank you very much for your excellent advice. I've successfully created a new data source and added it to Attunity Replicate. However, I'm now getting a new error:

    Task failed
    Cannot start Full Load subtask's threads
    ...
    No license for database 'AzureMirror' of type 'ODBC'

    Name:  Capture.PNG
Views: 407
Size:  20.0 KB

    How do I proceed from here?

  6. #6
    francis_lodwick is offline Junior Member
    Join Date
    Aug 2015
    Posts
    6
    Rep Power
    0
    More detail on the error: Name:  Capture.PNG
Views: 383
Size:  23.4 KB

  7. #7
    stevenguyen is offline Senior Member
    Join Date
    May 2014
    Posts
    297
    Rep Power
    6
    Hello Francis,

    What version of Replicate are you using?

    Thanks,
    Steve

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •