Data Replication 2
Results 1 to 7 of 7

Thread: MySQL to hadoop replication

  1. #1
    andy is offline Junior Member
    Join Date
    Aug 2016
    Posts
    4
    Rep Power
    0

    Angry MySQL to hadoop replication

    Hi Guys,

    I have installed Attynity Replication Express in WIndows Server 2012 R2 and I try to do mysql replication (just full load) to hadoop file system (CDH 5.7) with no result.

    All endpoint are configured correctly (green status). Hadoop endpoint I set up with a password authentication as a user cloudera with "File SYstem" option to access folder own by cloudera user. Hive Scripts is set up to HQL SCripts.


    Taks just stops immediately after it started. Here is the log file:

    https://drive.google.com/open?id=0B6...HRJUEVHSXlEQWc

    Help is really appreciated!

  2. #2
    stevenguyen is offline Senior Member
    Join Date
    May 2014
    Posts
    299
    Rep Power
    6
    hello Andy,

    From the Report you are running version 5.0.2xx this is an old version.

    You would need to upgrade to the current 5.0.3xx to correct the issue.

    Please PM me your email so that I can send you the download link for 5.0.3xx.

    Thanks,
    Steve

  3. #3
    andy is offline Junior Member
    Join Date
    Aug 2016
    Posts
    4
    Rep Power
    0
    So why this version (5.0.2) is available through your download site? I am not able to send you PM.

    thanks for answer
    Last edited by andy; 08-08-2016 at 09:06 AM.

  4. #4
    Hein is offline Senior Member
    Join Date
    Dec 2007
    Location
    Nashua, NH - USA.
    Posts
    152
    Rep Power
    12
    Quote Originally Posted by andy View Post
    So why this version (5.0.2) is available through your download site? I am not able to send you PM.

    thanks for answer

    This was a temporary situation which has since been addressed.
    The download is always for the 'latest' GA (General Availabilty) release.
    Version 5.0.2 was 'short lived', replaced by 5.0.3.x

    Thanks,
    Hein

  5. #5
    andy is offline Junior Member
    Join Date
    Aug 2016
    Posts
    4
    Rep Power
    0
    After reinstalling the new version of Attunity (5.0.3.57) I have got new errors.....This time it looks like the are some problems with hive metastore. User that I'am uing has full read/write permission on \user\hive\warehouse\andrzej.db\testmehadoop. This directory also exists and without any problems using my user I can remove and create this directory.

    sudo -u andrzej hadoop fs -rmdir /user/hive/warehouse/andrzej.db/testmehadoop
    sudo -u andrzej hadoop fs -mkdir /user/hive/warehouse/andrzej.db/testmehadoop

    Any ideas guys?
    Attached Files Attached Files

  6. #6
    stevenguyen is offline Senior Member
    Join Date
    May 2014
    Posts
    299
    Rep Power
    6
    Hello Andy,

    We look at the logs and have the following question?

    1. Make sure that you have the Hadoop info set in your Windows HOST file according to the User Guide.

    2. Could you share your Hadoop Endpoint Target Definition with all the setting ?

    3. Make sure the Hadoop user have the correct permission according to the Replicate User Guide.

    Thanks,
    Steve

  7. #7
    Layeeq is offline Junior Member
    Join Date
    Nov 2018
    Posts
    8
    Rep Power
    0

    Mysql Connection Error : No valid MySQL ODBC 5.x Unicode Driver is installed.

    Hi Team,

    I am getting below error after installing driver also , not able to connect to mysql.

    No valid MySQL ODBC 5.x Unicode Driver is installed. The required ODBC driver or driver manager is not properly installed and configured.
    I installed Attunity Express Edition for one month.
    I installed Attunity in Linux Server. where Mysql is their and Hadoop also their and ODBC Jar also installed in same place.

    ODBC Driver:
    mysql-connector-odbc-5.3.10-1.el7.x86_64
    Mysql version : | version | 5.6.41
    | version_comment | MySQL Community Server (GPL)
    | version_compile_machine | x86_64
    version_compile_os | Linux

    I am doing CDC from MYSQL to Hadoop.

    Please find attached screen.

    Please help me on this, Thanks.
    Attached Images Attached Images  

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •