Get Data Moving 1
Results 1 to 1 of 1

Thread: Handling Large VARCHAR Columns

  1. #1
    JeffInFlorida's Avatar
    JeffInFlorida is offline US Technical Team
    Join Date
    Oct 2006
    Posts
    95
    Rep Power
    13

    Handling Large VARCHAR Columns

    The standard SSIS package that is generated using the 'Generate CDC Packages' wizard will create a CDC package that contains a Data Flow Component that handles the rows that have an error. The package will write these errors to a text file.

    The problem with this is that the text file does not support the DT_NTEXT column type that is used when processing VARCHAR columns > 4000 bytes long.

    The solution is to convert the column to a DT_TEXT type of column.

    To do this you need to insert a Data Conversion data flow component between the table Change Destination and the table Error Output components.
    • Add the component and then connect the error output of the change destination to the input.
    • Edit the component and place a check next to the column in question.
    • This will add the column with an output alias of 'Copy of ' column.
    • Change the Data Type to 'text stream [DT_TEXT]'.
    • Click OK and close the Transformation Editor.
    • Connect the Data Conversion component to the input of the Error Output component.
    • Edit the component and select the Mappings.
    • Change the mapping for the column from the original input column to the Copy of column that you created.
    That should correct the validation error.
    Last edited by JeffInFlorida; 04-06-2010 at 11:15 AM.
    To Find Out more About Attunity Technology:
    Attunity
    or:
    Contact Us

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •