Wednesday, 7 July 2021

PRE JOB AND POST JOB ACTIVITY WHICH SHOULD FOLLOW IN TALEND ETL

 Talend is a well known ETL tool nowadays. It’s based on java language and you can use your own java code with help of pre available components. Talend also provides facilities to developers to design their own component using JAVA code.

Most of the ETL have the same strategy like move data with needed transformation from source to target, but one should consider some basic points for pre and post job activities in Talend as best practices.

  • Open and close DB connections-

When we need to deal with any database component like tOracleinput , tMysqlinput etc  then the best practice is use DB connection components.

For example if you want to deal with oracle DB then you can use tOracleConnection component to connect with oracle and latter you can you same connection in any oracle DB component like tOracleOutput, tOracleCommit, tOracleRollback etc. The mandatory thing is, tOracleConnection should run first or place before any other component which is going to use the same connection.

Steps for using connection in other components-

  1. Suppose to be using tOracleInput component, then open component setting.

  2. Open basic setting option.

  3. Tick yes on ‘USE EXISTING CONNECTION’ option.

  4. You can find the list of available connections in the component list.

  5. Select your required connection for perform any action on particular connection.


In order to close a running session on DB we need to use a close connection component at the end of the job. For a given  example you can use tOracleClose at the end of a job.

No comments:

Post a Comment