I am running my consumer code in loop due to memory constraints, committing my data and then loading into tables Following is the code which will run in loop // here is the main part of the component,…
Advertisement
Tag: talend
how to just extract the last 2 days recent files from tftpfilelist based on modified time without storing in a tbufferoutput component-talend job
As of now i am iterating through all the 5k files available in the folder and store them in a tbufferoutput and read through them by using tbufferinput and sorting them based on mtime desc(modified time in the ftp site) in the descending order and extract the top 10 files only. Since its iterating through all the 5k files at
Advertisement