I have two data sources, one sql table, one flat file (csv). Both sources have exact same columns. Example Data:
Table:
HCN Name Surname DOB
111
SOLUTION 1 : LOOKUP:
You can follows theses steps:
SOLUTION 2 : LEFT ANTI JOIN
You can follows theses steps:
1 Sort datasets / or modifiy the properties of the source to isSorted = true
2 Use a LEFT JOIN on the key, and add a new column containing the id of the right side
3 Add a conditional split condition on right side ID is null
Then redirect CASE 1 splited data to your destination, you have only rows from the left side without right side correspondance