Thanks for this article. In our ADF pipeline we are also using additional columns. When I add those additional columns in the mappingtable, i get the following error: ‘The column ‘columnname’ is not found in source side. How can I ensure that these columns are also loaded?

Thanks in advance.

According to me, You can set the target name at field level in your Entity class. for that you can use Hibernate Column property.
Ex.
@Column(name=”EMPLOYEE_ID”)
private Integer em_id;
I hope this can solve your problem.
Thank you, Bhushan

i have a question regarding your stored procedure. If i have my source and target columns the same, then i get an json output, but if i have my source names diffrent (e.g. technical names from the source system) and want them to have diffrent names, i can’t get the mapping to work. It returns NULL as the json_output.

Example by using your example:

VALUES
(‘dbo’,’EMPLOYEE’, ‘[EMPLOYEE_ID, EMPLOYEE_NAME, DESIGNATION, DATE_OF_JOINING, REPORTING_MANAGER]’, ‘[em_id, em_name, desig, date_joining, manager]’)

This will return me NULL

Any idea how i can get your procedure to work like this? EMPLOYEE_ID –> em_id, EMPLOYEE_NAME –> em_name etc.

Thanks,
Ray

Thanks for this nicely written article.
If anyone of you trying this out face an issue like: type conversion.
For example:
The given value of type Byte[] from the data source cannot be converted to type nvarchar of the specified target.

To resolve this, modify the stored procedure to allow type conversion like this:

DECLARE @json_construct varchar(MAX) = ‘{“type”: “TabularTranslator”, “mappings”: {X}, “typeConversion”: true, “typeConversionSettings”: {“allowDataTruncation”: true, “treatBooleanAsNumber”: false}}’;

Thanks,
Derik Roby

I faced this error: “Required property ‘sink’ is missing in payload”. The way I solved it was to double-check that my stored procedure was using the proper names:

I used to have: srccol.value as ‘source.name’, trgcol.value as ‘target.name’… , and I changed it to: srccol.value as ‘source.name’, trgcol.value as ‘sink.name’…. and it’s working now.

When i try to do dynamic mapping of JSON schema getting the error “Required property ‘source’ is missing in payload”. Could you please help me on how we can fix this issue.

Thanks in Advance