且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

如何从Azure数据工厂中的azure blob存储中获取某些数据,并将目标作为SQL数据库执行复制活动?

更新时间:2023-02-04 21:08:49

我想你在这里已经有了一些建议 


https://***.com/questions/56259168/copy-blob-data -to-sql-database-in-azure-data-factory-with-conditions / 56265030#56265030



I am trying to perform Copy Activity inside Azure Data Factory where the source are Blobs (JSON) and destination is MySql database.

I do not want certain data to be copied during that activity and that can be determined by reading First key value Element of the Blob's JSON.

Or maybe if it is not possible to stop reading all the BLOB data then at least while writing inside the SQL table I want just some specific data(Like some jsons should be copied and some filtered out on the basis of a key value present inside blob).

The main focus is to reduce the cost of writing irrelevant data, and to decrease the storage after writing.



I think you already have few suggestions here 

https://***.com/questions/56259168/copy-blob-data-to-sql-database-in-azure-data-factory-with-conditions/56265030#56265030