且构网

分享程序员开发的那些事...
且构网 - 分享程序员编程开发的那些事

删除CSV文件中的空行

更新时间:2023-02-09 13:09:08

嗨MG_ADF,


由于您的源是Blob存储,您可以使用自定义活动在复制之前转换数据。要阅读有关自定义活动的更多信息,请按以下文档操作:


https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-dotnet -custom-activity


如果源是Azure SQL DB,您可以使用存储过程转换数据(https://docs.microsoft.com/en-us/azure/ data-factory / transform-data-using-stored-procedure)


如果它是Azure Data Lake商店,你可以运行一个U-SQL活动来转换它(https:// docs.microsoft.com/en-us/azure/data-factory/transform-data-using-data-lake-analytics)


希望这会有所帮助。


Hi Team,

I'm copying data from CSV file and it is placed in Shared Path and moving to Blob. Then I'm moving data from blob to SQL table.

When we are loading data from blob to SQL there are some empty records loaded into table. I want to remove these empty rows before loading into Blob or SQL table by using ADF V2.

Is there any option to remove the empty rows.

Thanks,

MG

Hi MG_ADF,

Since your source is Blob Storage, you can transform the data before copying by using a custom activity. To read more about custom activities, please follow this doc :

https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-dotnet-custom-activity

Had the source been Azure SQL DB, you could have transformed the data using a Stored Procedure (https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-stored-procedure)

Had it been Azure Data Lake store, you could have run a U-SQL activity to transform it(https://docs.microsoft.com/en-us/azure/data-factory/transform-data-using-data-lake-analytics)

Hope this helps.