UploadFiles
Upload files to Azure Data Lake.
Last updated
Was this helpful?
Upload files to Azure Data Lake.
Task version: 1.4.0
Required Frends version: 5.5+
Required .NET version: 6.0
Compatible Agents: Crossplatform
Source code: https://github.com/FrendsPlatform/Frends.AzureDataLake/tree/main/Frends.AzureDataLake.UploadFiles
Source : Source
Specify source files parameters
Default: -
Example: -
Destination : Destination
Specify destination Data Lake parameters
Default: -
Example: -
Options : Options
Specify options how we should handle data and errors
Default: -
Example: -
Overwrite : Boolean
How the existing file will be handled.
Default: False
Example: true
UploadFilesRecursively : Boolean
True: Upload all files matching pattern, even in nested directories.
False: Upload files matching pattern, which are only directly in Source Directory
Default: True
Example: true
Close : Boolean
Specifies whether the uploaded file should be finalized (closed) after upload.
When true, it triggers a "final update" event in Azure Storage Events.
Default: True
Example: true
Success : Boolean
Operation complete. Returns false if ThrowErrorOnFailure is disabled and error occurred. Returns true otherwise.
Example: true
Data : Dictionary<String, String>
This object contains the list of local source file paths and their respective URLs in Azure Data Lake. If an ignorable error occurs, such as when a file already exists and Options.ThrowErrorOnFailure is set to false, the URL will be replaced with the corresponding error message.age.
Example: { { c:\temp\examplefile.txt, https://storage.dfs.core.windows.net/container/examplefile.txt }, { c:\temp\examplefile2.txt, File examplefile2 already exists. } }
ErrorMessage : String
This object contains the error message if task fail.
Example: Container ex does not exist
Changelog for Task Frends.AzureDataLake.UploadFiles.
Updated Azure packages to latest versions:
Azure.Storage.Files.DataLake 12.25.0
Azure.Identity 1.17.1
Added new Close parameter to control whether the uploaded file is finalized after upload.
Use the default parameter value ('true') if you want the upload operation to work as before (automatically closing the stream).
Set to 'false' if you need to manage the stream lifecycle manually after upload.
Updated the Azure.Identity package to version 1.12.0.
Added FrendsTaskMetadata.json
Initial implementation of Frends.AzureDataLake.UploadFiles.
Last updated
Was this helpful?
Was this helpful?

