Failed to Upload the Job to Server: Upload file failed during migration I can see from the network monitoring it is sending the data up but it's not completing after awhile it fails completely with "There was a problem during the Migrations "then on the next line "! several packages failed to upload. pause the task." but it automatically pauses if I unpaused after about ten minutes is automatically paused again the account has access to the both sides. the internet pipe in this office is smaller than most at 8 mb but it's transfers about 30 gb but now everytime I rerun it hits that 30gb and stops
has anyone had this issue and if so how do I fix example logs below. Regards Michael [07/24/2018 23:10:55][16d5][50][LOGGING][INFORMATION]File 28633654-4ed9-5c94-8784-108fea42118a.dat already exists at target container and is same as source, overwriting
[07/24/2018 23:10:55][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:10:57][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:10:57][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:10:57][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:10:59][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:10:59][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:11:00][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:11:02][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:11:02][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:11:02][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:11:04][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:11:04][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:11:04][16d5][75][LOGGING][INFORMATION]File blob already exists 7b2d4a88-a8ac-537d-8173-8e6fb4d95362.dat - checking blob metadata
[07/24/2018 23:11:04][16d5][75][LOGGING][INFORMATION]File 7b2d4a88-a8ac-537d-8173-8e6fb4d95362.dat already exists at target container and is same as source, overwriting
[07/24/2018 23:11:05][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:11:06][16d5][141][LOGGING][DEBUG]AggregateException when upload C:\sharepoint working\MigrationToolStorage\company name \WF_4627fd45\TASK_16d56d94\r1\pack55\data\0d518270-124a-59a0-8a14-c362321c9357.dat to Azure Storage, exception message: System.AggregateException:
One or more errors occurred. ---> Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: The client could not finish the operation within specified timeout. ---> System.TimeoutException:
The client could not finish the operation within specified timeout.
--- End of inner exception stack trace ---
at Microsoft.WindowsAzure.Storage.Core.Util.StorageAsyncResult`1.End()
at Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.EndPutBlock(IAsyncResult asyncResult)
at Microsoft.WindowsAzure.Storage.Core.Util.AsyncExtensions.<>c__DisplayClass4.<CreateCallbackVoid>b__3(IAsyncResult ar)
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<UploadBlobAsync>d__8.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__1.MoveNext()
--- End of inner exception stack trace ---
at Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.SingleObjectTransfer.<ExecuteAsync>d__2.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferManager.<DoTransfer>d__2.MoveNext()
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
at System.Threading.Tasks.Task.Wait(TimeSpan timeout)
at Microsoft.SharePoint.MigrationTool.MigrationLib.Common.TaskProxy.Wait(TimeSpan timeout)
at Microsoft.SharePoint.MigrationTool.MigrationLib.Upload.UploadHelper.UploadFromStream(ICloudBlobContainer blobContainerObj, String filePath, Stream sourceStream, Boolean overwriteExistingFiles, Boolean createSnapshot, List`1 filesEncryptionInfo)
at Microsoft.SharePoint.MigrationTool.MigrationLib.Upload.UploadHelper.UploadDataFile(ICloudBlobContainer blobContainerObj, FileBlob fileBlob, Boolean overwriteExistingFiles, Boolean createSnapshots, List`1 filesEncryptionInfo)
---> (Inner Exception #0) Microsoft.WindowsAzure.Storage.DataMovement.TransferException: The transfer failed. ---> Microsoft.WindowsAzure.Storage.StorageException: The client could not finish the operation within specified timeout. ---> System.TimeoutException:
The client could not finish the operation within specified timeout.
--- End of inner exception stack trace ---
at Microsoft.WindowsAzure.Storage.Core.Util.StorageAsyncResult`1.End()
at Microsoft.WindowsAzure.Storage.Blob.CloudBlockBlob.EndPutBlock(IAsyncResult asyncResult)
at Microsoft.WindowsAzure.Storage.Core.Util.AsyncExtensions.<>c__DisplayClass4.<CreateCallbackVoid>b__3(IAsyncResult ar)
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<UploadBlobAsync>d__8.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.BlockBlobWriter.<DoWorkInternalAsync>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.SyncTransferController.<DoWorkInternalAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferControllers.TransferControllerBase.<DoWorkAsync>d__0.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__1.MoveNext()
--- End of inner exception stack trace ---
at Microsoft.WindowsAzure.Storage.DataMovement.TransferScheduler.<ExecuteJobInternalAsync>d__1.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.SingleObjectTransfer.<ExecuteAsync>d__2.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
at Microsoft.WindowsAzure.Storage.DataMovement.TransferManager.<DoTransfer>d__2.MoveNext()<---
, inner Exception HResult: -2146233088
[07/24/2018 23:11:07][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:11:07][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:11:07][16d5][35][LOGGING][DEBUG]Sending update status node Finished: 59383 / 482280, bytes 33450836921 / 572783582073, ScanDone=True
[07/24/2018 23:11:07][16d5][35][LOGGING][DEBUG]TaskStatus:INPROGRESS TotalScannedFiles:482280 TotalScannedFolders:36098 TotalScannedItems:518378 TotalScannedBadFiles:0 FilteredOutItemsInScan:0 ToBeMigrated:482280 CurrentPacked:3298 CurrentUploading(OnAir):6337
CurrentUploaded(OnAir):2888 CurrentSubmitted(OnAir):0 NumLastTimeSubmittedFiles:159CurrentFinished(OnAir):59726 ActuallMigrated(on air):59383 Finished:59726 ActuallMigrated:59383
[07/24/2018 23:11:09][16d5][27][LOGGING][DEBUG]Size of Query Package Dict:0
[07/24/2018 23:11:09][16d5][27][LOGGING][DEBUG]Size of Query Que Dict:0
[07/24/2018 23:11:09][16d5][198][LOGGING][INFORMATION]File blob already exists 586a1198-33b9-5dee-b49c-7c7e0c47d52e.dat - checking blob metadata |