Paradata export error

Survey Management
, ,
#1

SS Team,

I wanted some feedback related to an error exporting paradata of a questionnaire.
This is a screenshot of the error:

image

Checking the logs of the server this is some of the detail it’s been provided related to that particular export.

2022-12-01 09:34:36.962 -03:00 [INF] Start job execution …
2022-12-01 09:34:37.204 -03:00 [INF] Database refresh done. Took 0:00:00.0126132
2022-12-01 09:34:37.275 -03:00 [INF] Start paradata export for … AllStatus -
2022-12-01 10:13:37.333 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:02” before next retry. Retry attempt 1
2022-12-01 10:13:37.333 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:02” before next retry. Retry attempt 1
2022-12-01 10:13:40.201 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:04” before next retry. Retry attempt 2
2022-12-01 10:13:40.316 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:04” before next retry. Retry attempt 2
2022-12-01 10:13:45.163 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:08” before next retry. Retry attempt 3
2022-12-01 10:13:45.357 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:08” before next retry. Retry attempt 3
2022-12-01 10:13:54.115 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:16” before next retry. Retry attempt 4
2022-12-01 10:13:54.226 -03:00 [WRN] Request failed with “InternalServerError”. Waiting “00:00:16” before next retry. Retry attempt 4
2022-12-01 10:14:14.076 -03:00 [FTL] Export job failed
System.AggregateException: One or more errors occurred. (One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)) (One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).))
—> System.AggregateException: One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)
—> Refit.ApiException: Response status code does not indicate success: 500 (Internal Server Error).
at Refit.RequestBuilderImplementation.<>c__DisplayClass14_02.<<BuildCancellableTaskFuncForMethod>b__0>d.MoveNext() in /_/Refit/RequestBuilderImplementation.cs:line 313 --- End of stack trace from previous location --- at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_0.<<ExportDataAsync>g__QueryParadata|0>d.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_1.<ExportDataAsync>b__1(IEnumerable1 exports)
at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion) --- End of stack trace from previous location --- at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica1.ExecuteAction(Boolean& yieldedBeforeCompletion) at System.Threading.Tasks.TaskReplicator.Replica.Execute() --- End of inner exception stack trace --- at System.Threading.Tasks.TaskReplicator.Run[TState](ReplicatableUserAction1 action, ParallelOptions options, Boolean stopOnFirstFailure)
at System.Threading.Tasks.Parallel.PartitionerForEachWorker[TSource,TLocal](Partitioner1 source, ParallelOptions parallelOptions, Action1 simpleBody, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
— End of stack trace from previous location —
at System.Threading.Tasks.Parallel.ThrowSingleCancellationExceptionOrOtherException(ICollection exceptions, CancellationToken cancelToken, Exception otherException)
at System.Threading.Tasks.Parallel.PartitionerForEachWorker[TSource,TLocal](Partitioner1 source, ParallelOptions parallelOptions, Action1 simpleBody, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
at System.Threading.Tasks.Parallel.ForEachWorker[TSource,TLocal](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
at System.Threading.Tasks.Parallel.ForEach[TSource](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body)
at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.ExportDataAsync(ExportState state, CancellationToken cancellationToken)
at WB.Services.Export.ExportProcessHandlers.Implementation.ExportProcessHandler.ExportDataAsync(DataExportProcessArgs process, CancellationToken cancellationToken)
at WB.Services.Export.Jobs.ExportJob.ExecuteAsync(DataExportProcessArgs pendingExportProcess, CancellationToken cancellationToken)
—> (Inner Exception #1) System.AggregateException: One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)
—> Refit.ApiException: Response status code does not indicate success: 500 (Internal Server Error).
at Refit.RequestBuilderImplementation.<>c__DisplayClass14_02.<<BuildCancellableTaskFuncForMethod>b__0>d.MoveNext() in /_/Refit/RequestBuilderImplementation.cs:line 313 --- End of stack trace from previous location --- at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_0.<<ExportDataAsync>g__QueryParadata|0>d.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_1.<ExportDataAsync>b__1(IEnumerable1 exports)
at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion) --- End of stack trace from previous location --- at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica`1.ExecuteAction(Boolean& yieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica.Execute()<—

2022-12-01 10:14:14.190 -03:00 [ERR] Error during job run …
System.AggregateException: One or more errors occurred. (One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)) (One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).))
—> System.AggregateException: One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)
—> Refit.ApiException: Response status code does not indicate success: 500 (Internal Server Error).
at Refit.RequestBuilderImplementation.<>c__DisplayClass14_02.<<BuildCancellableTaskFuncForMethod>b__0>d.MoveNext() in /_/Refit/RequestBuilderImplementation.cs:line 313 --- End of stack trace from previous location --- at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_0.<<ExportDataAsync>g__QueryParadata|0>d.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_1.<ExportDataAsync>b__1(IEnumerable1 exports)
at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion) --- End of stack trace from previous location --- at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica1.ExecuteAction(Boolean& yieldedBeforeCompletion) at System.Threading.Tasks.TaskReplicator.Replica.Execute() --- End of inner exception stack trace --- at System.Threading.Tasks.TaskReplicator.Run[TState](ReplicatableUserAction1 action, ParallelOptions options, Boolean stopOnFirstFailure)
at System.Threading.Tasks.Parallel.PartitionerForEachWorker[TSource,TLocal](Partitioner1 source, ParallelOptions parallelOptions, Action1 simpleBody, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
— End of stack trace from previous location —
at System.Threading.Tasks.Parallel.ThrowSingleCancellationExceptionOrOtherException(ICollection exceptions, CancellationToken cancelToken, Exception otherException)
at System.Threading.Tasks.Parallel.PartitionerForEachWorker[TSource,TLocal](Partitioner1 source, ParallelOptions parallelOptions, Action1 simpleBody, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
at System.Threading.Tasks.Parallel.ForEachWorker[TSource,TLocal](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body, Action2 bodyWithState, Action3 bodyWithStateAndIndex, Func4 bodyWithStateAndLocal, Func5 bodyWithEverything, Func1 localInit, Action1 localFinally)
at System.Threading.Tasks.Parallel.ForEach[TSource](IEnumerable1 source, ParallelOptions parallelOptions, Action1 body)
at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.ExportDataAsync(ExportState state, CancellationToken cancellationToken)
at WB.Services.Export.ExportProcessHandlers.Implementation.ExportProcessHandler.ExportDataAsync(DataExportProcessArgs process, CancellationToken cancellationToken)
at WB.Services.Export.Jobs.ExportJob.ExecuteAsync(DataExportProcessArgs pendingExportProcess, CancellationToken cancellationToken)
at WB.Services.Scheduler.Services.Implementation.JobExecutor.ExecuteAsync(JobItem job, CancellationToken token)
at WB.Services.Scheduler.Services.Implementation.JobExecutor.ExecuteAsync(JobItem job, CancellationToken token)
—> (Inner Exception #1) System.AggregateException: One or more errors occurred. (Response status code does not indicate success: 500 (Internal Server Error).)
—> Refit.ApiException: Response status code does not indicate success: 500 (Internal Server Error).
at Refit.RequestBuilderImplementation.<>c__DisplayClass14_02.<<BuildCancellableTaskFuncForMethod>b__0>d.MoveNext() in /_/Refit/RequestBuilderImplementation.cs:line 313 --- End of stack trace from previous location --- at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_0.<<ExportDataAsync>g__QueryParadata|0>d.MoveNext() --- End of inner exception stack trace --- at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions) at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken) at WB.Services.Export.ExportProcessHandlers.Implementation.Handlers.TabularFormatParaDataExportProcessHandler.<>c__DisplayClass9_1.<ExportDataAsync>b__1(IEnumerable1 exports)
at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.<PartitionerForEachWorker>b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion) --- End of stack trace from previous location --- at System.Threading.Tasks.Parallel.<>c__DisplayClass44_02.b__1(IEnumerator& partitionState, Int32 timeout, Boolean& replicationDelegateYieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica`1.ExecuteAction(Boolean& yieldedBeforeCompletion)
at System.Threading.Tasks.TaskReplicator.Replica.Execute()<—

Considering there’s already some jobs that can execute export of tabular data and I’ve managed to get paradata on other questionnaires on the same server and workspace, Is there some clue of why this happened on this particular export?

Thanks in advance.

#2

Do you have anything in the second log from main app?
What version of Survey Solutions do you have?

#3

Vitalli,

We’re using 22.06.7 (build 32810) version. The details specified before are from a file called export-service.20221201.log. I just checked another file called headquarters.20221201.log and that file gave me the answer I needed. Around the same time the attempts start to fail, it specifies:

2022-12-01 10:13:36.530 -03:00 [ERR] HTTP GET … responded 500 in 1418.2543 ms
System.IO.IOException: There is not enough space on the disk. : ‘C:\Windows\TEMP\ASPNETCORE_…tmp’

Thank you Vitalii.

#4