Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
05/23/2023 12:40:16
System.Data.SqlClient.SqlException
A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
---> System.IO.IOException: Unable to read data from the transport connection: Connection reset by peer.
---> System.Net.Sockets.SocketException (104): Connection reset by peer
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Threading.Tasks.ValueTask`1.ValueTaskSourceAsTask.<>c.<.cctor>b__4_0(Objectstate)
at System.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__122_0(Task`1result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.ExecutionContext.RunInternal(ExecutionContextexecutionContext, ContextCallbackcallback, Objectstate)
--- End of stack trace from previous location ---
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task¤tTaskSlot, ThreadthreadPoolThread)
--- End of stack trace from previous location ---
at Dapper.SqlMapper.QueryAsync[T](IDbConnectioncnn, TypeeffectiveType, CommandDefinitioncommand) in /_/Dapper/SqlMapper.Async.cs:line 418
at NibssRemittanceServiceWeb.BackgroundOperations.Repositories.FirsPaymentRepository.GetOfflinePaymentDetails(StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Repositories/FirsPaymentRepository.cs:line 50
at NibssRemittanceServiceWeb.BackgroundOperations.DefaultTaxNotificationProcessor.Execute(Int32assessmentId, StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Operations/DefaultTaxNotificationProcessor.cs:line 41
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
05/23/2023 12:40:16
System.Data.SqlClient.SqlException
A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
---> System.IO.IOException: Unable to read data from the transport connection: Connection reset by peer.
---> System.Net.Sockets.SocketException (104): Connection reset by peer
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Threading.Tasks.ValueTask`1.ValueTaskSourceAsTask.<>c.<.cctor>b__4_0(Objectstate)
at System.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__122_0(Task`1result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.ExecutionContext.RunInternal(ExecutionContextexecutionContext, ContextCallbackcallback, Objectstate)
--- End of stack trace from previous location ---
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task¤tTaskSlot, ThreadthreadPoolThread)
--- End of stack trace from previous location ---
at Dapper.SqlMapper.QueryAsync[T](IDbConnectioncnn, TypeeffectiveType, CommandDefinitioncommand) in /_/Dapper/SqlMapper.Async.cs:line 418
at NibssRemittanceServiceWeb.BackgroundOperations.Repositories.FirsPaymentRepository.GetOfflinePaymentDetails(StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Repositories/FirsPaymentRepository.cs:line 50
at NibssRemittanceServiceWeb.BackgroundOperations.DefaultTaxNotificationProcessor.Execute(Int32assessmentId, StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Operations/DefaultTaxNotificationProcessor.cs:line 41
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
05/23/2023 12:40:16
System.Data.SqlClient.SqlException
A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
---> System.IO.IOException: Unable to read data from the transport connection: Connection reset by peer.
---> System.Net.Sockets.SocketException (104): Connection reset by peer
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Threading.Tasks.ValueTask`1.ValueTaskSourceAsTask.<>c.<.cctor>b__4_0(Objectstate)
at System.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__122_0(Task`1result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.ExecutionContext.RunInternal(ExecutionContextexecutionContext, ContextCallbackcallback, Objectstate)
--- End of stack trace from previous location ---
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task¤tTaskSlot, ThreadthreadPoolThread)
--- End of stack trace from previous location ---
at Dapper.SqlMapper.QueryAsync[T](IDbConnectioncnn, TypeeffectiveType, CommandDefinitioncommand) in /_/Dapper/SqlMapper.Async.cs:line 418
at NibssRemittanceServiceWeb.BackgroundOperations.Repositories.FirsPaymentRepository.GetOfflinePaymentDetails(StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Repositories/FirsPaymentRepository.cs:line 50
at NibssRemittanceServiceWeb.BackgroundOperations.DefaultTaxNotificationProcessor.Execute(Int32assessmentId, StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Operations/DefaultTaxNotificationProcessor.cs:line 41
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
05/23/2023 11:34:27
System.Data.SqlClient.SqlException
A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
---> System.IO.IOException: Unable to read data from the transport connection: Connection reset by peer.
---> System.Net.Sockets.SocketException (104): Connection reset by peer
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Threading.Tasks.ValueTask`1.ValueTaskSourceAsTask.<>c.<.cctor>b__4_0(Objectstate)
at System.Data.SqlClient.SqlConnection.OnError(SqlExceptionexception, BooleanbreakConnection, Action`1wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObjectstateObj, BooleancallerHasConnectionLock, BooleanasyncClose)
at System.Data.SqlClient.TdsParserStateObject.ThrowExceptionAndWarning(BooleancallerHasConnectionLock, BooleanasyncClose)
at System.Data.SqlClient.TdsParserStateObject.ReadAsyncCallbackCaptureException(TaskCompletionSource`1source)
An exception occurred during performance of the job. More details...
05/23/2023 07:22:55
System.Data.SqlClient.SqlException
Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
System.Data.SqlClient.SqlException (0x80131904): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
---> System.ComponentModel.Win32Exception (258): No error information
at System.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__122_0(Task`1result)
at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
at System.Threading.ExecutionContext.RunInternal(ExecutionContextexecutionContext, ContextCallbackcallback, Objectstate)
--- End of stack trace from previous location ---
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task¤tTaskSlot, ThreadthreadPoolThread)
--- End of stack trace from previous location ---
at Dapper.SqlMapper.QueryMultipleAsync(IDbConnectioncnn, CommandDefinitioncommand) in /_/Dapper/SqlMapper.Async.cs:line 1039
at NibssRemittanceServiceWeb.BackgroundOperations.Repositories.FirsPaymentRepository.GetAssessmentDetails(Int32assessmentId) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Repositories/FirsPaymentRepository.cs:line 41
at NibssRemittanceServiceWeb.BackgroundOperations.DefaultTaxNotificationProcessor.Execute(Int32assessmentId, StringpaymentRef) in /app/NibssRemittanceServiceWeb/BackgroundOperations/Operations/DefaultTaxNotificationProcessor.cs:line 31
at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Tasktask)
An exception occurred during performance of the job. More details...
01/25/2023 07:23:14
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
---> System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 35 - An internal exception was caught)
---> System.IO.IOException: Unable to read data from the transport connection: Connection reset by peer.
---> System.Net.Sockets.SocketException (104): Connection reset by peer
at System.Net.Sockets.NetworkStream.Read(Byte[]buffer, Int32offset, Int32count)
--- End of inner exception stack trace ---
at System.Net.Sockets.NetworkStream.Read(Byte[]buffer, Int32offset, Int32count)
at System.Data.SqlClient.SNI.SNITCPHandle.Receive(SNIPacket&packet, Int32timeoutInMilliseconds)
at System.Data.SqlClient.SqlConnection.OnError(SqlExceptionexception, BooleanbreakConnection, Action`1wrapCloseInAction)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObjectstateObj, BooleancallerHasConnectionLock, BooleanasyncClose)
at System.Data.SqlClient.TdsParserStateObject.ThrowExceptionAndWarning(BooleancallerHasConnectionLock, BooleanasyncClose)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObjectstateObj, UInt32error)
at System.Data.SqlClient.TdsParserStateObject.ReadSniSyncOverAsync()
at System.Data.SqlClient.TdsParserStateObject.TryReadNetworkPacket()
at System.Data.SqlClient.TdsParserStateObject.TryPrepareBuffer()
at System.Data.SqlClient.TdsParserStateObject.TryReadByte(Byte&value)
at System.Data.SqlClient.TdsParser.TryRun(RunBehaviorrunBehavior, SqlCommandcmdHandler, SqlDataReaderdataStream, BulkCopySimpleResultSetbulkCopyHandler, TdsParserStateObjectstateObj, Boolean&dataReady)
at System.Data.SqlClient.SqlDataReader.TryConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReaderds, RunBehaviorrunBehavior, StringresetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehaviorcmdBehavior, RunBehaviorrunBehavior, BooleanreturnStream, Booleanasync, Int32timeout, Task&task, BooleanasyncWrite, SqlDataReaderds)
at System.Data.SqlClient.SqlCommand.ExecuteScalar()
at Dapper.SqlMapper.ExecuteScalarImpl[T](IDbConnectioncnn, CommandDefinition&command)
at Hangfire.SqlServer.SqlServerConnection.<>c__DisplayClass11_0.<GetJobParameter>b__0(DbConnectionconnection)
at Hangfire.SqlServer.SqlServerStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.SqlServer.SqlServerConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname)
ClientConnectionId:7f416206-ce6d-48c5-8934-6aaa04124b37
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
Failed to change state to a 'Succeeded' one due to an exception after 10 retry attempts More details...
12/30/2022 12:07:56
System.Data.SqlClient.SqlException
A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: TCP Provider, error: 40 - Could not open a connection to SQL Server)
System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: TCP Provider, error: 40 - Could not open a connection to SQL Server)
at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnectionowningObject, UInt32waitForMultipleObjectsTimeout, BooleanallowCreate, BooleanonlyOneCheckConnection, DbConnectionOptionsuserOptions, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnectionowningObject, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnectionowningConnection, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions, DbConnectionInternaloldConnection, DbConnectionInternal&connection)
at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnectionouterConnection, DbConnectionFactoryconnectionFactory, TaskCompletionSource`1retry, DbConnectionOptionsuserOptions)
at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1retry)
at System.Data.SqlClient.SqlConnection.Open()
at Hangfire.SqlServer.SqlServerStorage.CreateAndOpenConnection()
at Hangfire.SqlServer.SqlServerConnection.AcquireLock(Stringresource, TimeSpantimeout)
at Hangfire.SqlServer.SqlServerConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.Storage.StorageConnectionExtensions.AcquireDistributedJobLock(IStorageConnectionconnection, StringjobId, TimeSpantimeout)
at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContextcontext)
at Hangfire.Server.Worker.TryChangeState(BackgroundProcessContextcontext, IStorageConnectionconnection, IFetchedJobfetchedJob, IStatestate, String[]expectedStates, CancellationTokeninitializeToken, CancellationTokenabortToken)