New strange error: Url: /controller/api/v1/paymentMethod/ Content received: {"message":"An error has occurred.","exceptionMessage":"The 'CompressedContent' type failed to serialize the response body for content type 'application/json; charset=utf-8'.","exceptionType":"System.InvalidOperationException","stackTrace":null,"innerException":{"message":"An error has occurred.","exceptionMessage":"Timeout performing EVAL (5000ms), next: EVAL, inst: 2, qu: 0, qs: 7, aw: False, rs: ReadAsync, ws: Idle, in: 0, serverEndpoint: 10.10.6.4:15005, mc: 1/1/0, mgr: 8 of 10 available, clientName: erp096701000036, PerfCounterHelperkeyHashSlot: 15367, IOCP: (Busy=0,Free=1000,Min=8,Max=1000), WORKER: (Busy=32,Free=32735,Min=8,Max=32767), v: 2.1.58.34321 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts)","exceptionType":"StackExchange.Redis.RedisTimeoutException","stackTrace":" at StackExchange.Redis.ConnectionMultiplexer.ExecuteSyncImpl[T](Message message, ResultProcessor`1 processor, ServerEndPoint server) in /_/src/StackExchange.Redis/ConnectionMultiplexer.cs:line 2807\r\n at StackExchange.Redis.RedisBase.ExecuteSync[T](Message message, ResultProcessor`1 processor, ServerEndPoint server) in /_/src/StackExchange.Redis/RedisBase.cs:line 54\r\n at StackExchange.Redis.RedisDatabase.ScriptEvaluate(String script, RedisKey[] keys, RedisValue[] values, CommandFlags flags) in /_/src/StackExchange.Redis/RedisDatabase.cs:line 1153\r\n at Microsoft.Web.Redis.StackExchangeClientConnection.<>c__DisplayClass11_0.b__0()\r\n at Microsoft.Web.Redis.StackExchangeClientConnection.RetryForScriptNotFound(Func`1 redisOperation)\r\n at Microsoft.Web.Redis.StackExchangeClientConnection.RetryLogic(Func`1 redisOperation)\r\n at Microsoft.Web.Redis.StackExchangeClientConnection.Eval(String script, String[] keyArgs, Object[] valueArgs)\r\n at Microsoft.Web.Redis.RedisConnectionWrapper.TryCheckWriteLockAndGetData(Object& lockId, ISessionStateItemCollection& data, Int32& sessionTimeout)\r\n at Microsoft.Web.Redis.RedisSessionStateProvider.GetItemFromSessionStore(Boolean isWriteLockRequired, HttpContext context, String id, Boolean& locked, TimeSpan& lockAge, Object& lockId, SessionStateActions& actions)\r\n at Microsoft.Web.Redis.RedisSessionStateProvider.GetItem(HttpContext context, String id, Boolean& locked, TimeSpan& lockAge, Object& lockId, SessionStateActions& actions)\r\n at PX.Data.PXSessionStateStore.ProviderGetItem(HttpContext context, String id, Boolean& locked, TimeSpan& lockAge, Object& lockId, SessionStateActions& actionFlags)\r\n at PX.Data.PXSessionStateStore.LoadSessionItem(HttpContext context, String id, Boolean isReadonly, Object& lockId, Boolean& isNew)\r\n at PX.Data.PXSessionStateStore.WriteToSession(String id, Boolean isReadonly, Action`1 processMethod)\r\n at PX.Data.PXSessionStateStore.ProcessWithSessionContext(String id, Boolean isReadonly, Action`1 processMethod)\r\n at PX.Data.PXLongOperation.PXTaskPool.ReadSession(Object key, Boolean& abort)\r\n at PX.Data.PXLongOperation.PXTaskPool.TryGetValue(Object key, PXAsyncResult& result)\r\n at PX.Data.PXLongOperation.ClearStatus(Object key, Boolean abort)\r\n at PX.Data.PXLongOperation.ClearStatus(Object key)\r\n at PX.Data.PXGraph.Clear(PXClearOption option)\r\n at Visma.net.ERP.Api.Base.BaseRepository.d__4.MoveNext() in D:\\Data\\BuildAgent\\work\\11023e52ea15d342\\Web\\Lib\\Visma.net.ERP.Api\\Base\\BaseRepository.cs:line 77\r\n at Visma.net.ERP.Api.CA.Repository.PaymentMethodRepository.d__12.MoveNext() in D:\\Data\\BuildAgent\\work\\11023e52ea15d342\\Web\\Lib\\Visma.net.ERP.Api\\CA\\Repository\\PaymentMethodRepository.cs:line 129\r\n at Visma.net.ERP.Web.Api.Mapping.PaymentMethodMappingExtension.d__1.MoveNext() in D:\\Data\\BuildAgent\\work\\11023e52ea15d342\\Web\\Lib\\Visma.net.ERP.Web.Api\\Mapping\\PaymentMethodMappingExtension.cs:line 31\r\n at System.Linq.Buffer`1..ctor(IEnumerable`1 source)\r\n at System.Linq.Enumerable.ToArray[TSource](IEnumerable`1 source)\r\n at Visma.net.ERP.Web.Api.Mapping.PaymentMethodMappingExtension.ToDtoPaymentMethod(IPaymentMethodVo paymentMethodVo) in D:\\Data\\BuildAgent\\work\\11023e52ea15d342\\Web\\Lib\\Visma.net.ERP.Web.Api\\Mapping\\PaymentMethodMappingExtension.cs:line 16\r\n at System.Linq.Enumerable.WhereSelectEnumerableIterator`2.MoveNext()\r\n at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeList(JsonWriter writer, IEnumerable values, JsonArrayContract contract, JsonProperty member, JsonContainerContract collectionContract, JsonProperty containerProperty)\r\n at Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter jsonWriter, Object value, Type objectType)\r\n at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, Object value, Type objectType)\r\n at System.Net.Http.Formatting.BaseJsonMediaTypeFormatter.WriteToStream(Type type, Object value, Stream writeStream, Encoding effectiveEncoding)\r\n at System.Net.Http.Formatting.JsonMediaTypeFormatter.WriteToStream(Type type, Object value, Stream writeStream, Encoding effectiveEncoding)\r\n at System.Net.Http.Formatting.BaseJsonMediaTypeFormatter.WriteToStreamAsync(Type type, Object value, Stream writeStream, HttpContent content, TransportContext transportContext, CancellationToken cancellationToken)\r\n--- End of stack trace from previous location where exception was thrown ---\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n at PX.Api.Compression.BaseCompressor.d__4.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n at PX.Api.Compression.CompressedContent.d__4.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown ---\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)\r\n at System.Web.Http.WebHost.HttpControllerHandler.d__22.MoveNext()"}} ... View more

And also some 5520 Url: /controller/api/v1/carrier/ Content received: {"ExceptionType":"IPPException","ExceptionMessage":"","ExceptionFaultCode":"5520","ExceptionMessageID":"5520_ee4a2531-eeb8-4d09-96ab-43322a86647b","ExceptionDetails":""} ... View more

Worked great for a long time, but got a bunch of 504 now ... View more

Looks much better now! ... View more

Now 502 pops up again ... View more

Yes, working again now. Was down for almost 20 minutes ... but it is really slow sometimes. Response time from less than a second to 15 ... ... View more

Totally unavailable now, and has been like that for the last 10 minutes: 503 Service Temporarily Unavailable ... View more

And now at 07:37  502 Bad Gateway ... View more

About 300 new 5520-errors logged for me the last 12 hours. Looks like it occurs in periods. Quite a few between 06:40 and 06:50. Then again around 04:00.  Different clients and endpoints ... View more

Its a lot better, but there are still quite a few 5520-errors. These are the last three that i have logged 18:13: Completed: /controller/api/v1/Inventory?availabilityLastModifiedDateTimeCondition=%3E&availabilityLastModifiedDateTime=2023-10-23 18:02:18&pageNumber=1 {"ExceptionType":"IPPException","ExceptionMessage":"","ExceptionFaultCode":"5520","ExceptionMessageID":"5520_45f4518c-0a8f-453b-9392-9a94fe84de41","ExceptionDetails":""}   18:09: Completed: /controller/api/v1/Inventory?availabilityLastModifiedDateTimeCondition=%3E&availabilityLastModifiedDateTime=2023-10-23 18:03:25&pageNumber=2 {"ExceptionType":"IPPException","ExceptionMessage":"","ExceptionFaultCode":"5520","ExceptionMessageID":"5520_c9ed6b64-c339-4e30-8f97-2241534c9675","ExceptionDetails":""}   18:07: Completed: /controller/api/v1/carrier/ {"ExceptionType":"IPPException","ExceptionMessage":"","ExceptionFaultCode":"5520","ExceptionMessageID":"5520_93028f4b-ae94-460c-b38c-1b6045af90aa","ExceptionDetails":""} I can see that the status has changed to Operational, but that is a bit premature ... View more

Its not all the requests, but maybe about 50% of the requests. All kind of endpoints, like: PurchaseOrder Inventory SalesOrder Shipment Carrier PaymentMethod and so on. The response times varies a bit as well. Does not matter if there is an error or successful response back, but it can be from 0,5 seconds to 30 seconds ... View more

At excactly 04:00 we received the last error. 12 hours and 30 minutes with errors - and no update at status.visma.com. This is not good at all. ... View more

Still an issue. 6 hours. No feedback, no fix ... ... View more

Same again today: {"message":"Connection to cache service failed"} ... View more

Document Type  should be any of these values: Invoice, DebitNote, CreditNote, Payment, VoidPayment, Prepayment, Refund, FinCharge, SmallBalanceWo, SmallCreditWo, CashSale, CashReturn, Undefined, NoUpdate   ... View more

And what will happen to the newly generated tokens when/if the old tokens start working again ...? ... View more

Works againg if generating new token, but this is not an acceptable solution.  The need to generate about 100 new tokens - with all communication with customers and so on is not the way to go. We need to know when this will be fixed. ... View more

A lot (all?) clients get this error message consistent right now   { "ExceptionType": "IPPException", "ExceptionMessage": "Exception while trying to validate user context in ODP based on token.", "ExceptionFaultCode": "12020", "ExceptionMessageID": "12020_677cbe00-b346-48ec-a26e-d0b4300b4786", "ExceptionDetails": "" }   < HTTP/1.1 401 Unauthorized < Date: Wed, 01 Jun 2022 05:09:18 GMT < Server: Nginx < Strict-Transport-Security: max-age=31536000; includeSubDomains < Content-Type: application/json < ipp-request-id: dbfe87ed-f34e-4ac1-aaa5-4408c684e6ee < Transfer-Encoding: chunked   ... View more

Hi   The error came from clients with no WEBVARE attribute. The API also started to show Errors if we asked for a value type other than the one specified on the attribute, like 1 instead of B2C.   Got in contact with you through other channels and validation of the attributes parameter was a new feature toggle for the whole API that has now been switched off.   Working again now. ... View more

This  have started to occur on another client as well now (2195430). Its not working now, i did not work yesterday afternoon either.   I noticed it monday as well. It seems like it stops working and then starts again at about the same time each day, at least it did that on monday and tuesday. ... View more

Hi   Yes, only for the metioned company and I have only seen the error occur for inventory ... View more

Hi   This is stilll an issue. Sometimes the results are retunred as they should, other times, like now there is returned 0 bytes (ipp-request-id: 31d3cfe6-8bf3-4de1-990e-10d3cf4b4fce).   All request, both failing and working, is to VnfInstanceId: ERP_NO_REAL_0031     ... View more

It looks like the error occurs only for one ipp-companyid (3464226). Other clients do return a result. One other thing. Using only pageNumber (and not pageSize) returns all records. I think there have been a default pageSize for this endpoint earlier? ... View more

Nope, back to returning an empty response   One of the failed requests: ipp-request-id: 919f12d9-227a-4192-892b-98f9cbf34c14 ipp-company-id: 3464226 ... View more

Its working againg now. ... View more

No.  It  started working again at about 12:45 ... View more

Has started working again now - but a downtime of about 40 minutes, on cyber monday, is not good. ... View more