Guide: Have a Time Out instead of timeouts with OutSystems

Back to Forums

Miguel João

Staff

Guide: Have a Time Out instead of timeouts with OutSystems

Discussion

OS Certified

How-to

Permalink for updated KB article: www.outsystems.com/goto/timeouts-guide

Due to the web nature of the OutSystems platform, running over web application servers and databases, is implicit the existence of time limits to several interconnections.

Let's face it, how many of you never hit a timeout while developing, deploying or running an OutSystems application? In that regard, I think is time to talk about the several timeout events that can influence the proper development, deploying and runtime of OutSystems applications.

So, without further delay, let's meet the candidates. For the runtime level timeouts we have the SQL Query timeout, the application request timeout, the web service request timeout, the web server connection timeout, the session timeout and timer's timeout. While for deployment level timeouts we have the Service Studio Upload/Download timeout besides any runtime level timeouts that may also influence the deployment process.

Please note that usually, if you're having timeout events then either you have a very sluggish system, which can benefit from an upgrade or extended resources, or you have a very unoptimized logic, data models or slow integrations. Of course that depends on the application's purpose and dataset volumes, and the timeout settings should be adjusted accordingly.

SQL Query Timeout

Timeout Description

Being supported by a database backbone (either Microsoft SQL or Oracle) in nature, this is the most common timeout event that can occur in the OutSystems platform and their applications, specially low performance database servers or large data volume environments.

This SQL Query timeout defines the maximum amount of time that an SQL statement can take to be fully executed, and the resulting dataset be returned to the calling application. It influences OutSystems applications simple and advanced queries, as well as the entity actions

(Create, Update, Get, GetForUpdate and Deleted). It also influences the OutSystems platform system queries, scattered along the Service Center application and OutSystems Services. At the application level, it's possible to define this timeout value in Service Studio while in development

stage of an OML for simple or advanced queries., however, the entity actions and the OutSystems platform system queries do not have a timeout value definition that can be changed individually and follow a platform-wide default query timeout.

Timeout Symptoms

The symptoms detected when this timeout value is reached are usually a runtime error either in the applications or during deployment procedures, and a logged entry in Service Center. The log entry, for the most part looks very much like:

Message :Error in advanced query GetConsumers in Espace (SELECT ... ): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
Stack: at ssServiceCenter.Actions.QueryEspace_UpdateCacheGetConsumers(HeContext heContext, Int32 maxRecords, String qpkey)
at ssServiceCenter.Actions.UserActionEspace_UpdateCache(HeContext heContext, Int32 inParameSpaceId, Boolean inParamSkipConsumers, Boolean inParamOnlyConsumers)
at ssServiceCenter.Actions.UserActionEspace_PrepareDeploy(HeContext heContext, Int32 inParamUserId, Int32 inParameSpaceId, Int32 inParamVersionId, Boolean inParamDebug, Boolean inParamExcludePTA, Boolean inParamExcludeCacheUpdate, RLReferenceRecordList inParamDeployPack, RLHEMessageRecordList& outParamErrors)
at ssServiceCenter.Actions.UserActionEspace_Publish(HeContext heContext, Int32 inParamUserId, Int32 inParamVersionId, Boolean inParamForceDebug, Boolean inParamExcludePTA, Boolean inParamExcludeCacheUpdate, RLReferenceRecordList inParamPublishPack, RLHEMessageRecordList& outParamMessages, Int32& outParamErrorCount)
at ssServiceCenter.Actions.WebSrvcServiceStudioPublish(HeContext heContext, String inParamusername, String inParampassword, Int32 inParamversionid, RLHEMessageRecordList& outParammessages)
at ssServiceCenter.WebServices.ServiceStudio.Publish(String username, String password, Int32 versionid, WORCHEMessageRecord[]& messages)

In this case there's a explicit reference to a timeout and from the error stack we can assert that is occurring in a SQL query, in this example, the Advanced Query QueryEspace_UpdateCacheGetConsumers. However, this is not always the case. Sometimes the timeout error appears masked under a different error, usually a very nasty runtime error, like the one below:

Error in advanced query DeleteTestResults in DeleteInstanceFromDatabase ( DELETE ... ): Object reference not set to an instance of an object.
at ssreg_dashboard.Flows.FlowAdministrationFlow.ScrnManageInstances.CommandDelete(HeContext heContext, Int32 inParamInstanceId)
at ssreg_dashboard.Flows.FlowAdministrationFlow.ScrnManageInstances.wt_Submitwidget491643_Click(Object sender, EventArgs e)
Exception has been thrown by the target of an invocation.
at System.Reflection.RuntimeMethodInfo.InternalInvoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean isBinderDefault, Assembly caller, Boolean verifyAccess)
at System.Reflection.RuntimeMethodInfo.InternalInvoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean verifyAccess)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
at ssreg_dashboard.Flows.FlowAdministrationFlow.ScrnManageInstances.recTableTableRecords1_Select(Object sender, DataGridCommandEventArgs e)
at System.Web.UI.WebControls.DataGrid.OnItemCommand(DataGridCommandEventArgs e)
at System.Web.UI.WebControls.DataGrid.OnBubbleEvent(Object source, EventArgs e)
at System.Web.UI.Control.RaiseBubbleEvent(Object source, EventArgs args)
at System.Web.UI.WebControls.DataGridItem.OnBubbleEvent(Object source, EventArgs e)
at System.Web.UI.Control.RaiseBubbleEvent(Object source, EventArgs args)
at System.Web.UI.WebControls.Button.OnCommand(CommandEventArgs e)
at System.Web.UI.WebControls.Button.System.Web.UI.IPostBackEventHandler.RaisePostBackEvent(String eventArgument)
at System.Web.UI.Page.RaisePostBackEvent(IPostBackEventHandler sourceControl, String eventArgument)
at System.Web.UI.Page.RaisePostBackEvent(NameValueCollection postData)
at System.Web.UI.Page.ProcessRequestMain()

In this case we appear to have a serious crash, which we immediately react with horror and fear when we find our selves in the presence of the infamous Object reference not set to an instance of an object error. But fear not, because this is in fact just a consequence of a timeout event that just exceeded the limit. Although this scenario is not as common as the previous one, it can occur when an SQL reader closes due to the timeout event, associated with some "bad" timing when it happens to be still under access, generating this null reference exception.

Timeout Setting

For the application simple and advanced queries, is possible to specify a timeout value in seconds, during eSpace editing (development phase). When these queries do not have a timeout value specified, they take into account the platform wide default query timeout instead. Additionally, any system query from Service Center or OutSystems Services, also takes this default value as the timeout. This default query timeout can be specified on the OutSystems Hub Server Configuration Tool on the database tab, and by default is defined with 30 seconds. Note that changing this value will influence the timeout value for all non-application queries. To run the tool you can execute the ServerSetup.exe application located in the Hub Server installation directory (or Service Center for the 4.1 versions). Always remember to exit the tool with the Ok button to commit your changes

I'll be adding the remaining timeout events in this topic over the next few days, so keep "posted".

Cheers

Miguel João

15 Jun 2007

Miguel João

Staff

Hi

As promised, here I am to talk about some more timeout events that can cause runtime errors or general mis-behaviors, following up the previous thread. Our next in line is a good one!

Application Request Timeout

Timeout Description

Every web request done to an OutSystems application takes its time to process by the application server (either ASP.NET over IIS or JBoss) an is ruled by a Request Timeout that prevents the existence of everlasting web requests. So basically, when a web request is taking to long to process and reaches the a defined request timeout, the thread that's running it will be interrupted, generating a runtime error and avoiding waste of resources.

Timeout Symptoms

As expected, a very application-not-working-anymore runtime error will occur and logged in Service Center under the Error Logs page. Since this error depends on the amount of time the request is being processed, it can occur is practically anywhere in the application request: on the page_load, on page_render, in SQL queries, in extension or eSpace methods, etc. However, the error message is always very particular. In the ASP.NET version case, the message Thread was being aborted is the dead give away of this timeout event. For example, the following error stack is cause by a web request timeout event that occurred right when a SQL query was being executed:

Module_Name:
Message :[1] Error in advanced query GetOldProducers in Espace_UpdateCache_OldProducersRefs (SELECT ... ): Thread was being aborted.
Stack: at ssServiceCenter.Flows.FlowOperations_eSpace.ScrneSpace_Publish_Logic_Go.Preparation(HeContext heContext)
at ssServiceCenter.Flows.FlowOperations_eSpace.ScrneSpace_Publish_Logic_Go.Page_Load(Object sender, EventArgs e)
at System.Web.UI.Control.OnLoad(EventArgs e)
at System.Web.UI.Control.LoadRecursive()
at System.Web.UI.Page.ProcessRequestMain()

Below is another example when the timeout event occurs during a extension method invocation, also for the ASP.NET version of the OutSystems platform.

Module Name: Web service met
Message: Thread was being aborted.
Stack: at OutSystems.NssOMLProcessor.CssOMLProcessor.MssCompileeSpaceAsync(Boolean ssDebug, Byte[] ssOML, String ssServerKind, RLHEMessageRecordList& ssMessages, Int32& ssErrorCount, String& ssErrorText, String ssEspaceName, Int32 ssEspaceVersionId)
at ssServiceCenter.RssExtensionOMLProcessor.MssCompileeSpaceAsync(HeContext heContext, Boolean ssDebug, Byte[] ssOML, String ssServerKind, RLHEMessageRecordList& ssMessages, Int32& ssErrorCount, String& ssErrorText, String ssEspaceName, Int32 ssEspaceVersionId)
at ssServiceCenter.Actions.ssCompileFlow3004763(HeContext heContext, String ssusername, String sspassword, Int32 ssversionid, RLHEMessageRecordList& ssmessages)
at ssServiceCenter.WebServices.ServiceStudio.Compile(String username, String password, Int32 versionid, WORCHEMessageRecord[]& messages)

As you can see, the error message is the dead give away ...

Timeout Setting

In the ASP.NET version of the OutSystems platform, this timeout event value is defined in the machine.config file under the httpRuntime section, with the parameter executionTimeout. By default, in ASP,NET Framework 1.1 this value is 90 seconds, while in .NET Framework 2.0 and 3.0 is 110 seconds. Here's a sample of the setting definition for 90 seconds:

<httpRuntime executionTimeout="90" />

That's all for today. More will came in a few days.

Cheers

Miguel João

20 Jun 2007

3 replies

Last reply 04 Apr 2014

Show thread

Hide thread

Miguel João

Staff

Hi again

It's been a while since my last post in this topic, but this was not forgotten. Hence, I'm describing the remaining timeout events, and how you can avoid them. So, our next one is an easy one!

Web Service Request Timeout

Timeout Description

The web services is a very common way of integrating with different applications and external systems. The applications can invoke methods remotely through web services. These invocations are merely XML information being transfer to and back from a web server through standard web requests/responses. Apart from the inherited web requests timeout events, the web service it self will also have a invocation timeout event. This timeout event defines the total elapsed amount of time since the web service invocation until the complete reception of it's response.

Timeout Symptoms

The typical symptoms when this timeout event occurs are quite straight forward. In an OutSystems application, when calling a Web Service action, if the web service takes too long, it may generate the following timeout error.

Module_Name: Web service met
Message: The operation has timed-out.
Stack: at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request)
at System.Web.Services.Protocols.HttpWebClientProtocol.GetWebResponse(WebRequest request)
at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
at sswstimeout_om_.WebClient313.WebService1.VeryLongMethod()

In this case, the WebClientProtocol method is the key to identify this timeout event has the web service invocation timeout.

Timeout Setting

When developing your eSpace with Service Studio, upon adding your Web Reference to the eSpace, for each method/action you can define the Timeout In Seconds property, that specifies the maximum time value in seconds that the web service method invocation can take, prior to issue a timeout event. If there is no value specified in this property, the Web Reference method timeout is 100 seconds.

I'll be continuing with the following timeout events soon. Keep posted!

Cheers

Miguel João

01 Aug 2007

Miguel João

Staff

Hi All

Following up on the last timeout event, the next one is also an application level timeout event: the timer timeout

Timers Timeout

Timeout Description

Timers are OutSystems applications' synchronous jobs that execute a specified application logic on scheduled instants, invoked by the OutSystems Scheduler Service. The timer's timeout event occurs when the elapsed time since the timer's invocation and its completion surpasses the specified value.

Timeout Symptoms

When a timer reaches its timeout settings, an error log will be registered in the Error Logs page of Service Center with an error message and error stack similar to:
Module Name: Scheduler Service:

Error Message: Error executing request https://127.0.0.1/TesteSpace/timerhandler.asmx for Timer Send_Messages. Request duration = 1439 secs. [Marked as 'not running'. Computed next run.]

Stack: System.Net.WebException: The operation has timed-out.
at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request)
at System.Web.Services.Protocols.HttpWebClientProtocol.GetWebResponse(WebRequest request)
at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName Object[] parameters)
at OutSystems.HubEdition.RuntimePlatform.TimerHandler.ExecuteTimer(String ssKey Int32 timeout)
at OutSystems.HubEdition.Scheduler.Scheduler.ExecuteJob(JobData job)

Since it's the OutSystems Scheduler Service that invokes the timer of the application to run, it will also catch the error exception associated with the timeout event occurrence, which will abort the timer's execution. In this case, the timer execution took 1439 seconds, before being aborted.

Timeout Setting

When developing your eSpace with Service Studio, and creating the timer objects, for each one of them its possible to specify the Timeout in Minutes property. This value is the maximum elapsed period of time that the OutSystems platform has to completely execute the action associated with the timer. Fro more information on how timer are handled by the OutSystems Platform please check the Service Studio help topic How Timers are Handled.

That's all for today.

Cheers

Miguel João

01 Aug 2007

Pedro Menezes

I have the "Thread was being aborted" timeout error symptoms in my .Net server.

I have an Outsystems application running on a .Net server that timesout,

The application function is simply this: receives a very big file (zip), unzips that file, and then reads it for processing.

I already check all the files (machine config and web config) and increased the timeouts by 20 minutes (just to be sure)!! But the applications timesout if the processing lasts longer than 3:20 minutes.

Also increased the Tag for the max file size in the machine configs without resolving the problem.

Any other sugestions?

Thank you help would be very appreciated :=). The server can't have these problems.

04 Apr 2014

Paulo Garrudo

Staff

Hi Pedro,

You are trying to execute all 3 step synchronously? Because you always know that is going to take several minutes, you should go with an asynchronous process using a Timer.

Upload zip file into the server;
Store it into the database;
Wakeup our new timer to process this file;
Give feedback to the user during the timer execution based on the database information;

Regards,
Paulo Garrudo

16 May 2014

AcacioPN

Staff

Hi everyone

I would like to drop another timeout example that we ran accross in Support recently: timeout sending emails.

Email sending timeout

Description

Email sending is done in two steps:

In the first step, the email is rendered and added to a queue. Rendering involves a special web request to a specific endpoint that renders the "web page" with the email content. This content is then stored to the database. This request is made synchronously in the logic that sends the email.
E.g. if you send an email with the click of a button in a page, the email is rendered and queued before the page returns.
In the second step, Scheduler service picks emails from the queue and sends them to the server using the SMTP configurations in the server.

The email sending timeout I am referring to is the one that happens in step 1. Meaning: the rendering of the email takes too long.

Symptoms

When such a timeout occurs, you get an error similar to:

Error creating Email. The operation has timed out

at System.Net.HttpWebRequest.GetResponse()

at OutSystems.HubEdition.RuntimePlatform.Email.EmailHelper.HttpGetContent(String ssUrl, String method, String contentType, String userAgent, Cookie cookie, QueryParameter[] parameters, String& ssContent, String& ssContentEncoding)

at OutSystems.HubEdition.RuntimePlatform.Email.EmailHelper.HttpPost(String ssUrl, QueryParameter[] parameters, String userAgent, Cookie cookie, String& ssContent, String& ssContentEncoding)

at OutSystems.HubEdition.RuntimePlatform.Email.EmailProcessor.SendEmailRequest(String url, String from, String to, String cc, String bcc, Int32 activityId, Int32 tenantId, Boolean storeContent, EmailType type) On

at ssUserManagement.Flows.FlowMain.ScrnListUsers.CommandResetPassword(HeContext heContext)

Cause and resolution

Like I indicated earlier, the email being sent is taking too long to render. To solve this problem, you need to reduce the time it takes to render the email.

Note that there is no use in resorting to HTTPRequestHander.SetRequestTimeout to try to extend the duration of email processing: the timeout is not related to the length of the request to render the email; instead, the limit is in the method that calls the email (OutSystems.HubEdition.RuntimePlatform.Email.EmailHelper.HttpGetContent) is limited in time to ensure best practices.

To put it simply: it's the caller that is not waiting long enough for the request to be ready.

Hope this helps!

Cheers,
Acácio

05 Aug 2015

Community GuidelinesBe kind and respectful, give credit to the original source of content, and search for duplicates before posting.

See the full guidelines