How-To: Database Usage Control in Personal Environments

How-To: Database Usage Control in Personal Environments

  
Hello all

This post is a walkthrough guide on how to keep your cloud environment database usage under control and within the size limits that we’ve put in place to properly manage the overall experience of our cloud.


OutSystems Platform uses a shared database to store both system and application data.

  • System data is comprised of all the application’s definition metadata, including the data model definitions, module configurations, system and application logs, module versions, and much more, which usually grows with continuous application development and deployment.

  • Application data is the data your applications generate and manipulate, which usually grows with application usage.


All this data occupies database storage and can consume quite a bit in large development environments or highly used systems.


How to check the database usage in my personal environment


With Platform 9 Amsterdam, we’ve included more database usage information in our free public cloud. You can now verify your global database usage levels and identify how much is being used as system and as application data.



You can view your global database usage by accessing the Environments tab (https://<yourpersonalenvironmentname>.outsystemscloud.com) as shown below.



If you access the View details link in the Database section, you’ll be able to determine the amount of database storage usage for both system and application data, as shown in the image below.




The values shown in the database usage are updated hourly, thus any change in the occupation values may be reflected only after an hour.


How to free up System data


OutSystems Platform provides built-in capabilities to cleanup old system data. The most common cause for database usage growth is old versions of your applications.


Starting with Amsterdam, OutSystems Platform will periodically clean up old module versions from the database. Nevertheless, it’s possible that you might need to perform this cleanup yourself, by executing the described procedure below.


Deleting old module (eSpace) versions from your system is handled under the Factory section of your environment management console (https://<yourpersonalenvironmentname>.outsystemscloud.com/ServiceCenter). On the eSpaces subtab, you’ll find the Check Old eSpace Versions to Delete link, which will allow you to view the eSpace versions older than a specific period (1 week, 2 weeks, 1 month, etc), and select them for deletion.



Select the period, press the Check Versions to Delete button, and you’ll get a list of old eSpace versions that you can safely delete. These versions aren’t the currently published version, nor associated with existing Solution versions. By pressing the Delete Displayed Versions button, all listed eSpace versions will be remove from the database repository, freeing up significant database storage.


How to free up Application data


Application data is basically all the information that your applications store in their own entities/tables. This means that you control the amount of data that is stored in the application data model. So our recommendation to control that application data usage, is to have your applications keep a clean data model.


For instance, if you store files or large chunks of data in your application entities that you will use only once but never again, you might want to delete them from the data model. On the other hand, if you’re considering using the data model to store files or large chunks of data, you might want to consider pushing that information to external storage services, like Amazon S3, Box.com, Google Drive or Dropbox, using available connectors.


It’s also possible that during your development cycles, you may delete applications or entities. To prevent irreversible loss of data, OutSystems Platform doesn’t actually delete the data from the database. This can present another problem, which is that you lose the ability to delete the entity's data from within your applications. We provide an API to allow you to delete entities and columns from the data model, and free up some more espace. This is called the DB Cleaner API.


Hope this information helps you to keep your cloud environment database usage in check, to improve the stability and performance of your applications in the cloud.


Cheers!

As a suggestion, the DBCleaner component already excercises the DBCleaner API to help you manage your lingering database entities and it also allows you to cleanup old emails, espace versions, and soon it will allow to cleanup old BPT data using the BPT API.
Boas,
Mesmo depois de fazer essa dica, o meu system data continua a vermelho.
podes me ajudar?
apaguei todas as aplicações e mesmo assim não alterou nada, o que posso fazer.
Hello,

I have a problem with the storage, on this moment the system data is around 1090 mb. I deleted all the old espaces so where is this usage comming from? Can you guys help me with cleaning it up?

Guys
I would like to know what is the total space available for personal enviroment.
Answer will be appreciate...
Best Regards
Edgardo, the above screenshot is from a personal environment where it's visible that currently you have 2 GiB of database space available in your personal environment.

Hi There,

After deleted old module (eSpace) versions from our system. i see the System Data still the same size? Is there a way to check which application used the most data? 

I've written outaystens. Posted on their Facebook. Requested enterprise trial. Scoured through the entire forum. It seems to be a big secret. When we questioned the agent regarding the redundant errors in respect to the database useage and despite deleting everything, the system data remained full locking us out of our personal environment; their response was, well you don't think we're going to give this pass away for free? I was floored. Keep in mind we're an enterprise client who wants to utilize the premium account and eventually become a paying client, but just that response considering they advertise "open source." Is a big red flag for us. We understabd everyone needs to make a profit and we're not oppose to paying, we have/had every intention in paying but for those looking for the open source platform, I suppose it's a bait and switch? Correct me if I'm wrong please because we're about to look elsewhere. Lack of a better term, it seems very shady for the lack of response to this topic and solutions to this topic including the dialog we had over the phone. 


Very disappointed.

Hi Brian, 

We are very sorry that you are going through a bad experience and thank you for reporting this.

I will reach out to you via direct message so that we can help solve the issue. 

Regards,

Carla Sofia

Community Manager


Brian Cardozo wrote:

I've written outaystens. Posted on their Facebook. Requested enterprise trial. Scoured through the entire forum. It seems to be a big secret. When we questioned the agent regarding the redundant errors in respect to the database useage and despite deleting everything, the system data remained full locking us out of our personal environment; their response was, well you don't think we're going to give this pass away for free? I was floored. Keep in mind we're an enterprise client who wants to utilize the premium account and eventually become a paying client, but just that response considering they advertise "open source." Is a big red flag for us. We understabd everyone needs to make a profit and we're not oppose to paying, we have/had every intention in paying but for those looking for the open source platform, I suppose it's a bait and switch? Correct me if I'm wrong please because we're about to look elsewhere. Lack of a better term, it seems very shady for the lack of response to this topic and solutions to this topic including the dialog we had over the phone. 


Very disappointed.



Edgardo Gallardo wrote:

Guys
I would like to know what is the total space available for personal enviroment.
Answer will be appreciate...
Best Regards

Hey Edgardo, 


There is a maximum of 2 GB for database storage of system and application data in the Personal Environment.


Does that answer your question?


Thanks,

Alexandra 


In regards to the post above outsystems did reach out very quickly to clear up the misunderstanding. The issue seemed to be a misunderstanding between myself and someone who had called. We are now fully aware of how the process works and what we did wrong in the process. I appreciate the quick follow up and clarification in respect to the pricing and the storage issue we were facing. Both Mario and Alex cleared up any concerns we had and have fixed the misunderstanding by 110%.

Thank you for the fast follow up and fixing the issue at hand. We were out of town the past few days so please accept my apology for not following up with this response sooner.

We think outsystems would be a great choice for both personal use and corporate enterprise use. Outstanding team members making a less than positive experience extremely great in the end.

Thank you

Brian