1908
Views
16
Comments
Solved
Test Automation Tool for Outsystems
Question

Hello everyone

I am Lasha Gagnidze, software developer from Georgia.

Currently working on Outsystems platform, we are having quit a big application and having a two weeks sprints. So we need to test our application and we have tried testcomplete tool, but somehow we didn't succeed in it. While making scripts testcomplete maps object names by itself but when we run it on some cases we get errors on name mapping problem, thing is that there are for example two textboxes with the same name and system can't recognize which to choose and give some value.

Can you please share your experience about test automation tools, which is better for our platform to use. If you are using and are satisfied with results of it please share the name of that tool.


Thank you in advance for everyone.


Sincerely yours, Lasha.

Staff
Rank: #332
Solution

Hi everyone, 

Nice to see you sharing your experiences with test automation on OutSystems.

Let me begin by stating the test automation in OutSystems is not limited to UI testing alone - you can (and should) also test at the business logic layer. We currently have available at the Forge the BDDFramework component. It allows you to implement and run Component Tests for server-side public OutSystems actions. You can find some Best Practices here.

For UI tests we currently don't have a recommended tool or set of tools. We have experimented with some of the tools already mentioned in this thread but our recommendation is that you understand what are your requirements and your team capabilities and search the market for a tool that fits you best.

To support UI Test Automation, we do have some Best Practices on how you locate your elements in the screens. we recommended using the widget's Name property. Here are some links:

I remind that OutSystems does not endorse any of the tools mentioned in these articles other than the BDDFramework. They serve only as examples.

As a final note, this documentation is expected to be constantly updated as we mature the Test Automation practice in OutSystems and come up with new content, so make sure to stay tuned for the latest.

mvp_badge
MVP
Rank: #14

Hi,

welcome to the forums.

At our current project we use Tosca for testing the front-end.

This works like a charm!


Rank: #22726

Hi,

I am finishing my masters project in outsystems. I need to do tests and present the results of my web app and mobilie.

What is the fastest method to do tests and present a report of the results with any errors that may exist? It will be the Tosca?

Best regards

mvp_badge
MVP
Rank: #17

Hi,

I recently watched a presentation of https://www.leapwork.com/ automated testing tool.

This tool takes a 'low-code' approach on how you design your test work flows.

It had also a nice solution to handle the id's that OutSystems generates automatically.

Unfortunately do not have first-hand experience, just watched the presentation which was looking really good.

Regards,

Daniel


mvp_badge
MVP
Rank: #26

Hi,

I work at the company that gave the demo, LINKIT, and we are the implementation partner of LEAPWORK for OutSystems installations.

You can try their tooling for free (for one month). Just let them know it's for an OutSystems application and they will connect you with us. If you have any questions about test automation, you can reach me via a PM.

Kind regards,

Remco Dekkinga

Staff
Rank: #251

Lasha Gagnidze wrote:

Hello everyone

I am Lasha Gagnidze, software developer from Georgia.

Currently working on Outsystems platform, we are having quit a big application and having a two weeks sprints. So we need to test our application and we have tried testcomplete tool, but somehow we didn't succeed in it. While making scripts testcomplete maps object names by itself but when we run it on some cases we get errors on name mapping problem, thing is that there are for example two textboxes with the same name and system can't recognize which to choose and give some value.

Can you please share your experience about test automation tools, which is better for our platform to use. If you are using and are satisfied with results of it please share the name of that tool.


Thank you in advance for everyone.


Sincerely yours, Lasha.

Hi Lasha,

I heard from a customer that Ghost Inspector was easy to use (has recording) and with very little effort, recorded scripts may become robust. (By the way, the Test Framework available through the Forge supports Ghost Inspector).

I heard from another customer they are having good results with Ranorex, as long as they set the names on OutSystems objects and identify objects by "initial part of name" (something like XPATH [name > "createButton"]).

Remco also shared with me the Leapwork that unfortunately I didn't find time to dig into it, but looks promising (and the help from LINKIT may be just the "accelerator" you need).

OutSystems has some proximity with Tricentis (Tosca) because both platforms address same customer segments but we have not reached a joint GTM.

OutSystems is looking into cloud solutions, mainly device farms.

These are not official recommendations; just sharing things on top of my mind (that I would like to find the time to follow but I didn't do that yet... So, hopefully you may follow one or two and share your experience).

Thanks

Antonio


Hi, I am a senior automated tester currently busy with a huge project of outsystems. If I can advise you to check a freeware automation tool which is selenium and appium based you should check Katalon. I came in touch with it during a testmeeting. It is setup groovy/java based which can be used for functional as well as technical testdevelopers to create customized scripts.


They have dockerized containers which can be deployed in amazon instances to run things unattended in jenkins/gitlab in a CI/CD environment. Hope it helps!



Rank: #497

Hi,

We provide the testing framework specific to Outsystems based on selenium. You can write test scripts with OutSystems actions!

https://www.outsystems.com/forge/component-overview/4322/tellus

Rank: #497

Hi Jhonatan Melo,

Currently, we only support web testing. 

We plan to be able to test mobile by using Appium.

Rank: #14185

We had a similar issue when starting using Outsystems. To identify 2 input element we created extended properties and called the elements based off the tags selected as seen below, example html element testlink and the value input1, you can dive into the page source element to see where this is. Testing tool use selenium.

I like working with Tosca. Tosca makes it very easy to identify objects. You can even dynamically identify your objects during test execution when you set up your modules in a specific way. Given you give names to your objects in OutSystems, you will not have to work with extended properties like shown above, and you will be able to reuse your modules from Tosca in multiple screens.


Be careful with taking the automatically mapped object names from TestComplete, since there might be a generated string from OutSystems in that name, which might change after every deploy.

I use Katalon Studio with Outsystems Web & Mobile

https://www.katalon.com/

Rank: #2057

Hi,


There is any component for Automated Tests and free for Outsystems?


Thanks in advance

Staff
Rank: #332
Solution

Hi everyone, 

Nice to see you sharing your experiences with test automation on OutSystems.

Let me begin by stating the test automation in OutSystems is not limited to UI testing alone - you can (and should) also test at the business logic layer. We currently have available at the Forge the BDDFramework component. It allows you to implement and run Component Tests for server-side public OutSystems actions. You can find some Best Practices here.

For UI tests we currently don't have a recommended tool or set of tools. We have experimented with some of the tools already mentioned in this thread but our recommendation is that you understand what are your requirements and your team capabilities and search the market for a tool that fits you best.

To support UI Test Automation, we do have some Best Practices on how you locate your elements in the screens. we recommended using the widget's Name property. Here are some links:

I remind that OutSystems does not endorse any of the tools mentioned in these articles other than the BDDFramework. They serve only as examples.

As a final note, this documentation is expected to be constantly updated as we mature the Test Automation practice in OutSystems and come up with new content, so make sure to stay tuned for the latest.

Rank: #81953

Hi everyone,

We have project developed in outsystems. This project has charts like bar chart, stacked bar chart, line chart and donut chart etc. We are planning to do automation of this project and validate data displayed on the charts. As shown in below chart, we want to validate tool tip value and other chart elements like legends and axes values.



We tried with few tools but due to dynamic id's we are unable to locate the elements. What is the best method or tool to do automation of these charts?


Thank you!

Shivaji Dhumal