Hi,
I am new to OutSystems, trying to understand how it work. So my question is, can we extract data from web page or web site using OutSystems? if yes, then how?
Regards,
Yasmeen,
Are you looking for a Web Scrapping Tool?
I never used it in Outsystems, but I see that in the Forge you can have some components to perform that operation.
https://www.outsystems.com/forge/component-overview/2295/nscrape-web-scraping
https://www.outsystems.com/forge/component-overview/7079/web-scraping-demo-from-nextstep-2019
I never used them, so I can´t offer you specific support in this issue. Have a look into those componenent and try to find your way.
However, some RPA tools such as UiPath Software, have pre built web scrapping tools that are easy to use.
Best regards,
João Delgado
Hi Yasmeen,
Are you trying to create a web scraper? You could probably do it with OutSystems, but there's better tools for it out there. I wrote a proof of concept to scrape Linkedin with Selenium in an Extension and mainly used low code for the tool frontend.
Hi Afonso,
I am also trying to use Selenium to scrape data from a website but don't have enough knowledge to do so. Can you share with me how you do the scraping and installing Selenium to be used in Outsystems?
Hello Nhan,
You'll have to bundle the Selenium Webdriver in your Extension, as well as making sure that your OutSystems server has a compatible browser installed - the Webdriver will interact with the browser in headless mode.
Once you have the Extension configured, it's a matter of creating code that will acquire the webpage you want to scrape, as well as manipulate the DOM in order to access the values you want.
If you have any specific concerns, feel free to open a new thread. This will get your question more attention - I haven't continued working on this since 2019, so there may be users with more relevant experience.