Como Extrair varios dados de Url difernte REST (Html)

Alguem poderia me ajudar com um exemplo.

como posso extrair vários conteúdos do mesmo site mais em paginas diferentes.

  • Exemplo: Na página do pingo doce (https://www.pingodoce.pt/receitas/), há várias receitas, pretendendo extrair uma receita do tipo carne e também uma receita de peixe. 
  • como fazer para salvar os dois ou mais registros (das receitas) na minha tabela Receitas, qual é o URL diferente?

(Someone could help me with an example.

how I can extract various contents from the same site more on different pages.

Example: On the pingo doce page (https://www.pingodoce.pt/receitas/), there are several recipes, intending to extract a meat type recipe and also a fish recipe. 

How can I save the two or more entries (of the recipes) in my Recipes table, what is the different URL?)


Hi João,

The best language to use on this forum is English, as there are many knowledgeable people that do not speak Portuguese. Do you think you can edit the post and change it to English? Thanks.

Hi João,

During NextStep 2019, OutSystems MVP Miguel 'Kelter' Antunes held a tech talk about Web Scraping with OutSystems.

Maybe you have already seen it, but I thought there might be something useful in there that can help you solve your problem.

Regards,

Nordin

Nordin Ahdi wrote:

Hi João,

During NextStep 2019, OutSystems MVP Miguel 'Kelter' Antunes held a tech talk about Web Scraping with OutSystems.

Maybe you have already seen it, but I thought there might be something useful in there that can help you solve your problem.

Regards,

Nordin

 Thank you Nordin Ahdi,

My project was based on this module. There is a small difference. 

- Miguel 'Kelter' Antunes works with lists.

- Mine has different pages.


Example: https://www.pingodoce.pt/receitas/bifanas-no-pao/

"I can only extract the contents of the recipe <bifanas-no-pao/>"


Which I then have to change pages to be able to extract another recipe: https://www.pingodoce.pt/receitas/macas-caramelizadas-com-gelado-e-chocolate/

"macas-caramelizadas-com-gelado-e-chocolate/"


 

can someone help me? please

Hi João,
I have created a sample for that, it's attached to this post.
Indeed the sample was based on the Web Scraping component developed by Miguel Antunes in NextStep2019.


In this sample, you access www.pingodoce.pt/receitas and from there extract all the possible links. I even get into one of the links and extract the content, which is one recipe, just for demonstrate how it would work. 


For your implementation, allow me to suggest to:
1. have an Action for scraping the pages only looking for recipes' links (recursively);
2. Once you list them all, there may be duplicate links, so you need to clean it up;
3. With the clean list, go thru each of the links and extract the recipes;
4. You may have a process to run from time to time to get new recipes;
5. Once you have the links and the recipes, you can accomodate the way it makes sense to your app.

I hope it helps.

Regards,
Otávio Souza. 

HI Otavio! How are you?


Thank you for your anwer. It's very helpfull but i'm trying something diferent. I dont need a list of links...

I just need an input and change it to a link...

Using this example, i put an input (inputTest) but how can I changed to be your {link}? becaus i have more than 2 or 3 words and I have to have something connected with "-".

Thank you!!



Otavio Souza wrote:

Hi João,
I have created a sample for that, it's attached to this post.
Indeed the sample was based on the Web Scraping component developed by Miguel Antunes in NextStep2019.


In this sample, you access www.pingodoce.pt/receitas and from there extract all the possible links. I even get into one of the links and extract the content, which is one recipe, just for demonstrate how it would work. 


For your implementation, allow me to suggest to:
1. have an Action for scraping the pages only looking for recipes' links (recursively);
2. Once you list them all, there may be duplicate links, so you need to clean it up;
3. With the clean list, go thru each of the links and extract the recipes;
4. You may have a process to run from time to time to get new recipes;
5. Once you have the links and the recipes, you can accomodate the way it makes sense to your app.

I hope it helps.

Regards,
Otávio Souza.