Message Boards Message Boards

WebSearch undesired domains list

Posted 2 years ago

Hello Everyone

I am wondering if someone in here can help me as Wolfram Support has told me just to wait for the next version of Mathematica to solve this issue. I am trying to run an easy WebSearch of a bunch of data I have in a list. First I am trying with Google

SearchResultsGoogle = 
 Table[WebSearch[data[[i, 2]], "Hyperlinks", MaxItems -> 1, 
   Method -> "Google"], {i, 2, Length@data}]

The results show up like this

{{}, {}, {}, {}, {}, {}, {}, {}, {URL[ "https://www.smcpneumatics.com/TH1210N-20.html"]}, {URL[ "https://us.misumi-ec.com/vona2/detail/221000092501/?HissuCode=\ NART8UUR"]},

Nevertheless if I try to Google the first items in my list I do get some results from Google instead of just only {}. So then I ran the same search using Bing as a search Method

SearchResultsBing = 
 Table[WebSearch[data[[i, 2]], "Hyperlinks", MaxItems -> 1, 
   Method -> "Bing"], {i, 2, Length@data}]

Now the results are different

{{URL["https://us.misumi-ec.com/vona2/detail/221000570906/?HissuCode=\ TES-4-4X2.5-CWH-100M"]}, {URL[ "https://www.y-ic.com/pdf/Panasonic/SF4B-H64CA-J05.html"]}, {URL[ "https://tt-net.tsubakimoto.co.jp/tecs/pdct/ctc/pdctDtlCTCPBRSP.\ asp?kata=RSP"]}, {URL[ "https://www.seals-shop.com/eu/en/rod-seals/turcon-variseal-m2s-\ rod"]},

I need to know 2 things. 1 - Does someone knows a way to automate a Google search for a list of items?. Every time I run a search using Mathematica, Wolfram is charging me "Service Credits" even if the command is not working properly. I already have a ticket on this Case [4852512].

2- Does anyone knows how to give the WebSearch command a list of domains I want to exclude from the search?. For example search in everything that is not .gov ?

Thanks for your advice. Rodrigo

POSTED BY: Rodrigo Amor
Reply to this discussion
Community posts can be styled and formatted using the Markdown syntax.
Reply Preview
Attachments
Remove
or Discard

Group Abstract Group Abstract