3 @6^ @s(ddlmZmZmZGdddeZdS)) SpiderFootSpiderFootPluginSpiderFootEventc@sReZdZdZdddZdddZdZdZefd d Z d d Z d dZ ddZ dS)sfp_googlesearchzGoogle:Footprint,Investigate,Passive:Search Engines:apikey:Obtain information from the Google Custom Search API to identify sub-domains and links.z!013611106330597893267:tfgl3wxdtbp)api_keycse_idz!Google API Key for Google search.zGoogle Custom Search Engine ID.NFcCs>||_|j|_d|_x"t|jD]}|||j|<q$WdS)NF)sf tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr;/var/www/spiderfoot.crq.systems/modules/sfp_googlesearch.pysetup$s  zsfp_googlesearch.setupcCsdgS)N INTERNET_NAMEr)rrrr watchedEvents-szsfp_googlesearch.watchedEventscCsddgS)NLINKED_URL_INTERNAL RAW_RIR_DATAr)rrrrproducedEvents3szsfp_googlesearch.producedEventsc sx|j}|j}|jjrdSjjd|d|jddkrZjjddd_dSjkr|jjdd dSdj<jj d jd jd jdjd dd}|dkrdS|d}t t |t jj }x|D]}dj|<qWfdd|D}x8|D]0} jjd| t d| j|} j| qW|rtt dt|j|} j| dS)NzReceived event, z, from rrz>You enabled sfp_googlesearch but did not set a Google API key!FTzAlready did a search for z , skipping.zsite: _fetchtimeout _useragentr)timeout useragentrr) searchStringrurlscs"g|]}jj|jr|qSr)r urlFQDNendswith).0link) eventDatarrr asz0sfp_googlesearch.handleEvent..zFound a link: rr) eventTypemoduledatar r debugrerrorr googleIterater setrr__name__notifyListenersstr) revent eventName srcModuleNameresr!Z new_linkslZinternal_linksr%evtr)r&rr handleEvent6sF    zsfp_googlesearch.handleEvent) r/ __module__ __qualname____doc__roptdescsr r dictrrrr8rrrrrs rN)sflibrrrrrrrr s