U @6^ @s(ddlmZmZmZGdddeZdS)) SpiderFootSpiderFootPluginSpiderFootEventc@sReZdZdZdddZdddZdZdZefd d Z d d Z d dZ ddZ dS)sfp_googlesearchzGoogle:Footprint,Investigate,Passive:Search Engines:apikey:Obtain information from the Google Custom Search API to identify sub-domains and links.z!013611106330597893267:tfgl3wxdtbp)api_keycse_idz!Google API Key for Google search.zGoogle Custom Search Engine ID.NFcCs:||_||_d|_t|D]}|||j|<q"dS)NF)sf tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr;/var/www/spiderfoot.crq.systems/modules/sfp_googlesearch.pysetup$s  zsfp_googlesearch.setupcCsdgS)N INTERNET_NAMErrrrr watchedEvents-szsfp_googlesearch.watchedEventscCsddgS)NLINKED_URL_INTERNAL RAW_RIR_DATArrrrrproducedEvents3szsfp_googlesearch.producedEventsc sp|j}|j}|jjrdSjd|d|jddkrZjddd_dSjkr|jdd dSdj<jj d jd jd jdjd dd}|dkrdS|d}t t |t j }|D]}dj|<qfdd|D}|D]0} jd| t d| j|} | q|rlt dt|j|} | dS)NzReceived event, z, from rrz>You enabled sfp_googlesearch but did not set a Google API key!FTzAlready did a search for z , skipping.zsite: _fetchtimeout _useragentr)timeout useragentrr) searchStringrurlscs"g|]}j|r|qSr)r urlFQDNendswith).0link eventDatarrr `sz0sfp_googlesearch.handleEvent..zFound a link: rr) eventTypemoduledatar r debugrerrorr googleIterater setrr__name__notifyListenersstr) revent eventName srcModuleNameresr"Z new_linkslZinternal_linksr&evtrr'r handleEvent6sV     zsfp_googlesearch.handleEvent) r1 __module__ __qualname____doc__roptdescsr r dictrrrr:rrrrrs rN)sflibrrrrrrrr s