U @6^@s0ddlmZmZmZddlZGdddeZdS)) SpiderFootSpiderFootPluginSpiderFootEventNc@sZeZdZdZdddddZdddd dZd Zd Zefd d Z ddZ ddZ ddZ d S) sfp_onioncityzOnion.link:Footprint,Investigate:Search Engines:apikey:Search Tor 'Onion City' search engine for mentions of the target domain.z!013611106330597893267:tfgl3wxdtbpT)api_keycse_id fetchlinks fullnamesz%Google API Key for Onion.link search.zGoogle Custom Search Engine ID.zQFetch the darknet pages (via TOR, if enabled) to verify they mention your target.zSearch for human names?NFcCs:||_||_d|_t|D]}|||j|<q"dS)NF)sf tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr8/var/www/spiderfoot.crq.systems/modules/sfp_onioncity.pysetup)s  zsfp_onioncity.setupcCsddgS)N INTERNET_NAME DOMAIN_NAMErrrrr watchedEvents2szsfp_onioncity.watchedEventscCs dddgS)NDARKNET_MENTION_URLDARKNET_MENTION_CONTENT RAW_RIR_DATArrrrrproducedEvents8szsfp_onioncity.producedEventsc s&|j}|j}|j}jrdSjds2|dkr2dSjd|d|jddkrpjddd _dS|jkrjd |d dSd j|<jj d |jd jdjdjddd}|dkrdS|d}t t |t j }|D]}d j|<q|d} jj | jd jdd} | ddkrjtd| dj|} | njjdddrdSfdd|D} | D]} jd| | dd}jd rjj |jd jdd}|ddkrjd!| d"qtd#t|d#|dtjdkrTjd!| d$|qtd%|j|} | z&|d|d&}|t|d'}Wn:tk r}zjd(WYqW5d}~XYnX|d||}td)d*|d*j| } | ntd%|j|} | qdS)+Nr HUMAN_NAMEzReceived event, z, from rrz;You enabled sfp_onioncity but did not set a Google API key!FTzAlready did a search for z , skipping.z+site:onion.link _fetchtimeout _useragentr)timeout useragentrr) searchStringrurls webSearchUrl)r$r%code)200201Z202rcontentz%Failed to fetch Google web search URL) exceptioncs"g|]}j|dr|qS) .onion.link)r urlFQDNendswith).0linkrrr |sz-sfp_onioncity.handleEvent..zFound a darknet mention: r.z.onionr z Ignoring z as no data returnedz[^a-zA-Z\-\_0-9]z as no mention of rxzString not found in content.rz...) eventTypemoduledatarrr debugerrorr googleIteratersetrfetchUrlr__name__notifyListeners checkForStopreplaceresearchescape IGNORECASEindexlen BaseException)revent eventName srcModuleName eventDataresr' new_linkslZgooglesearch_urlresponseevtZ darknet_linksr2Ztorlink startIndexendIndexer8rrr handleEvent<s            zsfp_onioncity.handleEvent) r> __module__ __qualname____doc__roptdescsr rdictrrr rUrrrrrs"  r)sflibrrrrBrrrrrs