3 @6^@s0ddlmZmZmZddlZGdddeZdS)) SpiderFootSpiderFootPluginSpiderFootEventNc@sZeZdZdZdddddZdddd dZd Zd Zefd d Z ddZ ddZ ddZ d S) sfp_onioncityzOnion.link:Footprint,Investigate:Search Engines:apikey:Search Tor 'Onion City' search engine for mentions of the target domain.z!013611106330597893267:tfgl3wxdtbpT)api_keycse_id fetchlinks fullnamesz%Google API Key for Onion.link search.zGoogle Custom Search Engine ID.zQFetch the darknet pages (via TOR, if enabled) to verify they mention your target.zSearch for human names?NFcCs>||_|j|_d|_x"t|jD]}|||j|<q$WdS)NF)sf tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr8/var/www/spiderfoot.crq.systems/modules/sfp_onioncity.pysetup)s  zsfp_onioncity.setupcCsddgS)N INTERNET_NAME DOMAIN_NAMEr)rrrr watchedEvents2szsfp_onioncity.watchedEventscCs dddgS)NDARKNET_MENTION_URLDARKNET_MENTION_CONTENT RAW_RIR_DATAr)rrrrproducedEvents8szsfp_onioncity.producedEventscs,|j}|j}|j}jrdSjd r4|dkr4dSjjd|d|jddkrrjjddd _dS|jkrjjd |d dSd j|<jj d |jd jdjdjddd}|dkrdS|d}t t |t jj }x|D]}d j|<qW|d} jj | jd jdd} | dd-krptd| dj|} j| njjdddjrdSfdd|D} x| D]z} jjd| | jd d!}jd"rjj |jd jdd}|ddkrjjd#| d$qtjd%tj|d%|dtjdkr^jjd#| d&|qtd'|j|} j| y&|dj|d(}|t|d)}Wn4tk r}zjjd*wWYdd}~XnX|d||}td+d,|d,j| } j| ntd'|j|} j| qWdS).Nr HUMAN_NAMEzReceived event, z, from rrz;You enabled sfp_onioncity but did not set a Google API key!FTzAlready did a search for z , skipping.z+site:onion.link _fetchtimeout _useragentr)timeout useragentrr) searchStringrurls webSearchUrl)r#r$code200201202rcontentz%Failed to fetch Google web search URL) exceptioncs"g|]}jj|jdr|qS)z .onion.link)r urlFQDNendswith).0link)rrr }sz-sfp_onioncity.handleEvent..zFound a darknet mention: z .onion.linkz.onionr z Ignoring z as no data returnedz[^a-zA-Z\-\_0-9]z as no mention of rxzString not found in content.rz...)r)r*r+) eventTypemoduledatarrr debugerrorr googleIteratersetrfetchUrlr__name__notifyListeners checkForStopreplaceresearchescape IGNORECASEindexlen BaseException)revent eventName srcModuleName eventDataresr& new_linkslZgooglesearch_urlresponseevtZ darknet_linksr1Ztorlink startIndexendIndexer7r)rr handleEvent<s           zsfp_onioncity.handleEvent) r= __module__ __qualname____doc__roptdescsr rdictrrrrTrrrrrs r)sflibrrrrArrrrrs