3 @6^@sPddlZddlZddlZddlZddlZddlmZmZm Z GdddeZ dS)N) SpiderFootSpiderFootPluginSpiderFootEventc@steZdZdZdddddddd Zd d d d dddd ZdZdZdZe fddZ ddZ ddZ dddZ ddZdS) sfp_mnemoniczzMnemonic PassiveDNS:Footprint,Investigate,Passive:Passive DNS::Obtain Passive DNS information from PassiveDNS.mnemonic.no.TFd)per_page max_pagestimeoutmaxageverifycohostsamedomain maxcohostz#Maximum number of results per page.z,Maximum number of pages of results to fetch.zQuery timeout, in seconds.zOThe maximum age of the data returned, in days, in order to be considered valid.zMVerify co-hosts are valid by checking if they still resolve to the shared IP.z>Treat co-hosted sites on the same target domain as co-hosting?zbStop reporting co-hosted sites after this many are found, as it would likely indicate web hosting.rNcCsD||_|j|_d|_d|_x"t|jD]}|||j|<q*WdS)NrF)sf tempStorageresults cohostcount errorStatelistkeysopts)selfsfcuserOptsoptr7/var/www/spiderfoot.crq.systems/modules/sfp_mnemonic.pysetup0s  zsfp_mnemonic.setupcCs ddddgS)N IP_ADDRESS IPV6_ADDRESS INTERNET_NAME DOMAIN_NAMEr)rrrr watchedEvents:szsfp_mnemonic.watchedEventscCsdddddgS)Nr!r"CO_HOSTED_SITEr#r$r)rrrrproducedEvents>szsfp_mnemonic.producedEventsc Cst|t|d}d|dtjj|}|jj||jd|jdd}tjd|ddkrr|jj d |dSyt j |d}Wn,t k r}z|jj d dSd}~XnX|d d kr|jj d d|_dS|d dks|jj ddSd|kr|jj d |dSd|kr,|jj d |dSd|krJ|jj d |dS|d} |d} | sj| r~|jj d |dS|jj dt| dt| d|dS)N)limitoffsetz https://api.mnemonic.no/pdns/v3/?r _useragent)r useragentg?contentzNo results found for zError processing JSON response.Z responseCodeiz8Error retrieving search results: Resource limit exceededTz Error retrieving search results.datacountsizez Retrieved z of z results)strurllibparse urlencoderfetchUrlrtimesleepinfojsonloads Exceptiondebugr) rqryr(r)paramsurlresr/er1r0rrrqueryDsH           $zsfp_mnemonic.querycCsp|j}|j}|j}|jrdS||jkr>|jjd|ddSd|j|<|jjd|d|d}t|jd}t|jd}tt j d d |jd }d} t } x|||krH|j rP|jrP|j |||d } | dkr|jj d |P||7}xD| D]:} d| dksd| dkr,q| d|krJ|jjdq|d&krp| ddkrp| j| d|d'kr| ddkrq| ddkr|jj| drtd| d|j|} |j| | ddkr|jj| drtd| d|j|} |j| | ddkr|jj| ddds2q| j| dqWqWxt| D]}|j rjdS||jkrzqV|dkr|jdr|jj|| r|jjd|d |qV|jd!s,|jj|ddr,td||j|} |j| |jj||jd"rVtd||j|} |j| qV|j|jd#krVtd$||j|} |j| |jd%7_qVWdS)(Nz Skipping z as already mapped.TzReceived event, z, from rr r ii\&r)r(r)zNo passive DNS data found for *rC%ZlastSeenTimestampzRecord found too old, skipping.r!rrtypear#r$ptranswerZaaaar"cname)includeParentsrzHost z no longer resolves to r _internettldsrr&)r!)r#r$) eventTypemoduler/rrrr=intrr7r checkForStoprCr9appendvalidIPr__name__notifyListenersvalidIP6 getTargetmatchesset validateIPisDomainr)revent eventName srcModuleName eventDatapositionr r agelimitrcohostsr/revtcorrr handleEvent~s         (    zsfp_mnemonic.handleEvent)rr)rT __module__ __qualname____doc__roptdescsrrrdictr r%r'rCrfrrrrrs.  :r) r:r7urllib.requestr3 urllib.parse urllib.errorsflibrrrrrrrrs