U @6^@s8ddlZddlZddlmZmZmZGdddeZdS)N) SpiderFootSpiderFootPluginSpiderFootEventc@sJeZdZdZddiZddiZdZefddZdd Z d d Z d d Z dS)sfp_crtzCertificate Transparency:Footprint,Investigate,Passive:Search Engines::Gather hostnames from historical certificates in crt.sh.verifyTz5Verify certificate subject alternative names resolve.NcCs4||_||_t|D]}|||j|<qdS)N)sf tempStorageresultslistkeysopts)selfsfcuserOptsoptr2/var/www/spiderfoot.crq.systems/modules/sfp_crt.pysetup s z sfp_crt.setupcCsddgS)N DOMAIN_NAME INTERNET_NAMErr rrr watchedEvents(szsfp_crt.watchedEventscCsddddddddgS) NSSL_CERTIFICATE_RAW RAW_RIR_DATArINTERNET_NAME_UNRESOLVEDrAFFILIATE_INTERNET_NAME"AFFILIATE_INTERNET_NAME_UNRESOLVEDAFFILIATE_DOMAIN_NAMErrrrrproducedEvents.szsfp_crt.producedEventsc Cs|j}|j}|j}||jkr dSd|j|<|jd|d|dt|dd}|jjdtj |d|j d d }|d dkr|j d |dSzt |d }Wn<tk r}z|jd t|WYdSd}~XYnX|dkst|dkrdStdt||j|} || t} t} |D]} | d} | rP| | | d}d|kr|d}|D]}| |ddqrn"|r2||kr2| |ddq2|j drt| dkr|j dttt| dt| D]}||jkr q|j||j ds$q|j|dddr@d}nd}|j drz|j|sz|jd|d|d7}t|||j|} || |j||j dr|drtd ||j|} || ntd!||j|} || qt| D]} | r dSd"t| i}|jjdtj |d|j d d }z|j!t|d }WnBtk r}z"|j d#t|WYqW5d}~XYnXtd$|d%|j|} || qdS)&NTzReceived event, z, from z%.json)qoutputzhttps://crt.sh/? _useragent)timeout useragentcontentz+No certificate transparency info found for z Error processing JSON response: rrid name_value z*.rz Resolving z domains ... _internettlds)includeChildrenincludeParentsrrzHost z could not be resolved _UNRESOLVED AFFILIATErrdzError parsing certificate: rtext)" eventTypemoduledatar rdebugstrfetchUrlurllibparse urlencoder inforloads BaseExceptionlenr__name__notifyListenersr getappendsplitreplaceset validHost getTargetmatches resolveHostisDomain startswith checkForStop parseCert)r event eventName srcModuleName eventDataparamsresr4eevtZcert_idsdomainsZ cert_infocert_iddomainZdomsr0evt_typecertrrr handleEvent5s                  zsfp_crt.handleEvent) r? __module__ __qualname____doc__r optdescsr dictrrrr[rrrrrsr)r urllib.parser8sflibrrrrrrrrs