U @6^@sPddlZddlZddlZddlZddlZddlmZmZm Z GdddeZ dS)N) SpiderFootSpiderFootPluginSpiderFootEventc@sneZdZdZddddZddddZd Zd Zefd d Z d dZ ddZ ddZ ddZ ddZddZd S) sfp_whatcmsznWhatCMS:Footprint,Investigate,Passive:Content Analysis:apikey,slow:Check web technology using WhatCMS.org API. )api_keytimeoutdelayzWhatCMS API keyzQuery timeout, in seconds.z#Delay between requests, in seconds.NFcCs@||_d|_||_d|_t|D]}|||j|<q(dS)NZWhatCMSF)sf__dataSource__ tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr6/var/www/spiderfoot.crq.systems/modules/sfp_whatcms.pysetup,s  zsfp_whatcms.setupcCsdgS)N DOMAIN_NAMErrrrr watchedEvents6szsfp_whatcms.watchedEventscCsddgS)N RAW_RIR_DATAWEBSERVER_TECHNOLOGYrrrrrproducedEvents:szsfp_whatcms.producedEventscCsd|djddd|jdd}|jjdtj||jd|jd d }t |jd | |S) Nraw_unicode_escapeasciireplaceerrorsr urlkeyz'https://whatcms.org/APIEndpoint/Detect?r _useragentr useragentr encodedecoderr fetchUrlurllibparse urlencodetimesleepparseApiResponserqryparamsresrrrqueryCmsDetect?szsfp_whatcms.queryCmsDetectcCsd|djddd|jdd}|jjdtj||jd|jd d }t |jd | |S) Nr!r"r#r$r r&z+https://whatcms.org/APIEndpoint/Technology?r r)r*r r,r6rrrqueryCmsTechnologyOszsfp_whatcms.queryCmsTechnologyc Cs|ddkr|jddS|ddkrH|jd|ddd|_dSzt|d}Wn<tk r}z|jdt|WYdSd}~XYnX|d }|dkr|jd ddSt|d}|d kr|jd dd|_dS|d kr |jddd|_dS|dkr.|jddd|_dS|dkrP|jddd|_dS|dkrr|jddd|_dS|dkr|jddd|_dS|dkr|jddd|_dS|dkr|jddd|_dS|dkr|jd|dd|_dS|S)NcontentzNo response from WhatCMS.orgcode200z#Unexpected reply from WhatCMS.org: FTz Error processing JSON response: resultzAPI error: no results0zAPI error: Server failureZ101zAPI error: Invalid API Key102z4API error: Unauthenticated request. Invalid API key?111zAPI error: Invalid URLZ120zAPI error: Too many requestsZ121z7API error: You have exceeded your monthly request quota123zAAPI error: Account disabled per violation of Terms and Conditions201z API error: CMS or Host not foundz)Unexpected status code from WhatCMS.org: ) r debugerrorrjsonloads BaseExceptionstrget)rr9dataer?r=rrrr5^sl            zsfp_whatcms.parseApiResponsec CsF|j}|j}|j}|jrdS|jddkrB|jddd|_dS||jkrPdSd|j|<|jd|d|| |}|dkr|jd|dS| d }|dkr|jd|dSt d t ||j |}|||D]`}| d r0d d d| d | dfD} t d| |j |}||q|jd|qdS)Nr rz3You enabled sfp_whatcms but did not set an API key!FTzReceived event, z, from zNo web technology found for rrname cSsg|] }|r|qSrr).0_frrr sz+sfp_whatcms.handleEvent..versionr) eventTypemodulerLrrr rFrrEr;rKrrJ__name__notifyListenersjoin) revent eventName srcModuleName eventDatarLrevtr?softwarerrr handleEvents:      $ zsfp_whatcms.handleEvent)rV __module__ __qualname____doc__roptdescsrrdictrrr r:r;r5r_rrrrrs$ Gr) rGurllib.requestr0 urllib.parse urllib.errorr3sflibrrrrrrrr s