3 @6^@sPddlZddlZddlZddlZddlZddlmZmZm Z GdddeZ dS)N) SpiderFootSpiderFootPluginSpiderFootEventc@sneZdZdZddddZddddZd Zd Zefd d Z d dZ ddZ ddZ ddZ ddZddZd S) sfp_whatcmsznWhatCMS:Footprint,Investigate,Passive:Content Analysis:apikey,slow:Check web technology using WhatCMS.org API. )api_keytimeoutdelayzWhatCMS API keyzQuery timeout, in seconds.z#Delay between requests, in seconds.NFcCsD||_d|_|j|_d|_x"t|jD]}|||j|<q*WdS)NZWhatCMSF)sf__dataSource__ tempStorageresults errorStatelistkeysopts)selfsfcuserOptsoptr6/var/www/spiderfoot.crq.systems/modules/sfp_whatcms.pysetup,s  zsfp_whatcms.setupcCsdgS)N DOMAIN_NAMEr)rrrr watchedEvents6szsfp_whatcms.watchedEventscCsddgS)N RAW_RIR_DATAWEBSERVER_TECHNOLOGYr)rrrrproducedEvents:szsfp_whatcms.producedEventscCsd|jdjddd|jdd}|jjdtjj||jd|jd d }tj |jd |j |S) Nraw_unicode_escapeasciireplace)errorsr )urlkeyz'https://whatcms.org/APIEndpoint/Detect?r _useragent)r useragentr ) encodedecoderr fetchUrlurllibparse urlencodetimesleepparseApiResponse)rqryparamsresrrrqueryCmsDetect?szsfp_whatcms.queryCmsDetectcCsd|jdjddd|jdd}|jjdtjj||jd|jd d }tj |jd |j |S) Nr r!r")r#r )r$r%z+https://whatcms.org/APIEndpoint/Technology?r r&)r r'r ) r(r)rr r*r+r,r-r.r/r0)rr1r2r3rrrqueryCmsTechnologyOszsfp_whatcms.queryCmsTechnologycCs|ddkr|jjddS|ddkrH|jjd|ddd|_dSytj|d}Wn4tk r}z|jjdt|dSd}~XnX|jd }|dkr|jjd ddSt|jd}|d kr|jjd dd|_dS|d kr|jjddd|_dS|dkr&|jjddd|_dS|dkrH|jjddd|_dS|dkrj|jjddd|_dS|dkr|jjddd|_dS|dkr|jjddd|_dS|dkr|jjddd|_dS|dkr|jjd|dd|_dS|S)NcontentzNo response from WhatCMS.orgcode200z#Unexpected reply from WhatCMS.org: FTz Error processing JSON response: resultzAPI error: no results0zAPI error: Server failureZ101zAPI error: Invalid API Key102z4API error: Unauthenticated request. Invalid API key?111zAPI error: Invalid URLZ120zAPI error: Too many requestsZ121z7API error: You have exceeded your monthly request quota123zAAPI error: Account disabled per violation of Terms and Conditions201z API error: CMS or Host not foundz)Unexpected status code from WhatCMS.org: ) r debugerrorrjsonloads BaseExceptionstrget)rr3dataer9r7rrrr0^sl            zsfp_whatcms.parseApiResponsec CsJ|j}|j}|j}|jrdS|jddkrB|jjddd|_dS||jkrPdSd|j|<|jjd|d||j |}|dkr|jjd|dS|j d }|dkr|jjd|dSt d t ||j |}|j|xh|D]`}|j d r2d jd d|j d |j dgD} t d| |j |}|j|q|jjd|qWdS)Nr rz3You enabled sfp_whatcms but did not set an API key!FTzReceived event, z, from zNo web technology found for rrname cSsg|] }|r|qSrr).0_frrr sz+sfp_whatcms.handleEvent..versionr) eventTypemodulerFrrr r@rr?r5rErrD__name__notifyListenersjoin) revent eventName srcModuleName eventDatarFrevtr9softwarerrr handleEvents:       $ zsfp_whatcms.handleEvent)rP __module__ __qualname____doc__roptdescsrrdictrrrr4r5r0rYrrrrrs  Gr) rAurllib.requestr+ urllib.parse urllib.errorr.sflibrrrrrrrr s