U @6^@sPddlmZmZddlZddlZddlZddlmZm Z m Z Gddde Z dS))PopenPIPEN) SpiderFootSpiderFootPluginSpiderFootEventc@sVeZdZdZddddZddddZd Zd Zefd d Z d dZ ddZ ddZ d S)sfp_tool_whatwebzuTool - WhatWeb:Footprint,Investigate:Content Analysis:tool:Identify what software is in use on the specified website.Zruby) aggression ruby_path whatweb_pathz"Set WhatWeb aggression level (1-4)zZPath to Ruby interpreter to use for WhatWeb. If just 'ruby' then it must be in your $PATH.z1Path to the whatweb executable file. Must be set.NFcCs@||_||_d|_d|_t|D]}|||j|<q(dS)NFzTarget Website)sf tempStorageresults errorState__dataSource__listkeysopts)selfsfcuserOptsoptr;/var/www/spiderfoot.crq.systems/modules/sfp_tool_whatweb.pysetup(s  zsfp_tool_whatweb.setupcCsdgS)N INTERNET_NAMErrrrr watchedEvents1szsfp_tool_whatweb.watchedEventscCs dddgS)N RAW_RIR_DATAWEBSERVER_BANNERWEBSERVER_TECHNOLOGYrrrrrproducedEvents4szsfp_tool_whatweb.producedEventscCsp|j}|j}|j}|jd|d||jr4dS||jkrV|jd|ddSd|j|<|jds|jddd|_dS|jd}|jd d r|d }t j |s|jd |dd|_dS|j |s|jd ddSz.t|jd }|dkrd}|dkrd}Wnd}YnX|jd|ddt|ddd|g}z"t|ttd}|jdd\} } Wn@tk r} z |jdt| dWYdSd} ~ XYnX|jdkr|jdd|jd| d| dS| s|jd|dSzt| } Wn@tk rN} z |jdt| dWYdSd} ~ XYnXtdt| |j|} || d d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4g}| D]}|d5}|sq|d$r|d$d6D] }td7||j|} || q|d1r4|d1d6D] }td8||j|} || q|D].}||krJq8td9||j|} || q8qdS):NzReceived event, z, from z Skipping z as already scanned.Tr z@You enabled sfp_tool_whatweb but did not set a path to the tool!F/ZwhatwebzFile does not exist: zInvalid input, refusing to run.r rr z--quietz --aggression=z--log-json=/dev/stdoutz--user-agent=Mozilla/5.0z--follow-redirect=never)stdoutstderr)inputzUnable to run WhatWeb: rzUnable to read WhatWeb output.zError running WhatWeb: z, zWhatWeb returned no output for z+Couldn't parse the JSON output of WhatWeb: rZCountryZIPScriptTitle HTTPServerZRedirectLocationZUncommonHeadersz Via-ProxyZCookiesHttpOnlyzStrict-Transport-Securityzx-hackerz x-machinez x-pingbackz X-BackendzX-CachezX-UA-Compatiblez X-Powered-ByzX-Forwarded-ForzX-Frame-OptionszX-XSS-Protectionpluginsstringr r! SOFTWARE_USED) eventTypemoduledatar debugrrrerrorendswithospathisfile sanitiseInputintstrrr communicate BaseException returncodejsonloadsr__name__notifyListenersget)revent eventName srcModuleName eventDataexer argspr%r&eZ result_jsonevt blacklistresultZplugin_matcheswpluginrrr handleEvent7s                 zsfp_tool_whatweb.handleEvent) r@ __module__ __qualname____doc__roptdescsrrdictrrr"rPrrrrrs r) subprocessrrior>os.pathr5sflibrrrrrrrrs