3
@6^>, @ s\ d dl Z d dlmZmZ d dlmZmZmZ ddddgdd d
gg d iZG d d
d
eZ dS ) N) IPAddress IPNetwork)
SpiderFootSpiderFootPluginSpiderFootEventz&Watchguard Reputation Authority Lookup _watchguardqueryipz,http://reputationauthority.org/lookup?ip={0}z.*>[6-9][0-9]/100 .*z.*>100/100 .*)idtypechecksurlbadregex goodregexc @ sl e Zd ZdZdddZddiZdZe fddZd d
Z d d Z
d
d Z dd Z dd Z
dd Zdd ZdS )sfp_watchguardzWatchguard:Investigate,Passive:Reputation Systems::Check if an IP is malicious according to Watchguard's reputationauthority.org.T)r checkaffiliatesr zApply checks to affiliates?Nc C s8 || _ | j | _x"t|j D ]}|| | j|< q W d S )N)sf tempStorageresultslistkeysopts)selfsfcuserOptsopt r 9/var/www/spiderfoot.crq.systems/modules/sfp_watchguard.pysetup1 s
zsfp_watchguard.setupc C s ddgS )N
IP_ADDRESSAFFILIATE_IPADDRr )r r r r
watchedEvents= s z sfp_watchguard.watchedEventsc C s dgS )NZ*MALICIOUS_IPADDRMALICIOUS_AFFILIATE_IPADDRr )r r r r producedEventsC s z sfp_watchguard.producedEventsc C s t |dkrDx6|D ].}tj||tjtjB r| jjd| dS qW t |dkrx6|D ].}tj||tjtjB rV| jjd| dS qVW | jjd d S )Nr z#Found to be bad against bad regex: Tz$Found to be good againt good regex: Fz Neither good nor bad, unknown.)lenrematch
IGNORECASEDOTALLr debug)r contentr r rxr r r contentMaliciousG s
z sfp_watchguard.contentMaliciousc C s | j jd| d | xttj D ]}t| d }||kr&t| d dkr&tt| d }| j j|j|| jd | jd d }|d
d kr| j j d |j| d d S | j
|d
t| d
t| d r&|j|S q&W d S )Nz Querying z for maliciousness of r
r r r
_fetchtimeout
_useragent)timeout useragentr) zUnable to fetch Fr r ) r r( r malchecksr strfetchUrlformatr errorr+ )r r
target
targetTypecheckcidr
resr r r
resourceQuery[ s $
z sfp_watchguard.resourceQueryc C s d}|dkr | j j|| jd }xjttj D ]X}t| d }||koXt| d dkr0t }t| d }| j jd| | jjd d
|d < |d d kr| j j || jd | jd
d}|d d kr| j j
d| d d S | j j d| |d |dkrFt } dt| krt| d j dd}
t
j|
t
j} | j jd| d |
xP|d jdD ].} t
j| | }
t|
d
krV| j|
d
qVW n|d jd} x| D ]}t|dk s|jdrq|j }y6t|t|kr| j j|d | d | |S W n< tk
r: } z | j jd t| wW Y d d }~X nX qW d S dt| krxZ|d jdD ]H} | |ks|dkrd| |krd| j j|d | d | d |S qdW q0ytt| d j|}tt| d j|}xj|d jdD ]X} |dkrt
j || t
js"t
j || t
jr| j j|d | d | d |S qW W q0 t k
r } z | j jd t| w0W Y d d }~X q0X q0W d S )!N domain
_internettldsr
r r r
sfmal_ cacheperiodr r) r, r- )r. r/ zUnable to fetch Fnetblockregexz{0}z(\d+\.\d+\.\d+\.\d+)zNew regex for z:
#z found within netblock/subnet z in zError encountered parsing: /z
found in z list.z Error encountered parsing 2: ) r
hostDomainr r r0 r dictcacheGetgetr2 r4 cachePutreplacer$ compiler& r( splitfindallr# append
startswithstripr r Exceptionr1 r3 r%
BaseException)r r
r5 r6 targetDomr7 r8 datar
iplistr* patlinegrpr erxDomrxTgtr r r resourceListm sr
zsfp_watchguard.resourceListc C s xt tj D ]}t| d }||kr|t| d kr| jjd| d | d | t| d dkrt| j|||S t| d dkr| j|||S qW d S ) Nr
r zChecking maliciousness of z (z) with: r r r )r r0 r r r( r: r] )r
resourceIditemTyper5 r7 r8 r r r
lookupItem s zsfp_watchguard.lookupItemc C s |j }|j}|j}| jjd| d | || jkrL| jjd| d d S d| j|< |dkrr| jjdd rrd S |d kr| jjd
d rd S |d kr| jjd d rd S |d
kr| jjdd rd S xtt j
D ]}t | d }| j| r|d%krd}|dkrd}nd}|d&kr&d}d}|d'kr^d}|dkrBd}|dkrPd }|dkr^d }|d krpd }d }|d
krd }d }| j |||} | j rd S | d k r|d! | d" d# | d$ }
t
||
| j|} | j| qW d S )(NzReceived event, z, from z Skipping z, already checked.TCO_HOSTED_SITE checkcohostsFr r NETBLOCK_OWNERchecknetblocksNETBLOCK_MEMBER checksubnetsr
r r MALICIOUS_IPADDRMALICIOUS_AFFILIATE_IPADDR BGP_AS_OWNER
BGP_AS_MEMBERasn
MALICIOUS_ASN
INTERNET_NAMEAFFILIATE_INTERNET_NAMEr< MALICIOUS_INTERNET_NAME!MALICIOUS_AFFILIATE_INTERNET_NAMEMALICIOUS_COHOSTr@ MALICIOUS_NETBLOCKMALICIOUS_SUBNETz [z]
zz)r r )ri rj )rm ra rn ) eventTypemodulerU r r( r r rI r r0 r r` checkForStopr __name__notifyListeners) r event eventName
srcModuleName eventDatar7 r8 typeIdevtTyper
textevtr r r handleEvent sf
zsfp_watchguard.handleEvent)rw
__module__ __qualname____doc__r optdescsr rG r r! r" r+ r: r] r` r r r r r r s Mr )
r$ netaddrr r sflibr r r r0 r r r r r
s