U
@6^\* @ sV d dl Z d dlmZmZ d dlmZmZmZ ddddgdd d
iZG d d d eZ dS )
N) IPAddress IPNetwork)
SpiderFootSpiderFootPluginSpiderFootEventzmultiproxy.org Open Proxies _multiproxylistipz'http://multiproxy.org/txt_all/proxy.txtz{0}:.*)idtypechecksurlregexc @ sp e Zd ZdZddddZdddZdZe fd d
Zd d Z d
d Z
dd Z dd Z dd Z
dd Zdd ZdS )sfp_multiproxyzmultiproxy.org Open Proxies:Investigate,Passive:Secondary Networks::Check if an IP is an open proxy according to multiproxy.org' open proxy list.T )r checkaffiliates cacheperiodzApply checks to affiliates?z,Hours to cache list data before re-fetching.)r r Nc C s4 || _ | | _t| D ]}|| | j|< q d S )N)sf tempStorageresultsr keysopts)selfsfcuserOptsopt r 9/var/www/spiderfoot.crq.systems/modules/sfp_multiproxy.pysetup3 s
zsfp_multiproxy.setupc C s ddgS )N
IP_ADDRESSAFFILIATE_IPADDRr r r r r
watchedEvents? s z sfp_multiproxy.watchedEventsc C s dgS )N*MALICIOUS_IPADDRMALICIOUS_AFFILIATE_IPADDRr r! r r r producedEventsF s z sfp_multiproxy.producedEventsc C s t |dkrB|D ]0}t||tjtjB r| jd| dS qt |dkr|D ]0}t||tjtjB rR| jd| dS qR| jd d S )Nr z#Found to be bad against bad regex: Tz$Found to be good againt good regex: Fz Neither good nor bad, unknown.)lenrematch
IGNORECASEDOTALLr debug)r content goodregexbadregexrxr r r contentMaliciousJ s z sfp_multiproxy.contentMaliciousc C s | j d| d | tt D ]}t| d }||kr$t| d dkr$tt| d }| j j||| jd | jd d }|d
d kr| j d || d d S |
|d
t| d
t| d r$|| S q$d S )Nz Querying z for maliciousness of r
r queryr
_fetchtimeout
_useragenttimeout useragentr+ Unable to fetch Fr, r- ) r r* r malchecksr strfetchUrlformatr errorr/ )r r
target
targetTypecheckcidr
resr r r
resourceQuery^ s $
z sfp_multiproxy.resourceQueryc C s d}|dkr | j || jd }tt D ]t}t| d }||kr,t| d dkr,t }t| d }| j d| | jd d
|d < |d d kr| j j || jd | jd
d}|d d kr| j
d| d d S | j d| |d |dkrNt } dt| krt| d dd}
t
|
t
j} | j d| d |
|d dD ].} t
| | }
t|
d
krR| |
d
qRn|d d} | D ]}t|dk s|drq| }z@t|t|kr| j |d | d | |W S W nB tk
rB } z"| j d t| W Y qW 5 d }~X Y nX q d S dt| kr|d dD ]P} | |ks|dkrj| |krj| j |d | d | d | S qjq,ztt| d |}tt| d |}|d dD ]b} |dkrt
|| t
js,t
|| t
jr| j |d | d | d | W S qW q, t k
r } z | j d t| W Y q,W 5 d }~X Y q,X q,d S )!N domain
_internettldsr
r r r
sfmal_r r r+ r1 r2 r3 r6 Fnetblockr z{0}z(\d+\.\d+\.\d+\.\d+)zNew regex for z:
#z found within netblock/subnet z in zError encountered parsing: /z
found in z list.z Error encountered parsing 2: ) r
hostDomainr r r7 r dictcacheGetgetr9 r; cachePutreplacer& compiler( r* splitfindallr% append
startswithstripr r Exceptionr8 r: r'
BaseException)r r
r< r= targetDomr> r? datar
iplistr. patlinegrpr erxDomrxTgtr r r resourceListp s
zsfp_multiproxy.resourceListc C s t t D ]}t| d }||kr |t| d kr | jd| d | d | t| d dkrv| ||| S t| d dkr | ||| S q d S ) Nr
r zChecking maliciousness of z (z) with: r r0 r )r r7 r r r* rA rb )r
resourceIditemTyper< r> r? r r r
lookupItem s zsfp_multiproxy.lookupItemc C sv |j }|j}|j}| jd| d | || jkrL| jd| d d S d| j|< |dkrp| jddspd S |d kr| jd
dsd S tt
D ]}t | d }| j| r|d krd
}|dkrd}nd}|dkrd}d}|dkrd}|dkrd}|dkrd}|dkrd}| |||} | r2 d S | d k r|d | d d | d }
t
||
| j|} | | qd S ) NzReceived event, z, from z Skipping z, already checked.TCO_HOSTED_SITE checkcohostsFr r r
)r r r r MALICIOUS_IPADDRMALICIOUS_AFFILIATE_IPADDR) BGP_AS_OWNER
BGP_AS_MEMBERasn
MALICIOUS_ASN)
INTERNET_NAMErf AFFILIATE_INTERNET_NAMErC rn MALICIOUS_INTERNET_NAMEro !MALICIOUS_AFFILIATE_INTERNET_NAMEMALICIOUS_COHOSTz [z]
zz) eventTypemodulerZ r r* r r rN r r7 r re checkForStopr __name__notifyListeners) r event eventName
srcModuleName eventDatar> r? typeIdevtTyper
textevtr r r handleEvent sR
zsfp_multiproxy.handleEvent)rv
__module__ __qualname____doc__r optdescsr rL r r" r$ r/ rA rb re r r r r r r s" Mr )
r& netaddrr r sflibr r r r7 r r r r r
s