3
@6^ @ sD d dl Z d dlZd dlmZ d dlmZmZmZ G dd deZdS ) N)
HTMLParser)
SpiderFootSpiderFootPluginSpiderFootEventc @ sR e Zd ZdZddiZddiZdZe fddZdd Z d
d Z
d d
Z dd Z dS )sfp_wikipediaeditszWikipedia Edits:Footprint,Investigate,Passive:Secondary Networks::Identify edits to Wikipedia articles made from a given IP address or username.
days_limit365z;Maximum age of data to be considered valid (0 = unlimited).Nc C s> || _ | j | _d| _x"t|j D ]}|| | j|< q$W d S )NZ Wikipedia)sf tempStorageresults__dataSource__listkeysopts)selfsfcuserOptsopt r =/var/www/spiderfoot.crq.systems/modules/sfp_wikipediaedits.pysetup% s
zsfp_wikipediaedits.setupc C s ddgS )N
IP_ADDRESSUSERNAMEr )r r r r
watchedEvents1 s z sfp_wikipediaedits.watchedEventsc C s dgS )NWIKIPEDIA_PAGE_EDITr )r r r r producedEvents5 s z!sfp_wikipediaedits.producedEventsc
C s4 d| }| j d dkr^tjj tjt| j d d }|jd}|jd}|d| d | 7 }| jj|| j d d
d }|d dkrd S t }yjt }|d sd S xR|d j
dD ]@} t j d| t j
}
x*|
D ]"}d|krq|j|} |j| qW qW |S tk
r. } z| jjdt| d d S d } ~ X nX d S )NzAhttps://en.wikipedia.org/w/api.php?action=feedcontributions&user=r 0)daysz%Yz%mz&year=z&month=
_fetchtimeoutr )timeout useragentcode404403500content
z(.*?)zSpecial:Contributionsz*Error processing response from Wikipedia: F)r" r# r$ )r datetimenow timedeltaintstrftimer fetchUrlr
r splitrefindall
IGNORECASEunescapeappend Exceptionerrorstr)
r qryurldtymreslinksparserlinematchesder r r query8 s4
zsfp_wikipediaedits.queryc C s |j }|j}|j}| jjd| d | || jkrL| jjd| d d S d| j|< | j|}|d krld S x&|D ] }td|| j|}| j | qrW d S )NzReceived event, z, from z Skipping z as already mapped.Tr )
eventTypemoduledatar debugr rB r __name__notifyListeners)r event eventName
srcModuleName eventDatarE lrA r r r handleEventW s
z sfp_wikipediaedits.handleEvent)
rG
__module__ __qualname____doc__r optdescsr dictr r r rB rN r r r r r s r ) r' r. html.parserr sflibr r r r r r r r
s