U
@6^ @ sD d dl Z d dlZd dlmZ d dlmZmZmZ G dd deZdS ) N)
HTMLParser)
SpiderFootSpiderFootPluginSpiderFootEventc @ sR e Zd ZdZddiZddiZdZe fddZdd Z d
d Z
d d
Z dd Z dS )sfp_wikipediaeditszWikipedia Edits:Footprint,Investigate,Passive:Secondary Networks::Identify edits to Wikipedia articles made from a given IP address or username.
days_limit365z;Maximum age of data to be considered valid (0 = unlimited).Nc C s: || _ | | _d| _t| D ]}|| | j|< q"d S )NZ Wikipedia)sf tempStorageresults__dataSource__listkeysopts)selfsfcuserOptsopt r =/var/www/spiderfoot.crq.systems/modules/sfp_wikipediaedits.pysetup% s
zsfp_wikipediaedits.setupc C s ddgS )N
IP_ADDRESSUSERNAMEr r r r r
watchedEvents1 s z sfp_wikipediaedits.watchedEventsc C s dgS )NWIKIPEDIA_PAGE_EDITr r r r r producedEvents5 s z!sfp_wikipediaedits.producedEventsc
C s8 d| }| j d dkr^tj tjt| j d d }|d}|d}|d| d | 7 }| jj|| j d d
d }|d d
krd S t }zft }|d sW d S |d
dD ]<} t d| t j
}
|
D ]"}d|krq||} || qq|W S tk
r2 } z | jdt| d W Y d S d } ~ X Y nX d S )NzAhttps://en.wikipedia.org/w/api.php?action=feedcontributions&user=r 0)daysz%Yz%mz&year=z&month=
_fetchtimeoutr )timeout useragentcode)404403500content
z(.*?)zSpecial:Contributionsz*Error processing response from Wikipedia: F)r datetimenow timedeltaintstrftimer fetchUrlr
r splitrefindall
IGNORECASEunescapeappend Exceptionerrorstr)
r qryurldtymreslinksparserlinematchesder r r query8 s6
zsfp_wikipediaedits.queryc C s |j }|j}|j}| jd| d | || jkrL| jd| d d S d| j|< | |}|d krld S |D ] }td|| j|}| | qpd S )NzReceived event, z, from z Skipping z as already mapped.Tr )
eventTypemoduledatar debugr rC r __name__notifyListeners)r event eventName
srcModuleName eventDatarF lrB r r r handleEventW s"
z sfp_wikipediaedits.handleEvent)
rH
__module__ __qualname____doc__r optdescsr dictr r r rC rO r r r r r s r ) r( r/ html.parserr sflibr r r r r r r r
s