3
@6^C @ s0 d dl Z d dlmZmZmZ G dd deZdS ) N)
SpiderFootSpiderFootPluginSpiderFootEventc @ sB e Zd ZdZi Zi ZdZe fddZdd Z dd Z
d d
Z dS ) sfp_webanalyticszWeb Analytics:Footprint,Investigate,Passive:Content Analysis::Identify web analytics IDs in scraped webpages and DNS TXT records.Nc C s8 || _ | j | _x"t|j D ]}|| | j|< q W d S )N)sf tempStorageresultslistkeysopts)selfsfcuserOptsopt r ;/var/www/spiderfoot.crq.systems/modules/sfp_webanalytics.pysetup s
zsfp_webanalytics.setupc C s ddgS )NTARGET_WEB_CONTENTDNS_TEXTr )r r r r
watchedEvents" s z sfp_webanalytics.watchedEventsc C s dgS )NWEB_ANALYTICS_IDr )r r r r producedEvents& s z sfp_webanalytics.producedEventsc C s |j }|j}|j}| jj|}|| jkr@| jjd| d d S d| j|< | jjd| d | |dkrtjd|tj }xj|D ]b}|j
j drq|j
j d rq|j
j d
rq| jjd | t d d
| | j
|}| j| qW tjd|tj }xL|D ]D}|j
j drq| jjd| t d d| | j
|}| j| qW tjd|tj }x<|D ]4}| jjd| t d d| | j
|}| j| q\W tjd|tj }x<|D ]4}| jjd| t d d| | j
|}| j| qW d|kr:tjd|tj }x<|D ]4}| jjd| t d d| | j
|}| j| qW tjd|tj }x<|D ]4}| jjd| t d d | | j
|}| j| qPW |d k rtjd |j tj }x,|D ]$}t d d| | j
|}| j| qW tjd |j tj }x,|D ]$}t d d | | j
|}| j| qW tjd!|j tj }x,|D ]$}t d d | | j
|}| j| q0W tjd"|j tj }x,|D ]$}t d d#| | j
|}| j| qrW tjd$|j tj }x,|D ]$}t d d%| | j
|}| j| qW tjd&|j tj }x,|D ]$}t d d'| | j
|}| j| qW tjd(|j tj }x,|D ]$}t d d)| | j
|}| j| q8W tjd*|j tj }x,|D ]$}t d d)| | j
|}| j| qzW tjd+|j tj }x,|D ]$}t d d,| | j
|}| j| qW tjd-|j tj }x,|D ]$}t d d.| | j
|}| j| qW tjd/|j tj }x,|D ]$}t d d0| | j
|}| j| q@W tjd1|j tj }x,|D ]$}t d d2| | j
|}| j| qW tjd3|j tj }x,|D ]$}t d d4| | j
|}| j| qW tjd5|j tj }x,|D ]$}t d d6| | j
|}| j| qW tjd7|j tj }x,|D ]$}t d d8| | j
|}| j| qHW tjd9|j tj }x,|D ]$}t d d:| | j
|}| j| qW tjd;|j tj }x,|D ]$}t d d<| | j
|}| j| qW tjd=|j tj }x,|D ]$}t d d | | j
|}| j| qW tjd>|j tj }x,|D ]$}t d d?| | j
|}| j| qPW tjd@|j tj }x,|D ]$}t d dA| | j
|}| j| qW tjdB|j tj }x,|D ]$}t d dC| | j
|}| j| qW tjdD|j tj }x,|D ]$}t d dE| | j
|}| j| qW tjdF|j tj }x,|D ]$}t d dG| | j
|}| j| qXW tjdH|j tj }x,|D ]$}t d dI| | j
|}| j| qW tjdJ|j tj }x,|D ]$}t d dK| | j
|}| j| qW d S )LNz Skipping z as already mapped.TzReceived event, z, from r z\bua\-\d{4,10}\-\d{1,4}\bz
ua-000000-z
ua-123456-z ua-12345678zGoogle Analytics match: r zGoogle Analytics: z\b(pub-\d{10,20})\bz pub-12345678zGoogle AdSense match: zGoogle AdSense: zG s