3 @6^@s`ddlZddlZddlZddlZddlZddlZddlZddlmZm Z m Z Gddde Z dS)N) SpiderFootSpiderFootPluginSpiderFootEventc@s\eZdZdZdddddddgd d Zd d d Zd ZefddZddZ ddZ ddZ d S) sfp_filemetazWFile Metadata:Footprint:Content Analysis::Extracts meta data from documents and images.docxpptxpdfjpgjpegtifftifi,)fileextstimeoutzlFile extensions of files you want to analyze the meta data of (only PDF, DOCX, XLSX and PPTX are supported.)z'Download timeout for files, in seconds.NcCs8||_|j|_x"t|jD]}|||j|<qWdS)N)sf tempStorageresultslistkeysopts)selfsfcuserOptsoptr7/var/www/spiderfoot.crq.systems/modules/sfp_filemeta.pysetup)s zsfp_filemeta.setupcCsddgS)NLINKED_URL_INTERNALZINTERESTING_FILEr)rrrr watchedEvents1szsfp_filemeta.watchedEventscCsddgS)NRAW_FILE_META_DATA SOFTWARE_USEDr)rrrrproducedEvents7szsfp_filemeta.producedEventscMCs|j}|j}|j}|jjd|d|||jkr8dSd|j|<x|jdD]}|jrbdSd|j|jkrP|jj ||jd|jdddd }|d dkr|jj d |d dSt |d d kr|jj dt t |d d dSd}d}|jdkry@t j|d } tj| d d} | j}t |}|jjd|WnDtk r} z&|jj d|dt | dd dSd} ~ XnX|jd,krFyjt j|d } tj| } tj|d}|jjdt || jj}| jj} dd|| gD}dj|}WnDtk rD} z&|jj d|dt | dd dSd} ~ XnX|jd-kryjt j|d } tj| } tj|d}|jjdt || jj}| jj} dd|| gD}dj|}WnDtk r} z&|jj d|dt | dd dSd} ~ XnX|jd.kry>t j|d } tj| }|dksDt |dkrFwPt |}WnDtk r} z&|jj d|dt | dd dSd} ~ XnX|dk rP|dk rPtd!||j |}|j!|t"}ytd"|kr|j#t |d"d#|kr|j#t |d#d$|kr|j#t |d$d%|kr8|j#t |d%Wn@tk rz} z"|jj d&|d't | d dSd} ~ XnXxh|D]`}|rt$|tj%j& r|jjd(t |d)jd*d|D}td+||j |}|j!|qWqPWdS)/NzReceived event, z, from Tr .r _useragenti)r useragent dontMangle sizeLimitcontentz(Unable to fetch file for meta analysis: Fiz%Strange content encountered, size of r)strictzObtained meta data from z Unable to parse meta data from: ()rrz Office type: cSsg|] }|r|qSrr).0_frrr ssz,sfp_filemeta.handleEvent..z, zUnable to process file: rcSsg|] }|r|qSrr)r*r+rrrr,sr r r rz /Producerz/Creator ApplicationzImage SoftwarezFailed to parse PDF, z: zVAL: cSs g|]}t|dkr|ndqS) )ord)r*irrrr,sr)r)r)r r r )' eventTypemoduledatardebugrr checkForStoplowerfetchUrlerrorlenstrioBytesIOPyPDF2Z PdfFileReaderZgetDocumentInfo BaseExceptionrZDocument mimetypes guess_typeZcore_propertiesZauthorcommentsjoinrZ PresentationexifreadZ process_filer__name__notifyListenersrappend isinstancegenericZ NullObject)revent eventName srcModuleName eventDatafileExtretmetar5rawrecdocmtypeaevtvalvrrr handleEvent;s                zsfp_filemeta.handleEvent) rF __module__ __qualname____doc__roptdescsrdictrrr r[rrrrrsr) rAr?rrrElxmlr=sflibrrrrrrrrs