U
@6^$ @ s0 d dl Z d dlmZmZmZ G dd deZdS ) N)
SpiderFootSpiderFootPluginSpiderFootEventc @ sN e Zd ZdZddiZddiZe fddZdd Zd d
Z d d Z
d
d Z dS )
sfp_githubz^Github:Footprint,Passive:Social Media::Identify associated public code repositories on Github. namesonlyTzYMatch repositories by name only, not by their descriptions. Helps reduce false positives.c C s4 || _ | | _t| D ]}|| | j|< q d S )N)sf tempStorageresultslistkeysopts)selfsfcuserOptsopt r 5/var/www/spiderfoot.crq.systems/modules/sfp_github.pysetup s
zsfp_github.setupc C s
dddgS )N DOMAIN_NAMEUSERNAME SOCIAL_MEDIAr r
r r r
watchedEvents& s zsfp_github.watchedEventsc C s
dddgS )N RAW_RIR_DATAGEOINFOPUBLIC_CODE_REPOr r r r r producedEvents, s zsfp_github.producedEventsc C s d }| dd kr"| jd d S | dd kr@| jd d S | dd kr^| jd d S d|d d d |d d d
|d }|S ) Nnamez+Incomplete Github information found (name).html_urlz*Incomplete Github information found (url). descriptionz2Incomplete Github information found (description).zName:
zURL: z
Description: )getr debug)r
item repo_infor r r
buildRepoInfo0 s$ zsfp_github.buildRepoInfoc C s |j }|j}|j}|| jkr4| jd| d d S d| j|< |dkrz0|dd }|dd dd d
d }W nJ tk
r } z,| j d | d t
| d
d W Y d S d }~X Y nX |dks| jd| d d S z |d}|t |d } W n: tk
r< } z| jd| W Y d S d }~X Y nX | jj d| | j
d | j
d d}
|
d d krrd S zt|
d } W n6 tk
r } z| jd W Y d S d }~X Y nX | ds| j| d d S | d s| j| d d S td d | d | j|}| | | d } | d kr6d S t | d k sRt | d!krf| jd"| d S td#| | j|}| | d S |d$kr| j|| j
d% } |d&kr|} | jd'| d}
d(| }| jj || j
d | j
d d}
|
d d kr| j d)| d d}
zt|
d }W n( tk
rH } zd }W 5 d }~X Y nX |d krj| j d*| d d}
|
s|d+d,d,kst |d- dkr| jd.| d}
|
s
|d- D ]R}| |}|d kr| j
d/ r| |d krqtd0|| j|}| | qd}
d1| }| jj || j
d | j
d d}
|
d d krX| j d)| d d}
|
sz2t|
d }|d kr| j d*| d d}
W n: tk
r } z| j d2| d d}
W 5 d }~X Y nX |
s
|d+d,d,kst |d- dkr
| jd.| d}
|
s|d- D ]~}|d3d kr>| jd4 q|d3 }| jj || j
d | j
d d}
|
d d kr| j d)| d qzt|
d }W n< tk
r } z | j d5d W Y qW 5 d }~X Y nX |d kr| j d*| d q|D ]}t|tkr | jd6 q| |}|d kr| j
d/ rP|d | krPq|d&krxd| d |d7d krxqtd0|| j|}| | qqd S )8NzAlready did a search for z , skipping.Tr z: r z zz Unable to parse SOCIAL_MEDIA: z ()FZGithubz!Skipping social network profile, z, as not a Github profile/z Couldn't get a username out of z https://api.github.com/users/
_fetchtimeout
_useragent)timeout useragentcontentz Error processing JSON response.loginz is not a valid Github profiler r zPossible full name: location d z"Skipping likely invalid location: r r
_internettldsr z Looking at z-https://api.github.com/search/repositories?q=zUnable to fetch z2Unable to process empty response from Github for: Z total_count0itemszNo Github information for r r z&https://api.github.com/search/users?q=z4Unable to process invalid response from Github for: Z repos_urlz0Incomplete Github information found (repos_url).z"Invalid JSON returned from Github.z8Encountered an unexpected or empty response from Github.r ) eventTypemoduledatar r r" splitreplace
BaseExceptionerrorstrlenfetchUrlr jsonloadsr! r __name__notifyListeners
domainKeywordr% typedict)r
event eventName
srcModuleName eventDatanetworkurlebitsr resZ json_datar0 failedretr# r$ evtZrepretr r r handleEventC sJ
"
"
$
$
$ zsfp_github.handleEventN) rB
__module__ __qualname____doc__r optdescsrF r r r r% rS r r r r r s r )r@ sflibr r r r r r r r s