3
@6^$ @ s0 d dl Z d dlmZmZmZ G dd deZdS ) N)
SpiderFootSpiderFootPluginSpiderFootEventc @ sN e Zd ZdZddiZddiZe fddZdd Zd d
Z d d Z
d
d Z dS )
sfp_githubz^Github:Footprint,Passive:Social Media::Identify associated public code repositories on Github. namesonlyTzYMatch repositories by name only, not by their descriptions. Helps reduce false positives.c C s8 || _ | j | _x"t|j D ]}|| | j|< q W d S )N)sf tempStorageresultslistkeysopts)selfsfcuserOptsopt r 5/var/www/spiderfoot.crq.systems/modules/sfp_github.pysetup s
zsfp_github.setupc C s
dddgS )N DOMAIN_NAMEUSERNAME SOCIAL_MEDIAr )r
r r r
watchedEvents& s zsfp_github.watchedEventsc C s
dddgS )N RAW_RIR_DATAGEOINFOPUBLIC_CODE_REPOr )r
r r r producedEvents, s zsfp_github.producedEventsc C s d }|j dd kr"| jjd d S |j dd kr@| jjd d S |j dd kr^| jjd d S d|d d d |d d d
|d }|S ) Nnamez+Incomplete Github information found (name).html_urlz*Incomplete Github information found (url). descriptionz2Incomplete Github information found (description).zName:
zURL: z
Description: )getr debug)r
item repo_infor r r
buildRepoInfo0 s ,zsfp_github.buildRepoInfoc [ C s |j }|j}|j}|| jkr4| jjd| d d S d| j|< |dkrly0|jdd }|jdd jdd jd
d }W nB tk
r } z&| jj d | d t
| d
d d S d }~X nX |dks| jjd| d d S y |jd}|t |d } W n2 tk
r, } z| jjd| d S d }~X nX | jj d| | j
d | j
d d}
|
d d krbd S ytj|
d } W n. tk
r } z| jjd d S d }~X nX | jds| jj| d d S | jd s| jj| d d S td d | d | j|}| j| | jd } | d kr d S t | d k s:t | d!krN| jjd"| d S td#| | j|}| j| d S |d$kr| jj|| j
d% } |d&kr|} | jjd'| d}
d(| }| jj || j
d | j
d d}
|
d d kr| jj d)| d d}
ytj|
d }W n( tk
r0 } z
d }W Y d d }~X nX |d krR| jj d*| d d}
|
s|jd+d,d,ks|t |d- dkr| jjd.| d}
|
sx^|d- D ]R}| j|}|d kr| j
d/ r| |d krqtd0|| j|}| j| qW d}
d1| }| jj || j
d | j
d d}
|
d d krD| jj d)| d d}
|
sy2tj|
d }|d krz| jj d*| d d}
W n: tk
r } z | jj d2| d d}
W Y d d }~X nX |
s|jd+d,d,kst |d- dkr| jjd.| d}
|
sx|d- D ]|}|jd3d kr.| jjd4 q|d3 }| jj || j
d | j
d d}
|
d d krx| jj d)| d qytj|
d }W n6 tk
r } z| jj d5d wW Y d d }~X nX |d kr| jj d*| d qx|D ]}t|tkr
| jjd6 q| j|}|d kr| j
d/ r<|d | kr<q|d&krdd| d |jd7d krdqtd0|| j|}| j| qW qW d S )8NzAlready did a search for z , skipping.Tr z: r z zz Unable to parse SOCIAL_MEDIA: z ()FZGithubz!Skipping social network profile, z, as not a Github profile/z Couldn't get a username out of z https://api.github.com/users/
_fetchtimeout
_useragent)timeout useragentcontentz Error processing JSON response.loginz is not a valid Github profiler r zPossible full name: location d z"Skipping likely invalid location: r r
_internettldsr z Looking at z-https://api.github.com/search/repositories?q=zUnable to fetch z2Unable to process empty response from Github for: Z total_count0itemszNo Github information for r r z&https://api.github.com/search/users?q=z4Unable to process invalid response from Github for: Z repos_urlz0Incomplete Github information found (repos_url).z"Invalid JSON returned from Github.z8Encountered an unexpected or empty response from Github.r ) eventTypemoduledatar r r! splitreplace
BaseExceptionerrorstrlenfetchUrlr jsonloadsr r __name__notifyListeners
domainKeywordr$ typedict)r
event eventName
srcModuleName eventDatanetworkurlebitsr resZ json_datar/ failedretr" r# evtZrepretr r r handleEventC s
"
"
$
$
$
zsfp_github.handleEventN) rA
__module__ __qualname____doc__r optdescsrE r r r r$ rR r r r r r s r )r? sflibr r r r r r r r s