|
|
91d7c0f499
|
made basic skeleton for crontab of all workers we have. lets see how it goes then we can tweak from there
|
2022-04-19 01:10:56 -05:00 |
|
|
|
59fba273f6
|
added trickest_poc_cve_importer_worker
|
2022-04-19 00:36:01 -05:00 |
|
|
|
2f28ebae73
|
added poc_in_github_importer_worker
|
2022-04-19 00:34:19 -05:00 |
|
|
|
785a02b53c
|
added inthewild_cve_exploit_importer_worker
|
2022-04-19 00:32:40 -05:00 |
|
|
|
387c869c6e
|
add github_user_importer_worker
|
2022-04-19 00:30:46 -05:00 |
|
|
|
f2396126e3
|
add github_advisory_importer_worker
|
2022-04-19 00:28:04 -05:00 |
|
|
|
941766c9a4
|
add cpe_importer_worker
|
2022-04-19 00:25:44 -05:00 |
|
|
|
dfbca14799
|
added cvemon in a worker now with upsert_all
|
2022-04-19 00:18:29 -05:00 |
|
|
|
44be58eeb3
|
add timestamps and some tricks to make sure i have all of my json keys before upsert_all is run
|
2022-04-18 22:07:22 -05:00 |
|
|
|
9fd17c606a
|
made a json helper to help me snake case / symbolize keys for prep to upsert_all into db
|
2022-04-18 20:01:57 -05:00 |
|
|
|
6f02a95a4a
|
begin with workers. first add a cna worker
|
2022-04-18 17:27:31 -05:00 |
|
|
|
39d4b385e5
|
basic crontab functionality working with faktory
|
2022-04-18 15:44:41 -05:00 |
|
|
|
449301ff58
|
added faktory
|
2022-04-18 15:14:54 -05:00 |
|
|
|
5e3e210f41
|
add a helper script to update github_usernames.txt file in data dir from github poc json data we have stored in our db
|
2022-04-13 10:45:50 -05:00 |
|
|
|
81b290595d
|
update readme
|
2022-04-12 14:55:04 -05:00 |
|
|
|
0ef9cf7a3c
|
make poc_in_github_importer subclass github_repo
|
2022-04-12 14:48:36 -05:00 |
|
|
|
03cadf14d4
|
fix typo
|
2022-04-12 12:34:50 -05:00 |
|
|
|
8ce7d5257c
|
do a github api repository owner lookup and combine that api response with our github user lookup and put it all in GithubUser
|
2022-04-12 12:24:50 -05:00 |
|
|
|
2dfd9981f7
|
make empty data dir
|
2022-04-11 21:04:54 -05:00 |
|
|
|
5e7865ef80
|
readme file update: to explain environment files needed
|
2022-04-11 21:03:35 -05:00 |
|
|
|
baed43201a
|
another readme update
|
2022-04-11 20:57:00 -05:00 |
|
|
|
70330cc355
|
update readme
|
2022-04-11 20:55:11 -05:00 |
|
|
|
d26395def2
|
if you create a text file at ./data/github_usernames.txt with one username per line GithubUserImporter will use this data to import a GithubUser for each one
|
2022-04-11 20:53:20 -05:00 |
|
|
|
db6afbfd59
|
now we pull github security advisories
|
2022-04-11 18:45:02 -05:00 |
|
|
|
4a0ce50305
|
make an importers dir in lib dir
|
2022-04-09 23:08:48 -05:00 |
|
|
|
c3511bf6b5
|
added github api client with graphql
|
2022-04-09 15:49:47 -05:00 |
|
|
|
5b859c6986
|
make query ILIKE instead of LIKE for case insensitive searches like google or Google
|
2022-04-07 18:48:24 -05:00 |
|
|
|
5b1cb76e29
|
do a fuzzy search incase we just wanna do like microsoft/google/one word orgname searches
|
2022-04-07 18:29:52 -05:00 |
|
|
|
4881609ee7
|
add a route to search via orgname
|
2022-04-07 18:26:42 -05:00 |
|
|
|
7ca243b324
|
add support for CNA info
|
2022-04-07 18:15:21 -05:00 |
|
|
|
16ea868013
|
more readme update
|
2022-04-07 04:39:50 -05:00 |
|
|
|
e8401ddedb
|
update readme
|
2022-04-07 04:33:56 -05:00 |
|
|
|
2d729a6999
|
added cvemon data support
|
2022-04-07 04:32:08 -05:00 |
|
|
|
73cdaabe3a
|
add support for trickest poc cve github repo
|
2022-04-07 01:51:44 -05:00 |
|
|
|
752aef6392
|
add base support for trickest poc cves to github
|
2022-04-06 22:31:52 -05:00 |
|
|
|
d81c31febe
|
add more verbosity
|
2022-04-06 02:45:11 -05:00 |
|
|
|
4ae8f9e078
|
update README
|
2022-04-06 02:35:02 -05:00 |
|
|
|
c152086fad
|
small adjustment to the way the inthewild_cve_exploits earliest_report data is stored
|
2022-04-06 02:21:18 -05:00 |
|
|
|
b439d4fc60
|
added a way to pull exploit feed info from inthewild.io exploits feed
|
2022-04-06 02:08:19 -05:00 |
|
|
|
bc06defa7c
|
added controller and view for github_poc
|
2022-04-05 22:22:23 -05:00 |
|
|
|
b91923a9e4
|
added model and working importer for PoC in Github nomi-sec json data into postgres
|
2022-04-05 22:09:21 -05:00 |
|
|
|
8d40ec1665
|
just make cves controller render it all as json for now
|
2022-04-05 12:36:32 -05:00 |
|
|
|
7f8dbc606e
|
experimenting with adding a route to show cves for specific year
|
2022-04-05 12:33:51 -05:00 |
|
|
|
8cbe59f55b
|
make json rendering for cpes and cves
|
2022-04-04 13:18:03 -05:00 |
|
|
|
5c85d95ce3
|
fix typo
|
2022-04-01 14:14:33 -05:00 |
|
|
|
9c42e1a8b3
|
update README
|
2022-04-01 14:10:16 -05:00 |
|
|
|
f075cd0284
|
some adjustments to the cvelist importer migrate and gemfiles
|
2022-04-01 14:07:49 -05:00 |
|
|
|
081bb068d5
|
added files for importing cves from cvelist repo to database
|
2022-04-01 13:36:20 -05:00 |
|
|
|
63636ec562
|
docker-compose and postgres basic rails app skeleton
|
2022-03-30 22:52:39 -05:00 |
|
|
|
91aa86ad99
|
init commit rails new data_importer
|
2022-03-30 22:12:56 -05:00 |
|
