bpmcdevitt/data_importer
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
This is a rails/postgres application that will serve json data from the following data sources: - Cves - Cpes - CNA security advisories - GHSA Github security advisories - Github repositories that track public exploits for cves. - A list of github usernames github API data.
19 commits 1 branch 0 tags 266 KiB
Ruby 89.8%
HTML 7.1%
JavaScript 1.2%
CSS 0.7%
Dockerfile 0.6%
Other 0.6%
Find a file
Brendan McDevitt 73cdaabe3a add support for trickest poc cve github repo
2022-04-07 01:51:44 -05:00
app add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00
bin make json rendering for cpes and cves 2022-04-04 13:18:03 -05:00
config add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00
db add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00
lib add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00
log init commit rails new data_importer 2022-03-30 22:12:56 -05:00
public init commit rails new data_importer 2022-03-30 22:12:56 -05:00
storage init commit rails new data_importer 2022-03-30 22:12:56 -05:00
test make json rendering for cpes and cves 2022-04-04 13:18:03 -05:00
tmp init commit rails new data_importer 2022-03-30 22:12:56 -05:00
vendor init commit rails new data_importer 2022-03-30 22:12:56 -05:00
.gitignore add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00
.ruby-version init commit rails new data_importer 2022-03-30 22:12:56 -05:00
config.ru init commit rails new data_importer 2022-03-30 22:12:56 -05:00
docker-compose.yml add base support for trickest poc cves to github 2022-04-06 22:31:52 -05:00
Dockerfile added files for importing cves from cvelist repo to database 2022-04-01 13:36:20 -05:00
entrypoint.sh docker-compose and postgres basic rails app skeleton 2022-03-30 22:52:39 -05:00
Gemfile add base support for trickest poc cves to github 2022-04-06 22:31:52 -05:00
Gemfile.lock add base support for trickest poc cves to github 2022-04-06 22:31:52 -05:00
package.json init commit rails new data_importer 2022-03-30 22:12:56 -05:00
Rakefile init commit rails new data_importer 2022-03-30 22:12:56 -05:00
README.md add support for trickest poc cve github repo 2022-04-07 01:51:44 -05:00

README.md

data_importer

Import common security data such as CVE, CPE, and Security Advisories from various CNAs into a rails app with a postgresql db backend.

Supported data models:

  • Cve data from cve_list github repo.
  • Cpe data from nvd 2.2 format.
  • GithubPoc data from nomi-sec github repo.
  • InthewildCveExploit data from inthewild.io exploited feed.
  • TrickestPocCve data from trickest github repo.

Initial Setup

Build container

docker-compose build

Database creation and seeding initial data

docker-compose run web rake db:create
docker-compose run web rake db:migrate
docker-compose run web rake db:seed

Launch Pry console

docker-compose run web rails console

HTTP API

For now unauthenticated api over localhost:3000 until I put in some basic token auth. All response data is json rendered.

Cves

  get "/cves", to: "cves#index"
  get "/cves/:cve_id", to: "cves#show"
  get "/cves/years/:year", to: "cves#show_year"

Cpes

  get "/cpes", to: "cpes#index"
  get "/cpes/:id", to: "cpes#show"

GithubPocs

  get "/github_pocs", to: "github_pocs#index"
  get "/github_pocs/:id", to: "github_pocs#show"
  get "/github_pocs/cve/:cve_id", to: "github_pocs#show_for_cve"
  get "/github_pocs/years/:year", to: "github_pocs#show_year"

InthewildCveExploits

  get "/inthewild_cve_exploits", to: "inthewild_cve_exploits#index"
  get "/inthewild_cve_exploits/:cve_id", to: "inthewild_cve_exploits#show"

TrickestPocCves

  get "/trickest_poc_cves", to: "trickest_poc_cves#index"
  get "/trickest_poc_cves/:id", to: "trickest_poc_cves#show"
  get "/trickest_poc_cves/cve/:cve_id", to: "trickest_poc_cves#show_for_cve"
  get "/trickest_poc_cves/years/:year", to: "trickest_poc_cves#show_year"