booboy
6c0b401d23
added the type of config block i want to have. not ready but setup a skeleton to use with it
2019-02-05 00:30:50 -06:00
booboy
0415c64960
made a paste_max limit option so you can query how many pastes you want
2019-02-04 22:45:26 -06:00
booboy
e104b0b015
good additions, got nested object working by loading paste_metadata as an array of hash instead of a string
2019-02-03 02:09:51 -06:00
booboy
fafd8268c0
added the ability to download either raw pastes or the full metadata + pastetext in one json document
2019-02-02 04:17:17 -06:00
booboy
e580c572f7
removed old mapping from pastebinner and also adjusted download to include metadata and fulltext of paste in the json
2019-02-02 03:52:56 -06:00
booboy
50b052a9bd
made elastic search helper better and made pastebinner pack json
2019-02-01 22:19:36 -06:00
booboy
c72f8c9a5f
put files in pastebinner dir
2019-01-28 23:58:30 -06:00
booboy
9a4f1251dd
fixed an issue that was occurring with downloading the raw pastes
2019-01-06 20:21:35 -06:00
booboy
46526a21e9
made pry console startup with just a pb object for easy experimentation with the methods
2019-01-06 19:26:16 -06:00
booboy
ce9626655a
made an error if only -k --key is passed
2018-11-17 19:04:12 -06:00
booboy
fa41c0cb7f
encode_json method and a 1 character change in the filename check
2018-11-10 04:31:32 -06:00
booboy
ef312d12cf
added a method that we will later use to serialize the raw paste into json so we can ship it to a DB
2018-11-10 04:27:25 -06:00
booboy
c4fde291e4
made an actual readme to explain how to download pastes
2018-11-09 22:53:09 -06:00
booboy
4c43f54e96
added an option_parser class to use with the command line binary
2018-11-09 01:51:21 -06:00
booboy
5aa45e28c3
fixed a part of the commandline options
2018-11-05 03:39:00 -06:00
booboy
4853f92ecd
wrote a method to download all the raw pastes to a file inside of a directory.
...
added a --download and -d shorthand switch to download the raw paste files from a public scrape.
i need to check to make sure that it is the correct way to do it, and also check to see if a filename exists already.
this will prevent duplicate files from being downloaded.
2018-11-05 03:15:29 -06:00
booboy
ebde6ca0f2
messed with the cmd line options, some work now
2018-11-04 02:59:25 -06:00
booboy
eae20ccd0c
started to work on the command line application
...
added
-- raw
-- scrape_public_pastes
-- list_trending (still broken though. need to fix the api call)
-- added a method to extract just the keys from public pastes
-- moved the previous tests to an examples.rb file
need to mess around with all the different ways to parse arguments for the
command line program.
2018-11-04 02:28:57 -06:00
kenna-bmcdevitt
2be2d4419c
fixed naming conventions and set this up to begin working on command line calls
2018-08-22 15:03:42 -05:00
booboy
da6c789a5c
initial commit
2018-08-16 14:54:08 -05:00
