Commit graph

15 commits

Author SHA1 Message Date
booboy
50b052a9bd made elastic search helper better and made pastebinner pack json 2019-02-01 22:19:36 -06:00
booboy
c72f8c9a5f put files in pastebinner dir 2019-01-28 23:58:30 -06:00
booboy
9a4f1251dd fixed an issue that was occurring with downloading the raw pastes 2019-01-06 20:21:35 -06:00
booboy
46526a21e9 made pry console startup with just a pb object for easy experimentation with the methods 2019-01-06 19:26:16 -06:00
booboy
ce9626655a made an error if only -k --key is passed 2018-11-17 19:04:12 -06:00
booboy
fa41c0cb7f encode_json method and a 1 character change in the filename check 2018-11-10 04:31:32 -06:00
booboy
ef312d12cf added a method that we will later use to serialize the raw paste into json so we can ship it to a DB 2018-11-10 04:27:25 -06:00
booboy
c4fde291e4 made an actual readme to explain how to download pastes 2018-11-09 22:53:09 -06:00
booboy
4c43f54e96 added an option_parser class to use with the command line binary 2018-11-09 01:51:21 -06:00
booboy
5aa45e28c3 fixed a part of the commandline options 2018-11-05 03:39:00 -06:00
booboy
4853f92ecd wrote a method to download all the raw pastes to a file inside of a directory.
added a --download and -d shorthand switch to download the raw paste files from a public scrape.
i need to check to make sure that it is the correct way to do it, and also check to see if a filename exists already.
this will prevent duplicate files from being downloaded.
2018-11-05 03:15:29 -06:00
booboy
ebde6ca0f2 messed with the cmd line options, some work now 2018-11-04 02:59:25 -06:00
booboy
eae20ccd0c started to work on the command line application
added
-- raw
-- scrape_public_pastes
-- list_trending (still broken though. need to fix the api call)
-- added a method to extract just the keys from public pastes
-- moved the previous tests to an examples.rb file

need to mess around with all the different ways to parse arguments for the
command line program.
2018-11-04 02:28:57 -06:00
kenna-bmcdevitt
2be2d4419c fixed naming conventions and set this up to begin working on command line calls 2018-08-22 15:03:42 -05:00
booboy
da6c789a5c initial commit 2018-08-16 14:54:08 -05:00