Are you happy with your logging solution? Would you help us out by taking a 30-second survey? Click here

nipspreview

Scripts that generate .html to more easily see NIPS papers

Subscribe to updates I use nipspreview


Statistics on nipspreview

Number of watchers on Github 120
Number of open issues 2
Average time to close an issue less than a minute
Main language Python
Open pull requests 1+
Closed pull requests 0+
Last commit over 6 years ago
Repo Created over 6 years ago
Repo Last Updated over 1 year ago
Size 165 KB
Organization / Authorkarpathy
Contributors1
Page Updated
Do you use nipspreview? Leave a review!
View open issues (2)
View nipspreview activity
View on github
Fresh, new opensource launches 🚀🚀🚀
Trendy new open source projects in your inbox! View examples

Subscribe to our mailing list

Evaluating nipspreview for your project? Score Explanation
Commits Score (?)
Issues & PR Score (?)

NIPS papers pretty html

This is a set of scripts for creating nice preview page (see here: http://cs.stanford.edu/~karpathy/nipspreview/ ) for all papers published at NIPS. I hope these scripts can be useful to others to create similar pages for other conferences. They show how one can manipulate PDFs, extract image thumbnails, analyze word frequencies, do AJAX requests to load abstracts, etc.

Installation

  1. Clone this repository git clone https://github.com/karpathy/nipspreview.git

  2. Download nips25offline from http://books.nips.cc/nips25.html and move it into the folder created in step 0

  3. Make sure you have ImageMagick: sudo apt-get install imagemagick

  4. Run pdftowordcloud.py (to generate top words for each paper. Output saved in topwords.p as pickle)

  5. Run pdftothumbs.py (to generate tiny thumbnails for all papers. Outputs saved in thumbs/ folder)

  6. Run scrape.py (to generate paperid, title, authors list by scraping NIPS .html page)

  7. Run makecorpus.py (to create allpapers.txt file that has all papers one per row)

  8. Run python lda.py -f allpapers.txt -k 7 --alpha=0.5 --beta=0.5 -i 100 . This will generate a pickle file called ldaphi.p that contains the LDA word distribution matrix. Thanks to this nice LDA code by shuyo! It requires nltk library and numpy. In this example we are using 7 categories. You would need to change the nipsnice_template.html file a bit if you wanted to try different number of categories.

  9. Generate the abstract files inside abstracts/ folder using getabstracts.py. Some user interaction may be necessary because of poorly formatted papers that make abstract extraction a pain. See script.

  10. Finally, run generatenicelda.py (to create the nipsnice.html page)

Licence

WTFPL licence

nipspreview open pull requests (View All Pulls)
  • Automatically download all papers
nipspreview list of languages used
Other projects in Python