Skip to content

Testing checklist

Ilya Razenshteyn edited this page Jan 15, 2016 · 9 revisions

Python

  • Download the archive from http://ilyaraz.org/FALCONN-1.1.tar.gz
  • Unzip it
  • Run python setup.py install from the resulting folder; ideally, should be done within a virtual environment (can be easily created via virtualenv); NumPy and setuptools must be installed
  • Run python benchmark/random_benchmark.py from the same folder, report the results
  • Run py.test test/wrapper_test.py from the same folder (for this step, py.test must be installed)
  • Do the above for both Python 2 and Python 3 (ideally, using two fresh virtual environments)
  • Report if something fails and the results of the random benchmark (for both Python 2 and Python 3)

Results

EC2 shared c4.2xlarge instance

Python 2

Average query times (seconds):
  Linear scan time: 9.036553e-02
  HP time: 1.924269e-03
  CP time: 5.111301e-04

Python 3

Average query times (seconds):
  Linear scan time: 9.222833e-02
  HP time: 1.916781e-03
  CP time: 5.030729e-04

Ludwig's mid-2015 Macbook Pro (2.8 GHz Core i7)

Python 2

Average query times (seconds):
  Linear scan time: 2.388043e-02
  HP time: 1.598065e-03
  CP time: 4.569931e-04

Ilya's laptop with Cygwin

Python 3

Average query times (seconds):
  Linear scan time: 1.626506e-01
  HP time: 2.073703e-03
  CP time: 5.876972e-04