Reproducibility Snapshot
Captured: 2026-01-13T08:50:00Z
Platform: Darwin (macOS), Apple Silicon
Test Results Summary
pytest (excluding FAISS tests)
29 passed, 191 warnings in 2.05s| Test Suite | Tests | Status |
|---|---|---|
| TestGroverCorrectness | 4 | PASS |
| TestHAMCorrectness | 4 | PASS |
| TestComplexityBounds | 3 | PASS |
| TestTheoreticalFormulas | 2 | PASS |
| TestGroverCrossValidation | 3 | PASS |
| TestStatisticalValidation | 2 | PASS |
| TestComplexityCrossValidation | 2 | PASS |
| TestGroverHardware | 2 | PASS |
| TestNoiseImpact | 1 | PASS |
| TestHardwareReadiness | 2 | PASS |
| TestGroverQuantumInspire | 2 | PASS |
| TestBackendComparison | 1 | PASS |
| TestQuantumInspireConfig | 1 | PASS |
Note: FAISS tests skipped due to segmentation fault on Apple Silicon (M-series).
Benchmark Results Summary
Scaling Analysis (Operations Count)
| N docs | Classical | Grover | HAM | Grover Speedup | HAM Speedup |
|---|---|---|---|---|---|
| 10 | 10 | 3.7 | 1 | 2.7x | 10x |
| 50 | 50 | 2 | 1 | 25x | 50x |
| 100 | 100 | 2 | 1 | 50x | 100x |
| 500 | 500 | 2 | 1 | 250x | 500x |
| 1000 | 1000 | 2 | 1 | 500x | 1000x |
| 2000 | 2000 | 2 | 1 | 1000x | 2000x |
Wall-Clock Latency (Average)
| N docs | Classical | Grover | HAM | QKNN | Hybrid |
|---|---|---|---|---|---|
| 10 | 0.04ms | 1.83ms | 0.05ms | 0.06ms | 0.18ms |
| 50 | 0.04ms | 2.03ms | 0.05ms | 0.16ms | 0.34ms |
| 100 | 0.05ms | 2.74ms | 0.05ms | 0.27ms | 0.54ms |
| 500 | 0.08ms | 11.63ms | 0.08ms | 1.22ms | 0.58ms |
| 1000 | 0.12ms | 24.19ms | 0.13ms | 2.32ms | 0.64ms |
| 2000 | 0.18ms | 64.77ms | 0.34ms | 5.68ms | 0.82ms |
Note: Wall-clock times are simulator overhead, not indicative of quantum advantage. See ops-count for algorithmic scaling.
Retrieval Quality (Recall@5)
| N docs | Classical | Grover | HAM | QKNN | Hybrid |
|---|---|---|---|---|---|
| 10 | 71.4% | 57.1% | 42.9% | 71.4% | 42.9% |
| 50 | 65.7% | 22.9% | 14.3% | 57.1% | 14.3% |
| 100 | 34.3% | 17.1% | 2.9% | 37.1% | 20.0% |
| 500 | 2.9% | 2.9% | 0.0% | 5.7% | 2.9% |
| 1000 | 0.0% | 2.9% | 2.9% | 0.0% | 2.9% |
| 2000 | 2.9% | 0.0% | 0.0% | 2.9% | 2.9% |
Note: Low recall at scale reflects synthetic document corpus; quality metrics need better embeddings + real corpus.
Environment Snapshots
quantum_env (Main Development)
Python 3.13.6
Key packages:
- qiskit==2.1.2
- qiskit-aer==0.17.2
- qiskit-algorithms==0.4.0
- qiskit-ibm-runtime==0.45.0
- qiskit-quantuminspire==0.14.0
- numpy==2.4.1
- scipy==1.17.0
- faiss-cpu==1.13.2
- pytest==9.0.2<details>
<summary>Full pip freeze (click to expand)</summary>
aiohappyeyeballs==2.6.1
aiohttp==3.13.3
aiosignal==1.4.0
annotated-types==0.7.0
anyio==4.12.1
appnope==0.1.4
argcomplete==3.6.3
argon2-cffi==25.1.0
argon2-cffi-bindings==25.1.0
arrow==1.4.0
asttokens==3.0.1
async-lru==2.0.5
attrs==25.4.0
autobahn==25.12.2
babel==2.17.0
beautifulsoup4==4.14.3
bleach==6.3.0
broadbean==0.14.0
cbor2==5.8.0
certifi==2026.1.4
cf_xarray==0.10.10
cffi==2.0.0
charset-normalizer==3.4.4
click==8.3.1
cloudpickle==3.1.2
colorama==0.4.6
comm==0.2.3
contourpy==1.3.3
coreapi==2.3.3
coreschema==0.0.4
coverage==7.13.1
cryptography==46.0.3
cycler==0.12.1
dask==2025.12.0
dataclasses-json==0.6.7
debugpy==1.8.19
decorator==5.2.1
defusedxml==0.7.1
dill==0.4.0
dnspython==2.8.0
executing==2.2.1
faiss-cpu==1.13.2
fastjsonschema==2.21.2
fonttools==4.61.1
fqdn==1.5.1
frozenlist==1.8.0
fsspec==2026.1.0
h11==0.16.0
h5netcdf==1.7.3
h5py==3.15.1
httpcore==1.0.9
httpx==0.28.1
hyperlink==21.0.0
ibm-cloud-sdk-core==3.24.2
ibm-platform-services==0.72.0
idna==3.11
importlib_metadata==8.7.1
iniconfig==2.3.0
ipykernel==7.1.0
ipython==9.9.0
ipython_pygments_lexers==1.1.1
ipywidgets==8.1.8
isoduration==20.11.0
itypes==1.2.0
jedi==0.19.2
Jinja2==3.1.6
joblib==1.5.3
json5==0.13.0
jsonpointer==3.0.0
jsonschema==4.26.0
jsonschema-specifications==2025.9.1
jupyter==1.1.1
jupyter-console==6.6.3
jupyter-events==0.12.0
jupyter-lsp==2.3.0
jupyter_client==8.8.0
jupyter_core==5.9.1
jupyter_server==2.17.0
jupyter_server_terminals==0.5.3
jupyterlab==4.5.2
jupyterlab_pygments==0.3.0
jupyterlab_server==2.28.0
jupyterlab_widgets==3.0.16
kiwisolver==1.4.9
lark==1.3.1
libqasm==1.2.1
locket==1.0.0
MarkupSafe==3.0.3
marshmallow==3.26.2
matplotlib==3.10.8
matplotlib-inline==0.2.1
mistune==3.2.0
msgpack==1.1.2
multidict==6.7.0
mypy_extensions==1.1.0
nbclient==0.10.4
nbconvert==7.16.6
nbformat==5.10.4
nbimporter==0.3.4
nest-asyncio==1.6.0
networkx==3.6.1
notebook==7.5.1
notebook_shim==0.2.4
numpy==2.4.1
opensquirrel==0.8.0
opentelemetry-api==1.39.1
packaging==25.0
pandas==2.3.3
pandocfilters==1.5.1
parso==0.8.5
partd==1.4.2
pexpect==4.9.0
pillow==12.1.0
pipx==1.8.0
platformdirs==4.5.1
pluggy==1.6.0
prometheus_client==0.23.1
prompt_toolkit==3.0.52
propcache==0.4.1
psutil==7.2.1
ptyprocess==0.7.0
pure_eval==0.2.3
py-ubjson==0.16.1
pyarrow==22.0.0
pycparser==2.23
pydantic==2.12.5
pydantic_core==2.41.5
Pygments==2.19.2
PyJWT==2.10.1
pylatexenc==2.10
pymongo==4.16.0
pyparsing==3.3.1
pyserial==3.5
pyspnego==0.12.0
pytest==9.0.2
python-dateutil==2.9.0.post0
python-dotenv==1.2.1
python-json-logger==4.0.0
pytz==2025.2
PyVISA==1.15.0
PyYAML==6.0.3
pyzmq==27.1.0
qcodes==0.54.4
qcodes_contrib_drivers==0.23.0
qi-compute-api-client==0.50.0
qilib==0.3.12
qiskit==2.1.2
qiskit-aer==0.17.2
qiskit-algorithms==0.4.0
qiskit-ibm-runtime==0.45.0
qiskit-quantuminspire==0.14.0
quantuminspire==2.3.0
referencing==0.37.0
requests==2.32.5
requests_ntlm==1.3.0
rfc3339-validator==0.1.4
rfc3986-validator==0.1.1
rfc3987-syntax==1.1.0
rpds-py==0.30.0
ruamel.yaml==0.19.1
rustworkx==0.17.1
schema==0.7.8
scikit-learn==1.8.0
scipy==1.17.0
Send2Trash==2.0.0
Serialize==0.2.1
setuptools==80.9.0
six==1.17.0
soupsieve==2.8.1
spirack==0.2.8
stack-data==0.6.3
stevedore==5.6.0
tabulate==0.9.0
terminado==0.18.1
threadpoolctl==3.6.0
tinycss2==1.4.0
toolz==1.1.0
tornado==6.5.4
tqdm==4.67.1
traitlets==5.14.3
txaio==25.12.2
typing-inspect==0.9.0
typing-inspection==0.4.2
typing_extensions==4.15.0
tzdata==2025.3
ujson==5.11.0
uncertainties==3.2.4
uri-template==1.3.0
uritemplate==4.2.0
urllib3==2.6.3
userpath==1.9.2
versioningit==3.3.0
wcwidth==0.2.14
webcolors==25.10.0
webencodings==0.5.1
websocket-client==1.9.0
websockets==16.0
widgetsnbextension==4.0.15
xarray==2025.12.0
yarl==1.22.0
zipp==3.23.0</details>
qi312_env (Quantum Inspire SDK)
Python 3.12.12
Key packages:
- qiskit==2.1.2
- qiskit-quantuminspire==0.15.0
- qi==3.1.5
- qi-compute-api-client==0.50.0
- numpy==2.4.1
- scipy==1.17.0<details>
<summary>Full pip freeze (click to expand)</summary>
aiohappyeyeballs==2.6.1
aiohttp==3.13.3
aiosignal==1.4.0
annotated-types==0.7.0
argcomplete==3.6.3
attrs==25.4.0
certifi==2026.1.4
charset-normalizer==3.4.4
click==8.3.1
colorama==0.4.6
dill==0.4.0
frozenlist==1.8.0
idna==3.11
libqasm==1.2.1
multidict==6.7.0
networkx==3.6.1
numpy==2.4.1
opensquirrel==0.8.0
packaging==25.0
pipx==1.8.0
platformdirs==4.5.1
propcache==0.4.1
pydantic==2.12.5
pydantic_core==2.41.5
python-dateutil==2.9.0.post0
qi==3.1.5
qi-compute-api-client==0.50.0
qiskit==2.1.2
qiskit-quantuminspire==0.15.0
requests==2.32.5
rustworkx==0.17.1
scipy==1.17.0
six==1.17.0
stevedore==5.6.0
typing-inspection==0.4.2
typing_extensions==4.15.0
urllib3==2.6.3
userpath==1.9.2
yarl==1.22.0</details>
Commands Used
# Tests (excluding FAISS due to segfault)
./quantum_env/bin/python -m pytest tests/ -v --ignore=tests/test_faiss_comparison.py
# Benchmarks
./quantum_env/bin/python progressive_benchmark.py
# Environment snapshots
./quantum_env/bin/python --version && ./quantum_env/bin/pip freeze
./qi312_env/bin/python --version && ./qi312_env/bin/pip freezeFiles Generated
| File | Description |
|---|---|
progressive_benchmark_results.json | Full benchmark data |
benchmark_log.txt | Detailed benchmark log |
docs/reference/REPRODUCIBILITY_SNAPSHOT.md | This file |
Known Issues
1. FAISS segfault on Apple Silicon: test_faiss_comparison.py causes segmentation fault on M-series Macs
2. Qiskit deprecation warnings: Several Qiskit 2.1 deprecation warnings (GroverOperator, MCXGate)
3. Low recall at scale: Synthetic corpus + simple embeddings cause poor quality metrics at 500+ docs
Captured by reproducibility lockdown task (STATUS.json task #1)