You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When invoking query(), we find that the platform is CPU constrained where CPU resources are consumed at fvec_renorm_L2 (faiss/swigfaiss.py), while GPU utilization remains stable.
In this psuedo code above, can normalize_L2 be optimized to utilize GPU?
Additionally, for this case, AVX2 support is not available.
Would AVX2 support provide any performance optimizations to normalize_L2 ?
Platform
OS: Linux
Faiss version: faiss-gpu-1.7.2
Installed from: pip
Faiss compilation options: N/A
Running on:
CPU
GPU
Interface:
C++
Python
Reproduction instructions
The text was updated successfully, but these errors were encountered:
Summary
Running searches against a GPU index using
normalize_L2
is heavily CPU intensive.Please refer to the following psuedo code:
When invoking
query()
, we find that the platform is CPU constrained where CPU resources are consumed atfvec_renorm_L2 (faiss/swigfaiss.py)
, while GPU utilization remains stable.Additionally, for this case, AVX2 support is not available.
Platform
OS: Linux
Faiss version: faiss-gpu-1.7.2
Installed from: pip
Faiss compilation options: N/A
Running on:
Interface:
Reproduction instructions
The text was updated successfully, but these errors were encountered: