Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error Running Server Example #28

Open
BradSmith2015 opened this issue Aug 30, 2023 · 1 comment
Open

Error Running Server Example #28

BradSmith2015 opened this issue Aug 30, 2023 · 1 comment

Comments

@BradSmith2015
Copy link

When I try to run the server example I get an error

bert_load_from_file: loading model from 'models/all-MiniLM-L6-v2/ggml-model-q4_0.bin' - please wait ...
bert_load_from_file: n_vocab = 30522
bert_load_from_file: n_max_tokens   = 512
bert_load_from_file: n_embd  = 384
bert_load_from_file: n_intermediate  = 1536
bert_load_from_file: n_head  = 12
bert_load_from_file: n_layer = 6
bert_load_from_file: f16     = 2
bert_load_from_file: ggml ctx size =  12.26 MB
libc++abi: terminating due to uncaught exception of type std::length_error: basic_string

Running on Mac m1

@jaybinks
Copy link

jaybinks commented Sep 25, 2023

I'm seeing the same, with a checkout from today.

backtrace from debugger

jaybinks@Jays-Mac-mini bert.cpp % sudo lldb ./build/bin/main
Password:
(lldb) target create "./build/bin/main"
Current executable set to '/Users/jaybinks/src/bert.cpp/build/bin/main' (arm64).
(lldb) run  -m models/all-MiniLM-L6-v2/ggml-model-q4_0.bin
Process 86343 launched: '/Users/jaybinks/src/bert.cpp/build/bin/main' (arm64)
bert_load_from_file: loading model from 'models/all-MiniLM-L6-v2/ggml-model-q4_0.bin' - please wait ...
bert_load_from_file: n_vocab = 30522
bert_load_from_file: n_max_tokens   = 512
bert_load_from_file: n_embd  = 384
bert_load_from_file: n_intermediate  = 1536
bert_load_from_file: n_head  = 12
bert_load_from_file: n_layer = 6
bert_load_from_file: f16     = 2
bert_load_from_file: ggml ctx size =  12.26 MB
libc++abi: terminating with uncaught exception of type std::length_error: basic_string
bert_load_from_file: Process 86343 stopped
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
    frame #0: 0x00000001a6dc6868 libsystem_kernel.dylib`__pthread_kill + 8
libsystem_kernel.dylib`:
->  0x1a6dc6868 <+8>:  b.lo   0x1a6dc6888               ; <+40>
    0x1a6dc686c <+12>: pacibsp 
    0x1a6dc6870 <+16>: stp    x29, x30, [sp, #-0x10]!
    0x1a6dc6874 <+20>: mov    x29, sp
(lldb) bt
* thread #1, queue = 'com.apple.main-thread', stop reason = signal SIGABRT
  * frame #0: 0x00000001a6dc6868 libsystem_kernel.dylib`__pthread_kill + 8
    frame #1: 0x00000001a6dfdcec libsystem_pthread.dylib`pthread_kill + 288
    frame #2: 0x00000001a6d362c8 libsystem_c.dylib`abort + 180
    frame #3: 0x00000001a6db6b18 libc++abi.dylib`abort_message + 132
    frame #4: 0x00000001a6da69f4 libc++abi.dylib`demangling_terminate_handler() + 312
    frame #5: 0x00000001a6aab774 libobjc.A.dylib`_objc_terminate() + 160
    frame #6: 0x00000001a6db5eb4 libc++abi.dylib`std::__terminate(void (*)()) + 20
    frame #7: 0x00000001a6db8c2c libc++abi.dylib`__cxxabiv1::failed_throw(__cxxabiv1::__cxa_exception*) + 36
    frame #8: 0x00000001a6db8bd8 libc++abi.dylib`__cxa_throw + 140
    frame #9: 0x0000000100003ee0 main`std::__1::__throw_length_error[abi:v15006](char const*) + 60
    frame #10: 0x0000000100009848 main`std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>>::__throw_length_error[abi:v15006]() const + 20
    frame #11: 0x000000010000835c main`bert_load_from_file + 8632
    frame #12: 0x0000000100003aec main`main + 124
    frame #13: 0x00000001a6ad3e50 dyld`start + 2544
(lldb) 

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants