Skip to content

LLM output regression from #857 building with Emscripten #885

@brendandahl

Description

@brendandahl

After #857, I now get gibberish from the llm output when using emscripten to build gemma.cpp.

To build you'll need emsdk and apply my patches from #833.

emcmake cmake -DCMAKE_POLICY_VERSION_MINIMUM=3.5 -B build-wasm
make -j -C build-wasm
node build-wasm/gemma.js --weights 270m-sfp-it.sbs --max_generated_tokens 100 --prompt "Why is the sky blue?"

Previous output: Something about rayleigh scattering...
New output: áis собой Росії3atayavisフレックスateur choice...

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions