Show HN: Compress Long LLM Prompt, Right in your web browser

4 points by letaem77 8 hours ago

I tried to port LLMLingua-2's official Python implementation into TypeScript.

For best performance, open the URL with a WebGPU enabled web browser.

Learn More: https://github.com/atjsh/llmlingua-2-js