Investigations - LLM / Large Language Model

Topics related to https://en.wikipedia.org/wiki/Large_language_model

• -

All-in-One Engine+UI

• https://github.com/ParisNeo/lollms-webui

  • https://parisneo.github.io/lollms-webui/tutorials/noobs_tutorial.html

• https://github.com/oobabooga/text-generation-webui

• local Engine Server

  • https://github.com/ollama/ollama

Web UI

• https://github.com/open-webui/open-webui

  • Tips

    • table {
      	text-wrap: pretty;
      }

Software Development

• ChatDev - https://github.com/OpenBMB/ChatDev

• AutoPR - https://github.com/irgolic/AutoPR

• https://github.com/openai/openai-assistants-quickstart

Supporting Tool/Lib

• LiteLLM - https://github.com/BerriAI/litellm/

• Ellama (LLM from Emacs) - https://github.com/s-kostyaev/ellama

Models

Models with Japanese Support

• …

• CyberAgentLM3

  • https://weel.co.jp/media/tech/cyberagentlm3-22b/

  • https://www.cyberagent.co.jp/news/detail/id=30463

  • https://gihyo.jp/article/2024/07/calm3

Prompt

• https://gist.github.com/philschmid/3a0ecc9e45763716f4dd9c36b6445fca#file-openai_meta-txt

Tool Calling / Function Calling

• https://ollama.com/blog/tool-support

  • https://python.langchain.com/docs/how_to/tools_prompting/

References

• https://note.com/npaka/n/nb97e9a0d8993

• https://github.com/danny-avila/LibreChat

  • https://github.com/danny-avila/LibreChat/issues/1131

• Dolly 2.0 - https://twitter.com/kun1em0n/status/1646356918049599488

  • https://qiita.com/taka_yayoi/items/59f0ba1a07c620a70a75

  • https://huggingface.co/databricks/dolly-v2-12b

  • https://qiita.com/riversun/items/7c45580f1a098b041528

• Vicuna-based

  • https://minigpt-4.github.io/

    • https://twitter.com/simonw/status/1647974477396054016?s=20

• LLaMA2

  • https://gigazine.net/news/20230720-llama-2-api/

• ELYZA-japanese-Llama

  • https://prtimes.jp/main/html/rd/p/000000034.000047565.html

• LLM helpers

  • https://langchain.com/

  • https://github.com/microsoft/guidance

  • https://github.com/imartinez/privateGPT

• https://twitter.com/kis/status/1686333070742568960?t=IBMI7ICMQmxTp8fDTaeMRA&s=19

• Japanese models

  • https://github.com/llm-jp/awesome-japanese-llm

  • https://twitter.com/npaka123/status/1753336604759118014?t=ySDSi8UYHf8HXIpKm0TbHg&s=19

  • HyperCLOVA LINE Japanese LLM

    • https://twitter.com/overlast/status/1649746483309330433?s=20

    • https://note.com/npaka/n/ndf326abda939

    • https://huggingface.co/line-corporation/japanese-large-lm-1.7b-instruction-sft

  • Japanese LLMs: フリーで使える日本語の主な大規模言語モデル（LLM）まとめ - https://zenn.dev/hellorusk/articles/ddee520a5e4318

  • https://note.com/retrieva/n/n7b4186dc5ada

  • Rinna

    • https://rinna.co.jp/news/2023/05/20230507.html

  • https://twitter.com/sudy_super/status/1680148471821529090?t=Vd_2mtQggcpBZsMjlKaIzA&s=19

• Helper Implementations

  • https://github.com/reworkd/AgentGPT

  • ChatDev - https://github.com/OpenBMB/ChatDev/blob/main/wiki.md

    • https://nowokay.hatenablog.com/entry/2023/09/01/132459

    • https://note.com/sumeragi_0258/n/n790d5a2721e6

• Branching Approaches of LLM-based Technologies

  • Transformer  

  • GPT

  • Bloom 

  • Megatron 

  • Deep Speed 

• Models

  • https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B

• Mistral AI + Microsoft

• Ollama

  • https://ollama.com/

  • https://zenn.dev/yuta_enginner/articles/b0945dea44acb3

  • https://github.com/n4ze3m/page-assist

    • https://note.com/lucas_san/n/nf00d01a02c3a