Investigations - LLM / Large Language Model

Topics related to https://en.wikipedia.org/wiki/Large_language_model

• -

All-in-One Engine+UI

• https://github.com/ParisNeo/lollms-webui

  • https://parisneo.github.io/lollms-webui/tutorials/noobs_tutorial.html

• https://github.com/oobabooga/text-generation-webui

• local Engine Server

  • https://github.com/ollama/ollama

Web UI

• https://github.com/open-webui/open-webui

Software Development

• ChatDev - https://github.com/OpenBMB/ChatDev

• AutoPR - https://github.com/irgolic/AutoPR

• https://github.com/openai/openai-assistants-quickstart

Supporting Tool/Lib

• LiteLLM - https://github.com/BerriAI/litellm/

• Ellama (LLM from Emacs) - https://github.com/s-kostyaev/ellama

Models

Models with Japanese Support

• …

• CyberAgentLM3

  • https://weel.co.jp/media/tech/cyberagentlm3-22b/

  • https://www.cyberagent.co.jp/news/detail/id=30463

  • https://gihyo.jp/article/2024/07/calm3

References

• https://note.com/npaka/n/nb97e9a0d8993

• https://github.com/danny-avila/LibreChat

  • https://github.com/danny-avila/LibreChat/issues/1131

• Dolly 2.0 - https://twitter.com/kun1em0n/status/1646356918049599488

  • https://qiita.com/taka_yayoi/items/59f0ba1a07c620a70a75

  • https://huggingface.co/databricks/dolly-v2-12b

  • https://qiita.com/riversun/items/7c45580f1a098b041528

• Vicuna-based

  • https://minigpt-4.github.io/

    • https://twitter.com/simonw/status/1647974477396054016?s=20

• LLaMA2

  • https://gigazine.net/news/20230720-llama-2-api/

• ELYZA-japanese-Llama

  • https://prtimes.jp/main/html/rd/p/000000034.000047565.html

• LLM helpers

  • https://langchain.com/

  • https://github.com/microsoft/guidance

  • https://github.com/imartinez/privateGPT

• https://twitter.com/kis/status/1686333070742568960?t=IBMI7ICMQmxTp8fDTaeMRA&s=19

• Japanese models

  • https://github.com/llm-jp/awesome-japanese-llm

  • https://twitter.com/npaka123/status/1753336604759118014?t=ySDSi8UYHf8HXIpKm0TbHg&s=19

  • HyperCLOVA LINE Japanese LLM

    • https://twitter.com/overlast/status/1649746483309330433?s=20

    • https://note.com/npaka/n/ndf326abda939

    • https://huggingface.co/line-corporation/japanese-large-lm-1.7b-instruction-sft

  • Japanese LLMs: フリーで使える日本語の主な大規模言語モデル（LLM）まとめ - https://zenn.dev/hellorusk/articles/ddee520a5e4318

  • https://note.com/retrieva/n/n7b4186dc5ada

  • Rinna

    • https://rinna.co.jp/news/2023/05/20230507.html

  • https://twitter.com/sudy_super/status/1680148471821529090?t=Vd_2mtQggcpBZsMjlKaIzA&s=19

• Helper Implementations

  • https://github.com/reworkd/AgentGPT

  • ChatDev - https://github.com/OpenBMB/ChatDev/blob/main/wiki.md

    • https://nowokay.hatenablog.com/entry/2023/09/01/132459

    • https://note.com/sumeragi_0258/n/n790d5a2721e6

• Branching Approaches of LLM-based Technologies

  • Transformer  

  • GPT

  • Bloom 

  • Megatron 

  • Deep Speed 

• Models

  • https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B

• Mistral AI + Microsoft