LLMops

다양한 LLMops에 관한 자료를 수집합니다.

📜 Reference

• ScatterLab - A/B 테스트를 위한 구조설계

  • https://tech.scatterlab.co.kr/serving-architecture-1/

• ScatterLab - ArgoCD와 모델 서빙

  • https://tech.scatterlab.co.kr/serving-architecture-2/

• HyperCLOVA 서빙 프레임워크 선정

  • https://engineering.clova.ai/posts/2022/01/hyperclova-part-1

• NSML : 분산학습 플랫폼의 스케줄링 요구사항

  • https://engineering.clova.ai/posts/2022/08/nsml-scheduler-part-1

• vLLM OpenSource

  • https://blog.vllm.ai/2023/06/20/vllm.html

• Ray OpenSource

  • https://www.ray.io/

• 로컬LLM에서 K8sGPT로 쿠버네티스 AIOps 실행하기

  • https://yozm.wishket.com/magazine/detail/2515/

• WandDB

  • https://docs.wandb.ai/ko/guides

• Dify OpenSource

  • https://github.com/langgenius/dify

• LangFlow OpenSource

  • https://github.com/langflow-ai/langflow

• LangGraph Quick Start

  • https://langchain-ai.github.io/langgraph/tutorials/introduction/

• 최대 24배 빠른 vLLM의 비밀 파헤치기

  • https://tech.scatterlab.co.kr/vllm-implementation-details/

• Langchain Tutorial (Korean)

  • https://wikidocs.net/book/14314

• Langchain OpenTutorial (Global)

  • https://github.com/LangChain-OpenTutorial