반응형 qa data2 [LLM][RAG][AutoRAG]AutoRAG Part2: QA set(RAGAS) AutoRAG Part2: QA set-RAGASusing RAGAS framework1. default# 1. default methodimport pandas as pdfrom autorag.data.qacreation.ragas import generate_qa_ragascorpus_df = pd.read_parquet(corpus_path)qa_df_ragas = generate_qa_ragas(corpus_df, test_size=50)2. distribution# 2. distributions methodfrom ragas.testset.evolutions import simple, reasoning, multi_context, conditionalfrom autorag.data.qacreat.. 2024. 7. 17. [LLM][RAG][AutoRAG]AutoRAG Part1: QA set AutoRAG Part1: QA setAutoRAG 준비물 중 하나인 QA data set을 만드는 것은 중요한 첫 단추Single Question and AnswerCorpus의 context를 보고 LLM이 Question 과 Answer를 생성한다https://docs.auto-rag.com/data_creation/tutorial.html#make-qa-data-from-corpus-data Start creating your own evaluation data - AutoRAG documentationPrevious Configure LLM & Embedding modelsdocs.auto-rag.com RawData 1)→ corpus 2)→ QA set 1. corpusDocs(Raw Da.. 2024. 7. 12. 이전 1 다음