2j(SSKrSSKrSSKJr SSKJr SSKJr SSKJr SSK r SSK r SSK r SSK J r SSK r Sr"SS 5r"S S 5rS rS rSrSr\S:Xa\ R*"\"55 gg)N)OllamaEmbeddings)FAISS)PromptTemplate) ChatOllama)tqdmc[SS9nSUSUS3n[RRU5(az[R"U5Vs/sHoDR S5(dMUPM nnU(a%[ R"X2SS9n[S U35 U$[S US 35 g[S US US 35 gs snf)Nznomic-embed-text)modelzmy_embeddings//z /merged_faiss)z.faissz.pklT)allow_dangerous_deserializationzEmbeddings loaded from zNo embedding files found in .z"No embeddings found for client_id z and reference_id ) rospathisdirlistdirendswithr load_localprint) client_id reference_id embeddings reference_dirfembedding_filesvectorss D/var/www/eduai.edurigo.com/question_generate/staging/generate_mcq.pyload_all_embeddingsr s!(:;J$YKqmLM ww}}]##&(jj&?b&?::N`Ca1&?b &&}bfgG +M?; <N 0qA B  29+=OP\~]^_` cs C,Cc8\rSrSrSrSrSrSrSrSr Sr g ) QuestionHistorycJSUSUS3UlUR5Ulg)Nzquestion_history/r z.json) file_pathload questions)selfrrs r__init__QuestionHistory.__init__s%,YKqeLc[RRUR5(ao[ URS5nUR 5R 5nU(a[[R"U55O [5sSSS5 $[S5 [5$!,(df  g=f![Ra& [SURS35 [5s$f=f)NrzWarning: Invalid JSON in z!. Starting with an empty history.z6No history file found. Starting with an empty history.) r rexistsr!openreadstripsetjsonloadsJSONDecodeErrorr)r$rcontents rr"QuestionHistory.load!s 77>>$.. ) ) $..#.!ffhnn.G7>3tzz'23CE/. J L5L/.'' 1$..1AAbcdu  s0CAB3 C3 C=CC7C>=C>c0[R"[RRUR5SS9 [ URS5n[ R"[UR5U5 SSS5 g!,(df  g=f)NT)exist_okw) r makedirsrdirnamer!r+r/dumplistr#)r$rs rsaveQuestionHistory.save.sT BGGOODNN3dC $..# &! IId4>>*A .' & &s +B Bc:URRU5 gN)r#addr$questions rr?QuestionHistory.add3s 8$r'cXR;$r>)r#r@s r __contains__QuestionHistory.__contains__6s>>))r'c,[UR5$r>)lenr#)r$s r__len__QuestionHistory.__len__9s4>>""r')r!r#N) __name__ __module__ __qualname____firstlineno__r%r"r;r?rDrH__static_attributes__r'rrrs % / %*#r'rc \rSrSrSrSrSrg) RateLimiter<c*XlX l/Ulgr> max_requestsperiodrequests)r$rUrVs rr%RateLimiter.__init__=s(  r'c# [R"5nURVs/sHo!U- UR:dMUPM snUl[UR5UR:aBURXRS- - nUS:a[ R "U5IShvN URR[R"55 gs snfN87f)Nr)timerWrVrGrUasynciosleepappend)r$nowreq sleep_times rwaitRateLimiter.waitBsiik(, Q sT[[9P Q t}} !2!2 2mmA.>(>?JA~mmJ/// TYY[) R0s#$C)C"C"A(C).C'/9C)rTN)rJrKrLrMr%rarNrOr'rrQrQ<s  *r'rQc# [X5nU(d[S5 /S4$[X5nUR5n[ SSS9n[ SS/SS 9ng7f) N=No embeddings found for the given client ID and reference ID.rhttp://127.0.0.1:11434 gemma3:12bbase_urlr context num_questions7 {context} Generate {num_questions} multiple-choice questions based on the provided context. Each question should include one correct answer and three plausible but incorrect options. Follow the format below: Q: A) B) C) D) Correct: Guidelines: Ensure questions are clear, relevant, and focused on key details from the context. Phrase questions concisely to avoid ambiguity. Avoid questions like "in this document" or "in this code" or " in given document" unless accompanied by specific, relevant information. Make incorrect options (distractors) credible and similar in structure or content to the correct answer, encouraging thoughtful selection. input_variablestemplate)rrr as_retrieverrr) rrjrGPUrquestion_history retrieverllm mcq_templates r generate_mcqruKsf!):G  MN1u &y?$$&I ) C""O4 LsAAcURSS5RSS5RSS5RSS5n[R"SU5n/nUGH}nUR5nU(dM[R"SU5nU(dM=USUR 5R5nU(dMg0nS HZnS U-S -n [R"X[R 5n U (a#U RS 5R5Xx'MZ O [U5S :aM[R"SU5n U (a U RS 5R5n OP[R"SU[R 5n U (a U RS 5R5n OGMhURUUU S.5 GM U$)z Robustly parses multiple-choice questions from the LLM response string. Supports bolding, different bullet styles, double newlines, and trailing spaces. z***___z3(?i)(?:^|\n)\s*(?:Q|Question)\s*(?:\d+)?\s*[:.-]\s*z(?i)(?:^|\n)\s*A[\s).:-]+N)ABCDz(?i)(?:^|\n)\s*z9[\s).:-]+(.*?)(?=\n\s*(?:[A-D][\s).:-]|Correct|Answer)|$)z:(?i)(?:Correct|Answer|Correct\s*Answer)\s*[:.-]*\s*([A-D])z'(?i)(?:Correct|Answer)\s*.*?\b([A-D])\b)rAoptionscorrect_answer) replaceresplitr-searchstartDOTALLgrouprGupperr]) response_strcleaned raw_blocksr#block opt_a_match question_textropt opt_pattern opt_match correct_matchcorrect_lettercorrect_match_fallbacks rparse_mcqs_robustlyros ""4,44S"=EEdBOWWX[]_`GPRYZJI  ii # T R5IShvN T RXS9nT RU5IShvN nURn[ U5n/nUH8nUSn U T ;dMUR U[ U5-U USUSS.5 M: U$NN_7f)N)rirjrArr)numberrArr)raformatainvoker2rr]rG)ri start_number batch_sizepromptresponserparsed_questionsr#qrArsrtrq rate_limiters rprocess_context%generate_mcq..process_contexts!!!$$W$OV,,'' .|< !A}H//  *S^; ( |&'(8&9 ""! ",s&B!B'B!B+B!//B!B!zGenerating MCQs)totaldesci,zRandom query for retrieval irAzError processing context: zWarning: Only generated z unique questions out of z requested.)rrrrorrrQrrZrGminrandomrandintinvoke page_contentr]r?update Exceptionr;)rrjrrprrrmcqsquestion_numberrpbartimeoutremaining_questionsrqueryresultsresultrinew_mcqsmcqersrtrqrs @@@@rrurusC!):G  MN1u &y?$$&I ) C""O4 L. DOBr:L& M(9 :d))+#$i-'DIIK',A"/#d)"; 0!4J1&..D2I1JKE&&u-G!t9 - -- %4Wo%ZZH't9}4ZP`9` KK,,00ZA+q0O KKN (t9 -#"$i-'DIIK',A4 t9} $ ,SYK7PQ^P__jk l; ;> %& &&% [!6qc:;+ ; :ssA4I:B*I% H'1H%2H' H'?H' I',I*I%I%H'' I 1I?II  I IIcJ# SnSnSnSn[XX#5IShvN upEU(d [S5 g[SU35 UHXn[SUSS US 35 US R5Hupx[US U35 M [S USS35 MZ gN7f)Nrichrz'No multiple-choice questions generated.zTotal questions in history: z Question rz: rArz) zCorrect Answer: r )ruritems) rrjrrpr history_countroptiontexts rmainrsIML C ,Y| XXD  78 ( 89 #h-3z?*;<= N002LF VHBtf% &3  %5!6 7r:; YsB#B!BB#__main__)r rlangchain_ollamar langchain_community.vectorstoresrlangchain_core.promptsrrrr/r[rrZrrrQrurrrJrunrOr'rrsu -21'   ##@ * *"H2h['z<$ z KKr'