k j-N :SSKJr SSKrSSKrSSKJr SSKJrJrJrJ r J r SSK J r SSK Jr SSKJr SSKJr SS KJr SSKrSS KJr SS KJr SS KJr SS KJr SSKrSSKrSSKrSSKrSSK r \"5r!SSK"J#r#J$r$J%r%J&r&J'r'J(r( SSK)J*r*J+r+ SSK,J-r-J.r. \!R_S5S5r0"SS\5r1"SS\5r2Sr3\!RiS\1S\20S\20S.S9\ "S5\ "S5\ "S54S\5S\5S\54S jj5r6\!RiS!\1S\20S\20S.S9\ "S5\ "S5\ "S54S\5S\5S\54S"jj5r7\!RiS#\1S\20S\20S.S9\ "S5\ "S5\ "S54S\5S\5S\54S$jj5r8SSK9r9\!RiS%5\ "S5\ "S54S\5S\54S&jj5r:SS'K;J;r; "S(S)\5r<\!RiS*5\ "S5\ "S5\ "S5\ "S54S\=S+\=S\=S,\=4S-jj5r>SS.K?J?r? \!RiS/5\ "S5\ "S5\ "S5\ "S54S\=S+\=S\=S,\=4S0jj5r@SS1KAJArA \!RiS25\ "S5\ "S5\ "S5\ "S54S\=S+\=S\=S,\=4S3jj5rBSS4KCJDrD "S5S6\5rE"S7S\5r2\!RiS8\ES\20S\20S.S9\ "S5\ "S54S\5S9\54S:jj5rFSS;KGJHrHJIrIJJrJJKrKJLrL "S<S=\5rM"S>S?\5rNS@rO\!RiSA\MS\N0S\N0S.S9\ "S5\ "S5\ "S54S\5S\5S\54SBjj5rPSSCKQJQrQ "SDS)\5r<\!RiSE5\ "S5\ "S5\ "S5\ "S54S\=S+\=S\=S,\=4SFjj5r>g)G)NamedTemporaryFileN)List)FastAPI UploadFileFileFormBody) JSONResponse)Document)RecursiveCharacterTextSplitter) BaseModel)OllamaEmbeddings) AudioSegment)r) HTTPException)BytesIO)load_pdf split_text_with_semantic_chunkercount_tokens_in_documentssave_documents_to_txtcreate_and_save_embeddingsmerge_all_faiss)load_doccount_tokens_in_doc_documents)load_pptcount_tokens_in_ppt_documentsz)/helloEdurigoAiChatAndGenQuestionsTestingc SS0$)Nmessagez!Hello from edurigo_ai testing envrR/var/www/eduai.edurigo.com/question_generate/testing/question_generate_fast_api.pyhellor!s : ;;rc*\rSrSr%\\S'\\S'Srg) TrainResponse&r token_countrN__name__ __module__ __qualname____firstlineno__str__annotations__int__static_attributes__rrr r#r#& Lrr#c \rSrSr%\\S'Srg) ErrorResponse*errorrNr'r(r)r*r+r,r.rrr r1r1* Jrr1c[R"SSSU/SSS9nUR$![Ran[ SSU3S9eSnAff=f Ncurlz-kz-sT)capture_outputcheckzError fetching document:  status_codedetail subprocessrunstdoutCalledProcessErrorrurlresultes r fetch_document_with_curlrH.s\UtS 9$VZ[}}  ( (U6OPQs4STTU%(A A  Az/train_with_document_edurigo_aimodel)r;)response_model responses. client_id document_url reference_idc[RRU5SR5nUS;a [ SSS9e[ R "5n[ R "5n[ U5n[S[ R "5U- SS35 [ R "5n[R"S [RRU5SS 9nURU5 URn SSS5 [S [ R "5U- SS35 [ R "5n [W 5n [S [ R "5U - SS [U 535 [ R "5n [SS9n [X5n[S[ R "5U - SS[U535 [ R "5nSUSU3n[!UU5 [S[ R "5U- SS35 [ R "5n[#XU5 [S[ R "5U- SS35 [ R "5n[%X5n[S[ R "5U- SS35 [ R "5n['U 5n[S[ R "5U- SS35 [S[ R "5U- SS35 SUS.[RR)U 5(a[R*"U 5 $$!,(df  GNh=f![,an[ SSU3S9eSnAff=f![RR)W 5(a[R*"U 5 ff=f)N)z.pdf.txt.docx.doc.pptx.pptr;zRUnsupported file type. Only .pdf, .txt, .docx, .doc, .pptx and .ppt are supported.r<z[TIME] Download: .2fsFdeletesuffixz[TIME] Save temp file: z[TIME] Load PDF: z s | Pages: nomic-embed-textrJz[TIME] Split text: s | Chunks: temp/_z[TIME] Save text: z[TIME] Embeddings: z[TIME] Merge FAISS: z[TIME] Token count: z[TOTAL TIME]: z7Training and embedding creation completed successfully.rr%rKProcessing failed: )ospathsplitextlowerrtimerHprinttempfilerwritenamerlenrrrrrrexistsremove Exception)rNrOrPfile_extension start_totalt1document_contentt2 temp_filetemp_file_patht3docst4 embeddingssplit_documentst5 output_dirt6t7merged_embeddingst8r%rGs r process_documentr6s%WW%%l3A6<<>NOO5IJ J))+KA& YY[3LA !$))+"23!7q9:YY[  ( (bgg>N>N|>\]^>_ `dm OO, -&^^Na ' b(8'=Q?@YY[' !$))+"23!7{3t9+NOYY[%,>? :4L #DIIK"$4S#9c/FZE[\]YY[YKq7 oz: "499;#3C"8:;YY["?|L #DIIK"$4S#9;<YY[+ID $TYY[2%5c$:!<=YY[/5  $TYY[2%5c$:!<= tyy{[8=Q?@Tdop 77>>. ) ) IIn % *ca `Z O6I!4MNNO 77>>. ) ) IIn % *s>BM8'M&H%M8& M50M88 N NNN=Oz/train_with_doc_edurigo_aic[RRU5SR5nUS;a [ SSS9e[ R "5nSn[ R "5n[ U5n[S[ R "5U- SS 35 [ R "5n[R"S US 9n U RU5 U RnSSS5 [S [ R "5U- SS 35 [ R "5n [U5n [S [ R "5U - SS[U 535 U (d [ SSS9e[ R "5n [SS9n [X5n[S[ R "5U - SS[U535 [ R "5nSUSU3n[!UU5 [S[ R "5U- SS 35 [ R "5n[#XU5 [S[ R "5U- SS 35 [ R "5n[%X5 [S[ R "5U- SS 35 [ R "5n['U 5n[S[ R "5U- SS 35 [S[ R "5U- SS 35 SUS.U(a<[RR)U5(a[R*"U5 $$$!,(df  GN=f![a e[,an[ SSU3S9eSnAff=f!U(a<[RR)U5(a[R*"U5 fff=f)z.Train embeddings from DOC/DOCX document files.rR)rUrTr;z9Unsupported file type. Only .doc and .docx are supported.r<Nz[DOC] [TIME] Download: rXrYFrZz[DOC] [TIME] Save temp file: z[DOC] [TIME] Load document: s | Documents: z5No text content could be extracted from the document.r]r^z[DOC] [TIME] Split text: r_r`raz[DOC] [TIME] Save text: z[DOC] [TIME] Embeddings: z[DOC] [TIME] Merge FAISS: z[DOC] [TIME] Token count: z[DOC] [TOTAL TIME]: z@DOC/DOCX training and embedding creation completed successfully.rbrKrc)rdrerfrgrrhrHrirjrrkrlrrmrrrrrrrnrorprNrOrPrqrrrwrsrtrurvrxryrzr{r|r}r~rrrr%rGs r process_document_docrs0WW%%l3A6<<>N..4opp))+KN:& YY[3LA ' b(8'=Q?@YY[  ( (n MQZ OO, -&^^NN -diikB.>s-C1EFYY[' ,TYY[2-=c,B/RUVZR[Q\]^C8op pYY[%,>? :4L )$))+*:3)?|CP_L`KabcYY[YKq7 oz: (r)9#(>a@AYY["?|L )$))+*:3)?qABYY[ 0 *499;+;C*@BCYY[3D9  *499;+;C*@BC $TYY[;%>s$C1EF]nyz bggnn^<< IIn %=>cN MX  O6I!4MNNO bggnn^<< IIn %=>?A0M3 M!'H6M3! M0+M33N NNNAO!z/train_with_ppt_edurigo_aic[RRU5SR5nUS;a [ SSS9e[ R "5nSn[ R "5n[ U5n[S[ R "5U- SS 35 [ R "5n[R"S US 9n U RU5 U RnSSS5 [S [ R "5U- SS 35 [ R "5n [U5n [S [ R "5U - SS[U 535 U (d [ SSS9e[ R "5n [SS9n [X5n[S[ R "5U - SS[U535 [ R "5nSUSU3n[!UU5 [S[ R "5U- SS 35 [ R "5n[#XU5 [S[ R "5U- SS 35 [ R "5n[%X5 [S[ R "5U- SS 35 [ R "5n['U 5n[S[ R "5U- SS 35 [S[ R "5U- SS 35 SUS.U(a<[RR)U5(a[R*"U5 $$$!,(df  GN=f![a e[,an[ SSU3S9eSnAff=f!U(a<[RR)U5(a[R*"U5 fff=f)z2Train embeddings from PPT/PPTX presentation files.rR)rWrVr;z9Unsupported file type. Only .ppt and .pptx are supported.r<Nz[PPT] [TIME] Download: rXrYFrZz[PPT] [TIME] Save temp file: z [PPT] [TIME] Load presentation: rz9No text content could be extracted from the presentation.r]r^z[PPT] [TIME] Split text: r_r`raz[PPT] [TIME] Save text: z[PPT] [TIME] Embeddings: z[PPT] [TIME] Merge FAISS: z[PPT] [TIME] Token count: z[PPT] [TOTAL TIME]: z@PPT/PPTX training and embedding creation completed successfully.rbrKrc)rdrerfrgrrhrHrirjrrkrlrrmrrrrrrrnrorprs r process_document_pptrs0WW%%l3A6<<>N..4opp))+KN:& YY[3LA ' b(8'=Q?@YY[  ( (n MQZ OO, -&^^NN -diikB.>s-C1EFYY[' 0r1A#0FoVYZ^V_U`abC8st tYY[%,>? :4L )$))+*:3)?|CP_L`KabcYY[YKq7 oz: (r)9#(>a@AYY["?|L )$))+*:3)?qABYY[ 0 *499;+;C*@BCYY[3D9  *499;+;C*@BC $TYY[;%>s$C1EF]nyz bggnn^<< IIn %=>cN MX  O6I!4MNNO bggnn^<< IIn %=>rz/untrain_document_edurigo_aic# SU3n[RRX 5n[RRU5(aU[RR U5(a[R "U5 O[ R"U5 SS0$[SSS9e![an[S[U5S9eSnAff=f7f)Nzmy_embeddings/rzDocument untrained successfullyizDocument not foundr<rK) rdrejoinrnisfileroshutilrmtreerrpr+)rPrN local_path file_pathrGs r delete_documentrs <%i[1 GGLL: 77>>) $ $ww~~i(( )$ i(@A AC8LM M <CF;;\rSrSr%\\S'\\S'\\S'\\S'Srg)GenerateMCQRequesti/rN num_questionsrPisGPUrNr'r(r)r*r-r,r.rrr rr/N Irrz /generate_mcqrrcB# [XX#5IShvN upEXTS.$N 7f)N history_countmcqsrrNrrPrrrs r generate_mcq_endpointr5s& ,Y| [[D* 99\  generate_mcq_docz/generate_mcq_doccB# [XX#5IShvN upEXTS.$N 7f)z8Generate MCQs from trained DOC/DOCX document embeddings.Nrrrs r generate_mcq_doc_endpointr?(!1< __D* 99`rgenerate_mcq_pptz/generate_mcq_pptcB# [XX#5IShvN upEXTS.$N 7f)zNX%4abb$^$45N)'&|nD9%d+ 0 1\NK5\B .$ '9 OO, -(  B C8OP P~?_:3;?C8XY Y(9 -YKqG  K$/:$[A 77>>. ) ) IIn % 77>>/ * * IIo & +C( '8 T6I#a&4RSST 77>>. ) ) IIn % 77>>/ * * IIo & +sQAH1 *F3E>BFA6H1> F F F4F//F44F77A7H..H1generate_mcq_videoc>\rSrSr%\\S'\\S'\\S'\\S'Srg)rirNrrPrrNrrrr rrrrz/generate_mcq_videocF# [XX#5IShvN upEnXTUS.$N 7f)N)rrr%r)rNrrPrrrr%s r rrs+-? Zf-n'n$D* UU(os ! !)Rrjr tracebacktypingrfastapirrrrr fastapi.responsesr langchain_core.documentsr langchain_text_splittersr pydanticr langchain_ollamaruvicornpydubrfastapi.datastructuresriorr@rdasynciorequestsrhapptrainingrrrrrr training_docrr training_pptrrgetr!r#r1rHpostr+rrrrrrrr-rrrrrchattingrrrtraining_videorrrrrrrrrrrrr rs'99*-C--!   i__@@ 45<6<<IIU +M\cer[s|CER{SVTU&*3iT#YdhildmI&I&sI&^aI&UI&X@ &}W^`mVnv}@MvNQOP*.s)chlmphqC&CC&3C&beC&PC&LD &}W^`mVnv}@MvNQOP*.s)chlmphqC&CC&3C&beC&PC&L ().23i$s) <