fiuP|SSKJrJrJrJr SSKrSSKJr SSKJ r J r J r SSK J r SSKJr SSKJr "SS 5rg) )DictListAnyOptionalN)RoleplayScenario)SkillAssessment SkillScoreConversationTurn) GroqService) OllamaService) JSONHandlerc\rSrSrS"SjrS\4SjrS\S\4Sjr S \ \ S \ S\ \\44S jrS \S\4S jrS\S \ S\4SjrS\ \\4S\4SjrS\ \S\S\ \4SjrS#S\S \ S \ \ S\S\S\\4 SjjrS\S \ S \ \ S\S\\4 SjrS\S\4SjrS\S\S\\4SjrS\S\ \ \\44SjrS\ \S\ \\44SjrS\ \S\4S jrS!rg)$ SkillAnalyzer NcU=(d [5UlU=(d [5Ul[ 5UlgN)r groq_servicer ollama_servicer json_handler)selfrrs I/var/www/eduai.edurigo.com/roleplay/production/services/skill_analyzer.py__init__SkillAnalyzer.__init__ s*(9KM,? 'Muse_groqc@U(a UR$UR$)z9Get the appropriate AI service based on groqRoleplay flag)rr)rrs r_get_ai_serviceSkillAnalyzer._get_ai_services$,t  E$2E2EEr score_valreturncUcg[U[5(aU$[U[5(a [U5$[U[5(aUR 5R 5nU(dgSU;a5[[UR S5SR 555$SU;aC[[UR 5R S5SR 555$[R"SU5nU(a#[[URS555$gg![[4a Nf=f![[4a Nmf=f![[4a gf=f)z.Robustly parse a score value from AI response.r/z out of z (\d+\.?\d*)) isinstanceintfloatstrstriplowersplit ValueError IndexErrorresearchgroup TypeError)rrsmatchs r _parse_scoreSkillAnalyzer._parse_scoresQ   i % %  i ' 'y> ! i % %!'')AaxuQWWS\!_%:%:%<=>> QuQWWY__Z%@%C%I%I%KLMM   .!4uU[[^455 %#J/#J/ *  s8>3E9AEE?conversation_turnsscenariocUVs/sHo3RS:XdMUPM nn[U5nSRSU55nUR5(a[UR 55OSnUS:aXu- OSnUS:aUR U5OSn UR Xb5n US:XaSn Sn OfUS:Xa U (aSn S n OTUS:XaUS :a U S :aSn S n O=US ::aUS :a U S :aSn Sn O&US::a U S:aSn Sn OUS:a U S:aSn Sn OSn Sn UU[US5U [U S 5U U S.n [SU 35 U $s snf)zp Analyze the depth and quality of the learner's participation. Returns engagement metrics and a hard score cap. learner c3T# UHoRR5v M g7fr)messager().0ts r .Is#M}!IIOO$5$5}s&(rTnoner#minimalg?g?lowg?moderateg? excellent good)learner_turn_counttotal_learner_wordsavg_words_per_turnis_only_greetingobjective_coverageengagement_levelmax_allowed_scorez$DEBUG: Conversation depth analysis: ) speakerlenjoinr(r*_is_greeting_only_estimate_objective_coverageroundprint)rr5r6r= learner_turnsrNall_learner_textrOrPrQrRrSrTdepth_analysiss r_analyze_conversation_depth)SkillAnalyzer._analyze_conversation_depth?s %7Q$6q))y:P$6 Q /88#M}#MM?O?U?U?W?Wc"2"8"8":;]^K]`aKa1FghHZ\]G]4112BCcg">>?OZ  "%  !  1 $)9(  !  1 $) 0"'(:A"> 0!2  4^4DEFaRs E E textcV^UR5R5m[R"SST5m/SQn[ TR 55nUS:ag[ U4SjU55n/SQn[ U4SjU55nUS :a US :XaUS ::ag US :aUS :ag g)z Determine whether the learner's combined text is essentially just a greeting / self-introduction with no substantive content. z[^\w\s])z>^(hi|hello|hey|good\s+(morning|afternoon|evening)|greetings)\bz\b(my name is|i am|i\'m)\s+\w+z?\b(here to help|here to assist|how can i help|how may i help)\bz*\b(nice to meet|pleased to meet|welcome)\bFc3d># UH%n[R"UT5(dM!Sv M' g7fr#Nr-r.r<pcleaneds rr>2SkillAnalyzer._is_greeting_only..s"U*;QryyG?Tqq*; 0 0)z^\b(check|verify|confirm|look into|investigate|resolve|arrange|schedule|offer|provide|ensure)\bzL\b(room|reservation|booking|account|order|issue|problem|request|complaint)\bz9\b(available|status|update|information|details|options)\bc3d># UH%n[R"UT5(dM!Sv M' g7frfrgrhs rr>rks"S(91RYYq'=RQQ(9rlr#rTrM)r)r(r-subrVr*sum)rragreeting_patterns word_countgreeting_matchesaction_indicatorsaction_matchesrjs @rrXSkillAnalyzer._is_greeting_onlyws **,$$&&&R1 ) ?U*;UU  S(9SS q ^q%8Z2=M >.!3r learner_textc^ UR5(dgUR5m URR5n[R"SU5nUVs/sH2n[ UR55S:dM"UR5PM4 nnU(dgSnUHn1SknUR 5V s/sHoU;dM [ U 5S:dMU PM n n U (dMH[ U 4SjU 55n U [S[ U 5S -5:dM{US- nM U(aU[ U5- OSn [U S 5$s snfs sn f) zv Estimate what fraction of the scenario objectives the learner's text addresses. Returns a float between 0.0 and 1.0. z[,&\n]+rFr>#aanatbebydoinisofonortoandarebutcandidforhadhasmaythewasbeendoeshavewerewillwithbeingcouldmightshallwouldshouldrBc36># UHoT;dM Sv M g7frf)r<kw learner_lowers rr>=SkillAnalyzer._estimate_objective_coverage..sJ(BM6Iaa(s  r#g333333??) r(r) objectiver-r*rVrpmaxmin)rrwr6objective_textsub_objectivesr1addressed_countsub_obj stop_wordswkeywordsmatchescoveragers @rrY*SkillAnalyzer._estimate_objective_coverages. !!##$**, "++113*n=-;R^s1779~PQ?Q)!'')^R%GCJ$+==?Y?az6IcRSfWXj?HYxJ(JJc!S]S%899#q(O&=K?S%88PS8S!!-SZs!E E = E EEr^cSUSSUSSUSSUS(aS OS S [US S -5SUSR5SUSS3$)zV Build a human-readable engagement metadata string for injection into the LLM prompt. z<--- CONVERSATION ENGAGEMENT SUMMARY --- Learner Turn Count: rNz Total Learner Words: rOz Average Words Per Turn: rPz Learner Response Type: rQz"Generic greeting/introduction ONLYzContains substantive contentz Objective Coverage: rRdz% Engagement Level: rSz Maximum Allowed Score: rTz"/10 --- END ENGAGEMENT SUMMARY ---)r%upper)rr^s r_build_engagement_metadata_text-SkillAnalyzer._build_engagement_metadata_texts ##12F#G"HI$$23H$I#JK''56J'K&LM&N\]oNp&JwU&VV##&~6J'Kc'Q#R"ST!!/0B!C!I!I!K LM&&45H&I%JK- . r skill_scoresrTc  /nUHnURn[XR5nXe:wa"[SURSUSUSUS3 5 UR [ URUUR URURS95 M U$)zw Clamp every skill score to the engagement-based maximum. Returns a new list of SkillScore objects with capped scores. zDEBUG: Score capped for 'z': u → z (max allowed: ) skill_namescoreevidence strengthsimprovement_areas) rrr[rappendr rrr)rrrT capped_scoresssoriginal_score capped_scores r_apply_score_capSkillAnalyzer._apply_score_caps  BXXN~AL-1"--NCSSXYeXffuwHvIIJKL  ==",,"$"6"6 " r session_idis_adminc # UVs/sHofRS:XdMUPM nnU(dURXX45$URX25nUSS:XaURXX45$URU5n UVs/sHnURURS.PM n nUR U5n U R UR5X5IShvN n U (dg/n URHnXS;dM U SUn[UURURSS55URS /5URS /5URS /5S 9nU RU5 M US nURU U5n U (a[SU 55[U 5- nOSn[!U[#U55nUR%U5n['SUSUSSUS35 [(R*"UUR,[/US5UU UU RS05U RS05S9n['SU35 UR0R3UR5U5(a ['S5 U$['S5 gs snfs snfGN![4a,n['SU35 SSKnUR95 SnAgSnAff=f7f)z;Perform comprehensive skill analysis on a completed sessionr8rSr@)rUr;Nskill_analysisrrrrrrrTc38# UHoRv M g7fr)r)r<rs rr>0SkillAnalyzer.analyze_session../s#J\EKK\sryzDEBUG: Final overall score: z (engagement: z, cap: rr#conversation_analysisrecommendationsr scenario_id overall_scoreperformance_levelrr5rrz1DEBUG: Attempting to save assessment for session z$DEBUG: Assessment saved successfullyz DEBUG: Failed to save assessmentz"Error processing analysis result: )rU_create_zero_assessmentr_rr;ranalyze_skillsto_dictskills_to_assessr r3getrrrprVrr&_determine_performance_levelr[r create_newrrZrsave_assessment Exception traceback print_exc)rrr6r5rrturnr\r^engagement_metadataconversation_data ai_serviceanalysis_resultrr skill_data skill_score max_allowedrr assessmenters ranalyze_sessionSkillAnalyzer.analyze_sessions +=Z*<$ PY@Y*< Z// FXc c99:LW , - 7// FXc c#BB>R+  + <<<< +  ))(3 * 9 9     1!  : L&77 1A!BB!01A!B:!NJ",#-"// w0JK!+ B!?",..b"A*4..9Lb*Q #K!'' 48))<=K00{KL ##J\#J JSQ]M^ ^ #  u[/ABM!% A A- P  0~n]oNpMqqxzEyFFGH I)33%$//#M15"3)#5&5&9&9:QSU&V / 3 34Er J J Ej\R S  001C1C1ExPP<>!!89m["  |  6qc: ; i113 sjK#JJAK##J"#6K#J' K#'J*FJ*K# J* K#* K 4"KK#K  K#c x/nURH#n[USS//S/S9nURU5 M% [R"UUR SSUU//S/S.S /S //S .S 9n[ S U35 URRUR5U5(a [ S5 U$[ S5 g)zBCreate assessment with zero scores when learner didn't participaterz1No learner responses detected in the conversationz1Participate actively in the roleplay conversationrryzNo Participationz7Complete lack of participation in the roleplay scenario)rcritical_momentsmissed_opportunitiesz-Start participating in roleplay conversationsz/Begin with simple greetings and basic responses)immediate_focuspractice_suggestionsadvanced_skillsrzIDEBUG: Creating zero assessment for non-participating learner in session z)DEBUG: Zero assessment saved successfullyz%DEBUG: Failed to save zero assessmentN) rr rrrrr[rrr) rrr6r5rrrrrs rr%SkillAnalyzer._create_zero_assessmentUs  "33J$%MN#V"W K    ,4%//! ++0%1$&)b(c# %T#T)Z([#% ( YZdYefg    , ,Z-?-?-A8 L L = ?  9 :rrc<US:agUS:agUS:agUS:agg ) z2Determine performance level based on overall scoreg"@Expertg@Advancedg@ Intermediateg@BeginnerzNeeds Improvementr)rrs rr*SkillAnalyzer._determine_performance_levels1 C  c ! c !! c !&rctURRX5nU(a[R"U5$g)zLoad an existing assessmentN)rload_assessmentr from_dict)rrrassessment_datas rrSkillAnalyzer.load_assessments/++;;JQ ",,_= =rc8URRU5$)zList all assessments)rlist_assessments)rrs rrSkillAnalyzer.list_assessmentss  11(;;r assessmentscXU(d0$0n/nUHcnURUR5 URH5nURnXb;a/X&'X&RUR5 M7 Me 0nUR 5HSuph[ [U5[U5- S5[U5US[U5S:a USUS- OSS.Xv'MU [U5[ [U5[U5- S5[U5USUURU5S.$)z7Generate summary statistics across multiple assessmentsr#r) average_score best_score latest_score improvement)total_sessionsoverall_average best_overalllatest_overallskill_breakdownperformance_trend) rrrrritemsrZrprVr_calculate_trend) rrroverall_scoresrrrskill_averagesscoress rget_skill_summarySkillAnalyzer.get_skill_summarys+I %J  ! !*":": ;)66 (33 /-/J*&--k.?.?@ 7&","2"2"4 J!&s6{S['@!!D!&k &r 9T6/?6DHcN6p*c*d*X$"$"HX$"]b$"L d38n QT T*-=RUZ^_iZj6dh``?O`+/0@+A`MP`\``ltvEmF`D+#+AQ+378H3I+UX+]efu]v+Z '% 'C '#/AZ<<d38n1E<# T/-B# tCQTH~# JtE{srr)typingrrrrr-models.scenariormodels.assessmentrr r services.groq_servicer services.ollama_servicer utils.json_handlerr rrrrr%s,,, ,KK-1*EEr