MiB %SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK J r SSK Jr SSKJrJrJrJrJr SSKJr SSKJr SS KJr SS KJrJrJr SS KJ r "S S \!\ 5r"\"RFS1\"RH1Sk\"RJ1Sk\"RL1Sk\"RN1Sk0r(\\"\\!4\)S'S\S\*4Sjr+S\*S\!4Sjr,\"RLS4S\!S\"S\-S\\!\44Sjjr."SS5r/\0S :Xa\/"5r1SSKrSSK Jr \Rd"5r3\Rh"\1Rk\!"\3S!- 555r6\Rh"\1Ro55 \1Rq5r9\9Hr:\;"S"\:S#S$\:S35 M \1RyS%5r=\=(a \;"S&5 g\;"S'5 gg)(z Browser Profiler Module This module provides a dedicated class for managing browser profiles that can be used for identity-based crawling with Crawl4AI. N)Enum)Path)ListDictOptionalAnySet)Console BrowserConfig)ManagedBrowser) AsyncLoggerAsyncLoggerBaseLogColor)get_home_folderc,\rSrSrSrSrSrSrSrSr Sr g ) ShrinkLevelz%Profile shrink aggressiveness levels.nonelightmedium aggressiveminimalN) __name__ __module__ __qualname____firstlineno____doc__NONELIGHTMEDIUM AGGRESSIVEMINIMAL__static_attributes__rs/var/www/eduai.edurigo.com/storigo/production/storigo_env/lib/python3.13/site-packages/crawl4ai/browser_profiler.pyrrs/ D E FJGr'r*>CookiesHistoryNetwork Bookmarks IndexedDB PreferencesTransportSecurityWeb Data Login Data Trust Tokens Local Storage Visited LinksHistory-journalSession StorageSecure Preferencesstorage_state.jsonLogin Data For Account> r*r,r.r/r0r1r2r4r7r8r9r:>r*r,r.r/r4r9>r*r,r4r9 KEEP_PATTERNSpathreturnc.UR5(aUR5R$SnURS5H6nUR5(dMXR5R- nM8 U$![[ 4a U$f=f)z9Get total size in bytes. Works for files and directories.rr))is_filestatst_sizerglobPermissionErrorOSError)r<totalfs r( _get_sizerG<s ||~~yy{""" E CAyy{{)))! L W %  L s'B BBBncJSHnUS:a USSU3s $US-nM USS3$)z&Format bytes as human-readable string.)BKBMBGBiz.1f z TBr)rHus r( _format_sizerPJs> $ t8WAaS> ! T %WC=r'F profile_pathleveldry_runc^ U[R:Xa//S/S.$[U5nUR5(aUR 5(d[ SU35eUS- R 5(aUS- OUn[ Un//S/[U5S.nUR5HnURm [U 4SjU55(aUSRT 5 M?[U5nU(d_UR 5(a[R"U5OUR5 USRT 5 US ==U- ss'MUSRT 5 US ==U- ss'M U(d [U5OS US 'U$![a%n US RT S U 35 S n A GMS n A ff=f)aZ Shrink a Chrome profile to reduce storage while preserving auth data. Args: profile_path: Path to profile directory level: How aggressively to shrink (LIGHT/MEDIUM/AGGRESSIVE/MINIMAL) dry_run: If True, only report what would be removed Returns: Dict with 'removed', 'kept', 'bytes_freed', 'size_before', 'size_after', 'errors' r)removedkept bytes_freederrorsProfile not found: Default)rUrVrWrX size_beforec3^># UH"nTU:H=(d TRU5v M$ g7fN) startswith).0pnames r( !shrink_profile..ss&=1tqy.DOOA..s*-rVrUrWrXz: N size_after)rr!rexistsis_dir ValueErrorr;rGiterdirraanyappendshutilrmtreeunlink Exception) rQrRrSprofiletargetkeepresultitemsizeeras @r(shrink_profilervSs     r!rJJ< G >>  7>>#3#3.|n=>>&-y%8$@$@$B$BWy F  DRRXabiXj kF yy == = = 6N ! !$ 'T?D<+/;;==FMM$'dkkm9%,,T2=)T1)y!((.}%-%!!$6=9W-$F< M!<8$++tfBqcN;;%d3DKFO44%d3DK KGGLL):JG D%%5$&77<<0ACT#U #%77<<0H0HJ_#`  D,,t> ,,.CC%!jj1#c(a- ??,, yy{c) (( 2237 #'/~~) (++-/000mmC(((S NLM M N.%%"%**X"6C1%$% %61)  ##&J1#$NTW#XmmC(((  sF+DF+'EDEF+E0F+2AEF+ EE E#F+$E=E>EF+DF+ E(D;9E; E EEF+ E  EEE F( 6F#FF#F+#F((F+rc# SSKnSSKnSSKn[R R 5nSnURU5nURU5 UR[R ///S5un n U (a[R RS5n U (aU R5S:XakURRUR!U5U["R$S 9 UR'5 UbUR)XtR*U5 ggU"5IShvN (a#UbUR)XtR*U5 gg[.R0"S 5IShvN GM,![a [S5ef=f![[4a [S5ef=f!URan [SU 35eSn A ff=f![,a'n URRS U 3US 9 Sn A gSn A ff=fN![,a'n URRS U 3US 9 Sn A gSn A ff=fN![2[44a URRS US 9 UR'5 UbRUR)XtR*U5 g![,a'n URRS U 3US 9 Sn A gSn A ff=fg[,aHn URR7SU 3US 9 [.R0"S 5IShvN Sn A GMSn A ff=f!UbRUR)XtR*U5 f![,a'n URRS U 3US 9 Sn A fSn A ff=ff=f7f)z>- ,//1"*'\%%b*;*;\J(%3444"'\%%b*;*;\J("--,,,1) [YZ Z [ ( 978 8 9}} F @DE E F`!\KK%%(MaS&QWZ%[\+5*!\KK%%(MaS&QWZ%[\#-)84KK$$%B$L#'')'\%%b*;*;\J \KK%%(MaS&QWZ%[\(!KK''*KA3(OUX'Y!--,,,'\%%b*;*;\J \KK%%(MaS&QWZ%[\(sN  FFN F:L1B0I N  G (N * I 4H5 I ?N HN !I :I ;I ?L1FN F77N :G GGN  H*H N  HN I  I I=N IN  I :L.L1N  J('N ( K2KN KN  L.&6L)LL)"L1)L..L11N6MN NM?:N?NNN c ^^^^ # TRRSTS9 SSKnSSKnUR 5m U UUU4SjnUR USS9nUR 5 TR5(dT R5nUS:XaITRRTRT5T[RS 9 TR5 gU"5IShvN (ag[R"S 5IShvN TR5(dMgg!URa N^f=fNWN5![ a7n TRR#S U 3TS9 TR5 Sn A gSn A ff=f7f) z7Fallback keyboard listener using simple input() method.zTR5(dY[S5R5R5nTR U5 US:XagTR5(dMXgg![ [ 4a TR S5 g[a'nTRRSU3TS9 SnAgSnAff=f![a'nTRRSU3TS9 SnAgSnAff=f)z Thread function to handle input.zPress 'q' + Enter to quit: rzError in input thread: rNzInput thread failed: ) is_setinputstriprputrrrnrzrr) user_inputru input_queuerrrs r( input_thread6BrowserProfiler._listen_fallback..input_threadLs H)0022 %*+H%I%O%O%Q%W%W%Y # 3%,!- *0022%&78#,$ ++.EaS,Is+S H !!$9!"=3!G HsLC>A2C2!CC CC;CCC C9C44C9T)rpdaemonrrrzFallback listener failed: )rzr threadingqueueQueueThreadstartr get_nowaitrrrrEmptyrrrnr) rrrrrrrthreadrrurs `` ` @r(_listen_fallback BrowserProfiler._listen_fallbackBsg W]`a kkm  H H(!!d!C  "%,,.. !,!7!7!9J!S( (( 2237 #'/~~) (++-)/000mmC((()&,,..{{1) " KK   :1#>C  H    ! ! "sAF#D?9AD%F D?#D;$ D?-F.D?D=D?#F%D85D?7D88D?=D?? F -E;6F;FF profile_namebrowser_config shrink_levelc^^^^^^# SS/nUcSSKJn U"SSSUS 9nO:SUlUR(aURR U5 OXBlU(dU[ R R 5RS 5nS US [R"5RSS 3nSRSU55n[RRTRU5n[R"USS9 SnTR R#SSSSU30S[$R&0S9 TR R#SSSU0S[$R(0S9 TR R#SSSU0S[$R*0S9 TR R#SSS9 TR R#SSS9 TR R#SSSS 0S[$R&0S9 TR R#S!SSS"0S[$R*0S9 TR R#S#SS9 TR R#SSSUS30S[$R&0S9 SUlXrl[/UTR S$9m[0R2"[0R45m[0R2"[0R65mUUUU4S%jmU4S&jn [0R0"[0R4U 5 [0R0"[0R6U 5 [8R:"5mUUU4S'jn S(S)KJn TRA5IShvN n U "5RA5IShvN n U RBREU 5IShvN nURFS(nTRHnU(d~TR RKS*SS9 [0R0"[0R4T5 [0R0"[0R6T5 TRM5IShvN gTR R#S+SS9 [8RN"U "55nTRQ5(dWURS5cF[8RT"S,5IShvN TRQ5(dURS5cMFURW5(dURY5 UIShvN [RRUS-5nUR]US.9IShvN TR R#S/U3SS9 URc5IShvN U Re5IShvN URS5cGTRQ5(a2TR R#S1SS9 TRM5IShvN TR RgS2U3SS9 [0R0"[0R4T5 [0R0"[0R6T5 TRM5IShvN U[hRj:wa?U(a8TR R#S4URl3SS9 TRoXs5 U$GNhGNNGN.GNGNGN![8RZa GNf=fGN![^a(nTR RaS0U3SS9 SnAGNSnAff=fGNGNGNE![^anTR RKS3U<3SS9 TRM5IShvN SnA[0R0"[0R4T5 [0R0"[0R6T5 TRM5IShvN gSnAff=fGNy![0R0"[0R4T5 [0R0"[0R6T5 TRM5IShvN f=f7f)5a Creates a browser profile by launching a browser for interactive user setup and waits until the user closes it. The profile is stored in a directory that can be used later with BrowserConfig.user_data_dir. Args: profile_name (str, optional): Name for the profile directory. If None, a name is generated based on timestamp. browser_config (BrowserConfig, optional): Configuration for the browser. If None, a default configuration is used with headless=False. shrink_level (ShrinkLevel, optional): Optionally shrink profile after creation. Default is NONE (no shrinking). Returns: str: Path to the created profile directory, or None if creation failed Example: ```python profiler = BrowserProfiler() # Create a profile interactively profile_path = await profiler.create_profile( profile_name="my-login-profile" ) # Use the profile in a crawler browser_config = BrowserConfig( headless=True, use_managed_browser=True, user_data_dir=profile_path ) async with AsyncWebCrawler(config=browser_config) as crawler: # The crawler will now use your profile with all your cookies and login state result = await crawler.arun("https://example.com/dashboard") ``` z--password-store=basicz--use-mock-keychainNr r chromiumFT) browser_typeheadlessr| extra_args %Y%m%d_%H%M%Sprofile_rc3^# UH#oR5(dUS;aUOSv M% g7f)z-_rN)isalnum)r_cs r(rb1BrowserProfiler.create_profile..s#\|!IIKK19q#E|s+-r~P================================================================================{border}rborder rparamscolorsz(Creating browser profile: {profile_name}rz!Profile directory: {profile_path}rQz Instructions:rz=1. A browser window will open for you to set up your profile.z.{segment}, configure settings, etc. as needed.segmentz2. Log in to websitesz43. When you're done, {segment} to close the browser.zpress 'q' in this terminalz<4. The profile will be saved and ready to use with Crawl4AI.)rrzc># TRRSSS9 TR5IShvN [R"[RT5 [R"[R T5 U[R:Xa1TRR SSS9 [R"S5 ggN7f)N Cleaning up browser process...rrz8Profile creation interrupted. Profile may be incomplete.r rzrcleanupsignalSIGINTSIGTERMrrexitsigframemanaged_browseroriginal_sigintoriginal_sigtermrs r(cleanup_handler7BrowserProfiler.create_profile..cleanup_handlers KK   B  R!))+ + + MM&-- 9 MM&..*: ;fmm# !!"\bk!l $ ,.CCBCc>>[R"T"X55 gr]r create_taskr r rs r(sigint_handler6BrowserProfiler.create_profile..sigint_handler    ; # TRRSSSS0S[R0[RS9 UUU4SjnTR 5(aTR TUS5IShvN gTRTUS5IShvN gN!N![a]nTRRSU3SS 9 TRRS SS 9 TRTUS5IShvN SnAgSnAff=f7f) >Cross-platform keyboard listener that waits for 'q' key press.z9Press {segment} when you've finished using the browser...rr'q'rrrrc># TR(aFTRR5b+TRRSSS9 TR 5 gg7f)*Check if browser process is still running..Browser already closed. Ending input listener.rrTFbrowser_processpollrzrrr rrsr(r^BrowserProfiler.create_profile..listen_for_quit_command..check_browser_process sV$33'77<<>JKK$$Hi%$'')AAN,Platform-specific keyboard listener failed: r$Falling back to simple input mode... rzrrYELLOWCYANrrrrnrrrrur rrs r(listen_for_quit_command?BrowserProfiler.create_profile..listen_for_quit_commands KK  K!5)9hoo2N#==    _##%%..@UW`aaa++O=RT]^^^b^ _ ##&RSTRU$V\e#f   !GY W++O=RT]^^^ _mAD +B5B6B:D;BBBDBB D%A C=2C53C=8D=DDr)async_playwright Failed to start browser process.z.Browser launched. Waiting for you to finish...rr9)r<u%[PROFILE].i storage_state saved → z+[PROFILE].w failed to save storage_state: Terminating browser process...z"Browser closed. Profile saved at: zError creating profile: zShrinking profile with level: )8 async_configsr rrextenddatetimenowstrftimeuuiduuid4hexrrr<rrrzrrr*rr) user_data_dirrr getsignalrrrEventplaywright.async_apir/rrconnect_over_cdpcontextsr!rrrrr"rdonecancelCancelledError storage_staternrclosestopsuccessrr!valueshrink)rrrrportable_profile_argsr timestamprQrrr,r/cdp_urlpwbrowsercontextr! listener_task state_filerurr r rrs` @@@@@r(create_profileBrowserProfiler.create_profile~s~` % !!   ! 4*'0 N',N #(())001FG,A) ))--/88II%i[$**,2B2B2A2F1GHLww\|\\ ww||D$5$5|D  L408 H6(m;T^fhphuhu]vw C\jlx[yDRT\TbTbCc d <)UceqTr}KMUM\M\|] ^ * : X^gh IybknEbFPY[c[h[hOi j OU^hqtPhQ[dfnfufuZv w W]fg HPRm;T^fhphuhu]vw"''3$));;  !**6==9!++FNN;   =  fmm^4 fnnn5"--/ _DB , = ,1133G./5577B[[99'BBG''*G.==O" !!"D)!TX MM&-- 9 MM&..*: ;"))+ + +] KK  MS\  ]$//0G0IJM&,,..?3G3G3I3QmmC(((&,,..?3G3G3I3Q!%%''$$&''' l4HIJ f+++<<<   #H !U[d e --/ ! !'')OO##%-/2H2H2J2J   !Ay Q%--/// KK  "D\N SYb  c MM&-- 9 MM&..*: ;"))+ + + ;++ + KK  =l>P>P=QRXa  b KK 3G48Bp ,O) (-- = f ##&QRSQT$U[d#e f "  0  KK   8>I  N!))+ + + MM&-- 9 MM&..*: ;"))+ + +  , MM&-- 9 MM&..*: ;"))+ + +sMa#]1[2]["]1[2A]3Aa#["a#A4] [% *]7%][+"[(#[+' ]\ \!\ <]\>]'](A]?]!]"Aa#?_8Aa#]]]"a#%]([++\?]\]\ \;\60]6\;;]]] _51_0^_0_; Aa#)_,*a#0_55_;8a#;Aa aa  a#c[RRUR5(d/$/n[R"UR5GH~n[RR URU5n[RR U5(dMTSn[RR[RR US55(dC[RR[RR USS55(aSnOD[RR[RR US55(aSnU(dGM,[RR[RRU55nURUUUUS.5 GM URSS S 9 U$) a Lists all available browser profiles in the Crawl4AI profiles directory. Returns: list: A list of dictionaries containing profile information: [{"name": "profile_name", "path": "/path/to/profile", "created": datetime, "type": "chromium|firefox"}] Example: ```python profiler = BrowserProfiler() # List all available profiles profiles = profiler.list_profiles() for profile in profiles: print(f"Profile: {profile['name']}") print(f" Path: {profile['path']}") print(f" Created: {profile['created']}") print(f" Browser type: {profile['type']}") ``` Fr/rZrprefs.jsfirefox)rar<createdtypec US$)NrVr)xs r(/BrowserProfiler.list_profiles..sAiLr'T)rreverse) rr<rerlistdirrisdirr4 fromtimestampgetctimerjsort)rr}rarQis_validrVs r( list_profilesBrowserProfiler.list_profilespsP,ww~~d//00IJJt001D77<<(9(94@L77==.. Hww~~bggll<GHHww~~bggll<MRSS% \: FGG$x"++99GG$$\2 (&$ !12@  0$ ?r'c[RRURU5n[RR U5(d([RR U5(aUnOg[RR [RRUS55=(d [RR [RRUSS55=(d= [RR [RRUS55nU(dgU$)a Get the full path to a profile by name. Args: profile_name (str): Name of the profile (not the full path) Returns: str: Full path to the profile directory, or None if not found Example: ```python profiler = BrowserProfiler() path = profiler.get_profile_path("my-profile") if path: print(f"Profile path: {path}") else: print("Profile not found") ``` Nr/rZrT)rr<rrr^isabsre)rrrQ is_profiles r(get_profile_path BrowserProfiler.get_profile_paths*ww||D$5$5|D ww}}\**ww}}\**+  GGNN277<< mD E C GGNN277<< iO P C GGNN277<< jA B  r'profile_name_or_pathc[RRU5(aUnO*[RRURU5n[RR U5(dg[RR [RRUS55=(d [RR [RRUSS55=(d= [RR [RRUS55nU(dg[R"U5 g![a gf=f)a Delete a browser profile by name or path. Args: profile_name_or_path (str): Name of the profile or full path to profile directory Returns: bool: True if the profile was deleted successfully, False otherwise Example: ```python profiler = BrowserProfiler() # Delete by name success = profiler.delete_profile("my-profile") # Delete by path success = profiler.delete_profile("/path/to/.crawl4ai/profiles/my-profile") ``` Fr/rZrTT) rr<rfrrr^rerkrlrn)rrjrQrgs r(delete_profileBrowserProfiler.delete_profiles, 77==- . ./L77<<(9(9;OPLww}}\** GGNN277<< mD E C GGNN277<< iO P C GGNN277<< jA B    MM, '  sE E*)E*FrRrSc [RRU5(aUnO*[RRURU5n[RR U5(d[ SU35e[XBU5nU(aSOSnURRUS[US5S[US5S[US 5S 3S S 9 U$) aY Shrink a profile to reduce storage while preserving authentication data. Args: profile_name_or_path: Profile name or full path level: LIGHT, MEDIUM, AGGRESSIVE (default), or MINIMAL dry_run: If True, only preview what would be removed Returns: Dict with 'removed', 'kept', 'bytes_freed', 'size_before', 'size_after', 'errors' rYz Would freeFreedrNrWz (rUz items removed, rVz kept)SHRINKr) rr<rfrrr^rgrvrzrrPr)rrjrRrSrQrractions r(rHBrowserProfiler.shrink s$ 77==- . ./L77<<(9(9;OPLww}}\**23G2HIJ J W=!(g ha VM%:;<=F9%&''7F6N8K7LF T   r'cf # URRSSS9 URRSS[RS9 URRSS[RS9 URRSS[R S9 U(aUURRSS[R S9 URRS S[RS9 S nO+URRS S[RS9 S nURRS US3SS9 [5nUS:XaHURRSSS9 [5nURU=(d S5IShvN GOUS:XGa"UR5nU(dURRSSS9 GMURRSSS9 [U5HupgURRSUS-SUS3SS9 URRSUS3S[RS9 URRSUSRS 53SS9 URRS!US"3SS9 URRSSS9 M GOUS#:XGaUR5nU(dURRS$SS9 GMURRSS[RS9 [U5H+upgURRSUS-SUS3SS9 M- URRS%SS9 [5nUR!5S&:XaGM[#U5S- n S'U s=::a[%U5:aO OXYSn URRS(U S)3SS9 URRS*SS9 [5n U R!5S+:XaZUR'XYS5n U (a URR)S,U S-3SS9 GOURR+S.U 3SS9 GOURR+S/SS9 GOUS :XGa{U(GasUR5nU(dURRS1SS9 GMURRSS[RS9 [U5H+upgURRSUS-SUS3SS9 M- URRS2SS9 [5nUR!5S&:XaGMs[#U5S- n S'U s=::a[%U5:aaO O^XYSn URRS3SS9 [5nU(aU"X5IShvN OtURR+S4S5S9 OYURR+S/SS9 O>X2:XaURRS6SS9 gURR+S7US83SS9 GMTGN![,a URR+S0SS9 N,f=fN![,a URR+S0SS9 NXf=f7f)9aa Launch an interactive profile management console. Args: crawl_callback (callable, optional): Function to call when selecting option to use a profile for crawling. It will be called with (profile_path, url). Example: ```python profiler = BrowserProfiler() # Define a custom crawl function async def my_crawl_function(profile_path, url): print(f"Crawling {url} with profile {profile_path}") # Implement your crawling logic here # Start interactive manager await profiler.interactive_manager(crawl_callback=my_crawl_function) ``` z Profile Management Options:MENUrz1. Create a new profilerz2. List available profilesz3. Delete a profilez#4. Use a profile to crawl a websitez5. Exit5z4. Exit4z [cyan]Enter your choice (1-z ): [/cyan]r)end1zZ[green]Enter a name for the new profile (or press Enter for auto-generated name): [/green]N2z4 No profiles found. Create one first with option 1.PROFILESz Available profiles:[r z] raz Path: r<z Created: rVz%Y-%m-%d %H:%M:%Sz Browser type: rW3zNo profiles found to deletezI[red]Enter the number of the profile to delete (or 'c' to cancel): [/red]rrzDeleting profile: [yellow]z [/yellow]z@[red]Are you sure you want to delete this profile? (y/n): [/red]yzProfile z deleted successfullyzFailed to delete profile zInvalid profile numberzPlease enter a valid numberz$No profiles found. Create one first.zH[cyan]Enter the number of the profile to use (or 'c' to cancel): [/cyan]z%[cyan]Enter the URL to crawl: [/cyan]zNo URL providedCRAWLzExiting profile managementz4Invalid choice. Please enter a number between 1 and .)rzrrrr)REDr*MAGENTArrprintrQrcr enumerater6rintrrlrFrrg)rcrawl_callback exit_optionchoicerar}iro profile_idxidxrconfirmrFrQurls r(interactive_manager#BrowserProfiler.interactive_manager1sZ* KK  <&  I KK  6Fx~~  ^ KK  9vRZRaRa  b KK  28<<  X   !FF_g_l_l m   8CSCS T!    8CSCS T! KK  <[MTZ\  ]WF} ""#FH"Iw))$,$7773--/KK''(^dn'o   !8j I"+H"5JAKK$$q1R/@%Az$RKK$$z'&/1B%C`h`o`o$pKK$$}WY5G5P5PQd5e4f%gmw$xKK$$'9'&/9J%KQ[$\KK$$RZ$8 #63--/KK''(E:'V   !8jU]UdUd e"+H"5JAKK$$q1R/@%Az$R#6 ""#ntv"w#g $$&#-Uk*Q.CC/#h-/'/}V'<  ((+El^S\)]cm(n **+msu*v"''"==?c1&*&9&9(-:O&PG& $ 3 3h|nLa4bhr 3 s $ 1 14Ml^2\bl 1 m ))*B )S3>--/KK''(NT^'_   !8jU]UdUd e"+H"5JAKK$$q1R/@%Az$R#6 ""#msu"v#g $$&#-Uk*Q.CC/#h-/'/}V'<  **+RXZ*[#g"0"CCC KK--.?W-M ))*B )S&   !=6 J !!$XYdXeef"gms!tq,8n"UKK%%&C%TU:D "UKK%%&C%TUsF Z1YHZ1B?YZ1Y7Z19YC#Z17A$ZZZ Z1!Z;Z1<ZAZ1$Z?Z1ZZ1Z$Z.+Z1-Z..Z1rr:debugging_portrsave_as_builtinc^^^^^^# U(aUn[R"USS9 O[RR5R S5nSUS[ R "5RSS3n[RRTRU5n[R"USS9 Sn TRRS S S U 0S [R0S 9 TRRS S S9 TRRSS SU0S[R0S 9 TRRSS SU0S[R0S 9 TRRSU3S S9 TRRSU3S S9 [!UUUUSS9n [#U UUTRUS9m[$R&"[$R(5m[$R&"[$R*5mUUUU4SjmU4Sjn [$R$"[$R(U 5 [$R$"[$R*U 5 [,R."5mUUU4Sjn U4Sjn SnSnTR15IShvN TR2nU(d~TRR5SS S9 [$R$"[$R(T5 [$R$"[$R*T5 TR75IShvN gTRRSS S9 U "U5IShvN upU(aTRR9SU3S S9 U(aTRRSUR;SS 53S S[R0S!9 TRRS"UR;S#S 53S S#[R0S!9 S$U;a1TRRS%S S$US$0S$[R<0S 9 OTRR?S&S S9 OTRR5S'U3S S9 TR75IShvN [$R$"[$R(T5 [$R$"[$R*T5 TR75IShvN g[,R@"U "55nTRC5(dWURE5cF[,RF"S(5IShvN TRC5(dURE5cMFURI5(dURK5 UIShvN URE5cGTRC5(a2TRRS)S S9 TR75IShvN TRR9S*S S9 [$R$"[$R(T5 [$R$"[$R*T5 TR75IShvN U$GNGNVGN.GNGNGNCN![,RLa GNf=fN![NanTRR5S+[QU53S S9 TR75IShvN SnA[$R$"[$R(T5 [$R$"[$R*T5 TR75IShvN gSnAff=fN![$R$"[$R(T5 [$R$"[$R*T5 TR75IShvN f=f7f),a Launch a standalone browser with CDP debugging enabled and keep it running until the user presses 'q'. Returns and displays the CDP URL. Args: browser_type (str): Type of browser to launch ('chromium' or 'firefox') user_data_dir (str, optional): Path to user profile directory debugging_port (int): Port to use for CDP debugging headless (bool): Whether to run in headless mode Returns: str: CDP URL for the browser, or None if launch failed Example: ```python profiler = BrowserProfiler() cdp_url = await profiler.launch_standalone_browser( user_data_dir="/path/to/profile", debugging_port=9222 ) # Use cdp_url to connect to the browser ``` Tr~rtemp_rNrrrrrrz/Launching standalone browser with CDP debuggingrzBrowser type: {browser_type}rzProfile path: {profile_path}rQzDebugging port: zHeadless mode: )rrr:rr|)rr:rrzrc># TRRSSS9 TR5IShvN [R"[RT5 [R"[R T5 U[R:Xa1TRR SSS9 [R"S5 ggN7f)NrrrzBrowser terminated by user.r rr s r(rBBrowserProfiler.launch_standalone_browser..cleanup_handler s KK   B  N!))+ + + MM&-- 9 MM&..*: ;fmm# !!"?U!K $ ,rc>>[R"T"X55 gr]rrs r(rABrowserProfiler.launch_standalone_browser..sigint_handlerrr'c># TRRSSSS0S[R0[RS9 UUU4SjnTR 5(aTR TUS5IShvN gTRTUS5IShvN gN!N![a]nTRRSU3SS 9 TRRS SS 9 TRTUS5IShvN SnAgSnAff=f7f) rz/Press {segment} to stop the browser and exit...rrrrc># TR(aFTRR5b+TRRSSS9 TR 5 gg7f)rrrrTFr r#sr(riBrowserProfiler.launch_standalone_browser..listen_for_quit_command..check_browser_process(sN"227V7V7[7[7]7iKK$$%U[`$a#'')r%Nr&rr'r(r+s r(r,JBrowserProfiler.launch_standalone_browser..listen_for_quit_commands KK  A!5)9hoo2N#==    [##%%..@UW\]]]++O=RTYZZZ^Z [ ##&RSTRU$V\a#b   !GU S++O=RTYZZZ [r.c ># SSKnSU3nUS3nUR5IShvN n[S5HnURU5IShvN nURS:Xa?UR 5IShvN nX'4sSSS5IShvN s sSSS5IShvN $SSS5IShvN [R"S5IShvN M US4sSSS5IShvN $NNNvNeNTNE!,IShvN (df  NZ=f![ a Nif=fNSN=!,IShvN (df  g=f![ a4nT RRS[U53SS 9 US4sSnA$SnAff=f7f) Nrhttp://localhost: /json/version rzError fetching CDP JSON: rr) aiohttp ClientSessionrangegetstatusjsonrnrrrzrstr) portrrKjson_urlsessionrresponsedatarurs r( get_cdp_json?BrowserProfiler.launch_standalone_browser..get_cdp_json<sE )$0G!-0H %"0022g"2Y!'.{{8'<'<#+??c#919+@D+2=(='<'< 322(='<&mmC000'#D=322(=+@(= 3(='<'<'< )! !13222 % !!$=c!fX"FE!R}$ %sVFD?C+D?D%DC- D$C78C/ 9C7? D C1 DD% D?C3D?#F$ D/C50D4D% D! D% D?%D#&D?*F+D?-D/C71D3D?5D7D =D> D D D%D DD%DD%#D?%D<+D. , D<8D?;F<D?? E= )E82E=3F8E==Fr0zBR"SY^!_%--///< MM&-- 9 MM&..*: ;"))+ + +?$//0G0IJM&,,..?3G3G3I3QmmC(((&,,..?3G3G3I3Q!%%''$$&''' ##%-/2H2H2J2J   !Au M%--/// KK   1u  = MM&-- 9 MM&..*: ;"))+ + +A *z ,e$F0F ,7) (-- 0  KK   DSVHMSX  Y!))+ + + MM&-- 9 MM&..*: ;"))+ + +  , MM&-- 9 MM&..*: ;"))+ + +sLJ_ Z1Z1Z1A_-Z._3%Z1ZD0Z1 Z  Z1A_,Z -_2AZ1 Z *Z19%Z1Z$Z%Z)AZ1<Z/=Z1A_9]*:_Z1_Z1 Z1 _Z1ZZ,(Z1+Z,,Z11 ]';9]"4[75]":],>A_]_"]''],*_,A_ _  __c # UR5nU(aPURURS55(a+URR SSS9 URS5$[ R RURS5n[ R"USS9 [UUUURUS 9nUR5IS hvN URnU(dURRS SS9 g S U3nS S Kn US3n S n U R5IS hvN n [!S5Hn U RU 5IS hvN nUR"S:Xa+UR%5IS hvN n S S S 5IS hvN O2S S S 5IS hvN [(R*"S5IS hvN M S S S 5IS hvN UR0UUUU[2R2"5U S.n[5UR6S5n[$R8"UUSS9 S S S 5 S Ul URR;SU3SS9 U$GNGN0GN NNN!,IS hvN (df  N=f![&a Nf=fNN!,IS hvN (df  N=f![&a1nURR-S[/U53SS9 S nAGNS nAff=f!,(df  N=f![&aPnURRS[/U53SS9 U(aUR=5IS hvN S nAg S nAff=f7f)aM Launch a browser in the background for use as the builtin browser. Args: browser_type (str): Type of browser to launch ('chromium' or 'firefox') debugging_port (int): Port to use for CDP debugging headless (bool): Whether to run in headless mode Returns: str: CDP URL for the browser, or None if launch failed pidz"Builtin browser is already runningBUILTINrrK user_dataTr~)rr:rrzrNr0rrrrrrzCould not verify browser: )rrKr:rr start_timeconfigw)indentz%Builtin browser launched at CDP URL: z!Error launching builtin browser: )get_builtin_browser_info_is_browser_runningrrzrrr<rrrrrr!rrrrrrrnrrrrrtimeopenrdumprFr)rrrr browser_infor:r r!rKrrrrrrrurFs r(launch_builtin_browser&BrowserProfiler.launch_builtin_browsers 446 D44\5E5Ee5LMM KK  Ay  Q##I. . T%=%={K  MD1)%';;)  : !'') ) ).==O" !!"D)!T*.)9:G !-0HK Z"0022g"2Y!'.{{8'<'<#+??c#98@ 2GK$)(='<'<'<'< &mmC000'32'**"!. ,"0"iik%Ld..4 ,!45 /3O + KK  "Gy QW`  aNe *"3(=2G(='<'<'< )! !03222 Z ##&@Q$Iy#Y Z54  KK   A#a&JPY  Z%--///  sB>MK?I1K?MK?J0,I-J00JJI J$I(=I" >I( JI$JJ J I&!J%J>J?J J0JJ0=K?K.+-K?MK?J0J"I($J&J(I? .I1/ I? ;J>J?J J JJJJ0J-J  J-)J0,K?-J00 K+:&K& K?&K++K?. K<8K?? M AM M  MMMMc[RRUR5(dg[ URS5n[ R "U5nSSS5 URWRS55(dURRSSS9 gU$!,(df  NP=f![a0nURRS[U53SS9 SnAgSnAff=f)z Get information about the builtin browser. Returns: dict: Browser information or None if no builtin browser is configured NrrzBuiltin browser is not runningrrz&Error reading builtin browser config: )rr<rerrrloadrrrzrrnrr)rrFrrus r(r(BrowserProfiler.get_builtin_browser_infosww~~d6677 d..4#yy| 5++L,<,>11Q"OW=  sAA*A**BBc# UR5nU(dURRSSS9 gURS5nU(dg[R S:Xa#[ R"SSS [U5/S S 9 O[R"U[R5 [S 5H9nURU5(d OG[R "S 5IShvN M; [R"U[R"5 [R$R'UR(5(a [R*"UR(5 URR-SSS9 g N![.a0nURR1S[U53SS9 SnAgSnAff=f7f)zo Kill the builtin browser if it's running. Returns: bool: True if the browser was killed, False otherwise zNo builtin browser foundrrFrrtaskkillz/Fz/PIDT)checkrNzBuiltin browser terminatedzError killing builtin browser: )rrzrrrrrrrrrrrrrrrSIGKILLr<rerrmrFrnr)rrrrrus r(kill_builtin_browser$BrowserProfiler.kill_builtin_browser#sS446  KK   :  Ju% ||w& D&#c(C4PV^^,qA33C88!--,,," GGC0ww~~d6677 $223 KK   <)  L-  KK   ?AxHi  X sDA GBF*F+BFGF F= &F83G8F==Gcn# UR5nU(dSSSS.$SURS5US.$7f)z Get status information about the builtin browser. Returns: dict: Status information with running, cdp_url, and info fields FN)runningrKrTrK)rr)rrs r(get_builtin_browser_status*BrowserProfiler.get_builtin_browser_statusKsK446   #'' 2   s35)rrrrzrr])rN$FF)rrT)(rrrrr rrrboolrrrrrrrr<rrrr!r rQrrrrcrhrlr$rHrrrrrrrrr&rr'r(rxrxsh =x8=8JTJ(4(040(S(S(6QT6pD\'--D\]`D\L:"gmm:"ad:"|'+26$/$4$4 psmp!/p" p # pd=tDcN3=~)S)Xc])V03040j)33 #!## # c3h #JMu`7AAE8<38:? Y03Y19#Y36Y-1 Y 48 Y EMSM Yx6@7;26\/2\14\,0\*B0x}$&D&P $sCx. r'rx__main__z.crawl4ai/profiles/test-profilez Profile: raz, Path: z my-profilezProfile deleted successfullyzFailed to delete profile)>r rrrrr4r7rkrrrenumrpathlibrtypingrrrrr rich.consoler r2r browser_managerr async_loggerrrrutilsrrrr!r"r#r$r%r;__annotations__rrGrPrrvrxrprofilerhomehome_dirrrQrQrrcr}rorrlrFrr'r(rs    11 (+@@"#tse  uV. tKS)*$ D S CC%//00 00 #s(^ 0fY Y x& z Hyy{H;;x66HGh